2023-10-18T12:02:34.520 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-18T12:02:34.521 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_dparmar@teuthology --archive /home/teuthworker/archive/dparmar-2023-10-18_11:50:16-fs:functional-wip-63105-distro-default-smithi/7431514 --description fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-recovery} --name dparmar-2023-10-18_11:50:16-fs:functional-wip-63105-distro-default-smithi --verbose -- /home/teuthworker/archive/dparmar-2023-10-18_11:50:16-fs:functional-wip-63105-distro-default-smithi/7431514/orig.config.yaml 2023-10-18T12:02:34.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T12:02:34.645 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/dparmar-2023-10-18_11:50:16-fs:functional-wip-63105-distro-default-smithi/7431514 branch: wip-63105 description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-recovery} email: null first_in_suite: false job_id: '7431514' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: dparmar-2023-10-18_11:50:16-fs:functional-wip-63105-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-63105 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - evicting unresponsive client - but it is still running - slow request - MDS_CLIENT_LATE_RELEASE - t responding to mclientcaps - file system flag refuse_client_session is set - Degraded data redundancy - MDS_CLIENTS_LAGGY - Reduced data availability sha1: 6f3e6b48891b9b50415c0822b6b870797fcda16d ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 6f3e6b48891b9b50415c0822b6b870797fcda16d kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-63105 sha1: cbffa2410012c3070b383ae678737c8b7a571026 owner: scheduled_dparmar@teuthology priority: 55 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 2633 sha1: 6f3e6b48891b9b50415c0822b6b870797fcda16d sleep_before_teardown: 0 suite: fs:functional suite_branch: wip-63105 suite_path: /home/teuthworker/src/github.com_dparmar18_ceph_cbffa2410012c3070b383ae678737c8b7a571026/qa suite_relpath: qa suite_repo: https://github.com/dparmar18/ceph suite_sha1: cbffa2410012c3070b383ae678737c8b7a571026 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi114.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi172.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_client_recovery teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 202b180cb047e798fb131047314a862593f45403 timestamp: 2023-10-18_11:50:16 tube: smithi user: dparmar verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-18T12:02:34.645 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_dparmar18_ceph_cbffa2410012c3070b383ae678737c8b7a571026/qa; will attempt to use it 2023-10-18T12:02:34.646 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_dparmar18_ceph_cbffa2410012c3070b383ae678737c8b7a571026/qa/tasks 2023-10-18T12:02:34.646 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-18T12:02:34.648 INFO:teuthology.task.internal:Checking packages... 2023-10-18T12:02:34.673 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '6f3e6b48891b9b50415c0822b6b870797fcda16d' 2023-10-18T12:02:34.673 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-18T12:02:34.673 INFO:teuthology.packaging:ref: None 2023-10-18T12:02:34.674 INFO:teuthology.packaging:tag: None 2023-10-18T12:02:34.674 INFO:teuthology.packaging:branch: wip-63105 2023-10-18T12:02:34.674 INFO:teuthology.packaging:sha1: 6f3e6b48891b9b50415c0822b6b870797fcda16d 2023-10-18T12:02:34.675 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-63105 2023-10-18T12:02:34.840 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-5610-g6f3e6b48-1focal 2023-10-18T12:02:34.841 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-18T12:02:34.848 INFO:teuthology.task.internal:no buildpackages task found 2023-10-18T12:02:34.848 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-18T12:02:34.854 INFO:teuthology.task.internal:Saving configuration 2023-10-18T12:02:34.870 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-18T12:02:34.876 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-18T12:02:34.902 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi114.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-10-18_11:50:16-fs:functional-wip-63105-distro-default-smithi/7431514', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-18 11:56:19.502721', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-10-18T12:02:34.927 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-10-18_11:50:16-fs:functional-wip-63105-distro-default-smithi/7431514', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-18 11:56:19.504155', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-10-18T12:02:34.928 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-18T12:02:34.934 INFO:teuthology.task.internal:roles: ubuntu@smithi114.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-18T12:02:34.934 INFO:teuthology.task.internal:roles: ubuntu@smithi172.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-18T12:02:34.934 INFO:teuthology.run_tasks:Running task console_log... 2023-10-18T12:02:35.004 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f14950e8af0>, signals=[15]) 2023-10-18T12:02:35.005 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-18T12:02:35.011 INFO:teuthology.task.internal:Opening connections... 2023-10-18T12:02:35.012 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi114.front.sepia.ceph.com 2023-10-18T12:02:35.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T12:02:35.063 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi172.front.sepia.ceph.com 2023-10-18T12:02:35.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T12:02:35.112 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-18T12:02:35.119 DEBUG:teuthology.orchestra.run.smithi114:> uname -m 2023-10-18T12:02:35.139 INFO:teuthology.orchestra.run.smithi114.stdout:x86_64 2023-10-18T12:02:35.139 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release 2023-10-18T12:02:35.187 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="Ubuntu" 2023-10-18T12:02:35.188 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-18T12:02:35.188 INFO:teuthology.orchestra.run.smithi114.stdout:ID=ubuntu 2023-10-18T12:02:35.188 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE=debian 2023-10-18T12:02:35.188 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-18T12:02:35.189 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="20.04" 2023-10-18T12:02:35.189 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-18T12:02:35.189 INFO:teuthology.orchestra.run.smithi114.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-18T12:02:35.189 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-18T12:02:35.189 INFO:teuthology.orchestra.run.smithi114.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-18T12:02:35.190 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_CODENAME=focal 2023-10-18T12:02:35.190 INFO:teuthology.orchestra.run.smithi114.stdout:UBUNTU_CODENAME=focal 2023-10-18T12:02:35.191 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2023-10-18T12:02:35.211 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2023-10-18T12:02:35.218 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2023-10-18T12:02:35.218 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2023-10-18T12:02:35.225 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="Ubuntu" 2023-10-18T12:02:35.225 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-18T12:02:35.225 INFO:teuthology.orchestra.run.smithi172.stdout:ID=ubuntu 2023-10-18T12:02:35.225 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE=debian 2023-10-18T12:02:35.226 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-18T12:02:35.226 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="20.04" 2023-10-18T12:02:35.226 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-18T12:02:35.226 INFO:teuthology.orchestra.run.smithi172.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-18T12:02:35.226 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-18T12:02:35.227 INFO:teuthology.orchestra.run.smithi172.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-18T12:02:35.227 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_CODENAME=focal 2023-10-18T12:02:35.227 INFO:teuthology.orchestra.run.smithi172.stdout:UBUNTU_CODENAME=focal 2023-10-18T12:02:35.227 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2023-10-18T12:02:35.244 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-18T12:02:35.254 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-18T12:02:35.268 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-18T12:02:35.268 DEBUG:teuthology.orchestra.run.smithi114:> test '!' -e /home/ubuntu/cephtest 2023-10-18T12:02:35.271 DEBUG:teuthology.orchestra.run.smithi172:> test '!' -e /home/ubuntu/cephtest 2023-10-18T12:02:35.276 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-18T12:02:35.282 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-18T12:02:35.282 DEBUG:teuthology.orchestra.run.smithi114:> test -z $(ls -A /var/lib/ceph) 2023-10-18T12:02:35.319 DEBUG:teuthology.orchestra.run.smithi172:> test -z $(ls -A /var/lib/ceph) 2023-10-18T12:02:35.339 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-18T12:02:35.392 INFO:teuthology.run_tasks:Running task kernel... 2023-10-18T12:02:35.407 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-10-18T12:02:35.408 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-10-18T12:02:35.408 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-10-18T12:02:35.409 DEBUG:teuthology.orchestra.run.smithi114:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-18T12:02:35.409 DEBUG:teuthology.orchestra.run.smithi172:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-18T12:02:35.414 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T12:02:35.415 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=testing 2023-10-18T12:02:35.418 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T12:02:35.419 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=testing 2023-10-18T12:02:35.587 DEBUG:teuthology.task.kernel:sha1 for client.1 is 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-18T12:02:35.587 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "47672119149b103ec7cec2cc65c063ccbb001ac7"... 2023-10-18T12:02:35.587 DEBUG:teuthology.orchestra.run.smithi172:> uname -r 2023-10-18T12:02:35.594 INFO:teuthology.orchestra.run.smithi172.stdout:5.4.0-124-generic 2023-10-18T12:02:35.594 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-18T12:02:35.595 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-18T12:02:35.595 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2023-10-18T12:02:35.595 DEBUG:teuthology.orchestra.run.smithi172:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-10-18T12:02:35.617 INFO:teuthology.orchestra.run.smithi172.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2023-10-18T12:02:35.708 DEBUG:teuthology.task.kernel:sha1 for client.0 is 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-18T12:02:35.708 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "47672119149b103ec7cec2cc65c063ccbb001ac7"... 2023-10-18T12:02:35.709 DEBUG:teuthology.orchestra.run.smithi114:> uname -r 2023-10-18T12:02:35.715 INFO:teuthology.orchestra.run.smithi114.stdout:5.4.0-124-generic 2023-10-18T12:02:35.716 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-18T12:02:35.716 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-18T12:02:35.716 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2023-10-18T12:02:35.716 DEBUG:teuthology.orchestra.run.smithi114:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-10-18T12:02:35.729 INFO:teuthology.orchestra.run.smithi172.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-10-18T12:02:35.731 DEBUG:teuthology.orchestra.run.smithi172:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-10-18T12:02:35.760 DEBUG:teuthology.orchestra.run.smithi172:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-10-18T12:02:35.776 INFO:teuthology.orchestra.run.smithi114.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2023-10-18T12:02:35.821 DEBUG:teuthology.orchestra.run.smithi172:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-10-18T12:02:35.901 INFO:teuthology.orchestra.run.smithi114.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-10-18T12:02:35.903 DEBUG:teuthology.orchestra.run.smithi114:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-10-18T12:02:35.941 DEBUG:teuthology.orchestra.run.smithi114:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-10-18T12:02:35.958 DEBUG:teuthology.orchestra.run.smithi114:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-10-18T12:03:24.067 INFO:teuthology.orchestra.run.smithi114.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-10-18T12:03:24.067 INFO:teuthology.orchestra.run.smithi114.stderr: * [new branch] main -> origin/main 2023-10-18T12:03:24.125 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20190312 -> 20190312 2023-10-18T12:03:24.125 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20190416 -> 20190416 2023-10-18T12:03:24.125 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20190514 -> 20190514 2023-10-18T12:03:24.126 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20190618 -> 20190618 2023-10-18T12:03:24.126 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20190717 -> 20190717 2023-10-18T12:03:24.126 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20190815 -> 20190815 2023-10-18T12:03:24.126 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20190923 -> 20190923 2023-10-18T12:03:24.126 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20191022 -> 20191022 2023-10-18T12:03:24.127 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20191215 -> 20191215 2023-10-18T12:03:24.127 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20200122 -> 20200122 2023-10-18T12:03:24.127 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20200316 -> 20200316 2023-10-18T12:03:24.127 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20200421 -> 20200421 2023-10-18T12:03:24.127 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20200519 -> 20200519 2023-10-18T12:03:24.128 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20200619 -> 20200619 2023-10-18T12:03:24.128 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20200721 -> 20200721 2023-10-18T12:03:24.129 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20200817 -> 20200817 2023-10-18T12:03:24.129 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20200918 -> 20200918 2023-10-18T12:03:24.129 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20201022 -> 20201022 2023-10-18T12:03:24.130 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20201118 -> 20201118 2023-10-18T12:03:24.130 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20201218 -> 20201218 2023-10-18T12:03:24.130 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20210208 -> 20210208 2023-10-18T12:03:24.130 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20210315 -> 20210315 2023-10-18T12:03:24.130 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20210511 -> 20210511 2023-10-18T12:03:24.131 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20210716 -> 20210716 2023-10-18T12:03:24.131 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20210818 -> 20210818 2023-10-18T12:03:24.133 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20210919 -> 20210919 2023-10-18T12:03:24.133 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20211027 -> 20211027 2023-10-18T12:03:24.133 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20211216 -> 20211216 2023-10-18T12:03:24.134 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20220209 -> 20220209 2023-10-18T12:03:24.134 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20220310 -> 20220310 2023-10-18T12:03:24.134 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20220411 -> 20220411 2023-10-18T12:03:24.134 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20220509 -> 20220509 2023-10-18T12:03:24.134 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20220610 -> 20220610 2023-10-18T12:03:24.135 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20220708 -> 20220708 2023-10-18T12:03:24.135 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20220815 -> 20220815 2023-10-18T12:03:24.135 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20220913 -> 20220913 2023-10-18T12:03:24.135 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20221012 -> 20221012 2023-10-18T12:03:24.136 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20221109 -> 20221109 2023-10-18T12:03:24.136 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20221214 -> 20221214 2023-10-18T12:03:24.136 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20230117 -> 20230117 2023-10-18T12:03:24.136 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20230210 -> 20230210 2023-10-18T12:03:24.136 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20230310 -> 20230310 2023-10-18T12:03:24.137 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20230404 -> 20230404 2023-10-18T12:03:24.137 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20230515 -> 20230515 2023-10-18T12:03:24.137 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20230625 -> 20230625 2023-10-18T12:03:24.137 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20230804 -> 20230804 2023-10-18T12:03:24.137 INFO:teuthology.orchestra.run.smithi114.stderr: * [new tag] 20230919 -> 20230919 2023-10-18T12:03:27.797 INFO:teuthology.orchestra.run.smithi114.stderr:Updating files: 51% (1639/3161) Updating files: 52% (1644/3161) Updating files: 53% (1676/3161) Updating files: 54% (1707/3161) Updating files: 55% (1739/3161) Updating files: 56% (1771/3161) Updating files: 57% (1802/3161) Updating files: 58% (1834/3161) Updating files: 59% (1865/3161) Updating files: 60% (1897/3161) Updating files: 61% (1929/3161) Updating files: 62% (1960/3161) Updating files: 63% (1992/3161) Updating files: 64% (2024/3161) Updating files: 65% (2055/3161) Updating files: 66% (2087/3161) Updating files: 66% (2107/3161) Updating files: 67% (2118/3161) Updating files: 68% (2150/3161) Updating files: 69% (2182/3161) Updating files: 70% (2213/3161) Updating files: 71% (2245/3161) Updating files: 72% (2276/3161) Updating files: 73% (2308/3161) Updating files: 74% (2340/3161) Updating files: 75% (2371/3161) Updating files: 76% (2403/3161) Updating files: 77% (2434/3161) Updating files: 78% (2466/3161) Updating files: 79% (2498/3161) Updating files: 80% (2529/3161) Updating files: 81% (2561/3161) Updating files: 81% (2590/3161) Updating files: 82% (2593/3161) Updating files: 83% (2624/3161) Updating files: 84% (2656/3161) Updating files: 85% (2687/3161) Updating files: 86% (2719/3161) Updating files: 87% (2751/3161) Updating files: 88% (2782/3161) Updating files: 89% (2814/3161) Updating files: 90% (2845/3161) Updating files: 91% (2877/3161) Updating files: 92% (2909/3161) Updating files: 93% (2940/3161) Updating files: 94% (2972/3161) Updating files: 95% (3003/3161) Updating files: 96% (3035/3161) Updating files: 97% (3067/3161) Updating files: 98% (3098/3161) Updating files: 99% (3130/3161) Updating files: 100% (3161/3161) Updating files: 100% (3161/3161), done. 2023-10-18T12:03:27.802 INFO:teuthology.orchestra.run.smithi114.stdout:HEAD is now at 8ff933de Merge branch 'robot/pr-0-1697570762' into 'main' 2023-10-18T12:03:27.818 INFO:teuthology.task.kernel:Downloading kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on client.0... 2023-10-18T12:03:27.819 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-18T12:03:28.057 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-rc5-g47672119149b/ 2023-10-18T12:03:28.058 DEBUG:teuthology.orchestra.run.smithi114:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-rc5-g47672119149b_6.6.0-rc5-g47672119149b-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-rc5-g47672119149b/ --input-file=- 2023-10-18T12:03:28.060 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi114.front.sepia.ceph.com to complete... 2023-10-18T12:03:37.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18 12:03:37 URL:https://4.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-rc5-g47672119149b/linux-image-6.6.0-rc5-g47672119149b_6.6.0-rc5-g47672119149b-1_amd64.deb [38904644/38904644] -> "/tmp/linux-image.deb" [1] 2023-10-18T12:03:37.396 INFO:teuthology.orchestra.run.smithi114.stderr:FINISHED --2023-10-18 12:03:37-- 2023-10-18T12:03:37.396 INFO:teuthology.orchestra.run.smithi114.stderr:Total wall clock time: 9.3s 2023-10-18T12:03:37.396 INFO:teuthology.orchestra.run.smithi114.stderr:Downloaded: 1 files, 37M in 9.1s (4.08 MB/s) 2023-10-18T12:03:37.398 INFO:teuthology.task.kernel:Installing kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on client.0... 2023-10-18T12:03:37.398 DEBUG:teuthology.orchestra.run.smithi114:> sudo dpkg -i /tmp/linux-image.deb 2023-10-18T12:03:37.706 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package linux-image-6.6.0-rc5-g47672119149b. 2023-10-18T12:03:39.464 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... 104373 files and directories currently installed.) 2023-10-18T12:03:39.469 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-10-18T12:03:39.606 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking linux-image-6.6.0-rc5-g47672119149b (6.6.0-rc5-g47672119149b-1) ... 2023-10-18T12:03:42.640 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up linux-image-6.6.0-rc5-g47672119149b (6.6.0-rc5-g47672119149b-1) ... 2023-10-18T12:03:42.757 INFO:teuthology.orchestra.run.smithi114.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-rc5-g47672119149b 2023-10-18T12:03:52.610 INFO:teuthology.orchestra.run.smithi172.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-10-18T12:03:52.611 INFO:teuthology.orchestra.run.smithi172.stderr: * [new branch] main -> origin/main 2023-10-18T12:03:52.668 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20190312 -> 20190312 2023-10-18T12:03:52.668 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20190416 -> 20190416 2023-10-18T12:03:52.668 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20190514 -> 20190514 2023-10-18T12:03:52.669 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20190618 -> 20190618 2023-10-18T12:03:52.669 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20190717 -> 20190717 2023-10-18T12:03:52.669 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20190815 -> 20190815 2023-10-18T12:03:52.669 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20190923 -> 20190923 2023-10-18T12:03:52.671 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20191022 -> 20191022 2023-10-18T12:03:52.671 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20191215 -> 20191215 2023-10-18T12:03:52.672 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20200122 -> 20200122 2023-10-18T12:03:52.672 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20200316 -> 20200316 2023-10-18T12:03:52.672 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20200421 -> 20200421 2023-10-18T12:03:52.672 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20200519 -> 20200519 2023-10-18T12:03:52.672 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20200619 -> 20200619 2023-10-18T12:03:52.673 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20200721 -> 20200721 2023-10-18T12:03:52.673 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20200817 -> 20200817 2023-10-18T12:03:52.673 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20200918 -> 20200918 2023-10-18T12:03:52.673 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20201022 -> 20201022 2023-10-18T12:03:52.673 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20201118 -> 20201118 2023-10-18T12:03:52.673 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20201218 -> 20201218 2023-10-18T12:03:52.674 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20210208 -> 20210208 2023-10-18T12:03:52.674 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20210315 -> 20210315 2023-10-18T12:03:52.674 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20210511 -> 20210511 2023-10-18T12:03:52.674 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20210716 -> 20210716 2023-10-18T12:03:52.674 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20210818 -> 20210818 2023-10-18T12:03:52.677 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20210919 -> 20210919 2023-10-18T12:03:52.677 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20211027 -> 20211027 2023-10-18T12:03:52.677 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20211216 -> 20211216 2023-10-18T12:03:52.677 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20220209 -> 20220209 2023-10-18T12:03:52.677 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20220310 -> 20220310 2023-10-18T12:03:52.678 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20220411 -> 20220411 2023-10-18T12:03:52.678 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20220509 -> 20220509 2023-10-18T12:03:52.678 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20220610 -> 20220610 2023-10-18T12:03:52.678 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20220708 -> 20220708 2023-10-18T12:03:52.678 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20220815 -> 20220815 2023-10-18T12:03:52.679 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20220913 -> 20220913 2023-10-18T12:03:52.679 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20221012 -> 20221012 2023-10-18T12:03:52.679 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20221109 -> 20221109 2023-10-18T12:03:52.679 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20221214 -> 20221214 2023-10-18T12:03:52.680 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20230117 -> 20230117 2023-10-18T12:03:52.680 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20230210 -> 20230210 2023-10-18T12:03:52.680 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20230310 -> 20230310 2023-10-18T12:03:52.680 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20230404 -> 20230404 2023-10-18T12:03:52.680 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20230515 -> 20230515 2023-10-18T12:03:52.680 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20230625 -> 20230625 2023-10-18T12:03:52.681 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20230804 -> 20230804 2023-10-18T12:03:52.681 INFO:teuthology.orchestra.run.smithi172.stderr: * [new tag] 20230919 -> 20230919 2023-10-18T12:03:56.316 INFO:teuthology.orchestra.run.smithi172.stderr:Updating files: 52% (1659/3161) Updating files: 53% (1676/3161) Updating files: 54% (1707/3161) Updating files: 55% (1739/3161) Updating files: 56% (1771/3161) Updating files: 57% (1802/3161) Updating files: 58% (1834/3161) Updating files: 59% (1865/3161) Updating files: 60% (1897/3161) Updating files: 61% (1929/3161) Updating files: 62% (1960/3161) Updating files: 63% (1992/3161) Updating files: 64% (2024/3161) Updating files: 65% (2055/3161) Updating files: 66% (2087/3161) Updating files: 66% (2108/3161) Updating files: 67% (2118/3161) Updating files: 68% (2150/3161) Updating files: 69% (2182/3161) Updating files: 70% (2213/3161) Updating files: 71% (2245/3161) Updating files: 72% (2276/3161) Updating files: 73% (2308/3161) Updating files: 74% (2340/3161) Updating files: 75% (2371/3161) Updating files: 76% (2403/3161) Updating files: 77% (2434/3161) Updating files: 78% (2466/3161) Updating files: 79% (2498/3161) Updating files: 80% (2529/3161) Updating files: 81% (2561/3161) Updating files: 81% (2591/3161) Updating files: 82% (2593/3161) Updating files: 83% (2624/3161) Updating files: 84% (2656/3161) Updating files: 85% (2687/3161) Updating files: 86% (2719/3161) Updating files: 87% (2751/3161) Updating files: 88% (2782/3161) Updating files: 89% (2814/3161) Updating files: 90% (2845/3161) Updating files: 91% (2877/3161) Updating files: 92% (2909/3161) Updating files: 93% (2940/3161) Updating files: 94% (2972/3161) Updating files: 95% (3003/3161) Updating files: 96% (3035/3161) Updating files: 97% (3067/3161) Updating files: 98% (3098/3161) Updating files: 99% (3130/3161) Updating files: 100% (3161/3161) Updating files: 100% (3161/3161), done. 2023-10-18T12:03:56.321 INFO:teuthology.orchestra.run.smithi172.stdout:HEAD is now at 8ff933de Merge branch 'robot/pr-0-1697570762' into 'main' 2023-10-18T12:03:56.337 INFO:teuthology.task.kernel:Downloading kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on client.1... 2023-10-18T12:03:56.337 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-18T12:03:56.488 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-rc5-g47672119149b/ 2023-10-18T12:03:56.488 DEBUG:teuthology.orchestra.run.smithi172:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-rc5-g47672119149b_6.6.0-rc5-g47672119149b-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-rc5-g47672119149b/ --input-file=- 2023-10-18T12:03:56.491 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi172.front.sepia.ceph.com to complete... 2023-10-18T12:03:58.160 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18 12:03:58 URL:https://4.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-rc5-g47672119149b/linux-image-6.6.0-rc5-g47672119149b_6.6.0-rc5-g47672119149b-1_amd64.deb [38904644/38904644] -> "/tmp/linux-image.deb" [1] 2023-10-18T12:03:58.160 INFO:teuthology.orchestra.run.smithi172.stderr:FINISHED --2023-10-18 12:03:58-- 2023-10-18T12:03:58.160 INFO:teuthology.orchestra.run.smithi172.stderr:Total wall clock time: 1.6s 2023-10-18T12:03:58.161 INFO:teuthology.orchestra.run.smithi172.stderr:Downloaded: 1 files, 37M in 1.4s (25.7 MB/s) 2023-10-18T12:03:58.162 INFO:teuthology.task.kernel:Installing kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on client.1... 2023-10-18T12:03:58.162 DEBUG:teuthology.orchestra.run.smithi172:> sudo dpkg -i /tmp/linux-image.deb 2023-10-18T12:03:58.433 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package linux-image-6.6.0-rc5-g47672119149b. 2023-10-18T12:04:00.149 INFO:teuthology.orchestra.run.smithi172.stdout:(Reading database ... 104373 files and directories currently installed.) 2023-10-18T12:04:00.154 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-10-18T12:04:00.271 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking linux-image-6.6.0-rc5-g47672119149b (6.6.0-rc5-g47672119149b-1) ... 2023-10-18T12:04:03.151 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up linux-image-6.6.0-rc5-g47672119149b (6.6.0-rc5-g47672119149b-1) ... 2023-10-18T12:04:03.256 INFO:teuthology.orchestra.run.smithi172.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-rc5-g47672119149b 2023-10-18T12:04:08.156 INFO:teuthology.orchestra.run.smithi114.stderr:Sourcing file `/etc/default/grub' 2023-10-18T12:04:08.165 INFO:teuthology.orchestra.run.smithi114.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-18T12:04:08.192 INFO:teuthology.orchestra.run.smithi114.stderr:Generating grub configuration file ... 2023-10-18T12:04:08.541 INFO:teuthology.orchestra.run.smithi114.stderr:Found linux image: /boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-18T12:04:08.570 INFO:teuthology.orchestra.run.smithi114.stderr:Found initrd image: /boot/initrd.img-6.6.0-rc5-g47672119149b 2023-10-18T12:04:08.980 INFO:teuthology.orchestra.run.smithi114.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-18T12:04:08.992 INFO:teuthology.orchestra.run.smithi114.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-18T12:04:11.118 INFO:teuthology.orchestra.run.smithi114.stderr:done 2023-10-18T12:04:11.280 DEBUG:teuthology.orchestra.run.smithi114:> dpkg-deb -c /tmp/linux-image.deb 2023-10-18T12:04:11.290 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./ 2023-10-18T12:04:11.290 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./boot/ 2023-10-18T12:04:11.291 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 4415097 2023-10-10 19:59 ./boot/System.map-6.6.0-rc5-g47672119149b 2023-10-18T12:04:11.303 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 169298 2023-10-10 19:59 ./boot/config-6.6.0-rc5-g47672119149b 2023-10-18T12:04:11.304 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11352928 2023-10-10 19:59 ./boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-18T12:04:11.326 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./etc/ 2023-10-18T12:04:11.326 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./etc/kernel/ 2023-10-18T12:04:11.326 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./etc/kernel/postinst.d/ 2023-10-18T12:04:11.326 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./etc/kernel/postrm.d/ 2023-10-18T12:04:11.327 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./etc/kernel/preinst.d/ 2023-10-18T12:04:11.327 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./etc/kernel/prerm.d/ 2023-10-18T12:04:11.327 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/ 2023-10-18T12:04:11.327 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/ 2023-10-18T12:04:11.327 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/ 2023-10-18T12:04:11.328 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/ 2023-10-18T12:04:11.328 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/ 2023-10-18T12:04:11.328 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/ 2023-10-18T12:04:11.328 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/ 2023-10-18T12:04:11.328 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 490233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/aesni-intel.ko 2023-10-18T12:04:11.329 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-18T12:04:11.329 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-18T12:04:11.329 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-18T12:04:11.329 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 93113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-18T12:04:11.329 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 106729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-18T12:04:11.329 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 152241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-18T12:04:11.332 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-18T12:04:11.332 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-18T12:04:11.332 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 83889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-18T12:04:11.333 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-18T12:04:11.333 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-18T12:04:11.333 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-18T12:04:11.333 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 51801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-18T12:04:11.333 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-18T12:04:11.333 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-18T12:04:11.334 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 58585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-18T12:04:11.334 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 50497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-18T12:04:11.334 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-18T12:04:11.334 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-18T12:04:11.334 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/ 2023-10-18T12:04:11.335 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/ 2023-10-18T12:04:11.335 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce/ 2023-10-18T12:04:11.335 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-18T12:04:11.335 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpuid.ko 2023-10-18T12:04:11.335 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/msr.ko 2023-10-18T12:04:11.336 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/ 2023-10-18T12:04:11.336 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 353761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-18T12:04:11.336 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 881713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-18T12:04:11.336 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 2276817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm.ko 2023-10-18T12:04:11.408 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ 2023-10-18T12:04:11.409 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 53761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/af_alg.ko 2023-10-18T12:04:11.409 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/algif_hash.ko 2023-10-18T12:04:11.409 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/algif_skcipher.ko 2023-10-18T12:04:11.409 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ansi_cprng.ko 2023-10-18T12:04:11.410 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19641 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/anubis.ko 2023-10-18T12:04:11.410 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/arc4.ko 2023-10-18T12:04:11.410 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/asymmetric_keys/ 2023-10-18T12:04:11.410 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-10-18T12:04:11.410 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/ 2023-10-18T12:04:11.411 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-18T12:04:11.411 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_pq.ko 2023-10-18T12:04:11.411 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-18T12:04:11.411 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_tx.ko 2023-10-18T12:04:11.411 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_xor.ko 2023-10-18T12:04:11.412 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/raid6test.ko 2023-10-18T12:04:11.412 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authenc.ko 2023-10-18T12:04:11.412 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22641 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authencesn.ko 2023-10-18T12:04:11.412 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blake2b_generic.ko 2023-10-18T12:04:11.413 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_common.ko 2023-10-18T12:04:11.413 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_generic.ko 2023-10-18T12:04:11.413 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/camellia_generic.ko 2023-10-18T12:04:11.413 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast5_generic.ko 2023-10-18T12:04:11.413 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast6_generic.ko 2023-10-18T12:04:11.414 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast_common.ko 2023-10-18T12:04:11.414 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ccm.ko 2023-10-18T12:04:11.414 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cmac.ko 2023-10-18T12:04:11.414 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crc32_generic.ko 2023-10-18T12:04:11.415 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cryptd.ko 2023-10-18T12:04:11.415 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_engine.ko 2023-10-18T12:04:11.415 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_simd.ko 2023-10-18T12:04:11.415 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_user.ko 2023-10-18T12:04:11.415 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cts.ko 2023-10-18T12:04:11.416 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/des_generic.ko 2023-10-18T12:04:11.416 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/dh_generic.ko 2023-10-18T12:04:11.416 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/echainiv.ko 2023-10-18T12:04:11.416 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/essiv.ko 2023-10-18T12:04:11.416 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/fcrypt.ko 2023-10-18T12:04:11.417 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/khazad.ko 2023-10-18T12:04:11.417 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lrw.ko 2023-10-18T12:04:11.417 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4.ko 2023-10-18T12:04:11.417 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4hc.ko 2023-10-18T12:04:11.417 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/md4.ko 2023-10-18T12:04:11.418 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/michael_mic.ko 2023-10-18T12:04:11.418 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcbc.ko 2023-10-18T12:04:11.418 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcrypt.ko 2023-10-18T12:04:11.418 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/rmd160.ko 2023-10-18T12:04:11.418 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/seed.ko 2023-10-18T12:04:11.419 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/serpent_generic.ko 2023-10-18T12:04:11.419 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 149193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tcrypt.ko 2023-10-18T12:04:11.419 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tea.ko 2023-10-18T12:04:11.419 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_common.ko 2023-10-18T12:04:11.419 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_generic.ko 2023-10-18T12:04:11.420 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/vmac.ko 2023-10-18T12:04:11.420 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/wp512.ko 2023-10-18T12:04:11.420 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xcbc.ko 2023-10-18T12:04:11.420 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xor.ko 2023-10-18T12:04:11.420 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xts.ko 2023-10-18T12:04:11.421 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xxhash_generic.ko 2023-10-18T12:04:11.421 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ 2023-10-18T12:04:11.421 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/ 2023-10-18T12:04:11.421 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_extlog.ko 2023-10-18T12:04:11.421 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-18T12:04:11.421 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_pad.ko 2023-10-18T12:04:11.422 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/apei/ 2023-10-18T12:04:11.422 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/apei/einj.ko 2023-10-18T12:04:11.422 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/ec_sys.ko 2023-10-18T12:04:11.422 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/platform_profile.ko 2023-10-18T12:04:11.422 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbs.ko 2023-10-18T12:04:11.423 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbshc.ko 2023-10-18T12:04:11.423 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 103025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/video.ko 2023-10-18T12:04:11.423 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ 2023-10-18T12:04:11.423 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/acard-ahci.ko 2023-10-18T12:04:11.424 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 88865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ahci.ko 2023-10-18T12:04:11.424 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ahci_platform.ko 2023-10-18T12:04:11.424 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 88289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/libahci.ko 2023-10-18T12:04:11.424 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/libahci_platform.ko 2023-10-18T12:04:11.424 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_acpi.ko 2023-10-18T12:04:11.425 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ali.ko 2023-10-18T12:04:11.425 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_amd.ko 2023-10-18T12:04:11.425 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_artop.ko 2023-10-18T12:04:11.425 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atiixp.ko 2023-10-18T12:04:11.425 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atp867x.ko 2023-10-18T12:04:11.426 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd640.ko 2023-10-18T12:04:11.426 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-18T12:04:11.426 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cypress.ko 2023-10-18T12:04:11.426 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_efar.ko 2023-10-18T12:04:11.427 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt366.ko 2023-10-18T12:04:11.427 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-18T12:04:11.427 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-18T12:04:11.428 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-18T12:04:11.428 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it8213.ko 2023-10-18T12:04:11.428 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it821x.ko 2023-10-18T12:04:11.428 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_jmicron.ko 2023-10-18T12:04:11.428 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 51481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_legacy.ko 2023-10-18T12:04:11.429 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_marvell.ko 2023-10-18T12:04:11.429 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16281 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_mpiix.ko 2023-10-18T12:04:11.429 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_netcell.ko 2023-10-18T12:04:11.429 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ninja32.ko 2023-10-18T12:04:11.430 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87410.ko 2023-10-18T12:04:11.430 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17361 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87415.ko 2023-10-18T12:04:11.430 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-18T12:04:11.431 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15377 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_opti.ko 2023-10-18T12:04:11.431 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_optidma.ko 2023-10-18T12:04:11.431 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-18T12:04:11.431 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 37793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-18T12:04:11.431 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-18T12:04:11.432 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_piccolo.ko 2023-10-18T12:04:11.432 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_radisys.ko 2023-10-18T12:04:11.432 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_rdc.ko 2023-10-18T12:04:11.432 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_rz1000.ko 2023-10-18T12:04:11.432 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sch.ko 2023-10-18T12:04:11.433 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_serverworks.ko 2023-10-18T12:04:11.433 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sil680.ko 2023-10-18T12:04:11.433 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-18T12:04:11.433 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_triflex.ko 2023-10-18T12:04:11.433 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_via.ko 2023-10-18T12:04:11.433 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pdc_adma.ko 2023-10-18T12:04:11.434 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_inic162x.ko 2023-10-18T12:04:11.434 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 83345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_mv.ko 2023-10-18T12:04:11.434 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 70393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_nv.ko 2023-10-18T12:04:11.434 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 37377 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_promise.ko 2023-10-18T12:04:11.434 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_qstor.ko 2023-10-18T12:04:11.435 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil.ko 2023-10-18T12:04:11.435 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil24.ko 2023-10-18T12:04:11.435 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sis.ko 2023-10-18T12:04:11.435 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_svw.ko 2023-10-18T12:04:11.435 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sx4.ko 2023-10-18T12:04:11.436 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_uli.ko 2023-10-18T12:04:11.436 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_via.ko 2023-10-18T12:04:11.436 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_vsc.ko 2023-10-18T12:04:11.436 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay/ 2023-10-18T12:04:11.436 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-18T12:04:11.437 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma/ 2023-10-18T12:04:11.437 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 124473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma/bcma.ko 2023-10-18T12:04:11.437 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/ 2023-10-18T12:04:11.437 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe/ 2023-10-18T12:04:11.437 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 113665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe/aoe.ko 2023-10-18T12:04:11.438 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd/ 2023-10-18T12:04:11.438 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 965585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd/drbd.ko 2023-10-18T12:04:11.438 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 173225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/floppy.ko 2023-10-18T12:04:11.438 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx/ 2023-10-18T12:04:11.439 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 94297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-18T12:04:11.439 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 115793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/nbd.ko 2023-10-18T12:04:11.439 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk/ 2023-10-18T12:04:11.439 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 110449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-18T12:04:11.439 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 98193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/pktcdvd.ko 2023-10-18T12:04:11.440 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 263769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/rbd.ko 2023-10-18T12:04:11.440 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback/ 2023-10-18T12:04:11.440 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 98145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-18T12:04:11.440 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram/ 2023-10-18T12:04:11.440 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 60217 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram/zram.ko 2023-10-18T12:04:11.441 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ 2023-10-18T12:04:11.441 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30705 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/applicom.ko 2023-10-18T12:04:11.441 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hangcheck-timer.ko 2023-10-18T12:04:11.441 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/ 2023-10-18T12:04:11.441 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-18T12:04:11.442 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-18T12:04:11.442 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-18T12:04:11.442 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-18T12:04:11.442 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-18T12:04:11.443 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ 2023-10-18T12:04:11.443 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-18T12:04:11.443 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 148601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-18T12:04:11.443 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-18T12:04:11.443 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 139313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-18T12:04:11.444 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 70921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-18T12:04:11.444 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 53513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-18T12:04:11.444 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/lp.ko 2023-10-18T12:04:11.444 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave/ 2023-10-18T12:04:11.444 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 84097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave/mwave.ko 2023-10-18T12:04:11.445 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/nvram.ko 2023-10-18T12:04:11.445 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ppdev.ko 2023-10-18T12:04:11.445 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 51113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tlclk.ko 2023-10-18T12:04:11.445 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/ 2023-10-18T12:04:11.445 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-18T12:04:11.445 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-10-18T12:04:11.446 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-10-18T12:04:11.446 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-10-18T12:04:11.446 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-18T12:04:11.446 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-18T12:04:11.446 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-10-18T12:04:11.447 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/xillybus/ 2023-10-18T12:04:11.447 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/xillybus/xillybus_class.ko 2023-10-18T12:04:11.447 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 50945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/xillybus/xillybus_core.ko 2023-10-18T12:04:11.447 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-10-18T12:04:11.447 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/clk/ 2023-10-18T12:04:11.448 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/clk/clk-palmas.ko 2023-10-18T12:04:11.448 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/clk/clk-si5351.ko 2023-10-18T12:04:11.448 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/clk/clk-twl6040.ko 2023-10-18T12:04:11.448 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/clk/clk-wm831x.ko 2023-10-18T12:04:11.448 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/ 2023-10-18T12:04:11.449 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-18T12:04:11.449 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-18T12:04:11.449 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-18T12:04:11.449 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ 2023-10-18T12:04:11.449 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ 2023-10-18T12:04:11.450 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 70801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-18T12:04:11.450 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 243025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-18T12:04:11.450 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/ 2023-10-18T12:04:11.450 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/ 2023-10-18T12:04:11.450 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common/ 2023-10-18T12:04:11.451 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 438761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-18T12:04:11.451 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-10-18T12:04:11.451 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-18T12:04:11.451 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-aes.ko 2023-10-18T12:04:11.451 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-sha.ko 2023-10-18T12:04:11.452 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio/ 2023-10-18T12:04:11.452 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 68857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-18T12:04:11.452 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca/ 2023-10-18T12:04:11.452 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca/dca.ko 2023-10-18T12:04:11.453 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ 2023-10-18T12:04:11.453 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw/ 2023-10-18T12:04:11.453 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-18T12:04:11.453 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat/ 2023-10-18T12:04:11.453 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 122569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-18T12:04:11.454 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/ 2023-10-18T12:04:11.454 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 79953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/amd64_edac.ko 2023-10-18T12:04:11.454 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/e752x_edac.ko 2023-10-18T12:04:11.454 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 63617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-18T12:04:11.454 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3000_edac.ko 2023-10-18T12:04:11.455 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3200_edac.ko 2023-10-18T12:04:11.455 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5100_edac.ko 2023-10-18T12:04:11.455 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5400_edac.ko 2023-10-18T12:04:11.455 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7300_edac.ko 2023-10-18T12:04:11.456 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 52041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7core_edac.ko 2023-10-18T12:04:11.456 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i82975x_edac.ko 2023-10-18T12:04:11.456 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/ie31200_edac.ko 2023-10-18T12:04:11.456 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 56825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/sb_edac.ko 2023-10-18T12:04:11.457 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/x38_edac.ko 2023-10-18T12:04:11.457 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/ 2023-10-18T12:04:11.457 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-gpio.ko 2023-10-18T12:04:11.458 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-max14577.ko 2023-10-18T12:04:11.458 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-max77693.ko 2023-10-18T12:04:11.458 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-max8997.ko 2023-10-18T12:04:11.459 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-palmas.ko 2023-10-18T12:04:11.459 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-rt8973a.ko 2023-10-18T12:04:11.459 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-sm5502.ko 2023-10-18T12:04:11.460 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/ 2023-10-18T12:04:11.460 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/dmi-sysfs.ko 2023-10-18T12:04:11.460 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/efi/ 2023-10-18T12:04:11.461 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/efi/efi-pstore.ko 2023-10-18T12:04:11.461 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-18T12:04:11.461 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/ 2023-10-18T12:04:11.462 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-adp5520.ko 2023-10-18T12:04:11.462 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-amd8111.ko 2023-10-18T12:04:11.463 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-arizona.ko 2023-10-18T12:04:11.463 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-da9052.ko 2023-10-18T12:04:11.463 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-da9055.ko 2023-10-18T12:04:11.464 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-dln2.ko 2023-10-18T12:04:11.464 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 77849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-f7188x.ko 2023-10-18T12:04:11.464 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-generic.ko 2023-10-18T12:04:11.465 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-ich.ko 2023-10-18T12:04:11.465 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-10-18T12:04:11.465 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-kempld.ko 2023-10-18T12:04:11.465 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-lp3943.ko 2023-10-18T12:04:11.465 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-max7300.ko 2023-10-18T12:04:11.466 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-max730x.ko 2023-10-18T12:04:11.466 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-max732x.ko 2023-10-18T12:04:11.466 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-10-18T12:04:11.466 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-pca953x.ko 2023-10-18T12:04:11.467 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-pcf857x.ko 2023-10-18T12:04:11.467 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14377 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-rdc321x.ko 2023-10-18T12:04:11.467 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-sch.ko 2023-10-18T12:04:11.467 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-sch311x.ko 2023-10-18T12:04:11.467 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-tps65912.ko 2023-10-18T12:04:11.467 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-twl4030.ko 2023-10-18T12:04:11.468 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-twl6040.ko 2023-10-18T12:04:11.468 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-18T12:04:11.468 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15377 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-vx855.ko 2023-10-18T12:04:11.468 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16281 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-wm831x.ko 2023-10-18T12:04:11.468 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-wm8350.ko 2023-10-18T12:04:11.468 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-wm8994.ko 2023-10-18T12:04:11.469 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/ 2023-10-18T12:04:11.469 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-a4tech.ko 2023-10-18T12:04:11.469 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-apple.ko 2023-10-18T12:04:11.469 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-appleir.ko 2023-10-18T12:04:11.469 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-aureal.ko 2023-10-18T12:04:11.470 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-axff.ko 2023-10-18T12:04:11.470 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-belkin.ko 2023-10-18T12:04:11.470 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-cherry.ko 2023-10-18T12:04:11.470 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-chicony.ko 2023-10-18T12:04:11.470 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 60649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-cp2112.ko 2023-10-18T12:04:11.471 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-cypress.ko 2023-10-18T12:04:11.471 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-dr.ko 2023-10-18T12:04:11.471 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elecom.ko 2023-10-18T12:04:11.471 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elo.ko 2023-10-18T12:04:11.471 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-emsff.ko 2023-10-18T12:04:11.472 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ezkey.ko 2023-10-18T12:04:11.472 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gaff.ko 2023-10-18T12:04:11.472 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-generic.ko 2023-10-18T12:04:11.472 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gt683r.ko 2023-10-18T12:04:11.472 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gyration.ko 2023-10-18T12:04:11.473 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-18T12:04:11.473 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-18T12:04:11.473 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtekff.ko 2023-10-18T12:04:11.473 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-hyperv.ko 2023-10-18T12:04:11.473 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-icade.ko 2023-10-18T12:04:11.474 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-kensington.ko 2023-10-18T12:04:11.474 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-keytouch.ko 2023-10-18T12:04:11.474 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-kye.ko 2023-10-18T12:04:11.474 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lcpower.ko 2023-10-18T12:04:11.475 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-led.ko 2023-10-18T12:04:11.475 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42361 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lenovo.ko 2023-10-18T12:04:11.475 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lg-g15.ko 2023-10-18T12:04:11.475 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 58185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-18T12:04:11.475 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 101369 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-18T12:04:11.475 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 80993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech.ko 2023-10-18T12:04:11.476 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-magicmouse.ko 2023-10-18T12:04:11.476 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-microsoft.ko 2023-10-18T12:04:11.476 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10361 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-monterey.ko 2023-10-18T12:04:11.476 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 50161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-multitouch.ko 2023-10-18T12:04:11.476 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ntrig.ko 2023-10-18T12:04:11.477 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ortek.ko 2023-10-18T12:04:11.477 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-penmount.ko 2023-10-18T12:04:11.477 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-petalynx.ko 2023-10-18T12:04:11.477 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 72937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-picolcd.ko 2023-10-18T12:04:11.477 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-pl.ko 2023-10-18T12:04:11.478 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-plantronics.ko 2023-10-18T12:04:11.478 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-primax.ko 2023-10-18T12:04:11.478 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-rmi.ko 2023-10-18T12:04:11.478 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-18T12:04:11.478 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-18T12:04:11.479 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-18T12:04:11.479 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-18T12:04:11.479 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-18T12:04:11.479 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-18T12:04:11.479 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-18T12:04:11.480 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-18T12:04:11.480 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-18T12:04:11.480 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-18T12:04:11.480 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-18T12:04:11.480 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat.ko 2023-10-18T12:04:11.481 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-saitek.ko 2023-10-18T12:04:11.481 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-samsung.ko 2023-10-18T12:04:11.481 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-18T12:04:11.481 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sjoy.ko 2023-10-18T12:04:11.481 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 51249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sony.ko 2023-10-18T12:04:11.482 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-speedlink.ko 2023-10-18T12:04:11.482 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-steelseries.ko 2023-10-18T12:04:11.482 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sunplus.ko 2023-10-18T12:04:11.483 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-18T12:04:11.483 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tivo.ko 2023-10-18T12:04:11.483 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tmff.ko 2023-10-18T12:04:11.483 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-topseed.ko 2023-10-18T12:04:11.484 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-twinhan.ko 2023-10-18T12:04:11.484 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 71073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-uclogic.ko 2023-10-18T12:04:11.484 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-waltop.ko 2023-10-18T12:04:11.484 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 143473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-wiimote.ko 2023-10-18T12:04:11.484 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-xinmo.ko 2023-10-18T12:04:11.485 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zpff.ko 2023-10-18T12:04:11.485 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zydacron.ko 2023-10-18T12:04:11.485 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 267825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid.ko 2023-10-18T12:04:11.485 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/uhid.ko 2023-10-18T12:04:11.485 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/usbhid/ 2023-10-18T12:04:11.486 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 125721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/usbhid/usbhid.ko 2023-10-18T12:04:11.486 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/usbhid/usbkbd.ko 2023-10-18T12:04:11.486 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/usbhid/usbmouse.ko 2023-10-18T12:04:11.486 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 217873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/wacom.ko 2023-10-18T12:04:11.486 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/ 2023-10-18T12:04:11.487 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 64201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_balloon.ko 2023-10-18T12:04:11.487 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 89625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_utils.ko 2023-10-18T12:04:11.487 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 305465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_vmbus.ko 2023-10-18T12:04:11.487 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ 2023-10-18T12:04:11.487 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 66521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru.ko 2023-10-18T12:04:11.488 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 61393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru3.ko 2023-10-18T12:04:11.488 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-18T12:04:11.488 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7414.ko 2023-10-18T12:04:11.488 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7418.ko 2023-10-18T12:04:11.488 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adc128d818.ko 2023-10-18T12:04:11.489 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1025.ko 2023-10-18T12:04:11.489 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 97977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1026.ko 2023-10-18T12:04:11.489 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1029.ko 2023-10-18T12:04:11.489 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 45553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1031.ko 2023-10-18T12:04:11.489 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm9240.ko 2023-10-18T12:04:11.490 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ads7828.ko 2023-10-18T12:04:11.490 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7410.ko 2023-10-18T12:04:11.490 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7411.ko 2023-10-18T12:04:11.490 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 74433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7462.ko 2023-10-18T12:04:11.490 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7470.ko 2023-10-18T12:04:11.491 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 67929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7475.ko 2023-10-18T12:04:11.491 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7x10.ko 2023-10-18T12:04:11.491 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/amc6821.ko 2023-10-18T12:04:11.491 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 55265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/applesmc.ko 2023-10-18T12:04:11.491 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asb100.ko 2023-10-18T12:04:11.491 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 58617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asc7621.ko 2023-10-18T12:04:11.492 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-18T12:04:11.492 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/atxp1.ko 2023-10-18T12:04:11.492 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28281 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/coretemp.ko 2023-10-18T12:04:11.492 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/da9052-hwmon.ko 2023-10-18T12:04:11.492 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/da9055-hwmon.ko 2023-10-18T12:04:11.493 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-18T12:04:11.493 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 99601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dme1737.ko 2023-10-18T12:04:11.493 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds1621.ko 2023-10-18T12:04:11.493 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds620.ko 2023-10-18T12:04:11.493 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc1403.ko 2023-10-18T12:04:11.493 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc2103.ko 2023-10-18T12:04:11.494 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc6w201.ko 2023-10-18T12:04:11.494 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 66985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71805f.ko 2023-10-18T12:04:11.494 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 94457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71882fg.ko 2023-10-18T12:04:11.494 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f75375s.ko 2023-10-18T12:04:11.494 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-18T12:04:11.495 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 55449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fschmd.ko 2023-10-18T12:04:11.495 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g760a.ko 2023-10-18T12:04:11.495 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g762.ko 2023-10-18T12:04:11.495 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 46801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl518sm.ko 2023-10-18T12:04:11.495 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 45529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl520sm.ko 2023-10-18T12:04:11.496 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/hih6130.ko 2023-10-18T12:04:11.496 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-18T12:04:11.496 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-18T12:04:11.496 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-18T12:04:11.496 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmaem.ko 2023-10-18T12:04:11.496 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmpex.ko 2023-10-18T12:04:11.497 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina209.ko 2023-10-18T12:04:11.497 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina2xx.ko 2023-10-18T12:04:11.497 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 130449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/it87.ko 2023-10-18T12:04:11.497 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/jc42.ko 2023-10-18T12:04:11.497 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k10temp.ko 2023-10-18T12:04:11.498 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k8temp.ko 2023-10-18T12:04:11.498 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-18T12:04:11.498 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 48601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm63.ko 2023-10-18T12:04:11.498 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm73.ko 2023-10-18T12:04:11.498 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm75.ko 2023-10-18T12:04:11.499 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm77.ko 2023-10-18T12:04:11.499 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm78.ko 2023-10-18T12:04:11.499 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm80.ko 2023-10-18T12:04:11.499 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm83.ko 2023-10-18T12:04:11.499 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 72833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm85.ko 2023-10-18T12:04:11.500 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 46153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm87.ko 2023-10-18T12:04:11.500 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 37913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm90.ko 2023-10-18T12:04:11.500 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm92.ko 2023-10-18T12:04:11.500 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 108841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm93.ko 2023-10-18T12:04:11.500 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95234.ko 2023-10-18T12:04:11.501 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95241.ko 2023-10-18T12:04:11.501 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95245.ko 2023-10-18T12:04:11.501 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc2945.ko 2023-10-18T12:04:11.501 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4151.ko 2023-10-18T12:04:11.501 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4215.ko 2023-10-18T12:04:11.502 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4222.ko 2023-10-18T12:04:11.502 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4245.ko 2023-10-18T12:04:11.503 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4260.ko 2023-10-18T12:04:11.503 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4261.ko 2023-10-18T12:04:11.503 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max16065.ko 2023-10-18T12:04:11.503 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1619.ko 2023-10-18T12:04:11.503 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1668.ko 2023-10-18T12:04:11.504 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max197.ko 2023-10-18T12:04:11.504 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6639.ko 2023-10-18T12:04:11.504 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6650.ko 2023-10-18T12:04:11.504 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6697.ko 2023-10-18T12:04:11.504 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/mc13783-adc.ko 2023-10-18T12:04:11.505 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/mcp3021.ko 2023-10-18T12:04:11.505 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-10-18T12:04:11.505 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6683.ko 2023-10-18T12:04:11.505 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 119817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-18T12:04:11.505 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 60705 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775.ko 2023-10-18T12:04:11.505 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 59737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct7802.ko 2023-10-18T12:04:11.506 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 82337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87360.ko 2023-10-18T12:04:11.506 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 54433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87427.ko 2023-10-18T12:04:11.506 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pcf8591.ko 2023-10-18T12:04:11.506 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ 2023-10-18T12:04:11.507 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-18T12:04:11.507 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-18T12:04:11.507 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-18T12:04:11.507 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-18T12:04:11.507 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-18T12:04:11.507 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-18T12:04:11.508 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-18T12:04:11.508 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 82577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-18T12:04:11.508 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-18T12:04:11.508 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-18T12:04:11.509 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-18T12:04:11.509 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-18T12:04:11.509 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/powr1220.ko 2023-10-18T12:04:11.510 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18705 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5627.ko 2023-10-18T12:04:11.510 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5636.ko 2023-10-18T12:04:11.510 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-18T12:04:11.511 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht15.ko 2023-10-18T12:04:11.511 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht21.ko 2023-10-18T12:04:11.511 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/shtc1.ko 2023-10-18T12:04:11.512 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sis5595.ko 2023-10-18T12:04:11.512 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-18T12:04:11.513 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-18T12:04:11.513 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 37385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-18T12:04:11.513 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/thmc50.ko 2023-10-18T12:04:11.514 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp102.ko 2023-10-18T12:04:11.514 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp103.ko 2023-10-18T12:04:11.514 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp401.ko 2023-10-18T12:04:11.515 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp421.ko 2023-10-18T12:04:11.515 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-18T12:04:11.515 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via686a.ko 2023-10-18T12:04:11.516 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 52457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt1211.ko 2023-10-18T12:04:11.516 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 51545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt8231.ko 2023-10-18T12:04:11.516 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 57513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-18T12:04:11.516 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 78873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627hf.ko 2023-10-18T12:04:11.517 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 71345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83781d.ko 2023-10-18T12:04:11.517 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 63289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83791d.ko 2023-10-18T12:04:11.517 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 71321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83792d.ko 2023-10-18T12:04:11.517 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 101473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83793.ko 2023-10-18T12:04:11.517 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 119505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83795.ko 2023-10-18T12:04:11.517 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-18T12:04:11.518 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-18T12:04:11.518 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-10-18T12:04:11.518 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-10-18T12:04:11.518 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/ 2023-10-18T12:04:11.518 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/ 2023-10-18T12:04:11.519 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-18T12:04:11.519 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-18T12:04:11.519 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/ 2023-10-18T12:04:11.519 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-10-18T12:04:11.519 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-10-18T12:04:11.520 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-10-18T12:04:11.520 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-18T12:04:11.520 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-18T12:04:11.520 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-18T12:04:11.520 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-10-18T12:04:11.521 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 6929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-18T12:04:11.521 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-10-18T12:04:11.521 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 50201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-18T12:04:11.521 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-18T12:04:11.521 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-18T12:04:11.522 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-18T12:04:11.522 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-10-18T12:04:11.522 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-10-18T12:04:11.522 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 62817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-18T12:04:11.522 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-18T12:04:11.523 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-18T12:04:11.523 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-10-18T12:04:11.523 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-18T12:04:11.523 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-18T12:04:11.523 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-10-18T12:04:11.524 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-18T12:04:11.524 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-18T12:04:11.524 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-18T12:04:11.524 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-10-18T12:04:11.524 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-18T12:04:11.525 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-18T12:04:11.525 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-10-18T12:04:11.525 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29361 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-10-18T12:04:11.525 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-18T12:04:11.525 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-10-18T12:04:11.526 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-18T12:04:11.526 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-18T12:04:11.526 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-18T12:04:11.527 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-18T12:04:11.527 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-10-18T12:04:11.527 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-mux.ko 2023-10-18T12:04:11.527 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-18T12:04:11.527 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-stub.ko 2023-10-18T12:04:11.528 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/muxes/ 2023-10-18T12:04:11.528 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-10-18T12:04:11.528 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-10-18T12:04:11.528 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-10-18T12:04:11.528 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ 2023-10-18T12:04:11.529 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ 2023-10-18T12:04:11.529 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 273609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-18T12:04:11.529 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 879969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-18T12:04:11.529 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 69337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-18T12:04:11.529 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 324217 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-18T12:04:11.530 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 97985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-18T12:04:11.530 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 282273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-18T12:04:11.530 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 66201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-18T12:04:11.530 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/ 2023-10-18T12:04:11.531 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4/ 2023-10-18T12:04:11.531 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 493073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-18T12:04:11.531 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4/ 2023-10-18T12:04:11.531 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 419737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-18T12:04:11.531 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5/ 2023-10-18T12:04:11.532 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 739025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-18T12:04:11.532 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca/ 2023-10-18T12:04:11.532 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 296625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-18T12:04:11.532 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/ocrdma/ 2023-10-18T12:04:11.532 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 153697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-10-18T12:04:11.532 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/usnic/ 2023-10-18T12:04:11.533 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 168969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-10-18T12:04:11.533 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ 2023-10-18T12:04:11.533 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib/ 2023-10-18T12:04:11.533 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 263081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-18T12:04:11.533 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser/ 2023-10-18T12:04:11.533 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 100241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-18T12:04:11.534 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert/ 2023-10-18T12:04:11.534 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 111425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-18T12:04:11.534 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp/ 2023-10-18T12:04:11.534 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 128753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-18T12:04:11.534 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt/ 2023-10-18T12:04:11.535 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 129529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-18T12:04:11.535 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/ 2023-10-18T12:04:11.535 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/evbug.ko 2023-10-18T12:04:11.535 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/ff-memless.ko 2023-10-18T12:04:11.535 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/ 2023-10-18T12:04:11.536 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-18T12:04:11.536 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-18T12:04:11.536 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/gameport.ko 2023-10-18T12:04:11.536 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/joydev.ko 2023-10-18T12:04:11.536 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/ 2023-10-18T12:04:11.537 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-10-18T12:04:11.537 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-10-18T12:04:11.537 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-10-18T12:04:11.537 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-10-18T12:04:11.537 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-18T12:04:11.538 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-10-18T12:04:11.538 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/lkkbd.ko 2023-10-18T12:04:11.538 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/lm8323.ko 2023-10-18T12:04:11.538 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/lm8333.ko 2023-10-18T12:04:11.539 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-10-18T12:04:11.539 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18217 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-10-18T12:04:11.539 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-10-18T12:04:11.539 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-10-18T12:04:11.539 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/newtonkbd.ko 2023-10-18T12:04:11.540 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-10-18T12:04:11.540 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/qt1070.ko 2023-10-18T12:04:11.540 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/qt2160.ko 2023-10-18T12:04:11.540 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-10-18T12:04:11.540 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/stowaway.ko 2023-10-18T12:04:11.541 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/sunkbd.ko 2023-10-18T12:04:11.541 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-10-18T12:04:11.541 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-10-18T12:04:11.541 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-10-18T12:04:11.541 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/xtkbd.ko 2023-10-18T12:04:11.542 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/matrix-keymap.ko 2023-10-18T12:04:11.542 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/ 2023-10-18T12:04:11.542 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/appletouch.ko 2023-10-18T12:04:11.542 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-18T12:04:11.542 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 123681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-18T12:04:11.543 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 89449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-18T12:04:11.543 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/gpio_mouse.ko 2023-10-18T12:04:11.543 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 335977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/psmouse.ko 2023-10-18T12:04:11.543 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/sermouse.ko 2023-10-18T12:04:11.543 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-18T12:04:11.544 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-18T12:04:11.544 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-18T12:04:11.544 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4/ 2023-10-18T12:04:11.544 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 109873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-18T12:04:11.544 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/ 2023-10-18T12:04:11.544 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-18T12:04:11.545 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-18T12:04:11.545 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/ct82c710.ko 2023-10-18T12:04:11.545 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-18T12:04:11.545 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/parkbd.ko 2023-10-18T12:04:11.545 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/pcips2.ko 2023-10-18T12:04:11.546 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/ps2mult.ko 2023-10-18T12:04:11.546 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/serio_raw.ko 2023-10-18T12:04:11.546 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/serport.ko 2023-10-18T12:04:11.546 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/sparse-keymap.ko 2023-10-18T12:04:11.547 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/ 2023-10-18T12:04:11.547 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd/ 2023-10-18T12:04:11.547 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-18T12:04:11.548 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/ 2023-10-18T12:04:11.548 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-88pm860x.ko 2023-10-18T12:04:11.548 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-adp5520.ko 2023-10-18T12:04:11.549 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 59753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-bd2802.ko 2023-10-18T12:04:11.549 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-blinkm.ko 2023-10-18T12:04:11.549 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-da903x.ko 2023-10-18T12:04:11.550 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-da9052.ko 2023-10-18T12:04:11.550 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-gpio.ko 2023-10-18T12:04:11.551 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3530.ko 2023-10-18T12:04:11.551 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3533.ko 2023-10-18T12:04:11.551 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm355x.ko 2023-10-18T12:04:11.552 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3642.ko 2023-10-18T12:04:11.552 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lp3944.ko 2023-10-18T12:04:11.552 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lp8788.ko 2023-10-18T12:04:11.553 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-max8997.ko 2023-10-18T12:04:11.553 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-mc13783.ko 2023-10-18T12:04:11.553 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-menf21bmc.ko 2023-10-18T12:04:11.554 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-pca9532.ko 2023-10-18T12:04:11.554 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-pca955x.ko 2023-10-18T12:04:11.555 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-pca963x.ko 2023-10-18T12:04:11.555 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-ss4200.ko 2023-10-18T12:04:11.555 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-tca6507.ko 2023-10-18T12:04:11.555 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-wm831x-status.ko 2023-10-18T12:04:11.556 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-wm8350.ko 2023-10-18T12:04:11.557 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ 2023-10-18T12:04:11.557 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-18T12:04:11.558 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-18T12:04:11.558 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-18T12:04:11.559 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-18T12:04:11.559 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-18T12:04:11.559 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-18T12:04:11.559 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-18T12:04:11.560 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-18T12:04:11.560 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/ 2023-10-18T12:04:11.560 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache/ 2023-10-18T12:04:11.560 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 654969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache/bcache.ko 2023-10-18T12:04:11.560 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-bio-prison.ko 2023-10-18T12:04:11.561 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 89601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-bufio.ko 2023-10-18T12:04:11.561 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache-smq.ko 2023-10-18T12:04:11.561 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 156009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache.ko 2023-10-18T12:04:11.561 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 106897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-crypt.ko 2023-10-18T12:04:11.561 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-delay.ko 2023-10-18T12:04:11.561 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 53857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-era.ko 2023-10-18T12:04:11.562 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-flakey.ko 2023-10-18T12:04:11.562 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-log-userspace.ko 2023-10-18T12:04:11.562 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-log.ko 2023-10-18T12:04:11.562 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-mirror.ko 2023-10-18T12:04:11.563 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 78033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-multipath.ko 2023-10-18T12:04:11.563 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-queue-length.ko 2023-10-18T12:04:11.563 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 70825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-raid.ko 2023-10-18T12:04:11.563 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-region-hash.ko 2023-10-18T12:04:11.563 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-round-robin.ko 2023-10-18T12:04:11.563 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-service-time.ko 2023-10-18T12:04:11.564 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 109593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-snapshot.ko 2023-10-18T12:04:11.564 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19361 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-switch.ko 2023-10-18T12:04:11.564 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 181865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-thin-pool.ko 2023-10-18T12:04:11.564 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 51737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-verity.ko 2023-10-18T12:04:11.564 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-zero.ko 2023-10-18T12:04:11.565 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/faulty.ko 2023-10-18T12:04:11.565 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/linear.ko 2023-10-18T12:04:11.565 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/multipath.ko 2023-10-18T12:04:11.565 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data/ 2023-10-18T12:04:11.565 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 199937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-18T12:04:11.565 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 37337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid0.ko 2023-10-18T12:04:11.566 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 113073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid1.ko 2023-10-18T12:04:11.566 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 158681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid10.ko 2023-10-18T12:04:11.566 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 395721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid456.ko 2023-10-18T12:04:11.566 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/ 2023-10-18T12:04:11.566 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/ 2023-10-18T12:04:11.567 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 178137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptbase.ko 2023-10-18T12:04:11.567 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 63385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptctl.ko 2023-10-18T12:04:11.567 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptfc.ko 2023-10-18T12:04:11.567 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 37225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptlan.ko 2023-10-18T12:04:11.567 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 123321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptsas.ko 2023-10-18T12:04:11.568 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 79041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-18T12:04:11.568 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 53081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptspi.ko 2023-10-18T12:04:11.568 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/ 2023-10-18T12:04:11.568 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/88pm800.ko 2023-10-18T12:04:11.568 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/88pm805.ko 2023-10-18T12:04:11.569 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/88pm80x.ko 2023-10-18T12:04:11.569 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/arizona-i2c.ko 2023-10-18T12:04:11.569 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 123721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/arizona.ko 2023-10-18T12:04:11.569 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/bcm590xx.ko 2023-10-18T12:04:11.569 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/cros_ec_dev.ko 2023-10-18T12:04:11.569 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/dln2.ko 2023-10-18T12:04:11.570 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/janz-cmodio.ko 2023-10-18T12:04:11.570 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 53585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/kempld-core.ko 2023-10-18T12:04:11.570 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lm3533-core.ko 2023-10-18T12:04:11.570 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-10-18T12:04:11.570 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lp3943.ko 2023-10-18T12:04:11.571 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 54569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_ich.ko 2023-10-18T12:04:11.571 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_sch.ko 2023-10-18T12:04:11.571 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/max8907.ko 2023-10-18T12:04:11.571 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/mc13xxx-core.ko 2023-10-18T12:04:11.571 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-10-18T12:04:11.572 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/menf21bmc.ko 2023-10-18T12:04:11.572 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/pcf50633-adc.ko 2023-10-18T12:04:11.572 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/pcf50633-gpio.ko 2023-10-18T12:04:11.572 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/pcf50633.ko 2023-10-18T12:04:11.572 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-10-18T12:04:11.573 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/retu-mfd.ko 2023-10-18T12:04:11.573 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 80425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/si476x-core.ko 2023-10-18T12:04:11.573 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 48457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/sm501.ko 2023-10-18T12:04:11.573 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-10-18T12:04:11.573 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 51137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/tps65010.ko 2023-10-18T12:04:11.573 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/tps6507x.ko 2023-10-18T12:04:11.574 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/viperboard.ko 2023-10-18T12:04:11.574 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/vx855.ko 2023-10-18T12:04:11.574 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/wl1273-core.ko 2023-10-18T12:04:11.574 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/wm8994.ko 2023-10-18T12:04:11.575 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ 2023-10-18T12:04:11.575 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-10-18T12:04:11.575 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 48489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ad525x_dpot.ko 2023-10-18T12:04:11.575 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl/ 2023-10-18T12:04:11.575 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 46585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-18T12:04:11.576 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds9802als.ko 2023-10-18T12:04:11.576 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds990x.ko 2023-10-18T12:04:11.576 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 45593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/bh1770glc.ko 2023-10-18T12:04:11.576 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/c2port/ 2023-10-18T12:04:11.576 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-10-18T12:04:11.576 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35281 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/c2port/core.ko 2023-10-18T12:04:11.577 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710/ 2023-10-18T12:04:11.577 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710/cb710.ko 2023-10-18T12:04:11.577 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ds1682.ko 2023-10-18T12:04:11.577 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/dummy-irq.ko 2023-10-18T12:04:11.577 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/echo/ 2023-10-18T12:04:11.577 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/echo/echo.ko 2023-10-18T12:04:11.578 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/ 2023-10-18T12:04:11.578 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 37849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/at24.ko 2023-10-18T12:04:11.578 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-18T12:04:11.578 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-18T12:04:11.578 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-18T12:04:11.579 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/enclosure.ko 2023-10-18T12:04:11.579 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/genwqe/ 2023-10-18T12:04:11.579 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 152201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-10-18T12:04:11.579 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/hmc6352.ko 2023-10-18T12:04:11.579 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/hpilo.ko 2023-10-18T12:04:11.580 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ibmasm/ 2023-10-18T12:04:11.580 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 72129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-10-18T12:04:11.580 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ics932s401.ko 2023-10-18T12:04:11.580 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29003.ko 2023-10-18T12:04:11.580 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29020.ko 2023-10-18T12:04:11.580 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/ 2023-10-18T12:04:11.581 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-18T12:04:11.581 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-18T12:04:11.581 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/ 2023-10-18T12:04:11.581 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 125209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-me.ko 2023-10-18T12:04:11.581 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 56521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-18T12:04:11.582 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 310113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei.ko 2023-10-18T12:04:11.582 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/phantom.ko 2023-10-18T12:04:11.582 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ti-st/ 2023-10-18T12:04:11.582 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 74265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ti-st/st_drv.ko 2023-10-18T12:04:11.582 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-18T12:04:11.583 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_core.ko 2023-10-18T12:04:11.583 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tsl2550.ko 2023-10-18T12:04:11.583 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 48697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_balloon.ko 2023-10-18T12:04:11.583 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci/ 2023-10-18T12:04:11.583 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 183609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-18T12:04:11.584 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ 2023-10-18T12:04:11.584 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding/ 2023-10-18T12:04:11.584 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 490129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding/bonding.ko 2023-10-18T12:04:11.584 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/ 2023-10-18T12:04:11.584 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53/ 2023-10-18T12:04:11.585 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 106033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-18T12:04:11.585 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-18T12:04:11.585 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-18T12:04:11.585 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx/ 2023-10-18T12:04:11.585 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 453737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-18T12:04:11.586 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dummy.ko 2023-10-18T12:04:11.586 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/eql.ko 2023-10-18T12:04:11.586 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ 2023-10-18T12:04:11.586 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/ 2023-10-18T12:04:11.586 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 45785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-18T12:04:11.587 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-18T12:04:11.587 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 130553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-18T12:04:11.587 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 68849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-18T12:04:11.587 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/ 2023-10-18T12:04:11.587 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 37649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-18T12:04:11.588 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 59689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-18T12:04:11.588 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-18T12:04:11.588 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 99113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-18T12:04:11.588 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec/ 2023-10-18T12:04:11.588 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 54521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-18T12:04:11.588 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere/ 2023-10-18T12:04:11.589 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 69201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-18T12:04:11.589 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon/ 2023-10-18T12:04:11.589 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 59585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-18T12:04:11.589 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera/ 2023-10-18T12:04:11.589 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-18T12:04:11.590 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/ 2023-10-18T12:04:11.590 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 54609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-18T12:04:11.590 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-18T12:04:11.591 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 87297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-18T12:04:11.591 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/ 2023-10-18T12:04:11.591 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx/ 2023-10-18T12:04:11.591 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 97337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-18T12:04:11.591 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-10-18T12:04:11.591 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 104673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-18T12:04:11.592 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-10-18T12:04:11.592 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 90257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-18T12:04:11.592 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/ 2023-10-18T12:04:11.592 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 81569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-18T12:04:11.592 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 69729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-18T12:04:11.593 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/ 2023-10-18T12:04:11.593 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 78401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-18T12:04:11.593 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 176761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-18T12:04:11.593 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-10-18T12:04:11.593 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1421497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-18T12:04:11.594 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 128569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-18T12:04:11.594 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet/ 2023-10-18T12:04:11.594 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 132089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-18T12:04:11.594 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 312081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-18T12:04:11.714 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/ 2023-10-18T12:04:11.714 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna/ 2023-10-18T12:04:11.714 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 323513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-18T12:04:11.715 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/ 2023-10-18T12:04:11.715 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-10-18T12:04:11.715 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 193497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-18T12:04:11.715 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-10-18T12:04:11.715 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 347417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-18T12:04:11.716 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-10-18T12:04:11.716 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1044433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-18T12:04:11.716 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-10-18T12:04:11.716 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 166193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-18T12:04:11.716 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-10-18T12:04:11.716 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-18T12:04:11.717 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/ 2023-10-18T12:04:11.717 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic/ 2023-10-18T12:04:11.717 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 204345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-18T12:04:11.717 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/ 2023-10-18T12:04:11.717 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/ 2023-10-18T12:04:11.718 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 69449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-18T12:04:11.718 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 61489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-18T12:04:11.718 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 141225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-18T12:04:11.718 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 51497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-18T12:04:11.718 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 62817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-18T12:04:11.719 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31369 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-18T12:04:11.719 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/ 2023-10-18T12:04:11.719 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 60873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-18T12:04:11.719 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 62833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-18T12:04:11.719 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 45721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dnet.ko 2023-10-18T12:04:11.719 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ec_bhf.ko 2023-10-18T12:04:11.720 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/ 2023-10-18T12:04:11.720 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet/ 2023-10-18T12:04:11.720 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 281137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-18T12:04:11.720 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-18T12:04:11.720 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 51737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-18T12:04:11.721 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fujitsu/ 2023-10-18T12:04:11.721 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 45345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-10-18T12:04:11.721 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ 2023-10-18T12:04:11.721 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 90465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-18T12:04:11.721 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000/ 2023-10-18T12:04:11.721 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 295577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-18T12:04:11.722 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e/ 2023-10-18T12:04:11.722 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 584497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-18T12:04:11.722 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k/ 2023-10-18T12:04:11.722 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 246209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-18T12:04:11.722 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e/ 2023-10-18T12:04:11.723 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 925697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-18T12:04:11.723 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf/ 2023-10-18T12:04:11.723 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 302849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-18T12:04:11.723 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb/ 2023-10-18T12:04:11.723 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 514681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-18T12:04:11.724 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf/ 2023-10-18T12:04:11.724 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 93593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-18T12:04:11.724 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-10-18T12:04:11.724 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 734305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-18T12:04:11.724 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-10-18T12:04:11.724 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 151769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-18T12:04:11.725 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 86921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/jme.ko 2023-10-18T12:04:11.725 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/ 2023-10-18T12:04:11.725 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-18T12:04:11.725 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 102289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-18T12:04:11.725 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 122649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-18T12:04:11.725 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/ 2023-10-18T12:04:11.726 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-10-18T12:04:11.726 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 727601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-18T12:04:11.726 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 278937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-18T12:04:11.726 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-10-18T12:04:11.726 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-10-18T12:04:11.727 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1113993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-18T12:04:11.727 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ 2023-10-18T12:04:11.727 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 53105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-10-18T12:04:11.727 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-10-18T12:04:11.727 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-10-18T12:04:11.727 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 95665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-18T12:04:11.728 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/ 2023-10-18T12:04:11.728 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-10-18T12:04:11.728 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 108649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-18T12:04:11.728 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/ 2023-10-18T12:04:11.728 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 73441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-18T12:04:11.728 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-18T12:04:11.729 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion/ 2023-10-18T12:04:11.729 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 150905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-18T12:04:11.729 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia/ 2023-10-18T12:04:11.729 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 136721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-18T12:04:11.729 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/ 2023-10-18T12:04:11.730 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 50481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-18T12:04:11.730 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-18T12:04:11.730 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/ 2023-10-18T12:04:11.730 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-10-18T12:04:11.730 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 227897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-18T12:04:11.731 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 87081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-18T12:04:11.731 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-10-18T12:04:11.731 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 672049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-18T12:04:11.731 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc/ 2023-10-18T12:04:11.731 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-18T12:04:11.731 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/ 2023-10-18T12:04:11.732 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 67385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-18T12:04:11.732 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 83985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-18T12:04:11.732 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-18T12:04:11.732 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 189801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-18T12:04:11.732 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/samsung/ 2023-10-18T12:04:11.732 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-10-18T12:04:11.733 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 104241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-10-18T12:04:11.733 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc/ 2023-10-18T12:04:11.733 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1053921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-18T12:04:11.733 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan/ 2023-10-18T12:04:11.733 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-18T12:04:11.734 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/ 2023-10-18T12:04:11.734 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 54817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-18T12:04:11.734 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 63337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-18T12:04:11.734 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/ 2023-10-18T12:04:11.734 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 61601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-18T12:04:11.734 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 67193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-18T12:04:11.735 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 73409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-18T12:04:11.735 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 68177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-18T12:04:11.735 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/ 2023-10-18T12:04:11.735 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-10-18T12:04:11.735 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-10-18T12:04:11.735 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-18T12:04:11.736 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-10-18T12:04:11.736 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 486961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-18T12:04:11.736 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/ 2023-10-18T12:04:11.736 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 103337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-18T12:04:11.736 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 166161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-18T12:04:11.737 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 66329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-18T12:04:11.737 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 78801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-18T12:04:11.737 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti/ 2023-10-18T12:04:11.737 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 50057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-18T12:04:11.737 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti/ 2023-10-18T12:04:11.737 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 86529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-18T12:04:11.738 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/ 2023-10-18T12:04:11.738 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 80273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-18T12:04:11.738 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 83633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-18T12:04:11.738 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/ 2023-10-18T12:04:11.738 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 46241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-18T12:04:11.739 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-18T12:04:11.739 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom/ 2023-10-18T12:04:11.739 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 60057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-18T12:04:11.739 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/fddi/ 2023-10-18T12:04:11.739 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/fddi/defxx.ko 2023-10-18T12:04:11.740 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/fddi/skfp/ 2023-10-18T12:04:11.740 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 216985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/fddi/skfp/skfp.ko 2023-10-18T12:04:11.740 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 77345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/geneve.ko 2023-10-18T12:04:11.740 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv/ 2023-10-18T12:04:11.740 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 235521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-18T12:04:11.740 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154/ 2023-10-18T12:04:11.741 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-18T12:04:11.741 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ifb.ko 2023-10-18T12:04:11.741 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan/ 2023-10-18T12:04:11.741 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 83769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-18T12:04:11.741 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 62209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvlan.ko 2023-10-18T12:04:11.741 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvtap.ko 2023-10-18T12:04:11.742 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/ 2023-10-18T12:04:11.742 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-18T12:04:11.742 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-18T12:04:11.742 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-gpio.ko 2023-10-18T12:04:11.742 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-18T12:04:11.743 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio.ko 2023-10-18T12:04:11.743 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mii.ko 2023-10-18T12:04:11.743 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/netconsole.ko 2023-10-18T12:04:11.743 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/nlmon.ko 2023-10-18T12:04:11.743 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/ 2023-10-18T12:04:11.743 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-18T12:04:11.744 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-18T12:04:11.744 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/ 2023-10-18T12:04:11.744 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/amd.ko 2023-10-18T12:04:11.744 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 50097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-18T12:04:11.744 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-18T12:04:11.745 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-18T12:04:11.745 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/broadcom.ko 2023-10-18T12:04:11.745 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/cicada.ko 2023-10-18T12:04:11.745 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/davicom.ko 2023-10-18T12:04:11.745 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/et1011c.ko 2023-10-18T12:04:11.746 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/icplus.ko 2023-10-18T12:04:11.746 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/lxt.ko 2023-10-18T12:04:11.746 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 82049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/marvell.ko 2023-10-18T12:04:11.746 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 76177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/micrel.ko 2023-10-18T12:04:11.746 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/national.ko 2023-10-18T12:04:11.747 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 97857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/phylink.ko 2023-10-18T12:04:11.747 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/qsemi.ko 2023-10-18T12:04:11.747 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 50065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/realtek.ko 2023-10-18T12:04:11.747 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/smsc.ko 2023-10-18T12:04:11.747 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-18T12:04:11.747 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/vitesse.ko 2023-10-18T12:04:11.747 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/plip/ 2023-10-18T12:04:11.748 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/plip/plip.ko 2023-10-18T12:04:11.748 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ 2023-10-18T12:04:11.748 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-18T12:04:11.748 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-18T12:04:11.748 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-18T12:04:11.749 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-18T12:04:11.749 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-18T12:04:11.749 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppoe.ko 2023-10-18T12:04:11.749 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppox.ko 2023-10-18T12:04:11.749 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pptp.ko 2023-10-18T12:04:11.750 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/sb1000.ko 2023-10-18T12:04:11.750 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/ 2023-10-18T12:04:11.750 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slip.ko 2023-10-18T12:04:11.750 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/sungem_phy.ko 2023-10-18T12:04:11.750 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 64385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tap.ko 2023-10-18T12:04:11.751 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/ 2023-10-18T12:04:11.751 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 106169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team.ko 2023-10-18T12:04:11.751 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-18T12:04:11.751 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-18T12:04:11.751 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-18T12:04:11.751 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9641 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_random.ko 2023-10-18T12:04:11.752 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-18T12:04:11.752 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 87017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/veth.ko 2023-10-18T12:04:11.752 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3/ 2023-10-18T12:04:11.752 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 144297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-18T12:04:11.752 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan/ 2023-10-18T12:04:11.752 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 297329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-18T12:04:11.753 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback/ 2023-10-18T12:04:11.753 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 144649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-18T12:04:11.753 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb/ 2023-10-18T12:04:11.753 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb/ntb.ko 2023-10-18T12:04:11.753 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/ 2023-10-18T12:04:11.754 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/ 2023-10-18T12:04:11.754 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 264937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-18T12:04:11.754 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 102209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme.ko 2023-10-18T12:04:11.754 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/ 2023-10-18T12:04:11.754 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 133841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport.ko 2023-10-18T12:04:11.754 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_cs.ko 2023-10-18T12:04:11.755 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 84465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_pc.ko 2023-10-18T12:04:11.755 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_serial.ko 2023-10-18T12:04:11.755 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/ 2023-10-18T12:04:11.755 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/ 2023-10-18T12:04:11.755 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-18T12:04:11.756 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-10-18T12:04:11.756 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-10-18T12:04:11.756 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pci-stub.ko 2023-10-18T12:04:11.756 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 46529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/xen-pcifront.ko 2023-10-18T12:04:11.756 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/ 2023-10-18T12:04:11.756 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/i82092.ko 2023-10-18T12:04:11.757 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 145809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pcmcia.ko 2023-10-18T12:04:11.757 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 62137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pcmcia_core.ko 2023-10-18T12:04:11.757 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-10-18T12:04:11.757 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pd6729.ko 2023-10-18T12:04:11.757 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 112889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-18T12:04:11.758 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/phy/ 2023-10-18T12:04:11.758 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/phy/broadcom/ 2023-10-18T12:04:11.758 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-10-18T12:04:11.758 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/phy/samsung/ 2023-10-18T12:04:11.758 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-10-18T12:04:11.758 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/ 2023-10-18T12:04:11.759 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel/ 2023-10-18T12:04:11.759 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 70153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-18T12:04:11.759 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/ 2023-10-18T12:04:11.759 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/ 2023-10-18T12:04:11.759 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 50889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-10-18T12:04:11.760 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_ec.ko 2023-10-18T12:04:11.760 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-10-18T12:04:11.760 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-10-18T12:04:11.760 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-10-18T12:04:11.760 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-10-18T12:04:11.761 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-10-18T12:04:11.761 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/ 2023-10-18T12:04:11.761 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 67097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-18T12:04:11.761 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-18T12:04:11.761 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-18T12:04:11.761 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 59665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-18T12:04:11.762 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-18T12:04:11.762 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 127569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-18T12:04:11.762 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-18T12:04:11.762 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-18T12:04:11.762 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-18T12:04:11.763 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-18T12:04:11.763 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-18T12:04:11.763 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/hdaps.ko 2023-10-18T12:04:11.763 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/ibm_rtl.ko 2023-10-18T12:04:11.763 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/ 2023-10-18T12:04:11.764 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-18T12:04:11.764 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-10-18T12:04:11.764 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-18T12:04:11.764 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-18T12:04:11.764 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10377 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-18T12:04:11.764 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-18T12:04:11.765 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-18T12:04:11.765 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-18T12:04:11.765 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-18T12:04:11.765 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-18T12:04:11.765 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-18T12:04:11.766 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-18T12:04:11.766 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 57569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi.ko 2023-10-18T12:04:11.766 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/ 2023-10-18T12:04:11.766 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/ 2023-10-18T12:04:11.766 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/88pm860x_battery.ko 2023-10-18T12:04:11.767 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/88pm860x_charger.ko 2023-10-18T12:04:11.767 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 55057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/bq2415x_charger.ko 2023-10-18T12:04:11.767 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 54081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/bq24190_charger.ko 2023-10-18T12:04:11.767 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/bq24735-charger.ko 2023-10-18T12:04:11.767 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-10-18T12:04:11.767 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/da9030_battery.ko 2023-10-18T12:04:11.768 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/da9052-battery.ko 2023-10-18T12:04:11.768 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29281 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/ds2760_battery.ko 2023-10-18T12:04:11.768 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23217 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/ds2780_battery.ko 2023-10-18T12:04:11.768 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/ds2781_battery.ko 2023-10-18T12:04:11.768 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/ds2782_battery.ko 2023-10-18T12:04:11.769 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/gpio-charger.ko 2023-10-18T12:04:11.769 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/isp1704_charger.ko 2023-10-18T12:04:11.769 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/lp8727_charger.ko 2023-10-18T12:04:11.769 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/max14577_charger.ko 2023-10-18T12:04:11.769 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/max17040_battery.ko 2023-10-18T12:04:11.769 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/max17042_battery.ko 2023-10-18T12:04:11.770 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/max8903_charger.ko 2023-10-18T12:04:11.770 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/max8925_power.ko 2023-10-18T12:04:11.770 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/pcf50633-charger.ko 2023-10-18T12:04:11.770 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/sbs-battery.ko 2023-10-18T12:04:11.770 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/test_power.ko 2023-10-18T12:04:11.771 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/tps65090-charger.ko 2023-10-18T12:04:11.771 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/wm831x_backup.ko 2023-10-18T12:04:11.771 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/wm831x_power.ko 2023-10-18T12:04:11.771 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/wm8350_power.ko 2023-10-18T12:04:11.771 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/ 2023-10-18T12:04:11.772 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 57729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-18T12:04:11.772 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-18T12:04:11.772 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/ 2023-10-18T12:04:11.772 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/ 2023-10-18T12:04:11.772 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-18T12:04:11.773 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-18T12:04:11.773 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-18T12:04:11.773 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/pps_core.ko 2023-10-18T12:04:11.773 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ 2023-10-18T12:04:11.773 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 66385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp.ko 2023-10-18T12:04:11.773 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-18T12:04:11.774 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/ 2023-10-18T12:04:11.774 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-88pm80x.ko 2023-10-18T12:04:11.774 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-88pm860x.ko 2023-10-18T12:04:11.774 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-18T12:04:11.775 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-da9052.ko 2023-10-18T12:04:11.775 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-da9055.ko 2023-10-18T12:04:11.775 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-da9063.ko 2023-10-18T12:04:11.775 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-18T12:04:11.775 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 68577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-18T12:04:11.775 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-18T12:04:11.776 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18217 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-18T12:04:11.776 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-18T12:04:11.776 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-18T12:04:11.776 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13369 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-18T12:04:11.776 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-18T12:04:11.777 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23705 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-18T12:04:11.777 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-18T12:04:11.777 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-18T12:04:11.777 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-18T12:04:11.777 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-18T12:04:11.777 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-lp8788.ko 2023-10-18T12:04:11.778 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-18T12:04:11.778 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-18T12:04:11.778 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-18T12:04:11.778 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t86.ko 2023-10-18T12:04:11.778 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-18T12:04:11.779 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max8907.ko 2023-10-18T12:04:11.779 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max8925.ko 2023-10-18T12:04:11.779 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max8997.ko 2023-10-18T12:04:11.779 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max8998.ko 2023-10-18T12:04:11.779 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-10-18T12:04:11.780 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-18T12:04:11.780 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-palmas.ko 2023-10-18T12:04:11.780 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 46633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-18T12:04:11.780 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf50633.ko 2023-10-18T12:04:11.780 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-18T12:04:11.781 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-18T12:04:11.781 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-18T12:04:11.781 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-18T12:04:11.781 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rc5t583.ko 2023-10-18T12:04:11.781 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-18T12:04:11.781 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-18T12:04:11.782 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-18T12:04:11.782 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-18T12:04:11.782 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-18T12:04:11.782 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-s35390a.ko 2023-10-18T12:04:11.782 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-18T12:04:11.783 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-tps6586x.ko 2023-10-18T12:04:11.783 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-tps65910.ko 2023-10-18T12:04:11.783 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-wm831x.ko 2023-10-18T12:04:11.783 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-wm8350.ko 2023-10-18T12:04:11.783 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-18T12:04:11.784 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ 2023-10-18T12:04:11.784 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 77617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-18T12:04:11.784 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 57665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-sas.ko 2023-10-18T12:04:11.784 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 55169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-18T12:04:11.784 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 135185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/BusLogic.ko 2023-10-18T12:04:11.785 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/a100u2w.ko 2023-10-18T12:04:11.785 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid/ 2023-10-18T12:04:11.785 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 272305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-18T12:04:11.785 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 100617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/advansys.ko 2023-10-18T12:04:11.785 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/ 2023-10-18T12:04:11.785 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 356265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-18T12:04:11.786 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 295801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-18T12:04:11.786 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic94xx/ 2023-10-18T12:04:11.786 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 189185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-10-18T12:04:11.786 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/am53c974.ko 2023-10-18T12:04:11.786 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr/ 2023-10-18T12:04:11.787 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 106881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-18T12:04:11.787 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/atp870u.ko 2023-10-18T12:04:11.787 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi/ 2023-10-18T12:04:11.787 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 246985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-18T12:04:11.787 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa/ 2023-10-18T12:04:11.788 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1171945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-18T12:04:11.788 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc/ 2023-10-18T12:04:11.788 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 237273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-18T12:04:11.788 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i/ 2023-10-18T12:04:11.788 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 115369 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-18T12:04:11.789 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ch.ko 2023-10-18T12:04:11.789 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor/ 2023-10-18T12:04:11.789 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 308921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-18T12:04:11.789 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/ 2023-10-18T12:04:11.789 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-10-18T12:04:11.789 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 76145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-18T12:04:11.790 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-10-18T12:04:11.790 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 101449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-18T12:04:11.790 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 146689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-18T12:04:11.790 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 75553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dc395x.ko 2023-10-18T12:04:11.790 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dmx3191d.ko 2023-10-18T12:04:11.791 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r/ 2023-10-18T12:04:11.791 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 212425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-18T12:04:11.791 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 60505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esp_scsi.ko 2023-10-18T12:04:11.791 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/ 2023-10-18T12:04:11.791 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 78209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-18T12:04:11.792 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 158505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-18T12:04:11.792 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fdomain.ko 2023-10-18T12:04:11.792 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic/ 2023-10-18T12:04:11.792 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 263489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-18T12:04:11.792 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 201817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hpsa.ko 2023-10-18T12:04:11.792 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 51209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hptiop.ko 2023-10-18T12:04:11.793 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-18T12:04:11.793 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/imm.ko 2023-10-18T12:04:11.793 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/initio.ko 2023-10-18T12:04:11.793 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 266537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ipr.ko 2023-10-18T12:04:11.793 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 101881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ips.ko 2023-10-18T12:04:11.793 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci/ 2023-10-18T12:04:11.794 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 317153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci/isci.ko 2023-10-18T12:04:11.794 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-18T12:04:11.794 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 52961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-18T12:04:11.794 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc/ 2023-10-18T12:04:11.794 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 314865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-18T12:04:11.795 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 145585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi.ko 2023-10-18T12:04:11.795 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 53521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-18T12:04:11.795 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas/ 2023-10-18T12:04:11.795 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 216665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-18T12:04:11.795 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc/ 2023-10-18T12:04:11.795 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 2197249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-18T12:04:11.796 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/ 2023-10-18T12:04:11.796 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 73569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-18T12:04:11.796 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-18T12:04:11.796 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 310617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-18T12:04:11.796 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 84721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid.ko 2023-10-18T12:04:11.797 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas/ 2023-10-18T12:04:11.797 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 659777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-18T12:04:11.797 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas/ 2023-10-18T12:04:11.797 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 119561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-18T12:04:11.797 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 78129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvumi.ko 2023-10-18T12:04:11.797 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pcmcia/ 2023-10-18T12:04:11.798 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 81625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-10-18T12:04:11.798 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-10-18T12:04:11.798 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-10-18T12:04:11.798 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-10-18T12:04:11.798 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001/ 2023-10-18T12:04:11.799 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 364105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-18T12:04:11.799 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 123617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pmcraid.ko 2023-10-18T12:04:11.799 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ppa.ko 2023-10-18T12:04:11.799 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 55361 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla1280.ko 2023-10-18T12:04:11.799 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/ 2023-10-18T12:04:11.799 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1876625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-18T12:04:11.800 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 85289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-18T12:04:11.800 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx/ 2023-10-18T12:04:11.800 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 559033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-18T12:04:11.800 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qlogicfas408.ko 2023-10-18T12:04:11.800 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/raid_class.ko 2023-10-18T12:04:11.801 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 238825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_debug.ko 2023-10-18T12:04:11.801 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 173937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-18T12:04:11.801 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 279313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-18T12:04:11.801 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 97729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-18T12:04:11.801 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 73881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-18T12:04:11.802 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-18T12:04:11.802 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ses.ko 2023-10-18T12:04:11.802 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 115889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/st.ko 2023-10-18T12:04:11.802 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 46825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/stex.ko 2023-10-18T12:04:11.802 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2/ 2023-10-18T12:04:11.803 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 162121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-18T12:04:11.803 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-18T12:04:11.803 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 50321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-18T12:04:11.803 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/wd719x.ko 2023-10-18T12:04:11.803 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 50025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/xen-scsifront.ko 2023-10-18T12:04:11.803 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb/ 2023-10-18T12:04:11.804 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 129441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb/ssb.ko 2023-10-18T12:04:11.804 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/ 2023-10-18T12:04:11.804 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi/ 2023-10-18T12:04:11.804 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 736601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-18T12:04:11.804 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback/ 2023-10-18T12:04:11.805 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-18T12:04:11.805 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_file.ko 2023-10-18T12:04:11.805 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_iblock.ko 2023-10-18T12:04:11.805 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 930321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_mod.ko 2023-10-18T12:04:11.805 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_pscsi.ko 2023-10-18T12:04:11.806 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 122521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_user.ko 2023-10-18T12:04:11.806 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc/ 2023-10-18T12:04:11.806 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 75593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-18T12:04:11.806 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/ 2023-10-18T12:04:11.806 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/ 2023-10-18T12:04:11.806 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/ 2023-10-18T12:04:11.807 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-18T12:04:11.807 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-18T12:04:11.807 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-18T12:04:11.807 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-18T12:04:11.807 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-18T12:04:11.808 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-18T12:04:11.808 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-18T12:04:11.808 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20281 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-18T12:04:11.808 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-18T12:04:11.808 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-18T12:04:11.809 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-18T12:04:11.809 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 37065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-18T12:04:11.809 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-10-18T12:04:11.809 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-18T12:04:11.809 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-18T12:04:11.809 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-18T12:04:11.810 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ 2023-10-18T12:04:11.810 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless/ 2023-10-18T12:04:11.810 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 78425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-18T12:04:11.810 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 57865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/moxa.ko 2023-10-18T12:04:11.810 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 50953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/mxser.ko 2023-10-18T12:04:11.811 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 108601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_gsm.ko 2023-10-18T12:04:11.811 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_hdlc.ko 2023-10-18T12:04:11.811 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 67929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/nozomi.ko 2023-10-18T12:04:11.811 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/ 2023-10-18T12:04:11.811 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/ 2023-10-18T12:04:11.811 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-10-18T12:04:11.812 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 59497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-18T12:04:11.812 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-10-18T12:04:11.812 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/altera_uart.ko 2023-10-18T12:04:11.812 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-18T12:04:11.812 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 72425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-10-18T12:04:11.813 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm/ 2023-10-18T12:04:11.813 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 103073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-18T12:04:11.813 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/rp2.ko 2023-10-18T12:04:11.813 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 52817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/sc16is7xx.ko 2023-10-18T12:04:11.813 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/ 2023-10-18T12:04:11.813 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core/ 2023-10-18T12:04:11.814 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 531265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-18T12:04:11.814 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ 2023-10-18T12:04:11.814 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-18T12:04:11.814 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-10-18T12:04:11.814 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/ 2023-10-18T12:04:11.815 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio.ko 2023-10-18T12:04:11.815 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_aec.ko 2023-10-18T12:04:11.815 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11281 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_cif.ko 2023-10-18T12:04:11.815 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_dmem_genirq.ko 2023-10-18T12:04:11.815 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_mf624.ko 2023-10-18T12:04:11.816 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_netx.ko 2023-10-18T12:04:11.816 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-18T12:04:11.816 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-10-18T12:04:11.816 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_sercos3.ko 2023-10-18T12:04:11.816 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/ 2023-10-18T12:04:11.816 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/c67x00/ 2023-10-18T12:04:11.817 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 73297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/c67x00/c67x00.ko 2023-10-18T12:04:11.817 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/chipidea/ 2023-10-18T12:04:11.817 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 144377 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-10-18T12:04:11.817 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-10-18T12:04:11.817 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-10-18T12:04:11.817 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-10-18T12:04:11.818 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/ 2023-10-18T12:04:11.818 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 87089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-18T12:04:11.818 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 51409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-18T12:04:11.818 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47369 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usblp.ko 2023-10-18T12:04:11.818 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 89857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usbtmc.ko 2023-10-18T12:04:11.819 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/common/ 2023-10-18T12:04:11.819 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/common/ulpi.ko 2023-10-18T12:04:11.819 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc2/ 2023-10-18T12:04:11.819 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-10-18T12:04:11.819 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc3/ 2023-10-18T12:04:11.819 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-10-18T12:04:11.820 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-10-18T12:04:11.820 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 444553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc3/dwc3.ko 2023-10-18T12:04:11.820 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/ 2023-10-18T12:04:11.820 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/ 2023-10-18T12:04:11.820 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 60177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/u_ether.ko 2023-10-18T12:04:11.820 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 51881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/u_serial.ko 2023-10-18T12:04:11.821 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-10-18T12:04:11.821 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-10-18T12:04:11.821 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-10-18T12:04:11.821 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-10-18T12:04:11.821 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 92489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-10-18T12:04:11.821 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 51049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-10-18T12:04:11.822 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 122081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-10-18T12:04:11.822 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 57617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-10-18T12:04:11.822 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-10-18T12:04:11.822 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-10-18T12:04:11.822 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 57729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-10-18T12:04:11.823 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 85609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-10-18T12:04:11.823 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-10-18T12:04:11.823 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 58113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-10-18T12:04:11.823 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 67337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-10-18T12:04:11.823 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/ 2023-10-18T12:04:11.823 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-10-18T12:04:11.824 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-10-18T12:04:11.824 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-10-18T12:04:11.824 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-10-18T12:04:11.824 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-10-18T12:04:11.824 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-10-18T12:04:11.824 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-10-18T12:04:11.825 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-10-18T12:04:11.825 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-10-18T12:04:11.825 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-10-18T12:04:11.825 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-10-18T12:04:11.825 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-10-18T12:04:11.825 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 62185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-10-18T12:04:11.826 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-10-18T12:04:11.826 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 161225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/libcomposite.ko 2023-10-18T12:04:11.826 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/ 2023-10-18T12:04:11.826 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17705 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-10-18T12:04:11.826 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/bdc/ 2023-10-18T12:04:11.827 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 157681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-10-18T12:04:11.827 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-10-18T12:04:11.827 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 52721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-10-18T12:04:11.827 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 69705 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-10-18T12:04:11.827 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 56033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-10-18T12:04:11.827 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 76057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/net2272.ko 2023-10-18T12:04:11.828 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 75073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/net2280.ko 2023-10-18T12:04:11.828 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 73169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-10-18T12:04:11.828 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 65809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-10-18T12:04:11.828 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 66097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-10-18T12:04:11.828 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 81505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-10-18T12:04:11.828 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 156073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-10-18T12:04:11.829 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/ 2023-10-18T12:04:11.829 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/bcma-hcd.ko 2023-10-18T12:04:11.829 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 80113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/isp116x-hcd.ko 2023-10-18T12:04:11.829 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 87353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-10-18T12:04:11.829 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 78873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-10-18T12:04:11.829 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 51329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-18T12:04:11.829 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/sl811_cs.ko 2023-10-18T12:04:11.830 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/ssb-hcd.ko 2023-10-18T12:04:11.830 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-10-18T12:04:11.830 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/ 2023-10-18T12:04:11.830 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/mdc800.ko 2023-10-18T12:04:11.830 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/microtek.ko 2023-10-18T12:04:11.831 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ 2023-10-18T12:04:11.831 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/adutux.ko 2023-10-18T12:04:11.831 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-18T12:04:11.831 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-10-18T12:04:11.831 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/cytherm.ko 2023-10-18T12:04:11.831 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ehset.ko 2023-10-18T12:04:11.832 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi26.ko 2023-10-18T12:04:11.832 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi62.ko 2023-10-18T12:04:11.832 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ezusb.ko 2023-10-18T12:04:11.832 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/idmouse.ko 2023-10-18T12:04:11.832 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-18T12:04:11.832 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-18T12:04:11.833 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ldusb.ko 2023-10-18T12:04:11.833 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-18T12:04:11.833 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/lvstest.ko 2023-10-18T12:04:11.833 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga/ 2023-10-18T12:04:11.833 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 64841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-18T12:04:11.833 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-18T12:04:11.834 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usb3503.ko 2023-10-18T12:04:11.834 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usblcd.ko 2023-10-18T12:04:11.834 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-18T12:04:11.834 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 70873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usbtest.ko 2023-10-18T12:04:11.834 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/uss720.ko 2023-10-18T12:04:11.835 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/yurex.ko 2023-10-18T12:04:11.835 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/mon/ 2023-10-18T12:04:11.835 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 72953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/mon/usbmon.ko 2023-10-18T12:04:11.835 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/musb/ 2023-10-18T12:04:11.835 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 301545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/musb/musb_hdrc.ko 2023-10-18T12:04:11.835 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/ 2023-10-18T12:04:11.836 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-18T12:04:11.836 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-10-18T12:04:11.836 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-isp1301.ko 2023-10-18T12:04:11.836 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-tahvo.ko 2023-10-18T12:04:11.836 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ 2023-10-18T12:04:11.837 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/aircable.ko 2023-10-18T12:04:11.837 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ark3116.ko 2023-10-18T12:04:11.837 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-18T12:04:11.837 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ch341.ko 2023-10-18T12:04:11.837 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 70257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cp210x.ko 2023-10-18T12:04:11.837 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-18T12:04:11.838 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 58217 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-18T12:04:11.838 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-18T12:04:11.838 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/empeg.ko 2023-10-18T12:04:11.838 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/f81232.ko 2023-10-18T12:04:11.838 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 175137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-18T12:04:11.839 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 53113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-18T12:04:11.839 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 137081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-18T12:04:11.839 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 124833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_ti.ko 2023-10-18T12:04:11.839 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 67769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipaq.ko 2023-10-18T12:04:11.839 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipw.ko 2023-10-18T12:04:11.839 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-18T12:04:11.840 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 58233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-18T12:04:11.840 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 107521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan.ko 2023-10-18T12:04:11.840 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-18T12:04:11.840 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-18T12:04:11.840 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-18T12:04:11.841 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-18T12:04:11.841 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/metro-usb.ko 2023-10-18T12:04:11.841 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 66449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7720.ko 2023-10-18T12:04:11.841 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 78217 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7840.ko 2023-10-18T12:04:11.841 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 56337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mxuport.ko 2023-10-18T12:04:11.841 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/navman.ko 2023-10-18T12:04:11.842 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/omninet.ko 2023-10-18T12:04:11.842 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/opticon.ko 2023-10-18T12:04:11.842 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 190633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/option.ko 2023-10-18T12:04:11.842 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/oti6858.ko 2023-10-18T12:04:11.842 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 54353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/pl2303.ko 2023-10-18T12:04:11.843 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcaux.ko 2023-10-18T12:04:11.843 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 37825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcserial.ko 2023-10-18T12:04:11.843 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/quatech2.ko 2023-10-18T12:04:11.843 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-18T12:04:11.843 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 51625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/sierra.ko 2023-10-18T12:04:11.844 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-18T12:04:11.844 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ssu100.ko 2023-10-18T12:04:11.844 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-18T12:04:11.844 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 61489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-18T12:04:11.844 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-18T12:04:11.844 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-18T12:04:11.845 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-18T12:04:11.845 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 125609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usbserial.ko 2023-10-18T12:04:11.845 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/visor.ko 2023-10-18T12:04:11.845 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 37409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-18T12:04:11.845 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/wishbone-serial.ko 2023-10-18T12:04:11.845 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-18T12:04:11.846 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ 2023-10-18T12:04:11.846 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 52913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/uas.ko 2023-10-18T12:04:11.846 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-18T12:04:11.846 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-18T12:04:11.846 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-18T12:04:11.846 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-18T12:04:11.847 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-18T12:04:11.847 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-18T12:04:11.847 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19361 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-18T12:04:11.847 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-18T12:04:11.847 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-18T12:04:11.848 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-18T12:04:11.848 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-18T12:04:11.848 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-18T12:04:11.848 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-18T12:04:11.848 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 179969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-18T12:04:11.848 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/ 2023-10-18T12:04:11.849 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 67481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-18T12:04:11.849 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 72177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-18T12:04:11.849 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 107001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-18T12:04:11.849 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/ 2023-10-18T12:04:11.849 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/ 2023-10-18T12:04:11.849 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 154297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-18T12:04:11.850 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-18T12:04:11.850 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 108737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio.ko 2023-10-18T12:04:11.850 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 77609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-18T12:04:11.850 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/ 2023-10-18T12:04:11.850 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 113873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost.ko 2023-10-18T12:04:11.851 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-18T12:04:11.851 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 58089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_net.ko 2023-10-18T12:04:11.851 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 89249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-18T12:04:11.851 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/ 2023-10-18T12:04:11.851 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/ 2023-10-18T12:04:11.852 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-10-18T12:04:11.852 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/aat2870_bl.ko 2023-10-18T12:04:11.852 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/adp5520_bl.ko 2023-10-18T12:04:11.852 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/adp8860_bl.ko 2023-10-18T12:04:11.852 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/adp8870_bl.ko 2023-10-18T12:04:11.852 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-18T12:04:11.853 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/as3711_bl.ko 2023-10-18T12:04:11.853 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/bd6107.ko 2023-10-18T12:04:11.853 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/da903x_bl.ko 2023-10-18T12:04:11.853 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/da9052_bl.ko 2023-10-18T12:04:11.853 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/gpio_backlight.ko 2023-10-18T12:04:11.854 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/kb3886_bl.ko 2023-10-18T12:04:11.854 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lcd.ko 2023-10-18T12:04:11.854 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lm3533_bl.ko 2023-10-18T12:04:11.854 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lm3639_bl.ko 2023-10-18T12:04:11.854 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lv5207lp.ko 2023-10-18T12:04:11.855 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/max8925_bl.ko 2023-10-18T12:04:11.855 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/pandora_bl.ko 2023-10-18T12:04:11.855 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-10-18T12:04:11.855 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-18T12:04:11.855 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/wm831x_bl.ko 2023-10-18T12:04:11.855 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/ 2023-10-18T12:04:11.856 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ 2023-10-18T12:04:11.856 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2482.ko 2023-10-18T12:04:11.856 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2490.ko 2023-10-18T12:04:11.856 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/matrox_w1.ko 2023-10-18T12:04:11.856 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/w1-gpio.ko 2023-10-18T12:04:11.857 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/ 2023-10-18T12:04:11.857 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-18T12:04:11.857 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-18T12:04:11.857 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-18T12:04:11.857 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-18T12:04:11.858 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-18T12:04:11.858 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-18T12:04:11.858 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-18T12:04:11.858 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-18T12:04:11.858 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-18T12:04:11.858 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-18T12:04:11.859 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 56425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-18T12:04:11.859 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 102673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/wire.ko 2023-10-18T12:04:11.859 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ 2023-10-18T12:04:11.859 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/acquirewdt.ko 2023-10-18T12:04:11.859 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/advantechwdt.ko 2023-10-18T12:04:11.859 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-18T12:04:11.860 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-18T12:04:11.860 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/cpu5wdt.ko 2023-10-18T12:04:11.860 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/da9052_wdt.ko 2023-10-18T12:04:11.860 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/da9055_wdt.ko 2023-10-18T12:04:11.860 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/da9063_wdt.ko 2023-10-18T12:04:11.861 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/dw_wdt.ko 2023-10-18T12:04:11.861 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/eurotechwdt.ko 2023-10-18T12:04:11.861 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-18T12:04:11.861 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/hpwdt.ko 2023-10-18T12:04:11.861 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/i6300esb.ko 2023-10-18T12:04:11.861 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-18T12:04:11.862 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-18T12:04:11.862 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-18T12:04:11.862 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ibmasr.ko 2023-10-18T12:04:11.862 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-18T12:04:11.862 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-18T12:04:11.863 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-18T12:04:11.863 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/kempld_wdt.ko 2023-10-18T12:04:11.863 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/machzwd.ko 2023-10-18T12:04:11.863 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/mena21_wdt.ko 2023-10-18T12:04:11.863 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13217 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-10-18T12:04:11.863 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/nv_tco.ko 2023-10-18T12:04:11.864 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-10-18T12:04:11.864 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pc87413_wdt.ko 2023-10-18T12:04:11.864 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-18T12:04:11.864 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-18T12:04:11.864 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/retu_wdt.ko 2023-10-18T12:04:11.865 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-10-18T12:04:11.865 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-10-18T12:04:11.865 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-18T12:04:11.865 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sc1200wdt.ko 2023-10-18T12:04:11.865 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-18T12:04:11.865 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-10-18T12:04:11.866 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/softdog.ko 2023-10-18T12:04:11.866 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-18T12:04:11.866 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/twl4030_wdt.ko 2023-10-18T12:04:11.866 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/via_wdt.ko 2023-10-18T12:04:11.866 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-18T12:04:11.867 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-18T12:04:11.867 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-18T12:04:11.867 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wafer5823wdt.ko 2023-10-18T12:04:11.867 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-18T12:04:11.867 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wm831x_wdt.ko 2023-10-18T12:04:11.868 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wm8350_wdt.ko 2023-10-18T12:04:11.868 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-18T12:04:11.868 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/ 2023-10-18T12:04:11.868 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-evtchn.ko 2023-10-18T12:04:11.868 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-18T12:04:11.869 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntdev.ko 2023-10-18T12:04:11.869 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback/ 2023-10-18T12:04:11.869 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 176441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-18T12:04:11.869 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-privcmd.ko 2023-10-18T12:04:11.869 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 71249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-scsiback.ko 2023-10-18T12:04:11.869 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs/ 2023-10-18T12:04:11.870 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-18T12:04:11.870 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ 2023-10-18T12:04:11.870 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p/ 2023-10-18T12:04:11.870 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 166425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p/9p.ko 2023-10-18T12:04:11.870 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/adfs/ 2023-10-18T12:04:11.871 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 61073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/adfs/adfs.ko 2023-10-18T12:04:11.871 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs/ 2023-10-18T12:04:11.871 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 163593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs/affs.ko 2023-10-18T12:04:11.871 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/afs/ 2023-10-18T12:04:11.871 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 932817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/afs/kafs.ko 2023-10-18T12:04:11.871 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/autofs/ 2023-10-18T12:04:11.872 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 101057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/autofs/autofs4.ko 2023-10-18T12:04:11.872 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs/ 2023-10-18T12:04:11.872 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 64545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs/befs.ko 2023-10-18T12:04:11.872 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/bfs/ 2023-10-18T12:04:11.872 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/bfs/bfs.ko 2023-10-18T12:04:11.872 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/binfmt_misc.ko 2023-10-18T12:04:11.873 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs/ 2023-10-18T12:04:11.873 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 3402585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs/btrfs.ko 2023-10-18T12:04:11.873 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles/ 2023-10-18T12:04:11.873 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 306073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles/cachefiles.ko 2023-10-18T12:04:11.873 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph/ 2023-10-18T12:04:11.874 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1323873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph/ceph.ko 2023-10-18T12:04:11.874 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda/ 2023-10-18T12:04:11.874 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 100801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda/coda.ko 2023-10-18T12:04:11.874 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/configfs/ 2023-10-18T12:04:11.874 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 108393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/configfs/configfs.ko 2023-10-18T12:04:11.875 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs/ 2023-10-18T12:04:11.875 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 29625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs/cramfs.ko 2023-10-18T12:04:11.875 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm/ 2023-10-18T12:04:11.875 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 642577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm/dlm.ko 2023-10-18T12:04:11.875 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/efs/ 2023-10-18T12:04:11.875 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/efs/efs.ko 2023-10-18T12:04:11.876 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs/ 2023-10-18T12:04:11.876 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1505025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs/f2fs.ko 2023-10-18T12:04:11.876 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/ 2023-10-18T12:04:11.876 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/msdos.ko 2023-10-18T12:04:11.876 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/freevxfs/ 2023-10-18T12:04:11.877 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/freevxfs/freevxfs.ko 2023-10-18T12:04:11.877 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache/ 2023-10-18T12:04:11.877 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 226481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache/fscache.ko 2023-10-18T12:04:11.877 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/ 2023-10-18T12:04:11.877 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/cuse.ko 2023-10-18T12:04:11.877 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2/ 2023-10-18T12:04:11.878 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1231529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2/gfs2.ko 2023-10-18T12:04:11.878 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs/ 2023-10-18T12:04:11.878 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 141209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs/hfs.ko 2023-10-18T12:04:11.878 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus/ 2023-10-18T12:04:11.878 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 222817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus/hfsplus.ko 2023-10-18T12:04:11.879 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hpfs/ 2023-10-18T12:04:11.879 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 192329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hpfs/hpfs.ko 2023-10-18T12:04:11.879 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs/ 2023-10-18T12:04:11.879 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 74065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs/isofs.ko 2023-10-18T12:04:11.879 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs/ 2023-10-18T12:04:11.880 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 419497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs/jfs.ko 2023-10-18T12:04:11.880 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd/ 2023-10-18T12:04:11.880 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 280313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd/lockd.ko 2023-10-18T12:04:11.880 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix/ 2023-10-18T12:04:11.880 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 89193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix/minix.ko 2023-10-18T12:04:11.881 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs/ 2023-10-18T12:04:11.881 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 124649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs/netfs.ko 2023-10-18T12:04:11.881 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/ 2023-10-18T12:04:11.881 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout/ 2023-10-18T12:04:11.881 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 81449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-18T12:04:11.881 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout/ 2023-10-18T12:04:11.882 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 59449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-18T12:04:11.882 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout/ 2023-10-18T12:04:11.882 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 117513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-18T12:04:11.882 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1055649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfs.ko 2023-10-18T12:04:11.882 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 66441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv2.ko 2023-10-18T12:04:11.883 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 120177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv3.ko 2023-10-18T12:04:11.883 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 2041689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv4.ko 2023-10-18T12:04:11.883 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/ 2023-10-18T12:04:11.883 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/grace.ko 2023-10-18T12:04:11.883 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-18T12:04:11.883 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd/ 2023-10-18T12:04:11.884 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1516809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd/nfsd.ko 2023-10-18T12:04:11.884 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2/ 2023-10-18T12:04:11.884 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 592833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2/nilfs2.ko 2023-10-18T12:04:11.884 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/ 2023-10-18T12:04:11.884 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-celtic.ko 2023-10-18T12:04:11.885 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-centeuro.ko 2023-10-18T12:04:11.885 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-croatian.ko 2023-10-18T12:04:11.885 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-cyrillic.ko 2023-10-18T12:04:11.885 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-gaelic.ko 2023-10-18T12:04:11.885 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-greek.ko 2023-10-18T12:04:11.885 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-iceland.ko 2023-10-18T12:04:11.886 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-inuit.ko 2023-10-18T12:04:11.886 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-roman.ko 2023-10-18T12:04:11.886 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-romanian.ko 2023-10-18T12:04:11.886 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-turkish.ko 2023-10-18T12:04:11.886 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_ascii.ko 2023-10-18T12:04:11.887 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1250.ko 2023-10-18T12:04:11.887 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1251.ko 2023-10-18T12:04:11.887 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1255.ko 2023-10-18T12:04:11.887 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp737.ko 2023-10-18T12:04:11.887 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp775.ko 2023-10-18T12:04:11.887 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp850.ko 2023-10-18T12:04:11.888 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp852.ko 2023-10-18T12:04:11.888 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp855.ko 2023-10-18T12:04:11.888 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp857.ko 2023-10-18T12:04:11.888 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp860.ko 2023-10-18T12:04:11.888 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp861.ko 2023-10-18T12:04:11.888 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp862.ko 2023-10-18T12:04:11.889 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp863.ko 2023-10-18T12:04:11.889 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp864.ko 2023-10-18T12:04:11.889 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp865.ko 2023-10-18T12:04:11.889 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp866.ko 2023-10-18T12:04:11.889 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp869.ko 2023-10-18T12:04:11.889 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp874.ko 2023-10-18T12:04:11.890 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 94137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp932.ko 2023-10-18T12:04:11.890 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 142673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp936.ko 2023-10-18T12:04:11.890 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 165745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp949.ko 2023-10-18T12:04:11.890 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 118121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp950.ko 2023-10-18T12:04:11.890 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_euc-jp.ko 2023-10-18T12:04:11.891 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-18T12:04:11.891 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-18T12:04:11.891 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-18T12:04:11.891 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-18T12:04:11.891 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-18T12:04:11.892 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-18T12:04:11.892 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-18T12:04:11.892 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-18T12:04:11.892 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-18T12:04:11.892 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-18T12:04:11.892 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-18T12:04:11.893 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-r.ko 2023-10-18T12:04:11.893 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-18T12:04:11.893 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-u.ko 2023-10-18T12:04:11.893 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_ucs2_utils.ko 2023-10-18T12:04:11.893 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_utf8.ko 2023-10-18T12:04:11.893 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ntfs/ 2023-10-18T12:04:11.894 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 219417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ntfs/ntfs.ko 2023-10-18T12:04:11.894 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ 2023-10-18T12:04:11.894 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster/ 2023-10-18T12:04:11.894 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 244409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-18T12:04:11.894 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm/ 2023-10-18T12:04:11.894 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 440737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-18T12:04:11.895 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs/ 2023-10-18T12:04:11.895 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 54049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-18T12:04:11.895 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 2592433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2.ko 2023-10-18T12:04:11.895 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-18T12:04:11.895 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-18T12:04:11.896 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-18T12:04:11.896 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/omfs/ 2023-10-18T12:04:11.896 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 53433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/omfs/omfs.ko 2023-10-18T12:04:11.896 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs/ 2023-10-18T12:04:11.896 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 352153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs/overlay.ko 2023-10-18T12:04:11.896 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore/ 2023-10-18T12:04:11.897 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 54809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore/ramoops.ko 2023-10-18T12:04:11.897 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/qnx4/ 2023-10-18T12:04:11.897 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/qnx4/qnx4.ko 2023-10-18T12:04:11.897 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/qnx6/ 2023-10-18T12:04:11.897 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 46689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/qnx6/qnx6.ko 2023-10-18T12:04:11.897 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/quota/ 2023-10-18T12:04:11.898 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/quota/quota_tree.ko 2023-10-18T12:04:11.898 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14361 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/quota/quota_v1.ko 2023-10-18T12:04:11.898 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/quota/quota_v2.ko 2023-10-18T12:04:11.898 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs/ 2023-10-18T12:04:11.898 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 532673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs/reiserfs.ko 2023-10-18T12:04:11.899 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs/ 2023-10-18T12:04:11.899 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28641 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs/romfs.ko 2023-10-18T12:04:11.899 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/ 2023-10-18T12:04:11.899 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client/ 2023-10-18T12:04:11.899 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 2668121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client/cifs.ko 2023-10-18T12:04:11.899 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/ 2023-10-18T12:04:11.900 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-18T12:04:11.900 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_md4.ko 2023-10-18T12:04:11.900 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs/ 2023-10-18T12:04:11.900 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 134641 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs/squashfs.ko 2023-10-18T12:04:11.900 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv/ 2023-10-18T12:04:11.901 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 90721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv/sysv.ko 2023-10-18T12:04:11.901 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf/ 2023-10-18T12:04:11.901 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 247737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf/udf.ko 2023-10-18T12:04:11.901 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs/ 2023-10-18T12:04:11.901 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 162497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs/ufs.ko 2023-10-18T12:04:11.902 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs/ 2023-10-18T12:04:11.902 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 4010729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs/xfs.ko 2023-10-18T12:04:11.902 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/ 2023-10-18T12:04:11.902 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/locking/ 2023-10-18T12:04:11.902 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 75489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/locking/locktorture.ko 2023-10-18T12:04:11.903 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/time/ 2023-10-18T12:04:11.903 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/time/test_udelay.ko 2023-10-18T12:04:11.903 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 60553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/torture.ko 2023-10-18T12:04:11.903 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ 2023-10-18T12:04:11.903 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 6833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc-itu-t.ko 2023-10-18T12:04:11.903 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 6529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc7.ko 2023-10-18T12:04:11.904 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc8.ko 2023-10-18T12:04:11.904 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/ 2023-10-18T12:04:11.904 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libarc4.ko 2023-10-18T12:04:11.904 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 37081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libdes.ko 2023-10-18T12:04:11.904 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/interval_tree_test.ko 2023-10-18T12:04:11.904 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/libcrc32c.ko 2023-10-18T12:04:11.905 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lru_cache.ko 2023-10-18T12:04:11.905 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/ 2023-10-18T12:04:11.905 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4_compress.ko 2023-10-18T12:04:11.905 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-18T12:04:11.905 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math/ 2023-10-18T12:04:11.906 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 6617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math/cordic.ko 2023-10-18T12:04:11.906 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/memory-notifier-error-inject.ko 2023-10-18T12:04:11.906 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/notifier-error-inject.ko 2023-10-18T12:04:11.906 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/percpu_test.ko 2023-10-18T12:04:11.906 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/pm-notifier-error-inject.ko 2023-10-18T12:04:11.907 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6/ 2023-10-18T12:04:11.907 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 143433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6/raid6_pq.ko 2023-10-18T12:04:11.907 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/rbtree_test.ko 2023-10-18T12:04:11.907 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon/ 2023-10-18T12:04:11.907 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-18T12:04:11.908 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test-kstrtox.ko 2023-10-18T12:04:11.908 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test-string_helpers.ko 2023-10-18T12:04:11.908 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 4760425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test_bpf.ko 2023-10-18T12:04:11.908 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test_firmware.ko 2023-10-18T12:04:11.908 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 6369 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test_module.ko 2023-10-18T12:04:11.908 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test_user_copy.ko 2023-10-18T12:04:11.909 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_bm.ko 2023-10-18T12:04:11.909 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_fsm.ko 2023-10-18T12:04:11.909 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_kmp.ko 2023-10-18T12:04:11.909 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/xz/ 2023-10-18T12:04:11.909 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/xz/xz_dec_test.ko 2023-10-18T12:04:11.910 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/mm/ 2023-10-18T12:04:11.910 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/mm/hwpoison-inject.ko 2023-10-18T12:04:11.910 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ 2023-10-18T12:04:11.910 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/ 2023-10-18T12:04:11.910 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 55737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/6lowpan.ko 2023-10-18T12:04:11.911 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_dest.ko 2023-10-18T12:04:11.911 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-18T12:04:11.911 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_hop.ko 2023-10-18T12:04:11.911 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 6985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-18T12:04:11.911 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-18T12:04:11.911 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_routing.ko 2023-10-18T12:04:11.912 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_udp.ko 2023-10-18T12:04:11.912 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/ 2023-10-18T12:04:11.912 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/garp.ko 2023-10-18T12:04:11.912 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/mrp.ko 2023-10-18T12:04:11.912 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/p8022.ko 2023-10-18T12:04:11.913 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/psnap.ko 2023-10-18T12:04:11.913 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/stp.ko 2023-10-18T12:04:11.913 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q/ 2023-10-18T12:04:11.913 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 81737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q/8021q.ko 2023-10-18T12:04:11.913 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/ 2023-10-18T12:04:11.913 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 198337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet.ko 2023-10-18T12:04:11.914 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_fd.ko 2023-10-18T12:04:11.914 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_rdma.ko 2023-10-18T12:04:11.914 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_virtio.ko 2023-10-18T12:04:11.914 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv/ 2023-10-18T12:04:11.914 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 649297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv/batman-adv.ko 2023-10-18T12:04:11.915 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/ 2023-10-18T12:04:11.915 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 63809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/br_netfilter.ko 2023-10-18T12:04:11.915 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 777689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/bridge.ko 2023-10-18T12:04:11.915 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ 2023-10-18T12:04:11.915 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-18T12:04:11.916 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-18T12:04:11.916 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-18T12:04:11.916 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-18T12:04:11.916 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-18T12:04:11.916 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-18T12:04:11.916 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-18T12:04:11.917 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-18T12:04:11.917 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13217 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-18T12:04:11.917 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-18T12:04:11.917 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-18T12:04:11.917 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-18T12:04:11.918 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-18T12:04:11.918 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-18T12:04:11.918 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-18T12:04:11.918 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-18T12:04:11.918 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-18T12:04:11.919 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-18T12:04:11.919 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-18T12:04:11.919 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-18T12:04:11.919 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 55929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-18T12:04:11.919 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-18T12:04:11.919 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-18T12:04:11.920 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph/ 2023-10-18T12:04:11.920 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1047017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph/libceph.ko 2023-10-18T12:04:11.920 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/ 2023-10-18T12:04:11.920 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 125697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/pktgen.ko 2023-10-18T12:04:11.920 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/ 2023-10-18T12:04:11.920 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 194209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp.ko 2023-10-18T12:04:11.921 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_diag.ko 2023-10-18T12:04:11.921 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 57881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv4.ko 2023-10-18T12:04:11.921 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 60337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv6.ko 2023-10-18T12:04:11.921 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/ 2023-10-18T12:04:11.921 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 390473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/dsa_core.ko 2023-10-18T12:04:11.922 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_brcm.ko 2023-10-18T12:04:11.922 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_dsa.ko 2023-10-18T12:04:11.922 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_none.ko 2023-10-18T12:04:11.922 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_trailer.ko 2023-10-18T12:04:11.922 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/hsr/ 2023-10-18T12:04:11.923 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 99729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/hsr/hsr.ko 2023-10-18T12:04:11.923 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ 2023-10-18T12:04:11.923 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan/ 2023-10-18T12:04:11.923 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 45233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-18T12:04:11.923 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 254625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154.ko 2023-10-18T12:04:11.924 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-18T12:04:11.924 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ 2023-10-18T12:04:11.924 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ah4.ko 2023-10-18T12:04:11.924 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/esp4.ko 2023-10-18T12:04:11.924 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 48401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/fou.ko 2023-10-18T12:04:11.924 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/gre.ko 2023-10-18T12:04:11.925 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 48657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/inet_diag.ko 2023-10-18T12:04:11.925 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 60633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_gre.ko 2023-10-18T12:04:11.925 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 61225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_tunnel.ko 2023-10-18T12:04:11.925 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_vti.ko 2023-10-18T12:04:11.925 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipcomp.ko 2023-10-18T12:04:11.926 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipip.ko 2023-10-18T12:04:11.926 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ 2023-10-18T12:04:11.926 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 37641 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-18T12:04:11.926 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-18T12:04:11.926 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-18T12:04:11.927 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ip_tables.ko 2023-10-18T12:04:11.927 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-18T12:04:11.927 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-10-18T12:04:11.927 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-18T12:04:11.927 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-18T12:04:11.928 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-18T12:04:11.928 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-10-18T12:04:11.928 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-18T12:04:11.928 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-18T12:04:11.928 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-18T12:04:11.928 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-18T12:04:11.929 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-18T12:04:11.929 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-18T12:04:11.929 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-18T12:04:11.929 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-18T12:04:11.929 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-18T12:04:11.930 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-10-18T12:04:11.930 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-18T12:04:11.930 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-18T12:04:11.930 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-18T12:04:11.930 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-18T12:04:11.931 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-18T12:04:11.931 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_bic.ko 2023-10-18T12:04:11.931 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-18T12:04:11.931 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15369 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_diag.ko 2023-10-18T12:04:11.931 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-18T12:04:11.932 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_htcp.ko 2023-10-18T12:04:11.932 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_hybla.ko 2023-10-18T12:04:11.932 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_illinois.ko 2023-10-18T12:04:11.932 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_lp.ko 2023-10-18T12:04:11.932 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_scalable.ko 2023-10-18T12:04:11.932 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_vegas.ko 2023-10-18T12:04:11.933 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_veno.ko 2023-10-18T12:04:11.933 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_westwood.ko 2023-10-18T12:04:11.933 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_yeah.ko 2023-10-18T12:04:11.933 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tunnel4.ko 2023-10-18T12:04:11.933 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_diag.ko 2023-10-18T12:04:11.933 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 41665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_tunnel.ko 2023-10-18T12:04:11.934 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-18T12:04:11.934 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ 2023-10-18T12:04:11.934 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ah6.ko 2023-10-18T12:04:11.934 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/esp6.ko 2023-10-18T12:04:11.934 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/fou6.ko 2023-10-18T12:04:11.935 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 80897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_gre.ko 2023-10-18T12:04:11.935 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 93577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-18T12:04:11.935 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-18T12:04:11.935 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 53273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_vti.ko 2023-10-18T12:04:11.935 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ipcomp6.ko 2023-10-18T12:04:11.935 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/mip6.ko 2023-10-18T12:04:11.936 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ 2023-10-18T12:04:11.936 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-18T12:04:11.936 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-10-18T12:04:11.936 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-18T12:04:11.936 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-18T12:04:11.937 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-18T12:04:11.937 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-18T12:04:11.937 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-18T12:04:11.937 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-18T12:04:11.937 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-18T12:04:11.937 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-18T12:04:11.938 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-18T12:04:11.938 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-18T12:04:11.938 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-18T12:04:11.938 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-18T12:04:11.938 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-18T12:04:11.939 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-18T12:04:11.939 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-18T12:04:11.939 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-18T12:04:11.939 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-18T12:04:11.939 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-18T12:04:11.939 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-18T12:04:11.940 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-18T12:04:11.940 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-18T12:04:11.940 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-18T12:04:11.940 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-18T12:04:11.940 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 74073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/sit.ko 2023-10-18T12:04:11.941 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/tunnel6.ko 2023-10-18T12:04:11.941 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-18T12:04:11.941 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key/ 2023-10-18T12:04:11.941 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 82833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key/af_key.ko 2023-10-18T12:04:11.941 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/ 2023-10-18T12:04:11.941 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 125281 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_core.ko 2023-10-18T12:04:11.942 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-18T12:04:11.942 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 25953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_eth.ko 2023-10-18T12:04:11.942 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip.ko 2023-10-18T12:04:11.942 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-18T12:04:11.942 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-18T12:04:11.943 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 53241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-18T12:04:11.943 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/lapb/ 2023-10-18T12:04:11.943 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 47977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/lapb/lapb.ko 2023-10-18T12:04:11.943 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/ 2023-10-18T12:04:11.943 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/llc.ko 2023-10-18T12:04:11.943 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 267777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/llc2.ko 2023-10-18T12:04:11.944 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154/ 2023-10-18T12:04:11.944 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 290417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154/mac802154.ko 2023-10-18T12:04:11.944 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls/ 2023-10-18T12:04:11.944 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls/mpls_gso.ko 2023-10-18T12:04:11.944 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ 2023-10-18T12:04:11.945 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ 2023-10-18T12:04:11.945 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 119585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-18T12:04:11.945 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-18T12:04:11.945 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-18T12:04:11.945 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26369 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-18T12:04:11.945 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 100297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-18T12:04:11.946 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 101441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-18T12:04:11.946 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 102817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-18T12:04:11.946 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 103481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-18T12:04:11.946 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 112849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-18T12:04:11.946 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 60329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-18T12:04:11.946 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 109593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-18T12:04:11.947 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 113129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-18T12:04:11.947 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 112585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-18T12:04:11.947 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 111585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-18T12:04:11.947 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 114465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-18T12:04:11.947 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-18T12:04:11.947 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ 2023-10-18T12:04:11.948 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 411729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-18T12:04:11.948 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-18T12:04:11.948 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-18T12:04:11.948 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-18T12:04:11.948 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-18T12:04:11.949 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-18T12:04:11.949 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-18T12:04:11.949 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-18T12:04:11.949 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-18T12:04:11.949 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-18T12:04:11.949 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-18T12:04:11.950 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-18T12:04:11.950 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-18T12:04:11.950 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-18T12:04:11.950 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conncount.ko 2023-10-18T12:04:11.950 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 408257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack.ko 2023-10-18T12:04:11.951 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-18T12:04:11.951 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-18T12:04:11.951 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-18T12:04:11.951 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 118145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-18T12:04:11.951 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-18T12:04:11.952 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-18T12:04:11.952 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 107297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-18T12:04:11.952 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-18T12:04:11.952 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-18T12:04:11.952 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 66641 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-18T12:04:11.952 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-18T12:04:11.953 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-18T12:04:11.953 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-18T12:04:11.953 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 89473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table.ko 2023-10-18T12:04:11.953 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-18T12:04:11.953 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 37129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-18T12:04:11.953 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 95417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat.ko 2023-10-18T12:04:11.954 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-18T12:04:11.954 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-18T12:04:11.954 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-18T12:04:11.954 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-18T12:04:11.954 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-18T12:04:11.955 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 44065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-18T12:04:11.955 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 615313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_tables.ko 2023-10-18T12:04:11.955 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 42561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink.ko 2023-10-18T12:04:11.955 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-18T12:04:11.955 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-10-18T12:04:11.955 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 39785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-18T12:04:11.956 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-18T12:04:11.956 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49377 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-18T12:04:11.956 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-18T12:04:11.956 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_compat.ko 2023-10-18T12:04:11.956 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 40721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_ct.ko 2023-10-18T12:04:11.957 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-18T12:04:11.957 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fib.ko 2023-10-18T12:04:11.957 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-18T12:04:11.957 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_hash.ko 2023-10-18T12:04:11.957 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_limit.ko 2023-10-18T12:04:11.957 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_log.ko 2023-10-18T12:04:11.958 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_masq.ko 2023-10-18T12:04:11.958 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_nat.ko 2023-10-18T12:04:11.958 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_numgen.ko 2023-10-18T12:04:11.958 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_osf.ko 2023-10-18T12:04:11.958 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_queue.ko 2023-10-18T12:04:11.959 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_redir.ko 2023-10-18T12:04:11.959 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject.ko 2023-10-18T12:04:11.959 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-18T12:04:11.959 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_socket.ko 2023-10-18T12:04:11.959 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20369 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_synproxy.ko 2023-10-18T12:04:11.959 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_tproxy.ko 2023-10-18T12:04:11.960 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 89313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/x_tables.ko 2023-10-18T12:04:11.960 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-18T12:04:11.960 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-18T12:04:11.960 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-18T12:04:11.960 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-18T12:04:11.961 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 18169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CT.ko 2023-10-18T12:04:11.961 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_DSCP.ko 2023-10-18T12:04:11.961 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HL.ko 2023-10-18T12:04:11.961 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HMARK.ko 2023-10-18T12:04:11.961 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-18T12:04:11.961 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LED.ko 2023-10-18T12:04:11.962 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LOG.ko 2023-10-18T12:04:11.962 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-18T12:04:11.962 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-18T12:04:11.965 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-18T12:04:11.965 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-18T12:04:11.965 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-18T12:04:11.966 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-18T12:04:11.966 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 14337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-18T12:04:11.966 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-18T12:04:11.966 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-18T12:04:11.966 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17361 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TEE.ko 2023-10-18T12:04:11.967 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-18T12:04:11.967 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TRACE.ko 2023-10-18T12:04:11.967 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_addrtype.ko 2023-10-18T12:04:11.967 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_bpf.ko 2023-10-18T12:04:11.967 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cgroup.ko 2023-10-18T12:04:11.968 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cluster.ko 2023-10-18T12:04:11.968 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_comment.ko 2023-10-18T12:04:11.968 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connbytes.ko 2023-10-18T12:04:11.968 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlabel.ko 2023-10-18T12:04:11.968 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlimit.ko 2023-10-18T12:04:11.969 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connmark.ko 2023-10-18T12:04:11.969 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_conntrack.ko 2023-10-18T12:04:11.969 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cpu.ko 2023-10-18T12:04:11.969 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dccp.ko 2023-10-18T12:04:11.969 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_devgroup.ko 2023-10-18T12:04:11.969 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dscp.ko 2023-10-18T12:04:11.970 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ecn.ko 2023-10-18T12:04:11.970 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_esp.ko 2023-10-18T12:04:11.970 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-18T12:04:11.970 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_helper.ko 2023-10-18T12:04:11.970 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hl.ko 2023-10-18T12:04:11.970 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-18T12:04:11.971 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_iprange.ko 2023-10-18T12:04:11.971 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipvs.ko 2023-10-18T12:04:11.971 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_l2tp.ko 2023-10-18T12:04:11.971 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_length.ko 2023-10-18T12:04:11.971 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_limit.ko 2023-10-18T12:04:11.972 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mac.ko 2023-10-18T12:04:11.972 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8641 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mark.ko 2023-10-18T12:04:11.972 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_multiport.ko 2023-10-18T12:04:11.972 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nat.ko 2023-10-18T12:04:11.972 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nfacct.ko 2023-10-18T12:04:11.972 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_osf.ko 2023-10-18T12:04:11.973 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_owner.ko 2023-10-18T12:04:11.973 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_physdev.ko 2023-10-18T12:04:11.973 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_pkttype.ko 2023-10-18T12:04:11.973 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_policy.ko 2023-10-18T12:04:11.973 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_quota.ko 2023-10-18T12:04:11.973 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_rateest.ko 2023-10-18T12:04:11.973 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_realm.ko 2023-10-18T12:04:11.974 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_recent.ko 2023-10-18T12:04:11.974 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_sctp.ko 2023-10-18T12:04:11.974 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_set.ko 2023-10-18T12:04:11.974 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 16089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_socket.ko 2023-10-18T12:04:11.974 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_state.ko 2023-10-18T12:04:11.975 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_statistic.ko 2023-10-18T12:04:11.975 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_string.ko 2023-10-18T12:04:11.975 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 8553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-18T12:04:11.975 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_tcpudp.ko 2023-10-18T12:04:11.975 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_time.ko 2023-10-18T12:04:11.975 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_u32.ko 2023-10-18T12:04:11.976 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink/ 2023-10-18T12:04:11.976 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink/netlink_diag.ko 2023-10-18T12:04:11.976 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh/ 2023-10-18T12:04:11.976 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 12425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh/nsh.ko 2023-10-18T12:04:11.976 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/ 2023-10-18T12:04:11.976 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 380033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/openvswitch.ko 2023-10-18T12:04:11.977 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-geneve.ko 2023-10-18T12:04:11.977 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-gre.ko 2023-10-18T12:04:11.977 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 11793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-18T12:04:11.977 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet/ 2023-10-18T12:04:11.977 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet/af_packet_diag.ko 2023-10-18T12:04:11.977 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/phonet/ 2023-10-18T12:04:11.978 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 110201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/phonet/phonet.ko 2023-10-18T12:04:11.978 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 54697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/phonet/pn_pep.ko 2023-10-18T12:04:11.978 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/ 2023-10-18T12:04:11.978 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 251481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds.ko 2023-10-18T12:04:11.978 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 164937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_rdma.ko 2023-10-18T12:04:11.979 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 67377 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_tcp.ko 2023-10-18T12:04:11.979 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rxrpc/ 2023-10-18T12:04:11.979 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 819657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rxrpc/rxrpc.ko 2023-10-18T12:04:11.979 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/ 2023-10-18T12:04:11.979 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_csum.ko 2023-10-18T12:04:11.979 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_gact.ko 2023-10-18T12:04:11.980 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_ipt.ko 2023-10-18T12:04:11.980 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_mirred.ko 2023-10-18T12:04:11.980 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_nat.ko 2023-10-18T12:04:11.980 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 43449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_pedit.ko 2023-10-18T12:04:11.980 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_police.ko 2023-10-18T12:04:11.980 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_simple.ko 2023-10-18T12:04:11.981 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_skbedit.ko 2023-10-18T12:04:11.981 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_vlan.ko 2023-10-18T12:04:11.981 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_basic.ko 2023-10-18T12:04:11.981 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_bpf.ko 2023-10-18T12:04:11.981 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_cgroup.ko 2023-10-18T12:04:11.982 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_flow.ko 2023-10-18T12:04:11.982 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_fw.ko 2023-10-18T12:04:11.982 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 38489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_route.ko 2023-10-18T12:04:11.982 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 61409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_u32.ko 2023-10-18T12:04:11.982 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_cmp.ko 2023-10-18T12:04:11.983 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 13409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_ipset.ko 2023-10-18T12:04:11.983 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_meta.ko 2023-10-18T12:04:11.983 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_nbyte.ko 2023-10-18T12:04:11.983 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_text.ko 2023-10-18T12:04:11.983 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_u32.ko 2023-10-18T12:04:11.983 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 21649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_choke.ko 2023-10-18T12:04:11.984 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_codel.ko 2023-10-18T12:04:11.984 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 34633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_drr.ko 2023-10-18T12:04:11.984 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 33609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_fq.ko 2023-10-18T12:04:11.984 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_fq_codel.ko 2023-10-18T12:04:11.984 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 35433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_gred.ko 2023-10-18T12:04:11.984 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 49601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hfsc.ko 2023-10-18T12:04:11.985 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hhf.ko 2023-10-18T12:04:11.985 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 66393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_htb.ko 2023-10-18T12:04:11.985 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_ingress.ko 2023-10-18T12:04:11.985 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 30273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio.ko 2023-10-18T12:04:11.985 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-18T12:04:11.986 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_multiq.ko 2023-10-18T12:04:11.986 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 36137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_netem.ko 2023-10-18T12:04:11.986 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 27497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_pie.ko 2023-10-18T12:04:11.986 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_plug.ko 2023-10-18T12:04:11.986 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 24729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_prio.ko 2023-10-18T12:04:11.987 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 48793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_qfq.ko 2023-10-18T12:04:11.987 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 32905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_red.ko 2023-10-18T12:04:11.987 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 26881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfb.ko 2023-10-18T12:04:11.987 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 31353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfq.ko 2023-10-18T12:04:11.987 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_tbf.ko 2023-10-18T12:04:11.987 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 28105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_teql.ko 2023-10-18T12:04:11.988 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/ 2023-10-18T12:04:11.988 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 929745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp.ko 2023-10-18T12:04:11.988 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 19033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp_diag.ko 2023-10-18T12:04:11.988 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/ 2023-10-18T12:04:11.988 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/ 2023-10-18T12:04:11.989 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 336529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-18T12:04:11.989 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 54737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-18T12:04:11.989 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 1520161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/sunrpc.ko 2023-10-18T12:04:11.989 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma/ 2023-10-18T12:04:11.989 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 707721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-18T12:04:11.989 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/ 2023-10-18T12:04:11.990 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/diag.ko 2023-10-18T12:04:11.990 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 862641 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/tipc.ko 2023-10-18T12:04:11.990 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix/ 2023-10-18T12:04:11.990 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix/unix_diag.ko 2023-10-18T12:04:11.990 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/ 2023-10-18T12:04:11.991 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 85337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-18T12:04:11.991 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 68049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-18T12:04:11.991 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 96193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock.ko 2023-10-18T12:04:11.991 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 10705 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-18T12:04:11.991 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 17521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-18T12:04:11.992 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/x25/ 2023-10-18T12:04:11.992 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 125177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/x25/x25.ko 2023-10-18T12:04:11.992 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/ 2023-10-18T12:04:11.992 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 22657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_algo.ko 2023-10-18T12:04:11.992 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 20649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-18T12:04:11.992 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 102257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_user.ko 2023-10-18T12:04:11.993 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/ 2023-10-18T12:04:11.993 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib/ 2023-10-18T12:04:11.993 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 15537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib/irqbypass.ko 2023-10-18T12:04:11.993 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 639863 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.alias 2023-10-18T12:04:11.993 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 623919 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.alias.bin 2023-10-18T12:04:11.994 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 7663 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.builtin 2023-10-18T12:04:11.994 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 23428 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.alias.bin 2023-10-18T12:04:11.994 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 9821 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.bin 2023-10-18T12:04:11.994 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 70004 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.modinfo 2023-10-18T12:04:11.994 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 146313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.dep 2023-10-18T12:04:11.994 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 232548 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.dep.bin 2023-10-18T12:04:11.995 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 210 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.devname 2023-10-18T12:04:11.995 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 72606 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.order 2023-10-18T12:04:11.995 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 879 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.softdep 2023-10-18T12:04:11.995 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 254438 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.symbols 2023-10-18T12:04:11.995 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 309363 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.symbols.bin 2023-10-18T12:04:11.995 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./usr/ 2023-10-18T12:04:11.996 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./usr/share/ 2023-10-18T12:04:11.996 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./usr/share/doc/ 2023-10-18T12:04:11.996 INFO:teuthology.orchestra.run.smithi114.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./usr/share/doc/linux-image-6.6.0-rc5-g47672119149b/ 2023-10-18T12:04:11.996 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 174 2023-10-10 19:59 ./usr/share/doc/linux-image-6.6.0-rc5-g47672119149b/changelog.Debian.gz 2023-10-18T12:04:11.996 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r-- root/root 691 2023-10-10 19:59 ./usr/share/doc/linux-image-6.6.0-rc5-g47672119149b/copyright 2023-10-18T12:04:11.997 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-rc5-g47672119149b 2023-10-18T12:04:11.997 INFO:teuthology.task.kernel:searching for kernel 6.6.0-rc5-g47672119149b 2023-10-18T12:04:11.998 DEBUG:teuthology.orchestra.run.smithi114:> egrep '(submenu|menuentry.*6.6.0-rc5-g47672119149b).*{' /boot/grub/grub.cfg 2023-10-18T12:04:12.007 INFO:teuthology.orchestra.run.smithi114.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-10-18T12:04:12.007 INFO:teuthology.orchestra.run.smithi114.stdout: menuentry 'Ubuntu, with Linux 6.6.0-rc5-g47672119149b' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-rc5-g47672119149b-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-10-18T12:04:12.007 INFO:teuthology.orchestra.run.smithi114.stdout: menuentry 'Ubuntu, with Linux 6.6.0-rc5-g47672119149b (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-rc5-g47672119149b-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-10-18T12:04:12.008 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-10-18T12:04:12.008 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-rc5-g47672119149b 2023-10-18T12:04:12.008 DEBUG:teuthology.orchestra.run.smithi114:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-10-18T12:04:12.010 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi114.front.sepia.ceph.com to complete... 2023-10-18T12:04:12.733 INFO:teuthology.orchestra.run.smithi114.stderr:Sourcing file `/etc/default/grub' 2023-10-18T12:04:12.739 INFO:teuthology.orchestra.run.smithi114.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-18T12:04:12.754 INFO:teuthology.orchestra.run.smithi114.stderr:Generating grub configuration file ... 2023-10-18T12:04:12.979 INFO:teuthology.orchestra.run.smithi114.stderr:Found linux image: /boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-18T12:04:12.991 INFO:teuthology.orchestra.run.smithi114.stderr:Found initrd image: /boot/initrd.img-6.6.0-rc5-g47672119149b 2023-10-18T12:04:13.378 INFO:teuthology.orchestra.run.smithi114.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-18T12:04:13.390 INFO:teuthology.orchestra.run.smithi114.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-18T12:04:14.417 INFO:teuthology.orchestra.run.smithi114.stderr:done 2023-10-18T12:04:28.334 INFO:teuthology.orchestra.run.smithi172.stderr:Sourcing file `/etc/default/grub' 2023-10-18T12:04:28.341 INFO:teuthology.orchestra.run.smithi172.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-18T12:04:28.365 INFO:teuthology.orchestra.run.smithi172.stderr:Generating grub configuration file ... 2023-10-18T12:04:28.738 INFO:teuthology.orchestra.run.smithi172.stderr:Found linux image: /boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-18T12:04:28.764 INFO:teuthology.orchestra.run.smithi172.stderr:Found initrd image: /boot/initrd.img-6.6.0-rc5-g47672119149b 2023-10-18T12:04:29.197 INFO:teuthology.orchestra.run.smithi172.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-18T12:04:29.208 INFO:teuthology.orchestra.run.smithi172.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-18T12:04:31.200 INFO:teuthology.orchestra.run.smithi172.stderr:done 2023-10-18T12:04:31.346 DEBUG:teuthology.orchestra.run.smithi172:> dpkg-deb -c /tmp/linux-image.deb 2023-10-18T12:04:31.356 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./ 2023-10-18T12:04:31.356 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./boot/ 2023-10-18T12:04:31.356 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 4415097 2023-10-10 19:59 ./boot/System.map-6.6.0-rc5-g47672119149b 2023-10-18T12:04:31.370 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 169298 2023-10-10 19:59 ./boot/config-6.6.0-rc5-g47672119149b 2023-10-18T12:04:31.371 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11352928 2023-10-10 19:59 ./boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-18T12:04:31.392 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./etc/ 2023-10-18T12:04:31.392 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./etc/kernel/ 2023-10-18T12:04:31.392 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./etc/kernel/postinst.d/ 2023-10-18T12:04:31.392 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./etc/kernel/postrm.d/ 2023-10-18T12:04:31.393 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./etc/kernel/preinst.d/ 2023-10-18T12:04:31.393 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./etc/kernel/prerm.d/ 2023-10-18T12:04:31.393 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/ 2023-10-18T12:04:31.393 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/ 2023-10-18T12:04:31.393 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/ 2023-10-18T12:04:31.394 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/ 2023-10-18T12:04:31.394 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/ 2023-10-18T12:04:31.394 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/ 2023-10-18T12:04:31.394 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/ 2023-10-18T12:04:31.394 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 490233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/aesni-intel.ko 2023-10-18T12:04:31.397 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 25329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-18T12:04:31.397 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 29529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-18T12:04:31.398 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 30313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-18T12:04:31.398 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 93113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-18T12:04:31.398 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 106729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-18T12:04:31.398 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 152241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-18T12:04:31.398 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-18T12:04:31.399 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-18T12:04:31.399 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 83889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-18T12:04:31.399 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-18T12:04:31.399 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 47225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-18T12:04:31.399 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 47209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-18T12:04:31.400 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 51801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-18T12:04:31.400 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 38937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-18T12:04:31.400 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 40529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-18T12:04:31.400 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 58585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-18T12:04:31.401 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 50497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-18T12:04:31.401 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 32065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-18T12:04:31.401 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-18T12:04:31.401 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/ 2023-10-18T12:04:31.401 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/ 2023-10-18T12:04:31.402 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce/ 2023-10-18T12:04:31.402 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 40113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-18T12:04:31.402 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpuid.ko 2023-10-18T12:04:31.402 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/msr.ko 2023-10-18T12:04:31.402 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/ 2023-10-18T12:04:31.403 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 353761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-18T12:04:31.403 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 881713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-18T12:04:31.403 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 2276817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm.ko 2023-10-18T12:04:31.468 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ 2023-10-18T12:04:31.468 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 53761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/af_alg.ko 2023-10-18T12:04:31.468 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 23097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/algif_hash.ko 2023-10-18T12:04:31.469 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/algif_skcipher.ko 2023-10-18T12:04:31.469 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ansi_cprng.ko 2023-10-18T12:04:31.469 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19641 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/anubis.ko 2023-10-18T12:04:31.469 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/arc4.ko 2023-10-18T12:04:31.469 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/asymmetric_keys/ 2023-10-18T12:04:31.470 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-10-18T12:04:31.470 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/ 2023-10-18T12:04:31.470 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-18T12:04:31.470 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_pq.ko 2023-10-18T12:04:31.470 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 21561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-18T12:04:31.471 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_tx.ko 2023-10-18T12:04:31.471 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_xor.ko 2023-10-18T12:04:31.471 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/raid6test.ko 2023-10-18T12:04:31.471 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authenc.ko 2023-10-18T12:04:31.471 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 22641 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authencesn.ko 2023-10-18T12:04:31.472 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 21817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blake2b_generic.ko 2023-10-18T12:04:31.472 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_common.ko 2023-10-18T12:04:31.472 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_generic.ko 2023-10-18T12:04:31.472 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 38873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/camellia_generic.ko 2023-10-18T12:04:31.472 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 27321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast5_generic.ko 2023-10-18T12:04:31.472 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast6_generic.ko 2023-10-18T12:04:31.473 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast_common.ko 2023-10-18T12:04:31.473 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 35097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ccm.ko 2023-10-18T12:04:31.473 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cmac.ko 2023-10-18T12:04:31.473 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crc32_generic.ko 2023-10-18T12:04:31.473 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 47505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cryptd.ko 2023-10-18T12:04:31.474 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 39505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_engine.ko 2023-10-18T12:04:31.474 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 26953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_simd.ko 2023-10-18T12:04:31.474 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 24737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_user.ko 2023-10-18T12:04:31.474 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cts.ko 2023-10-18T12:04:31.474 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/des_generic.ko 2023-10-18T12:04:31.475 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/dh_generic.ko 2023-10-18T12:04:31.475 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/echainiv.ko 2023-10-18T12:04:31.475 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 25321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/essiv.ko 2023-10-18T12:04:31.475 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/fcrypt.ko 2023-10-18T12:04:31.475 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 26897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/khazad.ko 2023-10-18T12:04:31.476 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lrw.ko 2023-10-18T12:04:31.476 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4.ko 2023-10-18T12:04:31.476 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4hc.ko 2023-10-18T12:04:31.476 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/md4.ko 2023-10-18T12:04:31.476 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/michael_mic.ko 2023-10-18T12:04:31.476 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcbc.ko 2023-10-18T12:04:31.477 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcrypt.ko 2023-10-18T12:04:31.477 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/rmd160.ko 2023-10-18T12:04:31.477 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 29393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/seed.ko 2023-10-18T12:04:31.477 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 27081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/serpent_generic.ko 2023-10-18T12:04:31.477 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 149193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tcrypt.ko 2023-10-18T12:04:31.478 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tea.ko 2023-10-18T12:04:31.478 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 28777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_common.ko 2023-10-18T12:04:31.478 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_generic.ko 2023-10-18T12:04:31.478 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/vmac.ko 2023-10-18T12:04:31.478 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 36185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/wp512.ko 2023-10-18T12:04:31.479 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xcbc.ko 2023-10-18T12:04:31.479 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 26665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xor.ko 2023-10-18T12:04:31.479 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xts.ko 2023-10-18T12:04:31.479 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xxhash_generic.ko 2023-10-18T12:04:31.479 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ 2023-10-18T12:04:31.479 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/ 2023-10-18T12:04:31.480 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_extlog.ko 2023-10-18T12:04:31.480 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 26985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-18T12:04:31.480 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 28793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_pad.ko 2023-10-18T12:04:31.480 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/apei/ 2023-10-18T12:04:31.480 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 31241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/apei/einj.ko 2023-10-18T12:04:31.481 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/ec_sys.ko 2023-10-18T12:04:31.481 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/platform_profile.ko 2023-10-18T12:04:31.481 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 24401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbs.ko 2023-10-18T12:04:31.481 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbshc.ko 2023-10-18T12:04:31.481 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 103025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/video.ko 2023-10-18T12:04:31.482 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ 2023-10-18T12:04:31.482 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 21601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/acard-ahci.ko 2023-10-18T12:04:31.482 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 88865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ahci.ko 2023-10-18T12:04:31.482 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ahci_platform.ko 2023-10-18T12:04:31.483 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 88289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/libahci.ko 2023-10-18T12:04:31.483 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 34985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/libahci_platform.ko 2023-10-18T12:04:31.483 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_acpi.ko 2023-10-18T12:04:31.483 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 30497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ali.ko 2023-10-18T12:04:31.483 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 33569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_amd.ko 2023-10-18T12:04:31.484 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 21265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_artop.ko 2023-10-18T12:04:31.484 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 21121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atiixp.ko 2023-10-18T12:04:31.484 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 24945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atp867x.ko 2023-10-18T12:04:31.484 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd640.ko 2023-10-18T12:04:31.484 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 25249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-18T12:04:31.485 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cypress.ko 2023-10-18T12:04:31.485 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_efar.ko 2023-10-18T12:04:31.485 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 21945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt366.ko 2023-10-18T12:04:31.485 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 33977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-18T12:04:31.485 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 23129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-18T12:04:31.486 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-18T12:04:31.486 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it8213.ko 2023-10-18T12:04:31.486 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 35273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it821x.ko 2023-10-18T12:04:31.486 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_jmicron.ko 2023-10-18T12:04:31.486 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 51481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_legacy.ko 2023-10-18T12:04:31.487 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_marvell.ko 2023-10-18T12:04:31.487 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16281 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_mpiix.ko 2023-10-18T12:04:31.487 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_netcell.ko 2023-10-18T12:04:31.487 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ninja32.ko 2023-10-18T12:04:31.487 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87410.ko 2023-10-18T12:04:31.488 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17361 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87415.ko 2023-10-18T12:04:31.488 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-18T12:04:31.488 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15377 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_opti.ko 2023-10-18T12:04:31.488 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_optidma.ko 2023-10-18T12:04:31.488 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 32585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-18T12:04:31.489 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 37793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-18T12:04:31.489 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-18T12:04:31.489 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_piccolo.ko 2023-10-18T12:04:31.489 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_radisys.ko 2023-10-18T12:04:31.489 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_rdc.ko 2023-10-18T12:04:31.490 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_rz1000.ko 2023-10-18T12:04:31.490 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sch.ko 2023-10-18T12:04:31.490 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 23097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_serverworks.ko 2023-10-18T12:04:31.490 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 23457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sil680.ko 2023-10-18T12:04:31.490 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-18T12:04:31.491 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_triflex.ko 2023-10-18T12:04:31.491 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 30497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_via.ko 2023-10-18T12:04:31.491 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 22793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pdc_adma.ko 2023-10-18T12:04:31.491 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 29121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_inic162x.ko 2023-10-18T12:04:31.491 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 83345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_mv.ko 2023-10-18T12:04:31.492 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 70393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_nv.ko 2023-10-18T12:04:31.492 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 37377 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_promise.ko 2023-10-18T12:04:31.492 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 23041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_qstor.ko 2023-10-18T12:04:31.492 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 29273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil.ko 2023-10-18T12:04:31.492 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 38337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil24.ko 2023-10-18T12:04:31.493 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sis.ko 2023-10-18T12:04:31.493 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_svw.ko 2023-10-18T12:04:31.493 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 44793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sx4.ko 2023-10-18T12:04:31.493 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_uli.ko 2023-10-18T12:04:31.493 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 35065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_via.ko 2023-10-18T12:04:31.493 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_vsc.ko 2023-10-18T12:04:31.494 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay/ 2023-10-18T12:04:31.494 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-18T12:04:31.494 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma/ 2023-10-18T12:04:31.494 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 124473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma/bcma.ko 2023-10-18T12:04:31.495 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/ 2023-10-18T12:04:31.495 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe/ 2023-10-18T12:04:31.495 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 113665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe/aoe.ko 2023-10-18T12:04:31.495 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd/ 2023-10-18T12:04:31.495 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 965585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd/drbd.ko 2023-10-18T12:04:31.496 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 173225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/floppy.ko 2023-10-18T12:04:31.496 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx/ 2023-10-18T12:04:31.496 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 94297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-18T12:04:31.496 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 115793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/nbd.ko 2023-10-18T12:04:31.496 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk/ 2023-10-18T12:04:31.497 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 110449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-18T12:04:31.497 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 98193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/pktcdvd.ko 2023-10-18T12:04:31.497 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 263769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/rbd.ko 2023-10-18T12:04:31.497 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback/ 2023-10-18T12:04:31.497 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 98145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-18T12:04:31.497 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram/ 2023-10-18T12:04:31.498 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 60217 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram/zram.ko 2023-10-18T12:04:31.498 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ 2023-10-18T12:04:31.498 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 30705 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/applicom.ko 2023-10-18T12:04:31.498 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hangcheck-timer.ko 2023-10-18T12:04:31.498 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/ 2023-10-18T12:04:31.499 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-18T12:04:31.499 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-18T12:04:31.499 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-18T12:04:31.499 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-18T12:04:31.499 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-18T12:04:31.500 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ 2023-10-18T12:04:31.500 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 30713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-18T12:04:31.500 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 148601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-18T12:04:31.500 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 26569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-18T12:04:31.500 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 139313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-18T12:04:31.500 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 70921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-18T12:04:31.501 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 53513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-18T12:04:31.501 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 36321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/lp.ko 2023-10-18T12:04:31.501 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave/ 2023-10-18T12:04:31.501 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 84097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave/mwave.ko 2023-10-18T12:04:31.501 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 25873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/nvram.ko 2023-10-18T12:04:31.502 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 32169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ppdev.ko 2023-10-18T12:04:31.502 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 51113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tlclk.ko 2023-10-18T12:04:31.502 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/ 2023-10-18T12:04:31.502 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-18T12:04:31.502 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-10-18T12:04:31.503 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 23473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-10-18T12:04:31.503 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 32985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-10-18T12:04:31.503 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 30121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-18T12:04:31.503 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 22697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-18T12:04:31.503 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 23561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-10-18T12:04:31.504 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/xillybus/ 2023-10-18T12:04:31.504 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/xillybus/xillybus_class.ko 2023-10-18T12:04:31.504 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 50945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/xillybus/xillybus_core.ko 2023-10-18T12:04:31.504 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-10-18T12:04:31.504 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/clk/ 2023-10-18T12:04:31.505 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/clk/clk-palmas.ko 2023-10-18T12:04:31.505 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 47849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/clk/clk-si5351.ko 2023-10-18T12:04:31.505 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/clk/clk-twl6040.ko 2023-10-18T12:04:31.505 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/clk/clk-wm831x.ko 2023-10-18T12:04:31.505 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/ 2023-10-18T12:04:31.505 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-18T12:04:31.506 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-18T12:04:31.506 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 25297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-18T12:04:31.506 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ 2023-10-18T12:04:31.506 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ 2023-10-18T12:04:31.506 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 70801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-18T12:04:31.507 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 243025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-18T12:04:31.507 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/ 2023-10-18T12:04:31.507 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/ 2023-10-18T12:04:31.507 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common/ 2023-10-18T12:04:31.507 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 438761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-18T12:04:31.508 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-10-18T12:04:31.508 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 24081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-18T12:04:31.508 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-aes.ko 2023-10-18T12:04:31.508 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 21537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-sha.ko 2023-10-18T12:04:31.508 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio/ 2023-10-18T12:04:31.509 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 68857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-18T12:04:31.509 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca/ 2023-10-18T12:04:31.509 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 29785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca/dca.ko 2023-10-18T12:04:31.509 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ 2023-10-18T12:04:31.509 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw/ 2023-10-18T12:04:31.510 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-18T12:04:31.510 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat/ 2023-10-18T12:04:31.510 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 122569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-18T12:04:31.510 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/ 2023-10-18T12:04:31.510 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 79953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/amd64_edac.ko 2023-10-18T12:04:31.510 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 35769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/e752x_edac.ko 2023-10-18T12:04:31.511 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 63617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-18T12:04:31.511 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3000_edac.ko 2023-10-18T12:04:31.511 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3200_edac.ko 2023-10-18T12:04:31.511 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 22537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5100_edac.ko 2023-10-18T12:04:31.511 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 25657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5400_edac.ko 2023-10-18T12:04:31.512 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 24913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7300_edac.ko 2023-10-18T12:04:31.512 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 52041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7core_edac.ko 2023-10-18T12:04:31.512 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i82975x_edac.ko 2023-10-18T12:04:31.512 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/ie31200_edac.ko 2023-10-18T12:04:31.512 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 56825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/sb_edac.ko 2023-10-18T12:04:31.513 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/x38_edac.ko 2023-10-18T12:04:31.513 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/ 2023-10-18T12:04:31.513 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-gpio.ko 2023-10-18T12:04:31.513 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 27185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-max14577.ko 2023-10-18T12:04:31.513 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 29569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-max77693.ko 2023-10-18T12:04:31.513 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 24745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-max8997.ko 2023-10-18T12:04:31.514 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 26537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-palmas.ko 2023-10-18T12:04:31.514 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 23713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-rt8973a.ko 2023-10-18T12:04:31.514 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 27785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/extcon/extcon-sm5502.ko 2023-10-18T12:04:31.514 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/ 2023-10-18T12:04:31.514 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 34977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/dmi-sysfs.ko 2023-10-18T12:04:31.515 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/efi/ 2023-10-18T12:04:31.515 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/efi/efi-pstore.ko 2023-10-18T12:04:31.515 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-18T12:04:31.515 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/ 2023-10-18T12:04:31.515 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-adp5520.ko 2023-10-18T12:04:31.516 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-amd8111.ko 2023-10-18T12:04:31.516 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-arizona.ko 2023-10-18T12:04:31.516 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-da9052.ko 2023-10-18T12:04:31.516 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-da9055.ko 2023-10-18T12:04:31.516 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 22065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-dln2.ko 2023-10-18T12:04:31.517 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 77849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-f7188x.ko 2023-10-18T12:04:31.517 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 28937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-generic.ko 2023-10-18T12:04:31.517 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-ich.ko 2023-10-18T12:04:31.517 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-10-18T12:04:31.517 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-kempld.ko 2023-10-18T12:04:31.517 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-lp3943.ko 2023-10-18T12:04:31.518 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-max7300.ko 2023-10-18T12:04:31.518 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-max730x.ko 2023-10-18T12:04:31.518 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 22073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-max732x.ko 2023-10-18T12:04:31.518 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 25145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-10-18T12:04:31.519 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 47073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-pca953x.ko 2023-10-18T12:04:31.519 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 26825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-pcf857x.ko 2023-10-18T12:04:31.519 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14377 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-rdc321x.ko 2023-10-18T12:04:31.519 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-sch.ko 2023-10-18T12:04:31.519 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-sch311x.ko 2023-10-18T12:04:31.520 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-tps65912.ko 2023-10-18T12:04:31.520 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 21057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-twl4030.ko 2023-10-18T12:04:31.520 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-twl6040.ko 2023-10-18T12:04:31.520 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-18T12:04:31.520 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15377 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-vx855.ko 2023-10-18T12:04:31.520 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16281 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-wm831x.ko 2023-10-18T12:04:31.521 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-wm8350.ko 2023-10-18T12:04:31.521 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-wm8994.ko 2023-10-18T12:04:31.521 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/ 2023-10-18T12:04:31.521 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-a4tech.ko 2023-10-18T12:04:31.521 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 39169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-apple.ko 2023-10-18T12:04:31.522 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-appleir.ko 2023-10-18T12:04:31.522 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 8353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-aureal.ko 2023-10-18T12:04:31.522 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-axff.ko 2023-10-18T12:04:31.522 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-belkin.ko 2023-10-18T12:04:31.522 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-cherry.ko 2023-10-18T12:04:31.523 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-chicony.ko 2023-10-18T12:04:31.523 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 60649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-cp2112.ko 2023-10-18T12:04:31.523 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-cypress.ko 2023-10-18T12:04:31.523 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-dr.ko 2023-10-18T12:04:31.523 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elecom.ko 2023-10-18T12:04:31.524 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elo.ko 2023-10-18T12:04:31.524 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-emsff.ko 2023-10-18T12:04:31.524 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ezkey.ko 2023-10-18T12:04:31.524 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gaff.ko 2023-10-18T12:04:31.524 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-generic.ko 2023-10-18T12:04:31.524 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gt683r.ko 2023-10-18T12:04:31.525 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gyration.ko 2023-10-18T12:04:31.525 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-18T12:04:31.525 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-18T12:04:31.525 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtekff.ko 2023-10-18T12:04:31.525 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-hyperv.ko 2023-10-18T12:04:31.526 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-icade.ko 2023-10-18T12:04:31.526 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-kensington.ko 2023-10-18T12:04:31.526 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 8545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-keytouch.ko 2023-10-18T12:04:31.526 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-kye.ko 2023-10-18T12:04:31.526 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lcpower.ko 2023-10-18T12:04:31.527 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-led.ko 2023-10-18T12:04:31.527 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 42361 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lenovo.ko 2023-10-18T12:04:31.527 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 30761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lg-g15.ko 2023-10-18T12:04:31.527 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 58185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-18T12:04:31.527 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 101369 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-18T12:04:31.528 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 80993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech.ko 2023-10-18T12:04:31.528 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 30801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-magicmouse.ko 2023-10-18T12:04:31.528 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 21969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-microsoft.ko 2023-10-18T12:04:31.528 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10361 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-monterey.ko 2023-10-18T12:04:31.528 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 50161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-multitouch.ko 2023-10-18T12:04:31.528 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 32593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ntrig.ko 2023-10-18T12:04:31.529 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 8857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ortek.ko 2023-10-18T12:04:31.529 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-penmount.ko 2023-10-18T12:04:31.529 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-petalynx.ko 2023-10-18T12:04:31.529 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 72937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-picolcd.ko 2023-10-18T12:04:31.529 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-pl.ko 2023-10-18T12:04:31.530 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-plantronics.ko 2023-10-18T12:04:31.530 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 8417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-primax.ko 2023-10-18T12:04:31.530 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 35457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-rmi.ko 2023-10-18T12:04:31.530 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-18T12:04:31.530 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-18T12:04:31.531 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 31425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-18T12:04:31.531 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 29729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-18T12:04:31.531 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 31129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-18T12:04:31.531 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 21137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-18T12:04:31.531 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 29489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-18T12:04:31.532 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-18T12:04:31.532 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 29313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-18T12:04:31.532 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 27937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-18T12:04:31.532 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-18T12:04:31.532 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 23337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat.ko 2023-10-18T12:04:31.533 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-saitek.ko 2023-10-18T12:04:31.533 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-samsung.ko 2023-10-18T12:04:31.533 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 36817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-18T12:04:31.533 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sjoy.ko 2023-10-18T12:04:31.533 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 51249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sony.ko 2023-10-18T12:04:31.533 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 8313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-speedlink.ko 2023-10-18T12:04:31.534 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 25297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-steelseries.ko 2023-10-18T12:04:31.534 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sunplus.ko 2023-10-18T12:04:31.534 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-18T12:04:31.534 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tivo.ko 2023-10-18T12:04:31.534 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tmff.ko 2023-10-18T12:04:31.535 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-topseed.ko 2023-10-18T12:04:31.535 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-twinhan.ko 2023-10-18T12:04:31.535 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 71073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-uclogic.ko 2023-10-18T12:04:31.535 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-waltop.ko 2023-10-18T12:04:31.535 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 143473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-wiimote.ko 2023-10-18T12:04:31.536 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 8153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-xinmo.ko 2023-10-18T12:04:31.536 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zpff.ko 2023-10-18T12:04:31.536 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zydacron.ko 2023-10-18T12:04:31.536 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 267825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid.ko 2023-10-18T12:04:31.536 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 32321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/uhid.ko 2023-10-18T12:04:31.536 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/usbhid/ 2023-10-18T12:04:31.537 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 125721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/usbhid/usbhid.ko 2023-10-18T12:04:31.537 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/usbhid/usbkbd.ko 2023-10-18T12:04:31.537 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/usbhid/usbmouse.ko 2023-10-18T12:04:31.537 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 217873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/wacom.ko 2023-10-18T12:04:31.537 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/ 2023-10-18T12:04:31.538 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 64201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_balloon.ko 2023-10-18T12:04:31.538 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 89625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_utils.ko 2023-10-18T12:04:31.538 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 305465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_vmbus.ko 2023-10-18T12:04:31.538 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ 2023-10-18T12:04:31.538 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 66521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru.ko 2023-10-18T12:04:31.539 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 61393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru3.ko 2023-10-18T12:04:31.539 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 34745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-18T12:04:31.539 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7414.ko 2023-10-18T12:04:31.539 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7418.ko 2023-10-18T12:04:31.539 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 25257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adc128d818.ko 2023-10-18T12:04:31.539 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 31729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1025.ko 2023-10-18T12:04:31.540 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 97977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1026.ko 2023-10-18T12:04:31.540 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1029.ko 2023-10-18T12:04:31.540 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 45553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1031.ko 2023-10-18T12:04:31.540 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 26289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm9240.ko 2023-10-18T12:04:31.540 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ads7828.ko 2023-10-18T12:04:31.541 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7410.ko 2023-10-18T12:04:31.541 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 22049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7411.ko 2023-10-18T12:04:31.541 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 74433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7462.ko 2023-10-18T12:04:31.541 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 39585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7470.ko 2023-10-18T12:04:31.541 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 67929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7475.ko 2023-10-18T12:04:31.542 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7x10.ko 2023-10-18T12:04:31.542 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 39073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/amc6821.ko 2023-10-18T12:04:31.542 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 55265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/applesmc.ko 2023-10-18T12:04:31.542 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 49913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asb100.ko 2023-10-18T12:04:31.542 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 58617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asc7621.ko 2023-10-18T12:04:31.543 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 40889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-18T12:04:31.543 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/atxp1.ko 2023-10-18T12:04:31.543 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 28281 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/coretemp.ko 2023-10-18T12:04:31.543 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 24657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/da9052-hwmon.ko 2023-10-18T12:04:31.543 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/da9055-hwmon.ko 2023-10-18T12:04:31.544 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 44465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-18T12:04:31.544 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 99601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dme1737.ko 2023-10-18T12:04:31.544 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds1621.ko 2023-10-18T12:04:31.544 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds620.ko 2023-10-18T12:04:31.544 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 29777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc1403.ko 2023-10-18T12:04:31.545 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 33185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc2103.ko 2023-10-18T12:04:31.545 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 30321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc6w201.ko 2023-10-18T12:04:31.545 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 66985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71805f.ko 2023-10-18T12:04:31.545 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 94457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71882fg.ko 2023-10-18T12:04:31.545 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 41401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f75375s.ko 2023-10-18T12:04:31.545 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 21305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-18T12:04:31.546 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 55449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fschmd.ko 2023-10-18T12:04:31.546 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g760a.ko 2023-10-18T12:04:31.546 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 24017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g762.ko 2023-10-18T12:04:31.546 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 46801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl518sm.ko 2023-10-18T12:04:31.546 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 45529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl520sm.ko 2023-10-18T12:04:31.547 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/hih6130.ko 2023-10-18T12:04:31.547 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-18T12:04:31.547 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-18T12:04:31.547 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 22601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-18T12:04:31.547 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 34529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmaem.ko 2023-10-18T12:04:31.548 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 21321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmpex.ko 2023-10-18T12:04:31.548 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 24873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina209.ko 2023-10-18T12:04:31.548 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina2xx.ko 2023-10-18T12:04:31.548 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 130449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/it87.ko 2023-10-18T12:04:31.548 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/jc42.ko 2023-10-18T12:04:31.548 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 24329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k10temp.ko 2023-10-18T12:04:31.549 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k8temp.ko 2023-10-18T12:04:31.549 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-18T12:04:31.549 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 48601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm63.ko 2023-10-18T12:04:31.549 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm73.ko 2023-10-18T12:04:31.549 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 36777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm75.ko 2023-10-18T12:04:31.550 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm77.ko 2023-10-18T12:04:31.550 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 34657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm78.ko 2023-10-18T12:04:31.550 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 31745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm80.ko 2023-10-18T12:04:31.550 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm83.ko 2023-10-18T12:04:31.550 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 72833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm85.ko 2023-10-18T12:04:31.551 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 46153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm87.ko 2023-10-18T12:04:31.551 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 37913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm90.ko 2023-10-18T12:04:31.551 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm92.ko 2023-10-18T12:04:31.551 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 108841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm93.ko 2023-10-18T12:04:31.551 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 33393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95234.ko 2023-10-18T12:04:31.552 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95241.ko 2023-10-18T12:04:31.552 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95245.ko 2023-10-18T12:04:31.552 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 24017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc2945.ko 2023-10-18T12:04:31.552 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4151.ko 2023-10-18T12:04:31.552 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4215.ko 2023-10-18T12:04:31.553 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4222.ko 2023-10-18T12:04:31.553 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4245.ko 2023-10-18T12:04:31.553 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4260.ko 2023-10-18T12:04:31.553 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4261.ko 2023-10-18T12:04:31.553 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 33489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max16065.ko 2023-10-18T12:04:31.554 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1619.ko 2023-10-18T12:04:31.554 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 24353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1668.ko 2023-10-18T12:04:31.554 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max197.ko 2023-10-18T12:04:31.554 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 27129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6639.ko 2023-10-18T12:04:31.554 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 23321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6650.ko 2023-10-18T12:04:31.555 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 35777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6697.ko 2023-10-18T12:04:31.555 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/mc13783-adc.ko 2023-10-18T12:04:31.555 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/mcp3021.ko 2023-10-18T12:04:31.555 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-10-18T12:04:31.555 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 44129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6683.ko 2023-10-18T12:04:31.555 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 119817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-18T12:04:31.556 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 60705 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775.ko 2023-10-18T12:04:31.556 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 59737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct7802.ko 2023-10-18T12:04:31.556 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 82337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87360.ko 2023-10-18T12:04:31.556 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 54433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87427.ko 2023-10-18T12:04:31.556 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pcf8591.ko 2023-10-18T12:04:31.557 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ 2023-10-18T12:04:31.557 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 21353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-18T12:04:31.557 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-18T12:04:31.557 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 28329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-18T12:04:31.557 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-18T12:04:31.557 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-18T12:04:31.558 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-18T12:04:31.558 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-18T12:04:31.558 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 82577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-18T12:04:31.558 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 8729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-18T12:04:31.558 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 30729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-18T12:04:31.559 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-18T12:04:31.559 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-18T12:04:31.559 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/powr1220.ko 2023-10-18T12:04:31.559 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18705 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5627.ko 2023-10-18T12:04:31.559 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 28817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5636.ko 2023-10-18T12:04:31.559 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 27145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-18T12:04:31.560 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 32137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht15.ko 2023-10-18T12:04:31.560 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht21.ko 2023-10-18T12:04:31.560 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/shtc1.ko 2023-10-18T12:04:31.560 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 40105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sis5595.ko 2023-10-18T12:04:31.560 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-18T12:04:31.561 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 39193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-18T12:04:31.561 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 37385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-18T12:04:31.561 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 26553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/thmc50.ko 2023-10-18T12:04:31.561 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp102.ko 2023-10-18T12:04:31.561 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp103.ko 2023-10-18T12:04:31.562 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 21257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp401.ko 2023-10-18T12:04:31.562 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp421.ko 2023-10-18T12:04:31.562 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-18T12:04:31.562 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 41945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via686a.ko 2023-10-18T12:04:31.562 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 52457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt1211.ko 2023-10-18T12:04:31.563 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 51545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt8231.ko 2023-10-18T12:04:31.563 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 57513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-18T12:04:31.563 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 78873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627hf.ko 2023-10-18T12:04:31.563 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 71345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83781d.ko 2023-10-18T12:04:31.563 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 63289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83791d.ko 2023-10-18T12:04:31.564 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 71321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83792d.ko 2023-10-18T12:04:31.564 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 101473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83793.ko 2023-10-18T12:04:31.564 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 119505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83795.ko 2023-10-18T12:04:31.564 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-18T12:04:31.564 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 35625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-18T12:04:31.564 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-10-18T12:04:31.565 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-10-18T12:04:31.565 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/ 2023-10-18T12:04:31.565 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/ 2023-10-18T12:04:31.565 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-18T12:04:31.565 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-18T12:04:31.566 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/ 2023-10-18T12:04:31.566 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 27969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-10-18T12:04:31.566 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 28801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-10-18T12:04:31.566 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 27777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-10-18T12:04:31.567 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-18T12:04:31.567 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 26193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-18T12:04:31.567 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-18T12:04:31.567 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-10-18T12:04:31.567 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 6929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-18T12:04:31.567 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-10-18T12:04:31.568 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 50201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-18T12:04:31.568 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 23905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-18T12:04:31.568 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-18T12:04:31.568 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-18T12:04:31.568 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-10-18T12:04:31.569 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-10-18T12:04:31.569 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 62817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-18T12:04:31.569 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 22433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-18T12:04:31.569 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 47889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-18T12:04:31.569 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-10-18T12:04:31.570 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-18T12:04:31.570 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 22337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-18T12:04:31.570 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 26329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-10-18T12:04:31.570 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 25145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-18T12:04:31.570 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-18T12:04:31.571 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 47241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-18T12:04:31.571 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-10-18T12:04:31.571 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-18T12:04:31.571 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-18T12:04:31.571 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 22313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-10-18T12:04:31.572 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 29361 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-10-18T12:04:31.572 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-18T12:04:31.572 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-10-18T12:04:31.572 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-18T12:04:31.572 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-18T12:04:31.573 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 26081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-18T12:04:31.573 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-18T12:04:31.573 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 47657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-10-18T12:04:31.573 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 22449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-mux.ko 2023-10-18T12:04:31.573 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-18T12:04:31.573 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 27073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-stub.ko 2023-10-18T12:04:31.574 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/muxes/ 2023-10-18T12:04:31.574 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-10-18T12:04:31.574 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-10-18T12:04:31.574 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 29801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-10-18T12:04:31.574 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ 2023-10-18T12:04:31.575 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ 2023-10-18T12:04:31.575 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 273609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-18T12:04:31.575 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 879969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-18T12:04:31.575 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 69337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-18T12:04:31.575 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 324217 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-18T12:04:31.576 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 97985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-18T12:04:31.576 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 282273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-18T12:04:31.576 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 66201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-18T12:04:31.576 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/ 2023-10-18T12:04:31.576 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4/ 2023-10-18T12:04:31.577 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 493073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-18T12:04:31.577 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4/ 2023-10-18T12:04:31.577 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 419737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-18T12:04:31.577 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5/ 2023-10-18T12:04:31.577 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 739025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-18T12:04:31.578 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca/ 2023-10-18T12:04:31.578 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 296625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-18T12:04:31.578 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/ocrdma/ 2023-10-18T12:04:31.578 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 153697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-10-18T12:04:31.578 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/usnic/ 2023-10-18T12:04:31.579 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 168969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-10-18T12:04:31.579 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ 2023-10-18T12:04:31.579 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib/ 2023-10-18T12:04:31.579 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 263081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-18T12:04:31.579 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser/ 2023-10-18T12:04:31.580 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 100241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-18T12:04:31.580 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert/ 2023-10-18T12:04:31.580 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 111425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-18T12:04:31.580 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp/ 2023-10-18T12:04:31.580 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 128753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-18T12:04:31.580 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt/ 2023-10-18T12:04:31.581 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 129529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-18T12:04:31.581 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/ 2023-10-18T12:04:31.581 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/evbug.ko 2023-10-18T12:04:31.581 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 24129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/ff-memless.ko 2023-10-18T12:04:31.582 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/ 2023-10-18T12:04:31.582 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-18T12:04:31.582 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-18T12:04:31.582 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 41241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/gameport.ko 2023-10-18T12:04:31.582 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 41801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/joydev.ko 2023-10-18T12:04:31.583 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/ 2023-10-18T12:04:31.583 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-10-18T12:04:31.583 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-10-18T12:04:31.583 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 26905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-10-18T12:04:31.583 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 24761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-10-18T12:04:31.583 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 36665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-18T12:04:31.584 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-10-18T12:04:31.584 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 21257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/lkkbd.ko 2023-10-18T12:04:31.584 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 26473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/lm8323.ko 2023-10-18T12:04:31.584 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/lm8333.ko 2023-10-18T12:04:31.584 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 24265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-10-18T12:04:31.585 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18217 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-10-18T12:04:31.585 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-10-18T12:04:31.585 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-10-18T12:04:31.585 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/newtonkbd.ko 2023-10-18T12:04:31.585 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-10-18T12:04:31.586 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/qt1070.ko 2023-10-18T12:04:31.586 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/qt2160.ko 2023-10-18T12:04:31.586 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 23817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-10-18T12:04:31.586 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/stowaway.ko 2023-10-18T12:04:31.586 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/sunkbd.ko 2023-10-18T12:04:31.587 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-10-18T12:04:31.587 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-10-18T12:04:31.587 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-10-18T12:04:31.587 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/xtkbd.ko 2023-10-18T12:04:31.587 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/matrix-keymap.ko 2023-10-18T12:04:31.588 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/ 2023-10-18T12:04:31.588 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 34329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/appletouch.ko 2023-10-18T12:04:31.588 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 34177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-18T12:04:31.588 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 123681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-18T12:04:31.588 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 89449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-18T12:04:31.589 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/gpio_mouse.ko 2023-10-18T12:04:31.589 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 335977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/psmouse.ko 2023-10-18T12:04:31.589 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/sermouse.ko 2023-10-18T12:04:31.589 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 23881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-18T12:04:31.589 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 22569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-18T12:04:31.590 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-18T12:04:31.590 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4/ 2023-10-18T12:04:31.590 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 109873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-18T12:04:31.590 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/ 2023-10-18T12:04:31.590 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-18T12:04:31.591 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-18T12:04:31.591 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/ct82c710.ko 2023-10-18T12:04:31.591 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-18T12:04:31.591 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/parkbd.ko 2023-10-18T12:04:31.591 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/pcips2.ko 2023-10-18T12:04:31.592 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/ps2mult.ko 2023-10-18T12:04:31.592 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 24153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/serio_raw.ko 2023-10-18T12:04:31.592 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/serport.ko 2023-10-18T12:04:31.592 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/sparse-keymap.ko 2023-10-18T12:04:31.592 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/ 2023-10-18T12:04:31.592 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd/ 2023-10-18T12:04:31.593 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 39289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-18T12:04:31.593 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/ 2023-10-18T12:04:31.593 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-88pm860x.ko 2023-10-18T12:04:31.593 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-adp5520.ko 2023-10-18T12:04:31.593 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 59753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-bd2802.ko 2023-10-18T12:04:31.594 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 24785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-blinkm.ko 2023-10-18T12:04:31.594 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-da903x.ko 2023-10-18T12:04:31.594 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-da9052.ko 2023-10-18T12:04:31.594 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-gpio.ko 2023-10-18T12:04:31.594 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3530.ko 2023-10-18T12:04:31.595 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 30505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3533.ko 2023-10-18T12:04:31.595 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm355x.ko 2023-10-18T12:04:31.595 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3642.ko 2023-10-18T12:04:31.595 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lp3944.ko 2023-10-18T12:04:31.595 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lp8788.ko 2023-10-18T12:04:31.596 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-max8997.ko 2023-10-18T12:04:31.596 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-mc13783.ko 2023-10-18T12:04:31.596 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-menf21bmc.ko 2023-10-18T12:04:31.596 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-pca9532.ko 2023-10-18T12:04:31.596 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-pca955x.ko 2023-10-18T12:04:31.597 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-pca963x.ko 2023-10-18T12:04:31.597 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 34433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-ss4200.ko 2023-10-18T12:04:31.597 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 24865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-tca6507.ko 2023-10-18T12:04:31.597 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-wm831x-status.ko 2023-10-18T12:04:31.597 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-wm8350.ko 2023-10-18T12:04:31.598 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ 2023-10-18T12:04:31.598 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-18T12:04:31.598 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-18T12:04:31.598 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-18T12:04:31.598 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 7617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-18T12:04:31.598 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-18T12:04:31.599 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-18T12:04:31.599 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-18T12:04:31.599 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-18T12:04:31.599 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/ 2023-10-18T12:04:31.599 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache/ 2023-10-18T12:04:31.600 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 654969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache/bcache.ko 2023-10-18T12:04:31.600 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 40577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-bio-prison.ko 2023-10-18T12:04:31.600 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 89601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-bufio.ko 2023-10-18T12:04:31.600 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 47529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache-smq.ko 2023-10-18T12:04:31.600 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 156009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache.ko 2023-10-18T12:04:31.601 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 106897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-crypt.ko 2023-10-18T12:04:31.601 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 21545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-delay.ko 2023-10-18T12:04:31.601 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 53857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-era.ko 2023-10-18T12:04:31.601 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 28465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-flakey.ko 2023-10-18T12:04:31.601 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 41593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-log-userspace.ko 2023-10-18T12:04:31.601 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 32737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-log.ko 2023-10-18T12:04:31.602 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 49545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-mirror.ko 2023-10-18T12:04:31.602 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 78033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-multipath.ko 2023-10-18T12:04:31.602 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-queue-length.ko 2023-10-18T12:04:31.602 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 70825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-raid.ko 2023-10-18T12:04:31.603 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 36297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-region-hash.ko 2023-10-18T12:04:31.603 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-round-robin.ko 2023-10-18T12:04:31.603 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-service-time.ko 2023-10-18T12:04:31.603 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 109593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-snapshot.ko 2023-10-18T12:04:31.603 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19361 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-switch.ko 2023-10-18T12:04:31.603 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 181865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-thin-pool.ko 2023-10-18T12:04:31.604 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 51737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-verity.ko 2023-10-18T12:04:31.604 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 8561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-zero.ko 2023-10-18T12:04:31.604 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/faulty.ko 2023-10-18T12:04:31.604 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/linear.ko 2023-10-18T12:04:31.604 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 32417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/multipath.ko 2023-10-18T12:04:31.605 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data/ 2023-10-18T12:04:31.605 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 199937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-18T12:04:31.605 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 37337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid0.ko 2023-10-18T12:04:31.605 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 113073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid1.ko 2023-10-18T12:04:31.605 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 158681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid10.ko 2023-10-18T12:04:31.605 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 395721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid456.ko 2023-10-18T12:04:31.606 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/ 2023-10-18T12:04:31.606 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/ 2023-10-18T12:04:31.606 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 178137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptbase.ko 2023-10-18T12:04:31.606 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 63385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptctl.ko 2023-10-18T12:04:31.607 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 44665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptfc.ko 2023-10-18T12:04:31.607 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 37225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptlan.ko 2023-10-18T12:04:31.607 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 123321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptsas.ko 2023-10-18T12:04:31.607 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 79041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-18T12:04:31.607 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 53081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptspi.ko 2023-10-18T12:04:31.607 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/ 2023-10-18T12:04:31.608 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/88pm800.ko 2023-10-18T12:04:31.608 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/88pm805.ko 2023-10-18T12:04:31.608 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/88pm80x.ko 2023-10-18T12:04:31.608 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/arizona-i2c.ko 2023-10-18T12:04:31.608 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 123721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/arizona.ko 2023-10-18T12:04:31.609 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/bcm590xx.ko 2023-10-18T12:04:31.609 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/cros_ec_dev.ko 2023-10-18T12:04:31.609 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 34961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/dln2.ko 2023-10-18T12:04:31.609 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/janz-cmodio.ko 2023-10-18T12:04:31.609 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 53585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/kempld-core.ko 2023-10-18T12:04:31.610 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 27529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lm3533-core.ko 2023-10-18T12:04:31.610 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-10-18T12:04:31.610 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lp3943.ko 2023-10-18T12:04:31.610 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 54569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_ich.ko 2023-10-18T12:04:31.610 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_sch.ko 2023-10-18T12:04:31.611 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/max8907.ko 2023-10-18T12:04:31.611 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 29857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/mc13xxx-core.ko 2023-10-18T12:04:31.611 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-10-18T12:04:31.611 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/menf21bmc.ko 2023-10-18T12:04:31.611 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/pcf50633-adc.ko 2023-10-18T12:04:31.612 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/pcf50633-gpio.ko 2023-10-18T12:04:31.612 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 34873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/pcf50633.ko 2023-10-18T12:04:31.612 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-10-18T12:04:31.612 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/retu-mfd.ko 2023-10-18T12:04:31.612 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 80425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/si476x-core.ko 2023-10-18T12:04:31.613 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 48457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/sm501.ko 2023-10-18T12:04:31.613 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-10-18T12:04:31.613 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 51137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/tps65010.ko 2023-10-18T12:04:31.613 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/tps6507x.ko 2023-10-18T12:04:31.613 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/viperboard.ko 2023-10-18T12:04:31.613 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/vx855.ko 2023-10-18T12:04:31.614 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/wl1273-core.ko 2023-10-18T12:04:31.614 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 44345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/wm8994.ko 2023-10-18T12:04:31.614 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ 2023-10-18T12:04:31.614 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-10-18T12:04:31.614 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 48489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ad525x_dpot.ko 2023-10-18T12:04:31.615 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl/ 2023-10-18T12:04:31.615 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 46585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-18T12:04:31.615 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds9802als.ko 2023-10-18T12:04:31.615 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 36729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds990x.ko 2023-10-18T12:04:31.615 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 45593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/bh1770glc.ko 2023-10-18T12:04:31.616 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/c2port/ 2023-10-18T12:04:31.616 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-10-18T12:04:31.616 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 35281 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/c2port/core.ko 2023-10-18T12:04:31.616 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710/ 2023-10-18T12:04:31.616 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 25161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710/cb710.ko 2023-10-18T12:04:31.616 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ds1682.ko 2023-10-18T12:04:31.617 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 8897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/dummy-irq.ko 2023-10-18T12:04:31.617 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/echo/ 2023-10-18T12:04:31.617 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/echo/echo.ko 2023-10-18T12:04:31.617 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/ 2023-10-18T12:04:31.617 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 37849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/at24.ko 2023-10-18T12:04:31.618 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-18T12:04:31.618 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-18T12:04:31.618 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-18T12:04:31.618 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 33009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/enclosure.ko 2023-10-18T12:04:31.618 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/genwqe/ 2023-10-18T12:04:31.619 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 152201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-10-18T12:04:31.619 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/hmc6352.ko 2023-10-18T12:04:31.619 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 31321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/hpilo.ko 2023-10-18T12:04:31.619 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ibmasm/ 2023-10-18T12:04:31.619 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 72129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-10-18T12:04:31.619 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ics932s401.ko 2023-10-18T12:04:31.620 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 21681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29003.ko 2023-10-18T12:04:31.620 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29020.ko 2023-10-18T12:04:31.620 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/ 2023-10-18T12:04:31.620 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 42513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-18T12:04:31.620 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-18T12:04:31.620 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/ 2023-10-18T12:04:31.621 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 125209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-me.ko 2023-10-18T12:04:31.621 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 56521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-18T12:04:31.621 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 310113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei.ko 2023-10-18T12:04:31.621 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 31329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/phantom.ko 2023-10-18T12:04:31.621 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ti-st/ 2023-10-18T12:04:31.622 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 74265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/ti-st/st_drv.ko 2023-10-18T12:04:31.622 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 24305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-18T12:04:31.622 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 28849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_core.ko 2023-10-18T12:04:31.622 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tsl2550.ko 2023-10-18T12:04:31.622 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 48697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_balloon.ko 2023-10-18T12:04:31.623 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci/ 2023-10-18T12:04:31.623 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 183609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-18T12:04:31.623 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ 2023-10-18T12:04:31.623 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding/ 2023-10-18T12:04:31.623 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 490129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding/bonding.ko 2023-10-18T12:04:31.623 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/ 2023-10-18T12:04:31.624 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53/ 2023-10-18T12:04:31.624 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 106033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-18T12:04:31.624 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 40297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-18T12:04:31.624 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-18T12:04:31.624 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx/ 2023-10-18T12:04:31.625 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 453737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-18T12:04:31.625 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dummy.ko 2023-10-18T12:04:31.625 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/eql.ko 2023-10-18T12:04:31.625 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ 2023-10-18T12:04:31.625 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/ 2023-10-18T12:04:31.626 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 45785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-18T12:04:31.626 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 42105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-18T12:04:31.626 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 130553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-18T12:04:31.626 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 68849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-18T12:04:31.626 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/ 2023-10-18T12:04:31.627 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 37649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-18T12:04:31.627 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 59689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-18T12:04:31.627 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 27201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-18T12:04:31.627 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 99113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-18T12:04:31.627 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec/ 2023-10-18T12:04:31.628 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 54521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-18T12:04:31.628 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere/ 2023-10-18T12:04:31.628 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 69201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-18T12:04:31.628 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon/ 2023-10-18T12:04:31.628 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 59585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-18T12:04:31.629 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera/ 2023-10-18T12:04:31.629 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 41409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-18T12:04:31.629 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/ 2023-10-18T12:04:31.629 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 54609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-18T12:04:31.629 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 49289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-18T12:04:31.629 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 87297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-18T12:04:31.630 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/ 2023-10-18T12:04:31.630 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx/ 2023-10-18T12:04:31.630 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 97337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-18T12:04:31.630 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-10-18T12:04:31.630 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 104673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-18T12:04:31.631 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-10-18T12:04:31.631 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 90257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-18T12:04:31.631 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/ 2023-10-18T12:04:31.631 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 81569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-18T12:04:31.632 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 69729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-18T12:04:31.632 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/ 2023-10-18T12:04:31.632 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 78401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-18T12:04:31.632 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 176761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-18T12:04:31.632 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-10-18T12:04:31.632 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 1421497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-18T12:04:31.733 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 128569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-18T12:04:31.734 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet/ 2023-10-18T12:04:31.734 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 132089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-18T12:04:31.734 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 312081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-18T12:04:31.734 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/ 2023-10-18T12:04:31.735 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna/ 2023-10-18T12:04:31.735 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 323513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-18T12:04:31.735 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/ 2023-10-18T12:04:31.735 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-10-18T12:04:31.735 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 193497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-18T12:04:31.736 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-10-18T12:04:31.736 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 347417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-18T12:04:31.736 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-10-18T12:04:31.736 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 1044433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-18T12:04:31.736 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-10-18T12:04:31.736 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 166193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-18T12:04:31.737 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-10-18T12:04:31.737 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 34881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-18T12:04:31.737 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/ 2023-10-18T12:04:31.737 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic/ 2023-10-18T12:04:31.737 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 204345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-18T12:04:31.737 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/ 2023-10-18T12:04:31.738 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/ 2023-10-18T12:04:31.738 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 69449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-18T12:04:31.738 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 61489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-18T12:04:31.738 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 141225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-18T12:04:31.738 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 51497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-18T12:04:31.739 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 62817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-18T12:04:31.739 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 31369 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-18T12:04:31.739 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/ 2023-10-18T12:04:31.739 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 60873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-18T12:04:31.740 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 62833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-18T12:04:31.740 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 45721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dnet.ko 2023-10-18T12:04:31.740 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 25185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ec_bhf.ko 2023-10-18T12:04:31.740 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/ 2023-10-18T12:04:31.740 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet/ 2023-10-18T12:04:31.740 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 281137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-18T12:04:31.741 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 49457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-18T12:04:31.741 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 51737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-18T12:04:31.741 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fujitsu/ 2023-10-18T12:04:31.741 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 45345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-10-18T12:04:31.741 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ 2023-10-18T12:04:31.742 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 90465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-18T12:04:31.742 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000/ 2023-10-18T12:04:31.742 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 295577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-18T12:04:31.742 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e/ 2023-10-18T12:04:31.743 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 584497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-18T12:04:31.743 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k/ 2023-10-18T12:04:31.743 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 246209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-18T12:04:31.743 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e/ 2023-10-18T12:04:31.743 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 925697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-18T12:04:31.743 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf/ 2023-10-18T12:04:31.744 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 302849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-18T12:04:31.744 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb/ 2023-10-18T12:04:31.744 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 514681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-18T12:04:31.744 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf/ 2023-10-18T12:04:31.744 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 93593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-18T12:04:31.745 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-10-18T12:04:31.745 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 734305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-18T12:04:31.745 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-10-18T12:04:31.745 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 151769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-18T12:04:31.745 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 86921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/jme.ko 2023-10-18T12:04:31.746 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/ 2023-10-18T12:04:31.746 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-18T12:04:31.746 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 102289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-18T12:04:31.746 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 122649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-18T12:04:31.746 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/ 2023-10-18T12:04:31.747 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-10-18T12:04:31.747 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 727601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-18T12:04:31.747 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 278937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-18T12:04:31.747 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-10-18T12:04:31.747 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-10-18T12:04:31.747 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 1113993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-18T12:04:31.748 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ 2023-10-18T12:04:31.748 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 53105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-10-18T12:04:31.748 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 40993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-10-18T12:04:31.748 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-10-18T12:04:31.748 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 95665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-18T12:04:31.748 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/ 2023-10-18T12:04:31.749 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-10-18T12:04:31.749 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 108649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-18T12:04:31.749 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/ 2023-10-18T12:04:31.749 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 73441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-18T12:04:31.749 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 47777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-18T12:04:31.749 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion/ 2023-10-18T12:04:31.750 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 150905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-18T12:04:31.750 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia/ 2023-10-18T12:04:31.750 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 136721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-18T12:04:31.750 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/ 2023-10-18T12:04:31.750 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 50481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-18T12:04:31.751 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 43145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-18T12:04:31.751 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/ 2023-10-18T12:04:31.751 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-10-18T12:04:31.751 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 227897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-18T12:04:31.752 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 87081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-18T12:04:31.752 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-10-18T12:04:31.752 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 672049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-18T12:04:31.752 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc/ 2023-10-18T12:04:31.752 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 43017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-18T12:04:31.753 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/ 2023-10-18T12:04:31.753 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 67385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-18T12:04:31.753 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 83985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-18T12:04:31.753 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 29321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-18T12:04:31.753 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 189801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-18T12:04:31.753 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/samsung/ 2023-10-18T12:04:31.754 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-10-18T12:04:31.754 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 104241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-10-18T12:04:31.754 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc/ 2023-10-18T12:04:31.754 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 1053921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-18T12:04:31.754 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan/ 2023-10-18T12:04:31.755 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 47097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-18T12:04:31.755 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/ 2023-10-18T12:04:31.755 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 54817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-18T12:04:31.755 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 63337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-18T12:04:31.755 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/ 2023-10-18T12:04:31.756 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 61601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-18T12:04:31.756 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 67193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-18T12:04:31.756 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 73409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-18T12:04:31.756 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 68177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-18T12:04:31.756 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/ 2023-10-18T12:04:31.756 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-10-18T12:04:31.757 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-10-18T12:04:31.757 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 39905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-18T12:04:31.757 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-10-18T12:04:31.757 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 486961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-18T12:04:31.757 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/ 2023-10-18T12:04:31.757 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 103337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-18T12:04:31.758 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 166161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-18T12:04:31.758 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 66329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-18T12:04:31.758 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 78801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-18T12:04:31.758 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti/ 2023-10-18T12:04:31.758 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 50057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-18T12:04:31.759 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti/ 2023-10-18T12:04:31.759 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 86529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-18T12:04:31.759 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/ 2023-10-18T12:04:31.759 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 80273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-18T12:04:31.759 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 83633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-18T12:04:31.759 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/ 2023-10-18T12:04:31.760 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 46241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-18T12:04:31.760 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 30849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-18T12:04:31.760 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom/ 2023-10-18T12:04:31.760 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 60057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-18T12:04:31.760 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/fddi/ 2023-10-18T12:04:31.761 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 41065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/fddi/defxx.ko 2023-10-18T12:04:31.761 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/fddi/skfp/ 2023-10-18T12:04:31.761 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 216985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/fddi/skfp/skfp.ko 2023-10-18T12:04:31.761 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 77345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/geneve.ko 2023-10-18T12:04:31.761 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv/ 2023-10-18T12:04:31.762 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 235521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-18T12:04:31.762 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154/ 2023-10-18T12:04:31.762 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-18T12:04:31.762 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 25065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ifb.ko 2023-10-18T12:04:31.762 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan/ 2023-10-18T12:04:31.763 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 83769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-18T12:04:31.763 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 62209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvlan.ko 2023-10-18T12:04:31.763 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvtap.ko 2023-10-18T12:04:31.763 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/ 2023-10-18T12:04:31.763 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-18T12:04:31.763 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-18T12:04:31.764 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-gpio.ko 2023-10-18T12:04:31.764 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 8825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-18T12:04:31.764 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio.ko 2023-10-18T12:04:31.764 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mii.ko 2023-10-18T12:04:31.764 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 43953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/netconsole.ko 2023-10-18T12:04:31.765 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/nlmon.ko 2023-10-18T12:04:31.765 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/ 2023-10-18T12:04:31.765 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-18T12:04:31.765 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 38977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-18T12:04:31.765 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/ 2023-10-18T12:04:31.765 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/amd.ko 2023-10-18T12:04:31.766 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 50097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-18T12:04:31.766 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 44505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-18T12:04:31.766 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-18T12:04:31.766 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 42241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/broadcom.ko 2023-10-18T12:04:31.766 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/cicada.ko 2023-10-18T12:04:31.767 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/davicom.ko 2023-10-18T12:04:31.767 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/et1011c.ko 2023-10-18T12:04:31.767 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 24969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/icplus.ko 2023-10-18T12:04:31.767 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/lxt.ko 2023-10-18T12:04:31.767 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 82049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/marvell.ko 2023-10-18T12:04:31.768 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 76177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/micrel.ko 2023-10-18T12:04:31.768 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/national.ko 2023-10-18T12:04:31.768 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 97857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/phylink.ko 2023-10-18T12:04:31.768 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/qsemi.ko 2023-10-18T12:04:31.768 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 50065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/realtek.ko 2023-10-18T12:04:31.769 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 29985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/smsc.ko 2023-10-18T12:04:31.769 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-18T12:04:31.769 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 24289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/vitesse.ko 2023-10-18T12:04:31.769 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/plip/ 2023-10-18T12:04:31.769 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 43569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/plip/plip.ko 2023-10-18T12:04:31.769 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ 2023-10-18T12:04:31.770 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-18T12:04:31.770 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 29713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-18T12:04:31.770 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-18T12:04:31.770 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-18T12:04:31.771 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 28729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-18T12:04:31.771 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 42545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppoe.ko 2023-10-18T12:04:31.771 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppox.ko 2023-10-18T12:04:31.771 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 32689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pptp.ko 2023-10-18T12:04:31.771 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 28289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/sb1000.ko 2023-10-18T12:04:31.772 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/ 2023-10-18T12:04:31.772 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 42465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slip.ko 2023-10-18T12:04:31.772 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 26929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/sungem_phy.ko 2023-10-18T12:04:31.772 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 64385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tap.ko 2023-10-18T12:04:31.772 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/ 2023-10-18T12:04:31.773 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 106169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team.ko 2023-10-18T12:04:31.773 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-18T12:04:31.773 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-18T12:04:31.773 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 28881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-18T12:04:31.773 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9641 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_random.ko 2023-10-18T12:04:31.773 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-18T12:04:31.774 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 87017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/veth.ko 2023-10-18T12:04:31.774 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3/ 2023-10-18T12:04:31.774 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 144297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-18T12:04:31.774 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan/ 2023-10-18T12:04:31.775 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 297329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-18T12:04:31.775 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback/ 2023-10-18T12:04:31.775 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 144649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-18T12:04:31.775 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb/ 2023-10-18T12:04:31.775 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb/ntb.ko 2023-10-18T12:04:31.775 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/ 2023-10-18T12:04:31.776 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/ 2023-10-18T12:04:31.776 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 264937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-18T12:04:31.776 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 102209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme.ko 2023-10-18T12:04:31.776 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/ 2023-10-18T12:04:31.776 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 133841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport.ko 2023-10-18T12:04:31.777 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_cs.ko 2023-10-18T12:04:31.777 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 84465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_pc.ko 2023-10-18T12:04:31.777 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 26121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_serial.ko 2023-10-18T12:04:31.777 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/ 2023-10-18T12:04:31.777 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/ 2023-10-18T12:04:31.778 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 25009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-18T12:04:31.778 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-10-18T12:04:31.778 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-10-18T12:04:31.778 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pci-stub.ko 2023-10-18T12:04:31.778 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 46529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/xen-pcifront.ko 2023-10-18T12:04:31.779 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/ 2023-10-18T12:04:31.779 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 26793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/i82092.ko 2023-10-18T12:04:31.779 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 145809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pcmcia.ko 2023-10-18T12:04:31.779 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 62137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pcmcia_core.ko 2023-10-18T12:04:31.779 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 34345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-10-18T12:04:31.779 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 34265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pd6729.ko 2023-10-18T12:04:31.780 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 112889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-18T12:04:31.780 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/phy/ 2023-10-18T12:04:31.780 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/phy/broadcom/ 2023-10-18T12:04:31.780 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-10-18T12:04:31.780 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/phy/samsung/ 2023-10-18T12:04:31.781 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 8441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-10-18T12:04:31.781 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/ 2023-10-18T12:04:31.781 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel/ 2023-10-18T12:04:31.781 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 70153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-18T12:04:31.781 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/ 2023-10-18T12:04:31.782 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/ 2023-10-18T12:04:31.782 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 50889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-10-18T12:04:31.782 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_ec.ko 2023-10-18T12:04:31.782 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 21449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-10-18T12:04:31.782 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 25417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-10-18T12:04:31.783 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 26201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-10-18T12:04:31.783 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-10-18T12:04:31.783 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-10-18T12:04:31.783 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/ 2023-10-18T12:04:31.783 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 67097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-18T12:04:31.784 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 39145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-18T12:04:31.784 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 36913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-18T12:04:31.784 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 59665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-18T12:04:31.784 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 31097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-18T12:04:31.784 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 127569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-18T12:04:31.785 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 36913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-18T12:04:31.785 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 49121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-18T12:04:31.785 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-18T12:04:31.785 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 40265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-18T12:04:31.785 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 22521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-18T12:04:31.786 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 36657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/hdaps.ko 2023-10-18T12:04:31.786 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/ibm_rtl.ko 2023-10-18T12:04:31.786 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/ 2023-10-18T12:04:31.786 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-18T12:04:31.786 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 8985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-10-18T12:04:31.787 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 43497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-18T12:04:31.787 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-18T12:04:31.787 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10377 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-18T12:04:31.787 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 34801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-18T12:04:31.787 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 42329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-18T12:04:31.788 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-18T12:04:31.788 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-18T12:04:31.788 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-18T12:04:31.788 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-18T12:04:31.788 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-18T12:04:31.788 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 57569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi.ko 2023-10-18T12:04:31.789 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/ 2023-10-18T12:04:31.789 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/ 2023-10-18T12:04:31.789 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 30345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/88pm860x_battery.ko 2023-10-18T12:04:31.789 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 33985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/88pm860x_charger.ko 2023-10-18T12:04:31.789 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 55057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/bq2415x_charger.ko 2023-10-18T12:04:31.790 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 54081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/bq24190_charger.ko 2023-10-18T12:04:31.790 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 21553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/bq24735-charger.ko 2023-10-18T12:04:31.790 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-10-18T12:04:31.790 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/da9030_battery.ko 2023-10-18T12:04:31.790 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/da9052-battery.ko 2023-10-18T12:04:31.791 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 29281 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/ds2760_battery.ko 2023-10-18T12:04:31.791 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 23217 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/ds2780_battery.ko 2023-10-18T12:04:31.791 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 23353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/ds2781_battery.ko 2023-10-18T12:04:31.791 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 23649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/ds2782_battery.ko 2023-10-18T12:04:31.791 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/gpio-charger.ko 2023-10-18T12:04:31.792 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/isp1704_charger.ko 2023-10-18T12:04:31.792 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/lp8727_charger.ko 2023-10-18T12:04:31.792 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/max14577_charger.ko 2023-10-18T12:04:31.792 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 25897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/max17040_battery.ko 2023-10-18T12:04:31.792 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 30289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/max17042_battery.ko 2023-10-18T12:04:31.793 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/max8903_charger.ko 2023-10-18T12:04:31.793 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 23729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/max8925_power.ko 2023-10-18T12:04:31.793 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 21657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/pcf50633-charger.ko 2023-10-18T12:04:31.793 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 38009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/sbs-battery.ko 2023-10-18T12:04:31.793 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 28385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/test_power.ko 2023-10-18T12:04:31.794 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/tps65090-charger.ko 2023-10-18T12:04:31.794 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/wm831x_backup.ko 2023-10-18T12:04:31.794 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 24521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/wm831x_power.ko 2023-10-18T12:04:31.794 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 22417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/power/supply/wm8350_power.ko 2023-10-18T12:04:31.794 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/ 2023-10-18T12:04:31.795 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 57729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-18T12:04:31.795 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-18T12:04:31.795 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/ 2023-10-18T12:04:31.795 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/ 2023-10-18T12:04:31.795 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-18T12:04:31.796 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-18T12:04:31.796 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-18T12:04:31.796 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 41873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/pps_core.ko 2023-10-18T12:04:31.796 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ 2023-10-18T12:04:31.796 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 66385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp.ko 2023-10-18T12:04:31.797 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-18T12:04:31.797 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/ 2023-10-18T12:04:31.797 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 23497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-88pm80x.ko 2023-10-18T12:04:31.797 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 24521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-88pm860x.ko 2023-10-18T12:04:31.797 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-18T12:04:31.798 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-da9052.ko 2023-10-18T12:04:31.798 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-da9055.ko 2023-10-18T12:04:31.798 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-da9063.ko 2023-10-18T12:04:31.798 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-18T12:04:31.798 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 68577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-18T12:04:31.799 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-18T12:04:31.799 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18217 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-18T12:04:31.799 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-18T12:04:31.799 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-18T12:04:31.799 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13369 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-18T12:04:31.799 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-18T12:04:31.800 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 23705 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-18T12:04:31.800 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-18T12:04:31.800 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 24329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-18T12:04:31.800 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-18T12:04:31.800 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 35969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-18T12:04:31.801 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-lp8788.ko 2023-10-18T12:04:31.801 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 38097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-18T12:04:31.801 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-18T12:04:31.801 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 25945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-18T12:04:31.801 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t86.ko 2023-10-18T12:04:31.802 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-18T12:04:31.802 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max8907.ko 2023-10-18T12:04:31.802 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max8925.ko 2023-10-18T12:04:31.802 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 25809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max8997.ko 2023-10-18T12:04:31.802 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max8998.ko 2023-10-18T12:04:31.803 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-10-18T12:04:31.803 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-18T12:04:31.803 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-palmas.ko 2023-10-18T12:04:31.803 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 46633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-18T12:04:31.803 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf50633.ko 2023-10-18T12:04:31.804 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 26993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-18T12:04:31.804 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 21825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-18T12:04:31.804 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 29881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-18T12:04:31.804 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-18T12:04:31.804 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rc5t583.ko 2023-10-18T12:04:31.805 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-18T12:04:31.805 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 33753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-18T12:04:31.805 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 27833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-18T12:04:31.805 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 25257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-18T12:04:31.805 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-18T12:04:31.806 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 21617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-s35390a.ko 2023-10-18T12:04:31.806 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-18T12:04:31.806 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-tps6586x.ko 2023-10-18T12:04:31.806 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 21337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-tps65910.ko 2023-10-18T12:04:31.806 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-wm831x.ko 2023-10-18T12:04:31.807 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 21089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-wm8350.ko 2023-10-18T12:04:31.807 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 27873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-18T12:04:31.807 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ 2023-10-18T12:04:31.807 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 77617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-18T12:04:31.807 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 57665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-sas.ko 2023-10-18T12:04:31.808 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 55169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-18T12:04:31.808 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 135185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/BusLogic.ko 2023-10-18T12:04:31.808 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 26657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/a100u2w.ko 2023-10-18T12:04:31.808 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid/ 2023-10-18T12:04:31.808 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 272305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-18T12:04:31.809 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 100617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/advansys.ko 2023-10-18T12:04:31.809 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/ 2023-10-18T12:04:31.809 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 356265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-18T12:04:31.809 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 295801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-18T12:04:31.809 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic94xx/ 2023-10-18T12:04:31.809 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 189185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-10-18T12:04:31.810 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 24073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/am53c974.ko 2023-10-18T12:04:31.810 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr/ 2023-10-18T12:04:31.810 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 106881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-18T12:04:31.810 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 38185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/atp870u.ko 2023-10-18T12:04:31.811 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi/ 2023-10-18T12:04:31.811 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 246985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-18T12:04:31.811 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa/ 2023-10-18T12:04:31.811 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 1171945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-18T12:04:31.811 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc/ 2023-10-18T12:04:31.811 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 237273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-18T12:04:31.812 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i/ 2023-10-18T12:04:31.812 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 115369 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-18T12:04:31.812 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 40585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ch.ko 2023-10-18T12:04:31.812 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor/ 2023-10-18T12:04:31.812 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 308921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-18T12:04:31.813 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/ 2023-10-18T12:04:31.813 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-10-18T12:04:31.813 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 76145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-18T12:04:31.813 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-10-18T12:04:31.813 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 101449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-18T12:04:31.814 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 146689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-18T12:04:31.814 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 75553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dc395x.ko 2023-10-18T12:04:31.814 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 38137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dmx3191d.ko 2023-10-18T12:04:31.814 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r/ 2023-10-18T12:04:31.814 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 212425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-18T12:04:31.815 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 60505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esp_scsi.ko 2023-10-18T12:04:31.815 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/ 2023-10-18T12:04:31.815 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 78209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-18T12:04:31.815 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 158505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-18T12:04:31.815 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fdomain.ko 2023-10-18T12:04:31.816 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic/ 2023-10-18T12:04:31.816 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 263489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-18T12:04:31.816 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 201817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hpsa.ko 2023-10-18T12:04:31.816 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 51209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hptiop.ko 2023-10-18T12:04:31.816 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 49041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-18T12:04:31.817 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 35337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/imm.ko 2023-10-18T12:04:31.817 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 44057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/initio.ko 2023-10-18T12:04:31.817 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 266537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ipr.ko 2023-10-18T12:04:31.817 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 101881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ips.ko 2023-10-18T12:04:31.817 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci/ 2023-10-18T12:04:31.818 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 317153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci/isci.ko 2023-10-18T12:04:31.818 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 26385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-18T12:04:31.818 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 52961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-18T12:04:31.818 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc/ 2023-10-18T12:04:31.818 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 314865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-18T12:04:31.819 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 145585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi.ko 2023-10-18T12:04:31.819 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 53521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-18T12:04:31.819 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas/ 2023-10-18T12:04:31.819 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 216665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-18T12:04:31.819 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc/ 2023-10-18T12:04:31.819 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 2197249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-18T12:04:31.820 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/ 2023-10-18T12:04:31.820 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 73569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-18T12:04:31.820 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 33529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-18T12:04:31.820 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 310617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-18T12:04:31.820 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 84721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid.ko 2023-10-18T12:04:31.821 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas/ 2023-10-18T12:04:31.821 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 659777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-18T12:04:31.821 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas/ 2023-10-18T12:04:31.821 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 119561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-18T12:04:31.821 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 78129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvumi.ko 2023-10-18T12:04:31.821 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pcmcia/ 2023-10-18T12:04:31.822 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 81625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-10-18T12:04:31.822 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-10-18T12:04:31.822 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-10-18T12:04:31.822 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 23857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-10-18T12:04:31.822 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001/ 2023-10-18T12:04:31.823 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 364105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-18T12:04:31.823 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 123617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pmcraid.ko 2023-10-18T12:04:31.823 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 34513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ppa.ko 2023-10-18T12:04:31.823 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 55361 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla1280.ko 2023-10-18T12:04:31.823 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/ 2023-10-18T12:04:31.824 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 1876625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-18T12:04:31.824 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 85289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-18T12:04:31.824 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx/ 2023-10-18T12:04:31.824 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 559033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-18T12:04:31.824 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qlogicfas408.ko 2023-10-18T12:04:31.825 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/raid_class.ko 2023-10-18T12:04:31.825 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 238825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_debug.ko 2023-10-18T12:04:31.825 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 173937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-18T12:04:31.825 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 279313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-18T12:04:31.825 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 97729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-18T12:04:31.825 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 73881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-18T12:04:31.826 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 44993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-18T12:04:31.826 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 26249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ses.ko 2023-10-18T12:04:31.826 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 115889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/st.ko 2023-10-18T12:04:31.826 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 46825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/stex.ko 2023-10-18T12:04:31.826 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2/ 2023-10-18T12:04:31.827 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 162121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-18T12:04:31.827 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 42297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-18T12:04:31.827 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 50321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-18T12:04:31.827 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 40025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/wd719x.ko 2023-10-18T12:04:31.827 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 50025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/xen-scsifront.ko 2023-10-18T12:04:31.827 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb/ 2023-10-18T12:04:31.828 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 129441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb/ssb.ko 2023-10-18T12:04:31.828 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/ 2023-10-18T12:04:31.828 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi/ 2023-10-18T12:04:31.828 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 736601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-18T12:04:31.828 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback/ 2023-10-18T12:04:31.828 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 49985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-18T12:04:31.829 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 39713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_file.ko 2023-10-18T12:04:31.829 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 43025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_iblock.ko 2023-10-18T12:04:31.829 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 930321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_mod.ko 2023-10-18T12:04:31.829 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 44305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_pscsi.ko 2023-10-18T12:04:31.829 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 122521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_user.ko 2023-10-18T12:04:31.830 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc/ 2023-10-18T12:04:31.830 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 75593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-18T12:04:31.830 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/ 2023-10-18T12:04:31.830 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/ 2023-10-18T12:04:31.830 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/ 2023-10-18T12:04:31.831 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 23481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-18T12:04:31.831 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 29321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-18T12:04:31.831 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-18T12:04:31.831 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-18T12:04:31.831 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-18T12:04:31.831 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-18T12:04:31.832 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 26809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-18T12:04:31.832 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20281 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-18T12:04:31.832 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-18T12:04:31.832 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-18T12:04:31.832 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-18T12:04:31.833 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 37065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-18T12:04:31.833 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 30729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-10-18T12:04:31.833 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-18T12:04:31.833 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-18T12:04:31.833 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 26489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-18T12:04:31.834 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ 2023-10-18T12:04:31.834 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless/ 2023-10-18T12:04:31.834 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 78425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-18T12:04:31.834 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 57865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/moxa.ko 2023-10-18T12:04:31.834 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 50953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/mxser.ko 2023-10-18T12:04:31.834 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 108601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_gsm.ko 2023-10-18T12:04:31.835 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 31961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_hdlc.ko 2023-10-18T12:04:31.835 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 67929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/nozomi.ko 2023-10-18T12:04:31.835 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/ 2023-10-18T12:04:31.835 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/ 2023-10-18T12:04:31.835 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 35753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-10-18T12:04:31.836 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 59497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-18T12:04:31.836 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-10-18T12:04:31.836 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 22577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/altera_uart.ko 2023-10-18T12:04:31.836 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-18T12:04:31.836 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 72425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-10-18T12:04:31.837 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm/ 2023-10-18T12:04:31.837 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 103073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-18T12:04:31.837 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 28785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/rp2.ko 2023-10-18T12:04:31.837 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 52817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/sc16is7xx.ko 2023-10-18T12:04:31.837 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/ 2023-10-18T12:04:31.837 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core/ 2023-10-18T12:04:31.838 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 531265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-18T12:04:31.838 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ 2023-10-18T12:04:31.838 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 28481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-18T12:04:31.838 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-10-18T12:04:31.838 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/ 2023-10-18T12:04:31.839 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 44513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio.ko 2023-10-18T12:04:31.839 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_aec.ko 2023-10-18T12:04:31.839 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11281 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_cif.ko 2023-10-18T12:04:31.839 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_dmem_genirq.ko 2023-10-18T12:04:31.839 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_mf624.ko 2023-10-18T12:04:31.840 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_netx.ko 2023-10-18T12:04:31.840 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-18T12:04:31.840 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-10-18T12:04:31.840 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_sercos3.ko 2023-10-18T12:04:31.840 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/ 2023-10-18T12:04:31.841 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/c67x00/ 2023-10-18T12:04:31.841 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 73297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/c67x00/c67x00.ko 2023-10-18T12:04:31.841 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/chipidea/ 2023-10-18T12:04:31.841 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 144377 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-10-18T12:04:31.841 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-10-18T12:04:31.842 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-10-18T12:04:31.842 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-10-18T12:04:31.842 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/ 2023-10-18T12:04:31.842 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 87089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-18T12:04:31.842 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 51409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-18T12:04:31.843 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 47369 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usblp.ko 2023-10-18T12:04:31.843 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 89857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usbtmc.ko 2023-10-18T12:04:31.843 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/common/ 2023-10-18T12:04:31.843 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 22953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/common/ulpi.ko 2023-10-18T12:04:31.843 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc2/ 2023-10-18T12:04:31.844 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-10-18T12:04:31.844 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc3/ 2023-10-18T12:04:31.844 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-10-18T12:04:31.844 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 30041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-10-18T12:04:31.844 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 444553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/dwc3/dwc3.ko 2023-10-18T12:04:31.844 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/ 2023-10-18T12:04:31.845 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/ 2023-10-18T12:04:31.845 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 60177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/u_ether.ko 2023-10-18T12:04:31.845 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 51881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/u_serial.ko 2023-10-18T12:04:31.845 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 28841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-10-18T12:04:31.845 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 42449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-10-18T12:04:31.846 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 27953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-10-18T12:04:31.846 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 36513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-10-18T12:04:31.846 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 92489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-10-18T12:04:31.846 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 51049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-10-18T12:04:31.846 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 122081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-10-18T12:04:31.847 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 57617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-10-18T12:04:31.847 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 22185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-10-18T12:04:31.847 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 31265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-10-18T12:04:31.847 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 57729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-10-18T12:04:31.847 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 85609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-10-18T12:04:31.848 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-10-18T12:04:31.848 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 58113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-10-18T12:04:31.848 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 67337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-10-18T12:04:31.848 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/ 2023-10-18T12:04:31.848 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 21265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-10-18T12:04:31.849 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-10-18T12:04:31.849 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-10-18T12:04:31.849 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 21657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-10-18T12:04:31.849 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 28401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-10-18T12:04:31.849 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-10-18T12:04:31.850 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-10-18T12:04:31.850 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-10-18T12:04:31.850 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 32073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-10-18T12:04:31.850 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-10-18T12:04:31.850 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-10-18T12:04:31.851 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 27201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-10-18T12:04:31.851 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 62185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-10-18T12:04:31.851 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-10-18T12:04:31.851 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 161225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/libcomposite.ko 2023-10-18T12:04:31.851 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/ 2023-10-18T12:04:31.852 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17705 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-10-18T12:04:31.852 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/bdc/ 2023-10-18T12:04:31.852 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 157681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-10-18T12:04:31.852 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 36089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-10-18T12:04:31.852 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 52721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-10-18T12:04:31.853 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 69705 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-10-18T12:04:31.853 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 56033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-10-18T12:04:31.853 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 76057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/net2272.ko 2023-10-18T12:04:31.853 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 75073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/net2280.ko 2023-10-18T12:04:31.853 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 73169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-10-18T12:04:31.853 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 65809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-10-18T12:04:31.854 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 66097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-10-18T12:04:31.854 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 81505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-10-18T12:04:31.854 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 156073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-10-18T12:04:31.855 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/ 2023-10-18T12:04:31.855 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/bcma-hcd.ko 2023-10-18T12:04:31.855 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 80113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/isp116x-hcd.ko 2023-10-18T12:04:31.856 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 87353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-10-18T12:04:31.856 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 78873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-10-18T12:04:31.856 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 51329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-18T12:04:31.856 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/sl811_cs.ko 2023-10-18T12:04:31.856 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/ssb-hcd.ko 2023-10-18T12:04:31.857 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 25945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-10-18T12:04:31.857 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/ 2023-10-18T12:04:31.857 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 34585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/mdc800.ko 2023-10-18T12:04:31.857 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 21081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/microtek.ko 2023-10-18T12:04:31.857 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ 2023-10-18T12:04:31.858 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 41721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/adutux.ko 2023-10-18T12:04:31.858 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-18T12:04:31.858 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-10-18T12:04:31.858 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 23049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/cytherm.ko 2023-10-18T12:04:31.858 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ehset.ko 2023-10-18T12:04:31.859 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi26.ko 2023-10-18T12:04:31.859 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi62.ko 2023-10-18T12:04:31.859 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ezusb.ko 2023-10-18T12:04:31.859 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/idmouse.ko 2023-10-18T12:04:31.859 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 36617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-18T12:04:31.860 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-18T12:04:31.860 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 36529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ldusb.ko 2023-10-18T12:04:31.860 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 36265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-18T12:04:31.860 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 27793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/lvstest.ko 2023-10-18T12:04:31.860 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga/ 2023-10-18T12:04:31.861 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 64841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-18T12:04:31.861 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-18T12:04:31.861 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usb3503.ko 2023-10-18T12:04:31.861 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 25145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usblcd.ko 2023-10-18T12:04:31.861 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 22753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-18T12:04:31.862 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 70873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usbtest.ko 2023-10-18T12:04:31.862 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 41969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/uss720.ko 2023-10-18T12:04:31.862 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 27617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/yurex.ko 2023-10-18T12:04:31.862 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/mon/ 2023-10-18T12:04:31.862 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 72953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/mon/usbmon.ko 2023-10-18T12:04:31.863 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/musb/ 2023-10-18T12:04:31.863 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 301545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/musb/musb_hdrc.ko 2023-10-18T12:04:31.863 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/ 2023-10-18T12:04:31.863 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 21105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-18T12:04:31.865 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-10-18T12:04:31.865 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-isp1301.ko 2023-10-18T12:04:31.865 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 21745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-tahvo.ko 2023-10-18T12:04:31.865 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ 2023-10-18T12:04:31.866 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/aircable.ko 2023-10-18T12:04:31.866 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 33329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ark3116.ko 2023-10-18T12:04:31.866 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 26633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-18T12:04:31.866 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 38105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ch341.ko 2023-10-18T12:04:31.866 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 70257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cp210x.ko 2023-10-18T12:04:31.867 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 31057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-18T12:04:31.867 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 58217 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-18T12:04:31.867 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 49817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-18T12:04:31.867 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/empeg.ko 2023-10-18T12:04:31.867 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 44337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/f81232.ko 2023-10-18T12:04:31.868 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 175137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-18T12:04:31.868 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 53113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-18T12:04:31.868 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 137081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-18T12:04:31.868 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 124833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_ti.ko 2023-10-18T12:04:31.868 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 67769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipaq.ko 2023-10-18T12:04:31.869 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipw.ko 2023-10-18T12:04:31.869 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 26897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-18T12:04:31.869 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 58233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-18T12:04:31.869 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 107521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan.ko 2023-10-18T12:04:31.869 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 35617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-18T12:04:31.869 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 25665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-18T12:04:31.870 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 33689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-18T12:04:31.870 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 32953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-18T12:04:31.870 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 22033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/metro-usb.ko 2023-10-18T12:04:31.870 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 66449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7720.ko 2023-10-18T12:04:31.870 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 78217 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7840.ko 2023-10-18T12:04:31.871 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 56337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mxuport.ko 2023-10-18T12:04:31.871 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/navman.ko 2023-10-18T12:04:31.871 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/omninet.ko 2023-10-18T12:04:31.871 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 24633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/opticon.ko 2023-10-18T12:04:31.871 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 190633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/option.ko 2023-10-18T12:04:31.872 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 39073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/oti6858.ko 2023-10-18T12:04:31.872 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 54353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/pl2303.ko 2023-10-18T12:04:31.872 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcaux.ko 2023-10-18T12:04:31.872 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 37825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcserial.ko 2023-10-18T12:04:31.872 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 34321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/quatech2.ko 2023-10-18T12:04:31.873 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-18T12:04:31.873 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 51625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/sierra.ko 2023-10-18T12:04:31.873 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 21673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-18T12:04:31.873 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 29993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ssu100.ko 2023-10-18T12:04:31.873 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-18T12:04:31.874 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 61489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-18T12:04:31.874 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 23729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-18T12:04:31.874 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-18T12:04:31.874 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 33201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-18T12:04:31.874 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 125609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usbserial.ko 2023-10-18T12:04:31.875 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 28753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/visor.ko 2023-10-18T12:04:31.875 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 37409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-18T12:04:31.875 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/wishbone-serial.ko 2023-10-18T12:04:31.875 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-18T12:04:31.875 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ 2023-10-18T12:04:31.876 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 52913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/uas.ko 2023-10-18T12:04:31.876 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 26017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-18T12:04:31.876 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-18T12:04:31.876 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 22049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-18T12:04:31.876 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 33497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-18T12:04:31.877 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-18T12:04:31.877 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-18T12:04:31.877 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19361 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-18T12:04:31.877 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-18T12:04:31.877 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-18T12:04:31.877 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 28441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-18T12:04:31.878 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 28905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-18T12:04:31.878 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-18T12:04:31.878 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 35337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-18T12:04:31.878 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 179969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-18T12:04:31.878 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/ 2023-10-18T12:04:31.879 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 67481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-18T12:04:31.879 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 72177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-18T12:04:31.879 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 107001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-18T12:04:31.879 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/ 2023-10-18T12:04:31.879 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/ 2023-10-18T12:04:31.880 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 154297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-18T12:04:31.880 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 29537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-18T12:04:31.880 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 108737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio.ko 2023-10-18T12:04:31.880 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 77609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-18T12:04:31.880 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/ 2023-10-18T12:04:31.881 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 113873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost.ko 2023-10-18T12:04:31.881 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-18T12:04:31.881 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 58089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_net.ko 2023-10-18T12:04:31.881 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 89249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-18T12:04:31.881 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/ 2023-10-18T12:04:31.882 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/ 2023-10-18T12:04:31.882 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-10-18T12:04:31.882 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/aat2870_bl.ko 2023-10-18T12:04:31.882 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 23305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/adp5520_bl.ko 2023-10-18T12:04:31.882 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 32609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/adp8860_bl.ko 2023-10-18T12:04:31.883 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 39993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/adp8870_bl.ko 2023-10-18T12:04:31.883 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-18T12:04:31.883 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/as3711_bl.ko 2023-10-18T12:04:31.883 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/bd6107.ko 2023-10-18T12:04:31.883 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/da903x_bl.ko 2023-10-18T12:04:31.884 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/da9052_bl.ko 2023-10-18T12:04:31.884 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/gpio_backlight.ko 2023-10-18T12:04:31.884 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/kb3886_bl.ko 2023-10-18T12:04:31.884 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 22017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lcd.ko 2023-10-18T12:04:31.884 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 23657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lm3533_bl.ko 2023-10-18T12:04:31.885 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lm3639_bl.ko 2023-10-18T12:04:31.885 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lv5207lp.ko 2023-10-18T12:04:31.885 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/max8925_bl.ko 2023-10-18T12:04:31.885 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/pandora_bl.ko 2023-10-18T12:04:31.885 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-10-18T12:04:31.885 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-18T12:04:31.886 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/wm831x_bl.ko 2023-10-18T12:04:31.886 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/ 2023-10-18T12:04:31.886 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ 2023-10-18T12:04:31.886 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2482.ko 2023-10-18T12:04:31.887 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 38985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2490.ko 2023-10-18T12:04:31.887 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/matrox_w1.ko 2023-10-18T12:04:31.887 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/w1-gpio.ko 2023-10-18T12:04:31.887 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/ 2023-10-18T12:04:31.887 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-18T12:04:31.887 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 22809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-18T12:04:31.888 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-18T12:04:31.888 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-18T12:04:31.888 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-18T12:04:31.888 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-18T12:04:31.888 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-18T12:04:31.889 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-18T12:04:31.889 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-18T12:04:31.889 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 7385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-18T12:04:31.889 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 56425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-18T12:04:31.890 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 102673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/wire.ko 2023-10-18T12:04:31.890 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ 2023-10-18T12:04:31.890 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/acquirewdt.ko 2023-10-18T12:04:31.890 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/advantechwdt.ko 2023-10-18T12:04:31.890 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-18T12:04:31.891 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 22969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-18T12:04:31.891 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/cpu5wdt.ko 2023-10-18T12:04:31.891 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/da9052_wdt.ko 2023-10-18T12:04:31.891 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/da9055_wdt.ko 2023-10-18T12:04:31.891 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/da9063_wdt.ko 2023-10-18T12:04:31.892 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/dw_wdt.ko 2023-10-18T12:04:31.892 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/eurotechwdt.ko 2023-10-18T12:04:31.892 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 23865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-18T12:04:31.892 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 27401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/hpwdt.ko 2023-10-18T12:04:31.892 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/i6300esb.ko 2023-10-18T12:04:31.893 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-18T12:04:31.893 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 21913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-18T12:04:31.893 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-18T12:04:31.893 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ibmasr.ko 2023-10-18T12:04:31.893 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-18T12:04:31.894 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 21225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-18T12:04:31.894 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-18T12:04:31.894 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 21489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/kempld_wdt.ko 2023-10-18T12:04:31.894 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/machzwd.ko 2023-10-18T12:04:31.894 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/mena21_wdt.ko 2023-10-18T12:04:31.894 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13217 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-10-18T12:04:31.895 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 24673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/nv_tco.ko 2023-10-18T12:04:31.895 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-10-18T12:04:31.895 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 22265 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pc87413_wdt.ko 2023-10-18T12:04:31.895 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 38657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-18T12:04:31.895 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 31825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-18T12:04:31.896 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/retu_wdt.ko 2023-10-18T12:04:31.896 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-10-18T12:04:31.896 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-10-18T12:04:31.896 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-18T12:04:31.896 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 23809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sc1200wdt.ko 2023-10-18T12:04:31.896 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 23321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-18T12:04:31.897 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 21577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-10-18T12:04:31.897 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/softdog.ko 2023-10-18T12:04:31.897 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 22273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-18T12:04:31.897 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/twl4030_wdt.ko 2023-10-18T12:04:31.897 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/via_wdt.ko 2023-10-18T12:04:31.898 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-18T12:04:31.898 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-18T12:04:31.898 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 25409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-18T12:04:31.898 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wafer5823wdt.ko 2023-10-18T12:04:31.898 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 28089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-18T12:04:31.899 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wm831x_wdt.ko 2023-10-18T12:04:31.899 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wm8350_wdt.ko 2023-10-18T12:04:31.899 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-18T12:04:31.899 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/ 2023-10-18T12:04:31.899 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 24729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-evtchn.ko 2023-10-18T12:04:31.900 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 26769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-18T12:04:31.900 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 47865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntdev.ko 2023-10-18T12:04:31.900 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback/ 2023-10-18T12:04:31.900 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 176441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-18T12:04:31.900 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 40121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-privcmd.ko 2023-10-18T12:04:31.901 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 71249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-scsiback.ko 2023-10-18T12:04:31.901 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs/ 2023-10-18T12:04:31.901 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-18T12:04:31.901 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ 2023-10-18T12:04:31.901 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p/ 2023-10-18T12:04:31.902 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 166425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p/9p.ko 2023-10-18T12:04:31.902 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/adfs/ 2023-10-18T12:04:31.902 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 61073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/adfs/adfs.ko 2023-10-18T12:04:31.902 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs/ 2023-10-18T12:04:31.902 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 163593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs/affs.ko 2023-10-18T12:04:31.903 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/afs/ 2023-10-18T12:04:31.903 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 932817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/afs/kafs.ko 2023-10-18T12:04:31.903 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/autofs/ 2023-10-18T12:04:31.903 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 101057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/autofs/autofs4.ko 2023-10-18T12:04:31.903 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs/ 2023-10-18T12:04:31.904 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 64545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs/befs.ko 2023-10-18T12:04:31.904 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/bfs/ 2023-10-18T12:04:31.904 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 41257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/bfs/bfs.ko 2023-10-18T12:04:31.904 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 34585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/binfmt_misc.ko 2023-10-18T12:04:31.904 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs/ 2023-10-18T12:04:31.904 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 3402585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs/btrfs.ko 2023-10-18T12:04:31.905 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles/ 2023-10-18T12:04:31.905 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 306073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles/cachefiles.ko 2023-10-18T12:04:31.905 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph/ 2023-10-18T12:04:31.905 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 1323873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph/ceph.ko 2023-10-18T12:04:31.905 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda/ 2023-10-18T12:04:31.906 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 100801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda/coda.ko 2023-10-18T12:04:31.906 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/configfs/ 2023-10-18T12:04:31.906 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 108393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/configfs/configfs.ko 2023-10-18T12:04:31.906 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs/ 2023-10-18T12:04:31.906 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 29625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs/cramfs.ko 2023-10-18T12:04:31.907 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm/ 2023-10-18T12:04:31.907 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 642577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm/dlm.ko 2023-10-18T12:04:31.907 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/efs/ 2023-10-18T12:04:31.907 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 36649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/efs/efs.ko 2023-10-18T12:04:31.907 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs/ 2023-10-18T12:04:31.908 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 1505025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs/f2fs.ko 2023-10-18T12:04:31.908 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/ 2023-10-18T12:04:31.908 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 27929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/msdos.ko 2023-10-18T12:04:31.908 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/freevxfs/ 2023-10-18T12:04:31.908 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 42545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/freevxfs/freevxfs.ko 2023-10-18T12:04:31.908 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache/ 2023-10-18T12:04:31.909 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 226481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache/fscache.ko 2023-10-18T12:04:31.909 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/ 2023-10-18T12:04:31.909 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 24489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/cuse.ko 2023-10-18T12:04:31.909 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2/ 2023-10-18T12:04:31.909 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 1231529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2/gfs2.ko 2023-10-18T12:04:31.910 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs/ 2023-10-18T12:04:31.910 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 141209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs/hfs.ko 2023-10-18T12:04:31.910 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus/ 2023-10-18T12:04:31.910 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 222817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus/hfsplus.ko 2023-10-18T12:04:31.910 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hpfs/ 2023-10-18T12:04:31.911 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 192329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hpfs/hpfs.ko 2023-10-18T12:04:31.911 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs/ 2023-10-18T12:04:31.911 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 74065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs/isofs.ko 2023-10-18T12:04:31.911 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs/ 2023-10-18T12:04:31.911 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 419497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs/jfs.ko 2023-10-18T12:04:31.912 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd/ 2023-10-18T12:04:31.912 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 280313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd/lockd.ko 2023-10-18T12:04:31.912 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix/ 2023-10-18T12:04:31.912 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 89193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix/minix.ko 2023-10-18T12:04:31.912 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs/ 2023-10-18T12:04:31.912 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 124649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs/netfs.ko 2023-10-18T12:04:31.913 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/ 2023-10-18T12:04:31.913 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout/ 2023-10-18T12:04:31.913 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 81449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-18T12:04:31.913 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout/ 2023-10-18T12:04:31.913 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 59449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-18T12:04:31.914 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout/ 2023-10-18T12:04:31.914 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 117513 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-18T12:04:31.914 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 1055649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfs.ko 2023-10-18T12:04:31.914 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 66441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv2.ko 2023-10-18T12:04:31.914 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 120177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv3.ko 2023-10-18T12:04:31.915 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 2041689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv4.ko 2023-10-18T12:04:31.915 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/ 2023-10-18T12:04:31.915 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/grace.ko 2023-10-18T12:04:31.915 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-18T12:04:31.915 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd/ 2023-10-18T12:04:31.916 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 1516809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd/nfsd.ko 2023-10-18T12:04:31.916 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2/ 2023-10-18T12:04:31.916 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 592833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2/nilfs2.ko 2023-10-18T12:04:31.916 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/ 2023-10-18T12:04:31.916 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-celtic.ko 2023-10-18T12:04:31.917 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-centeuro.ko 2023-10-18T12:04:31.917 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-croatian.ko 2023-10-18T12:04:31.917 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-cyrillic.ko 2023-10-18T12:04:31.917 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-gaelic.ko 2023-10-18T12:04:31.917 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-greek.ko 2023-10-18T12:04:31.918 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-iceland.ko 2023-10-18T12:04:31.918 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-inuit.ko 2023-10-18T12:04:31.918 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-roman.ko 2023-10-18T12:04:31.918 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-romanian.ko 2023-10-18T12:04:31.918 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-turkish.ko 2023-10-18T12:04:31.919 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_ascii.ko 2023-10-18T12:04:31.919 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1250.ko 2023-10-18T12:04:31.919 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1251.ko 2023-10-18T12:04:31.919 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1255.ko 2023-10-18T12:04:31.919 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp737.ko 2023-10-18T12:04:31.920 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp775.ko 2023-10-18T12:04:31.920 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp850.ko 2023-10-18T12:04:31.920 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp852.ko 2023-10-18T12:04:31.920 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp855.ko 2023-10-18T12:04:31.920 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp857.ko 2023-10-18T12:04:31.920 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp860.ko 2023-10-18T12:04:31.921 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp861.ko 2023-10-18T12:04:31.921 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp862.ko 2023-10-18T12:04:31.921 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp863.ko 2023-10-18T12:04:31.921 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp864.ko 2023-10-18T12:04:31.922 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp865.ko 2023-10-18T12:04:31.922 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp866.ko 2023-10-18T12:04:31.922 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp869.ko 2023-10-18T12:04:31.922 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp874.ko 2023-10-18T12:04:31.922 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 94137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp932.ko 2023-10-18T12:04:31.923 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 142673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp936.ko 2023-10-18T12:04:31.923 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 165745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp949.ko 2023-10-18T12:04:31.923 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 118121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp950.ko 2023-10-18T12:04:31.923 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_euc-jp.ko 2023-10-18T12:04:31.923 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-18T12:04:31.923 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-18T12:04:31.924 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-18T12:04:31.924 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-18T12:04:31.924 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-18T12:04:31.924 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-18T12:04:31.924 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-18T12:04:31.925 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-18T12:04:31.925 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-18T12:04:31.925 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-18T12:04:31.925 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-18T12:04:31.925 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-r.ko 2023-10-18T12:04:31.925 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 8017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-18T12:04:31.926 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-u.ko 2023-10-18T12:04:31.926 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 7569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_ucs2_utils.ko 2023-10-18T12:04:31.926 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 8337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_utf8.ko 2023-10-18T12:04:31.926 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ntfs/ 2023-10-18T12:04:31.926 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 219417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ntfs/ntfs.ko 2023-10-18T12:04:31.927 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ 2023-10-18T12:04:31.927 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster/ 2023-10-18T12:04:31.927 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 244409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-18T12:04:31.927 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm/ 2023-10-18T12:04:31.927 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 440737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-18T12:04:31.928 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs/ 2023-10-18T12:04:31.928 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 54049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-18T12:04:31.928 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 2592433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2.ko 2023-10-18T12:04:31.928 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-18T12:04:31.928 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 31729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-18T12:04:31.929 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 35897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-18T12:04:31.929 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/omfs/ 2023-10-18T12:04:31.929 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 53433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/omfs/omfs.ko 2023-10-18T12:04:31.929 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs/ 2023-10-18T12:04:31.929 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 352153 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs/overlay.ko 2023-10-18T12:04:31.929 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore/ 2023-10-18T12:04:31.930 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 54809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore/ramoops.ko 2023-10-18T12:04:31.930 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/qnx4/ 2023-10-18T12:04:31.930 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 26865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/qnx4/qnx4.ko 2023-10-18T12:04:31.930 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/qnx6/ 2023-10-18T12:04:31.931 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 46689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/qnx6/qnx6.ko 2023-10-18T12:04:31.931 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/quota/ 2023-10-18T12:04:31.931 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 30881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/quota/quota_tree.ko 2023-10-18T12:04:31.931 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14361 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/quota/quota_v1.ko 2023-10-18T12:04:31.931 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 22017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/quota/quota_v2.ko 2023-10-18T12:04:31.931 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs/ 2023-10-18T12:04:31.932 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 532673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs/reiserfs.ko 2023-10-18T12:04:31.932 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs/ 2023-10-18T12:04:31.932 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 28641 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs/romfs.ko 2023-10-18T12:04:31.932 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/ 2023-10-18T12:04:31.932 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client/ 2023-10-18T12:04:31.933 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 2668121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client/cifs.ko 2023-10-18T12:04:31.933 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/ 2023-10-18T12:04:31.933 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 7161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-18T12:04:31.933 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_md4.ko 2023-10-18T12:04:31.933 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs/ 2023-10-18T12:04:31.933 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 134641 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs/squashfs.ko 2023-10-18T12:04:31.934 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv/ 2023-10-18T12:04:31.934 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 90721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv/sysv.ko 2023-10-18T12:04:31.934 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf/ 2023-10-18T12:04:31.934 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 247737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf/udf.ko 2023-10-18T12:04:31.934 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs/ 2023-10-18T12:04:31.935 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 162497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs/ufs.ko 2023-10-18T12:04:31.935 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs/ 2023-10-18T12:04:31.935 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 4010729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs/xfs.ko 2023-10-18T12:04:31.935 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/ 2023-10-18T12:04:31.935 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/locking/ 2023-10-18T12:04:31.936 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 75489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/locking/locktorture.ko 2023-10-18T12:04:31.936 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/time/ 2023-10-18T12:04:31.936 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/time/test_udelay.ko 2023-10-18T12:04:31.936 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 60553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/torture.ko 2023-10-18T12:04:31.936 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ 2023-10-18T12:04:31.936 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 6833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc-itu-t.ko 2023-10-18T12:04:31.937 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 6529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc7.ko 2023-10-18T12:04:31.937 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 7025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc8.ko 2023-10-18T12:04:31.937 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/ 2023-10-18T12:04:31.937 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 7097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libarc4.ko 2023-10-18T12:04:31.937 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 37081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libdes.ko 2023-10-18T12:04:31.938 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/interval_tree_test.ko 2023-10-18T12:04:31.938 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 8425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/libcrc32c.ko 2023-10-18T12:04:31.938 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 24953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lru_cache.ko 2023-10-18T12:04:31.938 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/ 2023-10-18T12:04:31.938 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 33801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4_compress.ko 2023-10-18T12:04:31.939 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 22633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-18T12:04:31.939 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math/ 2023-10-18T12:04:31.939 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 6617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math/cordic.ko 2023-10-18T12:04:31.939 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 8233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/memory-notifier-error-inject.ko 2023-10-18T12:04:31.939 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/notifier-error-inject.ko 2023-10-18T12:04:31.940 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/percpu_test.ko 2023-10-18T12:04:31.940 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 8305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/pm-notifier-error-inject.ko 2023-10-18T12:04:31.940 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6/ 2023-10-18T12:04:31.940 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 143433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6/raid6_pq.ko 2023-10-18T12:04:31.940 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 21105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/rbtree_test.ko 2023-10-18T12:04:31.940 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon/ 2023-10-18T12:04:31.941 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-18T12:04:31.941 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 38841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test-kstrtox.ko 2023-10-18T12:04:31.941 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 26321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test-string_helpers.ko 2023-10-18T12:04:31.941 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 4760425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test_bpf.ko 2023-10-18T12:04:31.941 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 49089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test_firmware.ko 2023-10-18T12:04:31.942 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 6369 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test_module.ko 2023-10-18T12:04:31.942 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/test_user_copy.ko 2023-10-18T12:04:31.942 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_bm.ko 2023-10-18T12:04:31.942 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_fsm.ko 2023-10-18T12:04:31.942 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_kmp.ko 2023-10-18T12:04:31.943 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/xz/ 2023-10-18T12:04:31.943 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/xz/xz_dec_test.ko 2023-10-18T12:04:31.943 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/mm/ 2023-10-18T12:04:31.943 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/mm/hwpoison-inject.ko 2023-10-18T12:04:31.943 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ 2023-10-18T12:04:31.944 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/ 2023-10-18T12:04:31.944 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 55737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/6lowpan.ko 2023-10-18T12:04:31.944 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 7049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_dest.ko 2023-10-18T12:04:31.944 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 7065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-18T12:04:31.944 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 7049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_hop.ko 2023-10-18T12:04:31.945 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 6985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-18T12:04:31.945 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 7065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-18T12:04:31.945 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 7065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_routing.ko 2023-10-18T12:04:31.945 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_udp.ko 2023-10-18T12:04:31.945 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/ 2023-10-18T12:04:31.946 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 30385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/garp.ko 2023-10-18T12:04:31.946 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 34809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/mrp.ko 2023-10-18T12:04:31.946 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 8545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/p8022.ko 2023-10-18T12:04:31.946 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/psnap.ko 2023-10-18T12:04:31.946 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/stp.ko 2023-10-18T12:04:31.947 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q/ 2023-10-18T12:04:31.947 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 81737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q/8021q.ko 2023-10-18T12:04:31.947 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/ 2023-10-18T12:04:31.947 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 198337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet.ko 2023-10-18T12:04:31.947 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 35977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_fd.ko 2023-10-18T12:04:31.947 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 26345 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_rdma.ko 2023-10-18T12:04:31.948 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 32337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_virtio.ko 2023-10-18T12:04:31.948 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv/ 2023-10-18T12:04:31.948 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 649297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv/batman-adv.ko 2023-10-18T12:04:31.948 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/ 2023-10-18T12:04:31.948 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 63809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/br_netfilter.ko 2023-10-18T12:04:31.949 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 777689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/bridge.ko 2023-10-18T12:04:31.949 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ 2023-10-18T12:04:31.949 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 7657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-18T12:04:31.949 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-18T12:04:31.949 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-18T12:04:31.950 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-18T12:04:31.950 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-18T12:04:31.950 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 8737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-18T12:04:31.950 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-18T12:04:31.950 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-18T12:04:31.951 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13217 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-18T12:04:31.951 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 7585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-18T12:04:31.951 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 7593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-18T12:04:31.951 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 8385 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-18T12:04:31.951 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 7537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-18T12:04:31.952 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-18T12:04:31.952 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 8649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-18T12:04:31.952 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 8889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-18T12:04:31.952 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-18T12:04:31.952 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-18T12:04:31.953 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-18T12:04:31.953 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-18T12:04:31.953 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 55929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-18T12:04:31.953 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-18T12:04:31.953 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-18T12:04:31.954 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph/ 2023-10-18T12:04:31.954 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 1047017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph/libceph.ko 2023-10-18T12:04:31.954 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/ 2023-10-18T12:04:31.954 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 125697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/pktgen.ko 2023-10-18T12:04:31.954 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/ 2023-10-18T12:04:31.955 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 194209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp.ko 2023-10-18T12:04:31.955 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 8665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_diag.ko 2023-10-18T12:04:31.955 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 57881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv4.ko 2023-10-18T12:04:31.955 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 60337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv6.ko 2023-10-18T12:04:31.955 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/ 2023-10-18T12:04:31.955 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 390473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/dsa_core.ko 2023-10-18T12:04:31.956 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_brcm.ko 2023-10-18T12:04:31.956 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_dsa.ko 2023-10-18T12:04:31.956 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 7721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_none.ko 2023-10-18T12:04:31.956 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 8953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_trailer.ko 2023-10-18T12:04:31.956 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/hsr/ 2023-10-18T12:04:31.957 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 99729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/hsr/hsr.ko 2023-10-18T12:04:31.957 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ 2023-10-18T12:04:31.957 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan/ 2023-10-18T12:04:31.957 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 45233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-18T12:04:31.957 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 254625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154.ko 2023-10-18T12:04:31.958 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 47289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-18T12:04:31.958 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ 2023-10-18T12:04:31.958 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 24729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ah4.ko 2023-10-18T12:04:31.958 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 38905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/esp4.ko 2023-10-18T12:04:31.958 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 48401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/fou.ko 2023-10-18T12:04:31.959 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/gre.ko 2023-10-18T12:04:31.959 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 48657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/inet_diag.ko 2023-10-18T12:04:31.959 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 60633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_gre.ko 2023-10-18T12:04:31.959 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 61225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_tunnel.ko 2023-10-18T12:04:31.959 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 34505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_vti.ko 2023-10-18T12:04:31.960 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipcomp.ko 2023-10-18T12:04:31.960 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 28841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipip.ko 2023-10-18T12:04:31.960 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ 2023-10-18T12:04:31.960 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 37641 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-18T12:04:31.960 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 8873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-18T12:04:31.960 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-18T12:04:31.961 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 41673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ip_tables.ko 2023-10-18T12:04:31.961 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-18T12:04:31.961 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-10-18T12:04:31.961 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-18T12:04:31.961 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-18T12:04:31.962 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-18T12:04:31.962 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11305 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-10-18T12:04:31.962 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-18T12:04:31.962 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-18T12:04:31.962 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-18T12:04:31.963 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-18T12:04:31.963 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-18T12:04:31.963 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 8817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-18T12:04:31.963 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 27625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-18T12:04:31.963 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18225 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-18T12:04:31.964 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-18T12:04:31.964 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-10-18T12:04:31.964 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-18T12:04:31.964 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-18T12:04:31.964 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-18T12:04:31.965 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-18T12:04:31.965 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-18T12:04:31.965 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_bic.ko 2023-10-18T12:04:31.965 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-18T12:04:31.965 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15369 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_diag.ko 2023-10-18T12:04:31.966 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-18T12:04:31.966 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_htcp.ko 2023-10-18T12:04:31.966 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_hybla.ko 2023-10-18T12:04:31.966 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_illinois.ko 2023-10-18T12:04:31.966 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_lp.ko 2023-10-18T12:04:31.967 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 8329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_scalable.ko 2023-10-18T12:04:31.967 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_vegas.ko 2023-10-18T12:04:31.967 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_veno.ko 2023-10-18T12:04:31.967 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_westwood.ko 2023-10-18T12:04:31.967 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_yeah.ko 2023-10-18T12:04:31.967 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 22601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tunnel4.ko 2023-10-18T12:04:31.968 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_diag.ko 2023-10-18T12:04:31.968 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 41665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_tunnel.ko 2023-10-18T12:04:31.968 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-18T12:04:31.968 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ 2023-10-18T12:04:31.968 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 26441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ah6.ko 2023-10-18T12:04:31.969 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 39537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/esp6.ko 2023-10-18T12:04:31.969 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/fou6.ko 2023-10-18T12:04:31.969 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 80897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_gre.ko 2023-10-18T12:04:31.969 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 93577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-18T12:04:31.969 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-18T12:04:31.970 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 53273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_vti.ko 2023-10-18T12:04:31.970 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ipcomp6.ko 2023-10-18T12:04:31.970 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19017 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/mip6.ko 2023-10-18T12:04:31.970 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ 2023-10-18T12:04:31.970 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 42169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-18T12:04:31.971 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-10-18T12:04:31.971 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-18T12:04:31.971 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-18T12:04:31.971 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-18T12:04:31.971 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 7801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-18T12:04:31.972 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-18T12:04:31.972 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-18T12:04:31.972 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 8913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-18T12:04:31.972 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-18T12:04:31.972 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-18T12:04:31.973 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-18T12:04:31.973 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-18T12:04:31.973 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11121 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-18T12:04:31.973 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-18T12:04:31.973 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-18T12:04:31.973 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-18T12:04:31.974 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 39113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-18T12:04:31.974 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 8449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-18T12:04:31.974 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 25945 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-18T12:04:31.974 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-18T12:04:31.974 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-18T12:04:31.975 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-18T12:04:31.975 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-18T12:04:31.975 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9009 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-18T12:04:31.975 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 74073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/sit.ko 2023-10-18T12:04:31.975 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 24193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/tunnel6.ko 2023-10-18T12:04:31.976 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 23297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-18T12:04:31.976 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key/ 2023-10-18T12:04:31.976 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 82833 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key/af_key.ko 2023-10-18T12:04:31.976 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/ 2023-10-18T12:04:31.976 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 125281 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_core.ko 2023-10-18T12:04:31.977 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-18T12:04:31.977 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 25953 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_eth.ko 2023-10-18T12:04:31.977 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 35569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip.ko 2023-10-18T12:04:31.977 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 36713 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-18T12:04:31.977 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 33001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-18T12:04:31.977 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 53241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-18T12:04:31.978 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/lapb/ 2023-10-18T12:04:31.978 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 47977 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/lapb/lapb.ko 2023-10-18T12:04:31.978 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/ 2023-10-18T12:04:31.978 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 23193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/llc.ko 2023-10-18T12:04:31.978 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 267777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/llc2.ko 2023-10-18T12:04:31.979 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154/ 2023-10-18T12:04:31.979 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 290417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154/mac802154.ko 2023-10-18T12:04:31.979 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls/ 2023-10-18T12:04:31.979 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls/mpls_gso.ko 2023-10-18T12:04:31.979 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ 2023-10-18T12:04:31.980 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ 2023-10-18T12:04:31.980 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 119585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-18T12:04:31.980 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 28353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-18T12:04:31.980 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 26913 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-18T12:04:31.980 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 26369 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-18T12:04:31.981 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 100297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-18T12:04:31.981 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 101441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-18T12:04:31.981 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 102817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-18T12:04:31.981 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 103481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-18T12:04:31.981 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 112849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-18T12:04:31.982 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 60329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-18T12:04:31.982 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 109593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-18T12:04:31.982 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 113129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-18T12:04:31.982 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 112585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-18T12:04:31.982 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 111585 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-18T12:04:31.982 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 114465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-18T12:04:31.983 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 30025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-18T12:04:31.983 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ 2023-10-18T12:04:31.983 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 411729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-18T12:04:31.983 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-18T12:04:31.983 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 7625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-18T12:04:31.984 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-18T12:04:31.984 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-18T12:04:31.984 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-18T12:04:31.984 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 7689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-18T12:04:31.984 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 7689 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-18T12:04:31.985 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10681 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-18T12:04:31.985 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-18T12:04:31.985 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 7697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-18T12:04:31.985 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-18T12:04:31.986 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 7697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-18T12:04:31.986 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10993 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-18T12:04:31.986 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 49257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conncount.ko 2023-10-18T12:04:31.986 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 408257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack.ko 2023-10-18T12:04:31.986 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-18T12:04:31.987 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-18T12:04:31.987 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 33761 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-18T12:04:31.987 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 118145 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-18T12:04:31.987 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 22185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-18T12:04:31.987 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 8817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-18T12:04:31.988 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 107297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-18T12:04:31.988 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 33633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-18T12:04:31.988 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-18T12:04:31.988 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 66641 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-18T12:04:31.988 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-18T12:04:31.988 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-18T12:04:31.989 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10113 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-18T12:04:31.989 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 89473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table.ko 2023-10-18T12:04:31.989 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9593 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-18T12:04:31.989 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 37129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-18T12:04:31.989 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 95417 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat.ko 2023-10-18T12:04:31.990 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-18T12:04:31.990 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-18T12:04:31.990 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11857 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-18T12:04:31.990 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 28929 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-18T12:04:31.990 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 8809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-18T12:04:31.991 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 44065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-18T12:04:31.991 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 615313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_tables.ko 2023-10-18T12:04:31.991 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 42561 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink.ko 2023-10-18T12:04:31.991 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 30233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-18T12:04:31.991 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 30569 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-10-18T12:04:31.992 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 39785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-18T12:04:31.992 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 22921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-18T12:04:31.992 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 49377 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-18T12:04:31.992 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10457 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-18T12:04:31.992 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 33209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_compat.ko 2023-10-18T12:04:31.992 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 40721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_ct.ko 2023-10-18T12:04:31.993 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-18T12:04:31.993 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fib.ko 2023-10-18T12:04:31.993 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-18T12:04:31.993 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14185 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_hash.ko 2023-10-18T12:04:31.993 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_limit.ko 2023-10-18T12:04:31.994 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_log.ko 2023-10-18T12:04:31.994 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_masq.ko 2023-10-18T12:04:31.994 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14329 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_nat.ko 2023-10-18T12:04:31.994 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13673 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_numgen.ko 2023-10-18T12:04:31.994 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11841 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_osf.ko 2023-10-18T12:04:31.994 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_queue.ko 2023-10-18T12:04:31.995 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_redir.ko 2023-10-18T12:04:31.995 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject.ko 2023-10-18T12:04:31.995 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-18T12:04:31.995 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_socket.ko 2023-10-18T12:04:31.995 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20369 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_synproxy.ko 2023-10-18T12:04:31.996 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_tproxy.ko 2023-10-18T12:04:31.996 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 89313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/x_tables.ko 2023-10-18T12:04:31.996 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-18T12:04:31.996 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-18T12:04:31.996 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 7729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-18T12:04:31.996 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-18T12:04:31.997 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 18169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CT.ko 2023-10-18T12:04:31.997 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_DSCP.ko 2023-10-18T12:04:31.997 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HL.ko 2023-10-18T12:04:31.997 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HMARK.ko 2023-10-18T12:04:31.997 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 38873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-18T12:04:31.998 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13889 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LED.ko 2023-10-18T12:04:31.998 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LOG.ko 2023-10-18T12:04:31.998 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11753 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-18T12:04:31.998 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-18T12:04:31.998 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-18T12:04:31.999 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-18T12:04:31.999 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-18T12:04:31.999 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-18T12:04:31.999 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 14337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-18T12:04:31.999 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-18T12:04:31.999 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-18T12:04:32.000 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17361 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TEE.ko 2023-10-18T12:04:32.000 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-18T12:04:32.000 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 8321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TRACE.ko 2023-10-18T12:04:32.000 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_addrtype.ko 2023-10-18T12:04:32.000 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_bpf.ko 2023-10-18T12:04:32.000 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cgroup.ko 2023-10-18T12:04:32.001 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11209 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cluster.ko 2023-10-18T12:04:32.001 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 7505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_comment.ko 2023-10-18T12:04:32.001 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10465 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connbytes.ko 2023-10-18T12:04:32.001 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11081 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlabel.ko 2023-10-18T12:04:32.001 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlimit.ko 2023-10-18T12:04:32.002 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connmark.ko 2023-10-18T12:04:32.002 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_conntrack.ko 2023-10-18T12:04:32.002 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 7817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cpu.ko 2023-10-18T12:04:32.002 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dccp.ko 2023-10-18T12:04:32.002 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 7865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_devgroup.ko 2023-10-18T12:04:32.003 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 8801 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dscp.ko 2023-10-18T12:04:32.003 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ecn.ko 2023-10-18T12:04:32.003 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_esp.ko 2023-10-18T12:04:32.003 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 43289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-18T12:04:32.003 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_helper.ko 2023-10-18T12:04:32.004 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 7865 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hl.ko 2023-10-18T12:04:32.004 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11921 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-18T12:04:32.004 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_iprange.ko 2023-10-18T12:04:32.004 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11785 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipvs.ko 2023-10-18T12:04:32.004 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16041 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_l2tp.ko 2023-10-18T12:04:32.005 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 8001 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_length.ko 2023-10-18T12:04:32.005 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_limit.ko 2023-10-18T12:04:32.005 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 7545 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mac.ko 2023-10-18T12:04:32.005 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 8641 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mark.ko 2023-10-18T12:04:32.005 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11825 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_multiport.ko 2023-10-18T12:04:32.006 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13817 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nat.ko 2023-10-18T12:04:32.006 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nfacct.ko 2023-10-18T12:04:32.006 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 8297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_osf.ko 2023-10-18T12:04:32.006 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_owner.ko 2023-10-18T12:04:32.006 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_physdev.ko 2023-10-18T12:04:32.007 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 7633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_pkttype.ko 2023-10-18T12:04:32.007 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11985 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_policy.ko 2023-10-18T12:04:32.007 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_quota.ko 2023-10-18T12:04:32.007 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_rateest.ko 2023-10-18T12:04:32.007 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 8257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_realm.ko 2023-10-18T12:04:32.007 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 36497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_recent.ko 2023-10-18T12:04:32.008 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_sctp.ko 2023-10-18T12:04:32.008 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 30089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_set.ko 2023-10-18T12:04:32.008 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 16089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_socket.ko 2023-10-18T12:04:32.008 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9505 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_state.ko 2023-10-18T12:04:32.008 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9473 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_statistic.ko 2023-10-18T12:04:32.009 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 8809 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_string.ko 2023-10-18T12:04:32.009 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 8553 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-18T12:04:32.009 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15777 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_tcpudp.ko 2023-10-18T12:04:32.009 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11129 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_time.ko 2023-10-18T12:04:32.009 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_u32.ko 2023-10-18T12:04:32.010 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink/ 2023-10-18T12:04:32.010 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13969 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink/netlink_diag.ko 2023-10-18T12:04:32.010 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh/ 2023-10-18T12:04:32.010 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 12425 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh/nsh.ko 2023-10-18T12:04:32.010 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/ 2023-10-18T12:04:32.011 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 380033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/openvswitch.ko 2023-10-18T12:04:32.011 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10321 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-geneve.ko 2023-10-18T12:04:32.011 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-gre.ko 2023-10-18T12:04:32.011 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 11793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-18T12:04:32.011 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet/ 2023-10-18T12:04:32.011 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13057 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet/af_packet_diag.ko 2023-10-18T12:04:32.012 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/phonet/ 2023-10-18T12:04:32.012 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 110201 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/phonet/phonet.ko 2023-10-18T12:04:32.012 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 54697 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/phonet/pn_pep.ko 2023-10-18T12:04:32.012 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/ 2023-10-18T12:04:32.012 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 251481 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds.ko 2023-10-18T12:04:32.013 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 164937 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_rdma.ko 2023-10-18T12:04:32.013 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 67377 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_tcp.ko 2023-10-18T12:04:32.013 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rxrpc/ 2023-10-18T12:04:32.013 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 819657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rxrpc/rxrpc.ko 2023-10-18T12:04:32.013 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/ 2023-10-18T12:04:32.014 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 32241 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_csum.ko 2023-10-18T12:04:32.014 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 23577 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_gact.ko 2023-10-18T12:04:32.014 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 26873 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_ipt.ko 2023-10-18T12:04:32.014 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 34097 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_mirred.ko 2023-10-18T12:04:32.014 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 23401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_nat.ko 2023-10-18T12:04:32.015 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 43449 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_pedit.ko 2023-10-18T12:04:32.015 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 31961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_police.ko 2023-10-18T12:04:32.015 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_simple.ko 2023-10-18T12:04:32.015 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 35297 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_skbedit.ko 2023-10-18T12:04:32.015 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 36665 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_vlan.ko 2023-10-18T12:04:32.016 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 26169 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_basic.ko 2023-10-18T12:04:32.016 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 33961 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_bpf.ko 2023-10-18T12:04:32.016 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19233 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_cgroup.ko 2023-10-18T12:04:32.016 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 31401 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_flow.ko 2023-10-18T12:04:32.016 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 31769 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_fw.ko 2023-10-18T12:04:32.016 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 38489 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_route.ko 2023-10-18T12:04:32.017 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 61409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_u32.ko 2023-10-18T12:04:32.017 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 7441 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_cmp.ko 2023-10-18T12:04:32.017 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 13409 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_ipset.ko 2023-10-18T12:04:32.017 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 33289 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_meta.ko 2023-10-18T12:04:32.017 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 7897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_nbyte.ko 2023-10-18T12:04:32.018 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_text.ko 2023-10-18T12:04:32.018 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 7249 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_u32.ko 2023-10-18T12:04:32.018 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 21649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_choke.ko 2023-10-18T12:04:32.018 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20849 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_codel.ko 2023-10-18T12:04:32.018 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 34633 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_drr.ko 2023-10-18T12:04:32.019 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 33609 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_fq.ko 2023-10-18T12:04:32.019 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 31617 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_fq_codel.ko 2023-10-18T12:04:32.019 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 35433 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_gred.ko 2023-10-18T12:04:32.019 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 49601 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hfsc.ko 2023-10-18T12:04:32.019 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 22089 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hhf.ko 2023-10-18T12:04:32.020 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 66393 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_htb.ko 2023-10-18T12:04:32.020 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 26073 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_ingress.ko 2023-10-18T12:04:32.020 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 30273 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio.ko 2023-10-18T12:04:32.020 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-18T12:04:32.020 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 26065 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_multiq.ko 2023-10-18T12:04:32.021 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 36137 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_netem.ko 2023-10-18T12:04:32.021 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 27497 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_pie.ko 2023-10-18T12:04:32.021 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10625 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_plug.ko 2023-10-18T12:04:32.021 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 24729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_prio.ko 2023-10-18T12:04:32.021 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 48793 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_qfq.ko 2023-10-18T12:04:32.021 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 32905 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_red.ko 2023-10-18T12:04:32.022 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 26881 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfb.ko 2023-10-18T12:04:32.022 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 31353 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfq.ko 2023-10-18T12:04:32.022 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 28897 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_tbf.ko 2023-10-18T12:04:32.022 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 28105 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_teql.ko 2023-10-18T12:04:32.022 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/ 2023-10-18T12:04:32.023 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 929745 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp.ko 2023-10-18T12:04:32.023 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 19033 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp_diag.ko 2023-10-18T12:04:32.023 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/ 2023-10-18T12:04:32.023 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/ 2023-10-18T12:04:32.023 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 336529 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-18T12:04:32.024 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 54737 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-18T12:04:32.024 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 1520161 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/sunrpc.ko 2023-10-18T12:04:32.024 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma/ 2023-10-18T12:04:32.024 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 707721 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-18T12:04:32.024 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/ 2023-10-18T12:04:32.025 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10025 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/diag.ko 2023-10-18T12:04:32.025 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 862641 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/tipc.ko 2023-10-18T12:04:32.025 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix/ 2023-10-18T12:04:32.025 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15729 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix/unix_diag.ko 2023-10-18T12:04:32.025 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/ 2023-10-18T12:04:32.026 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 85337 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-18T12:04:32.026 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 68049 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-18T12:04:32.026 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 96193 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock.ko 2023-10-18T12:04:32.026 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 10705 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-18T12:04:32.026 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 17521 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-18T12:04:32.027 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/x25/ 2023-10-18T12:04:32.027 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 125177 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/x25/x25.ko 2023-10-18T12:04:32.027 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/ 2023-10-18T12:04:32.027 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 22657 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_algo.ko 2023-10-18T12:04:32.027 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 20649 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-18T12:04:32.027 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 102257 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_user.ko 2023-10-18T12:04:32.028 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/ 2023-10-18T12:04:32.028 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib/ 2023-10-18T12:04:32.028 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 15537 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib/irqbypass.ko 2023-10-18T12:04:32.028 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 639863 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.alias 2023-10-18T12:04:32.028 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 623919 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.alias.bin 2023-10-18T12:04:32.029 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 7663 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.builtin 2023-10-18T12:04:32.029 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 23428 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.alias.bin 2023-10-18T12:04:32.029 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 9821 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.bin 2023-10-18T12:04:32.029 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 70004 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.modinfo 2023-10-18T12:04:32.029 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 146313 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.dep 2023-10-18T12:04:32.030 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 232548 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.dep.bin 2023-10-18T12:04:32.030 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 210 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.devname 2023-10-18T12:04:32.030 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 72606 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.order 2023-10-18T12:04:32.030 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 879 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.softdep 2023-10-18T12:04:32.030 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 254438 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.symbols 2023-10-18T12:04:32.031 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 309363 2023-10-10 19:59 ./lib/modules/6.6.0-rc5-g47672119149b/modules.symbols.bin 2023-10-18T12:04:32.031 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./usr/ 2023-10-18T12:04:32.031 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./usr/share/ 2023-10-18T12:04:32.031 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./usr/share/doc/ 2023-10-18T12:04:32.031 INFO:teuthology.orchestra.run.smithi172.stdout:drwxr-xr-x root/root 0 2023-10-10 19:59 ./usr/share/doc/linux-image-6.6.0-rc5-g47672119149b/ 2023-10-18T12:04:32.032 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 174 2023-10-10 19:59 ./usr/share/doc/linux-image-6.6.0-rc5-g47672119149b/changelog.Debian.gz 2023-10-18T12:04:32.032 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r-- root/root 691 2023-10-10 19:59 ./usr/share/doc/linux-image-6.6.0-rc5-g47672119149b/copyright 2023-10-18T12:04:32.033 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-rc5-g47672119149b 2023-10-18T12:04:32.033 INFO:teuthology.task.kernel:searching for kernel 6.6.0-rc5-g47672119149b 2023-10-18T12:04:32.033 DEBUG:teuthology.orchestra.run.smithi172:> egrep '(submenu|menuentry.*6.6.0-rc5-g47672119149b).*{' /boot/grub/grub.cfg 2023-10-18T12:04:32.042 INFO:teuthology.orchestra.run.smithi172.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-10-18T12:04:32.043 INFO:teuthology.orchestra.run.smithi172.stdout: menuentry 'Ubuntu, with Linux 6.6.0-rc5-g47672119149b' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-rc5-g47672119149b-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-10-18T12:04:32.043 INFO:teuthology.orchestra.run.smithi172.stdout: menuentry 'Ubuntu, with Linux 6.6.0-rc5-g47672119149b (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-rc5-g47672119149b-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-10-18T12:04:32.043 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-10-18T12:04:32.044 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-rc5-g47672119149b 2023-10-18T12:04:32.044 DEBUG:teuthology.orchestra.run.smithi172:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-10-18T12:04:32.086 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi172.front.sepia.ceph.com to complete... 2023-10-18T12:04:32.732 INFO:teuthology.orchestra.run.smithi172.stderr:Sourcing file `/etc/default/grub' 2023-10-18T12:04:32.737 INFO:teuthology.orchestra.run.smithi172.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-10-18T12:04:32.756 INFO:teuthology.orchestra.run.smithi172.stderr:Generating grub configuration file ... 2023-10-18T12:04:32.974 INFO:teuthology.orchestra.run.smithi172.stderr:Found linux image: /boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-18T12:04:32.985 INFO:teuthology.orchestra.run.smithi172.stderr:Found initrd image: /boot/initrd.img-6.6.0-rc5-g47672119149b 2023-10-18T12:04:33.325 INFO:teuthology.orchestra.run.smithi172.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-10-18T12:04:33.337 INFO:teuthology.orchestra.run.smithi172.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-10-18T12:04:34.328 INFO:teuthology.orchestra.run.smithi172.stderr:done 2023-10-18T12:04:45.556 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-18T12:04:45.556 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2023-10-18T12:04:45.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T12:05:05.454 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-10-18T12:05:05.455 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-10-18T12:05:05.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T12:05:23.967 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-10-18T12:05:32.974 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-10-18T12:05:32.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T12:05:36.033 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-10-18T12:05:45.569 DEBUG:teuthology.orchestra.remote:timed out 2023-10-18T12:05:48.037 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-10-18T12:05:48.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T12:05:54.574 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2023-10-18T12:05:54.575 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T12:05:54.973 DEBUG:teuthology.orchestra.run.smithi114:> true 2023-10-18T12:05:56.013 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com' 2023-10-18T12:05:56.013 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-rc5-g47672119149b"... 2023-10-18T12:05:56.013 DEBUG:teuthology.orchestra.run.smithi114:> uname -r 2023-10-18T12:05:56.071 INFO:teuthology.orchestra.run.smithi114.stdout:6.6.0-rc5-g47672119149b 2023-10-18T12:05:56.071 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-rc5-g47672119149b vs 6.6.0-rc5-g47672119149b 2023-10-18T12:05:56.072 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-18T12:05:56.072 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-18T12:05:57.074 DEBUG:teuthology.parallel:result is None 2023-10-18T12:06:06.458 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-10-18T12:06:21.460 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-10-18T12:06:21.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T12:06:23.515 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-10-18T12:06:41.516 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-10-18T12:06:41.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T12:06:41.767 DEBUG:teuthology.orchestra.run.smithi172:> true 2023-10-18T12:06:42.512 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-10-18T12:06:42.513 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.6.0-rc5-g47672119149b"... 2023-10-18T12:06:42.513 DEBUG:teuthology.orchestra.run.smithi172:> uname -r 2023-10-18T12:06:42.573 INFO:teuthology.orchestra.run.smithi172.stdout:6.6.0-rc5-g47672119149b 2023-10-18T12:06:42.573 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-rc5-g47672119149b vs 6.6.0-rc5-g47672119149b 2023-10-18T12:06:42.573 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-18T12:06:42.574 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-10-18T12:06:43.575 DEBUG:teuthology.parallel:result is None 2023-10-18T12:06:43.575 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-18T12:06:43.583 INFO:teuthology.task.internal:Creating test directory... 2023-10-18T12:06:43.583 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-18T12:06:43.591 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-18T12:06:43.610 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-18T12:06:43.617 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-18T12:06:43.624 INFO:teuthology.task.internal:Creating archive directory... 2023-10-18T12:06:43.624 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-18T12:06:43.656 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-18T12:06:43.691 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-18T12:06:43.698 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-18T12:06:43.698 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-18T12:06:43.728 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-18T12:06:43.833 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-18T12:06:43.847 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-18T12:06:43.855 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-18T12:06:43.876 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-18T12:06:43.879 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-18T12:06:43.890 INFO:teuthology.task.internal:Configuring sudo... 2023-10-18T12:06:43.891 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-18T12:06:43.898 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-18T12:06:43.935 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-18T12:06:43.944 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-18T12:06:43.945 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-18T12:06:43.976 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-18T12:06:43.997 DEBUG:teuthology.orchestra.run.smithi114:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-18T12:06:44.051 DEBUG:teuthology.orchestra.run.smithi114:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-18T12:06:44.113 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:06:44.114 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-18T12:06:44.198 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-18T12:06:44.220 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-18T12:06:44.282 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T12:06:44.283 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-18T12:06:44.369 DEBUG:teuthology.orchestra.run.smithi114:> sudo service rsyslog restart 2023-10-18T12:06:44.377 DEBUG:teuthology.orchestra.run.smithi172:> sudo service rsyslog restart 2023-10-18T12:06:44.526 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-18T12:06:44.535 INFO:teuthology.task.internal:Starting timer... 2023-10-18T12:06:44.535 INFO:teuthology.run_tasks:Running task pcp... 2023-10-18T12:06:44.545 INFO:teuthology.run_tasks:Running task selinux... 2023-10-18T12:06:44.554 DEBUG:teuthology.task.selinux:Excluding smithi114: OS 'ubuntu' does not support SELinux 2023-10-18T12:06:44.555 DEBUG:teuthology.task.selinux:Excluding smithi172: OS 'ubuntu' does not support SELinux 2023-10-18T12:06:44.555 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-18T12:06:44.555 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-10-18T12:06:44.556 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-18T12:06:44.556 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-18T12:06:44.569 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-18T12:06:44.569 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-18T12:06:44.590 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-18T12:06:44.592 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi114.front.sepia.ceph.com,smithi172.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-18T12:14:42.523 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi114.front.sepia.ceph.com'), Remote(name='ubuntu@smithi172.front.sepia.ceph.com')] 2023-10-18T12:14:42.550 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2023-10-18T12:14:42.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T12:14:42.657 DEBUG:teuthology.orchestra.run.smithi114:> true 2023-10-18T12:14:42.911 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com' 2023-10-18T12:14:42.911 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-10-18T12:14:42.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T12:14:43.021 DEBUG:teuthology.orchestra.run.smithi172:> true 2023-10-18T12:14:43.261 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-10-18T12:14:43.262 INFO:teuthology.run_tasks:Running task clock... 2023-10-18T12:14:43.273 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-18T12:14:43.273 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-18T12:14:43.274 DEBUG:teuthology.orchestra.run.smithi114:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-18T12:14:43.281 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-18T12:14:43.282 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-18T12:14:43.360 INFO:teuthology.orchestra.run.smithi114.stdout:18 Oct 12:14:43 ntpd[22744]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-10-18T12:14:43.360 INFO:teuthology.orchestra.run.smithi114.stdout:18 Oct 12:14:43 ntpd[22744]: Command line: ntpd -gq 2023-10-18T12:14:43.361 INFO:teuthology.orchestra.run.smithi114.stdout:18 Oct 12:14:43 ntpd[22744]: proto: precision = 0.041 usec (-24) 2023-10-18T12:14:43.361 INFO:teuthology.orchestra.run.smithi114.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-18T12:14:43.362 INFO:teuthology.orchestra.run.smithi114.stdout:18 Oct 12:14:43 ntpd[22744]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-18T12:14:43.362 INFO:teuthology.orchestra.run.smithi114.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-18T12:14:43.363 INFO:teuthology.orchestra.run.smithi114.stdout:18 Oct 12:14:43 ntpd[22744]: restrict ::: KOD does nothing without LIMITED. 2023-10-18T12:14:43.363 INFO:teuthology.orchestra.run.smithi114.stdout:18 Oct 12:14:43 ntpd[22744]: Listen and drop on 0 v6wildcard [::]:123 2023-10-18T12:14:43.364 INFO:teuthology.orchestra.run.smithi114.stdout:18 Oct 12:14:43 ntpd[22744]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-18T12:14:43.364 INFO:teuthology.orchestra.run.smithi114.stdout:18 Oct 12:14:43 ntpd[22744]: Listen normally on 2 lo 127.0.0.1:123 2023-10-18T12:14:43.364 INFO:teuthology.orchestra.run.smithi114.stdout:18 Oct 12:14:43 ntpd[22744]: Listen normally on 3 enp3s0f1 172.21.15.114:123 2023-10-18T12:14:43.364 INFO:teuthology.orchestra.run.smithi114.stdout:18 Oct 12:14:43 ntpd[22744]: Listen normally on 4 lo [::1]:123 2023-10-18T12:14:43.364 INFO:teuthology.orchestra.run.smithi114.stdout:18 Oct 12:14:43 ntpd[22744]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cb63%5]:123 2023-10-18T12:14:43.365 INFO:teuthology.orchestra.run.smithi114.stdout:18 Oct 12:14:43 ntpd[22744]: Listening on routing socket on fd #22 for interface updates 2023-10-18T12:14:43.382 INFO:teuthology.orchestra.run.smithi172.stdout:18 Oct 12:14:43 ntpd[22760]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-10-18T12:14:43.382 INFO:teuthology.orchestra.run.smithi172.stdout:18 Oct 12:14:43 ntpd[22760]: Command line: ntpd -gq 2023-10-18T12:14:43.383 INFO:teuthology.orchestra.run.smithi172.stdout:18 Oct 12:14:43 ntpd[22760]: proto: precision = 0.041 usec (-24) 2023-10-18T12:14:43.384 INFO:teuthology.orchestra.run.smithi172.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-18T12:14:43.386 INFO:teuthology.orchestra.run.smithi172.stdout:18 Oct 12:14:43 ntpd[22760]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-10-18T12:14:43.387 INFO:teuthology.orchestra.run.smithi172.stderr:restrict ::: KOD does nothing without LIMITED. 2023-10-18T12:14:43.388 INFO:teuthology.orchestra.run.smithi172.stdout:18 Oct 12:14:43 ntpd[22760]: restrict ::: KOD does nothing without LIMITED. 2023-10-18T12:14:43.388 INFO:teuthology.orchestra.run.smithi172.stdout:18 Oct 12:14:43 ntpd[22760]: Listen and drop on 0 v6wildcard [::]:123 2023-10-18T12:14:43.388 INFO:teuthology.orchestra.run.smithi172.stdout:18 Oct 12:14:43 ntpd[22760]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-10-18T12:14:43.388 INFO:teuthology.orchestra.run.smithi172.stdout:18 Oct 12:14:43 ntpd[22760]: Listen normally on 2 lo 127.0.0.1:123 2023-10-18T12:14:43.389 INFO:teuthology.orchestra.run.smithi172.stdout:18 Oct 12:14:43 ntpd[22760]: Listen normally on 3 enp3s0f1 172.21.15.172:123 2023-10-18T12:14:43.389 INFO:teuthology.orchestra.run.smithi172.stdout:18 Oct 12:14:43 ntpd[22760]: Listen normally on 4 lo [::1]:123 2023-10-18T12:14:43.389 INFO:teuthology.orchestra.run.smithi172.stdout:18 Oct 12:14:43 ntpd[22760]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f91%5]:123 2023-10-18T12:14:43.389 INFO:teuthology.orchestra.run.smithi172.stdout:18 Oct 12:14:43 ntpd[22760]: Listening on routing socket on fd #22 for interface updates 2023-10-18T12:14:44.361 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:44 ntpd[22744]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T12:14:44.361 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:44 ntpd[22744]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T12:14:44.362 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:44 ntpd[22744]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T12:14:44.362 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:44 ntpd[22744]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T12:14:44.362 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:44 ntpd[22744]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-18T12:14:44.362 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:44 ntpd[22744]: can't open /var/log/ntpstats/peerstats.20231018: Permission denied 2023-10-18T12:14:44.382 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:44 ntpd[22760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T12:14:44.383 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:44 ntpd[22760]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T12:14:45.361 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:45 ntpd[22744]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T12:14:45.361 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:45 ntpd[22744]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T12:14:45.362 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:45 ntpd[22744]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T12:14:45.362 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:45 ntpd[22744]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T12:14:45.362 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:45 ntpd[22744]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T12:14:45.362 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:45 ntpd[22744]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T12:14:45.362 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:45 ntpd[22744]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-18T12:14:45.363 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:45 ntpd[22744]: can't open /var/log/ntpstats/peerstats.20231018: Permission denied 2023-10-18T12:14:45.383 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:45 ntpd[22760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T12:14:45.383 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:45 ntpd[22760]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T12:14:45.383 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:45 ntpd[22760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T12:14:45.383 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:45 ntpd[22760]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T12:14:45.383 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:45 ntpd[22760]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-18T12:14:45.384 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:45 ntpd[22760]: can't open /var/log/ntpstats/peerstats.20231018: Permission denied 2023-10-18T12:14:46.361 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:46 ntpd[22744]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T12:14:46.361 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:46 ntpd[22744]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T12:14:46.361 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:46 ntpd[22744]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T12:14:46.362 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:46 ntpd[22744]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T12:14:46.362 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:46 ntpd[22744]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-18T12:14:46.362 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:46 ntpd[22744]: can't open /var/log/ntpstats/peerstats.20231018: Permission denied 2023-10-18T12:14:46.383 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:46 ntpd[22760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T12:14:46.384 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:46 ntpd[22760]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T12:14:46.384 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:46 ntpd[22760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T12:14:46.384 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:46 ntpd[22760]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T12:14:46.384 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:46 ntpd[22760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T12:14:46.384 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:46 ntpd[22760]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T12:14:46.385 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:46 ntpd[22760]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-18T12:14:46.385 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:46 ntpd[22760]: can't open /var/log/ntpstats/peerstats.20231018: Permission denied 2023-10-18T12:14:46.385 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:46 ntpd[22760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T12:14:46.385 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:46 ntpd[22760]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T12:14:46.385 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:46 ntpd[22760]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-18T12:14:46.386 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:46 ntpd[22760]: can't open /var/log/ntpstats/peerstats.20231018: Permission denied 2023-10-18T12:14:47.362 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:47 ntpd[22744]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T12:14:47.362 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:47 ntpd[22744]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T12:14:47.362 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:47 ntpd[22744]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T12:14:47.362 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:47 ntpd[22744]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T12:14:47.363 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:47 ntpd[22744]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T12:14:47.363 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:47 ntpd[22744]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T12:14:47.363 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:47 ntpd[22744]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-18T12:14:47.363 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:47 ntpd[22744]: can't open /var/log/ntpstats/peerstats.20231018: Permission denied 2023-10-18T12:14:47.363 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:47 ntpd[22744]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T12:14:47.364 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:47 ntpd[22744]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T12:14:47.364 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:47 ntpd[22744]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-18T12:14:47.364 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:47 ntpd[22744]: can't open /var/log/ntpstats/peerstats.20231018: Permission denied 2023-10-18T12:14:47.383 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:47 ntpd[22760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T12:14:47.383 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:47 ntpd[22760]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T12:14:47.384 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:47 ntpd[22760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T12:14:47.384 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:47 ntpd[22760]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T12:14:47.384 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:47 ntpd[22760]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-18T12:14:47.384 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:47 ntpd[22760]: can't open /var/log/ntpstats/peerstats.20231018: Permission denied 2023-10-18T12:14:48.361 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:48 ntpd[22744]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T12:14:48.361 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:48 ntpd[22744]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T12:14:48.362 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:48 ntpd[22744]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T12:14:48.362 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:48 ntpd[22744]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T12:14:48.362 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:48 ntpd[22744]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-18T12:14:48.362 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:48 ntpd[22744]: can't open /var/log/ntpstats/peerstats.20231018: Permission denied 2023-10-18T12:14:48.383 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:48 ntpd[22760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T12:14:48.383 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:48 ntpd[22760]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T12:14:48.383 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:48 ntpd[22760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T12:14:48.384 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:48 ntpd[22760]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T12:14:48.384 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:48 ntpd[22760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T12:14:48.384 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:48 ntpd[22760]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T12:14:48.384 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:48 ntpd[22760]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-18T12:14:48.384 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:48 ntpd[22760]: can't open /var/log/ntpstats/peerstats.20231018: Permission denied 2023-10-18T12:14:48.385 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:48 ntpd[22760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T12:14:48.385 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:48 ntpd[22760]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T12:14:48.385 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:48 ntpd[22760]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-18T12:14:48.385 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:48 ntpd[22760]: can't open /var/log/ntpstats/peerstats.20231018: Permission denied 2023-10-18T12:14:49.361 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:49 ntpd[22744]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T12:14:49.362 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:49 ntpd[22744]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T12:14:49.362 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:49 ntpd[22744]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T12:14:49.362 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:49 ntpd[22744]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T12:14:49.362 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:49 ntpd[22744]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T12:14:49.363 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:49 ntpd[22744]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T12:14:49.363 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:49 ntpd[22744]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-18T12:14:49.363 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:49 ntpd[22744]: can't open /var/log/ntpstats/peerstats.20231018: Permission denied 2023-10-18T12:14:49.363 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:49 ntpd[22744]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T12:14:49.363 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:49 ntpd[22744]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T12:14:49.364 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:49 ntpd[22744]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-18T12:14:49.364 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:49 ntpd[22744]: can't open /var/log/ntpstats/peerstats.20231018: Permission denied 2023-10-18T12:14:49.383 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:49 ntpd[22760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T12:14:49.383 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:49 ntpd[22760]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T12:14:49.383 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:49 ntpd[22760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T12:14:49.384 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:49 ntpd[22760]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T12:14:49.384 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:49 ntpd[22760]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-18T12:14:49.384 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:49 ntpd[22760]: can't open /var/log/ntpstats/peerstats.20231018: Permission denied 2023-10-18T12:14:50.361 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:50 ntpd[22744]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T12:14:50.361 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:50 ntpd[22744]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T12:14:50.362 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:50 ntpd[22744]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T12:14:50.362 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:50 ntpd[22744]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T12:14:50.362 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:50 ntpd[22744]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-18T12:14:50.362 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:50 ntpd[22744]: can't open /var/log/ntpstats/peerstats.20231018: Permission denied 2023-10-18T12:14:50.363 INFO:teuthology.orchestra.run.smithi114.stdout:18 Oct 12:14:50 ntpd[22744]: ntpd: time slew +0.000123 s 2023-10-18T12:14:50.363 INFO:teuthology.orchestra.run.smithi114.stdout:ntpd: time slew +0.000123s 2023-10-18T12:14:50.363 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:50 ntpd[22744]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-18T12:14:50.363 INFO:teuthology.orchestra.run.smithi114.stderr:18 Oct 12:14:50 ntpd[22744]: can't open /var/log/ntpstats/loopstats.20231018: Permission denied 2023-10-18T12:14:50.383 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:50 ntpd[22760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T12:14:50.384 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:50 ntpd[22760]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T12:14:50.384 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:50 ntpd[22760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T12:14:50.384 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:50 ntpd[22760]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T12:14:50.384 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:50 ntpd[22760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T12:14:50.384 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:50 ntpd[22760]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T12:14:50.385 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:50 ntpd[22760]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-18T12:14:50.385 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:50 ntpd[22760]: can't open /var/log/ntpstats/peerstats.20231018: Permission denied 2023-10-18T12:14:50.385 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:50 ntpd[22760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T12:14:50.385 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:50 ntpd[22760]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T12:14:50.385 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:50 ntpd[22760]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-18T12:14:50.386 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:50 ntpd[22760]: can't open /var/log/ntpstats/peerstats.20231018: Permission denied 2023-10-18T12:14:50.493 INFO:teuthology.orchestra.run.smithi114.stdout: remote refid st t when poll reach delay offset jitter 2023-10-18T12:14:50.494 INFO:teuthology.orchestra.run.smithi114.stdout:============================================================================== 2023-10-18T12:14:50.494 INFO:teuthology.orchestra.run.smithi114.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-18T12:14:50.494 INFO:teuthology.orchestra.run.smithi114.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-18T12:14:50.494 INFO:teuthology.orchestra.run.smithi114.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-18T12:14:50.495 INFO:teuthology.orchestra.run.smithi114.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-18T12:14:51.383 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:51 ntpd[22760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T12:14:51.383 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:51 ntpd[22760]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T12:14:51.384 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:51 ntpd[22760]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-10-18T12:14:51.384 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:51 ntpd[22760]: can't open /var/log/ntpstats/rawstats.20231018: Permission denied 2023-10-18T12:14:51.384 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:51 ntpd[22760]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-10-18T12:14:51.384 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:51 ntpd[22760]: can't open /var/log/ntpstats/peerstats.20231018: Permission denied 2023-10-18T12:14:51.385 INFO:teuthology.orchestra.run.smithi172.stdout:18 Oct 12:14:51 ntpd[22760]: ntpd: time slew -0.000506 s 2023-10-18T12:14:51.385 INFO:teuthology.orchestra.run.smithi172.stdout:ntpd: time slew -0.000506s 2023-10-18T12:14:51.385 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:51 ntpd[22760]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-10-18T12:14:51.386 INFO:teuthology.orchestra.run.smithi172.stderr:18 Oct 12:14:51 ntpd[22760]: can't open /var/log/ntpstats/loopstats.20231018: Permission denied 2023-10-18T12:14:51.535 INFO:teuthology.orchestra.run.smithi172.stdout: remote refid st t when poll reach delay offset jitter 2023-10-18T12:14:51.535 INFO:teuthology.orchestra.run.smithi172.stdout:============================================================================== 2023-10-18T12:14:51.536 INFO:teuthology.orchestra.run.smithi172.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-18T12:14:51.536 INFO:teuthology.orchestra.run.smithi172.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-18T12:14:51.537 INFO:teuthology.orchestra.run.smithi172.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-18T12:14:51.537 INFO:teuthology.orchestra.run.smithi172.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-10-18T12:14:51.539 INFO:teuthology.run_tasks:Running task install... 2023-10-18T12:14:51.551 DEBUG:teuthology.task.install:project ceph 2023-10-18T12:14:51.552 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '6f3e6b48891b9b50415c0822b6b870797fcda16d'}} 2023-10-18T12:14:51.552 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '6f3e6b48891b9b50415c0822b6b870797fcda16d'} 2023-10-18T12:14:51.553 INFO:teuthology.task.install:Using flavor: default 2023-10-18T12:14:51.565 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-18T12:14:51.566 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-18T12:14:51.567 DEBUG:teuthology.orchestra.run.smithi114:> sudo apt-key list | grep Ceph 2023-10-18T12:14:51.568 DEBUG:teuthology.orchestra.run.smithi172:> sudo apt-key list | grep Ceph 2023-10-18T12:14:51.798 INFO:teuthology.orchestra.run.smithi172.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-10-18T12:14:51.809 INFO:teuthology.orchestra.run.smithi114.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-10-18T12:14:51.945 INFO:teuthology.orchestra.run.smithi172.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-18T12:14:51.945 INFO:teuthology.orchestra.run.smithi172.stdout:uid [ unknown] Ceph.com (release key) 2023-10-18T12:14:51.947 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-18T12:14:51.947 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-10-18T12:14:51.948 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=6f3e6b48891b9b50415c0822b6b870797fcda16d 2023-10-18T12:14:51.960 INFO:teuthology.orchestra.run.smithi114.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-10-18T12:14:51.961 INFO:teuthology.orchestra.run.smithi114.stdout:uid [ unknown] Ceph.com (release key) 2023-10-18T12:14:51.962 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-10-18T12:14:51.962 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-10-18T12:14:51.963 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=6f3e6b48891b9b50415c0822b6b870797fcda16d 2023-10-18T12:14:52.178 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default/ 2023-10-18T12:14:52.178 INFO:teuthology.task.install.deb:Package version is 18.0.0-5610-g6f3e6b48-1focal 2023-10-18T12:14:52.183 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default/ 2023-10-18T12:14:52.183 INFO:teuthology.task.install.deb:Package version is 18.0.0-5610-g6f3e6b48-1focal 2023-10-18T12:14:52.356 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T12:14:52.357 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-18T12:14:52.371 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:14:52.371 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-10-18T12:14:52.392 DEBUG:teuthology.orchestra.run.smithi172:> sudo apt-get update 2023-10-18T12:14:52.406 DEBUG:teuthology.orchestra.run.smithi114:> sudo apt-get update 2023-10-18T12:14:52.687 INFO:teuthology.orchestra.run.smithi114.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-18T12:14:52.688 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-10-18T12:14:52.778 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-18T12:14:52.781 INFO:teuthology.orchestra.run.smithi114.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-10-18T12:14:52.785 INFO:teuthology.orchestra.run.smithi114.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal InRelease 2023-10-18T12:14:52.786 INFO:teuthology.orchestra.run.smithi172.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal InRelease 2023-10-18T12:14:52.823 INFO:teuthology.orchestra.run.smithi114.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-10-18T12:14:52.824 INFO:teuthology.orchestra.run.smithi172.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-10-18T12:14:52.860 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-18T12:14:52.864 INFO:teuthology.orchestra.run.smithi114.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal Release.gpg 2023-10-18T12:14:52.864 INFO:teuthology.orchestra.run.smithi114.stdout:Hit:6 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-10-18T12:14:52.866 INFO:teuthology.orchestra.run.smithi172.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal Release.gpg 2023-10-18T12:14:52.906 INFO:teuthology.orchestra.run.smithi114.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main i386 Packages [3,429 B] 2023-10-18T12:14:52.907 INFO:teuthology.orchestra.run.smithi172.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main i386 Packages [3,429 B] 2023-10-18T12:14:52.942 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-18T12:14:52.945 INFO:teuthology.orchestra.run.smithi114.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-10-18T12:14:52.963 INFO:teuthology.orchestra.run.smithi114.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-10-18T12:14:52.969 INFO:teuthology.orchestra.run.smithi172.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-10-18T12:14:54.087 INFO:teuthology.orchestra.run.smithi114.stdout:Fetched 28.5 kB in 1s (21.3 kB/s) 2023-10-18T12:14:54.128 INFO:teuthology.orchestra.run.smithi172.stdout:Fetched 28.5 kB in 1s (20.8 kB/s) 2023-10-18T12:14:55.288 INFO:teuthology.orchestra.run.smithi114.stdout:Reading package lists... 2023-10-18T12:14:55.328 INFO:teuthology.orchestra.run.smithi172.stdout:Reading package lists... 2023-10-18T12:14:55.330 DEBUG:teuthology.orchestra.run.smithi114:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-5610-g6f3e6b48-1focal cephadm=18.0.0-5610-g6f3e6b48-1focal ceph-mds=18.0.0-5610-g6f3e6b48-1focal ceph-mgr=18.0.0-5610-g6f3e6b48-1focal ceph-common=18.0.0-5610-g6f3e6b48-1focal ceph-fuse=18.0.0-5610-g6f3e6b48-1focal ceph-test=18.0.0-5610-g6f3e6b48-1focal ceph-volume=18.0.0-5610-g6f3e6b48-1focal radosgw=18.0.0-5610-g6f3e6b48-1focal python3-rados=18.0.0-5610-g6f3e6b48-1focal python3-rgw=18.0.0-5610-g6f3e6b48-1focal python3-cephfs=18.0.0-5610-g6f3e6b48-1focal python3-rbd=18.0.0-5610-g6f3e6b48-1focal libcephfs2=18.0.0-5610-g6f3e6b48-1focal libcephfs-dev=18.0.0-5610-g6f3e6b48-1focal librados2=18.0.0-5610-g6f3e6b48-1focal librbd1=18.0.0-5610-g6f3e6b48-1focal rbd-fuse=18.0.0-5610-g6f3e6b48-1focal python3-cephfs=18.0.0-5610-g6f3e6b48-1focal cephfs-shell=18.0.0-5610-g6f3e6b48-1focal cephfs-top=18.0.0-5610-g6f3e6b48-1focal cephfs-mirror=18.0.0-5610-g6f3e6b48-1focal 2023-10-18T12:14:55.366 DEBUG:teuthology.orchestra.run.smithi172:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-5610-g6f3e6b48-1focal cephadm=18.0.0-5610-g6f3e6b48-1focal ceph-mds=18.0.0-5610-g6f3e6b48-1focal ceph-mgr=18.0.0-5610-g6f3e6b48-1focal ceph-common=18.0.0-5610-g6f3e6b48-1focal ceph-fuse=18.0.0-5610-g6f3e6b48-1focal ceph-test=18.0.0-5610-g6f3e6b48-1focal ceph-volume=18.0.0-5610-g6f3e6b48-1focal radosgw=18.0.0-5610-g6f3e6b48-1focal python3-rados=18.0.0-5610-g6f3e6b48-1focal python3-rgw=18.0.0-5610-g6f3e6b48-1focal python3-cephfs=18.0.0-5610-g6f3e6b48-1focal python3-rbd=18.0.0-5610-g6f3e6b48-1focal libcephfs2=18.0.0-5610-g6f3e6b48-1focal libcephfs-dev=18.0.0-5610-g6f3e6b48-1focal librados2=18.0.0-5610-g6f3e6b48-1focal librbd1=18.0.0-5610-g6f3e6b48-1focal rbd-fuse=18.0.0-5610-g6f3e6b48-1focal python3-cephfs=18.0.0-5610-g6f3e6b48-1focal cephfs-shell=18.0.0-5610-g6f3e6b48-1focal cephfs-top=18.0.0-5610-g6f3e6b48-1focal cephfs-mirror=18.0.0-5610-g6f3e6b48-1focal 2023-10-18T12:14:55.450 INFO:teuthology.orchestra.run.smithi114.stdout:Reading package lists... 2023-10-18T12:14:55.491 INFO:teuthology.orchestra.run.smithi172.stdout:Reading package lists... 2023-10-18T12:14:55.657 INFO:teuthology.orchestra.run.smithi114.stdout:Building dependency tree... 2023-10-18T12:14:55.658 INFO:teuthology.orchestra.run.smithi114.stdout:Reading state information... 2023-10-18T12:14:55.674 INFO:teuthology.orchestra.run.smithi172.stdout:Building dependency tree... 2023-10-18T12:14:55.675 INFO:teuthology.orchestra.run.smithi172.stdout:Reading state information... 2023-10-18T12:14:55.848 INFO:teuthology.orchestra.run.smithi172.stdout:The following packages were automatically installed and are no longer required: 2023-10-18T12:14:55.849 INFO:teuthology.orchestra.run.smithi172.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-18T12:14:55.849 INFO:teuthology.orchestra.run.smithi172.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-18T12:14:55.849 INFO:teuthology.orchestra.run.smithi172.stdout:The following additional packages will be installed: 2023-10-18T12:14:55.850 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-18T12:14:55.850 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-10-18T12:14:55.850 INFO:teuthology.orchestra.run.smithi172.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-10-18T12:14:55.850 INFO:teuthology.orchestra.run.smithi172.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-10-18T12:14:55.851 INFO:teuthology.orchestra.run.smithi172.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-10-18T12:14:55.852 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-10-18T12:14:55.853 INFO:teuthology.orchestra.run.smithi172.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-10-18T12:14:55.853 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-10-18T12:14:55.853 INFO:teuthology.orchestra.run.smithi172.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-10-18T12:14:55.853 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2023-10-18T12:14:55.854 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-10-18T12:14:55.854 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-10-18T12:14:55.854 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-10-18T12:14:55.854 INFO:teuthology.orchestra.run.smithi172.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-10-18T12:14:55.854 INFO:teuthology.orchestra.run.smithi172.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-10-18T12:14:55.855 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-10-18T12:14:55.855 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2023-10-18T12:14:55.855 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-10-18T12:14:55.855 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-10-18T12:14:55.855 INFO:teuthology.orchestra.run.smithi172.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-18T12:14:55.856 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-18T12:14:55.856 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-18T12:14:55.856 INFO:teuthology.orchestra.run.smithi172.stdout: qttranslations5-l10n socat xmlstarlet 2023-10-18T12:14:55.856 INFO:teuthology.orchestra.run.smithi172.stdout:Suggested packages: 2023-10-18T12:14:55.856 INFO:teuthology.orchestra.run.smithi172.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-10-18T12:14:55.857 INFO:teuthology.orchestra.run.smithi172.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-10-18T12:14:55.857 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-10-18T12:14:55.857 INFO:teuthology.orchestra.run.smithi172.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-10-18T12:14:55.857 INFO:teuthology.orchestra.run.smithi172.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-10-18T12:14:55.857 INFO:teuthology.orchestra.run.smithi172.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-10-18T12:14:55.857 INFO:teuthology.orchestra.run.smithi172.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-10-18T12:14:55.858 INFO:teuthology.orchestra.run.smithi172.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-10-18T12:14:55.858 INFO:teuthology.orchestra.run.smithi172.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-10-18T12:14:55.858 INFO:teuthology.orchestra.run.smithi172.stdout:Recommended packages: 2023-10-18T12:14:55.859 INFO:teuthology.orchestra.run.smithi172.stdout: btrfs-tools 2023-10-18T12:14:55.859 INFO:teuthology.orchestra.run.smithi114.stdout:The following packages were automatically installed and are no longer required: 2023-10-18T12:14:55.859 INFO:teuthology.orchestra.run.smithi114.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-18T12:14:55.860 INFO:teuthology.orchestra.run.smithi114.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-18T12:14:55.860 INFO:teuthology.orchestra.run.smithi114.stdout:The following additional packages will be installed: 2023-10-18T12:14:55.860 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-10-18T12:14:55.860 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-10-18T12:14:55.861 INFO:teuthology.orchestra.run.smithi114.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-10-18T12:14:55.861 INFO:teuthology.orchestra.run.smithi114.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-10-18T12:14:55.861 INFO:teuthology.orchestra.run.smithi114.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-10-18T12:14:55.861 INFO:teuthology.orchestra.run.smithi114.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-10-18T12:14:55.861 INFO:teuthology.orchestra.run.smithi114.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-10-18T12:14:55.862 INFO:teuthology.orchestra.run.smithi114.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-10-18T12:14:55.862 INFO:teuthology.orchestra.run.smithi114.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-10-18T12:14:55.862 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2023-10-18T12:14:55.862 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-10-18T12:14:55.862 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-10-18T12:14:55.863 INFO:teuthology.orchestra.run.smithi114.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-10-18T12:14:55.863 INFO:teuthology.orchestra.run.smithi114.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-10-18T12:14:55.863 INFO:teuthology.orchestra.run.smithi114.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-10-18T12:14:55.863 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-10-18T12:14:55.864 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2023-10-18T12:14:55.864 INFO:teuthology.orchestra.run.smithi114.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-10-18T12:14:55.864 INFO:teuthology.orchestra.run.smithi114.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-10-18T12:14:55.864 INFO:teuthology.orchestra.run.smithi114.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-18T12:14:55.864 INFO:teuthology.orchestra.run.smithi114.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-18T12:14:55.865 INFO:teuthology.orchestra.run.smithi114.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-18T12:14:55.865 INFO:teuthology.orchestra.run.smithi114.stdout: qttranslations5-l10n socat xmlstarlet 2023-10-18T12:14:55.865 INFO:teuthology.orchestra.run.smithi114.stdout:Suggested packages: 2023-10-18T12:14:55.865 INFO:teuthology.orchestra.run.smithi114.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-10-18T12:14:55.866 INFO:teuthology.orchestra.run.smithi114.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-10-18T12:14:55.866 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-10-18T12:14:55.866 INFO:teuthology.orchestra.run.smithi114.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-10-18T12:14:55.866 INFO:teuthology.orchestra.run.smithi114.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-10-18T12:14:55.866 INFO:teuthology.orchestra.run.smithi114.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-10-18T12:14:55.867 INFO:teuthology.orchestra.run.smithi114.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-10-18T12:14:55.867 INFO:teuthology.orchestra.run.smithi114.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-10-18T12:14:55.867 INFO:teuthology.orchestra.run.smithi114.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-10-18T12:14:55.867 INFO:teuthology.orchestra.run.smithi114.stdout:Recommended packages: 2023-10-18T12:14:55.867 INFO:teuthology.orchestra.run.smithi114.stdout: btrfs-tools 2023-10-18T12:14:56.055 INFO:teuthology.orchestra.run.smithi172.stdout:The following NEW packages will be installed: 2023-10-18T12:14:56.056 INFO:teuthology.orchestra.run.smithi172.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-18T12:14:56.056 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-18T12:14:56.056 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-18T12:14:56.057 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-10-18T12:14:56.057 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-10-18T12:14:56.057 INFO:teuthology.orchestra.run.smithi172.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-10-18T12:14:56.057 INFO:teuthology.orchestra.run.smithi172.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-10-18T12:14:56.058 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-10-18T12:14:56.058 INFO:teuthology.orchestra.run.smithi172.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-10-18T12:14:56.058 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-10-18T12:14:56.058 INFO:teuthology.orchestra.run.smithi172.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-10-18T12:14:56.059 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2023-10-18T12:14:56.059 INFO:teuthology.orchestra.run.smithi172.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-10-18T12:14:56.059 INFO:teuthology.orchestra.run.smithi172.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-10-18T12:14:56.060 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-18T12:14:56.060 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-18T12:14:56.060 INFO:teuthology.orchestra.run.smithi172.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-18T12:14:56.061 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-18T12:14:56.061 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-18T12:14:56.061 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-10-18T12:14:56.061 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-18T12:14:56.062 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-10-18T12:14:56.062 INFO:teuthology.orchestra.run.smithi172.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-18T12:14:56.062 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-18T12:14:56.063 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-18T12:14:56.063 INFO:teuthology.orchestra.run.smithi172.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-10-18T12:14:56.064 INFO:teuthology.orchestra.run.smithi172.stdout:The following packages will be upgraded: 2023-10-18T12:14:56.064 INFO:teuthology.orchestra.run.smithi172.stdout: librados2 librbd1 2023-10-18T12:14:56.066 INFO:teuthology.orchestra.run.smithi114.stdout:The following NEW packages will be installed: 2023-10-18T12:14:56.066 INFO:teuthology.orchestra.run.smithi114.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-10-18T12:14:56.066 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-10-18T12:14:56.066 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-10-18T12:14:56.066 INFO:teuthology.orchestra.run.smithi114.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-10-18T12:14:56.067 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-10-18T12:14:56.067 INFO:teuthology.orchestra.run.smithi114.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-10-18T12:14:56.067 INFO:teuthology.orchestra.run.smithi114.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-10-18T12:14:56.067 INFO:teuthology.orchestra.run.smithi114.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-10-18T12:14:56.068 INFO:teuthology.orchestra.run.smithi114.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-10-18T12:14:56.068 INFO:teuthology.orchestra.run.smithi114.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-10-18T12:14:56.068 INFO:teuthology.orchestra.run.smithi114.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-10-18T12:14:56.068 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2023-10-18T12:14:56.068 INFO:teuthology.orchestra.run.smithi114.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-10-18T12:14:56.069 INFO:teuthology.orchestra.run.smithi114.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-10-18T12:14:56.069 INFO:teuthology.orchestra.run.smithi114.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-10-18T12:14:56.069 INFO:teuthology.orchestra.run.smithi114.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-10-18T12:14:56.069 INFO:teuthology.orchestra.run.smithi114.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-10-18T12:14:56.069 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-10-18T12:14:56.070 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-10-18T12:14:56.070 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-10-18T12:14:56.070 INFO:teuthology.orchestra.run.smithi114.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-10-18T12:14:56.070 INFO:teuthology.orchestra.run.smithi114.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-10-18T12:14:56.071 INFO:teuthology.orchestra.run.smithi114.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-10-18T12:14:56.071 INFO:teuthology.orchestra.run.smithi114.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-10-18T12:14:56.071 INFO:teuthology.orchestra.run.smithi114.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-10-18T12:14:56.071 INFO:teuthology.orchestra.run.smithi114.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-10-18T12:14:56.072 INFO:teuthology.orchestra.run.smithi114.stdout:The following packages will be upgraded: 2023-10-18T12:14:56.072 INFO:teuthology.orchestra.run.smithi114.stdout: librados2 librbd1 2023-10-18T12:14:56.245 INFO:teuthology.orchestra.run.smithi172.stdout:2 upgraded, 116 newly installed, 0 to remove and 256 not upgraded. 2023-10-18T12:14:56.245 INFO:teuthology.orchestra.run.smithi172.stdout:Need to get 210 MB of archives. 2023-10-18T12:14:56.245 INFO:teuthology.orchestra.run.smithi172.stdout:After this operation, 1,040 MB of additional disk space will be used. 2023-10-18T12:14:56.246 INFO:teuthology.orchestra.run.smithi172.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-5610-g6f3e6b48-1focal [3,591 kB] 2023-10-18T12:14:56.255 INFO:teuthology.orchestra.run.smithi114.stdout:2 upgraded, 116 newly installed, 0 to remove and 256 not upgraded. 2023-10-18T12:14:56.255 INFO:teuthology.orchestra.run.smithi114.stdout:Need to get 210 MB of archives. 2023-10-18T12:14:56.255 INFO:teuthology.orchestra.run.smithi114.stdout:After this operation, 1,040 MB of additional disk space will be used. 2023-10-18T12:14:56.256 INFO:teuthology.orchestra.run.smithi114.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-5610-g6f3e6b48-1focal [3,591 kB] 2023-10-18T12:14:56.280 INFO:teuthology.orchestra.run.smithi172.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-10-18T12:14:56.288 INFO:teuthology.orchestra.run.smithi114.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-10-18T12:14:56.365 INFO:teuthology.orchestra.run.smithi172.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-10-18T12:14:56.373 INFO:teuthology.orchestra.run.smithi114.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-10-18T12:14:56.399 INFO:teuthology.orchestra.run.smithi172.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-10-18T12:14:56.408 INFO:teuthology.orchestra.run.smithi114.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-10-18T12:14:56.538 INFO:teuthology.orchestra.run.smithi172.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-10-18T12:14:56.545 INFO:teuthology.orchestra.run.smithi114.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-10-18T12:14:56.561 INFO:teuthology.orchestra.run.smithi172.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-5610-g6f3e6b48-1focal [4,010 kB] 2023-10-18T12:14:56.583 INFO:teuthology.orchestra.run.smithi114.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-5610-g6f3e6b48-1focal [4,010 kB] 2023-10-18T12:14:56.674 INFO:teuthology.orchestra.run.smithi172.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-10-18T12:14:56.681 INFO:teuthology.orchestra.run.smithi114.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-10-18T12:14:56.693 INFO:teuthology.orchestra.run.smithi172.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-10-18T12:14:56.699 INFO:teuthology.orchestra.run.smithi114.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-10-18T12:14:56.754 INFO:teuthology.orchestra.run.smithi172.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-10-18T12:14:56.760 INFO:teuthology.orchestra.run.smithi114.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-10-18T12:14:56.787 INFO:teuthology.orchestra.run.smithi172.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-5610-g6f3e6b48-1focal [736 kB] 2023-10-18T12:14:56.818 INFO:teuthology.orchestra.run.smithi114.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-5610-g6f3e6b48-1focal [736 kB] 2023-10-18T12:14:56.847 INFO:teuthology.orchestra.run.smithi172.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-5610-g6f3e6b48-1focal [378 kB] 2023-10-18T12:14:56.859 INFO:teuthology.orchestra.run.smithi172.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-5610-g6f3e6b48-1focal [22.5 kB] 2023-10-18T12:14:56.860 INFO:teuthology.orchestra.run.smithi172.stdout:Get:13 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-5610-g6f3e6b48-1focal [191 kB] 2023-10-18T12:14:56.878 INFO:teuthology.orchestra.run.smithi114.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-5610-g6f3e6b48-1focal [378 kB] 2023-10-18T12:14:56.890 INFO:teuthology.orchestra.run.smithi114.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-5610-g6f3e6b48-1focal [22.5 kB] 2023-10-18T12:14:56.891 INFO:teuthology.orchestra.run.smithi114.stdout:Get:13 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-5610-g6f3e6b48-1focal [191 kB] 2023-10-18T12:14:56.897 INFO:teuthology.orchestra.run.smithi114.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-5610-g6f3e6b48-1focal [51.7 kB] 2023-10-18T12:14:56.899 INFO:teuthology.orchestra.run.smithi114.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-5610-g6f3e6b48-1focal [355 kB] 2023-10-18T12:14:56.906 INFO:teuthology.orchestra.run.smithi172.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-5610-g6f3e6b48-1focal [51.7 kB] 2023-10-18T12:14:56.908 INFO:teuthology.orchestra.run.smithi172.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-5610-g6f3e6b48-1focal [355 kB] 2023-10-18T12:14:56.919 INFO:teuthology.orchestra.run.smithi172.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-5610-g6f3e6b48-1focal [6,829 kB] 2023-10-18T12:14:56.949 INFO:teuthology.orchestra.run.smithi114.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-5610-g6f3e6b48-1focal [6,829 kB] 2023-10-18T12:14:56.957 INFO:teuthology.orchestra.run.smithi172.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-10-18T12:14:56.962 INFO:teuthology.orchestra.run.smithi114.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-10-18T12:14:56.965 INFO:teuthology.orchestra.run.smithi172.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-10-18T12:14:56.970 INFO:teuthology.orchestra.run.smithi114.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-10-18T12:14:56.992 INFO:teuthology.orchestra.run.smithi172.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-10-18T12:14:56.997 INFO:teuthology.orchestra.run.smithi114.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-10-18T12:14:57.000 INFO:teuthology.orchestra.run.smithi172.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-10-18T12:14:57.005 INFO:teuthology.orchestra.run.smithi114.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-10-18T12:14:57.165 INFO:teuthology.orchestra.run.smithi172.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-10-18T12:14:57.170 INFO:teuthology.orchestra.run.smithi114.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-10-18T12:14:57.380 INFO:teuthology.orchestra.run.smithi172.stdout:Get:22 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-5610-g6f3e6b48-1focal [103 kB] 2023-10-18T12:14:57.381 INFO:teuthology.orchestra.run.smithi172.stdout:Get:23 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-5610-g6f3e6b48-1focal [464 kB] 2023-10-18T12:14:57.398 INFO:teuthology.orchestra.run.smithi114.stdout:Get:22 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-5610-g6f3e6b48-1focal [103 kB] 2023-10-18T12:14:57.400 INFO:teuthology.orchestra.run.smithi114.stdout:Get:23 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-5610-g6f3e6b48-1focal [464 kB] 2023-10-18T12:14:57.411 INFO:teuthology.orchestra.run.smithi114.stdout:Get:24 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-5610-g6f3e6b48-1focal [25.7 MB] 2023-10-18T12:14:57.427 INFO:teuthology.orchestra.run.smithi172.stdout:Get:24 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-5610-g6f3e6b48-1focal [25.7 MB] 2023-10-18T12:14:57.533 INFO:teuthology.orchestra.run.smithi172.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-10-18T12:14:57.539 INFO:teuthology.orchestra.run.smithi114.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-10-18T12:14:57.554 INFO:teuthology.orchestra.run.smithi172.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-10-18T12:14:57.561 INFO:teuthology.orchestra.run.smithi114.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-10-18T12:14:57.733 INFO:teuthology.orchestra.run.smithi172.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-10-18T12:14:57.739 INFO:teuthology.orchestra.run.smithi114.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-10-18T12:14:57.742 INFO:teuthology.orchestra.run.smithi172.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-10-18T12:14:57.749 INFO:teuthology.orchestra.run.smithi114.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-10-18T12:14:57.779 INFO:teuthology.orchestra.run.smithi172.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-10-18T12:14:57.784 INFO:teuthology.orchestra.run.smithi172.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-10-18T12:14:57.789 INFO:teuthology.orchestra.run.smithi172.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-10-18T12:14:57.790 INFO:teuthology.orchestra.run.smithi114.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-10-18T12:14:57.791 INFO:teuthology.orchestra.run.smithi172.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-10-18T12:14:57.792 INFO:teuthology.orchestra.run.smithi114.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-10-18T12:14:57.794 INFO:teuthology.orchestra.run.smithi114.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-10-18T12:14:57.797 INFO:teuthology.orchestra.run.smithi114.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-10-18T12:14:57.799 INFO:teuthology.orchestra.run.smithi172.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-18T12:14:57.800 INFO:teuthology.orchestra.run.smithi172.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-10-18T12:14:57.806 INFO:teuthology.orchestra.run.smithi114.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-10-18T12:14:57.807 INFO:teuthology.orchestra.run.smithi114.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-10-18T12:14:57.967 INFO:teuthology.orchestra.run.smithi172.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-10-18T12:14:57.972 INFO:teuthology.orchestra.run.smithi114.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-10-18T12:14:58.308 INFO:teuthology.orchestra.run.smithi172.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-10-18T12:14:58.310 INFO:teuthology.orchestra.run.smithi114.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-10-18T12:14:58.332 INFO:teuthology.orchestra.run.smithi172.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-10-18T12:14:58.333 INFO:teuthology.orchestra.run.smithi114.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-10-18T12:14:58.403 INFO:teuthology.orchestra.run.smithi114.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-10-18T12:14:58.404 INFO:teuthology.orchestra.run.smithi172.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-10-18T12:14:58.467 INFO:teuthology.orchestra.run.smithi114.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-10-18T12:14:58.468 INFO:teuthology.orchestra.run.smithi172.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-10-18T12:14:58.475 INFO:teuthology.orchestra.run.smithi114.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-10-18T12:14:58.476 INFO:teuthology.orchestra.run.smithi172.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-10-18T12:14:58.594 INFO:teuthology.orchestra.run.smithi114.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-10-18T12:14:58.595 INFO:teuthology.orchestra.run.smithi114.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-10-18T12:14:58.597 INFO:teuthology.orchestra.run.smithi172.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-10-18T12:14:58.597 INFO:teuthology.orchestra.run.smithi172.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-10-18T12:14:58.599 INFO:teuthology.orchestra.run.smithi114.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-10-18T12:14:58.602 INFO:teuthology.orchestra.run.smithi172.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-10-18T12:14:58.602 INFO:teuthology.orchestra.run.smithi114.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-10-18T12:14:58.605 INFO:teuthology.orchestra.run.smithi172.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-10-18T12:14:58.614 INFO:teuthology.orchestra.run.smithi114.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-10-18T12:14:58.617 INFO:teuthology.orchestra.run.smithi172.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-10-18T12:14:58.800 INFO:teuthology.orchestra.run.smithi114.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-10-18T12:14:58.804 INFO:teuthology.orchestra.run.smithi172.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-10-18T12:14:59.095 INFO:teuthology.orchestra.run.smithi114.stdout:Get:47 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-5610-g6f3e6b48-1focal [11.0 MB] 2023-10-18T12:14:59.134 INFO:teuthology.orchestra.run.smithi172.stdout:Get:47 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-5610-g6f3e6b48-1focal [11.0 MB] 2023-10-18T12:14:59.254 INFO:teuthology.orchestra.run.smithi114.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-10-18T12:14:59.256 INFO:teuthology.orchestra.run.smithi172.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-10-18T12:14:59.267 INFO:teuthology.orchestra.run.smithi114.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-10-18T12:14:59.269 INFO:teuthology.orchestra.run.smithi172.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-10-18T12:14:59.316 INFO:teuthology.orchestra.run.smithi172.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-10-18T12:14:59.316 INFO:teuthology.orchestra.run.smithi114.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-10-18T12:14:59.356 INFO:teuthology.orchestra.run.smithi114.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-10-18T12:14:59.358 INFO:teuthology.orchestra.run.smithi172.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-10-18T12:14:59.365 INFO:teuthology.orchestra.run.smithi114.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-10-18T12:14:59.367 INFO:teuthology.orchestra.run.smithi172.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-10-18T12:14:59.372 INFO:teuthology.orchestra.run.smithi114.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-18T12:14:59.373 INFO:teuthology.orchestra.run.smithi172.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-10-18T12:14:59.375 INFO:teuthology.orchestra.run.smithi114.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-10-18T12:14:59.377 INFO:teuthology.orchestra.run.smithi172.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-10-18T12:14:59.403 INFO:teuthology.orchestra.run.smithi114.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-10-18T12:14:59.404 INFO:teuthology.orchestra.run.smithi172.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-10-18T12:14:59.422 INFO:teuthology.orchestra.run.smithi114.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-10-18T12:14:59.424 INFO:teuthology.orchestra.run.smithi172.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-10-18T12:14:59.433 INFO:teuthology.orchestra.run.smithi114.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-10-18T12:14:59.435 INFO:teuthology.orchestra.run.smithi172.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-10-18T12:14:59.598 INFO:teuthology.orchestra.run.smithi114.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-10-18T12:14:59.600 INFO:teuthology.orchestra.run.smithi172.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-10-18T12:14:59.790 INFO:teuthology.orchestra.run.smithi114.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-10-18T12:14:59.795 INFO:teuthology.orchestra.run.smithi172.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-10-18T12:14:59.823 INFO:teuthology.orchestra.run.smithi114.stdout:Get:60 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-5610-g6f3e6b48-1focal [224 kB] 2023-10-18T12:14:59.825 INFO:teuthology.orchestra.run.smithi114.stdout:Get:61 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-5610-g6f3e6b48-1focal [135 kB] 2023-10-18T12:14:59.827 INFO:teuthology.orchestra.run.smithi114.stdout:Get:62 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-5610-g6f3e6b48-1focal [1,564 kB] 2023-10-18T12:14:59.862 INFO:teuthology.orchestra.run.smithi172.stdout:Get:60 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-5610-g6f3e6b48-1focal [224 kB] 2023-10-18T12:14:59.865 INFO:teuthology.orchestra.run.smithi172.stdout:Get:61 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-5610-g6f3e6b48-1focal [135 kB] 2023-10-18T12:14:59.869 INFO:teuthology.orchestra.run.smithi172.stdout:Get:62 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-5610-g6f3e6b48-1focal [1,564 kB] 2023-10-18T12:14:59.912 INFO:teuthology.orchestra.run.smithi114.stdout:Get:63 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-5610-g6f3e6b48-1focal [9,388 kB] 2023-10-18T12:14:59.961 INFO:teuthology.orchestra.run.smithi172.stdout:Get:63 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-5610-g6f3e6b48-1focal [9,388 kB] 2023-10-18T12:15:00.528 INFO:teuthology.orchestra.run.smithi114.stdout:Get:64 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-5610-g6f3e6b48-1focal [31.4 MB] 2023-10-18T12:15:00.621 INFO:teuthology.orchestra.run.smithi114.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-10-18T12:15:00.626 INFO:teuthology.orchestra.run.smithi172.stdout:Get:64 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-5610-g6f3e6b48-1focal [31.4 MB] 2023-10-18T12:15:00.645 INFO:teuthology.orchestra.run.smithi172.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-10-18T12:15:00.679 INFO:teuthology.orchestra.run.smithi114.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-10-18T12:15:00.695 INFO:teuthology.orchestra.run.smithi172.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-10-18T12:15:00.697 INFO:teuthology.orchestra.run.smithi172.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-10-18T12:15:00.697 INFO:teuthology.orchestra.run.smithi114.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-10-18T12:15:00.749 INFO:teuthology.orchestra.run.smithi114.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-10-18T12:15:00.750 INFO:teuthology.orchestra.run.smithi114.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-10-18T12:15:00.752 INFO:teuthology.orchestra.run.smithi114.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-10-18T12:15:00.753 INFO:teuthology.orchestra.run.smithi114.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-10-18T12:15:00.755 INFO:teuthology.orchestra.run.smithi114.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-10-18T12:15:00.755 INFO:teuthology.orchestra.run.smithi114.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-10-18T12:15:00.765 INFO:teuthology.orchestra.run.smithi172.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-10-18T12:15:00.766 INFO:teuthology.orchestra.run.smithi172.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-10-18T12:15:00.768 INFO:teuthology.orchestra.run.smithi172.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-10-18T12:15:00.769 INFO:teuthology.orchestra.run.smithi172.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-10-18T12:15:00.771 INFO:teuthology.orchestra.run.smithi172.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-10-18T12:15:00.772 INFO:teuthology.orchestra.run.smithi172.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-10-18T12:15:00.920 INFO:teuthology.orchestra.run.smithi114.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-10-18T12:15:00.937 INFO:teuthology.orchestra.run.smithi172.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-10-18T12:15:01.258 INFO:teuthology.orchestra.run.smithi114.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-10-18T12:15:01.271 INFO:teuthology.orchestra.run.smithi114.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-10-18T12:15:01.276 INFO:teuthology.orchestra.run.smithi172.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-10-18T12:15:01.290 INFO:teuthology.orchestra.run.smithi172.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-10-18T12:15:01.298 INFO:teuthology.orchestra.run.smithi114.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-10-18T12:15:01.317 INFO:teuthology.orchestra.run.smithi172.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-10-18T12:15:01.453 INFO:teuthology.orchestra.run.smithi114.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-10-18T12:15:01.474 INFO:teuthology.orchestra.run.smithi172.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-10-18T12:15:01.498 INFO:teuthology.orchestra.run.smithi114.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-10-18T12:15:01.517 INFO:teuthology.orchestra.run.smithi172.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-10-18T12:15:01.525 INFO:teuthology.orchestra.run.smithi114.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-10-18T12:15:01.534 INFO:teuthology.orchestra.run.smithi114.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-10-18T12:15:01.545 INFO:teuthology.orchestra.run.smithi172.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-10-18T12:15:01.554 INFO:teuthology.orchestra.run.smithi172.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-10-18T12:15:01.577 INFO:teuthology.orchestra.run.smithi114.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-10-18T12:15:01.597 INFO:teuthology.orchestra.run.smithi172.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-10-18T12:15:01.607 INFO:teuthology.orchestra.run.smithi114.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-10-18T12:15:01.609 INFO:teuthology.orchestra.run.smithi114.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-10-18T12:15:01.627 INFO:teuthology.orchestra.run.smithi172.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-10-18T12:15:01.629 INFO:teuthology.orchestra.run.smithi172.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-10-18T12:15:01.893 INFO:teuthology.orchestra.run.smithi114.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-10-18T12:15:01.913 INFO:teuthology.orchestra.run.smithi172.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-10-18T12:15:02.382 INFO:teuthology.orchestra.run.smithi114.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-10-18T12:15:02.401 INFO:teuthology.orchestra.run.smithi172.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-10-18T12:15:02.442 INFO:teuthology.orchestra.run.smithi114.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-10-18T12:15:02.461 INFO:teuthology.orchestra.run.smithi172.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-10-18T12:15:02.589 INFO:teuthology.orchestra.run.smithi114.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-5610-g6f3e6b48-1focal [3,808 B] 2023-10-18T12:15:02.590 INFO:teuthology.orchestra.run.smithi114.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-5610-g6f3e6b48-1focal [846 kB] 2023-10-18T12:15:02.634 INFO:teuthology.orchestra.run.smithi114.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-5610-g6f3e6b48-1focal [2,299 kB] 2023-10-18T12:15:02.686 INFO:teuthology.orchestra.run.smithi172.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-5610-g6f3e6b48-1focal [3,808 B] 2023-10-18T12:15:02.687 INFO:teuthology.orchestra.run.smithi172.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-5610-g6f3e6b48-1focal [846 kB] 2023-10-18T12:15:02.732 INFO:teuthology.orchestra.run.smithi172.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-5610-g6f3e6b48-1focal [2,299 kB] 2023-10-18T12:15:02.770 INFO:teuthology.orchestra.run.smithi114.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-5610-g6f3e6b48-1focal [227 kB] 2023-10-18T12:15:02.776 INFO:teuthology.orchestra.run.smithi114.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-5610-g6f3e6b48-1focal [126 kB] 2023-10-18T12:15:02.789 INFO:teuthology.orchestra.run.smithi114.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-10-18T12:15:02.791 INFO:teuthology.orchestra.run.smithi114.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-10-18T12:15:02.792 INFO:teuthology.orchestra.run.smithi114.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-10-18T12:15:02.793 INFO:teuthology.orchestra.run.smithi114.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-10-18T12:15:02.793 INFO:teuthology.orchestra.run.smithi114.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-10-18T12:15:02.795 INFO:teuthology.orchestra.run.smithi114.stdout:Get:98 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-10-18T12:15:02.796 INFO:teuthology.orchestra.run.smithi114.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-5610-g6f3e6b48-1focal [1,817 kB] 2023-10-18T12:15:02.809 INFO:teuthology.orchestra.run.smithi172.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-10-18T12:15:02.811 INFO:teuthology.orchestra.run.smithi172.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-10-18T12:15:02.812 INFO:teuthology.orchestra.run.smithi172.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-10-18T12:15:02.814 INFO:teuthology.orchestra.run.smithi172.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-10-18T12:15:02.814 INFO:teuthology.orchestra.run.smithi172.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-10-18T12:15:02.817 INFO:teuthology.orchestra.run.smithi172.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-10-18T12:15:02.835 INFO:teuthology.orchestra.run.smithi114.stdout:Get:100 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-10-18T12:15:02.835 INFO:teuthology.orchestra.run.smithi114.stdout:Get:101 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-18T12:15:02.856 INFO:teuthology.orchestra.run.smithi172.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-10-18T12:15:02.857 INFO:teuthology.orchestra.run.smithi172.stdout:Get:98 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-10-18T12:15:02.871 INFO:teuthology.orchestra.run.smithi172.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-5610-g6f3e6b48-1focal [227 kB] 2023-10-18T12:15:02.902 INFO:teuthology.orchestra.run.smithi114.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-5610-g6f3e6b48-1focal [7,890 kB] 2023-10-18T12:15:02.910 INFO:teuthology.orchestra.run.smithi172.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-5610-g6f3e6b48-1focal [126 kB] 2023-10-18T12:15:02.914 INFO:teuthology.orchestra.run.smithi172.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-5610-g6f3e6b48-1focal [1,817 kB] 2023-10-18T12:15:02.999 INFO:teuthology.orchestra.run.smithi114.stdout:Get:103 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-10-18T12:15:03.023 INFO:teuthology.orchestra.run.smithi172.stdout:Get:102 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-10-18T12:15:03.039 INFO:teuthology.orchestra.run.smithi172.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-5610-g6f3e6b48-1focal [7,890 kB] 2023-10-18T12:15:03.165 INFO:teuthology.orchestra.run.smithi114.stdout:Get:104 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-10-18T12:15:03.192 INFO:teuthology.orchestra.run.smithi172.stdout:Get:104 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-10-18T12:15:03.402 INFO:teuthology.orchestra.run.smithi114.stdout:Get:105 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-10-18T12:15:03.418 INFO:teuthology.orchestra.run.smithi114.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-5610-g6f3e6b48-1focal [3,932 B] 2023-10-18T12:15:03.418 INFO:teuthology.orchestra.run.smithi114.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-5610-g6f3e6b48-1focal [50.8 MB] 2023-10-18T12:15:03.425 INFO:teuthology.orchestra.run.smithi172.stdout:Get:105 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-10-18T12:15:03.455 INFO:teuthology.orchestra.run.smithi114.stdout:Get:108 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-10-18T12:15:03.467 INFO:teuthology.orchestra.run.smithi114.stdout:Get:109 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-10-18T12:15:03.477 INFO:teuthology.orchestra.run.smithi172.stdout:Get:106 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-10-18T12:15:03.490 INFO:teuthology.orchestra.run.smithi172.stdout:Get:107 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-10-18T12:15:03.533 INFO:teuthology.orchestra.run.smithi114.stdout:Get:110 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-10-18T12:15:03.548 INFO:teuthology.orchestra.run.smithi114.stdout:Get:111 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-10-18T12:15:03.555 INFO:teuthology.orchestra.run.smithi172.stdout:Get:108 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-10-18T12:15:03.561 INFO:teuthology.orchestra.run.smithi172.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-5610-g6f3e6b48-1focal [3,932 B] 2023-10-18T12:15:03.561 INFO:teuthology.orchestra.run.smithi172.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-5610-g6f3e6b48-1focal [50.8 MB] 2023-10-18T12:15:03.569 INFO:teuthology.orchestra.run.smithi172.stdout:Get:111 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-10-18T12:15:06.748 INFO:teuthology.orchestra.run.smithi114.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-5610-g6f3e6b48-1focal [222 kB] 2023-10-18T12:15:06.750 INFO:teuthology.orchestra.run.smithi114.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.0.0-5610-g6f3e6b48-1focal [258 kB] 2023-10-18T12:15:06.752 INFO:teuthology.orchestra.run.smithi114.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.0.0-5610-g6f3e6b48-1focal [23.3 kB] 2023-10-18T12:15:06.753 INFO:teuthology.orchestra.run.smithi114.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.0.0-5610-g6f3e6b48-1focal [12.9 kB] 2023-10-18T12:15:06.753 INFO:teuthology.orchestra.run.smithi114.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-5610-g6f3e6b48-1focal [28.1 kB] 2023-10-18T12:15:06.754 INFO:teuthology.orchestra.run.smithi114.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-5610-g6f3e6b48-1focal [13.8 MB] 2023-10-18T12:15:06.940 INFO:teuthology.orchestra.run.smithi172.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-5610-g6f3e6b48-1focal [222 kB] 2023-10-18T12:15:06.955 INFO:teuthology.orchestra.run.smithi172.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.0.0-5610-g6f3e6b48-1focal [258 kB] 2023-10-18T12:15:06.967 INFO:teuthology.orchestra.run.smithi172.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.0.0-5610-g6f3e6b48-1focal [23.3 kB] 2023-10-18T12:15:06.967 INFO:teuthology.orchestra.run.smithi172.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.0.0-5610-g6f3e6b48-1focal [12.9 kB] 2023-10-18T12:15:06.968 INFO:teuthology.orchestra.run.smithi172.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-5610-g6f3e6b48-1focal [28.1 kB] 2023-10-18T12:15:06.968 INFO:teuthology.orchestra.run.smithi172.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-5610-g6f3e6b48-1focal [13.8 MB] 2023-10-18T12:15:07.639 INFO:teuthology.orchestra.run.smithi114.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-5610-g6f3e6b48-1focal [96.3 kB] 2023-10-18T12:15:07.772 INFO:teuthology.orchestra.run.smithi172.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-5610-g6f3e6b48-1focal [96.3 kB] 2023-10-18T12:15:08.570 INFO:teuthology.orchestra.run.smithi114.stdout:Fetched 210 MB in 12s (18.2 MB/s) 2023-10-18T12:15:08.720 INFO:teuthology.orchestra.run.smithi172.stdout:Fetched 210 MB in 12s (17.9 MB/s) 2023-10-18T12:15:08.743 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-18T12:15:08.815 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107758 files and directories currently installed.) 2023-10-18T12:15:08.818 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-10-18T12:15:08.872 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-10-18T12:15:08.935 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pyperclip. 2023-10-18T12:15:09.010 INFO:teuthology.orchestra.run.smithi172.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107758 files and directories currently installed.) 2023-10-18T12:15:09.013 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-10-18T12:15:09.056 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-10-18T12:15:09.201 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-18T12:15:09.221 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-10-18T12:15:09.259 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-18T12:15:09.621 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-cmd2. 2023-10-18T12:15:09.626 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-wcwidth. 2023-10-18T12:15:09.641 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-10-18T12:15:09.644 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-10-18T12:15:09.678 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-10-18T12:15:09.684 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-18T12:15:10.037 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-cmd2. 2023-10-18T12:15:10.054 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-10-18T12:15:10.095 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-10-18T12:15:10.248 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-10-18T12:15:10.269 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-10-18T12:15:10.357 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-18T12:15:10.457 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-10-18T12:15:10.476 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-10-18T12:15:10.557 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-18T12:15:10.777 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-18T12:15:10.795 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-10-18T12:15:10.835 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-18T12:15:10.952 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-10-18T12:15:10.970 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-10-18T12:15:11.010 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-18T12:15:11.214 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-18T12:15:11.235 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-10-18T12:15:11.280 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-18T12:15:11.405 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-10-18T12:15:11.422 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-10-18T12:15:11.463 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-18T12:15:11.800 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-18T12:15:11.820 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-18T12:15:11.883 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-18T12:15:11.992 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-10-18T12:15:12.013 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-18T12:15:12.079 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-18T12:15:12.455 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-18T12:15:12.471 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-18T12:15:12.512 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-18T12:15:12.628 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-10-18T12:15:12.648 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-18T12:15:12.686 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-18T12:15:12.916 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-18T12:15:12.935 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-18T12:15:12.974 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-18T12:15:13.106 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-10-18T12:15:13.128 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-10-18T12:15:13.172 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-18T12:15:13.419 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-10-18T12:15:13.436 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-10-18T12:15:13.486 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-18T12:15:13.593 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-10-18T12:15:13.611 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-10-18T12:15:13.651 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-18T12:15:13.892 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../010-librbd1_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:15:14.014 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking librbd1 (18.0.0-5610-g6f3e6b48-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-18T12:15:14.085 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../010-librbd1_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:15:14.213 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking librbd1 (18.0.0-5610-g6f3e6b48-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-18T12:15:14.776 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../011-librados2_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:15:14.943 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking librados2 (18.0.0-5610-g6f3e6b48-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-18T12:15:14.971 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../011-librados2_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:15:15.092 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking librados2 (18.0.0-5610-g6f3e6b48-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-10-18T12:15:15.739 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libcephfs2. 2023-10-18T12:15:15.758 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:15:15.797 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libcephfs2 (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:15.863 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libcephfs2. 2023-10-18T12:15:15.881 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:15:15.929 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libcephfs2 (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:16.191 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-rados. 2023-10-18T12:15:16.211 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../013-python3-rados_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:15:16.249 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-rados (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:16.315 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-rados. 2023-10-18T12:15:16.336 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../013-python3-rados_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:15:16.373 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-rados (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:16.678 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-18T12:15:16.698 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-5610-g6f3e6b48-1focal_all.deb ... 2023-10-18T12:15:16.736 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-ceph-argparse (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:16.759 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-10-18T12:15:16.780 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-5610-g6f3e6b48-1focal_all.deb ... 2023-10-18T12:15:16.817 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-ceph-argparse (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:17.005 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-cephfs. 2023-10-18T12:15:17.023 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:15:17.097 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-cephfs (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:17.137 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-cephfs. 2023-10-18T12:15:17.155 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:15:17.203 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-cephfs (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:17.458 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-18T12:15:17.475 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-5610-g6f3e6b48-1focal_all.deb ... 2023-10-18T12:15:17.516 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-ceph-common (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:17.573 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-ceph-common. 2023-10-18T12:15:17.593 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-5610-g6f3e6b48-1focal_all.deb ... 2023-10-18T12:15:17.656 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-ceph-common (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:17.919 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-prettytable. 2023-10-18T12:15:17.940 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2023-10-18T12:15:17.977 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-10-18T12:15:18.026 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-prettytable. 2023-10-18T12:15:18.045 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2023-10-18T12:15:18.109 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-10-18T12:15:18.280 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-rbd. 2023-10-18T12:15:18.298 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:15:18.338 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-rbd (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:18.387 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-rbd. 2023-10-18T12:15:18.409 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:15:18.453 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-rbd (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:18.732 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-10-18T12:15:18.751 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-10-18T12:15:18.782 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-18T12:15:18.848 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-10-18T12:15:18.869 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-10-18T12:15:18.914 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-18T12:15:19.177 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-10-18T12:15:19.197 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2023-10-18T12:15:19.260 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-10-18T12:15:19.342 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-10-18T12:15:19.361 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2023-10-18T12:15:19.400 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-10-18T12:15:19.580 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-18T12:15:19.602 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-10-18T12:15:19.638 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-18T12:15:20.015 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package librgw2. 2023-10-18T12:15:20.020 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-10-18T12:15:20.029 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../022-librgw2_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:15:20.041 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-10-18T12:15:20.074 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking librgw2 (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:20.086 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-18T12:15:20.498 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package librgw2. 2023-10-18T12:15:20.518 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../022-librgw2_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:15:20.556 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking librgw2 (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:21.043 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-rgw. 2023-10-18T12:15:21.063 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../023-python3-rgw_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:15:21.101 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-rgw (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:21.508 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-rgw. 2023-10-18T12:15:21.513 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package liboath0. 2023-10-18T12:15:21.529 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../023-python3-rgw_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:15:21.533 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-10-18T12:15:21.566 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-rgw (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:21.570 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-10-18T12:15:21.899 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libradosstriper1. 2023-10-18T12:15:21.916 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../025-libradosstriper1_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:15:21.986 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package liboath0. 2023-10-18T12:15:21.990 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libradosstriper1 (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:22.003 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-10-18T12:15:22.044 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-10-18T12:15:22.422 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libradosstriper1. 2023-10-18T12:15:22.442 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../025-libradosstriper1_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:15:22.460 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-common. 2023-10-18T12:15:22.471 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libradosstriper1 (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:22.478 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../026-ceph-common_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:15:22.543 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-common (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:22.992 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-common. 2023-10-18T12:15:23.009 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../026-ceph-common_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:15:23.049 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-common (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:25.099 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-base. 2023-10-18T12:15:25.120 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../027-ceph-base_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:15:25.178 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-base (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:25.697 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-base. 2023-10-18T12:15:25.717 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../027-ceph-base_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:15:25.780 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-base (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:26.853 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-18T12:15:26.871 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-10-18T12:15:26.911 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-10-18T12:15:27.217 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-cherrypy3. 2023-10-18T12:15:27.230 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-10-18T12:15:27.265 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-natsort. 2023-10-18T12:15:27.275 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-10-18T12:15:27.285 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2023-10-18T12:15:27.323 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-10-18T12:15:27.662 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-natsort. 2023-10-18T12:15:27.668 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-logutils. 2023-10-18T12:15:27.681 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2023-10-18T12:15:27.690 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-10-18T12:15:27.720 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-10-18T12:15:27.734 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-10-18T12:15:28.090 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-logutils. 2023-10-18T12:15:28.096 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-18T12:15:28.111 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-10-18T12:15:28.115 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-10-18T12:15:28.148 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-10-18T12:15:28.153 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-10-18T12:15:28.499 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-mako. 2023-10-18T12:15:28.509 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-markupsafe. 2023-10-18T12:15:28.519 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-10-18T12:15:28.526 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-10-18T12:15:28.556 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-18T12:15:28.567 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-10-18T12:15:28.930 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-mako. 2023-10-18T12:15:28.936 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-18T12:15:28.951 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-10-18T12:15:28.953 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-18T12:15:28.987 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-18T12:15:28.993 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-18T12:15:29.338 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-18T12:15:29.359 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-10-18T12:15:29.365 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-simplegeneric. 2023-10-18T12:15:29.382 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-10-18T12:15:29.396 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-10-18T12:15:29.423 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-10-18T12:15:29.708 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-webob. 2023-10-18T12:15:29.724 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-10-18T12:15:29.765 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-10-18T12:15:29.785 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-singledispatch. 2023-10-18T12:15:29.802 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-10-18T12:15:29.900 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-10-18T12:15:30.127 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-soupsieve. 2023-10-18T12:15:30.146 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-10-18T12:15:30.176 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-18T12:15:30.563 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-bs4. 2023-10-18T12:15:30.583 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-10-18T12:15:30.620 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-10-18T12:15:30.812 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-webob. 2023-10-18T12:15:30.830 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-10-18T12:15:30.869 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-10-18T12:15:31.024 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-waitress. 2023-10-18T12:15:31.043 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-10-18T12:15:31.089 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-18T12:15:31.239 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-soupsieve. 2023-10-18T12:15:31.257 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-10-18T12:15:31.297 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-18T12:15:31.427 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-tempita. 2023-10-18T12:15:31.444 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-10-18T12:15:31.485 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-10-18T12:15:31.642 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-bs4. 2023-10-18T12:15:31.664 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-10-18T12:15:31.708 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-10-18T12:15:31.838 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-paste. 2023-10-18T12:15:31.858 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-10-18T12:15:31.912 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-10-18T12:15:32.121 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-waitress. 2023-10-18T12:15:32.141 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-10-18T12:15:32.193 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-18T12:15:32.249 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-18T12:15:32.271 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-10-18T12:15:32.315 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-10-18T12:15:32.581 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-tempita. 2023-10-18T12:15:32.598 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-10-18T12:15:32.639 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-10-18T12:15:32.668 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-18T12:15:32.688 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-10-18T12:15:32.726 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-10-18T12:15:32.975 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-paste. 2023-10-18T12:15:32.994 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-10-18T12:15:33.033 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-10-18T12:15:33.080 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-webtest. 2023-10-18T12:15:33.100 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-10-18T12:15:33.138 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-10-18T12:15:33.396 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-10-18T12:15:33.413 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-10-18T12:15:33.453 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-10-18T12:15:33.533 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pecan. 2023-10-18T12:15:33.550 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-10-18T12:15:33.582 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-10-18T12:15:33.781 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pastedeploy. 2023-10-18T12:15:33.798 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-10-18T12:15:33.864 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-10-18T12:15:33.987 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-18T12:15:34.005 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-10-18T12:15:34.078 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-18T12:15:34.183 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-webtest. 2023-10-18T12:15:34.201 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-10-18T12:15:34.241 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-10-18T12:15:34.373 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-18T12:15:34.386 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.0.0-5610-g6f3e6b48-1focal_all.deb ... 2023-10-18T12:15:34.431 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mgr-modules-core (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:34.628 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pecan. 2023-10-18T12:15:34.645 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-10-18T12:15:34.686 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-10-18T12:15:34.912 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-18T12:15:34.931 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:15:34.969 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:35.116 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-werkzeug. 2023-10-18T12:15:35.133 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-10-18T12:15:35.173 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-18T12:15:35.331 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-cryptography. 2023-10-18T12:15:35.354 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../048-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-10-18T12:15:35.397 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-18T12:15:35.535 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-10-18T12:15:35.553 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.0.0-5610-g6f3e6b48-1focal_all.deb ... 2023-10-18T12:15:35.594 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mgr-modules-core (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:35.835 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-openssl. 2023-10-18T12:15:35.855 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../049-python3-openssl_19.0.0-1build1_all.deb ... 2023-10-18T12:15:35.892 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-10-18T12:15:36.064 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-10-18T12:15:36.085 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:15:36.131 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:36.288 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mgr. 2023-10-18T12:15:36.307 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../050-ceph-mgr_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:15:36.362 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mgr (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:36.500 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-cryptography. 2023-10-18T12:15:36.521 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../048-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-10-18T12:15:36.566 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-18T12:15:36.891 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mon. 2023-10-18T12:15:36.911 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../051-ceph-mon_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:15:36.948 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mon (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:36.978 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-openssl. 2023-10-18T12:15:36.997 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../049-python3-openssl_19.0.0-1build1_all.deb ... 2023-10-18T12:15:37.036 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-10-18T12:15:37.440 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mgr. 2023-10-18T12:15:37.460 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../050-ceph-mgr_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:15:37.497 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mgr (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:38.034 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mon. 2023-10-18T12:15:38.053 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../051-ceph-mon_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:15:38.092 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mon (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:38.244 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-osd. 2023-10-18T12:15:38.264 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../052-ceph-osd_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:15:38.301 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-osd (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:39.395 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-osd. 2023-10-18T12:15:39.417 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../052-ceph-osd_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:15:39.461 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-osd (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:41.356 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph. 2023-10-18T12:15:41.377 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../053-ceph_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:15:41.421 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:41.758 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-fuse. 2023-10-18T12:15:41.776 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../054-ceph-fuse_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:15:41.815 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-fuse (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:42.215 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph. 2023-10-18T12:15:42.235 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../053-ceph_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:15:42.252 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mds. 2023-10-18T12:15:42.273 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:42.274 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../055-ceph-mds_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:15:42.318 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mds (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:42.660 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-fuse. 2023-10-18T12:15:42.677 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../054-ceph-fuse_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:15:42.717 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-fuse (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:42.855 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package cephadm. 2023-10-18T12:15:42.876 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../056-cephadm_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:15:42.913 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking cephadm (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:43.212 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mds. 2023-10-18T12:15:43.230 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../055-ceph-mds_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:15:43.269 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mds (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:43.274 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-asyncssh. 2023-10-18T12:15:43.294 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../057-python3-asyncssh_1.12.2-1_all.deb ... 2023-10-18T12:15:43.332 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-10-18T12:15:43.745 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-jinja2. 2023-10-18T12:15:43.761 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../058-python3-jinja2_2.10.1-2_all.deb ... 2023-10-18T12:15:43.801 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-10-18T12:15:43.840 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package cephadm. 2023-10-18T12:15:43.861 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../056-cephadm_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:15:43.905 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking cephadm (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:44.179 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-18T12:15:44.193 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../059-ceph-mgr-cephadm_18.0.0-5610-g6f3e6b48-1focal_all.deb ... 2023-10-18T12:15:44.229 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mgr-cephadm (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:44.267 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-asyncssh. 2023-10-18T12:15:44.288 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../057-python3-asyncssh_1.12.2-1_all.deb ... 2023-10-18T12:15:44.333 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-10-18T12:15:44.592 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-18T12:15:44.612 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../060-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-10-18T12:15:44.691 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-18T12:15:44.753 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-jinja2. 2023-10-18T12:15:44.773 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../058-python3-jinja2_2.10.1-2_all.deb ... 2023-10-18T12:15:44.810 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-10-18T12:15:44.994 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-jwt. 2023-10-18T12:15:45.013 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-10-18T12:15:45.043 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-18T12:15:45.214 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-10-18T12:15:45.237 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../059-ceph-mgr-cephadm_18.0.0-5610-g6f3e6b48-1focal_all.deb ... 2023-10-18T12:15:45.280 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mgr-cephadm (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:45.430 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-18T12:15:45.450 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../062-python3-repoze.lru_0.7-2_all.deb ... 2023-10-18T12:15:45.488 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-18T12:15:45.700 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-bcrypt. 2023-10-18T12:15:45.721 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../060-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-10-18T12:15:45.766 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-18T12:15:45.991 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libjs-underscore. 2023-10-18T12:15:46.012 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../063-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-10-18T12:15:46.057 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-18T12:15:46.136 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-jwt. 2023-10-18T12:15:46.157 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-10-18T12:15:46.202 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-18T12:15:46.393 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-10-18T12:15:46.411 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../064-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-10-18T12:15:46.451 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-18T12:15:46.589 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-repoze.lru. 2023-10-18T12:15:46.606 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../062-python3-repoze.lru_0.7-2_all.deb ... 2023-10-18T12:15:46.646 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-10-18T12:15:46.788 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-routes. 2023-10-18T12:15:46.807 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../065-python3-routes_2.4.1-2_all.deb ... 2023-10-18T12:15:46.870 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-10-18T12:15:46.933 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libjs-underscore. 2023-10-18T12:15:46.953 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../063-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-10-18T12:15:46.990 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-18T12:15:47.249 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-18T12:15:47.269 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../066-ceph-mgr-dashboard_18.0.0-5610-g6f3e6b48-1focal_all.deb ... 2023-10-18T12:15:47.293 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-10-18T12:15:47.313 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../064-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-10-18T12:15:47.315 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mgr-dashboard (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:47.376 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-18T12:15:47.712 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-routes. 2023-10-18T12:15:47.731 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../065-python3-routes_2.4.1-2_all.deb ... 2023-10-18T12:15:47.770 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-10-18T12:15:47.869 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-decorator. 2023-10-18T12:15:47.889 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../067-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-10-18T12:15:47.928 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-10-18T12:15:48.165 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-10-18T12:15:48.184 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../066-ceph-mgr-dashboard_18.0.0-5610-g6f3e6b48-1focal_all.deb ... 2023-10-18T12:15:48.222 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mgr-dashboard (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:48.288 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-10-18T12:15:48.306 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../068-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-10-18T12:15:48.346 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-18T12:15:48.699 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-scipy. 2023-10-18T12:15:48.719 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../069-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-10-18T12:15:48.758 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-10-18T12:15:48.768 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-decorator. 2023-10-18T12:15:48.786 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../067-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-10-18T12:15:48.851 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-10-18T12:15:49.187 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-10-18T12:15:49.206 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../068-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-10-18T12:15:49.245 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-18T12:15:49.606 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-scipy. 2023-10-18T12:15:49.629 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../069-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-10-18T12:15:49.672 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-10-18T12:15:50.199 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-10-18T12:15:50.220 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-10-18T12:15:50.257 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-18T12:15:50.869 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-joblib. 2023-10-18T12:15:50.888 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../071-python3-joblib_0.14.0-3_all.deb ... 2023-10-18T12:15:50.927 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-10-18T12:15:51.381 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-sklearn. 2023-10-18T12:15:51.382 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-10-18T12:15:51.402 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../072-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-10-18T12:15:51.403 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-10-18T12:15:51.438 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-18T12:15:51.447 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-18T12:15:52.067 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-joblib. 2023-10-18T12:15:52.087 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../071-python3-joblib_0.14.0-3_all.deb ... 2023-10-18T12:15:52.125 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-10-18T12:15:52.236 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-18T12:15:52.257 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../073-ceph-mgr-diskprediction-local_18.0.0-5610-g6f3e6b48-1focal_all.deb ... 2023-10-18T12:15:52.294 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:52.537 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-sklearn. 2023-10-18T12:15:52.557 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../072-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-10-18T12:15:52.597 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-18T12:15:53.313 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-10-18T12:15:53.330 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../073-ceph-mgr-diskprediction-local_18.0.0-5610-g6f3e6b48-1focal_all.deb ... 2023-10-18T12:15:53.362 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:53.539 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-cachetools. 2023-10-18T12:15:53.561 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../074-python3-cachetools_4.0.0-1_all.deb ... 2023-10-18T12:15:53.605 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-10-18T12:15:53.917 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-18T12:15:53.940 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../075-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-10-18T12:15:53.983 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-10-18T12:15:54.361 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-18T12:15:54.382 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../076-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-10-18T12:15:54.427 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-18T12:15:54.620 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-cachetools. 2023-10-18T12:15:54.641 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../074-python3-cachetools_4.0.0-1_all.deb ... 2023-10-18T12:15:54.678 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-10-18T12:15:54.816 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-rsa. 2023-10-18T12:15:54.842 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../077-python3-rsa_4.0-3_all.deb ... 2023-10-18T12:15:54.882 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-rsa (4.0-3) ... 2023-10-18T12:15:55.065 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pyasn1. 2023-10-18T12:15:55.083 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../075-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-10-18T12:15:55.123 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-10-18T12:15:55.278 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-google-auth. 2023-10-18T12:15:55.296 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../078-python3-google-auth_1.5.1-2_all.deb ... 2023-10-18T12:15:55.336 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-10-18T12:15:55.518 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-10-18T12:15:55.541 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../076-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-10-18T12:15:55.584 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-18T12:15:55.710 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-blinker. 2023-10-18T12:15:55.728 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../079-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-10-18T12:15:55.771 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-18T12:15:55.987 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-rsa. 2023-10-18T12:15:56.008 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../077-python3-rsa_4.0-3_all.deb ... 2023-10-18T12:15:56.053 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-rsa (4.0-3) ... 2023-10-18T12:15:56.112 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-oauthlib. 2023-10-18T12:15:56.129 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../080-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-10-18T12:15:56.170 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-18T12:15:56.398 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-google-auth. 2023-10-18T12:15:56.420 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../078-python3-google-auth_1.5.1-2_all.deb ... 2023-10-18T12:15:56.464 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-10-18T12:15:56.683 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-18T12:15:56.704 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../081-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-10-18T12:15:56.741 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-18T12:15:56.868 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-blinker. 2023-10-18T12:15:56.886 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../079-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-10-18T12:15:56.925 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-18T12:15:57.103 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-websocket. 2023-10-18T12:15:57.123 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../082-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-10-18T12:15:57.160 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-10-18T12:15:57.287 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-oauthlib. 2023-10-18T12:15:57.309 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../080-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-10-18T12:15:57.353 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-18T12:15:57.540 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-18T12:15:57.560 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../083-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-10-18T12:15:57.605 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-10-18T12:15:57.861 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-10-18T12:15:57.882 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../081-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-10-18T12:15:57.919 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-18T12:15:58.220 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-18T12:15:58.293 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../084-ceph-mgr-k8sevents_18.0.0-5610-g6f3e6b48-1focal_all.deb ... 2023-10-18T12:15:58.293 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:58.316 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-websocket. 2023-10-18T12:15:58.337 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../082-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-10-18T12:15:58.374 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-10-18T12:15:58.664 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-18T12:15:58.685 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../085-libonig5_6.9.4-1_amd64.deb ... 2023-10-18T12:15:58.730 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-10-18T12:15:58.745 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-kubernetes. 2023-10-18T12:15:58.762 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../083-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-10-18T12:15:58.809 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-10-18T12:15:59.151 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-18T12:15:59.172 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../086-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-18T12:15:59.217 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-18T12:15:59.406 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-10-18T12:15:59.429 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../084-ceph-mgr-k8sevents_18.0.0-5610-g6f3e6b48-1focal_all.deb ... 2023-10-18T12:15:59.472 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:15:59.520 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package jq. 2023-10-18T12:15:59.538 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../087-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-18T12:15:59.611 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-10-18T12:15:59.876 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libonig5:amd64. 2023-10-18T12:15:59.896 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../085-libonig5_6.9.4-1_amd64.deb ... 2023-10-18T12:15:59.897 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package socat. 2023-10-18T12:15:59.919 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../088-socat_1.7.3.3-2_amd64.deb ... 2023-10-18T12:15:59.942 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-10-18T12:15:59.963 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking socat (1.7.3.3-2) ... 2023-10-18T12:16:00.337 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libjq1:amd64. 2023-10-18T12:16:00.351 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package xmlstarlet. 2023-10-18T12:16:00.358 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../086-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-18T12:16:00.372 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../089-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-10-18T12:16:00.403 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-18T12:16:00.417 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-10-18T12:16:00.740 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package jq. 2023-10-18T12:16:00.760 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../087-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-10-18T12:16:00.797 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-10-18T12:16:00.830 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-test. 2023-10-18T12:16:00.853 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../090-ceph-test_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:16:00.896 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-test (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:01.117 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package socat. 2023-10-18T12:16:01.135 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../088-socat_1.7.3.3-2_amd64.deb ... 2023-10-18T12:16:01.175 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking socat (1.7.3.3-2) ... 2023-10-18T12:16:01.529 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package xmlstarlet. 2023-10-18T12:16:01.551 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../089-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-10-18T12:16:01.620 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-10-18T12:16:02.024 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-test. 2023-10-18T12:16:02.046 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../090-ceph-test_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:16:02.090 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-test (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:05.209 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-volume. 2023-10-18T12:16:05.231 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../091-ceph-volume_18.0.0-5610-g6f3e6b48-1focal_all.deb ... 2023-10-18T12:16:05.276 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-volume (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:05.747 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-18T12:16:05.767 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../092-cephfs-mirror_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:16:05.804 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking cephfs-mirror (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:06.208 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-colorama. 2023-10-18T12:16:06.231 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../093-python3-colorama_0.4.3-1build1_all.deb ... 2023-10-18T12:16:06.274 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-10-18T12:16:06.344 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ceph-volume. 2023-10-18T12:16:06.366 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../091-ceph-volume_18.0.0-5610-g6f3e6b48-1focal_all.deb ... 2023-10-18T12:16:06.410 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ceph-volume (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:06.562 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package cephfs-shell. 2023-10-18T12:16:06.587 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../094-cephfs-shell_18.0.0-5610-g6f3e6b48-1focal_all.deb ... 2023-10-18T12:16:06.627 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking cephfs-shell (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:06.874 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package cephfs-mirror. 2023-10-18T12:16:06.894 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../092-cephfs-mirror_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:16:06.931 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking cephfs-mirror (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:06.980 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package cephfs-top. 2023-10-18T12:16:07.003 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../095-cephfs-top_18.0.0-5610-g6f3e6b48-1focal_all.deb ... 2023-10-18T12:16:07.046 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking cephfs-top (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:07.318 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-colorama. 2023-10-18T12:16:07.341 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../093-python3-colorama_0.4.3-1build1_all.deb ... 2023-10-18T12:16:07.358 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package fonts-mathjax. 2023-10-18T12:16:07.378 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-18T12:16:07.384 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-10-18T12:16:07.415 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-18T12:16:07.729 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package cephfs-shell. 2023-10-18T12:16:07.749 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../094-cephfs-shell_18.0.0-5610-g6f3e6b48-1focal_all.deb ... 2023-10-18T12:16:07.786 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking cephfs-shell (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:07.928 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-18T12:16:07.948 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../097-libcephfs-dev_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:16:07.986 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libcephfs-dev (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:08.106 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package cephfs-top. 2023-10-18T12:16:08.132 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../095-cephfs-top_18.0.0-5610-g6f3e6b48-1focal_all.deb ... 2023-10-18T12:16:08.172 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking cephfs-top (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:08.422 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package nvme-cli. 2023-10-18T12:16:08.444 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-10-18T12:16:08.484 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package fonts-mathjax. 2023-10-18T12:16:08.505 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-18T12:16:08.521 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-10-18T12:16:08.550 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-18T12:16:08.899 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-10-18T12:16:08.923 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-10-18T12:16:08.968 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-10-18T12:16:09.105 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libcephfs-dev. 2023-10-18T12:16:09.127 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../097-libcephfs-dev_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:16:09.170 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libcephfs-dev (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:09.380 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libjs-mathjax. 2023-10-18T12:16:09.397 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-18T12:16:09.462 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-18T12:16:09.608 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package nvme-cli. 2023-10-18T12:16:09.629 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-10-18T12:16:09.714 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-10-18T12:16:10.095 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-10-18T12:16:10.118 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-10-18T12:16:10.161 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-10-18T12:16:10.615 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libjs-mathjax. 2023-10-18T12:16:10.636 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-10-18T12:16:10.680 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-18T12:16:11.482 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python-natsort-doc. 2023-10-18T12:16:11.502 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2023-10-18T12:16:11.540 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-10-18T12:16:12.318 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-atomicwrites. 2023-10-18T12:16:12.340 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../102-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-10-18T12:16:12.386 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-10-18T12:16:12.670 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python-natsort-doc. 2023-10-18T12:16:12.686 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2023-10-18T12:16:12.719 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-10-18T12:16:12.748 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-attr. 2023-10-18T12:16:12.766 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../103-python3-attr_19.3.0-2_all.deb ... 2023-10-18T12:16:12.805 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-10-18T12:16:13.125 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-atomicwrites. 2023-10-18T12:16:13.146 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../102-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-10-18T12:16:13.191 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-10-18T12:16:13.200 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-webencodings. 2023-10-18T12:16:13.224 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../104-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-10-18T12:16:13.266 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-18T12:16:13.562 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-attr. 2023-10-18T12:16:13.580 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../103-python3-attr_19.3.0-2_all.deb ... 2023-10-18T12:16:13.619 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-10-18T12:16:13.635 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-html5lib. 2023-10-18T12:16:13.657 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../105-python3-html5lib_1.0.1-2_all.deb ... 2023-10-18T12:16:13.703 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-10-18T12:16:13.990 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-webencodings. 2023-10-18T12:16:14.010 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../104-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-10-18T12:16:14.057 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-18T12:16:14.058 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-10-18T12:16:14.077 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../106-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-10-18T12:16:14.113 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-18T12:16:14.416 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-html5lib. 2023-10-18T12:16:14.437 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../105-python3-html5lib_1.0.1-2_all.deb ... 2023-10-18T12:16:14.484 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-10-18T12:16:14.600 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-packaging. 2023-10-18T12:16:14.624 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../107-python3-packaging_20.3-1_all.deb ... 2023-10-18T12:16:14.666 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-packaging (20.3-1) ... 2023-10-18T12:16:14.882 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-10-18T12:16:14.901 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../106-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-10-18T12:16:14.945 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-18T12:16:15.037 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pastescript. 2023-10-18T12:16:15.058 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../108-python3-pastescript_2.0.2-4_all.deb ... 2023-10-18T12:16:15.102 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-18T12:16:15.491 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-packaging. 2023-10-18T12:16:15.506 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pluggy. 2023-10-18T12:16:15.514 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../107-python3-packaging_20.3-1_all.deb ... 2023-10-18T12:16:15.527 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../109-python3-pluggy_0.13.0-2_all.deb ... 2023-10-18T12:16:15.556 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-packaging (20.3-1) ... 2023-10-18T12:16:15.572 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-10-18T12:16:15.934 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-psutil. 2023-10-18T12:16:15.935 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pastescript. 2023-10-18T12:16:15.948 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../110-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-10-18T12:16:15.956 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../108-python3-pastescript_2.0.2-4_all.deb ... 2023-10-18T12:16:15.992 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-10-18T12:16:16.001 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-10-18T12:16:16.370 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-py. 2023-10-18T12:16:16.389 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../111-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-10-18T12:16:16.413 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pluggy. 2023-10-18T12:16:16.427 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../109-python3-pluggy_0.13.0-2_all.deb ... 2023-10-18T12:16:16.445 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-10-18T12:16:16.587 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-10-18T12:16:16.825 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-18T12:16:16.844 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-10-18T12:16:16.883 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-18T12:16:16.949 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-psutil. 2023-10-18T12:16:16.970 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../110-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-10-18T12:16:17.015 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-10-18T12:16:17.279 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pytest. 2023-10-18T12:16:17.298 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../113-python3-pytest_4.6.9-1_all.deb ... 2023-10-18T12:16:17.337 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-10-18T12:16:17.420 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-py. 2023-10-18T12:16:17.442 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../111-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-10-18T12:16:17.486 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-10-18T12:16:17.749 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-simplejson. 2023-10-18T12:16:17.769 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-10-18T12:16:17.806 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-18T12:16:17.881 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pyinotify. 2023-10-18T12:16:17.900 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-10-18T12:16:17.939 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-18T12:16:18.154 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-18T12:16:18.176 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-10-18T12:16:18.222 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-18T12:16:18.309 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-pytest. 2023-10-18T12:16:18.330 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../113-python3-pytest_4.6.9-1_all.deb ... 2023-10-18T12:16:18.375 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-10-18T12:16:18.754 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package python3-simplejson. 2023-10-18T12:16:18.778 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-10-18T12:16:18.820 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-18T12:16:18.950 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package radosgw. 2023-10-18T12:16:18.964 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../116-radosgw_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:16:19.007 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking radosgw (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:19.124 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-10-18T12:16:19.143 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-10-18T12:16:19.182 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-18T12:16:19.930 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package radosgw. 2023-10-18T12:16:19.951 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../116-radosgw_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:16:20.029 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking radosgw (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:20.453 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package rbd-fuse. 2023-10-18T12:16:20.476 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../117-rbd-fuse_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:16:20.518 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking rbd-fuse (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:20.915 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-attr (19.3.0-2) ... 2023-10-18T12:16:21.285 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-10-18T12:16:21.452 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-18T12:16:21.474 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package rbd-fuse. 2023-10-18T12:16:21.498 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../117-rbd-fuse_18.0.0-5610-g6f3e6b48-1focal_amd64.deb ... 2023-10-18T12:16:21.540 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking rbd-fuse (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:21.578 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-10-18T12:16:21.804 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up cephadm (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:22.161 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-attr (19.3.0-2) ... 2023-10-18T12:16:22.523 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-10-18T12:16:22.579 INFO:teuthology.orchestra.run.smithi114.stdout:Adding system user cephadm....done 2023-10-18T12:16:22.649 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-10-18T12:16:22.769 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-18T12:16:22.775 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-10-18T12:16:22.894 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-18T12:16:23.026 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up cephadm (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:23.354 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-18T12:16:23.714 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-18T12:16:23.796 INFO:teuthology.orchestra.run.smithi172.stdout:Adding system user cephadm....done 2023-10-18T12:16:23.840 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-10-18T12:16:23.966 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-10-18T12:16:24.010 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-10-18T12:16:24.144 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-10-18T12:16:24.367 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-10-18T12:16:24.563 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-10-18T12:16:24.854 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-18T12:16:24.980 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-10-18T12:16:25.106 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-10-18T12:16:25.213 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-10-18T12:16:25.232 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-10-18T12:16:25.573 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-10-18T12:16:25.684 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-10-18T12:16:25.940 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-18T12:16:26.220 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-10-18T12:16:26.308 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-18T12:16:26.596 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-10-18T12:16:26.668 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-ceph-argparse (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:26.947 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-10-18T12:16:27.019 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-18T12:16:27.145 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-10-18T12:16:27.306 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-10-18T12:16:27.496 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-10-18T12:16:27.649 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-10-18T12:16:27.864 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-18T12:16:28.025 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-ceph-argparse (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:28.248 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-18T12:16:28.374 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-10-18T12:16:28.392 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-10-18T12:16:28.519 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-10-18T12:16:28.858 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-10-18T12:16:28.878 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-10-18T12:16:29.218 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-10-18T12:16:29.237 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-10-18T12:16:29.577 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-18T12:16:29.627 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-10-18T12:16:29.756 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-10-18T12:16:29.995 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-10-18T12:16:30.224 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-10-18T12:16:30.363 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-10-18T12:16:30.600 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-10-18T12:16:30.797 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-10-18T12:16:30.934 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-10-18T12:16:31.166 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-packaging (20.3-1) ... 2023-10-18T12:16:31.402 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-10-18T12:16:31.541 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-10-18T12:16:31.667 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-18T12:16:31.753 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-10-18T12:16:31.818 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-18T12:16:32.177 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-10-18T12:16:32.188 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-10-18T12:16:32.556 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-packaging (20.3-1) ... 2023-10-18T12:16:32.695 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-10-18T12:16:32.923 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-10-18T12:16:33.066 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-10-18T12:16:33.088 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-18T12:16:33.192 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-10-18T12:16:33.531 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-18T12:16:33.551 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-10-18T12:16:33.983 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up socat (1.7.3.3-2) ... 2023-10-18T12:16:34.028 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-10-18T12:16:34.109 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-ceph-common (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:34.429 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-10-18T12:16:34.511 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-18T12:16:34.661 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-10-18T12:16:34.907 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-10-18T12:16:35.089 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-18T12:16:35.214 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-10-18T12:16:35.340 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-10-18T12:16:35.401 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up socat (1.7.3.3-2) ... 2023-10-18T12:16:35.526 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-ceph-common (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:35.691 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-18T12:16:35.926 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-18T12:16:36.086 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-10-18T12:16:36.109 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-18T12:16:36.234 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-18T12:16:36.360 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-10-18T12:16:36.512 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-10-18T12:16:36.638 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-10-18T12:16:36.764 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-10-18T12:16:36.770 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-10-18T12:16:37.105 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-10-18T12:16:37.140 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-10-18T12:16:37.497 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-18T12:16:37.516 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-18T12:16:37.623 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-18T12:16:37.642 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-10-18T12:16:37.801 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-10-18T12:16:37.974 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-10-18T12:16:38.211 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-10-18T12:16:38.351 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-18T12:16:38.604 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-10-18T12:16:38.728 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-10-18T12:16:38.955 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-10-18T12:16:39.097 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-10-18T12:16:39.131 INFO:teuthology.orchestra.run.smithi114.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-10-18T12:16:39.440 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-10-18T12:16:39.472 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-10-18T12:16:39.600 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-18T12:16:39.800 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-10-18T12:16:40.001 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-10-18T12:16:40.159 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-10-18T12:16:40.452 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-18T12:16:40.595 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-18T12:16:40.609 INFO:teuthology.orchestra.run.smithi172.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-10-18T12:16:40.704 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-10-18T12:16:40.937 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-10-18T12:16:41.063 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-10-18T12:16:41.114 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-18T12:16:41.465 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-10-18T12:16:41.480 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-10-18T12:16:41.918 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-10-18T12:16:42.041 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-10-18T12:16:42.200 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-10-18T12:16:42.644 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-10-18T12:16:42.995 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-10-18T12:16:43.304 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-18T12:16:43.430 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-10-18T12:16:43.892 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-10-18T12:16:44.260 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-10-18T12:16:44.644 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-18T12:16:44.778 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-10-18T12:16:44.798 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-10-18T12:16:44.921 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-10-18T12:16:45.188 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-18T12:16:45.380 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-10-18T12:16:45.589 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-10-18T12:16:45.748 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-10-18T12:16:46.049 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-18T12:16:46.117 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-10-18T12:16:46.242 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-10-18T12:16:46.450 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-18T12:16:46.668 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-10-18T12:16:47.070 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-10-18T12:16:47.565 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-10-18T12:16:47.715 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-18T12:16:47.841 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-10-18T12:16:47.967 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-10-18T12:16:47.968 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-10-18T12:16:48.093 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-rsa (4.0-3) ... 2023-10-18T12:16:48.502 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-18T12:16:48.628 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-10-18T12:16:49.047 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-18T12:16:49.205 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-10-18T12:16:49.352 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-10-18T12:16:49.414 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-18T12:16:49.482 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-10-18T12:16:49.608 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-rsa (4.0-3) ... 2023-10-18T12:16:49.790 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-10-18T12:16:49.969 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-10-18T12:16:50.095 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-10-18T12:16:50.250 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up librados2 (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:50.463 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-10-18T12:16:50.495 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-10-18T12:16:50.622 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up librgw2 (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:50.748 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libsqlite3-mod-ceph (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:50.830 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-10-18T12:16:50.874 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libcephfs2 (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:51.025 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-routes (2.4.1-2) ... 2023-10-18T12:16:51.215 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-10-18T12:16:51.401 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libradosstriper1 (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:51.560 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-10-18T12:16:51.692 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up librados2 (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:51.929 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up librbd1 (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:51.937 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-10-18T12:16:52.063 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up librgw2 (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:52.096 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mgr-modules-core (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:52.180 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libsqlite3-mod-ceph (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:52.222 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-fuse (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:52.485 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-18T12:16:52.486 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-18T12:16:52.682 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libcephfs2 (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:52.833 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-routes (2.4.1-2) ... 2023-10-18T12:16:53.218 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libradosstriper1 (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:53.344 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-10-18T12:16:53.357 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libcephfs-dev (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:53.483 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-rados (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:53.609 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up cephfs-top (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:53.712 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up librbd1 (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:53.760 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-10-18T12:16:53.838 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mgr-modules-core (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:53.964 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-fuse (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:54.230 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-18T12:16:54.230 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-10-18T12:16:54.889 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-rbd (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:55.015 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up rbd-fuse (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:55.065 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libcephfs-dev (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:55.140 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-rgw (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:55.216 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-rados (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:55.266 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-cephfs (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:55.342 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up cephfs-top (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:55.409 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up cephfs-shell (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:55.476 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-10-18T12:16:55.535 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-common (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:56.141 INFO:teuthology.orchestra.run.smithi114.stdout:Adding group ceph....done 2023-10-18T12:16:56.614 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-rbd (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:56.624 INFO:teuthology.orchestra.run.smithi114.stdout:Adding system user ceph....done 2023-10-18T12:16:56.739 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up rbd-fuse (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:56.845 INFO:teuthology.orchestra.run.smithi114.stdout:Setting system user ceph properties....done 2023-10-18T12:16:56.865 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-rgw (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:56.880 INFO:teuthology.orchestra.run.smithi114.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-18T12:16:57.008 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up python3-cephfs (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:57.074 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-18T12:16:57.168 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up cephfs-shell (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:57.294 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-common (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:57.618 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-18T12:16:57.951 INFO:teuthology.orchestra.run.smithi172.stdout:Adding group ceph....done 2023-10-18T12:16:58.400 INFO:teuthology.orchestra.run.smithi172.stdout:Adding system user ceph....done 2023-10-18T12:16:58.571 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up cephfs-mirror (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:58.663 INFO:teuthology.orchestra.run.smithi172.stdout:Setting system user ceph properties....done 2023-10-18T12:16:58.694 INFO:teuthology.orchestra.run.smithi172.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-10-18T12:16:58.840 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-18T12:16:58.840 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-18T12:16:58.891 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-10-18T12:16:59.426 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-10-18T12:16:59.705 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-test (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:16:59.831 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up radosgw (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:17:00.141 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-18T12:17:00.142 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-18T12:17:00.414 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up cephfs-mirror (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:17:00.693 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-18T12:17:00.694 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-10-18T12:17:01.382 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-base (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:17:01.564 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-test (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:17:01.690 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up radosgw (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:17:01.885 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-18T12:17:02.030 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-18T12:17:02.031 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-10-18T12:17:02.801 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mds (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:17:03.091 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-18T12:17:03.091 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-18T12:17:03.317 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-base (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:17:03.809 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-10-18T12:17:03.911 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mgr (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:17:04.182 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-18T12:17:04.182 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-18T12:17:04.677 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mds (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:17:05.018 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-18T12:17:05.018 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-10-18T12:17:05.020 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-osd (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:17:05.854 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mgr (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:17:05.882 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-18T12:17:05.882 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-18T12:17:06.127 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-18T12:17:06.127 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-10-18T12:17:06.730 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mgr-k8sevents (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:17:06.889 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:17:06.988 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-osd (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:17:07.041 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mon (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:17:07.295 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-18T12:17:07.295 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-18T12:17:07.788 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-18T12:17:07.788 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-10-18T12:17:08.159 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mgr-cephadm (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:17:08.368 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:17:08.519 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mgr-dashboard (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:17:08.623 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mgr-k8sevents (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:17:08.670 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-volume (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:17:08.758 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:17:08.814 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-18T12:17:08.909 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mon (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:17:08.990 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-18T12:17:09.175 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-18T12:17:09.176 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-10-18T12:17:09.483 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-18T12:17:10.044 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mgr-cephadm (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:17:10.194 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:17:10.320 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-mgr-dashboard (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:17:10.471 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ceph-volume (18.0.0-5610-g6f3e6b48-1focal) ... 2023-10-18T12:17:10.623 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-18T12:17:10.800 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-18T12:17:11.276 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-18T12:17:14.970 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-10-18T12:17:15.772 INFO:teuthology.orchestra.run.smithi114.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-18T12:17:15.778 DEBUG:teuthology.orchestra.run.smithi114:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-10-18T12:17:15.897 INFO:teuthology.orchestra.run.smithi114.stdout:Reading package lists... 2023-10-18T12:17:16.107 INFO:teuthology.orchestra.run.smithi114.stdout:Building dependency tree... 2023-10-18T12:17:16.108 INFO:teuthology.orchestra.run.smithi114.stdout:Reading state information... 2023-10-18T12:17:16.308 INFO:teuthology.orchestra.run.smithi114.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-10-18T12:17:16.309 INFO:teuthology.orchestra.run.smithi114.stdout:flex is already the newest version (2.6.4-6.2). 2023-10-18T12:17:16.309 INFO:teuthology.orchestra.run.smithi114.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-10-18T12:17:16.309 INFO:teuthology.orchestra.run.smithi114.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-10-18T12:17:16.309 INFO:teuthology.orchestra.run.smithi114.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-10-18T12:17:16.310 INFO:teuthology.orchestra.run.smithi114.stdout:The following packages were automatically installed and are no longer required: 2023-10-18T12:17:16.311 INFO:teuthology.orchestra.run.smithi114.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-18T12:17:16.311 INFO:teuthology.orchestra.run.smithi114.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-18T12:17:16.311 INFO:teuthology.orchestra.run.smithi114.stdout:The following additional packages will be installed: 2023-10-18T12:17:16.311 INFO:teuthology.orchestra.run.smithi114.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-10-18T12:17:16.312 INFO:teuthology.orchestra.run.smithi114.stdout: libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 2023-10-18T12:17:16.312 INFO:teuthology.orchestra.run.smithi114.stdout: libteamdctl0 libuuid1 modemmanager network-manager-pptp postgresql-12 2023-10-18T12:17:16.312 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-client-12 postgresql-client-common ppp pptp-linux usb-modeswitch 2023-10-18T12:17:16.312 INFO:teuthology.orchestra.run.smithi114.stdout: usb-modeswitch-data wpasupplicant 2023-10-18T12:17:16.313 INFO:teuthology.orchestra.run.smithi114.stdout:Suggested packages: 2023-10-18T12:17:16.313 INFO:teuthology.orchestra.run.smithi114.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2023-10-18T12:17:16.313 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2023-10-18T12:17:16.313 INFO:teuthology.orchestra.run.smithi114.stdout: libengine-pkcs11-openssl 2023-10-18T12:17:16.354 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-10-18T12:17:16.412 INFO:teuthology.orchestra.run.smithi114.stdout:The following NEW packages will be installed: 2023-10-18T12:17:16.413 INFO:teuthology.orchestra.run.smithi114.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-10-18T12:17:16.413 INFO:teuthology.orchestra.run.smithi114.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2023-10-18T12:17:16.414 INFO:teuthology.orchestra.run.smithi114.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-10-18T12:17:16.414 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2023-10-18T12:17:16.414 INFO:teuthology.orchestra.run.smithi114.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2023-10-18T12:17:16.414 INFO:teuthology.orchestra.run.smithi114.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-18T12:17:16.415 INFO:teuthology.orchestra.run.smithi114.stdout:The following packages will be upgraded: 2023-10-18T12:17:16.415 INFO:teuthology.orchestra.run.smithi114.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-10-18T12:17:16.630 INFO:teuthology.orchestra.run.smithi114.stdout:6 upgraded, 31 newly installed, 0 to remove and 250 not upgraded. 2023-10-18T12:17:16.630 INFO:teuthology.orchestra.run.smithi114.stdout:Need to get 25.3 MB of archives. 2023-10-18T12:17:16.631 INFO:teuthology.orchestra.run.smithi114.stdout:After this operation, 79.9 MB of additional disk space will be used. 2023-10-18T12:17:16.631 INFO:teuthology.orchestra.run.smithi114.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-10-18T12:17:17.166 INFO:teuthology.orchestra.run.smithi172.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-18T12:17:17.171 DEBUG:teuthology.orchestra.run.smithi172:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-10-18T12:17:17.272 INFO:teuthology.orchestra.run.smithi114.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-10-18T12:17:17.274 INFO:teuthology.orchestra.run.smithi114.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-10-18T12:17:17.276 INFO:teuthology.orchestra.run.smithi114.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-10-18T12:17:17.289 INFO:teuthology.orchestra.run.smithi114.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-10-18T12:17:17.291 INFO:teuthology.orchestra.run.smithi114.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-10-18T12:17:17.302 INFO:teuthology.orchestra.run.smithi172.stdout:Reading package lists... 2023-10-18T12:17:17.390 INFO:teuthology.orchestra.run.smithi114.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-10-18T12:17:17.391 INFO:teuthology.orchestra.run.smithi114.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-10-18T12:17:17.398 INFO:teuthology.orchestra.run.smithi114.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-10-18T12:17:17.403 INFO:teuthology.orchestra.run.smithi114.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-10-18T12:17:17.404 INFO:teuthology.orchestra.run.smithi114.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-10-18T12:17:17.506 INFO:teuthology.orchestra.run.smithi172.stdout:Building dependency tree... 2023-10-18T12:17:17.507 INFO:teuthology.orchestra.run.smithi172.stdout:Reading state information... 2023-10-18T12:17:17.572 INFO:teuthology.orchestra.run.smithi114.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-10-18T12:17:17.701 INFO:teuthology.orchestra.run.smithi172.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-10-18T12:17:17.701 INFO:teuthology.orchestra.run.smithi172.stdout:flex is already the newest version (2.6.4-6.2). 2023-10-18T12:17:17.701 INFO:teuthology.orchestra.run.smithi172.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-10-18T12:17:17.702 INFO:teuthology.orchestra.run.smithi172.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-10-18T12:17:17.702 INFO:teuthology.orchestra.run.smithi172.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-10-18T12:17:17.702 INFO:teuthology.orchestra.run.smithi172.stdout:The following packages were automatically installed and are no longer required: 2023-10-18T12:17:17.703 INFO:teuthology.orchestra.run.smithi172.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-10-18T12:17:17.703 INFO:teuthology.orchestra.run.smithi172.stdout:Use 'sudo apt autoremove' to remove them. 2023-10-18T12:17:17.703 INFO:teuthology.orchestra.run.smithi172.stdout:The following additional packages will be installed: 2023-10-18T12:17:17.704 INFO:teuthology.orchestra.run.smithi172.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-10-18T12:17:17.704 INFO:teuthology.orchestra.run.smithi172.stdout: libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 2023-10-18T12:17:17.704 INFO:teuthology.orchestra.run.smithi172.stdout: libteamdctl0 libuuid1 modemmanager network-manager-pptp postgresql-12 2023-10-18T12:17:17.704 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-client-12 postgresql-client-common ppp pptp-linux usb-modeswitch 2023-10-18T12:17:17.704 INFO:teuthology.orchestra.run.smithi172.stdout: usb-modeswitch-data wpasupplicant 2023-10-18T12:17:17.705 INFO:teuthology.orchestra.run.smithi172.stdout:Suggested packages: 2023-10-18T12:17:17.705 INFO:teuthology.orchestra.run.smithi172.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2023-10-18T12:17:17.705 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2023-10-18T12:17:17.705 INFO:teuthology.orchestra.run.smithi172.stdout: libengine-pkcs11-openssl 2023-10-18T12:17:17.805 INFO:teuthology.orchestra.run.smithi172.stdout:The following NEW packages will be installed: 2023-10-18T12:17:17.806 INFO:teuthology.orchestra.run.smithi172.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-10-18T12:17:17.806 INFO:teuthology.orchestra.run.smithi172.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2023-10-18T12:17:17.807 INFO:teuthology.orchestra.run.smithi172.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-10-18T12:17:17.807 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2023-10-18T12:17:17.807 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2023-10-18T12:17:17.807 INFO:teuthology.orchestra.run.smithi172.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-10-18T12:17:17.808 INFO:teuthology.orchestra.run.smithi172.stdout:The following packages will be upgraded: 2023-10-18T12:17:17.808 INFO:teuthology.orchestra.run.smithi172.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-10-18T12:17:17.841 INFO:teuthology.orchestra.run.smithi114.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-10-18T12:17:17.984 INFO:teuthology.orchestra.run.smithi114.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-10-18T12:17:17.988 INFO:teuthology.orchestra.run.smithi114.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-10-18T12:17:18.004 INFO:teuthology.orchestra.run.smithi172.stdout:6 upgraded, 31 newly installed, 0 to remove and 250 not upgraded. 2023-10-18T12:17:18.005 INFO:teuthology.orchestra.run.smithi172.stdout:Need to get 25.3 MB of archives. 2023-10-18T12:17:18.005 INFO:teuthology.orchestra.run.smithi172.stdout:After this operation, 79.9 MB of additional disk space will be used. 2023-10-18T12:17:18.005 INFO:teuthology.orchestra.run.smithi172.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-10-18T12:17:18.092 INFO:teuthology.orchestra.run.smithi114.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-10-18T12:17:18.096 INFO:teuthology.orchestra.run.smithi114.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-10-18T12:17:18.176 INFO:teuthology.orchestra.run.smithi114.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.16-0ubuntu0.20.04.1 [115 kB] 2023-10-18T12:17:18.194 INFO:teuthology.orchestra.run.smithi114.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-10-18T12:17:18.261 INFO:teuthology.orchestra.run.smithi114.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-10-18T12:17:18.261 INFO:teuthology.orchestra.run.smithi114.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-10-18T12:17:18.346 INFO:teuthology.orchestra.run.smithi114.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-10-18T12:17:18.511 INFO:teuthology.orchestra.run.smithi114.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-10-18T12:17:18.643 INFO:teuthology.orchestra.run.smithi172.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-10-18T12:17:18.645 INFO:teuthology.orchestra.run.smithi172.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-10-18T12:17:18.646 INFO:teuthology.orchestra.run.smithi172.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-10-18T12:17:18.659 INFO:teuthology.orchestra.run.smithi172.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-10-18T12:17:18.661 INFO:teuthology.orchestra.run.smithi172.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-10-18T12:17:18.760 INFO:teuthology.orchestra.run.smithi172.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-10-18T12:17:18.762 INFO:teuthology.orchestra.run.smithi172.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-10-18T12:17:18.769 INFO:teuthology.orchestra.run.smithi172.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-10-18T12:17:18.775 INFO:teuthology.orchestra.run.smithi172.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-10-18T12:17:18.775 INFO:teuthology.orchestra.run.smithi172.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-10-18T12:17:18.942 INFO:teuthology.orchestra.run.smithi172.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-10-18T12:17:19.135 INFO:teuthology.orchestra.run.smithi114.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-10-18T12:17:19.214 INFO:teuthology.orchestra.run.smithi172.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-10-18T12:17:19.235 INFO:teuthology.orchestra.run.smithi114.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-10-18T12:17:19.324 INFO:teuthology.orchestra.run.smithi114.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-10-18T12:17:19.333 INFO:teuthology.orchestra.run.smithi114.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-10-18T12:17:19.334 INFO:teuthology.orchestra.run.smithi114.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-10-18T12:17:19.335 INFO:teuthology.orchestra.run.smithi114.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2023-10-18T12:17:19.336 INFO:teuthology.orchestra.run.smithi114.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.16-0ubuntu0.20.04.1 [1,053 kB] 2023-10-18T12:17:19.355 INFO:teuthology.orchestra.run.smithi172.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-10-18T12:17:19.360 INFO:teuthology.orchestra.run.smithi172.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-10-18T12:17:19.369 INFO:teuthology.orchestra.run.smithi114.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2023-10-18T12:17:19.373 INFO:teuthology.orchestra.run.smithi114.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.16-0ubuntu0.20.04.1 [13.5 MB] 2023-10-18T12:17:19.462 INFO:teuthology.orchestra.run.smithi172.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-10-18T12:17:19.466 INFO:teuthology.orchestra.run.smithi172.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-10-18T12:17:19.547 INFO:teuthology.orchestra.run.smithi172.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.16-0ubuntu0.20.04.1 [115 kB] 2023-10-18T12:17:19.564 INFO:teuthology.orchestra.run.smithi172.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-10-18T12:17:19.631 INFO:teuthology.orchestra.run.smithi172.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-10-18T12:17:19.632 INFO:teuthology.orchestra.run.smithi172.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-10-18T12:17:19.715 INFO:teuthology.orchestra.run.smithi172.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-10-18T12:17:19.745 INFO:teuthology.orchestra.run.smithi114.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2023-10-18T12:17:19.880 INFO:teuthology.orchestra.run.smithi172.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-10-18T12:17:19.912 INFO:teuthology.orchestra.run.smithi114.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2023-10-18T12:17:19.995 INFO:teuthology.orchestra.run.smithi114.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2023-10-18T12:17:19.995 INFO:teuthology.orchestra.run.smithi114.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-10-18T12:17:20.111 INFO:teuthology.orchestra.run.smithi114.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-10-18T12:17:20.514 INFO:teuthology.orchestra.run.smithi172.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-10-18T12:17:20.614 INFO:teuthology.orchestra.run.smithi172.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-10-18T12:17:20.704 INFO:teuthology.orchestra.run.smithi172.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-10-18T12:17:20.713 INFO:teuthology.orchestra.run.smithi172.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-10-18T12:17:20.714 INFO:teuthology.orchestra.run.smithi172.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-10-18T12:17:20.715 INFO:teuthology.orchestra.run.smithi172.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2023-10-18T12:17:20.716 INFO:teuthology.orchestra.run.smithi172.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.16-0ubuntu0.20.04.1 [1,053 kB] 2023-10-18T12:17:20.751 INFO:teuthology.orchestra.run.smithi172.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2023-10-18T12:17:20.753 INFO:teuthology.orchestra.run.smithi172.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.16-0ubuntu0.20.04.1 [13.5 MB] 2023-10-18T12:17:20.779 INFO:teuthology.orchestra.run.smithi114.stdout:Preconfiguring packages ... 2023-10-18T12:17:21.006 INFO:teuthology.orchestra.run.smithi114.stdout:Fetched 25.3 MB in 4s (6,688 kB/s) 2023-10-18T12:17:21.125 INFO:teuthology.orchestra.run.smithi172.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2023-10-18T12:17:21.289 INFO:teuthology.orchestra.run.smithi172.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2023-10-18T12:17:21.347 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118871 files and directories currently installed.) 2023-10-18T12:17:21.350 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-18T12:17:21.372 INFO:teuthology.orchestra.run.smithi172.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2023-10-18T12:17:21.373 INFO:teuthology.orchestra.run.smithi172.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-10-18T12:17:21.488 INFO:teuthology.orchestra.run.smithi172.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-10-18T12:17:21.528 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-18T12:17:22.164 INFO:teuthology.orchestra.run.smithi172.stdout:Preconfiguring packages ... 2023-10-18T12:17:22.386 INFO:teuthology.orchestra.run.smithi172.stdout:Fetched 25.3 MB in 4s (6,720 kB/s) 2023-10-18T12:17:22.727 INFO:teuthology.orchestra.run.smithi172.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118871 files and directories currently installed.) 2023-10-18T12:17:22.730 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-18T12:17:22.907 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-18T12:17:23.161 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-10-18T12:17:24.993 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-10-18T12:17:25.179 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118871 files and directories currently installed.) 2023-10-18T12:17:25.182 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-18T12:17:25.305 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-18T12:17:25.793 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-18T12:17:25.961 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-18T12:17:26.357 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-18T12:17:26.853 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118871 files and directories currently installed.) 2023-10-18T12:17:26.858 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-18T12:17:26.964 INFO:teuthology.orchestra.run.smithi172.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118871 files and directories currently installed.) 2023-10-18T12:17:26.968 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-18T12:17:26.994 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-18T12:17:27.122 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-18T12:17:27.501 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-18T12:17:27.601 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-10-18T12:17:27.632 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-18T12:17:27.780 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-10-18T12:17:28.175 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-18T12:17:28.176 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-18T12:17:28.337 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-10-18T12:17:28.688 INFO:teuthology.orchestra.run.smithi172.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118871 files and directories currently installed.) 2023-10-18T12:17:28.692 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-18T12:17:29.010 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-18T12:17:29.023 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-18T12:17:29.031 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-10-18T12:17:29.076 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-10-18T12:17:29.438 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package dump. 2023-10-18T12:17:29.460 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-10-18T12:17:29.504 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking dump (0.4b46-6) ... 2023-10-18T12:17:29.525 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-18T12:17:29.662 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-10-18T12:17:29.816 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package indent. 2023-10-18T12:17:29.838 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-10-18T12:17:29.899 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-18T12:17:30.179 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-18T12:17:30.269 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-18T12:17:30.290 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-10-18T12:17:30.325 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-10-18T12:17:30.335 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-10-18T12:17:30.747 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-18T12:17:30.769 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-10-18T12:17:30.813 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-18T12:17:30.904 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-10-18T12:17:30.918 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-10-18T12:17:30.979 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-10-18T12:17:31.125 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-18T12:17:31.148 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-18T12:17:31.191 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-18T12:17:31.323 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package dump. 2023-10-18T12:17:31.337 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-10-18T12:17:31.381 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking dump (0.4b46-6) ... 2023-10-18T12:17:31.603 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-18T12:17:31.622 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-18T12:17:31.660 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-18T12:17:31.744 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package indent. 2023-10-18T12:17:31.765 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-10-18T12:17:31.810 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-18T12:17:31.963 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-18T12:17:31.985 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-18T12:17:32.055 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-18T12:17:32.197 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-10-18T12:17:32.218 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-10-18T12:17:32.263 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-10-18T12:17:32.400 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-18T12:17:32.418 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-18T12:17:32.457 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-18T12:17:32.650 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-10-18T12:17:32.671 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-10-18T12:17:32.717 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-18T12:17:32.894 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-18T12:17:32.915 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-10-18T12:17:32.960 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-18T12:17:33.028 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-10-18T12:17:33.049 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-10-18T12:17:33.094 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-18T12:17:33.330 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-18T12:17:33.349 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-18T12:17:33.388 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-18T12:17:33.472 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-10-18T12:17:33.491 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-18T12:17:33.530 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-18T12:17:33.824 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libpq5:amd64. 2023-10-18T12:17:33.848 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../14-libpq5_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-10-18T12:17:33.867 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libmbim-proxy. 2023-10-18T12:17:33.886 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-10-18T12:17:33.890 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libpq5:amd64 (12.16-0ubuntu0.20.04.1) ... 2023-10-18T12:17:33.925 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-18T12:17:34.261 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-10-18T12:17:34.281 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-18T12:17:34.286 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-18T12:17:34.305 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../15-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-18T12:17:34.336 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-18T12:17:34.343 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-18T12:17:34.705 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-18T12:17:34.722 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libndp0:amd64. 2023-10-18T12:17:34.728 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../16-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-18T12:17:34.744 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-10-18T12:17:34.796 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-18T12:17:34.822 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-18T12:17:35.082 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-18T12:17:35.103 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../17-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-18T12:17:35.148 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-18T12:17:35.209 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libnm0:amd64. 2023-10-18T12:17:35.228 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-18T12:17:35.292 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-18T12:17:35.687 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libpq5:amd64. 2023-10-18T12:17:35.710 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../14-libpq5_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-10-18T12:17:35.746 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-18T12:17:35.767 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../18-libteamdctl0_1.30-1_amd64.deb ... 2023-10-18T12:17:35.778 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libpq5:amd64 (12.16-0ubuntu0.20.04.1) ... 2023-10-18T12:17:35.812 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-10-18T12:17:36.172 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-10-18T12:17:36.186 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../15-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-18T12:17:36.232 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package modemmanager. 2023-10-18T12:17:36.253 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../19-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-18T12:17:36.256 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-18T12:17:36.322 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-18T12:17:36.617 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libqmi-proxy. 2023-10-18T12:17:36.639 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../16-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-10-18T12:17:36.684 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-18T12:17:36.969 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-10-18T12:17:36.994 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../17-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-10-18T12:17:37.036 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-18T12:17:37.055 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package wpasupplicant. 2023-10-18T12:17:37.075 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../20-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-10-18T12:17:37.113 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-18T12:17:37.598 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-10-18T12:17:37.620 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../18-libteamdctl0_1.30-1_amd64.deb ... 2023-10-18T12:17:37.690 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-10-18T12:17:37.693 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package network-manager. 2023-10-18T12:17:37.713 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../21-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-18T12:17:37.799 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-10-18T12:17:38.101 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package modemmanager. 2023-10-18T12:17:38.123 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../19-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-10-18T12:17:38.211 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-18T12:17:38.642 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ppp. 2023-10-18T12:17:38.664 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../22-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-10-18T12:17:38.882 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package wpasupplicant. 2023-10-18T12:17:38.904 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../20-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-10-18T12:17:38.948 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-18T12:17:39.155 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-18T12:17:39.547 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package pptp-linux. 2023-10-18T12:17:39.554 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package network-manager. 2023-10-18T12:17:39.566 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../23-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-10-18T12:17:39.576 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../21-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-10-18T12:17:39.605 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-10-18T12:17:39.682 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-10-18T12:17:40.033 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-18T12:17:40.057 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../24-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-10-18T12:17:40.129 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-10-18T12:17:40.498 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package ppp. 2023-10-18T12:17:40.503 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package postgresql-client-common. 2023-10-18T12:17:40.516 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../22-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-10-18T12:17:40.524 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../25-postgresql-client-common_214ubuntu0.1_all.deb ... 2023-10-18T12:17:40.569 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2023-10-18T12:17:40.949 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package postgresql-client-12. 2023-10-18T12:17:40.970 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../26-postgresql-client-12_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-10-18T12:17:41.015 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking postgresql-client-12 (12.16-0ubuntu0.20.04.1) ... 2023-10-18T12:17:41.028 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-18T12:17:41.400 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package pptp-linux. 2023-10-18T12:17:41.422 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../23-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-10-18T12:17:41.466 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-10-18T12:17:41.662 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package postgresql-common. 2023-10-18T12:17:41.688 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../27-postgresql-common_214ubuntu0.1_all.deb ... 2023-10-18T12:17:41.761 INFO:teuthology.orchestra.run.smithi114.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-10-18T12:17:41.790 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2023-10-18T12:17:41.887 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package network-manager-pptp. 2023-10-18T12:17:41.908 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../24-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-10-18T12:17:41.982 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-10-18T12:17:42.324 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package postgresql-client-common. 2023-10-18T12:17:42.327 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package postgresql-12. 2023-10-18T12:17:42.342 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../25-postgresql-client-common_214ubuntu0.1_all.deb ... 2023-10-18T12:17:42.349 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../28-postgresql-12_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-10-18T12:17:42.381 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2023-10-18T12:17:42.400 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking postgresql-12 (12.16-0ubuntu0.20.04.1) ... 2023-10-18T12:17:42.755 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package postgresql-client-12. 2023-10-18T12:17:42.776 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../26-postgresql-client-12_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-10-18T12:17:42.818 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking postgresql-client-12 (12.16-0ubuntu0.20.04.1) ... 2023-10-18T12:17:43.523 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package postgresql-common. 2023-10-18T12:17:43.542 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../27-postgresql-common_214ubuntu0.1_all.deb ... 2023-10-18T12:17:43.619 INFO:teuthology.orchestra.run.smithi172.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-10-18T12:17:43.642 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2023-10-18T12:17:43.955 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package postgresql. 2023-10-18T12:17:43.977 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../29-postgresql_12+214ubuntu0.1_all.deb ... 2023-10-18T12:17:44.180 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package postgresql-12. 2023-10-18T12:17:44.199 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../28-postgresql-12_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-10-18T12:17:44.245 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking postgresql-12 (12.16-0ubuntu0.20.04.1) ... 2023-10-18T12:17:44.277 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2023-10-18T12:17:44.690 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package postgresql-client. 2023-10-18T12:17:44.709 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../30-postgresql-client_12+214ubuntu0.1_all.deb ... 2023-10-18T12:17:44.748 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2023-10-18T12:17:45.034 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package postgresql-contrib. 2023-10-18T12:17:45.053 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../31-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2023-10-18T12:17:45.091 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2023-10-18T12:17:45.369 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-18T12:17:45.388 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../32-usb-modeswitch-data_20191128-3_all.deb ... 2023-10-18T12:17:45.452 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-10-18T12:17:45.856 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-18T12:17:45.882 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../33-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-10-18T12:17:45.892 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package postgresql. 2023-10-18T12:17:45.914 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../29-postgresql_12+214ubuntu0.1_all.deb ... 2023-10-18T12:17:45.945 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-18T12:17:45.966 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2023-10-18T12:17:46.227 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package postgresql-client. 2023-10-18T12:17:46.249 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../30-postgresql-client_12+214ubuntu0.1_all.deb ... 2023-10-18T12:17:46.293 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2023-10-18T12:17:46.298 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2023-10-18T12:17:46.554 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-18T12:17:46.604 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package postgresql-contrib. 2023-10-18T12:17:46.627 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../31-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2023-10-18T12:17:46.670 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2023-10-18T12:17:46.921 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libpq5:amd64 (12.16-0ubuntu0.20.04.1) ... 2023-10-18T12:17:46.998 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-10-18T12:17:47.021 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../32-usb-modeswitch-data_20191128-3_all.deb ... 2023-10-18T12:17:47.047 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-10-18T12:17:47.064 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-10-18T12:17:47.206 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-10-18T12:17:47.332 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-18T12:17:47.509 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package usb-modeswitch. 2023-10-18T12:17:47.534 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../33-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-10-18T12:17:47.599 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-18T12:17:47.771 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-18T12:17:47.771 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-18T12:17:47.964 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2023-10-18T12:17:48.173 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-18T12:17:48.541 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libpq5:amd64 (12.16-0ubuntu0.20.04.1) ... 2023-10-18T12:17:48.676 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-10-18T12:17:48.677 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up postgresql-client-12 (12.16-0ubuntu0.20.04.1) ... 2023-10-18T12:17:48.802 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-10-18T12:17:48.953 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-10-18T12:17:49.771 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-18T12:17:49.771 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-10-18T12:17:50.698 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up postgresql-client-12 (12.16-0ubuntu0.20.04.1) ... 2023-10-18T12:17:50.805 INFO:teuthology.orchestra.run.smithi114.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-10-18T12:17:50.924 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-18T12:17:51.050 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-10-18T12:17:51.176 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2023-10-18T12:17:52.524 INFO:teuthology.orchestra.run.smithi114.stdout:Adding user postgres to group ssl-cert 2023-10-18T12:17:52.846 INFO:teuthology.orchestra.run.smithi172.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-10-18T12:17:52.913 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:17:52.913 INFO:teuthology.orchestra.run.smithi114.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-10-18T12:17:52.962 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-10-18T12:17:53.088 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-10-18T12:17:53.214 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2023-10-18T12:17:53.390 INFO:teuthology.orchestra.run.smithi114.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-10-18T12:17:53.391 INFO:teuthology.orchestra.run.smithi114.stdout:Removing obsolete dictionary files: 2023-10-18T12:17:53.921 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-10-18T12:17:54.899 INFO:teuthology.orchestra.run.smithi172.stdout:Adding user postgres to group ssl-cert 2023-10-18T12:17:55.266 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T12:17:55.266 INFO:teuthology.orchestra.run.smithi172.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-10-18T12:17:55.361 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-18T12:17:55.495 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-10-18T12:17:55.621 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-18T12:17:55.748 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-18T12:17:55.751 INFO:teuthology.orchestra.run.smithi172.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-10-18T12:17:55.751 INFO:teuthology.orchestra.run.smithi172.stdout:Removing obsolete dictionary files: 2023-10-18T12:17:56.316 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-10-18T12:17:57.056 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-10-18T12:17:57.511 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up dump (0.4b46-6) ... 2023-10-18T12:17:57.629 INFO:teuthology.orchestra.run.smithi114.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-18T12:17:57.696 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-18T12:17:57.766 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-10-18T12:17:57.822 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-18T12:17:57.900 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-10-18T12:17:57.948 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-18T12:17:58.026 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-10-18T12:17:58.099 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-18T12:17:58.152 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-10-18T12:17:58.284 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-18T12:17:58.410 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up postgresql-12 (12.16-0ubuntu0.20.04.1) ... 2023-10-18T12:17:58.937 INFO:teuthology.orchestra.run.smithi114.stdout:Creating new PostgreSQL cluster 12/main ... 2023-10-18T12:17:58.977 INFO:teuthology.orchestra.run.smithi114.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2023-10-18T12:17:59.055 INFO:teuthology.orchestra.run.smithi114.stdout:The files belonging to this database system will be owned by user "postgres". 2023-10-18T12:17:59.055 INFO:teuthology.orchestra.run.smithi114.stdout:This user must also own the server process. 2023-10-18T12:17:59.055 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:17:59.055 INFO:teuthology.orchestra.run.smithi114.stdout:The database cluster will be initialized with locale "en_US". 2023-10-18T12:17:59.056 INFO:teuthology.orchestra.run.smithi114.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-10-18T12:17:59.056 INFO:teuthology.orchestra.run.smithi114.stdout:The default text search configuration will be set to "english". 2023-10-18T12:17:59.056 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:17:59.056 INFO:teuthology.orchestra.run.smithi114.stdout:Data page checksums are disabled. 2023-10-18T12:17:59.056 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:17:59.057 INFO:teuthology.orchestra.run.smithi114.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2023-10-18T12:17:59.058 INFO:teuthology.orchestra.run.smithi114.stdout:creating subdirectories ... ok 2023-10-18T12:17:59.059 INFO:teuthology.orchestra.run.smithi114.stdout:selecting dynamic shared memory implementation ... posix 2023-10-18T12:17:59.093 INFO:teuthology.orchestra.run.smithi114.stdout:selecting default max_connections ... 100 2023-10-18T12:17:59.138 INFO:teuthology.orchestra.run.smithi114.stdout:selecting default shared_buffers ... 128MB 2023-10-18T12:17:59.161 INFO:teuthology.orchestra.run.smithi114.stdout:selecting default time zone ... Etc/UTC 2023-10-18T12:17:59.162 INFO:teuthology.orchestra.run.smithi114.stdout:creating configuration files ... ok 2023-10-18T12:17:59.348 INFO:teuthology.orchestra.run.smithi114.stdout:running bootstrap script ... ok 2023-10-18T12:17:59.401 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-10-18T12:17:59.816 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up dump (0.4b46-6) ... 2023-10-18T12:17:59.925 INFO:teuthology.orchestra.run.smithi172.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-10-18T12:17:59.970 INFO:teuthology.orchestra.run.smithi114.stdout:performing post-bootstrap initialization ... ok 2023-10-18T12:17:59.993 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-10-18T12:18:00.152 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-10-18T12:18:00.278 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-10-18T12:18:00.404 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-10-18T12:18:00.505 INFO:teuthology.orchestra.run.smithi114.stdout:syncing data to disk ... ok 2023-10-18T12:18:00.506 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:18:00.506 INFO:teuthology.orchestra.run.smithi114.stdout:Success. You can now start the database server using: 2023-10-18T12:18:00.506 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:18:00.507 INFO:teuthology.orchestra.run.smithi114.stdout: pg_ctlcluster 12 main start 2023-10-18T12:18:00.507 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:18:00.630 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-10-18T12:18:00.756 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up postgresql-12 (12.16-0ubuntu0.20.04.1) ... 2023-10-18T12:18:01.081 INFO:teuthology.orchestra.run.smithi114.stdout:Ver Cluster Port Status Owner Data directory Log file 2023-10-18T12:18:01.081 INFO:teuthology.orchestra.run.smithi114.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2023-10-18T12:18:01.266 INFO:teuthology.orchestra.run.smithi172.stdout:Creating new PostgreSQL cluster 12/main ... 2023-10-18T12:18:01.294 INFO:teuthology.orchestra.run.smithi114.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-10-18T12:18:01.298 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2023-10-18T12:18:01.368 INFO:teuthology.orchestra.run.smithi172.stdout:The files belonging to this database system will be owned by user "postgres". 2023-10-18T12:18:01.368 INFO:teuthology.orchestra.run.smithi172.stdout:This user must also own the server process. 2023-10-18T12:18:01.369 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T12:18:01.369 INFO:teuthology.orchestra.run.smithi172.stdout:The database cluster will be initialized with locale "en_US". 2023-10-18T12:18:01.369 INFO:teuthology.orchestra.run.smithi172.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-10-18T12:18:01.369 INFO:teuthology.orchestra.run.smithi172.stdout:The default text search configuration will be set to "english". 2023-10-18T12:18:01.370 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T12:18:01.370 INFO:teuthology.orchestra.run.smithi172.stdout:Data page checksums are disabled. 2023-10-18T12:18:01.370 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T12:18:01.370 INFO:teuthology.orchestra.run.smithi172.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2023-10-18T12:18:01.372 INFO:teuthology.orchestra.run.smithi172.stdout:creating subdirectories ... ok 2023-10-18T12:18:01.372 INFO:teuthology.orchestra.run.smithi172.stdout:selecting dynamic shared memory implementation ... posix 2023-10-18T12:18:01.407 INFO:teuthology.orchestra.run.smithi172.stdout:selecting default max_connections ... 100 2023-10-18T12:18:01.460 INFO:teuthology.orchestra.run.smithi172.stdout:selecting default shared_buffers ... 128MB 2023-10-18T12:18:01.482 INFO:teuthology.orchestra.run.smithi172.stdout:selecting default time zone ... Etc/UTC 2023-10-18T12:18:01.483 INFO:teuthology.orchestra.run.smithi172.stdout:creating configuration files ... ok 2023-10-18T12:18:01.670 INFO:teuthology.orchestra.run.smithi172.stdout:running bootstrap script ... ok 2023-10-18T12:18:02.285 INFO:teuthology.orchestra.run.smithi172.stdout:performing post-bootstrap initialization ... ok 2023-10-18T12:18:02.797 INFO:teuthology.orchestra.run.smithi172.stdout:syncing data to disk ... ok 2023-10-18T12:18:02.797 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T12:18:02.797 INFO:teuthology.orchestra.run.smithi172.stdout:Success. You can now start the database server using: 2023-10-18T12:18:02.798 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T12:18:02.798 INFO:teuthology.orchestra.run.smithi172.stdout: pg_ctlcluster 12 main start 2023-10-18T12:18:02.798 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T12:18:03.362 INFO:teuthology.orchestra.run.smithi172.stdout:Ver Cluster Port Status Owner Data directory Log file 2023-10-18T12:18:03.362 INFO:teuthology.orchestra.run.smithi172.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2023-10-18T12:18:03.573 INFO:teuthology.orchestra.run.smithi172.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-10-18T12:18:04.951 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-18T12:18:05.076 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-18T12:18:05.194 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-10-18T12:18:05.404 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-18T12:18:05.530 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2023-10-18T12:18:05.656 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-10-18T12:18:06.850 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:18:06.850 INFO:teuthology.orchestra.run.smithi114.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-18T12:18:06.850 INFO:teuthology.orchestra.run.smithi114.stdout:which means they are currently configured by ifupdown: 2023-10-18T12:18:06.850 INFO:teuthology.orchestra.run.smithi114.stdout:- enp3s0f1 2023-10-18T12:18:06.851 INFO:teuthology.orchestra.run.smithi114.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-18T12:18:06.851 INFO:teuthology.orchestra.run.smithi114.stdout:remove their configuration from /etc/network/interfaces. 2023-10-18T12:18:06.851 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:18:07.082 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-18T12:18:07.189 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-18T12:18:07.315 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-10-18T12:18:07.494 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-10-18T12:18:07.595 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-18T12:18:07.667 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-18T12:18:07.794 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2023-10-18T12:18:07.944 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-10-18T12:18:08.496 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-18T12:18:09.165 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T12:18:09.165 INFO:teuthology.orchestra.run.smithi172.stdout:The following network interfaces were found in /etc/network/interfaces 2023-10-18T12:18:09.165 INFO:teuthology.orchestra.run.smithi172.stdout:which means they are currently configured by ifupdown: 2023-10-18T12:18:09.166 INFO:teuthology.orchestra.run.smithi172.stdout:- enp3s0f1 2023-10-18T12:18:09.166 INFO:teuthology.orchestra.run.smithi172.stdout:If you want to manage those interfaces with NetworkManager instead 2023-10-18T12:18:09.166 INFO:teuthology.orchestra.run.smithi172.stdout:remove their configuration from /etc/network/interfaces. 2023-10-18T12:18:09.167 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T12:18:09.397 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-10-18T12:18:09.426 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-18T12:18:09.568 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-10-18T12:18:09.778 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-18T12:18:09.904 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2023-10-18T12:18:09.981 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-10-18T12:18:10.030 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2023-10-18T12:18:10.156 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-18T12:18:10.307 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-18T12:18:10.433 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-18T12:18:10.753 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-18T12:18:10.753 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-18T12:18:10.924 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-10-18T12:18:11.694 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-10-18T12:18:11.795 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-18T12:18:11.847 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-10-18T12:18:11.963 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-18T12:18:11.982 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-10-18T12:18:12.123 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-18T12:18:12.159 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-10-18T12:18:12.309 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2023-10-18T12:18:12.435 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2023-10-18T12:18:12.561 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-10-18T12:18:12.608 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-18T12:18:12.687 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-10-18T12:18:12.830 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-10-18T12:18:13.140 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-10-18T12:18:13.141 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-10-18T12:18:14.167 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-10-18T12:18:14.284 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-10-18T12:18:14.418 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-10-18T12:18:14.586 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-10-18T12:18:15.140 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-10-18T12:18:25.970 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-10-18T12:18:26.137 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-10-18T12:18:27.365 INFO:teuthology.orchestra.run.smithi114.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-18T12:18:27.372 DEBUG:teuthology.parallel:result is None 2023-10-18T12:18:28.566 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-10-18T12:18:28.674 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-10-18T12:18:29.918 INFO:teuthology.orchestra.run.smithi172.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-10-18T12:18:29.924 DEBUG:teuthology.parallel:result is None 2023-10-18T12:18:29.924 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=6f3e6b48891b9b50415c0822b6b870797fcda16d 2023-10-18T12:18:30.148 DEBUG:teuthology.orchestra.run.smithi114:> dpkg-query -W -f '${Version}' ceph 2023-10-18T12:18:30.187 INFO:teuthology.orchestra.run.smithi114.stdout:18.0.0-5610-g6f3e6b48-1focal 2023-10-18T12:18:30.188 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5610-g6f3e6b48-1focal 2023-10-18T12:18:30.188 INFO:teuthology.task.install:The correct ceph version 18.0.0-5610-g6f3e6b48-1focal is installed. 2023-10-18T12:18:30.189 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=6f3e6b48891b9b50415c0822b6b870797fcda16d 2023-10-18T12:18:30.335 DEBUG:teuthology.orchestra.run.smithi172:> dpkg-query -W -f '${Version}' ceph 2023-10-18T12:18:30.373 INFO:teuthology.orchestra.run.smithi172.stdout:18.0.0-5610-g6f3e6b48-1focal 2023-10-18T12:18:30.373 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5610-g6f3e6b48-1focal 2023-10-18T12:18:30.374 INFO:teuthology.task.install:The correct ceph version 18.0.0-5610-g6f3e6b48-1focal is installed. 2023-10-18T12:18:30.374 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-18T12:18:30.375 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:18:30.375 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-18T12:18:30.414 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T12:18:30.414 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-18T12:18:30.452 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-18T12:18:30.452 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:18:30.453 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/daemon-helper 2023-10-18T12:18:30.493 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-18T12:18:30.567 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T12:18:30.568 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/daemon-helper 2023-10-18T12:18:30.602 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-18T12:18:30.680 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-18T12:18:30.681 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:18:30.682 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-18T12:18:30.717 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-18T12:18:30.791 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T12:18:30.792 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-18T12:18:30.827 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-18T12:18:30.904 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-18T12:18:30.905 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:18:30.905 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/stdin-killer 2023-10-18T12:18:30.946 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-18T12:18:31.023 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T12:18:31.023 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/stdin-killer 2023-10-18T12:18:31.063 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-18T12:18:31.138 INFO:teuthology.run_tasks:Running task ceph... 2023-10-18T12:18:31.216 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-18T12:18:31.218 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 777 /var/log/ceph 2023-10-18T12:18:31.226 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 777 /var/log/ceph 2023-10-18T12:18:31.266 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-18T12:18:31.267 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-18T12:18:31.305 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-18T12:18:31.340 INFO:tasks.ceph:Creating extra log directories... 2023-10-18T12:18:31.341 DEBUG:teuthology.orchestra.run.smithi114:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-18T12:18:31.381 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-18T12:18:31.429 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-18T12:18:31.429 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-18T12:18:31.429 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-18T12:18:31.430 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:18:31.430 DEBUG:teuthology.orchestra.run.smithi114:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-18T12:18:31.480 DEBUG:teuthology.orchestra.run.smithi114:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-18T12:18:31.618 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T12:18:31.619 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-18T12:18:31.639 DEBUG:teuthology.orchestra.run.smithi172:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-18T12:18:31.768 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-18T12:18:31.769 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'but it is still running', 'slow request', 'MDS_CLIENT_LATE_RELEASE', 't responding to mclientcaps', 'file system flag refuse_client_session is set', 'Degraded data redundancy', 'MDS_CLIENTS_LAGGY', 'Reduced data availability'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-18T12:18:31.769 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/dparmar-2023-10-18_11:50:16-fs:functional-wip-63105-distro-default-smithi/7431514', 'branch': 'wip-63105', 'description': 'fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-recovery}', 'email': None, 'first_in_suite': False, 'job_id': '7431514', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'dparmar-2023-10-18_11:50:16-fs:functional-wip-63105-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-63105'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'but it is still running', 'slow request', 'MDS_CLIENT_LATE_RELEASE', 't responding to mclientcaps', 'file system flag refuse_client_session is set', 'Degraded data redundancy', 'MDS_CLIENTS_LAGGY', 'Reduced data availability'], 'sha1': '6f3e6b48891b9b50415c0822b6b870797fcda16d'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '6f3e6b48891b9b50415c0822b6b870797fcda16d'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-63105', 'sha1': 'cbffa2410012c3070b383ae678737c8b7a571026'}}, 'owner': 'scheduled_dparmar@teuthology', 'priority': 55, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 2633, 'sha1': '6f3e6b48891b9b50415c0822b6b870797fcda16d', 'sleep_before_teardown': 0, 'suite': 'fs:functional', 'suite_branch': 'wip-63105', 'suite_path': '/home/teuthworker/src/github.com_dparmar18_ceph_cbffa2410012c3070b383ae678737c8b7a571026/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/dparmar18/ceph', 'suite_sha1': 'cbffa2410012c3070b383ae678737c8b7a571026', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi114.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi172.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '6f3e6b48891b9b50415c0822b6b870797fcda16d'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_client_recovery']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '202b180cb047e798fb131047314a862593f45403', 'timestamp': '2023-10-18_11:50:16', 'tube': 'smithi', 'user': 'dparmar', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-18T12:18:31.770 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-18T12:18:31.777 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-18T12:18:31.798 DEBUG:teuthology.orchestra.run.smithi114:> sudo install -d -m0777 -- /var/run/ceph 2023-10-18T12:18:31.841 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m0777 -- /var/run/ceph 2023-10-18T12:18:31.878 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:18:31.878 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/scratch_devs of=/dev/stdout 2023-10-18T12:18:31.934 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-18T12:18:31.934 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_1 2023-10-18T12:18:31.993 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-18T12:18:31.994 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T12:18:31.994 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 5h/5d Inode: 497 Links: 1 2023-10-18T12:18:31.994 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T12:18:31.995 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2023-10-18 12:12:44.868681308 +0000 2023-10-18T12:18:31.995 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2023-10-18 12:12:44.400692267 +0000 2023-10-18T12:18:31.995 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2023-10-18 12:12:44.400692267 +0000 2023-10-18T12:18:31.995 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: - 2023-10-18T12:18:31.995 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-18T12:18:32.068 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2023-10-18T12:18:32.069 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2023-10-18T12:18:32.069 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000598339 s, 856 kB/s 2023-10-18T12:18:32.071 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-18T12:18:32.137 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_2 2023-10-18T12:18:32.199 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-18T12:18:32.200 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T12:18:32.200 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 5h/5d Inode: 505 Links: 1 2023-10-18T12:18:32.200 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T12:18:32.201 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2023-10-18 12:12:45.604664073 +0000 2023-10-18T12:18:32.201 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2023-10-18 12:12:45.160674470 +0000 2023-10-18T12:18:32.201 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2023-10-18 12:12:45.160674470 +0000 2023-10-18T12:18:32.201 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: - 2023-10-18T12:18:32.202 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-18T12:18:32.279 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2023-10-18T12:18:32.280 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2023-10-18T12:18:32.280 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000560911 s, 913 kB/s 2023-10-18T12:18:32.282 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-18T12:18:32.350 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_3 2023-10-18T12:18:32.416 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-18T12:18:32.416 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T12:18:32.416 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 5h/5d Inode: 510 Links: 1 2023-10-18T12:18:32.417 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T12:18:32.417 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2023-10-18 12:12:46.360646371 +0000 2023-10-18T12:18:32.417 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2023-10-18 12:12:45.884657517 +0000 2023-10-18T12:18:32.417 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2023-10-18 12:12:45.884657517 +0000 2023-10-18T12:18:32.417 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: - 2023-10-18T12:18:32.418 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-18T12:18:32.494 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2023-10-18T12:18:32.494 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2023-10-18T12:18:32.494 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000712815 s, 718 kB/s 2023-10-18T12:18:32.496 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-18T12:18:32.563 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_4 2023-10-18T12:18:32.624 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-18T12:18:32.624 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T12:18:32.624 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 5h/5d Inode: 515 Links: 1 2023-10-18T12:18:32.624 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T12:18:32.625 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2023-10-18 12:12:47.132628295 +0000 2023-10-18T12:18:32.625 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2023-10-18 12:12:46.652639534 +0000 2023-10-18T12:18:32.625 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2023-10-18 12:12:46.652639534 +0000 2023-10-18T12:18:32.625 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: - 2023-10-18T12:18:32.626 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-18T12:18:32.697 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2023-10-18T12:18:32.698 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2023-10-18T12:18:32.698 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.00066551 s, 769 kB/s 2023-10-18T12:18:32.699 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-18T12:18:32.765 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-18T12:18:32.766 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T12:18:32.766 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/scratch_devs of=/dev/stdout 2023-10-18T12:18:32.784 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-18T12:18:32.784 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_1 2023-10-18T12:18:32.849 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-18T12:18:32.850 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T12:18:32.850 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 494 Links: 1 2023-10-18T12:18:32.850 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T12:18:32.851 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2023-10-18 12:12:44.831221673 +0000 2023-10-18T12:18:32.851 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2023-10-18 12:12:44.359232558 +0000 2023-10-18T12:18:32.851 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2023-10-18 12:12:44.359232558 +0000 2023-10-18T12:18:32.851 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: - 2023-10-18T12:18:32.852 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-18T12:18:32.925 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2023-10-18T12:18:32.925 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2023-10-18T12:18:32.926 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000670542 s, 764 kB/s 2023-10-18T12:18:32.927 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-18T12:18:32.991 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_2 2023-10-18T12:18:33.055 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-18T12:18:33.056 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T12:18:33.056 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 499 Links: 1 2023-10-18T12:18:33.056 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T12:18:33.056 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2023-10-18 12:12:45.623203409 +0000 2023-10-18T12:18:33.057 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2023-10-18 12:12:45.131214756 +0000 2023-10-18T12:18:33.057 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2023-10-18 12:12:45.131214756 +0000 2023-10-18T12:18:33.057 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: - 2023-10-18T12:18:33.058 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-18T12:18:33.135 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2023-10-18T12:18:33.135 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2023-10-18T12:18:33.135 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.00071978 s, 711 kB/s 2023-10-18T12:18:33.137 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-18T12:18:33.203 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_3 2023-10-18T12:18:33.266 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-18T12:18:33.266 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T12:18:33.267 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 505 Links: 1 2023-10-18T12:18:33.267 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T12:18:33.267 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2023-10-18 12:12:46.399185514 +0000 2023-10-18T12:18:33.267 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2023-10-18 12:12:45.931196306 +0000 2023-10-18T12:18:33.267 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2023-10-18 12:12:45.931196306 +0000 2023-10-18T12:18:33.268 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: - 2023-10-18T12:18:33.268 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-18T12:18:33.342 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2023-10-18T12:18:33.342 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2023-10-18T12:18:33.342 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000523034 s, 979 kB/s 2023-10-18T12:18:33.345 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-18T12:18:33.411 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_4 2023-10-18T12:18:33.469 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-18T12:18:33.470 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-18T12:18:33.470 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 512 Links: 1 2023-10-18T12:18:33.470 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-18T12:18:33.470 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2023-10-18 12:12:47.171167711 +0000 2023-10-18T12:18:33.471 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2023-10-18 12:12:46.687178871 +0000 2023-10-18T12:18:33.471 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2023-10-18 12:12:46.687178871 +0000 2023-10-18T12:18:33.471 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: - 2023-10-18T12:18:33.471 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-18T12:18:33.544 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2023-10-18T12:18:33.545 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2023-10-18T12:18:33.545 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000687428 s, 745 kB/s 2023-10-18T12:18:33.547 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-18T12:18:33.615 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-18T12:18:33.616 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi114.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi172.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-18T12:18:33.616 INFO:tasks.ceph:Generating config... 2023-10-18T12:18:33.617 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-18T12:18:33.618 INFO:tasks.ceph:[client] debug client = 20 2023-10-18T12:18:33.618 INFO:tasks.ceph:[client] debug ms = 1 2023-10-18T12:18:33.618 INFO:tasks.ceph:[client] pid file = 2023-10-18T12:18:33.618 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-18T12:18:33.619 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-18T12:18:33.619 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-18T12:18:33.619 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-18T12:18:33.620 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-10-18T12:18:33.620 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-18T12:18:33.620 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-18T12:18:33.620 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-18T12:18:33.621 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-18T12:18:33.621 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-18T12:18:33.621 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-18T12:18:33.621 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-18T12:18:33.622 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-18T12:18:33.622 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-18T12:18:33.622 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-18T12:18:33.622 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-18T12:18:33.623 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-18T12:18:33.623 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-18T12:18:33.623 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-18T12:18:33.624 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-18T12:18:33.624 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-18T12:18:33.624 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-10-18T12:18:33.624 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-10-18T12:18:33.625 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-18T12:18:33.625 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-18T12:18:33.625 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-10-18T12:18:33.625 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-18T12:18:33.626 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-18T12:18:33.626 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-18T12:18:33.626 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-18T12:18:33.627 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-18T12:18:33.627 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-18T12:18:33.627 INFO:tasks.ceph:Setting up mon.a... 2023-10-18T12:18:33.628 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-18T12:18:33.697 INFO:teuthology.orchestra.run.smithi114.stdout:creating /etc/ceph/ceph.keyring 2023-10-18T12:18:33.713 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-18T12:18:33.787 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-18T12:18:33.820 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.114'), ('mon.b', '172.21.15.172'), ('mon.c', '[v2:172.21.15.172:3301,v1:172.21.15.172:6790]')] 2023-10-18T12:18:33.821 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.114,172.21.15.172,[v2:172.21.15.172:3301,v1:172.21.15.172:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-18T12:18:33.822 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:18:33.822 DEBUG:teuthology.orchestra.run.smithi114:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-18T12:18:33.883 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.114 --add b 172.21.15.172 --addv c '[v2:172.21.15.172:3301,v1:172.21.15.172:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-18T12:18:33.996 INFO:teuthology.orchestra.run.smithi114.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-18T12:18:33.996 INFO:teuthology.orchestra.run.smithi114.stdout:monmaptool: generated fsid 240ea340-5d3d-4f52-a4bc-af075aca3deb 2023-10-18T12:18:33.996 INFO:teuthology.orchestra.run.smithi114.stdout:setting min_mon_release = pacific 2023-10-18T12:18:33.996 INFO:teuthology.orchestra.run.smithi114.stdout:epoch 0 2023-10-18T12:18:33.997 INFO:teuthology.orchestra.run.smithi114.stdout:fsid 240ea340-5d3d-4f52-a4bc-af075aca3deb 2023-10-18T12:18:33.997 INFO:teuthology.orchestra.run.smithi114.stdout:last_changed 2023-10-18T12:18:33.995643+0000 2023-10-18T12:18:33.997 INFO:teuthology.orchestra.run.smithi114.stdout:created 2023-10-18T12:18:33.995643+0000 2023-10-18T12:18:33.997 INFO:teuthology.orchestra.run.smithi114.stdout:min_mon_release 16 (pacific) 2023-10-18T12:18:33.997 INFO:teuthology.orchestra.run.smithi114.stdout:election_strategy: 1 2023-10-18T12:18:33.998 INFO:teuthology.orchestra.run.smithi114.stdout:0: [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] mon.a 2023-10-18T12:18:33.998 INFO:teuthology.orchestra.run.smithi114.stdout:1: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2023-10-18T12:18:33.998 INFO:teuthology.orchestra.run.smithi114.stdout:2: [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] mon.c 2023-10-18T12:18:33.998 INFO:teuthology.orchestra.run.smithi114.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-18T12:18:33.999 DEBUG:teuthology.orchestra.run.smithi114:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-18T12:18:34.016 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 240ea340-5d3d-4f52-a4bc-af075aca3deb... 2023-10-18T12:18:34.018 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-18T12:18:34.068 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-18T12:18:34.131 INFO:teuthology.orchestra.run.smithi114.stdout:[global] 2023-10-18T12:18:34.132 INFO:teuthology.orchestra.run.smithi114.stdout: chdir = "" 2023-10-18T12:18:34.132 INFO:teuthology.orchestra.run.smithi114.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-18T12:18:34.132 INFO:teuthology.orchestra.run.smithi114.stdout: auth supported = cephx 2023-10-18T12:18:34.132 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:18:34.133 INFO:teuthology.orchestra.run.smithi114.stdout: filestore xattr use omap = true 2023-10-18T12:18:34.133 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:18:34.133 INFO:teuthology.orchestra.run.smithi114.stdout: mon clock drift allowed = 1.000 2023-10-18T12:18:34.133 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:18:34.133 INFO:teuthology.orchestra.run.smithi114.stdout: osd crush chooseleaf type = 0 2023-10-18T12:18:34.134 INFO:teuthology.orchestra.run.smithi114.stdout: auth debug = true 2023-10-18T12:18:34.134 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:18:34.134 INFO:teuthology.orchestra.run.smithi114.stdout: ms die on old message = true 2023-10-18T12:18:34.134 INFO:teuthology.orchestra.run.smithi114.stdout: ms die on bug = true 2023-10-18T12:18:34.134 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:18:34.135 INFO:teuthology.orchestra.run.smithi114.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-18T12:18:34.135 INFO:teuthology.orchestra.run.smithi114.stdout: mon pg warn max object skew = 0 2023-10-18T12:18:34.135 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:18:34.135 INFO:teuthology.orchestra.run.smithi114.stdout: # disable pg_autoscaler by default for new pools 2023-10-18T12:18:34.135 INFO:teuthology.orchestra.run.smithi114.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-18T12:18:34.136 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:18:34.136 INFO:teuthology.orchestra.run.smithi114.stdout: osd pool default size = 2 2023-10-18T12:18:34.136 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:18:34.136 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd allow primary affinity = true 2023-10-18T12:18:34.136 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd allow pg remap = true 2023-10-18T12:18:34.136 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on legacy crush tunables = false 2023-10-18T12:18:34.137 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on crush straw calc version zero = false 2023-10-18T12:18:34.137 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on no sortbitwise = false 2023-10-18T12:18:34.137 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on osd down out interval zero = false 2023-10-18T12:18:34.137 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on too few osds = false 2023-10-18T12:18:34.137 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-18T12:18:34.138 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-18T12:18:34.138 INFO:teuthology.orchestra.run.smithi114.stdout: mon_allow_pool_size_one = true 2023-10-18T12:18:34.138 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:18:34.138 INFO:teuthology.orchestra.run.smithi114.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-18T12:18:34.139 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:18:34.139 INFO:teuthology.orchestra.run.smithi114.stdout: osd default data pool replay window = 5 2023-10-18T12:18:34.139 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:18:34.139 INFO:teuthology.orchestra.run.smithi114.stdout: mon allow pool delete = true 2023-10-18T12:18:34.140 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:18:34.140 INFO:teuthology.orchestra.run.smithi114.stdout: mon cluster log file level = debug 2023-10-18T12:18:34.140 INFO:teuthology.orchestra.run.smithi114.stdout: debug asserts on shutdown = true 2023-10-18T12:18:34.140 INFO:teuthology.orchestra.run.smithi114.stdout: mon health detail to clog = false 2023-10-18T12:18:34.140 INFO:teuthology.orchestra.run.smithi114.stdout: mon host = "172.21.15.114,172.21.15.172,[v2:172.21.15.172:3301,v1:172.21.15.172:6790]" 2023-10-18T12:18:34.141 INFO:teuthology.orchestra.run.smithi114.stdout: ms die on skipped message = False 2023-10-18T12:18:34.141 INFO:teuthology.orchestra.run.smithi114.stdout: fsid = 240ea340-5d3d-4f52-a4bc-af075aca3deb 2023-10-18T12:18:34.141 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:18:34.141 INFO:teuthology.orchestra.run.smithi114.stdout:[osd] 2023-10-18T12:18:34.141 INFO:teuthology.orchestra.run.smithi114.stdout: osd journal size = 100 2023-10-18T12:18:34.142 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:18:34.142 INFO:teuthology.orchestra.run.smithi114.stdout: osd scrub load threshold = 5.0 2023-10-18T12:18:34.142 INFO:teuthology.orchestra.run.smithi114.stdout: osd scrub max interval = 600 2023-10-18T12:18:34.142 INFO:teuthology.orchestra.run.smithi114.stdout: osd mclock profile = high_recovery_ops 2023-10-18T12:18:34.142 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:18:34.143 INFO:teuthology.orchestra.run.smithi114.stdout: osd recover clone overlap = true 2023-10-18T12:18:34.143 INFO:teuthology.orchestra.run.smithi114.stdout: osd recovery max chunk = 1048576 2023-10-18T12:18:34.143 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:18:34.143 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug shutdown = true 2023-10-18T12:18:34.143 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug op order = true 2023-10-18T12:18:34.143 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug verify stray on activate = true 2023-10-18T12:18:34.144 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:18:34.144 INFO:teuthology.orchestra.run.smithi114.stdout: osd open classes on start = true 2023-10-18T12:18:34.144 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug pg log writeout = true 2023-10-18T12:18:34.144 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:18:34.144 INFO:teuthology.orchestra.run.smithi114.stdout: osd deep scrub update digest min age = 30 2023-10-18T12:18:34.145 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:18:34.145 INFO:teuthology.orchestra.run.smithi114.stdout: osd map max advance = 10 2023-10-18T12:18:34.145 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:18:34.145 INFO:teuthology.orchestra.run.smithi114.stdout: journal zero on create = true 2023-10-18T12:18:34.145 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:18:34.146 INFO:teuthology.orchestra.run.smithi114.stdout: filestore ondisk finisher threads = 3 2023-10-18T12:18:34.146 INFO:teuthology.orchestra.run.smithi114.stdout: filestore apply finisher threads = 3 2023-10-18T12:18:34.146 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:18:34.146 INFO:teuthology.orchestra.run.smithi114.stdout: bdev debug aio = true 2023-10-18T12:18:34.146 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug misdirected ops = true 2023-10-18T12:18:34.146 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore block size = 96636764160 2023-10-18T12:18:34.147 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore fsck on mount = True 2023-10-18T12:18:34.147 INFO:teuthology.orchestra.run.smithi114.stdout: debug bluefs = 20 2023-10-18T12:18:34.147 INFO:teuthology.orchestra.run.smithi114.stdout: debug bluestore = 20 2023-10-18T12:18:34.147 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2023-10-18T12:18:34.147 INFO:teuthology.orchestra.run.smithi114.stdout: debug osd = 20 2023-10-18T12:18:34.148 INFO:teuthology.orchestra.run.smithi114.stdout: debug rocksdb = 10 2023-10-18T12:18:34.148 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd backfillfull_ratio = 0.85 2023-10-18T12:18:34.148 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd full ratio = 0.9 2023-10-18T12:18:34.148 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd nearfull ratio = 0.8 2023-10-18T12:18:34.148 INFO:teuthology.orchestra.run.smithi114.stdout: osd failsafe full ratio = 0.95 2023-10-18T12:18:34.149 INFO:teuthology.orchestra.run.smithi114.stdout: osd objectstore = bluestore 2023-10-18T12:18:34.149 INFO:teuthology.orchestra.run.smithi114.stdout: osd op complaint time = 180 2023-10-18T12:18:34.149 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:18:34.149 INFO:teuthology.orchestra.run.smithi114.stdout:[mgr] 2023-10-18T12:18:34.149 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2023-10-18T12:18:34.150 INFO:teuthology.orchestra.run.smithi114.stdout: debug mgr = 20 2023-10-18T12:18:34.150 INFO:teuthology.orchestra.run.smithi114.stdout: debug mon = 20 2023-10-18T12:18:34.150 INFO:teuthology.orchestra.run.smithi114.stdout: debug auth = 20 2023-10-18T12:18:34.150 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min pgs per osd = 4 2023-10-18T12:18:34.150 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min bytes per osd = 10 2023-10-18T12:18:34.151 INFO:teuthology.orchestra.run.smithi114.stdout: mgr/telemetry/nag = false 2023-10-18T12:18:34.151 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:18:34.151 INFO:teuthology.orchestra.run.smithi114.stdout:[mon] 2023-10-18T12:18:34.151 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2023-10-18T12:18:34.151 INFO:teuthology.orchestra.run.smithi114.stdout: debug mon = 20 2023-10-18T12:18:34.151 INFO:teuthology.orchestra.run.smithi114.stdout: debug paxos = 20 2023-10-18T12:18:34.152 INFO:teuthology.orchestra.run.smithi114.stdout: debug auth = 20 2023-10-18T12:18:34.152 INFO:teuthology.orchestra.run.smithi114.stdout: mon data avail warn = 5 2023-10-18T12:18:34.152 INFO:teuthology.orchestra.run.smithi114.stdout: mon mgr mkfs grace = 240 2023-10-18T12:18:34.152 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min pgs per osd = 4 2023-10-18T12:18:34.152 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd reporter subtree level = osd 2023-10-18T12:18:34.153 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd prime pg temp = true 2023-10-18T12:18:34.153 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min bytes per osd = 10 2023-10-18T12:18:34.153 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:18:34.153 INFO:teuthology.orchestra.run.smithi114.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-18T12:18:34.153 INFO:teuthology.orchestra.run.smithi114.stdout: auth mon ticket ttl = 660 # 11m 2023-10-18T12:18:34.153 INFO:teuthology.orchestra.run.smithi114.stdout: auth service ticket ttl = 240 # 4m 2023-10-18T12:18:34.154 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:18:34.154 INFO:teuthology.orchestra.run.smithi114.stdout: # don't complain about insecure global_id in the test suite 2023-10-18T12:18:34.154 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-18T12:18:34.154 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-18T12:18:34.154 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:18:34.155 INFO:teuthology.orchestra.run.smithi114.stdout: # 1m isn't quite enough 2023-10-18T12:18:34.155 INFO:teuthology.orchestra.run.smithi114.stdout: mon_down_mkfs_grace = 2m 2023-10-18T12:18:34.155 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:18:34.155 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_filestore_osds = false 2023-10-18T12:18:34.155 INFO:teuthology.orchestra.run.smithi114.stdout: mon op complaint time = 120 2023-10-18T12:18:34.156 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:18:34.156 INFO:teuthology.orchestra.run.smithi114.stdout:[client] 2023-10-18T12:18:34.156 INFO:teuthology.orchestra.run.smithi114.stdout: rgw cache enabled = true 2023-10-18T12:18:34.156 INFO:teuthology.orchestra.run.smithi114.stdout: rgw enable ops log = true 2023-10-18T12:18:34.156 INFO:teuthology.orchestra.run.smithi114.stdout: rgw enable usage log = true 2023-10-18T12:18:34.156 INFO:teuthology.orchestra.run.smithi114.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-18T12:18:34.157 INFO:teuthology.orchestra.run.smithi114.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-18T12:18:34.157 INFO:teuthology.orchestra.run.smithi114.stdout: client mount timeout = 600 2023-10-18T12:18:34.157 INFO:teuthology.orchestra.run.smithi114.stdout: debug client = 20 2023-10-18T12:18:34.157 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2023-10-18T12:18:34.157 INFO:teuthology.orchestra.run.smithi114.stdout: pid file = "" 2023-10-18T12:18:34.158 INFO:teuthology.orchestra.run.smithi114.stdout: rados mon op timeout = 900 2023-10-18T12:18:34.158 INFO:teuthology.orchestra.run.smithi114.stdout: rados osd op timeout = 900 2023-10-18T12:18:34.158 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.a] 2023-10-18T12:18:34.158 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.b] 2023-10-18T12:18:34.158 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.c] 2023-10-18T12:18:34.159 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.a] 2023-10-18T12:18:34.159 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.c] 2023-10-18T12:18:34.159 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.b] 2023-10-18T12:18:34.159 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.d] 2023-10-18T12:18:34.159 INFO:teuthology.orchestra.run.smithi114.stdout:[mds] 2023-10-18T12:18:34.159 INFO:teuthology.orchestra.run.smithi114.stdout: debug mds = 20 2023-10-18T12:18:34.160 INFO:teuthology.orchestra.run.smithi114.stdout: debug mds balancer = 20 2023-10-18T12:18:34.160 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2023-10-18T12:18:34.160 INFO:teuthology.orchestra.run.smithi114.stdout: mds debug frag = True 2023-10-18T12:18:34.160 INFO:teuthology.orchestra.run.smithi114.stdout: mds debug scatterstat = True 2023-10-18T12:18:34.160 INFO:teuthology.orchestra.run.smithi114.stdout: mds op complaint time = 180 2023-10-18T12:18:34.161 INFO:teuthology.orchestra.run.smithi114.stdout: mds verify scatter = True 2023-10-18T12:18:34.161 INFO:teuthology.orchestra.run.smithi114.stdout: osd op complaint time = 180 2023-10-18T12:18:34.161 INFO:teuthology.orchestra.run.smithi114.stdout: rados mon op timeout = 900 2023-10-18T12:18:34.161 INFO:teuthology.orchestra.run.smithi114.stdout: rados osd op timeout = 900 2023-10-18T12:18:34.162 INFO:teuthology.orchestra.run.smithi172.stdout:[global] 2023-10-18T12:18:34.162 INFO:teuthology.orchestra.run.smithi172.stdout: chdir = "" 2023-10-18T12:18:34.162 INFO:teuthology.orchestra.run.smithi172.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-18T12:18:34.163 INFO:teuthology.orchestra.run.smithi172.stdout: auth supported = cephx 2023-10-18T12:18:34.163 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T12:18:34.163 INFO:teuthology.orchestra.run.smithi172.stdout: filestore xattr use omap = true 2023-10-18T12:18:34.163 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T12:18:34.163 INFO:teuthology.orchestra.run.smithi172.stdout: mon clock drift allowed = 1.000 2023-10-18T12:18:34.164 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T12:18:34.164 INFO:teuthology.orchestra.run.smithi172.stdout: osd crush chooseleaf type = 0 2023-10-18T12:18:34.164 INFO:teuthology.orchestra.run.smithi172.stdout: auth debug = true 2023-10-18T12:18:34.164 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T12:18:34.164 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on old message = true 2023-10-18T12:18:34.165 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on bug = true 2023-10-18T12:18:34.165 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T12:18:34.165 INFO:teuthology.orchestra.run.smithi172.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-18T12:18:34.165 INFO:teuthology.orchestra.run.smithi172.stdout: mon pg warn max object skew = 0 2023-10-18T12:18:34.165 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T12:18:34.166 INFO:teuthology.orchestra.run.smithi172.stdout: # disable pg_autoscaler by default for new pools 2023-10-18T12:18:34.166 INFO:teuthology.orchestra.run.smithi172.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-18T12:18:34.166 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T12:18:34.166 INFO:teuthology.orchestra.run.smithi172.stdout: osd pool default size = 2 2023-10-18T12:18:34.166 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T12:18:34.167 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd allow primary affinity = true 2023-10-18T12:18:34.167 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd allow pg remap = true 2023-10-18T12:18:34.167 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on legacy crush tunables = false 2023-10-18T12:18:34.167 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on crush straw calc version zero = false 2023-10-18T12:18:34.167 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on no sortbitwise = false 2023-10-18T12:18:34.167 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on osd down out interval zero = false 2023-10-18T12:18:34.168 INFO:teuthology.orchestra.run.smithi172.stdout: mon warn on too few osds = false 2023-10-18T12:18:34.168 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-18T12:18:34.168 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-18T12:18:34.168 INFO:teuthology.orchestra.run.smithi172.stdout: mon_allow_pool_size_one = true 2023-10-18T12:18:34.168 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T12:18:34.169 INFO:teuthology.orchestra.run.smithi172.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-18T12:18:34.169 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T12:18:34.169 INFO:teuthology.orchestra.run.smithi172.stdout: osd default data pool replay window = 5 2023-10-18T12:18:34.169 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T12:18:34.169 INFO:teuthology.orchestra.run.smithi172.stdout: mon allow pool delete = true 2023-10-18T12:18:34.170 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T12:18:34.170 INFO:teuthology.orchestra.run.smithi172.stdout: mon cluster log file level = debug 2023-10-18T12:18:34.170 INFO:teuthology.orchestra.run.smithi172.stdout: debug asserts on shutdown = true 2023-10-18T12:18:34.170 INFO:teuthology.orchestra.run.smithi172.stdout: mon health detail to clog = false 2023-10-18T12:18:34.170 INFO:teuthology.orchestra.run.smithi172.stdout: mon host = "172.21.15.114,172.21.15.172,[v2:172.21.15.172:3301,v1:172.21.15.172:6790]" 2023-10-18T12:18:34.171 INFO:teuthology.orchestra.run.smithi172.stdout: ms die on skipped message = False 2023-10-18T12:18:34.171 INFO:teuthology.orchestra.run.smithi172.stdout: fsid = 240ea340-5d3d-4f52-a4bc-af075aca3deb 2023-10-18T12:18:34.171 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T12:18:34.171 INFO:teuthology.orchestra.run.smithi172.stdout:[osd] 2023-10-18T12:18:34.171 INFO:teuthology.orchestra.run.smithi172.stdout: osd journal size = 100 2023-10-18T12:18:34.172 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T12:18:34.172 INFO:teuthology.orchestra.run.smithi172.stdout: osd scrub load threshold = 5.0 2023-10-18T12:18:34.172 INFO:teuthology.orchestra.run.smithi172.stdout: osd scrub max interval = 600 2023-10-18T12:18:34.172 INFO:teuthology.orchestra.run.smithi172.stdout: osd mclock profile = high_recovery_ops 2023-10-18T12:18:34.172 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T12:18:34.173 INFO:teuthology.orchestra.run.smithi172.stdout: osd recover clone overlap = true 2023-10-18T12:18:34.173 INFO:teuthology.orchestra.run.smithi172.stdout: osd recovery max chunk = 1048576 2023-10-18T12:18:34.173 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T12:18:34.173 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug shutdown = true 2023-10-18T12:18:34.173 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug op order = true 2023-10-18T12:18:34.174 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug verify stray on activate = true 2023-10-18T12:18:34.174 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T12:18:34.174 INFO:teuthology.orchestra.run.smithi172.stdout: osd open classes on start = true 2023-10-18T12:18:34.174 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug pg log writeout = true 2023-10-18T12:18:34.174 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T12:18:34.174 INFO:teuthology.orchestra.run.smithi172.stdout: osd deep scrub update digest min age = 30 2023-10-18T12:18:34.175 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T12:18:34.175 INFO:teuthology.orchestra.run.smithi172.stdout: osd map max advance = 10 2023-10-18T12:18:34.175 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T12:18:34.175 INFO:teuthology.orchestra.run.smithi172.stdout: journal zero on create = true 2023-10-18T12:18:34.175 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T12:18:34.176 INFO:teuthology.orchestra.run.smithi172.stdout: filestore ondisk finisher threads = 3 2023-10-18T12:18:34.176 INFO:teuthology.orchestra.run.smithi172.stdout: filestore apply finisher threads = 3 2023-10-18T12:18:34.176 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T12:18:34.176 INFO:teuthology.orchestra.run.smithi172.stdout: bdev debug aio = true 2023-10-18T12:18:34.176 INFO:teuthology.orchestra.run.smithi172.stdout: osd debug misdirected ops = true 2023-10-18T12:18:34.177 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore block size = 96636764160 2023-10-18T12:18:34.177 INFO:teuthology.orchestra.run.smithi172.stdout: bluestore fsck on mount = True 2023-10-18T12:18:34.177 INFO:teuthology.orchestra.run.smithi172.stdout: debug bluefs = 20 2023-10-18T12:18:34.177 INFO:teuthology.orchestra.run.smithi172.stdout: debug bluestore = 20 2023-10-18T12:18:34.177 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2023-10-18T12:18:34.178 INFO:teuthology.orchestra.run.smithi172.stdout: debug osd = 20 2023-10-18T12:18:34.178 INFO:teuthology.orchestra.run.smithi172.stdout: debug rocksdb = 10 2023-10-18T12:18:34.178 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd backfillfull_ratio = 0.85 2023-10-18T12:18:34.178 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd full ratio = 0.9 2023-10-18T12:18:34.178 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd nearfull ratio = 0.8 2023-10-18T12:18:34.179 INFO:teuthology.orchestra.run.smithi172.stdout: osd failsafe full ratio = 0.95 2023-10-18T12:18:34.179 INFO:teuthology.orchestra.run.smithi172.stdout: osd objectstore = bluestore 2023-10-18T12:18:34.179 INFO:teuthology.orchestra.run.smithi172.stdout: osd op complaint time = 180 2023-10-18T12:18:34.179 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T12:18:34.179 INFO:teuthology.orchestra.run.smithi172.stdout:[mgr] 2023-10-18T12:18:34.179 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2023-10-18T12:18:34.180 INFO:teuthology.orchestra.run.smithi172.stdout: debug mgr = 20 2023-10-18T12:18:34.180 INFO:teuthology.orchestra.run.smithi172.stdout: debug mon = 20 2023-10-18T12:18:34.180 INFO:teuthology.orchestra.run.smithi172.stdout: debug auth = 20 2023-10-18T12:18:34.180 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min pgs per osd = 4 2023-10-18T12:18:34.181 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min bytes per osd = 10 2023-10-18T12:18:34.181 INFO:teuthology.orchestra.run.smithi172.stdout: mgr/telemetry/nag = false 2023-10-18T12:18:34.181 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T12:18:34.181 INFO:teuthology.orchestra.run.smithi172.stdout:[mon] 2023-10-18T12:18:34.181 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2023-10-18T12:18:34.181 INFO:teuthology.orchestra.run.smithi172.stdout: debug mon = 20 2023-10-18T12:18:34.182 INFO:teuthology.orchestra.run.smithi172.stdout: debug paxos = 20 2023-10-18T12:18:34.182 INFO:teuthology.orchestra.run.smithi172.stdout: debug auth = 20 2023-10-18T12:18:34.182 INFO:teuthology.orchestra.run.smithi172.stdout: mon data avail warn = 5 2023-10-18T12:18:34.182 INFO:teuthology.orchestra.run.smithi172.stdout: mon mgr mkfs grace = 240 2023-10-18T12:18:34.182 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min pgs per osd = 4 2023-10-18T12:18:34.183 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd reporter subtree level = osd 2023-10-18T12:18:34.183 INFO:teuthology.orchestra.run.smithi172.stdout: mon osd prime pg temp = true 2023-10-18T12:18:34.183 INFO:teuthology.orchestra.run.smithi172.stdout: mon reweight min bytes per osd = 10 2023-10-18T12:18:34.183 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T12:18:34.183 INFO:teuthology.orchestra.run.smithi172.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-18T12:18:34.184 INFO:teuthology.orchestra.run.smithi172.stdout: auth mon ticket ttl = 660 # 11m 2023-10-18T12:18:34.184 INFO:teuthology.orchestra.run.smithi172.stdout: auth service ticket ttl = 240 # 4m 2023-10-18T12:18:34.184 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T12:18:34.184 INFO:teuthology.orchestra.run.smithi172.stdout: # don't complain about insecure global_id in the test suite 2023-10-18T12:18:34.184 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-18T12:18:34.184 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-18T12:18:34.185 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T12:18:34.185 INFO:teuthology.orchestra.run.smithi172.stdout: # 1m isn't quite enough 2023-10-18T12:18:34.185 INFO:teuthology.orchestra.run.smithi172.stdout: mon_down_mkfs_grace = 2m 2023-10-18T12:18:34.185 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T12:18:34.185 INFO:teuthology.orchestra.run.smithi172.stdout: mon_warn_on_filestore_osds = false 2023-10-18T12:18:34.185 INFO:teuthology.orchestra.run.smithi172.stdout: mon op complaint time = 120 2023-10-18T12:18:34.186 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-10-18T12:18:34.186 INFO:teuthology.orchestra.run.smithi172.stdout:[client] 2023-10-18T12:18:34.186 INFO:teuthology.orchestra.run.smithi172.stdout: rgw cache enabled = true 2023-10-18T12:18:34.186 INFO:teuthology.orchestra.run.smithi172.stdout: rgw enable ops log = true 2023-10-18T12:18:34.186 INFO:teuthology.orchestra.run.smithi172.stdout: rgw enable usage log = true 2023-10-18T12:18:34.187 INFO:teuthology.orchestra.run.smithi172.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-18T12:18:34.187 INFO:teuthology.orchestra.run.smithi172.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-18T12:18:34.187 INFO:teuthology.orchestra.run.smithi172.stdout: client mount timeout = 600 2023-10-18T12:18:34.187 INFO:teuthology.orchestra.run.smithi172.stdout: debug client = 20 2023-10-18T12:18:34.187 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2023-10-18T12:18:34.188 INFO:teuthology.orchestra.run.smithi172.stdout: pid file = "" 2023-10-18T12:18:34.188 INFO:teuthology.orchestra.run.smithi172.stdout: rados mon op timeout = 900 2023-10-18T12:18:34.188 INFO:teuthology.orchestra.run.smithi172.stdout: rados osd op timeout = 900 2023-10-18T12:18:34.188 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.a] 2023-10-18T12:18:34.188 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.b] 2023-10-18T12:18:34.188 INFO:teuthology.orchestra.run.smithi172.stdout:[mon.c] 2023-10-18T12:18:34.189 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.a] 2023-10-18T12:18:34.189 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.c] 2023-10-18T12:18:34.189 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.b] 2023-10-18T12:18:34.189 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.d] 2023-10-18T12:18:34.189 INFO:teuthology.orchestra.run.smithi172.stdout:[mds] 2023-10-18T12:18:34.189 INFO:teuthology.orchestra.run.smithi172.stdout: debug mds = 20 2023-10-18T12:18:34.190 INFO:teuthology.orchestra.run.smithi172.stdout: debug mds balancer = 20 2023-10-18T12:18:34.190 INFO:teuthology.orchestra.run.smithi172.stdout: debug ms = 1 2023-10-18T12:18:34.190 INFO:teuthology.orchestra.run.smithi172.stdout: mds debug frag = True 2023-10-18T12:18:34.190 INFO:teuthology.orchestra.run.smithi172.stdout: mds debug scatterstat = True 2023-10-18T12:18:34.190 INFO:teuthology.orchestra.run.smithi172.stdout: mds op complaint time = 180 2023-10-18T12:18:34.191 INFO:teuthology.orchestra.run.smithi172.stdout: mds verify scatter = True 2023-10-18T12:18:34.191 INFO:teuthology.orchestra.run.smithi172.stdout: osd op complaint time = 180 2023-10-18T12:18:34.191 INFO:teuthology.orchestra.run.smithi172.stdout: rados mon op timeout = 900 2023-10-18T12:18:34.191 INFO:teuthology.orchestra.run.smithi172.stdout: rados osd op timeout = 900 2023-10-18T12:18:34.193 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-18T12:18:34.193 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-18T12:18:34.325 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-18T12:18:34.325 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:18:34.326 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-18T12:18:34.342 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:18:34.343 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-18T12:18:34.407 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi114.front.sepia.ceph.com 2023-10-18T12:18:34.407 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:18:34.408 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-18T12:18:34.408 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-18T12:18:34.518 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:18:34.519 DEBUG:teuthology.orchestra.run.smithi114:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-18T12:18:34.579 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi172.front.sepia.ceph.com 2023-10-18T12:18:34.579 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T12:18:34.580 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-18T12:18:34.580 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-18T12:18:34.640 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T12:18:34.641 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-18T12:18:34.702 INFO:tasks.ceph:Setting up mon nodes... 2023-10-18T12:18:34.702 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-18T12:18:34.703 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-18T12:18:34.805 INFO:teuthology.orchestra.run.smithi114.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-18T12:18:34.814 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-18T12:18:34.915 INFO:teuthology.orchestra.run.smithi172.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-18T12:18:34.942 INFO:tasks.ceph:Setting up mds nodes... 2023-10-18T12:18:34.942 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-18T12:18:35.045 INFO:teuthology.orchestra.run.smithi114.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-18T12:18:35.052 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-18T12:18:35.087 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-18T12:18:35.229 INFO:teuthology.orchestra.run.smithi114.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-18T12:18:35.237 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-18T12:18:35.272 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-18T12:18:35.373 INFO:teuthology.orchestra.run.smithi172.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-18T12:18:35.380 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-18T12:18:35.415 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-18T12:18:35.558 INFO:teuthology.orchestra.run.smithi172.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-18T12:18:35.565 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-18T12:18:35.603 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-18T12:18:35.604 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-18T12:18:35.682 INFO:teuthology.orchestra.run.smithi114.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-18T12:18:35.712 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-18T12:18:35.785 INFO:teuthology.orchestra.run.smithi114.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-18T12:18:35.814 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-18T12:18:35.892 INFO:teuthology.orchestra.run.smithi172.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-18T12:18:35.918 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-18T12:18:35.996 INFO:teuthology.orchestra.run.smithi172.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-18T12:18:36.027 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-18T12:18:36.028 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi114.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi172.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-18T12:18:36.028 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-18T12:18:36.064 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-18T12:18:36.064 INFO:tasks.ceph:role: osd.0 2023-10-18T12:18:36.065 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi114.front.sepia.ceph.com 2023-10-18T12:18:36.065 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-18T12:18:36.648 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-18T12:18:36.648 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-18T12:18:36.648 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-18T12:18:36.649 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 2023-10-18T12:18:36.649 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-18T12:18:36.649 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2023-10-18T12:18:36.649 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-18T12:18:36.649 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-18T12:18:36.650 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-18T12:18:36.650 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-18T12:18:36.651 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2023-10-18T12:18:36.651 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-18T12:18:36.792 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-18T12:18:36.813 INFO:teuthology.orchestra.run.smithi114.stderr:sudo: /sbin/restorecon: command not found 2023-10-18T12:18:36.814 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T12:18:36.815 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-18T12:18:36.895 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-18T12:18:36.895 INFO:tasks.ceph:role: osd.1 2023-10-18T12:18:36.896 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi114.front.sepia.ceph.com 2023-10-18T12:18:36.896 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-18T12:18:37.415 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-18T12:18:37.416 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-18T12:18:37.416 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-18T12:18:37.416 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 2023-10-18T12:18:37.416 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-18T12:18:37.416 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2023-10-18T12:18:37.417 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-18T12:18:37.417 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-18T12:18:37.417 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-18T12:18:37.417 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-18T12:18:37.420 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2023-10-18T12:18:37.420 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-18T12:18:37.503 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-18T12:18:37.527 INFO:teuthology.orchestra.run.smithi114.stderr:sudo: /sbin/restorecon: command not found 2023-10-18T12:18:37.528 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T12:18:37.529 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-18T12:18:37.608 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-18T12:18:37.608 INFO:tasks.ceph:role: osd.2 2023-10-18T12:18:37.609 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi114.front.sepia.ceph.com 2023-10-18T12:18:37.609 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-18T12:18:38.189 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-18T12:18:38.189 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-18T12:18:38.189 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-18T12:18:38.189 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 2023-10-18T12:18:38.190 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-18T12:18:38.190 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2023-10-18T12:18:38.190 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-18T12:18:38.190 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-18T12:18:38.191 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-18T12:18:38.191 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-18T12:18:38.194 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2023-10-18T12:18:38.194 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-18T12:18:38.337 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-18T12:18:38.356 INFO:teuthology.orchestra.run.smithi114.stderr:sudo: /sbin/restorecon: command not found 2023-10-18T12:18:38.357 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T12:18:38.358 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-18T12:18:38.443 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-18T12:18:38.443 INFO:tasks.ceph:role: osd.3 2023-10-18T12:18:38.443 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi114.front.sepia.ceph.com 2023-10-18T12:18:38.444 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-18T12:18:39.018 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-18T12:18:39.018 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-18T12:18:39.018 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-18T12:18:39.018 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 2023-10-18T12:18:39.019 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-18T12:18:39.019 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2023-10-18T12:18:39.019 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-18T12:18:39.019 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-18T12:18:39.019 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-18T12:18:39.020 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-18T12:18:39.023 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2023-10-18T12:18:39.023 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-18T12:18:39.155 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-18T12:18:39.174 INFO:teuthology.orchestra.run.smithi114.stderr:sudo: /sbin/restorecon: command not found 2023-10-18T12:18:39.174 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T12:18:39.175 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-18T12:18:39.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:18:39.333+0000 7f6af130f700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-18T12:18:39.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:18:39.333+0000 7f6af130f700 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-18T12:18:39.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:18:39.333+0000 7f6af130f700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-18T12:18:39.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:18:39.333+0000 7f6af130f700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-18T12:18:39.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:18:39.333+0000 7f6af130f700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-18T12:18:39.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:18:39.337+0000 7f6af130f700 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-18T12:18:42.424 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-18T12:18:42.459 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-18T12:18:42.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:18:42.585+0000 7f1c29f4f700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-18T12:18:42.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:18:42.589+0000 7f1c29f4f700 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-18T12:18:42.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:18:42.589+0000 7f1c29f4f700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-18T12:18:42.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:18:42.589+0000 7f1c29f4f700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-18T12:18:42.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:18:42.589+0000 7f1c29f4f700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-18T12:18:42.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:18:42.589+0000 7f1c29f4f700 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-18T12:18:45.645 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-18T12:18:45.681 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-18T12:18:45.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:18:45.812+0000 7f429172e700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-18T12:18:45.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:18:45.816+0000 7f429172e700 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-18T12:18:45.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:18:45.816+0000 7f429172e700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-18T12:18:45.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:18:45.816+0000 7f429172e700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-18T12:18:45.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:18:45.816+0000 7f429172e700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-18T12:18:45.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:18:45.816+0000 7f429172e700 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-18T12:18:48.905 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-18T12:18:48.943 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-18T12:18:49.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:18:49.064+0000 7fa53e0bd700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-18T12:18:49.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:18:49.064+0000 7fa53e0bd700 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-18T12:18:49.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:18:49.064+0000 7fa53e0bd700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-18T12:18:49.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:18:49.064+0000 7fa53e0bd700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-18T12:18:49.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:18:49.064+0000 7fa53e0bd700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-18T12:18:49.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:18:49.068+0000 7fa53e0bd700 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-18T12:18:52.140 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-18T12:18:52.173 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-18T12:18:52.213 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-18T12:18:52.213 INFO:tasks.ceph:role: osd.4 2023-10-18T12:18:52.213 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi172.front.sepia.ceph.com 2023-10-18T12:18:52.214 DEBUG:teuthology.orchestra.run.smithi172:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-18T12:18:52.820 INFO:teuthology.orchestra.run.smithi172.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-18T12:18:52.821 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-18T12:18:52.821 INFO:teuthology.orchestra.run.smithi172.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-18T12:18:52.821 INFO:teuthology.orchestra.run.smithi172.stdout: = reflink=1 2023-10-18T12:18:52.821 INFO:teuthology.orchestra.run.smithi172.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-18T12:18:52.821 INFO:teuthology.orchestra.run.smithi172.stdout: = sunit=0 swidth=0 blks 2023-10-18T12:18:52.822 INFO:teuthology.orchestra.run.smithi172.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-18T12:18:52.822 INFO:teuthology.orchestra.run.smithi172.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-18T12:18:52.822 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-18T12:18:52.822 INFO:teuthology.orchestra.run.smithi172.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-18T12:18:52.825 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi172.front.sepia.ceph.com -o noatime 2023-10-18T12:18:52.825 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-18T12:18:52.956 DEBUG:teuthology.orchestra.run.smithi172:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-18T12:18:52.976 INFO:teuthology.orchestra.run.smithi172.stderr:sudo: /sbin/restorecon: command not found 2023-10-18T12:18:52.977 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T12:18:52.978 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-18T12:18:53.055 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-18T12:18:53.055 INFO:tasks.ceph:role: osd.5 2023-10-18T12:18:53.056 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi172.front.sepia.ceph.com 2023-10-18T12:18:53.056 DEBUG:teuthology.orchestra.run.smithi172:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-18T12:18:53.579 INFO:teuthology.orchestra.run.smithi172.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-18T12:18:53.579 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-18T12:18:53.579 INFO:teuthology.orchestra.run.smithi172.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-18T12:18:53.580 INFO:teuthology.orchestra.run.smithi172.stdout: = reflink=1 2023-10-18T12:18:53.580 INFO:teuthology.orchestra.run.smithi172.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-18T12:18:53.580 INFO:teuthology.orchestra.run.smithi172.stdout: = sunit=0 swidth=0 blks 2023-10-18T12:18:53.580 INFO:teuthology.orchestra.run.smithi172.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-18T12:18:53.580 INFO:teuthology.orchestra.run.smithi172.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-18T12:18:53.581 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-18T12:18:53.581 INFO:teuthology.orchestra.run.smithi172.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-18T12:18:53.584 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi172.front.sepia.ceph.com -o noatime 2023-10-18T12:18:53.584 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-18T12:18:53.656 DEBUG:teuthology.orchestra.run.smithi172:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-18T12:18:53.675 INFO:teuthology.orchestra.run.smithi172.stderr:sudo: /sbin/restorecon: command not found 2023-10-18T12:18:53.676 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T12:18:53.677 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-18T12:18:53.756 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-18T12:18:53.757 INFO:tasks.ceph:role: osd.6 2023-10-18T12:18:53.757 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi172.front.sepia.ceph.com 2023-10-18T12:18:53.757 DEBUG:teuthology.orchestra.run.smithi172:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-18T12:18:54.329 INFO:teuthology.orchestra.run.smithi172.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-18T12:18:54.330 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-18T12:18:54.330 INFO:teuthology.orchestra.run.smithi172.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-18T12:18:54.330 INFO:teuthology.orchestra.run.smithi172.stdout: = reflink=1 2023-10-18T12:18:54.330 INFO:teuthology.orchestra.run.smithi172.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-18T12:18:54.331 INFO:teuthology.orchestra.run.smithi172.stdout: = sunit=0 swidth=0 blks 2023-10-18T12:18:54.331 INFO:teuthology.orchestra.run.smithi172.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-18T12:18:54.331 INFO:teuthology.orchestra.run.smithi172.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-18T12:18:54.331 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-18T12:18:54.331 INFO:teuthology.orchestra.run.smithi172.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-18T12:18:54.334 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi172.front.sepia.ceph.com -o noatime 2023-10-18T12:18:54.334 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-18T12:18:54.475 DEBUG:teuthology.orchestra.run.smithi172:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-18T12:18:54.499 INFO:teuthology.orchestra.run.smithi172.stderr:sudo: /sbin/restorecon: command not found 2023-10-18T12:18:54.499 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T12:18:54.500 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-18T12:18:54.580 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-18T12:18:54.580 INFO:tasks.ceph:role: osd.7 2023-10-18T12:18:54.580 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi172.front.sepia.ceph.com 2023-10-18T12:18:54.581 DEBUG:teuthology.orchestra.run.smithi172:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-18T12:18:55.135 INFO:teuthology.orchestra.run.smithi172.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-18T12:18:55.135 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-18T12:18:55.135 INFO:teuthology.orchestra.run.smithi172.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-18T12:18:55.136 INFO:teuthology.orchestra.run.smithi172.stdout: = reflink=1 2023-10-18T12:18:55.136 INFO:teuthology.orchestra.run.smithi172.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-18T12:18:55.136 INFO:teuthology.orchestra.run.smithi172.stdout: = sunit=0 swidth=0 blks 2023-10-18T12:18:55.136 INFO:teuthology.orchestra.run.smithi172.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-18T12:18:55.137 INFO:teuthology.orchestra.run.smithi172.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-18T12:18:55.137 INFO:teuthology.orchestra.run.smithi172.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-18T12:18:55.137 INFO:teuthology.orchestra.run.smithi172.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-18T12:18:55.139 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi172.front.sepia.ceph.com -o noatime 2023-10-18T12:18:55.141 DEBUG:teuthology.orchestra.run.smithi172:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-18T12:18:55.295 DEBUG:teuthology.orchestra.run.smithi172:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-18T12:18:55.318 INFO:teuthology.orchestra.run.smithi172.stderr:sudo: /sbin/restorecon: command not found 2023-10-18T12:18:55.318 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T12:18:55.320 DEBUG:teuthology.orchestra.run.smithi172:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-18T12:18:55.479 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:18:55.474+0000 7fb872bf8700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-18T12:18:55.481 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:18:55.478+0000 7fb872bf8700 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-18T12:18:55.482 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:18:55.478+0000 7fb872bf8700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-18T12:18:55.482 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:18:55.478+0000 7fb872bf8700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-18T12:18:55.482 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:18:55.478+0000 7fb872bf8700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-18T12:18:55.484 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:18:55.482+0000 7fb872bf8700 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-18T12:18:58.571 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-18T12:18:58.609 DEBUG:teuthology.orchestra.run.smithi172:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-18T12:18:58.750 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:18:58.746+0000 7fc9252b2700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-18T12:18:58.751 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:18:58.746+0000 7fc9252b2700 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-18T12:18:58.751 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:18:58.746+0000 7fc9252b2700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-18T12:18:58.752 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:18:58.746+0000 7fc9252b2700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-18T12:18:58.752 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:18:58.746+0000 7fc9252b2700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-18T12:18:58.754 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:18:58.750+0000 7fc9252b2700 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-18T12:19:01.772 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:19:01.780 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:19:01.832 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-18T12:19:01.872 DEBUG:teuthology.orchestra.run.smithi172:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-18T12:19:01.996 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:01.990+0000 7fd6529df700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-18T12:19:01.997 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:01.994+0000 7fd6529df700 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-18T12:19:01.997 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:01.994+0000 7fd6529df700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-18T12:19:01.998 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:01.994+0000 7fd6529df700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-18T12:19:01.998 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:01.994+0000 7fd6529df700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-18T12:19:01.999 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:01.994+0000 7fd6529df700 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-18T12:19:05.094 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-18T12:19:05.126 DEBUG:teuthology.orchestra.run.smithi172:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-18T12:19:05.257 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:05.253+0000 7feff2ea1700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-18T12:19:05.258 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:05.253+0000 7feff2ea1700 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-18T12:19:05.258 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:05.253+0000 7feff2ea1700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-18T12:19:05.259 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:05.253+0000 7feff2ea1700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-18T12:19:05.259 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:05.253+0000 7feff2ea1700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-18T12:19:05.261 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:05.257+0000 7feff2ea1700 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-18T12:19:08.343 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-18T12:19:08.377 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-18T12:19:08.378 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:19:08.378 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-18T12:19:08.417 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:19:08.417 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-18T12:19:08.494 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:19:08.495 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-18T12:19:08.576 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:19:08.576 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-18T12:19:08.655 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:19:08.656 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-18T12:19:08.731 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:19:08.731 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-18T12:19:08.809 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:19:08.809 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-18T12:19:08.882 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T12:19:08.883 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-18T12:19:08.920 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T12:19:08.920 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-18T12:19:09.002 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T12:19:09.002 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-18T12:19:09.081 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T12:19:09.081 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-18T12:19:09.157 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T12:19:09.157 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-18T12:19:09.234 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T12:19:09.234 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-18T12:19:09.314 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T12:19:09.315 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-18T12:19:09.389 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:19:09.389 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-18T12:19:09.406 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:19:09.406 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-18T12:19:09.468 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T12:19:09.469 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-18T12:19:09.487 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T12:19:09.487 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-18T12:19:09.547 INFO:tasks.ceph:Adding keys to all mons... 2023-10-18T12:19:09.548 DEBUG:teuthology.orchestra.run.smithi114:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-18T12:19:09.555 DEBUG:teuthology.orchestra.run.smithi172:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-18T12:19:09.599 INFO:teuthology.orchestra.run.smithi114.stdout:[mgr.y] 2023-10-18T12:19:09.600 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQAazS9lPYgEMBAAK3W1/+VlrciLsySV2Mwc3w== 2023-10-18T12:19:09.600 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.a] 2023-10-18T12:19:09.600 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQAbzS9lMbyvAhAATn1ZaKPr2Ob+mCfUpnZQUA== 2023-10-18T12:19:09.600 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.c] 2023-10-18T12:19:09.600 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQAbzS9l9G+wDRAAcQa3OTTltHsp5Nh+xTkX6Q== 2023-10-18T12:19:09.601 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.0] 2023-10-18T12:19:09.601 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQAfzS9l3DgLFBAAbJK3lC1fDC5KHhqSo1EZkQ== 2023-10-18T12:19:09.601 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.1] 2023-10-18T12:19:09.601 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQAizS9ltCswIxAAG1lZDDOl9sU9AR2utwvvKQ== 2023-10-18T12:19:09.601 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.2] 2023-10-18T12:19:09.602 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQAlzS9lbGnJMBAAz85FiF64SOQgdYCs9rE+sQ== 2023-10-18T12:19:09.602 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.3] 2023-10-18T12:19:09.602 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQApzS9lFK4hBBAAooq9vTE7xBf29aEG4axrDA== 2023-10-18T12:19:09.602 INFO:teuthology.orchestra.run.smithi114.stdout:[mgr.x] 2023-10-18T12:19:09.602 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQAazS9lzU+PNhAAoye+ayO3tsf1cPX7DqGbFw== 2023-10-18T12:19:09.603 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.b] 2023-10-18T12:19:09.603 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQAbzS9lzdA8FhAAym50uH2oXqGiGudL16qy6Q== 2023-10-18T12:19:09.603 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.d] 2023-10-18T12:19:09.603 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQAbzS9lCDNHIRAAId2KJl4jXDLItVs/sNHz4w== 2023-10-18T12:19:09.603 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.4] 2023-10-18T12:19:09.604 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQAvzS9lXL6QHBAAMQ3Rjr6npggc+oOqT9I+iw== 2023-10-18T12:19:09.604 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.5] 2023-10-18T12:19:09.604 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQAyzS9l3DC7LBAADbHf9qkpz7b/2Bud5C91DA== 2023-10-18T12:19:09.604 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.6] 2023-10-18T12:19:09.604 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQA1zS9lFPlgOxAAhywc45lH31kl0/orIit6Ow== 2023-10-18T12:19:09.605 INFO:teuthology.orchestra.run.smithi114.stdout:[osd.7] 2023-10-18T12:19:09.605 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQA5zS9lygFYDxAAZkt1EJ8ZIUpQ6uDYIwDL+Q== 2023-10-18T12:19:09.605 INFO:teuthology.orchestra.run.smithi114.stdout:[client.0] 2023-10-18T12:19:09.605 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQAbzS9l47iuKBAAvzsyy0FyscOq8i4BEhLnMQ== 2023-10-18T12:19:09.605 INFO:teuthology.orchestra.run.smithi114.stdout:[client.2] 2023-10-18T12:19:09.606 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQAbzS9l7ybULhAA4NpR5cL6mpcRvb/MJLSttQ== 2023-10-18T12:19:09.606 INFO:teuthology.orchestra.run.smithi114.stdout:[client.1] 2023-10-18T12:19:09.606 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQAbzS9lNEArNRAAMiz4XCbs4GnXl/PhN3nQWg== 2023-10-18T12:19:09.606 INFO:teuthology.orchestra.run.smithi114.stdout:[client.3] 2023-10-18T12:19:09.606 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQAbzS9lV0psOxAAvAYUD9M9Ernw6QGuxS9htQ== 2023-10-18T12:19:09.623 INFO:teuthology.orchestra.run.smithi172.stdout:[mgr.y] 2023-10-18T12:19:09.623 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQAazS9lPYgEMBAAK3W1/+VlrciLsySV2Mwc3w== 2023-10-18T12:19:09.623 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.a] 2023-10-18T12:19:09.623 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQAbzS9lMbyvAhAATn1ZaKPr2Ob+mCfUpnZQUA== 2023-10-18T12:19:09.624 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.c] 2023-10-18T12:19:09.624 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQAbzS9l9G+wDRAAcQa3OTTltHsp5Nh+xTkX6Q== 2023-10-18T12:19:09.624 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.0] 2023-10-18T12:19:09.624 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQAfzS9l3DgLFBAAbJK3lC1fDC5KHhqSo1EZkQ== 2023-10-18T12:19:09.624 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.1] 2023-10-18T12:19:09.625 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQAizS9ltCswIxAAG1lZDDOl9sU9AR2utwvvKQ== 2023-10-18T12:19:09.625 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.2] 2023-10-18T12:19:09.625 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQAlzS9lbGnJMBAAz85FiF64SOQgdYCs9rE+sQ== 2023-10-18T12:19:09.625 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.3] 2023-10-18T12:19:09.625 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQApzS9lFK4hBBAAooq9vTE7xBf29aEG4axrDA== 2023-10-18T12:19:09.625 INFO:teuthology.orchestra.run.smithi172.stdout:[mgr.x] 2023-10-18T12:19:09.626 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQAazS9lzU+PNhAAoye+ayO3tsf1cPX7DqGbFw== 2023-10-18T12:19:09.626 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.b] 2023-10-18T12:19:09.626 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQAbzS9lzdA8FhAAym50uH2oXqGiGudL16qy6Q== 2023-10-18T12:19:09.626 INFO:teuthology.orchestra.run.smithi172.stdout:[mds.d] 2023-10-18T12:19:09.626 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQAbzS9lCDNHIRAAId2KJl4jXDLItVs/sNHz4w== 2023-10-18T12:19:09.627 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.4] 2023-10-18T12:19:09.627 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQAvzS9lXL6QHBAAMQ3Rjr6npggc+oOqT9I+iw== 2023-10-18T12:19:09.627 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.5] 2023-10-18T12:19:09.627 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQAyzS9l3DC7LBAADbHf9qkpz7b/2Bud5C91DA== 2023-10-18T12:19:09.627 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.6] 2023-10-18T12:19:09.628 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQA1zS9lFPlgOxAAhywc45lH31kl0/orIit6Ow== 2023-10-18T12:19:09.628 INFO:teuthology.orchestra.run.smithi172.stdout:[osd.7] 2023-10-18T12:19:09.628 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQA5zS9lygFYDxAAZkt1EJ8ZIUpQ6uDYIwDL+Q== 2023-10-18T12:19:09.628 INFO:teuthology.orchestra.run.smithi172.stdout:[client.0] 2023-10-18T12:19:09.628 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQAbzS9l47iuKBAAvzsyy0FyscOq8i4BEhLnMQ== 2023-10-18T12:19:09.628 INFO:teuthology.orchestra.run.smithi172.stdout:[client.2] 2023-10-18T12:19:09.629 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQAbzS9l7ybULhAA4NpR5cL6mpcRvb/MJLSttQ== 2023-10-18T12:19:09.629 INFO:teuthology.orchestra.run.smithi172.stdout:[client.1] 2023-10-18T12:19:09.629 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQAbzS9lNEArNRAAMiz4XCbs4GnXl/PhN3nQWg== 2023-10-18T12:19:09.629 INFO:teuthology.orchestra.run.smithi172.stdout:[client.3] 2023-10-18T12:19:09.629 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQAbzS9lV0psOxAAvAYUD9M9Ernw6QGuxS9htQ== 2023-10-18T12:19:09.630 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-18T12:19:09.656 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-18T12:19:09.755 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-18T12:19:09.763 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-18T12:19:09.849 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-18T12:19:09.856 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-18T12:19:09.944 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T12:19:09.950 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T12:19:10.036 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T12:19:10.043 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T12:19:10.126 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T12:19:10.133 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T12:19:10.217 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T12:19:10.224 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T12:19:10.309 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-18T12:19:10.316 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-18T12:19:10.399 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-18T12:19:10.405 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-18T12:19:10.492 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-18T12:19:10.499 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-18T12:19:10.588 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T12:19:10.595 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T12:19:10.684 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T12:19:10.691 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T12:19:10.777 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T12:19:10.784 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T12:19:10.875 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T12:19:10.882 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-18T12:19:10.967 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-18T12:19:10.974 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-18T12:19:11.062 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-18T12:19:11.069 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-18T12:19:11.158 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-18T12:19:11.165 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-18T12:19:11.253 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-18T12:19:11.260 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-18T12:19:11.347 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-18T12:19:11.347 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-18T12:19:11.381 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-18T12:19:11.527 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-18T12:19:11.560 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-18T12:19:11.596 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-18T12:19:11.754 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-18T12:19:11.791 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-18T12:19:11.868 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-18T12:19:12.021 DEBUG:teuthology.orchestra.run.smithi172:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-18T12:19:12.056 DEBUG:teuthology.orchestra.run.smithi114:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-18T12:19:12.064 DEBUG:teuthology.orchestra.run.smithi172:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-18T12:19:12.122 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-18T12:19:12.122 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-18T12:19:12.123 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-18T12:19:12.130 INFO:tasks.ceph.mon.a:Started 2023-10-18T12:19:12.131 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-18T12:19:12.131 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-18T12:19:12.174 INFO:tasks.ceph.mon.b:Started 2023-10-18T12:19:12.175 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-18T12:19:12.175 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-18T12:19:12.179 INFO:tasks.ceph.mon.c:Started 2023-10-18T12:19:12.179 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-18T12:19:12.180 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-18T12:19:12.180 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-18T12:19:12.188 INFO:tasks.ceph.mgr.y:Started 2023-10-18T12:19:12.188 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-18T12:19:12.188 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-18T12:19:12.194 INFO:tasks.ceph.mgr.x:Started 2023-10-18T12:19:12.194 INFO:tasks.ceph:Setting crush tunables to default 2023-10-18T12:19:12.194 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph osd crush tunables default 2023-10-18T12:19:12.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.356+0000 7f89714fb700 1 Processor -- start 2023-10-18T12:19:12.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.356+0000 7f89714fb700 1 -- start start 2023-10-18T12:19:12.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.360+0000 7f89714fb700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f896c15dcf0 0x7f896c06fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:12.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.360+0000 7f89714fb700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f896c0d2e20 0x7f896c0d32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:12.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.360+0000 7f89714fb700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f896c0b6e40 con 0x7f896c0d23e0 2023-10-18T12:19:12.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.360+0000 7f89714fb700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f896c15e160 con 0x7f896c0d2e20 2023-10-18T12:19:12.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.360+0000 7f89714fb700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f896c0d37f0 con 0x7f896c15dcf0 2023-10-18T12:19:12.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.360+0000 7f896bfff700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f896c0d23e0 0x7f896c0b65f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49892/0 (socket says 172.21.15.114:49892) 2023-10-18T12:19:12.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.360+0000 7f896bfff700 1 -- 172.21.15.114:0/2243211565 learned_addr learned my addr 172.21.15.114:0/2243211565 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:19:12.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.360+0000 7f896b7fe700 1 --2- 172.21.15.114:0/2243211565 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f896c15dcf0 0x7f896c06fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:12.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.360+0000 7f8970cfa700 1 --2- 172.21.15.114:0/2243211565 >> v2:172.21.15.172:3300/0 conn(0x7f896c0d2e20 0x7f896c0d32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:12.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.360+0000 7f896b7fe700 1 -- 172.21.15.114:0/2243211565 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f896c15dcf0 msgr2=0x7f896c06fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-18T12:19:12.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.360+0000 7f896b7fe700 1 -- 172.21.15.114:0/2243211565 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f896c15dcf0 msgr2=0x7f896c06fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-18T12:19:12.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.360+0000 7f896b7fe700 1 --2- 172.21.15.114:0/2243211565 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f896c15dcf0 0x7f896c06fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-18T12:19:12.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.360+0000 7f896b7fe700 1 --2- 172.21.15.114:0/2243211565 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f896c15dcf0 0x7f896c06fef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-18T12:19:12.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.360+0000 7f8970cfa700 1 -- 172.21.15.114:0/2243211565 >> v2:172.21.15.172:3300/0 conn(0x7f896c0d2e20 msgr2=0x7f896c0d32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-18T12:19:12.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.360+0000 7f8970cfa700 1 -- 172.21.15.114:0/2243211565 >> v2:172.21.15.172:3300/0 conn(0x7f896c0d2e20 msgr2=0x7f896c0d32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-18T12:19:12.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.360+0000 7f8970cfa700 1 --2- 172.21.15.114:0/2243211565 >> v2:172.21.15.172:3300/0 conn(0x7f896c0d2e20 0x7f896c0d32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-18T12:19:12.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.360+0000 7f8970cfa700 1 --2- 172.21.15.114:0/2243211565 >> v2:172.21.15.172:3300/0 conn(0x7f896c0d2e20 0x7f896c0d32b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-18T12:19:12.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.536+0000 7f896affd700 1 -- 172.21.15.114:0/2243211565 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2317772657 0 0) 0x7f896c0b6e40 con 0x7f896c0d23e0 2023-10-18T12:19:12.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.536+0000 7f896affd700 1 -- 172.21.15.114:0/2243211565 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89540035d0 con 0x7f896c0d23e0 2023-10-18T12:19:12.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.536+0000 7f896affd700 1 -- 172.21.15.114:0/2243211565 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1564733912 0 0) 0x7f89540035d0 con 0x7f896c0d23e0 2023-10-18T12:19:12.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.536+0000 7f896affd700 1 -- 172.21.15.114:0/2243211565 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f896c15dcf0 msgr2=0x7f896c06fef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T12:19:12.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.536+0000 7f896affd700 1 --2- 172.21.15.114:0/2243211565 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f896c15dcf0 0x7f896c06fef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:12.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.536+0000 7f896affd700 1 -- 172.21.15.114:0/2243211565 >> v2:172.21.15.172:3300/0 conn(0x7f896c0d2e20 msgr2=0x7f896c0d32b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-18T12:19:12.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.536+0000 7f896affd700 1 --2- 172.21.15.114:0/2243211565 >> v2:172.21.15.172:3300/0 conn(0x7f896c0d2e20 0x7f896c0d32b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:12.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.536+0000 7f896affd700 1 -- 172.21.15.114:0/2243211565 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f896c0b7120 con 0x7f896c0d23e0 2023-10-18T12:19:12.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.536+0000 7f896affd700 1 -- 172.21.15.114:0/2243211565 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3368469509 0 0) 0x7f895c001670 con 0x7f896c0d23e0 2023-10-18T12:19:12.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.536+0000 7f896affd700 1 -- 172.21.15.114:0/2243211565 >> v1:172.21.15.114:6789/0 conn(0x7f896c0d23e0 legacy=0x7f896c0b65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:12.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.536+0000 7f896affd700 1 --2- 172.21.15.114:0/2243211565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8954003a90 0x7f8954003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:12.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.536+0000 7f896affd700 1 --2- 172.21.15.114:0/2243211565 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f896c15dcf0 0x7f8954004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:12.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.536+0000 7f896affd700 1 --2- 172.21.15.114:0/2243211565 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8954004db0 0x7f8954005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:12.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.536+0000 7f896affd700 1 -- 172.21.15.114:0/2243211565 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896c15e160 con 0x7f8954004db0 2023-10-18T12:19:12.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.536+0000 7f896affd700 1 -- 172.21.15.114:0/2243211565 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896c0d37f0 con 0x7f8954003a90 2023-10-18T12:19:12.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.536+0000 7f896affd700 1 -- 172.21.15.114:0/2243211565 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f895400bbf0 con 0x7f896c15dcf0 2023-10-18T12:19:12.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.536+0000 7f8970cfa700 1 --2- 172.21.15.114:0/2243211565 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8954004db0 0x7f8954005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:12.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.536+0000 7f896b7fe700 1 --2- 172.21.15.114:0/2243211565 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f896c15dcf0 0x7f8954004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:12.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.536+0000 7f896bfff700 1 --2- 172.21.15.114:0/2243211565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8954003a90 0x7f8954003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:12.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.540+0000 7f8970cfa700 1 -- 172.21.15.114:0/2243211565 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f896c15dcf0 msgr2=0x7f8954004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:12.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.540+0000 7f8970cfa700 1 --2- 172.21.15.114:0/2243211565 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f896c15dcf0 0x7f8954004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:12.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.540+0000 7f8970cfa700 1 -- 172.21.15.114:0/2243211565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8954003a90 msgr2=0x7f8954003eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:12.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.540+0000 7f8970cfa700 1 --2- 172.21.15.114:0/2243211565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8954003a90 0x7f8954003eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:12.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.540+0000 7f8970cfa700 1 -- 172.21.15.114:0/2243211565 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89540035d0 con 0x7f8954004db0 2023-10-18T12:19:12.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.540+0000 7f896b7fe700 1 --2- 172.21.15.114:0/2243211565 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f896c15dcf0 0x7f8954004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:19:12.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.540+0000 7f8970cfa700 1 --2- 172.21.15.114:0/2243211565 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8954004db0 0x7f8954005230 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8964009fd0 tx=0x7f89540058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=797793abcd23788f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:12.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.540+0000 7f896affd700 1 -- 172.21.15.114:0/2243211565 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8964007e20 con 0x7f8954004db0 2023-10-18T12:19:12.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.540+0000 7f896affd700 1 -- 172.21.15.114:0/2243211565 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8964003a90 con 0x7f8954004db0 2023-10-18T12:19:12.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.540+0000 7f896affd700 1 -- 172.21.15.114:0/2243211565 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8964003e40 con 0x7f8954004db0 2023-10-18T12:19:12.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.544+0000 7f89714fb700 1 -- 172.21.15.114:0/2243211565 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8954004db0 msgr2=0x7f8954005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:12.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.544+0000 7f89714fb700 1 --2- 172.21.15.114:0/2243211565 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8954004db0 0x7f8954005230 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8964009fd0 tx=0x7f89540058a0 comp rx=0 tx=0).stop 2023-10-18T12:19:12.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.544+0000 7f8970cfa700 1 -- 172.21.15.114:0/2243211565 reap_dead start 2023-10-18T12:19:12.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.544+0000 7f89714fb700 1 -- 172.21.15.114:0/2243211565 shutdown_connections 2023-10-18T12:19:12.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.544+0000 7f89714fb700 1 -- 172.21.15.114:0/2243211565 >> 172.21.15.114:0/2243211565 conn(0x7f896c069f20 msgr2=0x7f896c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:12.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.544+0000 7f89714fb700 1 -- 172.21.15.114:0/2243211565 shutdown_connections 2023-10-18T12:19:12.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.544+0000 7f89714fb700 1 -- 172.21.15.114:0/2243211565 wait complete. 2023-10-18T12:19:12.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.548+0000 7f89714fb700 1 Processor -- start 2023-10-18T12:19:12.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.548+0000 7f89714fb700 1 -- start start 2023-10-18T12:19:12.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.548+0000 7f89714fb700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8954004db0 0x7f896c151710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:12.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.548+0000 7f89714fb700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f896c0b4ac0 0x7f896c0b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:12.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.548+0000 7f89714fb700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f896c1f5d40 0x7f896c1f61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:12.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.548+0000 7f89714fb700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896c1f6a90 con 0x7f8954004db0 2023-10-18T12:19:12.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.548+0000 7f89714fb700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896c151c50 con 0x7f896c0b4ac0 2023-10-18T12:19:12.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.548+0000 7f89714fb700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f896c0b5480 con 0x7f896c1f5d40 2023-10-18T12:19:12.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.548+0000 7f896bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8954004db0 0x7f896c151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:12.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.548+0000 7f896bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8954004db0 0x7f896c151710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57416/0 (socket says 172.21.15.114:57416) 2023-10-18T12:19:12.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.548+0000 7f896bfff700 1 -- 172.21.15.114:0/25321365 learned_addr learned my addr 172.21.15.114:0/25321365 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:12.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.548+0000 7f8970cfa700 1 --2- 172.21.15.114:0/25321365 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f896c1f5d40 0x7f896c1f61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:12.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.548+0000 7f896b7fe700 1 --2- 172.21.15.114:0/25321365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f896c0b4ac0 0x7f896c0b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:12.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.548+0000 7f896bfff700 1 -- 172.21.15.114:0/25321365 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f896c1f5d40 msgr2=0x7f896c1f61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:12.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.548+0000 7f896bfff700 1 --2- 172.21.15.114:0/25321365 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f896c1f5d40 0x7f896c1f61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:12.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.548+0000 7f896bfff700 1 -- 172.21.15.114:0/25321365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f896c0b4ac0 msgr2=0x7f896c0b4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:12.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.548+0000 7f896bfff700 1 --2- 172.21.15.114:0/25321365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f896c0b4ac0 0x7f896c0b4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:12.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.548+0000 7f896bfff700 1 -- 172.21.15.114:0/25321365 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f896c155850 con 0x7f8954004db0 2023-10-18T12:19:12.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.548+0000 7f896bfff700 1 --2- 172.21.15.114:0/25321365 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8954004db0 0x7f896c151710 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f895c00eb20 tx=0x7f895c00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:12.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.548+0000 7f8968ff9700 1 -- 172.21.15.114:0/25321365 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895c005e00 con 0x7f8954004db0 2023-10-18T12:19:12.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.548+0000 7f8968ff9700 1 -- 172.21.15.114:0/25321365 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895c00c7e0 con 0x7f8954004db0 2023-10-18T12:19:12.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.552+0000 7f89714fb700 1 -- 172.21.15.114:0/25321365 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f896c152290 con 0x7f8954004db0 2023-10-18T12:19:12.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.552+0000 7f8968ff9700 1 -- 172.21.15.114:0/25321365 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895c00cb90 con 0x7f8954004db0 2023-10-18T12:19:12.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.552+0000 7f89714fb700 1 -- 172.21.15.114:0/25321365 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f896c152850 con 0x7f8954004db0 2023-10-18T12:19:12.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.552+0000 7f8968ff9700 1 -- 172.21.15.114:0/25321365 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f895c01d460 con 0x7f8954004db0 2023-10-18T12:19:12.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.552+0000 7f8968ff9700 1 -- 172.21.15.114:0/25321365 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f895c01d770 con 0x7f8954004db0 2023-10-18T12:19:12.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.552+0000 7f89714fb700 1 -- 172.21.15.114:0/25321365 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f896c04e910 con 0x7f8954004db0 2023-10-18T12:19:12.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.556+0000 7f8968ff9700 1 -- 172.21.15.114:0/25321365 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f895c013650 con 0x7f8954004db0 2023-10-18T12:19:12.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.640+0000 7f89714fb700 1 -- 172.21.15.114:0/25321365 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f896c0ceac0 con 0x7f8954004db0 2023-10-18T12:19:12.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.648+0000 7f8968ff9700 1 -- 172.21.15.114:0/25321365 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f895c01d9e0 con 0x7f8954004db0 2023-10-18T12:19:12.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.648+0000 7f89714fb700 1 -- 172.21.15.114:0/25321365 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8954004db0 msgr2=0x7f896c151710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:12.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.648+0000 7f89714fb700 1 --2- 172.21.15.114:0/25321365 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8954004db0 0x7f896c151710 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f895c00eb20 tx=0x7f895c00eee0 comp rx=0 tx=0).stop 2023-10-18T12:19:12.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.648+0000 7f89714fb700 1 -- 172.21.15.114:0/25321365 shutdown_connections 2023-10-18T12:19:12.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.648+0000 7f89714fb700 1 --2- 172.21.15.114:0/25321365 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f896c1f5d40 0x7f896c1f61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:12.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.648+0000 7f89714fb700 1 --2- 172.21.15.114:0/25321365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f896c0b4ac0 0x7f896c0b4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:12.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.648+0000 7f89714fb700 1 --2- 172.21.15.114:0/25321365 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8954004db0 0x7f896c151710 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:12.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.648+0000 7f89714fb700 1 -- 172.21.15.114:0/25321365 >> 172.21.15.114:0/25321365 conn(0x7f896c069f20 msgr2=0x7f896c0b2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:12.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.648+0000 7f89714fb700 1 -- 172.21.15.114:0/25321365 shutdown_connections 2023-10-18T12:19:12.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:12.648+0000 7f89714fb700 1 -- 172.21.15.114:0/25321365 wait complete. 2023-10-18T12:19:12.656 INFO:teuthology.orchestra.run.smithi114.stderr:adjusted tunables profile to default 2023-10-18T12:19:12.679 INFO:tasks.ceph:check_enable_crimson: False 2023-10-18T12:19:12.679 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-18T12:19:12.680 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:19:12.680 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-18T12:19:12.712 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:19:12.712 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-18T12:19:12.788 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-10-18T12:19:12.784+0000 7f83947eb2c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-18T12:19:12.792 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:19:12.792 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-18T12:19:12.814 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-10-18T12:19:12.809+0000 7f7f0c1042c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-18T12:19:12.867 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:19:12.868 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-18T12:19:12.941 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T12:19:12.942 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-18T12:19:12.978 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T12:19:12.978 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-18T12:19:13.055 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T12:19:13.056 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-18T12:19:13.128 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T12:19:13.129 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-18T12:19:13.204 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new c3578978-1a03-4857-b9d2-34a5da3d7731 0 2023-10-18T12:19:13.420 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.413+0000 7f9bb359e700 1 Processor -- start 2023-10-18T12:19:13.420 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.413+0000 7f9bb359e700 1 -- start start 2023-10-18T12:19:13.423 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.417+0000 7f9bb359e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bb40d23e0 0x7f9bb415dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:13.423 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.417+0000 7f9bb359e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9bb40d2e20 0x7f9bb40d32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:13.424 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.417+0000 7f9bb359e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bb40b6e40 con 0x7f9bb406fef0 2023-10-18T12:19:13.424 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.417+0000 7f9bb359e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bb40d37f0 con 0x7f9bb40d2e20 2023-10-18T12:19:13.424 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.417+0000 7f9bb359e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb4070330 con 0x7f9bb40d23e0 2023-10-18T12:19:13.425 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.417+0000 7f9bb259c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bb40d23e0 0x7f9bb415dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:13.425 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.421+0000 7f9bb2d9d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9bb40d2e20 0x7f9bb40d32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:13.426 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.421+0000 7f9bb1d9b700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f9bb406fef0 0x7f9bb40b65f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.172:33864/0 (socket says 172.21.15.172:33864) 2023-10-18T12:19:13.426 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.421+0000 7f9bb1d9b700 1 -- 172.21.15.172:0/1536028596 learned_addr learned my addr 172.21.15.172:0/1536028596 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-10-18T12:19:13.426 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.421+0000 7f9bb259c700 1 -- 172.21.15.172:0/1536028596 >> v2:172.21.15.114:3300/0 conn(0x7f9bb40d2e20 msgr2=0x7f9bb40d32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:13.426 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.421+0000 7f9bb259c700 1 --2- 172.21.15.172:0/1536028596 >> v2:172.21.15.114:3300/0 conn(0x7f9bb40d2e20 0x7f9bb40d32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:13.427 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.421+0000 7f9bb259c700 1 -- 172.21.15.172:0/1536028596 >> v1:172.21.15.114:6789/0 conn(0x7f9bb406fef0 legacy=0x7f9bb40b65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:13.427 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.421+0000 7f9bb259c700 1 -- 172.21.15.172:0/1536028596 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb40b7120 con 0x7f9bb40d23e0 2023-10-18T12:19:13.427 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.421+0000 7f9bb259c700 1 --2- 172.21.15.172:0/1536028596 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bb40d23e0 0x7f9bb415dcf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4009850 tx=0x7f9ba4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6cbcd8a0119c02c server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:13.427 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.421+0000 7f9bb159a700 1 -- 172.21.15.172:0/1536028596 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba4011830 con 0x7f9bb40d23e0 2023-10-18T12:19:13.427 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.421+0000 7f9bb159a700 1 -- 172.21.15.172:0/1536028596 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba4011990 con 0x7f9bb40d23e0 2023-10-18T12:19:13.427 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.421+0000 7f9bb159a700 1 -- 172.21.15.172:0/1536028596 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba4011d40 con 0x7f9bb40d23e0 2023-10-18T12:19:13.428 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.421+0000 7f9bb359e700 1 -- 172.21.15.172:0/1536028596 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bb40d23e0 msgr2=0x7f9bb415dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:13.429 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.421+0000 7f9bb359e700 1 --2- 172.21.15.172:0/1536028596 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bb40d23e0 0x7f9bb415dcf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4009850 tx=0x7f9ba4009b60 comp rx=0 tx=0).stop 2023-10-18T12:19:13.429 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.421+0000 7f9bb359e700 1 -- 172.21.15.172:0/1536028596 shutdown_connections 2023-10-18T12:19:13.429 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.421+0000 7f9bb359e700 1 --2- 172.21.15.172:0/1536028596 >> v2:172.21.15.114:3300/0 conn(0x7f9bb40d2e20 0x7f9bb40d32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:13.429 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.421+0000 7f9bb359e700 1 --2- 172.21.15.172:0/1536028596 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bb40d23e0 0x7f9bb415dcf0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:13.429 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.421+0000 7f9bb359e700 1 -- 172.21.15.172:0/1536028596 >> 172.21.15.172:0/1536028596 conn(0x7f9bb4069f20 msgr2=0x7f9bb406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:13.430 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.421+0000 7f9bb359e700 1 -- 172.21.15.172:0/1536028596 shutdown_connections 2023-10-18T12:19:13.430 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.421+0000 7f9bb359e700 1 -- 172.21.15.172:0/1536028596 wait complete. 2023-10-18T12:19:13.430 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.425+0000 7f9bb359e700 1 Processor -- start 2023-10-18T12:19:13.431 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.425+0000 7f9bb359e700 1 -- start start 2023-10-18T12:19:13.432 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.425+0000 7f9bb359e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bb406fef0 0x7f9bb4157b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:13.432 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.425+0000 7f9bb359e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bb40d23e0 0x7f9bb415f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:13.432 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.425+0000 7f9bb359e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bb40d2e20 0x7f9bb415f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:13.433 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.425+0000 7f9bb359e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb4158050 con 0x7f9bb406fef0 2023-10-18T12:19:13.433 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.425+0000 7f9bb359e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb40aba80 con 0x7f9bb40d23e0 2023-10-18T12:19:13.433 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.425+0000 7f9bb359e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb40abd60 con 0x7f9bb40d2e20 2023-10-18T12:19:13.435 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.429+0000 7f9bb2d9d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bb40d2e20 0x7f9bb415f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:13.435 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.429+0000 7f9bb1d9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bb40d23e0 0x7f9bb415f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:13.435 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.429+0000 7f9bb2d9d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bb40d2e20 0x7f9bb415f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.172:33864/0 (socket says 172.21.15.172:33864) 2023-10-18T12:19:13.435 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.429+0000 7f9bb2d9d700 1 -- 172.21.15.172:0/4111461730 learned_addr learned my addr 172.21.15.172:0/4111461730 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-10-18T12:19:13.436 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.429+0000 7f9bb259c700 1 --2- 172.21.15.172:0/4111461730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bb406fef0 0x7f9bb4157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:13.436 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.429+0000 7f9bb2d9d700 1 -- 172.21.15.172:0/4111461730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bb40d23e0 msgr2=0x7f9bb415f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:13.436 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.429+0000 7f9bb2d9d700 1 --2- 172.21.15.172:0/4111461730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bb40d23e0 0x7f9bb415f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:13.436 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.429+0000 7f9bb2d9d700 1 -- 172.21.15.172:0/4111461730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bb406fef0 msgr2=0x7f9bb4157b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:13.436 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.429+0000 7f9bb2d9d700 1 --2- 172.21.15.172:0/4111461730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bb406fef0 0x7f9bb4157b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:13.437 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.429+0000 7f9bb2d9d700 1 -- 172.21.15.172:0/4111461730 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba40094b0 con 0x7f9bb40d2e20 2023-10-18T12:19:13.437 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.429+0000 7f9bb259c700 1 --2- 172.21.15.172:0/4111461730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bb406fef0 0x7f9bb4157b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:19:13.437 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.429+0000 7f9bb2d9d700 1 --2- 172.21.15.172:0/4111461730 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bb40d2e20 0x7f9bb415f8a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9bac00efc0 tx=0x7f9bac00c0c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:13.437 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.429+0000 7f9ba2ffd700 1 -- 172.21.15.172:0/4111461730 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac00cb80 con 0x7f9bb40d2e20 2023-10-18T12:19:13.437 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.429+0000 7f9ba2ffd700 1 -- 172.21.15.172:0/4111461730 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bac00f040 con 0x7f9bb40d2e20 2023-10-18T12:19:13.438 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.429+0000 7f9bb359e700 1 -- 172.21.15.172:0/4111461730 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb40ac040 con 0x7f9bb40d2e20 2023-10-18T12:19:13.438 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.429+0000 7f9ba2ffd700 1 -- 172.21.15.172:0/4111461730 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac014480 con 0x7f9bb40d2e20 2023-10-18T12:19:13.438 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.429+0000 7f9bb359e700 1 -- 172.21.15.172:0/4111461730 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb40ac600 con 0x7f9bb40d2e20 2023-10-18T12:19:13.438 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.429+0000 7f9ba2ffd700 1 -- 172.21.15.172:0/4111461730 <== mon.2 v2:172.21.15.172:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9bac0148e0 con 0x7f9bb40d2e20 2023-10-18T12:19:13.438 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.429+0000 7f9ba2ffd700 1 -- 172.21.15.172:0/4111461730 <== mon.2 v2:172.21.15.172:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9bac006e40 con 0x7f9bb40d2e20 2023-10-18T12:19:13.439 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.429+0000 7f9bb359e700 1 -- 172.21.15.172:0/4111461730 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bb40ac820 con 0x7f9bb40d2e20 2023-10-18T12:19:13.440 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.437+0000 7f9ba2ffd700 1 -- 172.21.15.172:0/4111461730 <== mon.2 v2:172.21.15.172:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f9bac018020 con 0x7f9bb40d2e20 2023-10-18T12:19:13.515 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-10-18T12:19:13.512+0000 7f83947eb2c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-18T12:19:13.544 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.541+0000 7f9bb359e700 1 -- 172.21.15.172:0/4111461730 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c3578978-1a03-4857-b9d2-34a5da3d7731", "id": 0} v 0) v1 -- 0x7f9bb404e910 con 0x7f9bb40d2e20 2023-10-18T12:19:13.555 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.549+0000 7f9ba2ffd700 1 -- 172.21.15.172:0/4111461730 <== mon.2 v2:172.21.15.172:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c3578978-1a03-4857-b9d2-34a5da3d7731", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9bac01d400 con 0x7f9bb40d2e20 2023-10-18T12:19:13.555 INFO:teuthology.orchestra.run.smithi172.stdout:0 2023-10-18T12:19:13.556 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.553+0000 7f9bb359e700 1 -- 172.21.15.172:0/4111461730 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bb40d2e20 msgr2=0x7f9bb415f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:13.557 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.553+0000 7f9bb359e700 1 --2- 172.21.15.172:0/4111461730 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bb40d2e20 0x7f9bb415f8a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9bac00efc0 tx=0x7f9bac00c0c0 comp rx=0 tx=0).stop 2023-10-18T12:19:13.557 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.553+0000 7f9bb359e700 1 -- 172.21.15.172:0/4111461730 shutdown_connections 2023-10-18T12:19:13.557 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.553+0000 7f9bb359e700 1 --2- 172.21.15.172:0/4111461730 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bb40d2e20 0x7f9bb415f8a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:13.557 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.553+0000 7f9bb359e700 1 --2- 172.21.15.172:0/4111461730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bb40d23e0 0x7f9bb415f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:13.557 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.553+0000 7f9bb359e700 1 --2- 172.21.15.172:0/4111461730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bb406fef0 0x7f9bb4157b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:13.558 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.553+0000 7f9bb359e700 1 -- 172.21.15.172:0/4111461730 >> 172.21.15.172:0/4111461730 conn(0x7f9bb4069f20 msgr2=0x7f9bb415c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:13.558 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.553+0000 7f9bb359e700 1 -- 172.21.15.172:0/4111461730 shutdown_connections 2023-10-18T12:19:13.558 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.553+0000 7f9bb359e700 1 -- 172.21.15.172:0/4111461730 wait complete. 2023-10-18T12:19:13.563 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-10-18T12:19:13.557+0000 7f7f0c1042c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-18T12:19:13.575 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new 43eb26a6-e2b3-4670-9559-bd053b5140d5 1 2023-10-18T12:19:13.607 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-10-18T12:19:13.604+0000 7f83947eb2c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-18T12:19:13.644 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-10-18T12:19:13.637+0000 7f7f0c1042c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-18T12:19:13.732 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.725+0000 7f1fb359e700 1 Processor -- start 2023-10-18T12:19:13.732 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.729+0000 7f1fb359e700 1 -- start start 2023-10-18T12:19:13.735 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.729+0000 7f1fb359e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1fb4070c70 0x7f1fb40cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:13.736 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.729+0000 7f1fb359e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb40b14f0 con 0x7f1fb40cde70 2023-10-18T12:19:13.736 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.729+0000 7f1fb359e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb415d590 con 0x7f1fb4159750 2023-10-18T12:19:13.736 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.729+0000 7f1fb359e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb40c9aa0 con 0x7f1fb4070c70 2023-10-18T12:19:13.736 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.729+0000 7f1fb1d9b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1fb4070c70 0x7f1fb40cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:13.736 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.729+0000 7f1fb1d9b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1fb4070c70 0x7f1fb40cd930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.172:33880/0 (socket says 172.21.15.172:33880) 2023-10-18T12:19:13.736 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.729+0000 7f1fb1d9b700 1 -- 172.21.15.172:0/3084860981 learned_addr learned my addr 172.21.15.172:0/3084860981 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-10-18T12:19:13.737 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.733+0000 7f1fb1d9b700 1 -- 172.21.15.172:0/3084860981 >> v1:172.21.15.172:6789/0 conn(0x7f1fb4159750 legacy=0x7f1fb4070560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:13.738 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.733+0000 7f1fb1d9b700 1 -- 172.21.15.172:0/3084860981 >> v1:172.21.15.114:6789/0 conn(0x7f1fb40cde70 legacy=0x7f1fb406cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:13.738 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.733+0000 7f1fb1d9b700 1 -- 172.21.15.172:0/3084860981 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb415d870 con 0x7f1fb4070c70 2023-10-18T12:19:13.738 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.733+0000 7f1fb1d9b700 1 --2- 172.21.15.172:0/3084860981 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1fb4070c70 0x7f1fb40cd930 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1fa800bbe0 tx=0x7f1fa800bef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=608c0d88936a6e3c server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:13.738 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.733+0000 7f1fb159a700 1 -- 172.21.15.172:0/3084860981 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa800dde0 con 0x7f1fb4070c70 2023-10-18T12:19:13.738 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.733+0000 7f1fb159a700 1 -- 172.21.15.172:0/3084860981 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa8010470 con 0x7f1fb4070c70 2023-10-18T12:19:13.739 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.733+0000 7f1fb159a700 1 -- 172.21.15.172:0/3084860981 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa8010800 con 0x7f1fb4070c70 2023-10-18T12:19:13.739 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.733+0000 7f1fb359e700 1 -- 172.21.15.172:0/3084860981 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1fb4070c70 msgr2=0x7f1fb40cd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:13.740 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.733+0000 7f1fb359e700 1 --2- 172.21.15.172:0/3084860981 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1fb4070c70 0x7f1fb40cd930 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1fa800bbe0 tx=0x7f1fa800bef0 comp rx=0 tx=0).stop 2023-10-18T12:19:13.740 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.733+0000 7f1fb359e700 1 -- 172.21.15.172:0/3084860981 shutdown_connections 2023-10-18T12:19:13.740 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.733+0000 7f1fb359e700 1 --2- 172.21.15.172:0/3084860981 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1fb4070c70 0x7f1fb40cd930 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:13.740 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.733+0000 7f1fb359e700 1 -- 172.21.15.172:0/3084860981 >> 172.21.15.172:0/3084860981 conn(0x7f1fb40ce5c0 msgr2=0x7f1fb40ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:13.741 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.733+0000 7f1fb359e700 1 -- 172.21.15.172:0/3084860981 shutdown_connections 2023-10-18T12:19:13.741 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.733+0000 7f1fb359e700 1 -- 172.21.15.172:0/3084860981 wait complete. 2023-10-18T12:19:13.742 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.737+0000 7f1fb359e700 1 Processor -- start 2023-10-18T12:19:13.742 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.737+0000 7f1fb359e700 1 -- start start 2023-10-18T12:19:13.743 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.737+0000 7f1fb359e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fb4070c70 0x7f1fb41511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:13.743 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.737+0000 7f1fb359e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1fb40cde70 0x7f1fb41580c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:13.744 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.737+0000 7f1fb359e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1fb4159750 0x7f1fb4158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:13.744 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.737+0000 7f1fb359e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb40c74d0 con 0x7f1fb4070c70 2023-10-18T12:19:13.744 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.737+0000 7f1fb359e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb41516e0 con 0x7f1fb40cde70 2023-10-18T12:19:13.744 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.737+0000 7f1fb359e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb40c7770 con 0x7f1fb4159750 2023-10-18T12:19:13.744 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.737+0000 7f1fb2d9d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1fb4159750 0x7f1fb4158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:13.744 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.737+0000 7f1fb1d9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1fb40cde70 0x7f1fb41580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:13.745 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.737+0000 7f1fb2d9d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1fb4159750 0x7f1fb4158600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.172:33888/0 (socket says 172.21.15.172:33888) 2023-10-18T12:19:13.745 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.737+0000 7f1fb1d9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1fb40cde70 0x7f1fb41580c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:53150/0 (socket says 172.21.15.172:53150) 2023-10-18T12:19:13.745 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.737+0000 7f1fb2d9d700 1 -- 172.21.15.172:0/351613362 learned_addr learned my addr 172.21.15.172:0/351613362 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-10-18T12:19:13.746 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.737+0000 7f1fb259c700 1 --2- 172.21.15.172:0/351613362 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fb4070c70 0x7f1fb41511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:13.747 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.737+0000 7f1fb2d9d700 1 -- 172.21.15.172:0/351613362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1fb40cde70 msgr2=0x7f1fb41580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:13.747 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.737+0000 7f1fb2d9d700 1 --2- 172.21.15.172:0/351613362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1fb40cde70 0x7f1fb41580c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:13.747 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.737+0000 7f1fb2d9d700 1 -- 172.21.15.172:0/351613362 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fb4070c70 msgr2=0x7f1fb41511a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:13.747 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.737+0000 7f1fb2d9d700 1 --2- 172.21.15.172:0/351613362 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fb4070c70 0x7f1fb41511a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:13.747 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.737+0000 7f1fb2d9d700 1 -- 172.21.15.172:0/351613362 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa800b810 con 0x7f1fb4159750 2023-10-18T12:19:13.748 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.741+0000 7f1fb2d9d700 1 --2- 172.21.15.172:0/351613362 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1fb4159750 0x7f1fb4158600 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1fac00cc50 tx=0x7f1fac00cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:13.748 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.741+0000 7f1fa2ffd700 1 -- 172.21.15.172:0/351613362 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac003c20 con 0x7f1fb4159750 2023-10-18T12:19:13.748 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.741+0000 7f1fa2ffd700 1 -- 172.21.15.172:0/351613362 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fac003d80 con 0x7f1fb4159750 2023-10-18T12:19:13.748 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.741+0000 7f1fa2ffd700 1 -- 172.21.15.172:0/351613362 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac00ab60 con 0x7f1fb4159750 2023-10-18T12:19:13.748 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.741+0000 7f1fb359e700 1 -- 172.21.15.172:0/351613362 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb40c7a50 con 0x7f1fb4159750 2023-10-18T12:19:13.748 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.741+0000 7f1fb359e700 1 -- 172.21.15.172:0/351613362 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb40c8010 con 0x7f1fb4159750 2023-10-18T12:19:13.749 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.741+0000 7f1fa2ffd700 1 -- 172.21.15.172:0/351613362 <== mon.2 v2:172.21.15.172:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1fac0050d0 con 0x7f1fb4159750 2023-10-18T12:19:13.749 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.741+0000 7f1fa2ffd700 1 -- 172.21.15.172:0/351613362 <== mon.2 v2:172.21.15.172:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f1fac012810 con 0x7f1fb4159750 2023-10-18T12:19:13.749 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.741+0000 7f1fb359e700 1 -- 172.21.15.172:0/351613362 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fb40c8200 con 0x7f1fb4159750 2023-10-18T12:19:13.750 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.745+0000 7f1fa2ffd700 1 -- 172.21.15.172:0/351613362 <== mon.2 v2:172.21.15.172:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f1fac005510 con 0x7f1fb4159750 2023-10-18T12:19:13.799 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-10-18T12:19:13.796+0000 7f83947eb2c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-18T12:19:13.828 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-10-18T12:19:13.825+0000 7f7f0c1042c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-18T12:19:13.853 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.849+0000 7f1fb359e700 1 -- 172.21.15.172:0/351613362 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "osd new", "uuid": "43eb26a6-e2b3-4670-9559-bd053b5140d5", "id": 1} v 0) v1 -- 0x7f1fb404e910 con 0x7f1fb4159750 2023-10-18T12:19:13.865 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.861+0000 7f1fa2ffd700 1 -- 172.21.15.172:0/351613362 <== mon.2 v2:172.21.15.172:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "43eb26a6-e2b3-4670-9559-bd053b5140d5", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1fac02a0b0 con 0x7f1fb4159750 2023-10-18T12:19:13.866 INFO:teuthology.orchestra.run.smithi172.stdout:1 2023-10-18T12:19:13.866 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.861+0000 7f1fb359e700 1 -- 172.21.15.172:0/351613362 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1fb4159750 msgr2=0x7f1fb4158600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:13.867 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.861+0000 7f1fb359e700 1 --2- 172.21.15.172:0/351613362 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1fb4159750 0x7f1fb4158600 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1fac00cc50 tx=0x7f1fac00cf60 comp rx=0 tx=0).stop 2023-10-18T12:19:13.867 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.861+0000 7f1fb359e700 1 -- 172.21.15.172:0/351613362 shutdown_connections 2023-10-18T12:19:13.868 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.861+0000 7f1fb359e700 1 --2- 172.21.15.172:0/351613362 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1fb4159750 0x7f1fb4158600 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:13.868 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.861+0000 7f1fb359e700 1 --2- 172.21.15.172:0/351613362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1fb40cde70 0x7f1fb41580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:13.868 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.861+0000 7f1fb359e700 1 --2- 172.21.15.172:0/351613362 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1fb4070c70 0x7f1fb41511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:13.868 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.861+0000 7f1fb359e700 1 -- 172.21.15.172:0/351613362 >> 172.21.15.172:0/351613362 conn(0x7f1fb40ce5c0 msgr2=0x7f1fb40c3ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:13.868 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.861+0000 7f1fb359e700 1 -- 172.21.15.172:0/351613362 shutdown_connections 2023-10-18T12:19:13.869 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:13.861+0000 7f1fb359e700 1 -- 172.21.15.172:0/351613362 wait complete. 2023-10-18T12:19:13.886 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new f3d4dbd5-521c-4dd2-b687-5768cc7d0938 2 2023-10-18T12:19:14.056 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.053+0000 7f84ea21d700 1 Processor -- start 2023-10-18T12:19:14.057 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.053+0000 7f84ea21d700 1 -- start start 2023-10-18T12:19:14.059 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.053+0000 7f84ea21d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84e40d2610 0x7f84e406e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:14.059 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.053+0000 7f84ea21d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f84e415e7d0 0x7f84e40d2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:14.059 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.053+0000 7f84ea21d700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84e40d29f0 con 0x7f84e40b1e60 2023-10-18T12:19:14.059 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.053+0000 7f84ea21d700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84e40b64b0 con 0x7f84e415e7d0 2023-10-18T12:19:14.059 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.053+0000 7f84ea21d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e40b6750 con 0x7f84e40d2610 2023-10-18T12:19:14.060 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.053+0000 7f84e37fe700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84e40d2610 0x7f84e406e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:14.061 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.053+0000 7f84e37fe700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84e40d2610 0x7f84e406e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.172:33898/0 (socket says 172.21.15.172:33898) 2023-10-18T12:19:14.061 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.053+0000 7f84e37fe700 1 -- 172.21.15.172:0/3613672261 learned_addr learned my addr 172.21.15.172:0/3613672261 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-10-18T12:19:14.061 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.053+0000 7f84e2ffd700 1 --2- 172.21.15.172:0/3613672261 >> v2:172.21.15.114:3300/0 conn(0x7f84e415e7d0 0x7f84e40d2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:14.061 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.053+0000 7f84e37fe700 1 -- 172.21.15.172:0/3613672261 >> v2:172.21.15.114:3300/0 conn(0x7f84e415e7d0 msgr2=0x7f84e40d2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:14.061 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.053+0000 7f84e37fe700 1 --2- 172.21.15.172:0/3613672261 >> v2:172.21.15.114:3300/0 conn(0x7f84e415e7d0 0x7f84e40d2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:14.062 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.053+0000 7f84e37fe700 1 -- 172.21.15.172:0/3613672261 >> v1:172.21.15.114:6789/0 conn(0x7f84e40b1e60 legacy=0x7f84e406f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:14.062 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.053+0000 7f84e37fe700 1 -- 172.21.15.172:0/3613672261 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e40b6a30 con 0x7f84e40d2610 2023-10-18T12:19:14.062 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.057+0000 7f84e37fe700 1 --2- 172.21.15.172:0/3613672261 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84e40d2610 0x7f84e406e6f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f84d4009910 tx=0x7f84d4009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=663bbb979e447167 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:14.062 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.057+0000 7f84e27fc700 1 -- 172.21.15.172:0/3613672261 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d4011830 con 0x7f84e40d2610 2023-10-18T12:19:14.063 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.057+0000 7f84e27fc700 1 -- 172.21.15.172:0/3613672261 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d4011990 con 0x7f84e40d2610 2023-10-18T12:19:14.063 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.057+0000 7f84e27fc700 1 -- 172.21.15.172:0/3613672261 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d4011d40 con 0x7f84e40d2610 2023-10-18T12:19:14.064 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.057+0000 7f84ea21d700 1 -- 172.21.15.172:0/3613672261 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84e40d2610 msgr2=0x7f84e406e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:14.064 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.057+0000 7f84ea21d700 1 --2- 172.21.15.172:0/3613672261 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84e40d2610 0x7f84e406e6f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f84d4009910 tx=0x7f84d4009c20 comp rx=0 tx=0).stop 2023-10-18T12:19:14.064 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.057+0000 7f84ea21d700 1 -- 172.21.15.172:0/3613672261 shutdown_connections 2023-10-18T12:19:14.064 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.057+0000 7f84ea21d700 1 --2- 172.21.15.172:0/3613672261 >> v2:172.21.15.114:3300/0 conn(0x7f84e415e7d0 0x7f84e40d2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:14.065 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.057+0000 7f84ea21d700 1 --2- 172.21.15.172:0/3613672261 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84e40d2610 0x7f84e406e6f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:14.065 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.057+0000 7f84ea21d700 1 -- 172.21.15.172:0/3613672261 >> 172.21.15.172:0/3613672261 conn(0x7f84e4069f20 msgr2=0x7f84e406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:14.065 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.057+0000 7f84ea21d700 1 -- 172.21.15.172:0/3613672261 shutdown_connections 2023-10-18T12:19:14.065 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.057+0000 7f84ea21d700 1 -- 172.21.15.172:0/3613672261 wait complete. 2023-10-18T12:19:14.065 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.061+0000 7f84ea21d700 1 Processor -- start 2023-10-18T12:19:14.066 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.061+0000 7f84ea21d700 1 -- start start 2023-10-18T12:19:14.068 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.061+0000 7f84ea21d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84e40b1e60 0x7f84e414b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:14.068 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.061+0000 7f84ea21d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84e40d2610 0x7f84e40d2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:14.068 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.061+0000 7f84ea21d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84e415e7d0 0x7f84e40d3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:14.068 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.061+0000 7f84ea21d700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e414d580 con 0x7f84e40b1e60 2023-10-18T12:19:14.069 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.061+0000 7f84ea21d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e414efe0 con 0x7f84e40d2610 2023-10-18T12:19:14.069 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.061+0000 7f84ea21d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e414f2c0 con 0x7f84e415e7d0 2023-10-18T12:19:14.071 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.065+0000 7f84e2ffd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84e40d2610 0x7f84e40d2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:14.071 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.065+0000 7f84e3fff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84e415e7d0 0x7f84e40d3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:14.071 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.065+0000 7f84e3fff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84e415e7d0 0x7f84e40d3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.172:33910/0 (socket says 172.21.15.172:33910) 2023-10-18T12:19:14.071 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.065+0000 7f84e2ffd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84e40d2610 0x7f84e40d2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:53160/0 (socket says 172.21.15.172:53160) 2023-10-18T12:19:14.071 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.065+0000 7f84e3fff700 1 -- 172.21.15.172:0/1077359687 learned_addr learned my addr 172.21.15.172:0/1077359687 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-10-18T12:19:14.072 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.065+0000 7f84e37fe700 1 --2- 172.21.15.172:0/1077359687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84e40b1e60 0x7f84e414b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:14.072 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.065+0000 7f84e2ffd700 1 -- 172.21.15.172:0/1077359687 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84e415e7d0 msgr2=0x7f84e40d3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:14.072 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.065+0000 7f84e2ffd700 1 --2- 172.21.15.172:0/1077359687 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84e415e7d0 0x7f84e40d3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:14.072 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.065+0000 7f84e2ffd700 1 -- 172.21.15.172:0/1077359687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84e40b1e60 msgr2=0x7f84e414b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:14.072 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.065+0000 7f84e2ffd700 1 --2- 172.21.15.172:0/1077359687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84e40b1e60 0x7f84e414b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:14.073 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.065+0000 7f84e2ffd700 1 -- 172.21.15.172:0/1077359687 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d4009570 con 0x7f84e40d2610 2023-10-18T12:19:14.073 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.065+0000 7f84e2ffd700 1 --2- 172.21.15.172:0/1077359687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84e40d2610 0x7f84e40d2de0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f84d800e840 tx=0x7f84d800eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:14.073 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.065+0000 7f84cbfff700 1 -- 172.21.15.172:0/1077359687 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d8013680 con 0x7f84e40d2610 2023-10-18T12:19:14.073 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.065+0000 7f84cbfff700 1 -- 172.21.15.172:0/1077359687 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d80137e0 con 0x7f84e40d2610 2023-10-18T12:19:14.073 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.065+0000 7f84ea21d700 1 -- 172.21.15.172:0/1077359687 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84e414f5a0 con 0x7f84e40d2610 2023-10-18T12:19:14.074 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.065+0000 7f84cbfff700 1 -- 172.21.15.172:0/1077359687 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d8013b70 con 0x7f84e40d2610 2023-10-18T12:19:14.074 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.065+0000 7f84ea21d700 1 -- 172.21.15.172:0/1077359687 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84e414c830 con 0x7f84e40d2610 2023-10-18T12:19:14.074 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.065+0000 7f84cbfff700 1 -- 172.21.15.172:0/1077359687 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f84d8005a40 con 0x7f84e40d2610 2023-10-18T12:19:14.074 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.065+0000 7f84cbfff700 1 -- 172.21.15.172:0/1077359687 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f84d8005cf0 con 0x7f84e40d2610 2023-10-18T12:19:14.075 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.069+0000 7f84ea21d700 1 -- 172.21.15.172:0/1077359687 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84e414ee40 con 0x7f84e40d2610 2023-10-18T12:19:14.077 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.073+0000 7f84cbfff700 1 -- 172.21.15.172:0/1077359687 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f84e414ee40 con 0x7f84e40d2610 2023-10-18T12:19:14.086 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-10-18T12:19:14.080+0000 7f83947eb2c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-18T12:19:14.114 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-10-18T12:19:14.109+0000 7f7f0c1042c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-18T12:19:14.164 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-10-18T12:19:14.160+0000 7f83947eb2c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-18T12:19:14.175 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.169+0000 7f84ea21d700 1 -- 172.21.15.172:0/1077359687 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f3d4dbd5-521c-4dd2-b687-5768cc7d0938", "id": 2} v 0) v1 -- 0x7f84e4072e60 con 0x7f84e40d2610 2023-10-18T12:19:14.186 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.181+0000 7f84cbfff700 1 -- 172.21.15.172:0/1077359687 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f3d4dbd5-521c-4dd2-b687-5768cc7d0938", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f84d8029020 con 0x7f84e40d2610 2023-10-18T12:19:14.187 INFO:teuthology.orchestra.run.smithi172.stdout:2 2023-10-18T12:19:14.188 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.181+0000 7f84ea21d700 1 -- 172.21.15.172:0/1077359687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84e40d2610 msgr2=0x7f84e40d2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:14.188 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.181+0000 7f84ea21d700 1 --2- 172.21.15.172:0/1077359687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84e40d2610 0x7f84e40d2de0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f84d800e840 tx=0x7f84d800eb50 comp rx=0 tx=0).stop 2023-10-18T12:19:14.188 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.181+0000 7f84ea21d700 1 -- 172.21.15.172:0/1077359687 shutdown_connections 2023-10-18T12:19:14.188 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.181+0000 7f84ea21d700 1 --2- 172.21.15.172:0/1077359687 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f84e415e7d0 0x7f84e40d3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:14.188 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.181+0000 7f84ea21d700 1 --2- 172.21.15.172:0/1077359687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84e40d2610 0x7f84e40d2de0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:14.189 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.181+0000 7f84ea21d700 1 --2- 172.21.15.172:0/1077359687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84e40b1e60 0x7f84e414b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:14.189 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.181+0000 7f84ea21d700 1 -- 172.21.15.172:0/1077359687 >> 172.21.15.172:0/1077359687 conn(0x7f84e4069f20 msgr2=0x7f84e415f760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:14.189 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.181+0000 7f84ea21d700 1 -- 172.21.15.172:0/1077359687 shutdown_connections 2023-10-18T12:19:14.189 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.181+0000 7f84ea21d700 1 -- 172.21.15.172:0/1077359687 wait complete. 2023-10-18T12:19:14.193 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-10-18T12:19:14.189+0000 7f7f0c1042c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-18T12:19:14.207 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new 823e5802-92b7-4f0d-b32d-a5748993f1b8 3 2023-10-18T12:19:14.365 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.361+0000 7f7cbcc7b700 1 Processor -- start 2023-10-18T12:19:14.365 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.361+0000 7f7cbcc7b700 1 -- start start 2023-10-18T12:19:14.368 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.365+0000 7f7cbcc7b700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7cb81464e0 0x7f7cb80b7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:14.369 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.365+0000 7f7cbcc7b700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb80b5d20 con 0x7f7cb81468c0 2023-10-18T12:19:14.369 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.365+0000 7f7cbcc7b700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb80b6000 con 0x7f7cb80700c0 2023-10-18T12:19:14.369 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.365+0000 7f7cbcc7b700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cb80b62e0 con 0x7f7cb81464e0 2023-10-18T12:19:14.370 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.365+0000 7f7cb6d9d700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f7cb80700c0 0x7f7cb80d0900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:57870/0 (socket says 172.21.15.172:57870) 2023-10-18T12:19:14.370 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.365+0000 7f7cb6d9d700 1 -- 172.21.15.172:0/751462141 learned_addr learned my addr 172.21.15.172:0/751462141 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-10-18T12:19:14.370 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.365+0000 7f7cb659c700 1 --2- 172.21.15.172:0/751462141 >> v2:172.21.15.114:3300/0 conn(0x7f7cb81464e0 0x7f7cb80b7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:14.371 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.365+0000 7f7cb659c700 1 -- 172.21.15.172:0/751462141 >> v1:172.21.15.172:6789/0 conn(0x7f7cb80700c0 legacy=0x7f7cb80d0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:14.371 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.365+0000 7f7cb559a700 1 -- 172.21.15.172:0/751462141 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 109830424 0 0) 0x7f7cb80b6000 con 0x7f7cb80700c0 2023-10-18T12:19:14.371 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.365+0000 7f7cb659c700 1 -- 172.21.15.172:0/751462141 >> v1:172.21.15.114:6789/0 conn(0x7f7cb81468c0 legacy=0x7f7cb806f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:14.371 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.365+0000 7f7cb659c700 1 -- 172.21.15.172:0/751462141 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb80b65c0 con 0x7f7cb81464e0 2023-10-18T12:19:14.372 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.365+0000 7f7cb659c700 1 --2- 172.21.15.172:0/751462141 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cb81464e0 0x7f7cb80b7650 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8009850 tx=0x7f7ca8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e21357c23f835e1c server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:14.372 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.365+0000 7f7cb559a700 1 -- 172.21.15.172:0/751462141 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca8011830 con 0x7f7cb81464e0 2023-10-18T12:19:14.373 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.365+0000 7f7cb559a700 1 -- 172.21.15.172:0/751462141 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca8011990 con 0x7f7cb81464e0 2023-10-18T12:19:14.373 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.365+0000 7f7cb559a700 1 -- 172.21.15.172:0/751462141 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca8011d20 con 0x7f7cb81464e0 2023-10-18T12:19:14.373 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.369+0000 7f7cbcc7b700 1 -- 172.21.15.172:0/751462141 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cb81464e0 msgr2=0x7f7cb80b7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:14.373 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.369+0000 7f7cbcc7b700 1 --2- 172.21.15.172:0/751462141 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cb81464e0 0x7f7cb80b7650 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8009850 tx=0x7f7ca8009b60 comp rx=0 tx=0).stop 2023-10-18T12:19:14.374 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.369+0000 7f7cbcc7b700 1 -- 172.21.15.172:0/751462141 shutdown_connections 2023-10-18T12:19:14.374 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.369+0000 7f7cbcc7b700 1 --2- 172.21.15.172:0/751462141 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cb81464e0 0x7f7cb80b7650 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:14.374 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.369+0000 7f7cbcc7b700 1 -- 172.21.15.172:0/751462141 >> 172.21.15.172:0/751462141 conn(0x7f7cb806a130 msgr2=0x7f7cb806a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:14.375 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.369+0000 7f7cbcc7b700 1 -- 172.21.15.172:0/751462141 shutdown_connections 2023-10-18T12:19:14.375 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.369+0000 7f7cbcc7b700 1 -- 172.21.15.172:0/751462141 wait complete. 2023-10-18T12:19:14.375 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.369+0000 7f7cbcc7b700 1 Processor -- start 2023-10-18T12:19:14.376 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.373+0000 7f7cbcc7b700 1 -- start start 2023-10-18T12:19:14.378 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.373+0000 7f7cbcc7b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7cb80700c0 0x7f7cb81f2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:14.378 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.373+0000 7f7cbcc7b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7cb81464e0 0x7f7cb8144890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:14.378 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.373+0000 7f7cbcc7b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cb81468c0 0x7f7cb8144dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:14.378 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.373+0000 7f7cbcc7b700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb81580f0 con 0x7f7cb81468c0 2023-10-18T12:19:14.378 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.373+0000 7f7cbcc7b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb8158340 con 0x7f7cb80700c0 2023-10-18T12:19:14.379 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.373+0000 7f7cbcc7b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb8158620 con 0x7f7cb81464e0 2023-10-18T12:19:14.380 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.373+0000 7f7cb659c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7cb80700c0 0x7f7cb81f2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:14.380 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.373+0000 7f7cb5d9b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7cb81464e0 0x7f7cb8144890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:14.380 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.373+0000 7f7cb659c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7cb80700c0 0x7f7cb81f2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:53162/0 (socket says 172.21.15.172:53162) 2023-10-18T12:19:14.381 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.373+0000 7f7cb659c700 1 -- 172.21.15.172:0/3557229031 learned_addr learned my addr 172.21.15.172:0/3557229031 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-10-18T12:19:14.381 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.373+0000 7f7cb6d9d700 1 --2- 172.21.15.172:0/3557229031 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cb81468c0 0x7f7cb8144dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:14.381 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.373+0000 7f7cb659c700 1 -- 172.21.15.172:0/3557229031 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7cb81464e0 msgr2=0x7f7cb8144890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:14.381 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.373+0000 7f7cb659c700 1 --2- 172.21.15.172:0/3557229031 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7cb81464e0 0x7f7cb8144890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:14.381 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.373+0000 7f7cb659c700 1 -- 172.21.15.172:0/3557229031 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cb81468c0 msgr2=0x7f7cb8144dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:14.382 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.373+0000 7f7cb659c700 1 --2- 172.21.15.172:0/3557229031 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cb81468c0 0x7f7cb8144dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:14.382 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.373+0000 7f7cb659c700 1 -- 172.21.15.172:0/3557229031 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca80094b0 con 0x7f7cb80700c0 2023-10-18T12:19:14.382 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.373+0000 7f7cb659c700 1 --2- 172.21.15.172:0/3557229031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7cb80700c0 0x7f7cb81f2800 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8009fd0 tx=0x7f7ca8004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:14.382 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.373+0000 7f7ca6ffd700 1 -- 172.21.15.172:0/3557229031 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca800bb60 con 0x7f7cb80700c0 2023-10-18T12:19:14.382 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.373+0000 7f7ca6ffd700 1 -- 172.21.15.172:0/3557229031 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca801f070 con 0x7f7cb80700c0 2023-10-18T12:19:14.383 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.373+0000 7f7ca6ffd700 1 -- 172.21.15.172:0/3557229031 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca800bec0 con 0x7f7cb80700c0 2023-10-18T12:19:14.383 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.373+0000 7f7cbcc7b700 1 -- 172.21.15.172:0/3557229031 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb8158900 con 0x7f7cb80700c0 2023-10-18T12:19:14.383 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.377+0000 7f7cbcc7b700 1 -- 172.21.15.172:0/3557229031 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb8158ec0 con 0x7f7cb80700c0 2023-10-18T12:19:14.384 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.377+0000 7f7ca6ffd700 1 -- 172.21.15.172:0/3557229031 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7ca801a730 con 0x7f7cb80700c0 2023-10-18T12:19:14.384 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.377+0000 7f7ca6ffd700 1 -- 172.21.15.172:0/3557229031 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f7ca8021070 con 0x7f7cb80700c0 2023-10-18T12:19:14.384 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.377+0000 7f7cbcc7b700 1 -- 172.21.15.172:0/3557229031 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cb81590e0 con 0x7f7cb80700c0 2023-10-18T12:19:14.386 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.381+0000 7f7ca6ffd700 1 -- 172.21.15.172:0/3557229031 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f7ca802a020 con 0x7f7cb80700c0 2023-10-18T12:19:14.425 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-10-18T12:19:14.420+0000 7f83947eb2c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-18T12:19:14.461 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-10-18T12:19:14.457+0000 7f7f0c1042c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-18T12:19:14.486 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.481+0000 7f7cbcc7b700 1 -- 172.21.15.172:0/3557229031 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd new", "uuid": "823e5802-92b7-4f0d-b32d-a5748993f1b8", "id": 3} v 0) v1 -- 0x7f7cb815e2d0 con 0x7f7cb80700c0 2023-10-18T12:19:14.497 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.493+0000 7f7ca6ffd700 1 -- 172.21.15.172:0/3557229031 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "823e5802-92b7-4f0d-b32d-a5748993f1b8", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7ca8015020 con 0x7f7cb80700c0 2023-10-18T12:19:14.498 INFO:teuthology.orchestra.run.smithi172.stdout:3 2023-10-18T12:19:14.499 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.493+0000 7f7cbcc7b700 1 -- 172.21.15.172:0/3557229031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7cb80700c0 msgr2=0x7f7cb81f2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:14.499 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.493+0000 7f7cbcc7b700 1 --2- 172.21.15.172:0/3557229031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7cb80700c0 0x7f7cb81f2800 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8009fd0 tx=0x7f7ca8004770 comp rx=0 tx=0).stop 2023-10-18T12:19:14.499 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.493+0000 7f7cbcc7b700 1 -- 172.21.15.172:0/3557229031 shutdown_connections 2023-10-18T12:19:14.499 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.493+0000 7f7cbcc7b700 1 --2- 172.21.15.172:0/3557229031 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7cb81464e0 0x7f7cb8144890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:14.500 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.493+0000 7f7cbcc7b700 1 --2- 172.21.15.172:0/3557229031 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7cb81468c0 0x7f7cb8144dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:14.500 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.493+0000 7f7cbcc7b700 1 --2- 172.21.15.172:0/3557229031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7cb80700c0 0x7f7cb81f2800 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:14.500 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.493+0000 7f7cbcc7b700 1 -- 172.21.15.172:0/3557229031 >> 172.21.15.172:0/3557229031 conn(0x7f7cb806a130 msgr2=0x7f7cb815f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:14.500 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.493+0000 7f7cbcc7b700 1 -- 172.21.15.172:0/3557229031 shutdown_connections 2023-10-18T12:19:14.500 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.493+0000 7f7cbcc7b700 1 -- 172.21.15.172:0/3557229031 wait complete. 2023-10-18T12:19:14.521 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new e47fb93e-13b4-44a4-b084-8c4384ceb41e 4 2023-10-18T12:19:14.522 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-10-18T12:19:14.516+0000 7f83947eb2c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-18T12:19:14.551 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-10-18T12:19:14.545+0000 7f7f0c1042c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-18T12:19:14.623 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-10-18T12:19:14.620+0000 7f83947eb2c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-18T12:19:14.649 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-10-18T12:19:14.645+0000 7f7f0c1042c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-18T12:19:14.684 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.677+0000 7f5a49acb700 1 Processor -- start 2023-10-18T12:19:14.685 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.681+0000 7f5a49acb700 1 -- start start 2023-10-18T12:19:14.686 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.681+0000 7f5a49acb700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a440d2e00 0x7f5a440b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:14.687 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.681+0000 7f5a49acb700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5a44160710 0x7f5a440d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:14.688 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.681+0000 7f5a49acb700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a4415d0d0 con 0x7f5a440b5ae0 2023-10-18T12:19:14.688 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.681+0000 7f5a49acb700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a4415df90 con 0x7f5a44160710 2023-10-18T12:19:14.688 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.681+0000 7f5a49acb700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4406f0f0 con 0x7f5a440d2e00 2023-10-18T12:19:14.688 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.681+0000 7f5a48ac9700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a440d2e00 0x7f5a440b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:14.689 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.681+0000 7f5a43fff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5a44160710 0x7f5a440d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:14.689 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.681+0000 7f5a48ac9700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a440d2e00 0x7f5a440b6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.172:33924/0 (socket says 172.21.15.172:33924) 2023-10-18T12:19:14.689 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.681+0000 7f5a48ac9700 1 -- 172.21.15.172:0/454083807 learned_addr learned my addr 172.21.15.172:0/454083807 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-10-18T12:19:14.689 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.681+0000 7f5a43fff700 1 -- 172.21.15.172:0/454083807 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a440d2e00 msgr2=0x7f5a440b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:14.689 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.681+0000 7f5a43fff700 1 --2- 172.21.15.172:0/454083807 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a440d2e00 0x7f5a440b6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:14.690 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.681+0000 7f5a43fff700 1 -- 172.21.15.172:0/454083807 >> v1:172.21.15.114:6789/0 conn(0x7f5a440b5ae0 legacy=0x7f5a4406db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:14.690 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.681+0000 7f5a43fff700 1 -- 172.21.15.172:0/454083807 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a440d3720 con 0x7f5a44160710 2023-10-18T12:19:14.690 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.685+0000 7f5a43fff700 1 --2- 172.21.15.172:0/454083807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a44160710 0x7f5a440d31e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5a30009880 tx=0x7f5a30009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82e1fd4d79f432b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:14.691 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.685+0000 7f5a437fe700 1 -- 172.21.15.172:0/454083807 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a30011830 con 0x7f5a44160710 2023-10-18T12:19:14.691 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.685+0000 7f5a437fe700 1 -- 172.21.15.172:0/454083807 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a30011990 con 0x7f5a44160710 2023-10-18T12:19:14.692 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.685+0000 7f5a437fe700 1 -- 172.21.15.172:0/454083807 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a30011d20 con 0x7f5a44160710 2023-10-18T12:19:14.692 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.685+0000 7f5a49acb700 1 -- 172.21.15.172:0/454083807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a44160710 msgr2=0x7f5a440d31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:14.692 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.685+0000 7f5a49acb700 1 --2- 172.21.15.172:0/454083807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a44160710 0x7f5a440d31e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5a30009880 tx=0x7f5a30009b90 comp rx=0 tx=0).stop 2023-10-18T12:19:14.692 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.685+0000 7f5a49acb700 1 -- 172.21.15.172:0/454083807 shutdown_connections 2023-10-18T12:19:14.692 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.685+0000 7f5a49acb700 1 --2- 172.21.15.172:0/454083807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a44160710 0x7f5a440d31e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:14.693 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.685+0000 7f5a49acb700 1 --2- 172.21.15.172:0/454083807 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a440d2e00 0x7f5a440b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:14.693 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.685+0000 7f5a49acb700 1 -- 172.21.15.172:0/454083807 >> 172.21.15.172:0/454083807 conn(0x7f5a44069f20 msgr2=0x7f5a4406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:14.693 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.685+0000 7f5a49acb700 1 -- 172.21.15.172:0/454083807 shutdown_connections 2023-10-18T12:19:14.693 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.685+0000 7f5a49acb700 1 -- 172.21.15.172:0/454083807 wait complete. 2023-10-18T12:19:14.694 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.689+0000 7f5a49acb700 1 Processor -- start 2023-10-18T12:19:14.694 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.689+0000 7f5a49acb700 1 -- start start 2023-10-18T12:19:14.696 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.689+0000 7f5a49acb700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a440b5ae0 0x7f5a441faaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:14.696 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.689+0000 7f5a49acb700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a440d2e00 0x7f5a44157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:14.696 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.689+0000 7f5a49acb700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a44160710 0x7f5a441596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:14.696 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.689+0000 7f5a49acb700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4408c5a0 con 0x7f5a440b5ae0 2023-10-18T12:19:14.697 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.689+0000 7f5a49acb700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a441fa030 con 0x7f5a44160710 2023-10-18T12:19:14.697 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.689+0000 7f5a49acb700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a441580d0 con 0x7f5a440d2e00 2023-10-18T12:19:14.697 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.689+0000 7f5a43fff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a440d2e00 0x7f5a44157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:14.697 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.689+0000 7f5a492ca700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a44160710 0x7f5a441596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:14.697 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.689+0000 7f5a43fff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a440d2e00 0x7f5a44157b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.172:33928/0 (socket says 172.21.15.172:33928) 2023-10-18T12:19:14.698 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.689+0000 7f5a43fff700 1 -- 172.21.15.172:0/1579966140 learned_addr learned my addr 172.21.15.172:0/1579966140 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-10-18T12:19:14.698 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.689+0000 7f5a48ac9700 1 --2- 172.21.15.172:0/1579966140 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a440b5ae0 0x7f5a441faaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:14.698 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.689+0000 7f5a43fff700 1 -- 172.21.15.172:0/1579966140 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a44160710 msgr2=0x7f5a441596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:14.698 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.689+0000 7f5a43fff700 1 --2- 172.21.15.172:0/1579966140 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a44160710 0x7f5a441596c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:14.698 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.689+0000 7f5a43fff700 1 -- 172.21.15.172:0/1579966140 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a440b5ae0 msgr2=0x7f5a441faaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:14.699 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.689+0000 7f5a43fff700 1 --2- 172.21.15.172:0/1579966140 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a440b5ae0 0x7f5a441faaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:14.699 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.689+0000 7f5a43fff700 1 -- 172.21.15.172:0/1579966140 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a300094b0 con 0x7f5a440d2e00 2023-10-18T12:19:14.699 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.689+0000 7f5a43fff700 1 --2- 172.21.15.172:0/1579966140 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a440d2e00 0x7f5a44157b90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5a30014040 tx=0x7f5a30004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:14.700 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.693+0000 7f5a417fa700 1 -- 172.21.15.172:0/1579966140 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a30004550 con 0x7f5a440d2e00 2023-10-18T12:19:14.701 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.693+0000 7f5a417fa700 1 -- 172.21.15.172:0/1579966140 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3001e070 con 0x7f5a440d2e00 2023-10-18T12:19:14.701 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.693+0000 7f5a49acb700 1 -- 172.21.15.172:0/1579966140 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a4415a180 con 0x7f5a440d2e00 2023-10-18T12:19:14.702 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.693+0000 7f5a417fa700 1 -- 172.21.15.172:0/1579966140 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a30003900 con 0x7f5a440d2e00 2023-10-18T12:19:14.702 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.693+0000 7f5a49acb700 1 -- 172.21.15.172:0/1579966140 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a441fa580 con 0x7f5a440d2e00 2023-10-18T12:19:14.702 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.693+0000 7f5a417fa700 1 -- 172.21.15.172:0/1579966140 <== mon.2 v2:172.21.15.172:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5a3001a420 con 0x7f5a440d2e00 2023-10-18T12:19:14.702 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.693+0000 7f5a417fa700 1 -- 172.21.15.172:0/1579966140 <== mon.2 v2:172.21.15.172:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f5a30003d60 con 0x7f5a440d2e00 2023-10-18T12:19:14.703 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.693+0000 7f5a49acb700 1 -- 172.21.15.172:0/1579966140 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a4404e910 con 0x7f5a440d2e00 2023-10-18T12:19:14.703 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.697+0000 7f5a417fa700 1 -- 172.21.15.172:0/1579966140 <== mon.2 v2:172.21.15.172:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f5a30032060 con 0x7f5a440d2e00 2023-10-18T12:19:14.800 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.797+0000 7f5a49acb700 1 -- 172.21.15.172:0/1579966140 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e47fb93e-13b4-44a4-b084-8c4384ceb41e", "id": 4} v 0) v1 -- 0x7f5a440b7a00 con 0x7f5a440d2e00 2023-10-18T12:19:14.811 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.805+0000 7f5a417fa700 1 -- 172.21.15.172:0/1579966140 <== mon.2 v2:172.21.15.172:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e47fb93e-13b4-44a4-b084-8c4384ceb41e", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5a30020070 con 0x7f5a440d2e00 2023-10-18T12:19:14.811 INFO:teuthology.orchestra.run.smithi172.stdout:4 2023-10-18T12:19:14.813 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.809+0000 7f5a49acb700 1 -- 172.21.15.172:0/1579966140 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a440d2e00 msgr2=0x7f5a44157b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:14.813 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.809+0000 7f5a49acb700 1 --2- 172.21.15.172:0/1579966140 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a440d2e00 0x7f5a44157b90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5a30014040 tx=0x7f5a30004770 comp rx=0 tx=0).stop 2023-10-18T12:19:14.814 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.809+0000 7f5a49acb700 1 -- 172.21.15.172:0/1579966140 shutdown_connections 2023-10-18T12:19:14.814 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.809+0000 7f5a49acb700 1 --2- 172.21.15.172:0/1579966140 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5a440d2e00 0x7f5a44157b90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:14.814 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.809+0000 7f5a49acb700 1 --2- 172.21.15.172:0/1579966140 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5a44160710 0x7f5a441596c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:14.815 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.809+0000 7f5a49acb700 1 --2- 172.21.15.172:0/1579966140 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5a440b5ae0 0x7f5a441faaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:14.815 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.809+0000 7f5a49acb700 1 -- 172.21.15.172:0/1579966140 >> 172.21.15.172:0/1579966140 conn(0x7f5a44069f20 msgr2=0x7f5a440b3970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:14.815 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.809+0000 7f5a49acb700 1 -- 172.21.15.172:0/1579966140 shutdown_connections 2023-10-18T12:19:14.815 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:14.809+0000 7f5a49acb700 1 -- 172.21.15.172:0/1579966140 wait complete. 2023-10-18T12:19:14.835 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new 7561a973-f479-45a0-af40-f324728d622e 5 2023-10-18T12:19:15.061 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.057+0000 7f5f6ed7f700 1 Processor -- start 2023-10-18T12:19:15.061 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.057+0000 7f5f6ed7f700 1 -- start start 2023-10-18T12:19:15.063 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.057+0000 7f5f6ed7f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f680b5b80 0x7f5f6815d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:15.064 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.057+0000 7f5f6ed7f700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f68146ba0 con 0x7f5f6806f9a0 2023-10-18T12:19:15.064 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.057+0000 7f5f6ed7f700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f680d0920 con 0x7f5f681467c0 2023-10-18T12:19:15.064 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.057+0000 7f5f6ed7f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f680b6160 con 0x7f5f680b5b80 2023-10-18T12:19:15.064 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.057+0000 7f5f6cb1b700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f5f681467c0 0x7f5f681612e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:57872/0 (socket says 172.21.15.172:57872) 2023-10-18T12:19:15.065 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.057+0000 7f5f6cb1b700 1 -- 172.21.15.172:0/3800138712 learned_addr learned my addr 172.21.15.172:0/3800138712 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-10-18T12:19:15.065 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.057+0000 7f5f67fff700 1 --2- 172.21.15.172:0/3800138712 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f680b5b80 0x7f5f6815d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:15.066 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.061+0000 7f5f677fe700 1 -- 172.21.15.172:0/3800138712 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 185212948 0 0) 0x7f5f680d0920 con 0x7f5f681467c0 2023-10-18T12:19:15.066 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.061+0000 7f5f677fe700 1 -- 172.21.15.172:0/3800138712 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f580035d0 con 0x7f5f681467c0 2023-10-18T12:19:15.066 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.061+0000 7f5f67fff700 1 -- 172.21.15.172:0/3800138712 >> v1:172.21.15.172:6789/0 conn(0x7f5f681467c0 legacy=0x7f5f681612e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:15.067 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.061+0000 7f5f67fff700 1 -- 172.21.15.172:0/3800138712 >> v1:172.21.15.114:6789/0 conn(0x7f5f6806f9a0 legacy=0x7f5f680d0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:15.067 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.061+0000 7f5f67fff700 1 -- 172.21.15.172:0/3800138712 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f680b6440 con 0x7f5f680b5b80 2023-10-18T12:19:15.067 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.061+0000 7f5f67fff700 1 --2- 172.21.15.172:0/3800138712 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f680b5b80 0x7f5f6815d310 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5f54009880 tx=0x7f5f54009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4a640e22b451d68 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:15.067 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.061+0000 7f5f677fe700 1 -- 172.21.15.172:0/3800138712 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f54011830 con 0x7f5f680b5b80 2023-10-18T12:19:15.067 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.061+0000 7f5f677fe700 1 -- 172.21.15.172:0/3800138712 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f54011990 con 0x7f5f680b5b80 2023-10-18T12:19:15.068 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.061+0000 7f5f677fe700 1 -- 172.21.15.172:0/3800138712 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f54011d20 con 0x7f5f680b5b80 2023-10-18T12:19:15.068 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.061+0000 7f5f6ed7f700 1 -- 172.21.15.172:0/3800138712 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f680b5b80 msgr2=0x7f5f6815d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:15.069 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.061+0000 7f5f6ed7f700 1 --2- 172.21.15.172:0/3800138712 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f680b5b80 0x7f5f6815d310 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5f54009880 tx=0x7f5f54009b90 comp rx=0 tx=0).stop 2023-10-18T12:19:15.069 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.061+0000 7f5f6ed7f700 1 -- 172.21.15.172:0/3800138712 shutdown_connections 2023-10-18T12:19:15.069 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.061+0000 7f5f6ed7f700 1 --2- 172.21.15.172:0/3800138712 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f680b5b80 0x7f5f6815d310 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:15.069 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.061+0000 7f5f6ed7f700 1 -- 172.21.15.172:0/3800138712 >> 172.21.15.172:0/3800138712 conn(0x7f5f6806a130 msgr2=0x7f5f6806a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:15.070 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.061+0000 7f5f6ed7f700 1 -- 172.21.15.172:0/3800138712 shutdown_connections 2023-10-18T12:19:15.070 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.061+0000 7f5f6ed7f700 1 -- 172.21.15.172:0/3800138712 wait complete. 2023-10-18T12:19:15.071 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.065+0000 7f5f6ed7f700 1 Processor -- start 2023-10-18T12:19:15.071 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.065+0000 7f5f6ed7f700 1 -- start start 2023-10-18T12:19:15.071 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.065+0000 7f5f6ed7f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f6806f9a0 0x7f5f681f6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:15.072 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.065+0000 7f5f6ed7f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f680b5b80 0x7f5f681f2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:15.072 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.065+0000 7f5f6ed7f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f681467c0 0x7f5f6813fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:15.072 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.065+0000 7f5f6ed7f700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f681f6eb0 con 0x7f5f681467c0 2023-10-18T12:19:15.072 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.065+0000 7f5f6ed7f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f681f2e40 con 0x7f5f680b5b80 2023-10-18T12:19:15.072 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.065+0000 7f5f6ed7f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6813ee60 con 0x7f5f6806f9a0 2023-10-18T12:19:15.073 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.065+0000 7f5f67fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f680b5b80 0x7f5f681f2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:15.073 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.065+0000 7f5f6cb1b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f6806f9a0 0x7f5f681f6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:15.073 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.065+0000 7f5f67fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f680b5b80 0x7f5f681f2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:53180/0 (socket says 172.21.15.172:53180) 2023-10-18T12:19:15.073 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.065+0000 7f5f67fff700 1 -- 172.21.15.172:0/2971624303 learned_addr learned my addr 172.21.15.172:0/2971624303 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-10-18T12:19:15.074 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.065+0000 7f5f6d31c700 1 --2- 172.21.15.172:0/2971624303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f681467c0 0x7f5f6813fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:15.075 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.065+0000 7f5f67fff700 1 -- 172.21.15.172:0/2971624303 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f6806f9a0 msgr2=0x7f5f681f6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:15.075 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.065+0000 7f5f67fff700 1 --2- 172.21.15.172:0/2971624303 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f6806f9a0 0x7f5f681f6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:15.075 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.065+0000 7f5f67fff700 1 -- 172.21.15.172:0/2971624303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f681467c0 msgr2=0x7f5f6813fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:15.076 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.065+0000 7f5f67fff700 1 --2- 172.21.15.172:0/2971624303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f681467c0 0x7f5f6813fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:15.076 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.065+0000 7f5f67fff700 1 -- 172.21.15.172:0/2971624303 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f540094b0 con 0x7f5f680b5b80 2023-10-18T12:19:15.076 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.065+0000 7f5f6cb1b700 1 --2- 172.21.15.172:0/2971624303 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f6806f9a0 0x7f5f681f6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:19:15.076 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.069+0000 7f5f67fff700 1 --2- 172.21.15.172:0/2971624303 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f680b5b80 0x7f5f681f2900 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5f54013040 tx=0x7f5f54004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:15.077 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.069+0000 7f5f657fa700 1 -- 172.21.15.172:0/2971624303 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f54004610 con 0x7f5f680b5b80 2023-10-18T12:19:15.077 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.069+0000 7f5f657fa700 1 -- 172.21.15.172:0/2971624303 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f540036c0 con 0x7f5f680b5b80 2023-10-18T12:19:15.077 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.069+0000 7f5f6ed7f700 1 -- 172.21.15.172:0/2971624303 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f680c7e80 con 0x7f5f680b5b80 2023-10-18T12:19:15.077 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.069+0000 7f5f657fa700 1 -- 172.21.15.172:0/2971624303 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f54003a50 con 0x7f5f680b5b80 2023-10-18T12:19:15.077 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.069+0000 7f5f6ed7f700 1 -- 172.21.15.172:0/2971624303 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f680c8440 con 0x7f5f680b5b80 2023-10-18T12:19:15.078 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.069+0000 7f5f657fa700 1 -- 172.21.15.172:0/2971624303 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5f54025410 con 0x7f5f680b5b80 2023-10-18T12:19:15.078 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.069+0000 7f5f657fa700 1 -- 172.21.15.172:0/2971624303 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f5f54025c40 con 0x7f5f680b5b80 2023-10-18T12:19:15.078 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.069+0000 7f5f6ed7f700 1 -- 172.21.15.172:0/2971624303 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f68072e60 con 0x7f5f680b5b80 2023-10-18T12:19:15.079 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.073+0000 7f5f657fa700 1 -- 172.21.15.172:0/2971624303 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f5f540256c0 con 0x7f5f680b5b80 2023-10-18T12:19:15.140 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-10-18T12:19:15.136+0000 7f83947eb2c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-18T12:19:15.175 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-10-18T12:19:15.169+0000 7f7f0c1042c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-18T12:19:15.181 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.177+0000 7f5f6ed7f700 1 -- 172.21.15.172:0/2971624303 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7561a973-f479-45a0-af40-f324728d622e", "id": 5} v 0) v1 -- 0x7f5f680b7200 con 0x7f5f680b5b80 2023-10-18T12:19:15.192 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.185+0000 7f5f657fa700 1 -- 172.21.15.172:0/2971624303 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7561a973-f479-45a0-af40-f324728d622e", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5f54025860 con 0x7f5f680b5b80 2023-10-18T12:19:15.192 INFO:teuthology.orchestra.run.smithi172.stdout:5 2023-10-18T12:19:15.193 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.189+0000 7f5f6ed7f700 1 -- 172.21.15.172:0/2971624303 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f680b5b80 msgr2=0x7f5f681f2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:15.193 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.189+0000 7f5f6ed7f700 1 --2- 172.21.15.172:0/2971624303 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f680b5b80 0x7f5f681f2900 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5f54013040 tx=0x7f5f54004770 comp rx=0 tx=0).stop 2023-10-18T12:19:15.194 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.189+0000 7f5f6ed7f700 1 -- 172.21.15.172:0/2971624303 shutdown_connections 2023-10-18T12:19:15.194 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.189+0000 7f5f6ed7f700 1 --2- 172.21.15.172:0/2971624303 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5f681467c0 0x7f5f6813fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:15.194 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.189+0000 7f5f6ed7f700 1 --2- 172.21.15.172:0/2971624303 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f680b5b80 0x7f5f681f2900 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:15.195 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.189+0000 7f5f6ed7f700 1 --2- 172.21.15.172:0/2971624303 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5f6806f9a0 0x7f5f681f6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:15.195 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.189+0000 7f5f6ed7f700 1 -- 172.21.15.172:0/2971624303 >> 172.21.15.172:0/2971624303 conn(0x7f5f6806a130 msgr2=0x7f5f6806cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:15.195 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.189+0000 7f5f6ed7f700 1 -- 172.21.15.172:0/2971624303 shutdown_connections 2023-10-18T12:19:15.195 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.189+0000 7f5f6ed7f700 1 -- 172.21.15.172:0/2971624303 wait complete. 2023-10-18T12:19:15.212 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new 51753f4b-7f06-4f1c-9ec7-6e18a66eb980 6 2023-10-18T12:19:15.321 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-10-18T12:19:15.316+0000 7f83947eb2c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-18T12:19:15.366 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-10-18T12:19:15.361+0000 7f7f0c1042c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-18T12:19:15.381 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.377+0000 7f1af3040700 1 Processor -- start 2023-10-18T12:19:15.381 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.377+0000 7f1af3040700 1 -- start start 2023-10-18T12:19:15.385 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.381+0000 7f1af3040700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1aec15dcf0 0x7f1aec06fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:15.385 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.381+0000 7f1af3040700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1aec0d2e20 0x7f1aec0d3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:15.386 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.381+0000 7f1af3040700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aec0d37a0 con 0x7f1aec0d23e0 2023-10-18T12:19:15.386 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.381+0000 7f1af3040700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aec15e160 con 0x7f1aec15dcf0 2023-10-18T12:19:15.386 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.381+0000 7f1af3040700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec0b6e40 con 0x7f1aec0d2e20 2023-10-18T12:19:15.388 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.381+0000 7f1af203e700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f1aec0d23e0 0x7f1aec0b65f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:57886/0 (socket says 172.21.15.172:57886) 2023-10-18T12:19:15.388 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.381+0000 7f1af183d700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1aec15dcf0 0x7f1aec06fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:15.388 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.381+0000 7f1af203e700 1 -- 172.21.15.172:0/258112686 learned_addr learned my addr 172.21.15.172:0/258112686 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-10-18T12:19:15.388 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.381+0000 7f1af283f700 1 --2- 172.21.15.172:0/258112686 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1aec0d2e20 0x7f1aec0d3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:15.388 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.381+0000 7f1af283f700 1 -- 172.21.15.172:0/258112686 >> v2:172.21.15.172:3300/0 conn(0x7f1aec15dcf0 msgr2=0x7f1aec06fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:15.389 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.381+0000 7f1af283f700 1 --2- 172.21.15.172:0/258112686 >> v2:172.21.15.172:3300/0 conn(0x7f1aec15dcf0 0x7f1aec06fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:15.389 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.381+0000 7f1af283f700 1 -- 172.21.15.172:0/258112686 >> v1:172.21.15.172:6789/0 conn(0x7f1aec0d23e0 legacy=0x7f1aec0b65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:15.389 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.381+0000 7f1af283f700 1 -- 172.21.15.172:0/258112686 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aec0b7120 con 0x7f1aec0d2e20 2023-10-18T12:19:15.389 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.381+0000 7f1af183d700 1 --2- 172.21.15.172:0/258112686 >> v2:172.21.15.172:3300/0 conn(0x7f1aec15dcf0 0x7f1aec06fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:19:15.389 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.381+0000 7f1af283f700 1 --2- 172.21.15.172:0/258112686 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1aec0d2e20 0x7f1aec0d3260 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1ae4009d90 tx=0x7f1ae400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6385adcaac948a5d server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:15.390 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.381+0000 7f1af103c700 1 -- 172.21.15.172:0/258112686 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae400e070 con 0x7f1aec0d2e20 2023-10-18T12:19:15.390 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.381+0000 7f1af103c700 1 -- 172.21.15.172:0/258112686 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae400bb20 con 0x7f1aec0d2e20 2023-10-18T12:19:15.390 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.381+0000 7f1af103c700 1 -- 172.21.15.172:0/258112686 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae4012430 con 0x7f1aec0d2e20 2023-10-18T12:19:15.391 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.385+0000 7f1af3040700 1 -- 172.21.15.172:0/258112686 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1aec0d2e20 msgr2=0x7f1aec0d3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:15.391 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.385+0000 7f1af3040700 1 --2- 172.21.15.172:0/258112686 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1aec0d2e20 0x7f1aec0d3260 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1ae4009d90 tx=0x7f1ae400b330 comp rx=0 tx=0).stop 2023-10-18T12:19:15.391 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.385+0000 7f1af3040700 1 -- 172.21.15.172:0/258112686 shutdown_connections 2023-10-18T12:19:15.392 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.385+0000 7f1af3040700 1 --2- 172.21.15.172:0/258112686 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1aec0d2e20 0x7f1aec0d3260 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:15.392 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.385+0000 7f1af3040700 1 --2- 172.21.15.172:0/258112686 >> v2:172.21.15.172:3300/0 conn(0x7f1aec15dcf0 0x7f1aec06fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:15.392 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.385+0000 7f1af3040700 1 -- 172.21.15.172:0/258112686 >> 172.21.15.172:0/258112686 conn(0x7f1aec069f20 msgr2=0x7f1aec06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:15.392 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.385+0000 7f1af3040700 1 -- 172.21.15.172:0/258112686 shutdown_connections 2023-10-18T12:19:15.392 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.385+0000 7f1af3040700 1 -- 172.21.15.172:0/258112686 wait complete. 2023-10-18T12:19:15.393 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.389+0000 7f1af3040700 1 Processor -- start 2023-10-18T12:19:15.393 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.389+0000 7f1af3040700 1 -- start start 2023-10-18T12:19:15.395 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.389+0000 7f1af3040700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1aec0d23e0 0x7f1aec14b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:15.395 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.389+0000 7f1af3040700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1aec0d2e20 0x7f1aec14cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:15.395 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.389+0000 7f1af3040700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1aec15dcf0 0x7f1aec153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:15.395 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.389+0000 7f1af3040700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec15adb0 con 0x7f1aec15dcf0 2023-10-18T12:19:15.395 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.389+0000 7f1af3040700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec15a480 con 0x7f1aec0d2e20 2023-10-18T12:19:15.396 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.389+0000 7f1af3040700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec15a760 con 0x7f1aec0d23e0 2023-10-18T12:19:15.397 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.389+0000 7f1af183d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1aec0d2e20 0x7f1aec14cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:15.398 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.389+0000 7f1af183d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1aec0d2e20 0x7f1aec14cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:53200/0 (socket says 172.21.15.172:53200) 2023-10-18T12:19:15.398 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.389+0000 7f1af183d700 1 -- 172.21.15.172:0/2378703198 learned_addr learned my addr 172.21.15.172:0/2378703198 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-10-18T12:19:15.398 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.389+0000 7f1af203e700 1 --2- 172.21.15.172:0/2378703198 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1aec0d23e0 0x7f1aec14b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:15.398 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.389+0000 7f1af183d700 1 -- 172.21.15.172:0/2378703198 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1aec0d23e0 msgr2=0x7f1aec14b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:15.398 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.389+0000 7f1af183d700 1 --2- 172.21.15.172:0/2378703198 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1aec0d23e0 0x7f1aec14b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:15.399 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.389+0000 7f1af183d700 1 -- 172.21.15.172:0/2378703198 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1aec15dcf0 msgr2=0x7f1aec153320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:15.399 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.389+0000 7f1af183d700 1 --2- 172.21.15.172:0/2378703198 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1aec15dcf0 0x7f1aec153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:15.399 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.389+0000 7f1af183d700 1 -- 172.21.15.172:0/2378703198 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1adc0094b0 con 0x7f1aec0d2e20 2023-10-18T12:19:15.399 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.389+0000 7f1af203e700 1 --2- 172.21.15.172:0/2378703198 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1aec0d23e0 0x7f1aec14b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:19:15.399 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.393+0000 7f1af183d700 1 --2- 172.21.15.172:0/2378703198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1aec0d2e20 0x7f1aec14cdb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1adc00ebe0 tx=0x7f1adc009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:15.400 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.393+0000 7f1ae2ffd700 1 -- 172.21.15.172:0/2378703198 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1adc00c8b0 con 0x7f1aec0d2e20 2023-10-18T12:19:15.400 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.393+0000 7f1ae2ffd700 1 -- 172.21.15.172:0/2378703198 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1adc00ca10 con 0x7f1aec0d2e20 2023-10-18T12:19:15.400 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.393+0000 7f1af3040700 1 -- 172.21.15.172:0/2378703198 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ae4009a70 con 0x7f1aec0d2e20 2023-10-18T12:19:15.400 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.393+0000 7f1ae2ffd700 1 -- 172.21.15.172:0/2378703198 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1adc00cda0 con 0x7f1aec0d2e20 2023-10-18T12:19:15.400 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.393+0000 7f1af3040700 1 -- 172.21.15.172:0/2378703198 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aec153da0 con 0x7f1aec0d2e20 2023-10-18T12:19:15.401 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.393+0000 7f1ae2ffd700 1 -- 172.21.15.172:0/2378703198 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1adc013770 con 0x7f1aec0d2e20 2023-10-18T12:19:15.401 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.393+0000 7f1ae2ffd700 1 -- 172.21.15.172:0/2378703198 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f1adc01cd60 con 0x7f1aec0d2e20 2023-10-18T12:19:15.401 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.393+0000 7f1af3040700 1 -- 172.21.15.172:0/2378703198 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aec15af20 con 0x7f1aec0d2e20 2023-10-18T12:19:15.402 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.397+0000 7f1ae2ffd700 1 -- 172.21.15.172:0/2378703198 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f1adc021060 con 0x7f1aec0d2e20 2023-10-18T12:19:15.526 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.521+0000 7f1af3040700 1 -- 172.21.15.172:0/2378703198 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd new", "uuid": "51753f4b-7f06-4f1c-9ec7-6e18a66eb980", "id": 6} v 0) v1 -- 0x7f1aec04e910 con 0x7f1aec0d2e20 2023-10-18T12:19:15.535 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.529+0000 7f1ae2ffd700 1 -- 172.21.15.172:0/2378703198 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "51753f4b-7f06-4f1c-9ec7-6e18a66eb980", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1adc017070 con 0x7f1aec0d2e20 2023-10-18T12:19:15.535 INFO:teuthology.orchestra.run.smithi172.stdout:6 2023-10-18T12:19:15.537 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.533+0000 7f1af3040700 1 -- 172.21.15.172:0/2378703198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1aec0d2e20 msgr2=0x7f1aec14cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:15.537 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.533+0000 7f1af3040700 1 --2- 172.21.15.172:0/2378703198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1aec0d2e20 0x7f1aec14cdb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1adc00ebe0 tx=0x7f1adc009e30 comp rx=0 tx=0).stop 2023-10-18T12:19:15.537 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.533+0000 7f1af3040700 1 -- 172.21.15.172:0/2378703198 shutdown_connections 2023-10-18T12:19:15.538 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.533+0000 7f1af3040700 1 --2- 172.21.15.172:0/2378703198 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1aec15dcf0 0x7f1aec153320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:15.538 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.533+0000 7f1af3040700 1 --2- 172.21.15.172:0/2378703198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1aec0d2e20 0x7f1aec14cdb0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:15.538 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.533+0000 7f1af3040700 1 --2- 172.21.15.172:0/2378703198 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1aec0d23e0 0x7f1aec14b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:15.538 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.533+0000 7f1af3040700 1 -- 172.21.15.172:0/2378703198 >> 172.21.15.172:0/2378703198 conn(0x7f1aec069f20 msgr2=0x7f1aec15e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:15.539 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.533+0000 7f1af3040700 1 -- 172.21.15.172:0/2378703198 shutdown_connections 2023-10-18T12:19:15.539 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.533+0000 7f1af3040700 1 -- 172.21.15.172:0/2378703198 wait complete. 2023-10-18T12:19:15.561 DEBUG:teuthology.orchestra.run.smithi172:> sudo ceph --cluster ceph osd new 4d8b1e15-143d-4d17-9074-59d92f0f9af8 7 2023-10-18T12:19:15.725 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.721+0000 7fbceabe6700 1 Processor -- start 2023-10-18T12:19:15.726 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.721+0000 7fbceabe6700 1 -- start start 2023-10-18T12:19:15.728 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.725+0000 7fbceabe6700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbce406ff50 0x7fbce406e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:15.728 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.725+0000 7fbceabe6700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbce4070330 0x7fbce40cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:15.729 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.725+0000 7fbceabe6700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbce406ec70 con 0x7fbce406dea0 2023-10-18T12:19:15.729 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.725+0000 7fbceabe6700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbce406ef50 con 0x7fbce406ff50 2023-10-18T12:19:15.730 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.725+0000 7fbceabe6700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbce40c9b10 con 0x7fbce4070330 2023-10-18T12:19:15.730 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.725+0000 7fbcdbfff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbce4070330 0x7fbce40cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:15.730 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.725+0000 7fbce9183700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fbce406dea0 0x7fbce415c390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.172:57894/0 (socket says 172.21.15.172:57894) 2023-10-18T12:19:15.730 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.725+0000 7fbce9183700 1 -- 172.21.15.172:0/3747341705 learned_addr learned my addr 172.21.15.172:0/3747341705 (peer_addr_for_me v1:172.21.15.172:0/0) 2023-10-18T12:19:15.730 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.725+0000 7fbce8982700 1 --2- 172.21.15.172:0/3747341705 >> v2:172.21.15.114:3300/0 conn(0x7fbce406ff50 0x7fbce406e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:15.731 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.725+0000 7fbcdb7fe700 1 -- 172.21.15.172:0/3747341705 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2996052423 0 0) 0x7fbce406ec70 con 0x7fbce406dea0 2023-10-18T12:19:15.732 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.725+0000 7fbcdb7fe700 1 -- 172.21.15.172:0/3747341705 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbccc0035d0 con 0x7fbce406dea0 2023-10-18T12:19:15.732 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.725+0000 7fbcdbfff700 1 -- 172.21.15.172:0/3747341705 >> v2:172.21.15.114:3300/0 conn(0x7fbce406ff50 msgr2=0x7fbce406e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:15.732 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.725+0000 7fbcdbfff700 1 --2- 172.21.15.172:0/3747341705 >> v2:172.21.15.114:3300/0 conn(0x7fbce406ff50 0x7fbce406e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:15.733 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.725+0000 7fbcdbfff700 1 -- 172.21.15.172:0/3747341705 >> v1:172.21.15.172:6789/0 conn(0x7fbce406dea0 legacy=0x7fbce415c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:15.733 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.725+0000 7fbcdbfff700 1 -- 172.21.15.172:0/3747341705 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce40c9df0 con 0x7fbce4070330 2023-10-18T12:19:15.733 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.725+0000 7fbcdbfff700 1 --2- 172.21.15.172:0/3747341705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbce4070330 0x7fbce40cc3f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbce40ce780 tx=0x7fbcd4009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f2cc60bec49c519 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:15.733 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.725+0000 7fbcdb7fe700 1 -- 172.21.15.172:0/3747341705 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd4011830 con 0x7fbce4070330 2023-10-18T12:19:15.734 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.725+0000 7fbcdb7fe700 1 -- 172.21.15.172:0/3747341705 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd4011990 con 0x7fbce4070330 2023-10-18T12:19:15.734 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.725+0000 7fbcdb7fe700 1 -- 172.21.15.172:0/3747341705 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd4011d20 con 0x7fbce4070330 2023-10-18T12:19:15.735 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.729+0000 7fbceabe6700 1 -- 172.21.15.172:0/3747341705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbce4070330 msgr2=0x7fbce40cc3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:15.735 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.729+0000 7fbceabe6700 1 --2- 172.21.15.172:0/3747341705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbce4070330 0x7fbce40cc3f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbce40ce780 tx=0x7fbcd4009b30 comp rx=0 tx=0).stop 2023-10-18T12:19:15.735 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.729+0000 7fbceabe6700 1 -- 172.21.15.172:0/3747341705 shutdown_connections 2023-10-18T12:19:15.735 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.729+0000 7fbceabe6700 1 --2- 172.21.15.172:0/3747341705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbce4070330 0x7fbce40cc3f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:15.736 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.729+0000 7fbceabe6700 1 --2- 172.21.15.172:0/3747341705 >> v2:172.21.15.114:3300/0 conn(0x7fbce406ff50 0x7fbce406e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:15.736 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.729+0000 7fbceabe6700 1 -- 172.21.15.172:0/3747341705 >> 172.21.15.172:0/3747341705 conn(0x7fbce40ce820 msgr2=0x7fbce40cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:15.736 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.729+0000 7fbceabe6700 1 -- 172.21.15.172:0/3747341705 shutdown_connections 2023-10-18T12:19:15.736 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.729+0000 7fbceabe6700 1 -- 172.21.15.172:0/3747341705 wait complete. 2023-10-18T12:19:15.737 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.729+0000 7fbceabe6700 1 Processor -- start 2023-10-18T12:19:15.737 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.729+0000 7fbceabe6700 1 -- start start 2023-10-18T12:19:15.738 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.733+0000 7fbceabe6700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbce406dea0 0x7fbce40abe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:15.738 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.733+0000 7fbceabe6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbce406ff50 0x7fbce40ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:15.738 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.733+0000 7fbceabe6700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbce4070330 0x7fbce40c2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:15.739 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.733+0000 7fbceabe6700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce40ad260 con 0x7fbce406dea0 2023-10-18T12:19:15.739 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.733+0000 7fbceabe6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce40ac650 con 0x7fbce406ff50 2023-10-18T12:19:15.739 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.733+0000 7fbceabe6700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce40ac930 con 0x7fbce4070330 2023-10-18T12:19:15.739 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.733+0000 7fbce9183700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbce4070330 0x7fbce40c2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:15.740 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.733+0000 7fbcdbfff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbce406ff50 0x7fbce40ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:15.740 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.733+0000 7fbce9183700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbce4070330 0x7fbce40c2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.172:33978/0 (socket says 172.21.15.172:33978) 2023-10-18T12:19:15.740 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.733+0000 7fbce9183700 1 -- 172.21.15.172:0/2773958331 learned_addr learned my addr 172.21.15.172:0/2773958331 (peer_addr_for_me v2:172.21.15.172:0/0) 2023-10-18T12:19:15.742 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.733+0000 7fbce8982700 1 --2- 172.21.15.172:0/2773958331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbce406dea0 0x7fbce40abe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:15.742 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.733+0000 7fbce9183700 1 -- 172.21.15.172:0/2773958331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbce406ff50 msgr2=0x7fbce40ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:15.743 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.733+0000 7fbce9183700 1 --2- 172.21.15.172:0/2773958331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbce406ff50 0x7fbce40ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:15.743 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.733+0000 7fbce9183700 1 -- 172.21.15.172:0/2773958331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbce406dea0 msgr2=0x7fbce40abe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:15.743 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.733+0000 7fbce9183700 1 --2- 172.21.15.172:0/2773958331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbce406dea0 0x7fbce40abe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:15.743 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.733+0000 7fbce9183700 1 -- 172.21.15.172:0/2773958331 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd40094b0 con 0x7fbce4070330 2023-10-18T12:19:15.744 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.733+0000 7fbce9183700 1 --2- 172.21.15.172:0/2773958331 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbce4070330 0x7fbce40c2c40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc00cb40 tx=0x7fbcdc00cb70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:15.744 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.733+0000 7fbcd97fa700 1 -- 172.21.15.172:0/2773958331 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc00a7b0 con 0x7fbce4070330 2023-10-18T12:19:15.744 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.733+0000 7fbcd97fa700 1 -- 172.21.15.172:0/2773958331 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcdc00a910 con 0x7fbce4070330 2023-10-18T12:19:15.744 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.733+0000 7fbceabe6700 1 -- 172.21.15.172:0/2773958331 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbce40acc10 con 0x7fbce4070330 2023-10-18T12:19:15.745 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.733+0000 7fbcd97fa700 1 -- 172.21.15.172:0/2773958331 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc00ac80 con 0x7fbce4070330 2023-10-18T12:19:15.745 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.733+0000 7fbceabe6700 1 -- 172.21.15.172:0/2773958331 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbce40ac340 con 0x7fbce4070330 2023-10-18T12:19:15.746 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.733+0000 7fbcd97fa700 1 -- 172.21.15.172:0/2773958331 <== mon.2 v2:172.21.15.172:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fbcdc01c440 con 0x7fbce4070330 2023-10-18T12:19:15.746 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.733+0000 7fbcd97fa700 1 -- 172.21.15.172:0/2773958331 <== mon.2 v2:172.21.15.172:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fbcdc01cd50 con 0x7fbce4070330 2023-10-18T12:19:15.746 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.737+0000 7fbceabe6700 1 -- 172.21.15.172:0/2773958331 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbce40c8cc0 con 0x7fbce4070330 2023-10-18T12:19:15.747 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.737+0000 7fbcd97fa700 1 -- 172.21.15.172:0/2773958331 <== mon.2 v2:172.21.15.172:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fbcdc021060 con 0x7fbce4070330 2023-10-18T12:19:15.753 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-10-18T12:19:15.748+0000 7f83947eb2c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-18T12:19:15.835 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-10-18T12:19:15.829+0000 7f7f0c1042c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-18T12:19:15.849 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.845+0000 7fbceabe6700 1 -- 172.21.15.172:0/2773958331 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4d8b1e15-143d-4d17-9074-59d92f0f9af8", "id": 7} v 0) v1 -- 0x7fbce40ad3d0 con 0x7fbce4070330 2023-10-18T12:19:15.859 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.853+0000 7fbcd97fa700 1 -- 172.21.15.172:0/2773958331 <== mon.2 v2:172.21.15.172:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4d8b1e15-143d-4d17-9074-59d92f0f9af8", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbcdc017070 con 0x7fbce4070330 2023-10-18T12:19:15.859 INFO:teuthology.orchestra.run.smithi172.stdout:7 2023-10-18T12:19:15.861 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.857+0000 7fbceabe6700 1 -- 172.21.15.172:0/2773958331 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbce4070330 msgr2=0x7fbce40c2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:15.861 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.857+0000 7fbceabe6700 1 --2- 172.21.15.172:0/2773958331 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbce4070330 0x7fbce40c2c40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc00cb40 tx=0x7fbcdc00cb70 comp rx=0 tx=0).stop 2023-10-18T12:19:15.862 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.857+0000 7fbceabe6700 1 -- 172.21.15.172:0/2773958331 shutdown_connections 2023-10-18T12:19:15.862 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.857+0000 7fbceabe6700 1 --2- 172.21.15.172:0/2773958331 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbce4070330 0x7fbce40c2c40 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:15.863 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.857+0000 7fbceabe6700 1 --2- 172.21.15.172:0/2773958331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbce406ff50 0x7fbce40ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:15.863 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.857+0000 7fbceabe6700 1 --2- 172.21.15.172:0/2773958331 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbce406dea0 0x7fbce40abe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:15.863 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.857+0000 7fbceabe6700 1 -- 172.21.15.172:0/2773958331 >> 172.21.15.172:0/2773958331 conn(0x7fbce40ce820 msgr2=0x7fbce40cee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:15.863 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.857+0000 7fbceabe6700 1 -- 172.21.15.172:0/2773958331 shutdown_connections 2023-10-18T12:19:15.863 INFO:teuthology.orchestra.run.smithi172.stderr:2023-10-18T12:19:15.857+0000 7fbceabe6700 1 -- 172.21.15.172:0/2773958331 wait complete. 2023-10-18T12:19:15.883 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-18T12:19:15.884 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-18T12:19:15.890 INFO:tasks.ceph.osd.0:Started 2023-10-18T12:19:15.890 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-18T12:19:15.891 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-18T12:19:15.897 INFO:tasks.ceph.osd.1:Started 2023-10-18T12:19:15.897 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-18T12:19:15.898 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-18T12:19:15.902 INFO:tasks.ceph.osd.2:Started 2023-10-18T12:19:15.902 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-18T12:19:15.902 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-18T12:19:15.909 INFO:tasks.ceph.osd.3:Started 2023-10-18T12:19:15.909 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-18T12:19:15.910 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-18T12:19:15.917 INFO:tasks.ceph.osd.4:Started 2023-10-18T12:19:15.917 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-18T12:19:15.918 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-18T12:19:15.923 INFO:tasks.ceph.osd.5:Started 2023-10-18T12:19:15.923 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-18T12:19:15.923 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-18T12:19:15.930 INFO:tasks.ceph.osd.6:Started 2023-10-18T12:19:15.931 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-18T12:19:15.931 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-18T12:19:15.938 INFO:tasks.ceph.osd.7:Started 2023-10-18T12:19:15.938 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T12:19:16.016 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-10-18T12:19:16.012+0000 7f83947eb2c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-18T12:19:16.094 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-10-18T12:19:16.089+0000 7f7f0c1042c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-18T12:19:16.117 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-10-18T12:19:16.112+0000 7f83947eb2c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-18T12:19:16.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.120+0000 7f4195b70700 1 Processor -- start 2023-10-18T12:19:16.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.120+0000 7f4195b70700 1 -- start start 2023-10-18T12:19:16.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.124+0000 7f4195b70700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f41900ce320 0x7f41900cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:16.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.124+0000 7f4195b70700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41900cbc80 con 0x7f4190155420 2023-10-18T12:19:16.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.124+0000 7f4195b70700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41900cb9a0 con 0x7f419015bf00 2023-10-18T12:19:16.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.124+0000 7f4195b70700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4190155800 con 0x7f41900ce320 2023-10-18T12:19:16.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.124+0000 7f418f7fe700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f4190155420 0x7f41900cb150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45728/0 (socket says 172.21.15.114:45728) 2023-10-18T12:19:16.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.124+0000 7f418f7fe700 1 -- 172.21.15.114:0/600347410 learned_addr learned my addr 172.21.15.114:0/600347410 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:19:16.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.124+0000 7f418ffff700 1 --2- 172.21.15.114:0/600347410 >> v2:172.21.15.172:3300/0 conn(0x7f41900ce320 0x7f41900cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:16.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.124+0000 7f418effd700 1 -- 172.21.15.114:0/600347410 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 726074598 0 0) 0x7f41900cbc80 con 0x7f4190155420 2023-10-18T12:19:16.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.124+0000 7f418effd700 1 -- 172.21.15.114:0/600347410 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f417c0035d0 con 0x7f4190155420 2023-10-18T12:19:16.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.124+0000 7f418ffff700 1 -- 172.21.15.114:0/600347410 >> v1:172.21.15.172:6789/0 conn(0x7f419015bf00 legacy=0x7f41900cdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:16.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.124+0000 7f418ffff700 1 -- 172.21.15.114:0/600347410 >> v1:172.21.15.114:6789/0 conn(0x7f4190155420 legacy=0x7f41900cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:16.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.124+0000 7f418ffff700 1 -- 172.21.15.114:0/600347410 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419015b420 con 0x7f41900ce320 2023-10-18T12:19:16.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.124+0000 7f418ffff700 1 --2- 172.21.15.114:0/600347410 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41900ce320 0x7f41900cc680 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4188009d90 tx=0x7f418800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57e2145d17c6daa0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:16.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.124+0000 7f418effd700 1 -- 172.21.15.114:0/600347410 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418800e070 con 0x7f41900ce320 2023-10-18T12:19:16.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.124+0000 7f418effd700 1 -- 172.21.15.114:0/600347410 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418800bb20 con 0x7f41900ce320 2023-10-18T12:19:16.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.124+0000 7f418effd700 1 -- 172.21.15.114:0/600347410 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4188012430 con 0x7f41900ce320 2023-10-18T12:19:16.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.124+0000 7f4195b70700 1 -- 172.21.15.114:0/600347410 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41900ce320 msgr2=0x7f41900cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:16.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.124+0000 7f4195b70700 1 --2- 172.21.15.114:0/600347410 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41900ce320 0x7f41900cc680 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4188009d90 tx=0x7f418800b330 comp rx=0 tx=0).stop 2023-10-18T12:19:16.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.124+0000 7f4195b70700 1 -- 172.21.15.114:0/600347410 shutdown_connections 2023-10-18T12:19:16.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.124+0000 7f4195b70700 1 --2- 172.21.15.114:0/600347410 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41900ce320 0x7f41900cc680 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:16.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.124+0000 7f4195b70700 1 -- 172.21.15.114:0/600347410 >> 172.21.15.114:0/600347410 conn(0x7f419006a340 msgr2=0x7f41900b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:16.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.128+0000 7f4195b70700 1 -- 172.21.15.114:0/600347410 shutdown_connections 2023-10-18T12:19:16.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.128+0000 7f4195b70700 1 -- 172.21.15.114:0/600347410 wait complete. 2023-10-18T12:19:16.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.128+0000 7f4195b70700 1 Processor -- start 2023-10-18T12:19:16.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.128+0000 7f4195b70700 1 -- start start 2023-10-18T12:19:16.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.128+0000 7f4195b70700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f41900ce320 0x7f419015de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:16.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.128+0000 7f4195b70700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4190155420 0x7f4190131ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:16.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.128+0000 7f4195b70700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f419015bf00 0x7f41901e6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:16.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.128+0000 7f4195b70700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419013f9f0 con 0x7f4190155420 2023-10-18T12:19:16.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.128+0000 7f4195b70700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41901e62b0 con 0x7f419015bf00 2023-10-18T12:19:16.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.128+0000 7f4195b70700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41901e6590 con 0x7f41900ce320 2023-10-18T12:19:16.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.128+0000 7f4186ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4190155420 0x7f4190131ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:16.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.128+0000 7f4186ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4190155420 0x7f4190131ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57536/0 (socket says 172.21.15.114:57536) 2023-10-18T12:19:16.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.128+0000 7f4186ffd700 1 -- 172.21.15.114:0/1874251706 learned_addr learned my addr 172.21.15.114:0/1874251706 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:16.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.128+0000 7f418ffff700 1 --2- 172.21.15.114:0/1874251706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f419015bf00 0x7f41901e6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:16.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.128+0000 7f418f7fe700 1 --2- 172.21.15.114:0/1874251706 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f41900ce320 0x7f419015de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:16.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.132+0000 7f4186ffd700 1 -- 172.21.15.114:0/1874251706 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f41900ce320 msgr2=0x7f419015de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:16.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.132+0000 7f4186ffd700 1 --2- 172.21.15.114:0/1874251706 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f41900ce320 0x7f419015de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:16.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.132+0000 7f4186ffd700 1 -- 172.21.15.114:0/1874251706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f419015bf00 msgr2=0x7f41901e6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:16.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.132+0000 7f4186ffd700 1 --2- 172.21.15.114:0/1874251706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f419015bf00 0x7f41901e6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:16.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.132+0000 7f4186ffd700 1 -- 172.21.15.114:0/1874251706 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4188009a70 con 0x7f4190155420 2023-10-18T12:19:16.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.132+0000 7f418f7fe700 1 --2- 172.21.15.114:0/1874251706 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f41900ce320 0x7f419015de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:19:16.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.132+0000 7f4186ffd700 1 --2- 172.21.15.114:0/1874251706 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4190155420 0x7f4190131ea0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f417800c500 tx=0x7f417800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:16.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.132+0000 7f418cff9700 1 -- 172.21.15.114:0/1874251706 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41780052d0 con 0x7f4190155420 2023-10-18T12:19:16.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.132+0000 7f418cff9700 1 -- 172.21.15.114:0/1874251706 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4178005430 con 0x7f4190155420 2023-10-18T12:19:16.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.132+0000 7f4195b70700 1 -- 172.21.15.114:0/1874251706 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f419013fc00 con 0x7f4190155420 2023-10-18T12:19:16.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.132+0000 7f418cff9700 1 -- 172.21.15.114:0/1874251706 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41780055a0 con 0x7f4190155420 2023-10-18T12:19:16.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.132+0000 7f4195b70700 1 -- 172.21.15.114:0/1874251706 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41901e5ed0 con 0x7f4190155420 2023-10-18T12:19:16.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.132+0000 7f418cff9700 1 -- 172.21.15.114:0/1874251706 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4178003be0 con 0x7f4190155420 2023-10-18T12:19:16.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.132+0000 7f418cff9700 1 -- 172.21.15.114:0/1874251706 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f4178011e40 con 0x7f4190155420 2023-10-18T12:19:16.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.132+0000 7f4195b70700 1 -- 172.21.15.114:0/1874251706 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4190072e60 con 0x7f4190155420 2023-10-18T12:19:16.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.136+0000 7f418cff9700 1 -- 172.21.15.114:0/1874251706 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f4178017070 con 0x7f4190155420 2023-10-18T12:19:16.197 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-10-18T12:19:16.193+0000 7f7f0c1042c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-18T12:19:16.201 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-10-18T12:19:16.196+0000 7f83947eb2c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-18T12:19:16.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.200+0000 7f4195b70700 1 -- 172.21.15.114:0/1874251706 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41900ad9f0 con 0x7f4190155420 2023-10-18T12:19:16.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.200+0000 7f418cff9700 1 -- 172.21.15.114:0/1874251706 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f4178011590 con 0x7f4190155420 2023-10-18T12:19:16.206 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:19:16.206 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":10,"fsid":"240ea340-5d3d-4f52-a4bc-af075aca3deb","created":"2023-10-18T12:19:12.512994+0000","modified":"2023-10-18T12:19:15.850693+0000","last_up_change":"0.000000","last_in_change":"2023-10-18T12:19:15.850693+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c3578978-1a03-4857-b9d2-34a5da3d7731","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"43eb26a6-e2b3-4670-9559-bd053b5140d5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f3d4dbd5-521c-4dd2-b687-5768cc7d0938","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"823e5802-92b7-4f0d-b32d-a5748993f1b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e47fb93e-13b4-44a4-b084-8c4384ceb41e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7561a973-f479-45a0-af40-f324728d622e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"51753f4b-7f06-4f1c-9ec7-6e18a66eb980","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"4d8b1e15-143d-4d17-9074-59d92f0f9af8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T12:19:16.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.204+0000 7f4195b70700 1 -- 172.21.15.114:0/1874251706 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4190155420 msgr2=0x7f4190131ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:16.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.204+0000 7f4195b70700 1 --2- 172.21.15.114:0/1874251706 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4190155420 0x7f4190131ea0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f417800c500 tx=0x7f417800c810 comp rx=0 tx=0).stop 2023-10-18T12:19:16.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.204+0000 7f4195b70700 1 -- 172.21.15.114:0/1874251706 shutdown_connections 2023-10-18T12:19:16.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.204+0000 7f4195b70700 1 --2- 172.21.15.114:0/1874251706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f419015bf00 0x7f41901e6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:16.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.204+0000 7f4195b70700 1 --2- 172.21.15.114:0/1874251706 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4190155420 0x7f4190131ea0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:16.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.204+0000 7f4195b70700 1 --2- 172.21.15.114:0/1874251706 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f41900ce320 0x7f419015de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:16.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.204+0000 7f4195b70700 1 -- 172.21.15.114:0/1874251706 >> 172.21.15.114:0/1874251706 conn(0x7f419006a340 msgr2=0x7f41900ccf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:16.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.204+0000 7f4195b70700 1 -- 172.21.15.114:0/1874251706 shutdown_connections 2023-10-18T12:19:16.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:16.204+0000 7f4195b70700 1 -- 172.21.15.114:0/1874251706 wait complete. 2023-10-18T12:19:16.229 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-18T12:19:16.229 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-18T12:19:16.283 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-10-18T12:19:16.277+0000 7f7f0c1042c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-18T12:19:16.561 INFO:tasks.ceph.osd.1.smithi114.stderr:2023-10-18T12:19:16.556+0000 7f7a61554700 -1 Falling back to public interface 2023-10-18T12:19:16.571 INFO:tasks.ceph.osd.2.smithi114.stderr:2023-10-18T12:19:16.568+0000 7fee8dcd3700 -1 Falling back to public interface 2023-10-18T12:19:16.595 INFO:tasks.ceph.osd.4.smithi172.stderr:2023-10-18T12:19:16.589+0000 7fc7379d3700 -1 Falling back to public interface 2023-10-18T12:19:16.597 INFO:tasks.ceph.osd.0.smithi114.stderr:2023-10-18T12:19:16.592+0000 7f0151747700 -1 Falling back to public interface 2023-10-18T12:19:16.599 INFO:tasks.ceph.osd.3.smithi114.stderr:2023-10-18T12:19:16.596+0000 7f9568554700 -1 Falling back to public interface 2023-10-18T12:19:16.607 INFO:tasks.ceph.osd.7.smithi172.stderr:2023-10-18T12:19:16.601+0000 7f570444f700 -1 Falling back to public interface 2023-10-18T12:19:16.610 INFO:tasks.ceph.osd.5.smithi172.stderr:2023-10-18T12:19:16.605+0000 7f37fd345700 -1 Falling back to public interface 2023-10-18T12:19:16.618 INFO:tasks.ceph.osd.6.smithi172.stderr:2023-10-18T12:19:16.613+0000 7f33b93ee700 -1 Falling back to public interface 2023-10-18T12:19:17.035 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-18T12:19:17.194 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.188+0000 7fec80a11700 1 Processor -- start 2023-10-18T12:19:17.194 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.188+0000 7fec80a11700 1 -- start start 2023-10-18T12:19:17.195 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.192+0000 7fec80a11700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fec7c0b6130 0x7fec7c06faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:17.195 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.192+0000 7fec80a11700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec7c06f330 con 0x7fec7c06ffe0 2023-10-18T12:19:17.196 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.192+0000 7fec80a11700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec7c15db50 con 0x7fec7c157230 2023-10-18T12:19:17.196 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.192+0000 7fec80a11700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec7c15de30 con 0x7fec7c0b6130 2023-10-18T12:19:17.198 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.192+0000 7fec7ad9d700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fec7c06ffe0 0x7fec7c06d500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45742/0 (socket says 172.21.15.114:45742) 2023-10-18T12:19:17.198 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.192+0000 7fec7ad9d700 1 -- 172.21.15.114:0/1648151989 learned_addr learned my addr 172.21.15.114:0/1648151989 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:19:17.198 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.192+0000 7fec73fff700 1 --2- 172.21.15.114:0/1648151989 >> v2:172.21.15.114:3300/0 conn(0x7fec7c0b6130 0x7fec7c06faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:17.198 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.192+0000 7fec79d9b700 1 -- 172.21.15.114:0/1648151989 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4233607898 0 0) 0x7fec7c06f330 con 0x7fec7c06ffe0 2023-10-18T12:19:17.199 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.192+0000 7fec79d9b700 1 -- 172.21.15.114:0/1648151989 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec680035d0 con 0x7fec7c06ffe0 2023-10-18T12:19:17.199 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.192+0000 7fec79d9b700 1 -- 172.21.15.114:0/1648151989 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3914936811 0 0) 0x7fec680035d0 con 0x7fec7c06ffe0 2023-10-18T12:19:17.199 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.192+0000 7fec79d9b700 1 -- 172.21.15.114:0/1648151989 >> v2:172.21.15.114:3300/0 conn(0x7fec7c0b6130 msgr2=0x7fec7c06faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:17.199 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.192+0000 7fec79d9b700 1 --2- 172.21.15.114:0/1648151989 >> v2:172.21.15.114:3300/0 conn(0x7fec7c0b6130 0x7fec7c06faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:17.199 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.192+0000 7fec79d9b700 1 -- 172.21.15.114:0/1648151989 >> v1:172.21.15.172:6789/0 conn(0x7fec7c157230 legacy=0x7fec7c15d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:17.200 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.192+0000 7fec79d9b700 1 -- 172.21.15.114:0/1648151989 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec7c15e110 con 0x7fec7c06ffe0 2023-10-18T12:19:17.200 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.192+0000 7fec79d9b700 1 -- 172.21.15.114:0/1648151989 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3368469509 0 0) 0x7fec740019f0 con 0x7fec7c06ffe0 2023-10-18T12:19:17.200 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.192+0000 7fec79d9b700 1 -- 172.21.15.114:0/1648151989 >> v1:172.21.15.114:6789/0 conn(0x7fec7c06ffe0 legacy=0x7fec7c06d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:17.200 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.192+0000 7fec79d9b700 1 --2- 172.21.15.114:0/1648151989 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fec68003a70 0x7fec68003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:17.200 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.192+0000 7fec79d9b700 1 --2- 172.21.15.114:0/1648151989 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec68004870 0x7fec68004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:17.201 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.192+0000 7fec79d9b700 1 --2- 172.21.15.114:0/1648151989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec68005280 0x7fec6800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:17.201 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.192+0000 7fec79d9b700 1 -- 172.21.15.114:0/1648151989 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c15de30 con 0x7fec68004870 2023-10-18T12:19:17.201 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.192+0000 7fec79d9b700 1 -- 172.21.15.114:0/1648151989 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6800c1d0 con 0x7fec68005280 2023-10-18T12:19:17.201 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.192+0000 7fec79d9b700 1 -- 172.21.15.114:0/1648151989 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec6800c390 con 0x7fec68003a70 2023-10-18T12:19:17.201 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.192+0000 7fec73fff700 1 --2- 172.21.15.114:0/1648151989 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec68004870 0x7fec68004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:17.202 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.192+0000 7fec7a59c700 1 --2- 172.21.15.114:0/1648151989 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fec68003a70 0x7fec68003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:17.202 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.192+0000 7fec7ad9d700 1 --2- 172.21.15.114:0/1648151989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec68005280 0x7fec6800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:17.203 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.196+0000 7fec73fff700 1 -- 172.21.15.114:0/1648151989 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fec68003a70 msgr2=0x7fec68003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:17.204 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.196+0000 7fec73fff700 1 --2- 172.21.15.114:0/1648151989 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fec68003a70 0x7fec68003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:17.204 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.196+0000 7fec73fff700 1 -- 172.21.15.114:0/1648151989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec68005280 msgr2=0x7fec6800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:17.204 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.196+0000 7fec73fff700 1 --2- 172.21.15.114:0/1648151989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec68005280 0x7fec6800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:17.204 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.196+0000 7fec73fff700 1 -- 172.21.15.114:0/1648151989 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec680035d0 con 0x7fec68004870 2023-10-18T12:19:17.204 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.196+0000 7fec7ad9d700 1 --2- 172.21.15.114:0/1648151989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec68005280 0x7fec6800ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:19:17.205 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.196+0000 7fec7ad9d700 1 -- 172.21.15.114:0/1648151989 reap_dead start 2023-10-18T12:19:17.205 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.196+0000 7fec73fff700 1 --2- 172.21.15.114:0/1648151989 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec68004870 0x7fec68004cf0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fec64009b40 tx=0x7fec680058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d348d9f4da9ac909 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:17.205 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.196+0000 7fec79d9b700 1 -- 172.21.15.114:0/1648151989 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6400e6c0 con 0x7fec68004870 2023-10-18T12:19:17.205 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.196+0000 7fec79d9b700 1 -- 172.21.15.114:0/1648151989 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6400e820 con 0x7fec68004870 2023-10-18T12:19:17.205 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.196+0000 7fec79d9b700 1 -- 172.21.15.114:0/1648151989 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6400ebb0 con 0x7fec68004870 2023-10-18T12:19:17.205 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.196+0000 7fec80a11700 1 -- 172.21.15.114:0/1648151989 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec68004870 msgr2=0x7fec68004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:17.206 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.196+0000 7fec80a11700 1 --2- 172.21.15.114:0/1648151989 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec68004870 0x7fec68004cf0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fec64009b40 tx=0x7fec680058a0 comp rx=0 tx=0).stop 2023-10-18T12:19:17.206 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.196+0000 7fec80a11700 1 -- 172.21.15.114:0/1648151989 shutdown_connections 2023-10-18T12:19:17.206 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.196+0000 7fec80a11700 1 --2- 172.21.15.114:0/1648151989 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec68004870 0x7fec68004cf0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:17.206 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.196+0000 7fec80a11700 1 -- 172.21.15.114:0/1648151989 >> 172.21.15.114:0/1648151989 conn(0x7fec7c069ef0 msgr2=0x7fec7c06a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:17.206 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.196+0000 7fec80a11700 1 -- 172.21.15.114:0/1648151989 shutdown_connections 2023-10-18T12:19:17.207 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.196+0000 7fec80a11700 1 -- 172.21.15.114:0/1648151989 wait complete. 2023-10-18T12:19:17.209 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.200+0000 7fec80a11700 1 Processor -- start 2023-10-18T12:19:17.209 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.200+0000 7fec80a11700 1 -- start start 2023-10-18T12:19:17.209 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.200+0000 7fec80a11700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fec68004870 0x7fec7c06e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:17.210 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.200+0000 7fec80a11700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec7c1f24e0 0x7fec7c1478c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:17.210 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.200+0000 7fec80a11700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec7c15c320 0x7fec7c15e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:17.210 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.200+0000 7fec80a11700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c14ed20 con 0x7fec7c1f24e0 2023-10-18T12:19:17.210 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.200+0000 7fec80a11700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c152c40 con 0x7fec7c15c320 2023-10-18T12:19:17.210 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.200+0000 7fec80a11700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c152ee0 con 0x7fec68004870 2023-10-18T12:19:17.211 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.200+0000 7fec73fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec7c1f24e0 0x7fec7c1478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:17.211 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.200+0000 7fec73fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec7c1f24e0 0x7fec7c1478c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57560/0 (socket says 172.21.15.114:57560) 2023-10-18T12:19:17.211 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.200+0000 7fec73fff700 1 -- 172.21.15.114:0/2354190449 learned_addr learned my addr 172.21.15.114:0/2354190449 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:17.211 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.200+0000 7fec7a59c700 1 --2- 172.21.15.114:0/2354190449 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fec68004870 0x7fec7c06e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:17.211 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.200+0000 7fec7ad9d700 1 --2- 172.21.15.114:0/2354190449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec7c15c320 0x7fec7c15e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:17.212 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.200+0000 7fec73fff700 1 -- 172.21.15.114:0/2354190449 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fec68004870 msgr2=0x7fec7c06e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:17.212 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.200+0000 7fec73fff700 1 --2- 172.21.15.114:0/2354190449 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fec68004870 0x7fec7c06e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:17.212 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.200+0000 7fec73fff700 1 -- 172.21.15.114:0/2354190449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec7c15c320 msgr2=0x7fec7c15e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:17.212 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.200+0000 7fec73fff700 1 --2- 172.21.15.114:0/2354190449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec7c15c320 0x7fec7c15e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:17.212 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.200+0000 7fec73fff700 1 -- 172.21.15.114:0/2354190449 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec7c15c7a0 con 0x7fec7c1f24e0 2023-10-18T12:19:17.213 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.204+0000 7fec73fff700 1 --2- 172.21.15.114:0/2354190449 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec7c1f24e0 0x7fec7c1478c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fec6400e4b0 tx=0x7fec640047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:17.213 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.204+0000 7fec72ffd700 1 -- 172.21.15.114:0/2354190449 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6400e6c0 con 0x7fec7c1f24e0 2023-10-18T12:19:17.213 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.204+0000 7fec72ffd700 1 -- 172.21.15.114:0/2354190449 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec64013e30 con 0x7fec7c1f24e0 2023-10-18T12:19:17.213 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.204+0000 7fec80a11700 1 -- 172.21.15.114:0/2354190449 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec7c06e7b0 con 0x7fec7c1f24e0 2023-10-18T12:19:17.213 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.204+0000 7fec72ffd700 1 -- 172.21.15.114:0/2354190449 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6401c690 con 0x7fec7c1f24e0 2023-10-18T12:19:17.214 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.204+0000 7fec80a11700 1 -- 172.21.15.114:0/2354190449 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec7c06ed70 con 0x7fec7c1f24e0 2023-10-18T12:19:17.214 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.204+0000 7fec72ffd700 1 -- 172.21.15.114:0/2354190449 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fec6401caf0 con 0x7fec7c1f24e0 2023-10-18T12:19:17.214 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.204+0000 7fec72ffd700 1 -- 172.21.15.114:0/2354190449 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fec640303f0 con 0x7fec7c1f24e0 2023-10-18T12:19:17.214 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.204+0000 7fec80a11700 1 -- 172.21.15.114:0/2354190449 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec7c06ef90 con 0x7fec7c1f24e0 2023-10-18T12:19:17.215 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-10-18T12:19:17.209+0000 7f7f0c1042c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-18T12:19:17.215 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.208+0000 7fec72ffd700 1 -- 172.21.15.114:0/2354190449 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fec64035060 con 0x7fec7c1f24e0 2023-10-18T12:19:17.283 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.280+0000 7fec80a11700 1 -- 172.21.15.114:0/2354190449 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec7c14ecb0 con 0x7fec7c1f24e0 2023-10-18T12:19:17.284 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.280+0000 7fec72ffd700 1 -- 172.21.15.114:0/2354190449 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fec64017070 con 0x7fec7c1f24e0 2023-10-18T12:19:17.285 INFO:teuthology.misc.health.smithi114.stdout: 2023-10-18T12:19:17.285 INFO:teuthology.misc.health.smithi114.stdout:{"epoch":10,"fsid":"240ea340-5d3d-4f52-a4bc-af075aca3deb","created":"2023-10-18T12:19:12.512994+0000","modified":"2023-10-18T12:19:15.850693+0000","last_up_change":"0.000000","last_in_change":"2023-10-18T12:19:15.850693+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c3578978-1a03-4857-b9d2-34a5da3d7731","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"43eb26a6-e2b3-4670-9559-bd053b5140d5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f3d4dbd5-521c-4dd2-b687-5768cc7d0938","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"823e5802-92b7-4f0d-b32d-a5748993f1b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e47fb93e-13b4-44a4-b084-8c4384ceb41e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7561a973-f479-45a0-af40-f324728d622e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"51753f4b-7f06-4f1c-9ec7-6e18a66eb980","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"4d8b1e15-143d-4d17-9074-59d92f0f9af8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T12:19:17.286 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.280+0000 7fec80a11700 1 -- 172.21.15.114:0/2354190449 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec7c1f24e0 msgr2=0x7fec7c1478c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:17.286 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.280+0000 7fec80a11700 1 --2- 172.21.15.114:0/2354190449 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec7c1f24e0 0x7fec7c1478c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fec6400e4b0 tx=0x7fec640047e0 comp rx=0 tx=0).stop 2023-10-18T12:19:17.287 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.280+0000 7fec80a11700 1 -- 172.21.15.114:0/2354190449 shutdown_connections 2023-10-18T12:19:17.287 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.280+0000 7fec80a11700 1 --2- 172.21.15.114:0/2354190449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec7c15c320 0x7fec7c15e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:17.287 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.280+0000 7fec80a11700 1 --2- 172.21.15.114:0/2354190449 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec7c1f24e0 0x7fec7c1478c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:17.287 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.280+0000 7fec80a11700 1 --2- 172.21.15.114:0/2354190449 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fec68004870 0x7fec7c06e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:17.287 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.280+0000 7fec80a11700 1 -- 172.21.15.114:0/2354190449 >> 172.21.15.114:0/2354190449 conn(0x7fec7c069ef0 msgr2=0x7fec7c0b6620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:17.288 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.280+0000 7fec80a11700 1 -- 172.21.15.114:0/2354190449 shutdown_connections 2023-10-18T12:19:17.288 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:17.284+0000 7fec80a11700 1 -- 172.21.15.114:0/2354190449 wait complete. 2023-10-18T12:19:17.288 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-10-18T12:19:17.284+0000 7f83947eb2c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-18T12:19:17.303 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-18T12:19:17.307 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-10-18T12:19:17.301+0000 7f7f0c1042c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-18T12:19:17.384 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-10-18T12:19:17.380+0000 7f83947eb2c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-18T12:19:17.484 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-10-18T12:19:17.477+0000 7f7f0c1042c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-18T12:19:17.574 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-10-18T12:19:17.569+0000 7f7f0c1042c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-18T12:19:17.642 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-10-18T12:19:17.640+0000 7f83947eb2c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-18T12:19:17.673 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-10-18T12:19:17.669+0000 7f7f0c1042c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-18T12:19:17.757 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-10-18T12:19:17.752+0000 7f83947eb2c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-18T12:19:17.865 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-10-18T12:19:17.860+0000 7f83947eb2c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-18T12:19:17.877 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-10-18T12:19:17.873+0000 7f7f0c1042c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-18T12:19:18.088 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-10-18T12:19:18.084+0000 7f83947eb2c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-18T12:19:18.130 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-10-18T12:19:18.125+0000 7f7f0c1042c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-18T12:19:18.358 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-10-18T12:19:18.352+0000 7f83947eb2c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-18T12:19:18.926 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-10-18T12:19:18.921+0000 7f7f0c1042c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-18T12:19:19.166 INFO:tasks.ceph.mgr.y.smithi114.stderr:2023-10-18T12:19:19.160+0000 7f83947eb2c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-18T12:19:19.964 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-10-18T12:19:19.961+0000 7f7ef30f6700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-18T12:19:19.966 INFO:tasks.ceph.mgr.x.smithi172.stderr:2023-10-18T12:19:19.961+0000 7f7ef30f6700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-18T12:19:20.487 INFO:tasks.ceph.osd.1.smithi114.stderr:2023-10-18T12:19:20.484+0000 7f7a61554700 -1 osd.1 0 log_to_monitors true 2023-10-18T12:19:20.594 INFO:tasks.ceph.osd.4.smithi172.stderr:2023-10-18T12:19:20.589+0000 7fc7379d3700 -1 osd.4 0 log_to_monitors true 2023-10-18T12:19:20.598 INFO:tasks.ceph.osd.3.smithi114.stderr:2023-10-18T12:19:20.592+0000 7f9568554700 -1 osd.3 0 log_to_monitors true 2023-10-18T12:19:20.680 INFO:tasks.ceph.osd.5.smithi172.stderr:2023-10-18T12:19:20.673+0000 7f37fd345700 -1 osd.5 0 log_to_monitors true 2023-10-18T12:19:20.848 INFO:tasks.ceph.osd.6.smithi172.stderr:2023-10-18T12:19:20.841+0000 7f33b93ee700 -1 osd.6 0 log_to_monitors true 2023-10-18T12:19:20.871 INFO:tasks.ceph.osd.2.smithi114.stderr:2023-10-18T12:19:20.868+0000 7fee8dcd3700 -1 osd.2 0 log_to_monitors true 2023-10-18T12:19:20.879 INFO:tasks.ceph.osd.7.smithi172.stderr:2023-10-18T12:19:20.873+0000 7f570444f700 -1 osd.7 0 log_to_monitors true 2023-10-18T12:19:20.899 INFO:tasks.ceph.osd.0.smithi114.stderr:2023-10-18T12:19:20.896+0000 7f0151747700 -1 osd.0 0 log_to_monitors true 2023-10-18T12:19:24.110 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-18T12:19:24.282 INFO:tasks.ceph.osd.0.smithi114.stderr:2023-10-18T12:19:24.275+0000 7f014d586700 -1 osd.0 0 waiting for initial osdmap 2023-10-18T12:19:24.305 INFO:tasks.ceph.osd.0.smithi114.stderr:2023-10-18T12:19:24.299+0000 7f0144ff0700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T12:19:24.323 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.319+0000 7fe8dcad6700 1 Processor -- start 2023-10-18T12:19:24.324 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.319+0000 7fe8dcad6700 1 -- start start 2023-10-18T12:19:24.326 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.319+0000 7fe8dcad6700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe8d806b440 0x7fe8d806a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:24.326 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.319+0000 7fe8dcad6700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d80ccd90 con 0x7fe8d8160160 2023-10-18T12:19:24.327 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.319+0000 7fe8dcad6700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d806fd40 con 0x7fe8d806a720 2023-10-18T12:19:24.327 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.319+0000 7fe8dcad6700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d80ac000 con 0x7fe8d806b440 2023-10-18T12:19:24.327 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.319+0000 7fe8d659c700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe8d8160160 0x7fe8d80ab8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45750/0 (socket says 172.21.15.114:45750) 2023-10-18T12:19:24.327 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.319+0000 7fe8d659c700 1 -- 172.21.15.114:0/1099612466 learned_addr learned my addr 172.21.15.114:0/1099612466 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:19:24.328 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.323+0000 7fe8d559a700 1 -- 172.21.15.114:0/1099612466 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2213507502 0 0) 0x7fe8d80ccd90 con 0x7fe8d8160160 2023-10-18T12:19:24.328 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.323+0000 7fe8d559a700 1 -- 172.21.15.114:0/1099612466 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8c40035d0 con 0x7fe8d8160160 2023-10-18T12:19:24.328 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.323+0000 7fe8d559a700 1 -- 172.21.15.114:0/1099612466 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1277496206 0 0) 0x7fe8c40035d0 con 0x7fe8d8160160 2023-10-18T12:19:24.329 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.323+0000 7fe8d559a700 1 -- 172.21.15.114:0/1099612466 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe8d806b440 msgr2=0x7fe8d806a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:24.331 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.327+0000 7fe8d559a700 1 --2- 172.21.15.114:0/1099612466 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe8d806b440 0x7fe8d806a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:24.332 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.327+0000 7fe8d559a700 1 -- 172.21.15.114:0/1099612466 >> v1:172.21.15.172:6789/0 conn(0x7fe8d806a720 legacy=0x7fe8d80701d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:24.332 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.327+0000 7fe8d559a700 1 -- 172.21.15.114:0/1099612466 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d806b8a0 con 0x7fe8d8160160 2023-10-18T12:19:24.332 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.327+0000 7fe8d559a700 1 -- 172.21.15.114:0/1099612466 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3368469509 0 0) 0x7fe8d00019f0 con 0x7fe8d8160160 2023-10-18T12:19:24.332 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.327+0000 7fe8d559a700 1 -- 172.21.15.114:0/1099612466 >> v1:172.21.15.114:6789/0 conn(0x7fe8d8160160 legacy=0x7fe8d80ab8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:24.333 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.327+0000 7fe8d559a700 1 --2- 172.21.15.114:0/1099612466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8c4003a50 0x7fe8c4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:24.333 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.327+0000 7fe8d559a700 1 --2- 172.21.15.114:0/1099612466 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe8d806b440 0x7fe8c4004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:24.333 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.327+0000 7fe8d559a700 1 --2- 172.21.15.114:0/1099612466 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8c4004ed0 0x7fe8c400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:24.333 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.327+0000 7fe8d559a700 1 -- 172.21.15.114:0/1099612466 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d80ac000 con 0x7fe8c4004ed0 2023-10-18T12:19:24.333 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.327+0000 7fe8d5d9b700 1 --2- 172.21.15.114:0/1099612466 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe8d806b440 0x7fe8c4004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:24.334 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.327+0000 7fe8d559a700 1 -- 172.21.15.114:0/1099612466 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c40056c0 con 0x7fe8c4003a50 2023-10-18T12:19:24.334 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.327+0000 7fe8d559a700 1 -- 172.21.15.114:0/1099612466 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c400bf70 con 0x7fe8d806b440 2023-10-18T12:19:24.334 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.327+0000 7fe8d659c700 1 --2- 172.21.15.114:0/1099612466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8c4003a50 0x7fe8c4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:24.335 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.331+0000 7fe8d659c700 1 -- 172.21.15.114:0/1099612466 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe8d806b440 msgr2=0x7fe8c4004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:24.335 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.331+0000 7fe8d659c700 1 --2- 172.21.15.114:0/1099612466 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe8d806b440 0x7fe8c4004870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:24.336 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.331+0000 7fe8d659c700 1 -- 172.21.15.114:0/1099612466 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8c4004ed0 msgr2=0x7fe8c400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:24.336 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.331+0000 7fe8d659c700 1 --2- 172.21.15.114:0/1099612466 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8c4004ed0 0x7fe8c400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:24.336 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.331+0000 7fe8d659c700 1 -- 172.21.15.114:0/1099612466 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c40035d0 con 0x7fe8c4003a50 2023-10-18T12:19:24.337 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.331+0000 7fe8d659c700 1 --2- 172.21.15.114:0/1099612466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8c4003a50 0x7fe8c4003e30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe8d000a870 tx=0x7fe8c40058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8ea94101d965b34 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:24.337 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.331+0000 7fe8d559a700 1 -- 172.21.15.114:0/1099612466 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d00072d0 con 0x7fe8c4003a50 2023-10-18T12:19:24.338 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.331+0000 7fe8d559a700 1 -- 172.21.15.114:0/1099612466 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d0007430 con 0x7fe8c4003a50 2023-10-18T12:19:24.342 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.331+0000 7fe8d559a700 1 -- 172.21.15.114:0/1099612466 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d00077c0 con 0x7fe8c4003a50 2023-10-18T12:19:24.342 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.335+0000 7fe8dcad6700 1 -- 172.21.15.114:0/1099612466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8c4003a50 msgr2=0x7fe8c4003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:24.342 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.335+0000 7fe8dcad6700 1 --2- 172.21.15.114:0/1099612466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8c4003a50 0x7fe8c4003e30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe8d000a870 tx=0x7fe8c40058a0 comp rx=0 tx=0).stop 2023-10-18T12:19:24.342 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.335+0000 7fe8d6d9d700 1 -- 172.21.15.114:0/1099612466 reap_dead start 2023-10-18T12:19:24.343 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.335+0000 7fe8dcad6700 1 -- 172.21.15.114:0/1099612466 shutdown_connections 2023-10-18T12:19:24.343 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.335+0000 7fe8dcad6700 1 -- 172.21.15.114:0/1099612466 >> 172.21.15.114:0/1099612466 conn(0x7fe8d8071020 msgr2=0x7fe8d8071430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:24.343 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.335+0000 7fe8dcad6700 1 -- 172.21.15.114:0/1099612466 shutdown_connections 2023-10-18T12:19:24.343 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.335+0000 7fe8dcad6700 1 -- 172.21.15.114:0/1099612466 wait complete. 2023-10-18T12:19:24.343 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.335+0000 7fe8dcad6700 1 Processor -- start 2023-10-18T12:19:24.344 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.335+0000 7fe8dcad6700 1 -- start start 2023-10-18T12:19:24.344 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.339+0000 7fe8dcad6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8c4003a50 0x7fe8d81ffdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:24.345 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.339+0000 7fe8dcad6700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe8d80c5880 0x7fe8d81f5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:24.345 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.339+0000 7fe8d659c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8c4003a50 0x7fe8d81ffdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:24.346 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.339+0000 7fe8d659c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8c4003a50 0x7fe8d81ffdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:34458/0 (socket says 172.21.15.114:34458) 2023-10-18T12:19:24.346 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.339+0000 7fe8d659c700 1 -- 172.21.15.114:0/4245980003 learned_addr learned my addr 172.21.15.114:0/4245980003 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:24.346 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.339+0000 7fe8d5d9b700 1 --2- 172.21.15.114:0/4245980003 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe8d80c5880 0x7fe8d81f5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:24.346 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.339+0000 7fe8dcad6700 1 --2- 172.21.15.114:0/4245980003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8d80b3c40 0x7fe8d80b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:24.347 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.339+0000 7fe8d6d9d700 1 --2- 172.21.15.114:0/4245980003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8d80b3c40 0x7fe8d80b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:24.347 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.343+0000 7fe8dcad6700 1 -- 172.21.15.114:0/4245980003 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d80b4630 con 0x7fe8d80b3c40 2023-10-18T12:19:24.348 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.343+0000 7fe8dcad6700 1 -- 172.21.15.114:0/4245980003 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d815fa30 con 0x7fe8c4003a50 2023-10-18T12:19:24.348 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.343+0000 7fe8dcad6700 1 -- 172.21.15.114:0/4245980003 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d80c77e0 con 0x7fe8d80c5880 2023-10-18T12:19:24.348 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.343+0000 7fe8d6d9d700 1 -- 172.21.15.114:0/4245980003 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe8d80c5880 msgr2=0x7fe8d81f5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:24.349 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.343+0000 7fe8d6d9d700 1 --2- 172.21.15.114:0/4245980003 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe8d80c5880 0x7fe8d81f5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:24.349 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.343+0000 7fe8d6d9d700 1 -- 172.21.15.114:0/4245980003 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8c4003a50 msgr2=0x7fe8d81ffdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:24.349 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.343+0000 7fe8d6d9d700 1 --2- 172.21.15.114:0/4245980003 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8c4003a50 0x7fe8d81ffdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:24.349 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.343+0000 7fe8d6d9d700 1 -- 172.21.15.114:0/4245980003 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d82002f0 con 0x7fe8d80b3c40 2023-10-18T12:19:24.350 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.343+0000 7fe8d6d9d700 1 --2- 172.21.15.114:0/4245980003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8d80b3c40 0x7fe8d80b40f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8070ed0 tx=0x7fe8c000c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:24.350 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.343+0000 7fe8d659c700 1 --2- 172.21.15.114:0/4245980003 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8c4003a50 0x7fe8d81ffdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:19:24.351 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.343+0000 7fe8ceffd700 1 -- 172.21.15.114:0/4245980003 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c0004220 con 0x7fe8d80b3c40 2023-10-18T12:19:24.351 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.343+0000 7fe8dcad6700 1 -- 172.21.15.114:0/4245980003 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d80c68c0 con 0x7fe8d80b3c40 2023-10-18T12:19:24.351 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.343+0000 7fe8dcad6700 1 -- 172.21.15.114:0/4245980003 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d80c6020 con 0x7fe8d80b3c40 2023-10-18T12:19:24.351 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.347+0000 7fe8ceffd700 1 -- 172.21.15.114:0/4245980003 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c0004380 con 0x7fe8d80b3c40 2023-10-18T12:19:24.352 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.347+0000 7fe8dcad6700 1 -- 172.21.15.114:0/4245980003 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8d80b1500 con 0x7fe8d80b3c40 2023-10-18T12:19:24.352 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.347+0000 7fe8ceffd700 1 -- 172.21.15.114:0/4245980003 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c0004220 con 0x7fe8d80b3c40 2023-10-18T12:19:24.358 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.351+0000 7fe8ceffd700 1 -- 172.21.15.114:0/4245980003 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 4) v1 ==== 84906+0+0 (secure 0 0 0) 0x7fe8c0005870 con 0x7fe8d80b3c40 2023-10-18T12:19:24.358 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.351+0000 7fe8ceffd700 1 --2- 172.21.15.114:0/4245980003 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe8b80656f0 0x7fe8b8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:24.359 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.351+0000 7fe8ceffd700 1 -- 172.21.15.114:0/4245980003 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7fe8c0053b30 con 0x7fe8d80b3c40 2023-10-18T12:19:24.360 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.355+0000 7fe8d659c700 1 --2- 172.21.15.114:0/4245980003 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe8b80656f0 0x7fe8b8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:24.366 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.359+0000 7fe8d659c700 1 --2- 172.21.15.114:0/4245980003 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe8b80656f0 0x7fe8b8067bb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0000f80 tx=0x7fe8d0009000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:24.367 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.363+0000 7fe8ceffd700 1 -- 172.21.15.114:0/4245980003 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fe8c004f7e0 con 0x7fe8d80b3c40 2023-10-18T12:19:24.400 INFO:tasks.ceph.osd.6.smithi172.stderr:2023-10-18T12:19:24.397+0000 7f33b522d700 -1 osd.6 0 waiting for initial osdmap 2023-10-18T12:19:24.418 INFO:tasks.ceph.osd.2.smithi114.stderr:2023-10-18T12:19:24.411+0000 7fee89b12700 -1 osd.2 0 waiting for initial osdmap 2023-10-18T12:19:24.420 INFO:tasks.ceph.osd.6.smithi172.stderr:2023-10-18T12:19:24.413+0000 7f33acbf0700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T12:19:24.430 INFO:tasks.ceph.osd.2.smithi114.stderr:2023-10-18T12:19:24.423+0000 7fee813f0700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T12:19:24.432 INFO:tasks.ceph.osd.5.smithi172.stderr:2023-10-18T12:19:24.429+0000 7f37f9184700 -1 osd.5 0 waiting for initial osdmap 2023-10-18T12:19:24.444 INFO:tasks.ceph.osd.4.smithi172.stderr:2023-10-18T12:19:24.437+0000 7fc733812700 -1 osd.4 0 waiting for initial osdmap 2023-10-18T12:19:24.444 INFO:tasks.ceph.osd.5.smithi172.stderr:2023-10-18T12:19:24.437+0000 7f37f0bf0700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T12:19:24.449 INFO:tasks.ceph.osd.4.smithi172.stderr:2023-10-18T12:19:24.445+0000 7fc72b1f0700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T12:19:24.461 INFO:tasks.ceph.osd.7.smithi172.stderr:2023-10-18T12:19:24.457+0000 7f570028e700 -1 osd.7 0 waiting for initial osdmap 2023-10-18T12:19:24.469 INFO:tasks.ceph.osd.7.smithi172.stderr:2023-10-18T12:19:24.465+0000 7f56f7bf0700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T12:19:24.504 INFO:tasks.ceph.osd.1.smithi114.stderr:2023-10-18T12:19:24.499+0000 7f7a5d393700 -1 osd.1 0 waiting for initial osdmap 2023-10-18T12:19:24.508 INFO:tasks.ceph.osd.3.smithi114.stderr:2023-10-18T12:19:24.503+0000 7f9564393700 -1 osd.3 0 waiting for initial osdmap 2023-10-18T12:19:24.515 INFO:tasks.ceph.osd.3.smithi114.stderr:2023-10-18T12:19:24.511+0000 7f955bdf0700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T12:19:24.518 INFO:tasks.ceph.osd.1.smithi114.stderr:2023-10-18T12:19:24.511+0000 7f7a54df0700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T12:19:24.609 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.603+0000 7fe8dcad6700 1 -- 172.21.15.114:0/4245980003 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe8d80b1500 con 0x7fe8d80b3c40 2023-10-18T12:19:24.610 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.603+0000 7fe8ceffd700 1 -- 172.21.15.114:0/4245980003 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fe8d80b1500 con 0x7fe8d80b3c40 2023-10-18T12:19:24.610 INFO:teuthology.misc.health.smithi114.stdout: 2023-10-18T12:19:24.611 INFO:teuthology.misc.health.smithi114.stdout:{"epoch":12,"fsid":"240ea340-5d3d-4f52-a4bc-af075aca3deb","created":"2023-10-18T12:19:12.512994+0000","modified":"2023-10-18T12:19:21.954902+0000","last_up_change":"0.000000","last_in_change":"2023-10-18T12:19:15.850693+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c3578978-1a03-4857-b9d2-34a5da3d7731","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"43eb26a6-e2b3-4670-9559-bd053b5140d5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f3d4dbd5-521c-4dd2-b687-5768cc7d0938","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"823e5802-92b7-4f0d-b32d-a5748993f1b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e47fb93e-13b4-44a4-b084-8c4384ceb41e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7561a973-f479-45a0-af40-f324728d622e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"51753f4b-7f06-4f1c-9ec7-6e18a66eb980","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"4d8b1e15-143d-4d17-9074-59d92f0f9af8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T12:19:24.613 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.607+0000 7fe8dcad6700 1 -- 172.21.15.114:0/4245980003 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe8b80656f0 msgr2=0x7fe8b8067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:24.614 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.607+0000 7fe8dcad6700 1 --2- 172.21.15.114:0/4245980003 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe8b80656f0 0x7fe8b8067bb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0000f80 tx=0x7fe8d0009000 comp rx=0 tx=0).stop 2023-10-18T12:19:24.614 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.607+0000 7fe8dcad6700 1 -- 172.21.15.114:0/4245980003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8d80b3c40 msgr2=0x7fe8d80b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:24.614 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.607+0000 7fe8dcad6700 1 --2- 172.21.15.114:0/4245980003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8d80b3c40 0x7fe8d80b40f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8070ed0 tx=0x7fe8c000c6e0 comp rx=0 tx=0).stop 2023-10-18T12:19:24.614 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.607+0000 7fe8dcad6700 1 -- 172.21.15.114:0/4245980003 shutdown_connections 2023-10-18T12:19:24.614 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.607+0000 7fe8dcad6700 1 --2- 172.21.15.114:0/4245980003 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe8b80656f0 0x7fe8b8067bb0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:24.615 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.607+0000 7fe8dcad6700 1 --2- 172.21.15.114:0/4245980003 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe8d80c5880 0x7fe8d81f5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:24.615 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.607+0000 7fe8dcad6700 1 --2- 172.21.15.114:0/4245980003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8d80b3c40 0x7fe8d80b40f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:24.615 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.607+0000 7fe8dcad6700 1 --2- 172.21.15.114:0/4245980003 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8c4003a50 0x7fe8d81ffdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:24.615 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.607+0000 7fe8dcad6700 1 -- 172.21.15.114:0/4245980003 >> 172.21.15.114:0/4245980003 conn(0x7fe8d8071020 msgr2=0x7fe8d80af4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:24.616 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.607+0000 7fe8dcad6700 1 -- 172.21.15.114:0/4245980003 shutdown_connections 2023-10-18T12:19:24.616 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:24.607+0000 7fe8dcad6700 1 -- 172.21.15.114:0/4245980003 wait complete. 2023-10-18T12:19:24.631 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-18T12:19:31.437 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-18T12:19:31.611 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.603+0000 7f59297d9700 1 Processor -- start 2023-10-18T12:19:31.611 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.607+0000 7f59297d9700 1 -- start start 2023-10-18T12:19:31.614 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.607+0000 7f59297d9700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f59240b6130 0x7f592406faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:31.614 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.607+0000 7f59297d9700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f592406f330 con 0x7f592406ffe0 2023-10-18T12:19:31.614 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.607+0000 7f59297d9700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f592415db50 con 0x7f5924157230 2023-10-18T12:19:31.614 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.607+0000 7f59297d9700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f592415de30 con 0x7f59240b6130 2023-10-18T12:19:31.615 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.607+0000 7f59237fe700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f592406ffe0 0x7f592406d500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:47070/0 (socket says 172.21.15.114:47070) 2023-10-18T12:19:31.615 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.607+0000 7f59237fe700 1 -- 172.21.15.114:0/1804536759 learned_addr learned my addr 172.21.15.114:0/1804536759 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:19:31.615 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.607+0000 7f59227fc700 1 --2- 172.21.15.114:0/1804536759 >> v2:172.21.15.172:3300/0 conn(0x7f59240b6130 0x7f592406faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:31.616 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.611+0000 7f5921ffb700 1 -- 172.21.15.114:0/1804536759 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4021549866 0 0) 0x7f592406f330 con 0x7f592406ffe0 2023-10-18T12:19:31.617 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.611+0000 7f5921ffb700 1 -- 172.21.15.114:0/1804536759 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f590c0035d0 con 0x7f592406ffe0 2023-10-18T12:19:31.617 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.611+0000 7f59227fc700 1 -- 172.21.15.114:0/1804536759 >> v1:172.21.15.172:6789/0 conn(0x7f5924157230 legacy=0x7f592415d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:31.617 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.611+0000 7f5921ffb700 1 -- 172.21.15.114:0/1804536759 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3305069252 0 0) 0x7f592415db50 con 0x7f5924157230 2023-10-18T12:19:31.617 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.611+0000 7f59227fc700 1 -- 172.21.15.114:0/1804536759 >> v1:172.21.15.114:6789/0 conn(0x7f592406ffe0 legacy=0x7f592406d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:31.617 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.611+0000 7f59227fc700 1 -- 172.21.15.114:0/1804536759 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592415e110 con 0x7f59240b6130 2023-10-18T12:19:31.618 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.611+0000 7f59227fc700 1 --2- 172.21.15.114:0/1804536759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59240b6130 0x7f592406faa0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5918009850 tx=0x7f5918009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2de8f4957a7fe61b server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:31.618 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.611+0000 7f5921ffb700 1 -- 172.21.15.114:0/1804536759 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5918011830 con 0x7f59240b6130 2023-10-18T12:19:31.619 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.611+0000 7f5921ffb700 1 -- 172.21.15.114:0/1804536759 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5918011990 con 0x7f59240b6130 2023-10-18T12:19:31.619 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.611+0000 7f5921ffb700 1 -- 172.21.15.114:0/1804536759 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5918011d40 con 0x7f59240b6130 2023-10-18T12:19:31.619 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.611+0000 7f59297d9700 1 -- 172.21.15.114:0/1804536759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59240b6130 msgr2=0x7f592406faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:31.619 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.611+0000 7f59297d9700 1 --2- 172.21.15.114:0/1804536759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59240b6130 0x7f592406faa0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5918009850 tx=0x7f5918009b60 comp rx=0 tx=0).stop 2023-10-18T12:19:31.619 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.611+0000 7f59297d9700 1 -- 172.21.15.114:0/1804536759 shutdown_connections 2023-10-18T12:19:31.620 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.611+0000 7f59297d9700 1 --2- 172.21.15.114:0/1804536759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59240b6130 0x7f592406faa0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:31.620 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.611+0000 7f59297d9700 1 -- 172.21.15.114:0/1804536759 >> 172.21.15.114:0/1804536759 conn(0x7f5924069ef0 msgr2=0x7f592406a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:31.620 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.611+0000 7f59297d9700 1 -- 172.21.15.114:0/1804536759 shutdown_connections 2023-10-18T12:19:31.620 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.611+0000 7f59297d9700 1 -- 172.21.15.114:0/1804536759 wait complete. 2023-10-18T12:19:31.621 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.615+0000 7f59297d9700 1 Processor -- start 2023-10-18T12:19:31.621 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.615+0000 7f59297d9700 1 -- start start 2023-10-18T12:19:31.622 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.615+0000 7f59297d9700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f592406ffe0 0x7f592413f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:31.622 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.615+0000 7f59297d9700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59240b6130 0x7f592406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:31.622 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.615+0000 7f59297d9700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5924157230 0x7f59241f1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:31.622 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.615+0000 7f59297d9700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592413fcf0 con 0x7f592406ffe0 2023-10-18T12:19:31.622 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.615+0000 7f59297d9700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59240d18c0 con 0x7f59240b6130 2023-10-18T12:19:31.623 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.615+0000 7f59297d9700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59240d1ba0 con 0x7f5924157230 2023-10-18T12:19:31.624 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.615+0000 7f5922ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f592406ffe0 0x7f592413f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:31.624 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.615+0000 7f5922ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f592406ffe0 0x7f592413f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44096/0 (socket says 172.21.15.114:44096) 2023-10-18T12:19:31.624 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.615+0000 7f5922ffd700 1 -- 172.21.15.114:0/3475705546 learned_addr learned my addr 172.21.15.114:0/3475705546 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:31.624 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.615+0000 7f59227fc700 1 --2- 172.21.15.114:0/3475705546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59240b6130 0x7f592406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:31.625 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.615+0000 7f59237fe700 1 --2- 172.21.15.114:0/3475705546 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5924157230 0x7f59241f1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:31.625 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.615+0000 7f5922ffd700 1 -- 172.21.15.114:0/3475705546 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5924157230 msgr2=0x7f59241f1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:31.625 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.615+0000 7f5922ffd700 1 --2- 172.21.15.114:0/3475705546 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5924157230 0x7f59241f1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:31.625 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.615+0000 7f5922ffd700 1 -- 172.21.15.114:0/3475705546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59240b6130 msgr2=0x7f592406e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:31.625 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.615+0000 7f5922ffd700 1 --2- 172.21.15.114:0/3475705546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59240b6130 0x7f592406e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:31.626 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.615+0000 7f5922ffd700 1 -- 172.21.15.114:0/3475705546 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59180094b0 con 0x7f592406ffe0 2023-10-18T12:19:31.626 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.615+0000 7f5922ffd700 1 --2- 172.21.15.114:0/3475705546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f592406ffe0 0x7f592413f7b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f591400c520 tx=0x7f591400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:31.626 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.619+0000 7f590b7fe700 1 -- 172.21.15.114:0/3475705546 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59140054e0 con 0x7f592406ffe0 2023-10-18T12:19:31.626 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.619+0000 7f590b7fe700 1 -- 172.21.15.114:0/3475705546 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59140036a0 con 0x7f592406ffe0 2023-10-18T12:19:31.626 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.619+0000 7f59297d9700 1 -- 172.21.15.114:0/3475705546 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59240d1e80 con 0x7f592406ffe0 2023-10-18T12:19:31.627 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.619+0000 7f590b7fe700 1 -- 172.21.15.114:0/3475705546 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5914003a50 con 0x7f592406ffe0 2023-10-18T12:19:31.627 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.619+0000 7f59297d9700 1 -- 172.21.15.114:0/3475705546 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f592414f0b0 con 0x7f592406ffe0 2023-10-18T12:19:31.627 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.619+0000 7f59297d9700 1 -- 172.21.15.114:0/3475705546 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59240d1610 con 0x7f592406ffe0 2023-10-18T12:19:31.628 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.623+0000 7f590b7fe700 1 -- 172.21.15.114:0/3475705546 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f5914003bb0 con 0x7f592406ffe0 2023-10-18T12:19:31.630 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.623+0000 7f590b7fe700 1 --2- 172.21.15.114:0/3475705546 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5910065740 0x7f5910067c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:31.630 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.623+0000 7f590b7fe700 1 -- 172.21.15.114:0/3475705546 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5914081e40 con 0x7f592406ffe0 2023-10-18T12:19:31.631 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.623+0000 7f59227fc700 1 --2- 172.21.15.114:0/3475705546 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5910065740 0x7f5910067c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:31.632 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.627+0000 7f59227fc700 1 --2- 172.21.15.114:0/3475705546 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5910065740 0x7f5910067c00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f59180090b0 tx=0x7f5918008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:31.638 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.631+0000 7f590b7fe700 1 -- 172.21.15.114:0/3475705546 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f591404fe20 con 0x7f592406ffe0 2023-10-18T12:19:31.823 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.819+0000 7f59297d9700 1 -- 172.21.15.114:0/3475705546 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5924073f60 con 0x7f592406ffe0 2023-10-18T12:19:31.825 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.819+0000 7f590b7fe700 1 -- 172.21.15.114:0/3475705546 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12874 (secure 0 0 0) 0x7f5914003e60 con 0x7f592406ffe0 2023-10-18T12:19:31.826 INFO:teuthology.misc.health.smithi114.stdout: 2023-10-18T12:19:31.826 INFO:teuthology.misc.health.smithi114.stdout:{"epoch":17,"fsid":"240ea340-5d3d-4f52-a4bc-af075aca3deb","created":"2023-10-18T12:19:12.512994+0000","modified":"2023-10-18T12:19:29.344704+0000","last_up_change":"2023-10-18T12:19:25.286009+0000","last_in_change":"2023-10-18T12:19:15.850693+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T12:19:27.040638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c3578978-1a03-4857-b9d2-34a5da3d7731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6817","nonce":1506287862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6820","nonce":1506287862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6830","nonce":1506287862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6825","nonce":1506287862}]},"public_addr":"172.21.15.114:6817/1506287862","cluster_addr":"172.21.15.114:6820/1506287862","heartbeat_back_addr":"172.21.15.114:6830/1506287862","heartbeat_front_addr":"172.21.15.114:6825/1506287862","state":["exists","up"]},{"osd":1,"uuid":"43eb26a6-e2b3-4670-9559-bd053b5140d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6801","nonce":3302727047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6803","nonce":3302727047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6807","nonce":3302727047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6805","nonce":3302727047}]},"public_addr":"172.21.15.114:6801/3302727047","cluster_addr":"172.21.15.114:6803/3302727047","heartbeat_back_addr":"172.21.15.114:6807/3302727047","heartbeat_front_addr":"172.21.15.114:6805/3302727047","state":["exists","up"]},{"osd":2,"uuid":"f3d4dbd5-521c-4dd2-b687-5768cc7d0938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6809","nonce":2699151351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6811","nonce":2699151351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6815","nonce":2699151351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6813","nonce":2699151351}]},"public_addr":"172.21.15.114:6809/2699151351","cluster_addr":"172.21.15.114:6811/2699151351","heartbeat_back_addr":"172.21.15.114:6815/2699151351","heartbeat_front_addr":"172.21.15.114:6813/2699151351","state":["exists","up"]},{"osd":3,"uuid":"823e5802-92b7-4f0d-b32d-a5748993f1b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6821","nonce":1361608073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6824","nonce":1361608073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6829","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6831","nonce":1361608073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6827","nonce":1361608073}]},"public_addr":"172.21.15.114:6821/1361608073","cluster_addr":"172.21.15.114:6824/1361608073","heartbeat_back_addr":"172.21.15.114:6831/1361608073","heartbeat_front_addr":"172.21.15.114:6827/1361608073","state":["exists","up"]},{"osd":4,"uuid":"e47fb93e-13b4-44a4-b084-8c4384ceb41e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6801","nonce":930839681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6803","nonce":930839681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6807","nonce":930839681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6805","nonce":930839681}]},"public_addr":"172.21.15.172:6801/930839681","cluster_addr":"172.21.15.172:6803/930839681","heartbeat_back_addr":"172.21.15.172:6807/930839681","heartbeat_front_addr":"172.21.15.172:6805/930839681","state":["exists","up"]},{"osd":5,"uuid":"7561a973-f479-45a0-af40-f324728d622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6814","nonce":571761850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6818","nonce":571761850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6824","nonce":571761850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6821","nonce":571761850}]},"public_addr":"172.21.15.172:6814/571761850","cluster_addr":"172.21.15.172:6818/571761850","heartbeat_back_addr":"172.21.15.172:6824/571761850","heartbeat_front_addr":"172.21.15.172:6821/571761850","state":["exists","up"]},{"osd":6,"uuid":"51753f4b-7f06-4f1c-9ec7-6e18a66eb980","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6825","nonce":1680398853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6827","nonce":1680398853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6831","nonce":1680398853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6829","nonce":1680398853}]},"public_addr":"172.21.15.172:6825/1680398853","cluster_addr":"172.21.15.172:6827/1680398853","heartbeat_back_addr":"172.21.15.172:6831/1680398853","heartbeat_front_addr":"172.21.15.172:6829/1680398853","state":["exists","up"]},{"osd":7,"uuid":"4d8b1e15-143d-4d17-9074-59d92f0f9af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6809","nonce":349710101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6811","nonce":349710101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6819","nonce":349710101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6815","nonce":349710101}]},"public_addr":"172.21.15.172:6809/349710101","cluster_addr":"172.21.15.172:6811/349710101","heartbeat_back_addr":"172.21.15.172:6819/349710101","heartbeat_front_addr":"172.21.15.172:6815/349710101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.889460+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.475494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.911473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.648596+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.609994+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.636248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.854589+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.885826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T12:19:31.831 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.823+0000 7f59297d9700 1 -- 172.21.15.114:0/3475705546 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5910065740 msgr2=0x7f5910067c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:31.831 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.823+0000 7f59297d9700 1 --2- 172.21.15.114:0/3475705546 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5910065740 0x7f5910067c00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f59180090b0 tx=0x7f5918008030 comp rx=0 tx=0).stop 2023-10-18T12:19:31.831 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.823+0000 7f59297d9700 1 -- 172.21.15.114:0/3475705546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f592406ffe0 msgr2=0x7f592413f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:31.831 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.823+0000 7f59297d9700 1 --2- 172.21.15.114:0/3475705546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f592406ffe0 0x7f592413f7b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f591400c520 tx=0x7f591400c8e0 comp rx=0 tx=0).stop 2023-10-18T12:19:31.831 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.823+0000 7f59297d9700 1 -- 172.21.15.114:0/3475705546 shutdown_connections 2023-10-18T12:19:31.832 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.823+0000 7f59297d9700 1 --2- 172.21.15.114:0/3475705546 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5910065740 0x7f5910067c00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:31.832 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.823+0000 7f59297d9700 1 --2- 172.21.15.114:0/3475705546 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5924157230 0x7f59241f1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:31.832 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.823+0000 7f59297d9700 1 --2- 172.21.15.114:0/3475705546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59240b6130 0x7f592406e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:31.832 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.823+0000 7f59297d9700 1 --2- 172.21.15.114:0/3475705546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f592406ffe0 0x7f592413f7b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:31.832 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.823+0000 7f59297d9700 1 -- 172.21.15.114:0/3475705546 >> 172.21.15.114:0/3475705546 conn(0x7f5924069ef0 msgr2=0x7f592406a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:31.833 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.823+0000 7f59297d9700 1 -- 172.21.15.114:0/3475705546 shutdown_connections 2023-10-18T12:19:31.833 INFO:teuthology.misc.health.smithi114.stderr:2023-10-18T12:19:31.823+0000 7f59297d9700 1 -- 172.21.15.114:0/3475705546 wait complete. 2023-10-18T12:19:31.849 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-18T12:19:31.849 INFO:tasks.ceph:Creating RBD pool 2023-10-18T12:19:31.849 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-18T12:19:31.872 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:19:31.905 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:19:32.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.003+0000 7ff4c954d700 1 Processor -- start 2023-10-18T12:19:32.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.003+0000 7ff4c954d700 1 -- start start 2023-10-18T12:19:32.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.007+0000 7ff4c954d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4c40d23e0 0x7ff4c415dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:32.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.007+0000 7ff4c954d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff4c406fef0 0x7ff4c40b65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:32.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.007+0000 7ff4c954d700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4c40b6e40 con 0x7ff4c40d2e20 2023-10-18T12:19:32.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.007+0000 7ff4c954d700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4c4070330 con 0x7ff4c406fef0 2023-10-18T12:19:32.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.007+0000 7ff4c954d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c40b7120 con 0x7ff4c40d23e0 2023-10-18T12:19:32.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.007+0000 7ff4c37fe700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff4c40d2e20 0x7ff4c41607d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:47078/0 (socket says 172.21.15.114:47078) 2023-10-18T12:19:32.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.007+0000 7ff4c37fe700 1 -- 172.21.15.114:0/2416772165 learned_addr learned my addr 172.21.15.114:0/2416772165 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:19:32.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.007+0000 7ff4c27fc700 1 --2- 172.21.15.114:0/2416772165 >> v2:172.21.15.114:3300/0 conn(0x7ff4c406fef0 0x7ff4c40b65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:32.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.007+0000 7ff4c2ffd700 1 --2- 172.21.15.114:0/2416772165 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4c40d23e0 0x7ff4c415dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:32.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.007+0000 7ff4c1ffb700 1 -- 172.21.15.114:0/2416772165 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 510726907 0 0) 0x7ff4c40b6e40 con 0x7ff4c40d2e20 2023-10-18T12:19:32.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.007+0000 7ff4c1ffb700 1 -- 172.21.15.114:0/2416772165 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4ac0035d0 con 0x7ff4c40d2e20 2023-10-18T12:19:32.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.007+0000 7ff4c27fc700 1 -- 172.21.15.114:0/2416772165 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4c40d23e0 msgr2=0x7ff4c415dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:32.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.007+0000 7ff4c27fc700 1 --2- 172.21.15.114:0/2416772165 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4c40d23e0 0x7ff4c415dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:32.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.007+0000 7ff4c27fc700 1 -- 172.21.15.114:0/2416772165 >> v1:172.21.15.114:6789/0 conn(0x7ff4c40d2e20 legacy=0x7ff4c41607d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:32.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.007+0000 7ff4c27fc700 1 -- 172.21.15.114:0/2416772165 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c415d4f0 con 0x7ff4c406fef0 2023-10-18T12:19:32.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.007+0000 7ff4c27fc700 1 --2- 172.21.15.114:0/2416772165 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4c406fef0 0x7ff4c40b65f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8009850 tx=0x7ff4b8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea53e66eab2ee9f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:32.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.007+0000 7ff4c1ffb700 1 -- 172.21.15.114:0/2416772165 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b8011830 con 0x7ff4c406fef0 2023-10-18T12:19:32.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.007+0000 7ff4c1ffb700 1 -- 172.21.15.114:0/2416772165 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b8011990 con 0x7ff4c406fef0 2023-10-18T12:19:32.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.007+0000 7ff4c1ffb700 1 -- 172.21.15.114:0/2416772165 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b8011d40 con 0x7ff4c406fef0 2023-10-18T12:19:32.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.011+0000 7ff4c954d700 1 -- 172.21.15.114:0/2416772165 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4c406fef0 msgr2=0x7ff4c40b65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:32.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.011+0000 7ff4c954d700 1 --2- 172.21.15.114:0/2416772165 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4c406fef0 0x7ff4c40b65f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8009850 tx=0x7ff4b8009b60 comp rx=0 tx=0).stop 2023-10-18T12:19:32.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.011+0000 7ff4c954d700 1 -- 172.21.15.114:0/2416772165 shutdown_connections 2023-10-18T12:19:32.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.011+0000 7ff4c954d700 1 --2- 172.21.15.114:0/2416772165 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4c406fef0 0x7ff4c40b65f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:32.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.011+0000 7ff4c954d700 1 --2- 172.21.15.114:0/2416772165 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4c40d23e0 0x7ff4c415dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:32.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.011+0000 7ff4c954d700 1 -- 172.21.15.114:0/2416772165 >> 172.21.15.114:0/2416772165 conn(0x7ff4c4069f20 msgr2=0x7ff4c406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:32.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.011+0000 7ff4c954d700 1 -- 172.21.15.114:0/2416772165 shutdown_connections 2023-10-18T12:19:32.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.011+0000 7ff4c954d700 1 -- 172.21.15.114:0/2416772165 wait complete. 2023-10-18T12:19:32.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.011+0000 7ff4c954d700 1 Processor -- start 2023-10-18T12:19:32.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.015+0000 7ff4c954d700 1 -- start start 2023-10-18T12:19:32.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.015+0000 7ff4c954d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4c406fef0 0x7ff4c40b5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:32.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.015+0000 7ff4c954d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4c40d23e0 0x7ff4c414bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:32.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.015+0000 7ff4c954d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4c40d2e20 0x7ff4c414c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:32.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.015+0000 7ff4c954d700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c4149c20 con 0x7ff4c406fef0 2023-10-18T12:19:32.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.015+0000 7ff4c954d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c414c7b0 con 0x7ff4c40d2e20 2023-10-18T12:19:32.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.015+0000 7ff4c954d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c414ca90 con 0x7ff4c40d23e0 2023-10-18T12:19:32.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.015+0000 7ff4c2ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4c406fef0 0x7ff4c40b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:32.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.015+0000 7ff4c2ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4c406fef0 0x7ff4c40b5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44108/0 (socket says 172.21.15.114:44108) 2023-10-18T12:19:32.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.015+0000 7ff4c2ffd700 1 -- 172.21.15.114:0/736449199 learned_addr learned my addr 172.21.15.114:0/736449199 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:32.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.015+0000 7ff4c37fe700 1 --2- 172.21.15.114:0/736449199 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4c40d2e20 0x7ff4c414c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:32.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.015+0000 7ff4c27fc700 1 --2- 172.21.15.114:0/736449199 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4c40d23e0 0x7ff4c414bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:32.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.015+0000 7ff4c2ffd700 1 -- 172.21.15.114:0/736449199 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4c40d23e0 msgr2=0x7ff4c414bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:32.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.015+0000 7ff4c2ffd700 1 --2- 172.21.15.114:0/736449199 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4c40d23e0 0x7ff4c414bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:32.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.015+0000 7ff4c2ffd700 1 -- 172.21.15.114:0/736449199 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4c40d2e20 msgr2=0x7ff4c414c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:32.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.015+0000 7ff4c2ffd700 1 --2- 172.21.15.114:0/736449199 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4c40d2e20 0x7ff4c414c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:32.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.015+0000 7ff4c2ffd700 1 -- 172.21.15.114:0/736449199 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b80094b0 con 0x7ff4c406fef0 2023-10-18T12:19:32.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.015+0000 7ff4c2ffd700 1 --2- 172.21.15.114:0/736449199 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4c406fef0 0x7ff4c40b5b00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff4b400e9d0 tx=0x7ff4b400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:32.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.015+0000 7ff4ab7fe700 1 -- 172.21.15.114:0/736449199 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4009720 con 0x7ff4c406fef0 2023-10-18T12:19:32.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.015+0000 7ff4ab7fe700 1 -- 172.21.15.114:0/736449199 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b400ee70 con 0x7ff4c406fef0 2023-10-18T12:19:32.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.019+0000 7ff4c954d700 1 -- 172.21.15.114:0/736449199 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c4149e70 con 0x7ff4c406fef0 2023-10-18T12:19:32.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.019+0000 7ff4ab7fe700 1 -- 172.21.15.114:0/736449199 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b400ca50 con 0x7ff4c406fef0 2023-10-18T12:19:32.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.019+0000 7ff4c954d700 1 -- 172.21.15.114:0/736449199 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c40b2220 con 0x7ff4c406fef0 2023-10-18T12:19:32.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.019+0000 7ff4c954d700 1 -- 172.21.15.114:0/736449199 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4c404e910 con 0x7ff4c406fef0 2023-10-18T12:19:32.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.019+0000 7ff4ab7fe700 1 -- 172.21.15.114:0/736449199 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff4b400cbb0 con 0x7ff4c406fef0 2023-10-18T12:19:32.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.023+0000 7ff4ab7fe700 1 --2- 172.21.15.114:0/736449199 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff4b00656f0 0x7ff4b0067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:32.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.023+0000 7ff4ab7fe700 1 -- 172.21.15.114:0/736449199 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff4b4082910 con 0x7ff4c406fef0 2023-10-18T12:19:32.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.023+0000 7ff4c27fc700 1 --2- 172.21.15.114:0/736449199 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff4b00656f0 0x7ff4b0067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:32.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.023+0000 7ff4c27fc700 1 --2- 172.21.15.114:0/736449199 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff4b00656f0 0x7ff4b0067bb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff4b80090b0 tx=0x7ff4b8008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:32.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.027+0000 7ff4ab7fe700 1 -- 172.21.15.114:0/736449199 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7ff4b4054310 con 0x7ff4c406fef0 2023-10-18T12:19:32.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.287+0000 7ff4c954d700 1 -- 172.21.15.114:0/736449199 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7ff4c406d450 con 0x7ff4c406fef0 2023-10-18T12:19:32.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.507+0000 7ff4ab7fe700 1 -- 172.21.15.114:0/736449199 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v18) v1 ==== 109+0+0 (secure 0 0 0) 0x7ff4b400ce60 con 0x7ff4c406fef0 2023-10-18T12:19:32.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.511+0000 7ff4c954d700 1 -- 172.21.15.114:0/736449199 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff4b00656f0 msgr2=0x7ff4b0067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:32.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.511+0000 7ff4c954d700 1 --2- 172.21.15.114:0/736449199 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff4b00656f0 0x7ff4b0067bb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff4b80090b0 tx=0x7ff4b8008030 comp rx=0 tx=0).stop 2023-10-18T12:19:32.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.511+0000 7ff4c954d700 1 -- 172.21.15.114:0/736449199 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4c406fef0 msgr2=0x7ff4c40b5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:32.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.511+0000 7ff4c954d700 1 --2- 172.21.15.114:0/736449199 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4c406fef0 0x7ff4c40b5b00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff4b400e9d0 tx=0x7ff4b400ece0 comp rx=0 tx=0).stop 2023-10-18T12:19:32.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.511+0000 7ff4c954d700 1 -- 172.21.15.114:0/736449199 shutdown_connections 2023-10-18T12:19:32.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.511+0000 7ff4c954d700 1 --2- 172.21.15.114:0/736449199 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff4b00656f0 0x7ff4b0067bb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:32.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.511+0000 7ff4c954d700 1 --2- 172.21.15.114:0/736449199 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff4c40d23e0 0x7ff4c414bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:32.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.511+0000 7ff4c954d700 1 --2- 172.21.15.114:0/736449199 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4c40d2e20 0x7ff4c414c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:32.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.511+0000 7ff4c954d700 1 --2- 172.21.15.114:0/736449199 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff4c406fef0 0x7ff4c40b5b00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:32.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.511+0000 7ff4c954d700 1 -- 172.21.15.114:0/736449199 >> 172.21.15.114:0/736449199 conn(0x7ff4c4069f20 msgr2=0x7ff4c40cecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:32.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.511+0000 7ff4c954d700 1 -- 172.21.15.114:0/736449199 shutdown_connections 2023-10-18T12:19:32.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.511+0000 7ff4c954d700 1 -- 172.21.15.114:0/736449199 wait complete. 2023-10-18T12:19:32.521 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'rbd' created 2023-10-18T12:19:32.540 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-18T12:19:32.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.763+0000 7f40872a2700 1 Processor -- start 2023-10-18T12:19:32.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.763+0000 7f40872a2700 1 -- start start 2023-10-18T12:19:32.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.763+0000 7f40872a2700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f408015cd30 0x7f4080160a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:32.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.763+0000 7f40872a2700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f408015d110 0x7f4080160f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:32.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.763+0000 7f40872a2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f408006ba80 0x7f4080161480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:32.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.763+0000 7f40872a2700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40800ce620 con 0x7f408015cd30 2023-10-18T12:19:32.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.763+0000 7f40872a2700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40800cf350 con 0x7f408015d110 2023-10-18T12:19:32.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.763+0000 7f40872a2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40800ce890 con 0x7f408006ba80 2023-10-18T12:19:32.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.763+0000 7f408503e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f408015cd30 0x7f4080160a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:32.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.763+0000 7f408503e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f408015cd30 0x7f4080160a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44114/0 (socket says 172.21.15.114:44114) 2023-10-18T12:19:32.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.763+0000 7f408503e700 1 -- 172.21.15.114:0/1059273735 learned_addr learned my addr 172.21.15.114:0/1059273735 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:32.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.767+0000 7f408483d700 1 --2- 172.21.15.114:0/1059273735 >> v2:172.21.15.172:3300/0 conn(0x7f408015d110 0x7f4080160f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:32.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.767+0000 7f408583f700 1 --2- 172.21.15.114:0/1059273735 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f408006ba80 0x7f4080161480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:32.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.767+0000 7f408503e700 1 -- 172.21.15.114:0/1059273735 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f408006ba80 msgr2=0x7f4080161480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:32.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.767+0000 7f408503e700 1 --2- 172.21.15.114:0/1059273735 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f408006ba80 0x7f4080161480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:32.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.767+0000 7f408503e700 1 -- 172.21.15.114:0/1059273735 >> v2:172.21.15.172:3300/0 conn(0x7f408015d110 msgr2=0x7f4080160f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:32.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.767+0000 7f408503e700 1 --2- 172.21.15.114:0/1059273735 >> v2:172.21.15.172:3300/0 conn(0x7f408015d110 0x7f4080160f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:32.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.767+0000 7f408503e700 1 -- 172.21.15.114:0/1059273735 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40800ceb70 con 0x7f408015cd30 2023-10-18T12:19:32.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.767+0000 7f408503e700 1 --2- 172.21.15.114:0/1059273735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f408015cd30 0x7f4080160a00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f40800c4350 tx=0x7f407c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c90a751176f12a44 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:32.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.767+0000 7f4077fff700 1 -- 172.21.15.114:0/1059273735 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407c011830 con 0x7f408015cd30 2023-10-18T12:19:32.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.767+0000 7f4077fff700 1 -- 172.21.15.114:0/1059273735 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f407c011990 con 0x7f408015cd30 2023-10-18T12:19:32.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.767+0000 7f4077fff700 1 -- 172.21.15.114:0/1059273735 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407c011d20 con 0x7f408015cd30 2023-10-18T12:19:32.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.767+0000 7f40872a2700 1 -- 172.21.15.114:0/1059273735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f408015cd30 msgr2=0x7f4080160a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:32.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.767+0000 7f40872a2700 1 --2- 172.21.15.114:0/1059273735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f408015cd30 0x7f4080160a00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f40800c4350 tx=0x7f407c009bf0 comp rx=0 tx=0).stop 2023-10-18T12:19:32.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.767+0000 7f40872a2700 1 -- 172.21.15.114:0/1059273735 shutdown_connections 2023-10-18T12:19:32.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.767+0000 7f40872a2700 1 --2- 172.21.15.114:0/1059273735 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f408006ba80 0x7f4080161480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:32.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.767+0000 7f40872a2700 1 --2- 172.21.15.114:0/1059273735 >> v2:172.21.15.172:3300/0 conn(0x7f408015d110 0x7f4080160f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:32.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.767+0000 7f40872a2700 1 --2- 172.21.15.114:0/1059273735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f408015cd30 0x7f4080160a00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:32.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.767+0000 7f40872a2700 1 -- 172.21.15.114:0/1059273735 >> 172.21.15.114:0/1059273735 conn(0x7f40800d09b0 msgr2=0x7f40800d0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:32.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.767+0000 7f40872a2700 1 -- 172.21.15.114:0/1059273735 shutdown_connections 2023-10-18T12:19:32.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.767+0000 7f40872a2700 1 -- 172.21.15.114:0/1059273735 wait complete. 2023-10-18T12:19:32.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.771+0000 7f40872a2700 1 Processor -- start 2023-10-18T12:19:32.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.771+0000 7f40872a2700 1 -- start start 2023-10-18T12:19:32.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.771+0000 7f40872a2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f408006ba80 0x7f40800b37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:32.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.771+0000 7f40872a2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f408015cd30 0x7f408006a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:32.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.771+0000 7f40872a2700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40800b3d30 0x7f408006a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:32.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.771+0000 7f40872a2700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40800c7250 con 0x7f40800b3d30 2023-10-18T12:19:32.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.771+0000 7f40872a2700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40800c7a80 con 0x7f408015cd30 2023-10-18T12:19:32.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.771+0000 7f40872a2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40800c7cd0 con 0x7f408006ba80 2023-10-18T12:19:32.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.771+0000 7f408583f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40800b3d30 0x7f408006a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:32.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.771+0000 7f408583f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40800b3d30 0x7f408006a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44116/0 (socket says 172.21.15.114:44116) 2023-10-18T12:19:32.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.771+0000 7f408583f700 1 -- 172.21.15.114:0/534587580 learned_addr learned my addr 172.21.15.114:0/534587580 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:32.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.771+0000 7f408503e700 1 --2- 172.21.15.114:0/534587580 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f408006ba80 0x7f40800b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:32.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.771+0000 7f408483d700 1 --2- 172.21.15.114:0/534587580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f408015cd30 0x7f408006a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:32.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.771+0000 7f408583f700 1 -- 172.21.15.114:0/534587580 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f408006ba80 msgr2=0x7f40800b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:32.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.775+0000 7f408583f700 1 --2- 172.21.15.114:0/534587580 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f408006ba80 0x7f40800b37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:32.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.775+0000 7f408583f700 1 -- 172.21.15.114:0/534587580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f408015cd30 msgr2=0x7f408006a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:32.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.775+0000 7f408583f700 1 --2- 172.21.15.114:0/534587580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f408015cd30 0x7f408006a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:32.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.775+0000 7f408583f700 1 -- 172.21.15.114:0/534587580 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f407c009570 con 0x7f40800b3d30 2023-10-18T12:19:32.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.775+0000 7f408483d700 1 --2- 172.21.15.114:0/534587580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f408015cd30 0x7f408006a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:19:32.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.775+0000 7f408583f700 1 --2- 172.21.15.114:0/534587580 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40800b3d30 0x7f408006a670 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f407800efc0 tx=0x7f407800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:32.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.775+0000 7f4075ffb700 1 -- 172.21.15.114:0/534587580 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4078009ea0 con 0x7f40800b3d30 2023-10-18T12:19:32.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.775+0000 7f4075ffb700 1 -- 172.21.15.114:0/534587580 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f407800f040 con 0x7f40800b3d30 2023-10-18T12:19:32.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.775+0000 7f4075ffb700 1 -- 172.21.15.114:0/534587580 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4078014480 con 0x7f40800b3d30 2023-10-18T12:19:32.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.775+0000 7f40872a2700 1 -- 172.21.15.114:0/534587580 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40800c7fb0 con 0x7f40800b3d30 2023-10-18T12:19:32.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.775+0000 7f40872a2700 1 -- 172.21.15.114:0/534587580 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40800c8570 con 0x7f40800b3d30 2023-10-18T12:19:32.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.775+0000 7f40872a2700 1 -- 172.21.15.114:0/534587580 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4080073f00 con 0x7f40800b3d30 2023-10-18T12:19:32.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.779+0000 7f4075ffb700 1 -- 172.21.15.114:0/534587580 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f40780145e0 con 0x7f40800b3d30 2023-10-18T12:19:32.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.779+0000 7f4075ffb700 1 --2- 172.21.15.114:0/534587580 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4064065720 0x7f4064067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:32.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.779+0000 7f4075ffb700 1 -- 172.21.15.114:0/534587580 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f4078083650 con 0x7f40800b3d30 2023-10-18T12:19:32.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.779+0000 7f408503e700 1 --2- 172.21.15.114:0/534587580 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4064065720 0x7f4064067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:32.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.779+0000 7f408503e700 1 --2- 172.21.15.114:0/534587580 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4064065720 0x7f4064067be0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f407c000c00 tx=0x7f407c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:32.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:32.787+0000 7f4075ffb700 1 -- 172.21.15.114:0/534587580 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f4078051350 con 0x7f40800b3d30 2023-10-18T12:19:33.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.047+0000 7f40872a2700 1 -- 172.21.15.114:0/534587580 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4080070d70 con 0x7f40800b3d30 2023-10-18T12:19:33.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.515+0000 7f4075ffb700 1 -- 172.21.15.114:0/534587580 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v19) v1 ==== 173+0+0 (secure 0 0 0) 0x7f4078054970 con 0x7f40800b3d30 2023-10-18T12:19:33.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.519+0000 7f40872a2700 1 -- 172.21.15.114:0/534587580 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4064065720 msgr2=0x7f4064067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:33.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.519+0000 7f40872a2700 1 --2- 172.21.15.114:0/534587580 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4064065720 0x7f4064067be0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f407c000c00 tx=0x7f407c008030 comp rx=0 tx=0).stop 2023-10-18T12:19:33.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.519+0000 7f40872a2700 1 -- 172.21.15.114:0/534587580 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40800b3d30 msgr2=0x7f408006a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:33.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.519+0000 7f40872a2700 1 --2- 172.21.15.114:0/534587580 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40800b3d30 0x7f408006a670 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f407800efc0 tx=0x7f407800c3a0 comp rx=0 tx=0).stop 2023-10-18T12:19:33.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.519+0000 7f40872a2700 1 -- 172.21.15.114:0/534587580 shutdown_connections 2023-10-18T12:19:33.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.519+0000 7f40872a2700 1 --2- 172.21.15.114:0/534587580 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4064065720 0x7f4064067be0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:33.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.519+0000 7f40872a2700 1 --2- 172.21.15.114:0/534587580 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40800b3d30 0x7f408006a670 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:33.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.519+0000 7f40872a2700 1 --2- 172.21.15.114:0/534587580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f408015cd30 0x7f408006a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:33.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.519+0000 7f40872a2700 1 --2- 172.21.15.114:0/534587580 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f408006ba80 0x7f40800b37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:33.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.519+0000 7f40872a2700 1 -- 172.21.15.114:0/534587580 >> 172.21.15.114:0/534587580 conn(0x7f40800d09b0 msgr2=0x7f40800b1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:33.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.519+0000 7f40872a2700 1 -- 172.21.15.114:0/534587580 shutdown_connections 2023-10-18T12:19:33.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.519+0000 7f40872a2700 1 -- 172.21.15.114:0/534587580 wait complete. 2023-10-18T12:19:33.529 INFO:teuthology.orchestra.run.smithi114.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-18T12:19:33.549 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-18T12:19:33.550 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-18T12:19:33.550 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-18T12:19:33.558 INFO:tasks.ceph.mds.a:Started 2023-10-18T12:19:33.558 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-18T12:19:33.559 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-18T12:19:33.565 INFO:tasks.ceph.mds.c:Started 2023-10-18T12:19:33.565 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-18T12:19:33.565 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-18T12:19:33.573 INFO:tasks.ceph.mds.b:Started 2023-10-18T12:19:33.574 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-18T12:19:33.574 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-18T12:19:33.578 INFO:tasks.ceph.mds.d:Started 2023-10-18T12:19:33.579 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-18T12:19:33.579 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T12:19:33.677 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2023-10-18T12:19:33.686 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2023-10-18T12:19:33.701 INFO:tasks.ceph.mds.d.smithi172.stdout:starting mds.d at 2023-10-18T12:19:33.705 INFO:tasks.ceph.mds.b.smithi172.stdout:starting mds.b at 2023-10-18T12:19:33.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.751+0000 7f4096d97700 1 Processor -- start 2023-10-18T12:19:33.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.751+0000 7f4096d97700 1 -- start start 2023-10-18T12:19:33.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.751+0000 7f4096d97700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4090070b00 0x7f4090060fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:33.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.751+0000 7f4096d97700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f409006e680 0x7f40900cd790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:33.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.751+0000 7f4096d97700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40900cccf0 con 0x7f40900cd240 2023-10-18T12:19:33.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.751+0000 7f4096d97700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40900ce550 con 0x7f409006e680 2023-10-18T12:19:33.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.751+0000 7f4096d97700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40901597e0 con 0x7f4090070b00 2023-10-18T12:19:33.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.751+0000 7f4095d95700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f40900cd240 0x7f40901590d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:47110/0 (socket says 172.21.15.114:47110) 2023-10-18T12:19:33.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.751+0000 7f4095d95700 1 -- 172.21.15.114:0/709930960 learned_addr learned my addr 172.21.15.114:0/709930960 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:19:33.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.755+0000 7f4096596700 1 --2- 172.21.15.114:0/709930960 >> v2:172.21.15.114:3300/0 conn(0x7f409006e680 0x7f40900cd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:33.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.755+0000 7f4095594700 1 --2- 172.21.15.114:0/709930960 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4090070b00 0x7f4090060fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:33.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.755+0000 7f4096596700 1 -- 172.21.15.114:0/709930960 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4090070b00 msgr2=0x7f4090060fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:33.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.755+0000 7f4096596700 1 --2- 172.21.15.114:0/709930960 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4090070b00 0x7f4090060fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:33.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.755+0000 7f4096596700 1 -- 172.21.15.114:0/709930960 >> v1:172.21.15.114:6789/0 conn(0x7f40900cd240 legacy=0x7f40901590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:33.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.755+0000 7f4096596700 1 -- 172.21.15.114:0/709930960 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4090070670 con 0x7f409006e680 2023-10-18T12:19:33.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.755+0000 7f4096596700 1 --2- 172.21.15.114:0/709930960 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f409006e680 0x7f40900cd790 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4088009d90 tx=0x7f408800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0de87721fa5d347 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:33.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.755+0000 7f4094d93700 1 -- 172.21.15.114:0/709930960 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408800e070 con 0x7f409006e680 2023-10-18T12:19:33.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.755+0000 7f4094d93700 1 -- 172.21.15.114:0/709930960 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408800bb20 con 0x7f409006e680 2023-10-18T12:19:33.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.755+0000 7f4094d93700 1 -- 172.21.15.114:0/709930960 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4088012430 con 0x7f409006e680 2023-10-18T12:19:33.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.755+0000 7f4096d97700 1 -- 172.21.15.114:0/709930960 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f409006e680 msgr2=0x7f40900cd790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:33.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.755+0000 7f4096d97700 1 --2- 172.21.15.114:0/709930960 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f409006e680 0x7f40900cd790 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4088009d90 tx=0x7f408800b330 comp rx=0 tx=0).stop 2023-10-18T12:19:33.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.755+0000 7f4096d97700 1 -- 172.21.15.114:0/709930960 shutdown_connections 2023-10-18T12:19:33.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.755+0000 7f4096d97700 1 --2- 172.21.15.114:0/709930960 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f409006e680 0x7f40900cd790 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:33.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.755+0000 7f4096d97700 1 --2- 172.21.15.114:0/709930960 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4090070b00 0x7f4090060fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:33.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.755+0000 7f4096d97700 1 -- 172.21.15.114:0/709930960 >> 172.21.15.114:0/709930960 conn(0x7f40900cb9f0 msgr2=0x7f40900cbe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:33.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.755+0000 7f4096d97700 1 -- 172.21.15.114:0/709930960 shutdown_connections 2023-10-18T12:19:33.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.755+0000 7f4096d97700 1 -- 172.21.15.114:0/709930960 wait complete. 2023-10-18T12:19:33.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.759+0000 7f4096d97700 1 Processor -- start 2023-10-18T12:19:33.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.759+0000 7f4096d97700 1 -- start start 2023-10-18T12:19:33.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.759+0000 7f4096d97700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f409006e680 0x7f40900b38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:33.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.759+0000 7f4096d97700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4090070b00 0x7f40900b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:33.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.759+0000 7f4096d97700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f40900c1e30 0x7f409014a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:33.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.759+0000 7f4096d97700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40900b4c80 con 0x7f4090070b00 2023-10-18T12:19:33.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.759+0000 7f4096d97700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40900c6420 con 0x7f409006e680 2023-10-18T12:19:33.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.759+0000 7f4096d97700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40900c6700 con 0x7f40900c1e30 2023-10-18T12:19:33.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.759+0000 7f4095594700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4090070b00 0x7f40900b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:33.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.759+0000 7f4095594700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4090070b00 0x7f40900b3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44186/0 (socket says 172.21.15.114:44186) 2023-10-18T12:19:33.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.759+0000 7f4095594700 1 -- 172.21.15.114:0/4223201294 learned_addr learned my addr 172.21.15.114:0/4223201294 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:33.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.759+0000 7f4095d95700 1 --2- 172.21.15.114:0/4223201294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f409006e680 0x7f40900b38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:33.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.759+0000 7f4096596700 1 --2- 172.21.15.114:0/4223201294 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f40900c1e30 0x7f409014a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:33.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.759+0000 7f4095594700 1 -- 172.21.15.114:0/4223201294 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f40900c1e30 msgr2=0x7f409014a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:33.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.759+0000 7f4095594700 1 --2- 172.21.15.114:0/4223201294 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f40900c1e30 0x7f409014a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:33.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.759+0000 7f4095594700 1 -- 172.21.15.114:0/4223201294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f409006e680 msgr2=0x7f40900b38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:33.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.759+0000 7f4095594700 1 --2- 172.21.15.114:0/4223201294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f409006e680 0x7f40900b38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:33.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.759+0000 7f4095594700 1 -- 172.21.15.114:0/4223201294 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4088009a70 con 0x7f4090070b00 2023-10-18T12:19:33.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.759+0000 7f4096596700 1 --2- 172.21.15.114:0/4223201294 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f40900c1e30 0x7f409014a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:19:33.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.763+0000 7f4095594700 1 --2- 172.21.15.114:0/4223201294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4090070b00 0x7f40900b3e20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f408000e9a0 tx=0x7f408000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:33.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.763+0000 7f40867fc700 1 -- 172.21.15.114:0/4223201294 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4080009720 con 0x7f4090070b00 2023-10-18T12:19:33.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.763+0000 7f40867fc700 1 -- 172.21.15.114:0/4223201294 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408000c850 con 0x7f4090070b00 2023-10-18T12:19:33.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.763+0000 7f40867fc700 1 -- 172.21.15.114:0/4223201294 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408000cbe0 con 0x7f4090070b00 2023-10-18T12:19:33.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.763+0000 7f4096d97700 1 -- 172.21.15.114:0/4223201294 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40900b4480 con 0x7f4090070b00 2023-10-18T12:19:33.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.763+0000 7f4096d97700 1 -- 172.21.15.114:0/4223201294 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40900c6040 con 0x7f4090070b00 2023-10-18T12:19:33.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.763+0000 7f4096d97700 1 -- 172.21.15.114:0/4223201294 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4090072e60 con 0x7f4090070b00 2023-10-18T12:19:33.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.763+0000 7f40867fc700 1 -- 172.21.15.114:0/4223201294 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f408000cd40 con 0x7f4090070b00 2023-10-18T12:19:33.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.767+0000 7f40867fc700 1 --2- 172.21.15.114:0/4223201294 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f40740656f0 0x7f4074067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:33.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.767+0000 7f40867fc700 1 -- 172.21.15.114:0/4223201294 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4080082b00 con 0x7f4090070b00 2023-10-18T12:19:33.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.767+0000 7f4095d95700 1 --2- 172.21.15.114:0/4223201294 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f40740656f0 0x7f4074067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:33.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.767+0000 7f4095d95700 1 --2- 172.21.15.114:0/4223201294 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f40740656f0 0x7f4074067bb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f408c005930 tx=0x7f408c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:33.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.775+0000 7f40867fc700 1 -- 172.21.15.114:0/4223201294 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f4080084e60 con 0x7f4090070b00 2023-10-18T12:19:33.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.959+0000 7f4096d97700 1 -- 172.21.15.114:0/4223201294 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40900b0450 con 0x7f4090070b00 2023-10-18T12:19:33.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.963+0000 7f40867fc700 1 -- 172.21.15.114:0/4223201294 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14673 (secure 0 0 0) 0x7f4080017020 con 0x7f4090070b00 2023-10-18T12:19:33.969 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:19:33.969 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":19,"fsid":"240ea340-5d3d-4f52-a4bc-af075aca3deb","created":"2023-10-18T12:19:12.512994+0000","modified":"2023-10-18T12:19:33.509707+0000","last_up_change":"2023-10-18T12:19:25.286009+0000","last_in_change":"2023-10-18T12:19:15.850693+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T12:19:27.040638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-18T12:19:32.358094+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c3578978-1a03-4857-b9d2-34a5da3d7731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6817","nonce":1506287862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6820","nonce":1506287862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6830","nonce":1506287862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6825","nonce":1506287862}]},"public_addr":"172.21.15.114:6817/1506287862","cluster_addr":"172.21.15.114:6820/1506287862","heartbeat_back_addr":"172.21.15.114:6830/1506287862","heartbeat_front_addr":"172.21.15.114:6825/1506287862","state":["exists","up"]},{"osd":1,"uuid":"43eb26a6-e2b3-4670-9559-bd053b5140d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6801","nonce":3302727047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6803","nonce":3302727047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6807","nonce":3302727047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6805","nonce":3302727047}]},"public_addr":"172.21.15.114:6801/3302727047","cluster_addr":"172.21.15.114:6803/3302727047","heartbeat_back_addr":"172.21.15.114:6807/3302727047","heartbeat_front_addr":"172.21.15.114:6805/3302727047","state":["exists","up"]},{"osd":2,"uuid":"f3d4dbd5-521c-4dd2-b687-5768cc7d0938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6809","nonce":2699151351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6811","nonce":2699151351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6815","nonce":2699151351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6813","nonce":2699151351}]},"public_addr":"172.21.15.114:6809/2699151351","cluster_addr":"172.21.15.114:6811/2699151351","heartbeat_back_addr":"172.21.15.114:6815/2699151351","heartbeat_front_addr":"172.21.15.114:6813/2699151351","state":["exists","up"]},{"osd":3,"uuid":"823e5802-92b7-4f0d-b32d-a5748993f1b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6821","nonce":1361608073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6824","nonce":1361608073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6829","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6831","nonce":1361608073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6827","nonce":1361608073}]},"public_addr":"172.21.15.114:6821/1361608073","cluster_addr":"172.21.15.114:6824/1361608073","heartbeat_back_addr":"172.21.15.114:6831/1361608073","heartbeat_front_addr":"172.21.15.114:6827/1361608073","state":["exists","up"]},{"osd":4,"uuid":"e47fb93e-13b4-44a4-b084-8c4384ceb41e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6801","nonce":930839681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6803","nonce":930839681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6807","nonce":930839681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6805","nonce":930839681}]},"public_addr":"172.21.15.172:6801/930839681","cluster_addr":"172.21.15.172:6803/930839681","heartbeat_back_addr":"172.21.15.172:6807/930839681","heartbeat_front_addr":"172.21.15.172:6805/930839681","state":["exists","up"]},{"osd":5,"uuid":"7561a973-f479-45a0-af40-f324728d622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6814","nonce":571761850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6818","nonce":571761850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6824","nonce":571761850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6821","nonce":571761850}]},"public_addr":"172.21.15.172:6814/571761850","cluster_addr":"172.21.15.172:6818/571761850","heartbeat_back_addr":"172.21.15.172:6824/571761850","heartbeat_front_addr":"172.21.15.172:6821/571761850","state":["exists","up"]},{"osd":6,"uuid":"51753f4b-7f06-4f1c-9ec7-6e18a66eb980","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6825","nonce":1680398853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6827","nonce":1680398853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6831","nonce":1680398853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6829","nonce":1680398853}]},"public_addr":"172.21.15.172:6825/1680398853","cluster_addr":"172.21.15.172:6827/1680398853","heartbeat_back_addr":"172.21.15.172:6831/1680398853","heartbeat_front_addr":"172.21.15.172:6829/1680398853","state":["exists","up"]},{"osd":7,"uuid":"4d8b1e15-143d-4d17-9074-59d92f0f9af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6809","nonce":349710101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6811","nonce":349710101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6819","nonce":349710101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6815","nonce":349710101}]},"public_addr":"172.21.15.172:6809/349710101","cluster_addr":"172.21.15.172:6811/349710101","heartbeat_back_addr":"172.21.15.172:6819/349710101","heartbeat_front_addr":"172.21.15.172:6815/349710101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.889460+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.475494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.911473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.648596+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.609994+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.636248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.854589+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.885826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T12:19:33.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.967+0000 7f4096d97700 1 -- 172.21.15.114:0/4223201294 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f40740656f0 msgr2=0x7f4074067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:33.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.967+0000 7f4096d97700 1 --2- 172.21.15.114:0/4223201294 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f40740656f0 0x7f4074067bb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f408c005930 tx=0x7f408c009040 comp rx=0 tx=0).stop 2023-10-18T12:19:33.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.967+0000 7f4096d97700 1 -- 172.21.15.114:0/4223201294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4090070b00 msgr2=0x7f40900b3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:33.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.967+0000 7f4096d97700 1 --2- 172.21.15.114:0/4223201294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4090070b00 0x7f40900b3e20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f408000e9a0 tx=0x7f408000ecb0 comp rx=0 tx=0).stop 2023-10-18T12:19:33.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.967+0000 7f4096d97700 1 -- 172.21.15.114:0/4223201294 shutdown_connections 2023-10-18T12:19:33.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.967+0000 7f4096d97700 1 --2- 172.21.15.114:0/4223201294 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f40740656f0 0x7f4074067bb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:33.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.967+0000 7f4096d97700 1 --2- 172.21.15.114:0/4223201294 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f40900c1e30 0x7f409014a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:33.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.967+0000 7f4096d97700 1 --2- 172.21.15.114:0/4223201294 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4090070b00 0x7f40900b3e20 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:33.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.967+0000 7f4096d97700 1 --2- 172.21.15.114:0/4223201294 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f409006e680 0x7f40900b38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:33.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.967+0000 7f4096d97700 1 -- 172.21.15.114:0/4223201294 >> 172.21.15.114:0/4223201294 conn(0x7f40900cb9f0 msgr2=0x7f40900aefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:33.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.967+0000 7f4096d97700 1 -- 172.21.15.114:0/4223201294 shutdown_connections 2023-10-18T12:19:33.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:33.967+0000 7f4096d97700 1 -- 172.21.15.114:0/4223201294 wait complete. 2023-10-18T12:19:33.992 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-18T12:19:27.040638+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-18T12:19:32.358094+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-18T12:19:33.993 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-18T12:19:34.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.163+0000 7f8264847700 1 Processor -- start 2023-10-18T12:19:34.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.163+0000 7f8264847700 1 -- start start 2023-10-18T12:19:34.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.167+0000 7f8264847700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f82600d2e00 0x7f82600b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:34.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.167+0000 7f8264847700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f826015d0d0 con 0x7f82600b5ae0 2023-10-18T12:19:34.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.167+0000 7f8264847700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f826006f0f0 con 0x7f8260160710 2023-10-18T12:19:34.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.167+0000 7f8264847700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f826015df90 con 0x7f82600d2e00 2023-10-18T12:19:34.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.167+0000 7f825f7fe700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f82600d2e00 0x7f82600b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:34.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.167+0000 7f825ffff700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f82600b5ae0 0x7f826006db60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:47112/0 (socket says 172.21.15.114:47112) 2023-10-18T12:19:34.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.167+0000 7f825ffff700 1 -- 172.21.15.114:0/2423508703 learned_addr learned my addr 172.21.15.114:0/2423508703 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:19:34.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.167+0000 7f825e7fc700 1 -- 172.21.15.114:0/2423508703 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3940925461 0 0) 0x7f82580014e0 con 0x7f82600b5ae0 2023-10-18T12:19:34.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.167+0000 7f825e7fc700 1 -- 172.21.15.114:0/2423508703 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82480035d0 con 0x7f82600b5ae0 2023-10-18T12:19:34.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.167+0000 7f825f7fe700 1 -- 172.21.15.114:0/2423508703 >> v1:172.21.15.172:6789/0 conn(0x7f8260160710 legacy=0x7f82600d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:34.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.167+0000 7f825f7fe700 1 -- 172.21.15.114:0/2423508703 >> v1:172.21.15.114:6789/0 conn(0x7f82600b5ae0 legacy=0x7f826006db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:34.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.167+0000 7f825f7fe700 1 -- 172.21.15.114:0/2423508703 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f826015d310 con 0x7f82600d2e00 2023-10-18T12:19:34.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.171+0000 7f825f7fe700 1 --2- 172.21.15.114:0/2423508703 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82600d2e00 0x7f82600b6e00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8250009850 tx=0x7f8250009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b42ca380ec979cd server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:34.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.171+0000 7f825e7fc700 1 -- 172.21.15.114:0/2423508703 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8250011830 con 0x7f82600d2e00 2023-10-18T12:19:34.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.171+0000 7f825e7fc700 1 -- 172.21.15.114:0/2423508703 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8250011990 con 0x7f82600d2e00 2023-10-18T12:19:34.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.171+0000 7f825e7fc700 1 -- 172.21.15.114:0/2423508703 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8250011d40 con 0x7f82600d2e00 2023-10-18T12:19:34.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.171+0000 7f8264847700 1 -- 172.21.15.114:0/2423508703 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82600d2e00 msgr2=0x7f82600b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:34.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.171+0000 7f8264847700 1 --2- 172.21.15.114:0/2423508703 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82600d2e00 0x7f82600b6e00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8250009850 tx=0x7f8250009b60 comp rx=0 tx=0).stop 2023-10-18T12:19:34.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.171+0000 7f8264847700 1 -- 172.21.15.114:0/2423508703 shutdown_connections 2023-10-18T12:19:34.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.171+0000 7f8264847700 1 --2- 172.21.15.114:0/2423508703 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82600d2e00 0x7f82600b6e00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:34.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.171+0000 7f8264847700 1 -- 172.21.15.114:0/2423508703 >> 172.21.15.114:0/2423508703 conn(0x7f8260069f20 msgr2=0x7f826006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:34.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.171+0000 7f8264847700 1 -- 172.21.15.114:0/2423508703 shutdown_connections 2023-10-18T12:19:34.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.171+0000 7f8264847700 1 -- 172.21.15.114:0/2423508703 wait complete. 2023-10-18T12:19:34.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.171+0000 7f8264847700 1 Processor -- start 2023-10-18T12:19:34.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.175+0000 7f8264847700 1 -- start start 2023-10-18T12:19:34.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.175+0000 7f8264847700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82600b5ae0 0x7f826015a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:34.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.175+0000 7f8264847700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82600d2e00 0x7f82601f5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:34.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.175+0000 7f8264847700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8260160710 0x7f826015b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:34.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.175+0000 7f8264847700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8260154060 con 0x7f82600d2e00 2023-10-18T12:19:34.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.175+0000 7f8264847700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8260154340 con 0x7f82600b5ae0 2023-10-18T12:19:34.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.175+0000 7f8264847700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8260154620 con 0x7f8260160710 2023-10-18T12:19:34.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.175+0000 7f825effd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82600d2e00 0x7f82601f5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:34.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.175+0000 7f825effd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82600d2e00 0x7f82601f5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44206/0 (socket says 172.21.15.114:44206) 2023-10-18T12:19:34.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.175+0000 7f825effd700 1 -- 172.21.15.114:0/227560525 learned_addr learned my addr 172.21.15.114:0/227560525 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:34.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.175+0000 7f825ffff700 1 --2- 172.21.15.114:0/227560525 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8260160710 0x7f826015b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:34.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.175+0000 7f825f7fe700 1 --2- 172.21.15.114:0/227560525 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82600b5ae0 0x7f826015a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:34.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.175+0000 7f825effd700 1 -- 172.21.15.114:0/227560525 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8260160710 msgr2=0x7f826015b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:34.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.175+0000 7f825effd700 1 --2- 172.21.15.114:0/227560525 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8260160710 0x7f826015b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:34.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.175+0000 7f825effd700 1 -- 172.21.15.114:0/227560525 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82600b5ae0 msgr2=0x7f826015a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:34.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.175+0000 7f825effd700 1 --2- 172.21.15.114:0/227560525 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82600b5ae0 0x7f826015a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:34.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.175+0000 7f825effd700 1 -- 172.21.15.114:0/227560525 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82500094b0 con 0x7f82600d2e00 2023-10-18T12:19:34.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.175+0000 7f825effd700 1 --2- 172.21.15.114:0/227560525 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82600d2e00 0x7f82601f5880 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f825400c4d0 tx=0x7f825400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:34.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.175+0000 7f8247fff700 1 -- 172.21.15.114:0/227560525 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82540052d0 con 0x7f82600d2e00 2023-10-18T12:19:34.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.175+0000 7f8247fff700 1 -- 172.21.15.114:0/227560525 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8254005430 con 0x7f82600d2e00 2023-10-18T12:19:34.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.175+0000 7f8264847700 1 -- 172.21.15.114:0/227560525 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8260154900 con 0x7f82600d2e00 2023-10-18T12:19:34.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.175+0000 7f8247fff700 1 -- 172.21.15.114:0/227560525 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82540055a0 con 0x7f82600d2e00 2023-10-18T12:19:34.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.175+0000 7f8264847700 1 -- 172.21.15.114:0/227560525 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f826015afb0 con 0x7f82600d2e00 2023-10-18T12:19:34.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.179+0000 7f8264847700 1 -- 172.21.15.114:0/227560525 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8260154b40 con 0x7f82600d2e00 2023-10-18T12:19:34.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.179+0000 7f8247fff700 1 -- 172.21.15.114:0/227560525 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f82540038c0 con 0x7f82600d2e00 2023-10-18T12:19:34.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.183+0000 7f8247fff700 1 --2- 172.21.15.114:0/227560525 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f824c0656f0 0x7f824c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:34.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.183+0000 7f8247fff700 1 -- 172.21.15.114:0/227560525 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8254081f60 con 0x7f82600d2e00 2023-10-18T12:19:34.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.183+0000 7f825f7fe700 1 --2- 172.21.15.114:0/227560525 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f824c0656f0 0x7f824c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:34.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.183+0000 7f825f7fe700 1 --2- 172.21.15.114:0/227560525 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f824c0656f0 0x7f824c067bb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f82500090b0 tx=0x7f825001c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:34.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.187+0000 7f8247fff700 1 -- 172.21.15.114:0/227560525 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f825404fd60 con 0x7f82600d2e00 2023-10-18T12:19:34.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.363+0000 7f8264847700 1 -- 172.21.15.114:0/227560525 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f826004e910 con 0x7f82600d2e00 2023-10-18T12:19:34.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.363+0000 7f8247fff700 1 -- 172.21.15.114:0/227560525 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8254053380 con 0x7f82600d2e00 2023-10-18T12:19:34.370 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-10-18T12:19:34.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.367+0000 7f8264847700 1 -- 172.21.15.114:0/227560525 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f824c0656f0 msgr2=0x7f824c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:34.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.367+0000 7f8264847700 1 --2- 172.21.15.114:0/227560525 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f824c0656f0 0x7f824c067bb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f82500090b0 tx=0x7f825001c040 comp rx=0 tx=0).stop 2023-10-18T12:19:34.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.367+0000 7f8264847700 1 -- 172.21.15.114:0/227560525 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82600d2e00 msgr2=0x7f82601f5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:34.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.367+0000 7f8264847700 1 --2- 172.21.15.114:0/227560525 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82600d2e00 0x7f82601f5880 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f825400c4d0 tx=0x7f825400c890 comp rx=0 tx=0).stop 2023-10-18T12:19:34.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.367+0000 7f8264847700 1 -- 172.21.15.114:0/227560525 shutdown_connections 2023-10-18T12:19:34.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.367+0000 7f8264847700 1 --2- 172.21.15.114:0/227560525 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f824c0656f0 0x7f824c067bb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:34.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.367+0000 7f8264847700 1 --2- 172.21.15.114:0/227560525 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8260160710 0x7f826015b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:34.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.367+0000 7f8264847700 1 --2- 172.21.15.114:0/227560525 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82600d2e00 0x7f82601f5880 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:34.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.367+0000 7f8264847700 1 --2- 172.21.15.114:0/227560525 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82600b5ae0 0x7f826015a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:34.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.367+0000 7f8264847700 1 -- 172.21.15.114:0/227560525 >> 172.21.15.114:0/227560525 conn(0x7f8260069f20 msgr2=0x7f82600b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:34.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.367+0000 7f8264847700 1 -- 172.21.15.114:0/227560525 shutdown_connections 2023-10-18T12:19:34.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.367+0000 7f8264847700 1 -- 172.21.15.114:0/227560525 wait complete. 2023-10-18T12:19:34.394 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-18T12:19:34.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.571+0000 7fc8dd55f700 1 Processor -- start 2023-10-18T12:19:34.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.571+0000 7fc8dd55f700 1 -- start start 2023-10-18T12:19:34.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.575+0000 7fc8dd55f700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc8d80d2e00 0x7fc8d80b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:34.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.575+0000 7fc8dd55f700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc8d8160710 0x7fc8d80d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:34.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.575+0000 7fc8dd55f700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8d815d0d0 con 0x7fc8d80b5ae0 2023-10-18T12:19:34.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.575+0000 7fc8dd55f700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8d815df90 con 0x7fc8d80d2e00 2023-10-18T12:19:34.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.575+0000 7fc8dd55f700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8d806f0f0 con 0x7fc8d8160710 2023-10-18T12:19:34.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.575+0000 7fc8dcd5e700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc8d80b5ae0 0x7fc8d806db60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:47120/0 (socket says 172.21.15.114:47120) 2023-10-18T12:19:34.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.575+0000 7fc8d7fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc8d80d2e00 0x7fc8d80b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:34.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.575+0000 7fc8dcd5e700 1 -- 172.21.15.114:0/682817933 learned_addr learned my addr 172.21.15.114:0/682817933 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:19:34.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.575+0000 7fc8cf7fe700 1 --2- 172.21.15.114:0/682817933 >> v2:172.21.15.172:3300/0 conn(0x7fc8d8160710 0x7fc8d80d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:34.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.575+0000 7fc8d7fff700 1 -- 172.21.15.114:0/682817933 >> v2:172.21.15.172:3300/0 conn(0x7fc8d8160710 msgr2=0x7fc8d80d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:34.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.575+0000 7fc8d7fff700 1 --2- 172.21.15.114:0/682817933 >> v2:172.21.15.172:3300/0 conn(0x7fc8d8160710 0x7fc8d80d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:34.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.575+0000 7fc8d7fff700 1 -- 172.21.15.114:0/682817933 >> v1:172.21.15.114:6789/0 conn(0x7fc8d80b5ae0 legacy=0x7fc8d806db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:34.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.575+0000 7fc8d7fff700 1 -- 172.21.15.114:0/682817933 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d80d3720 con 0x7fc8d80d2e00 2023-10-18T12:19:34.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.575+0000 7fc8cf7fe700 1 --2- 172.21.15.114:0/682817933 >> v2:172.21.15.172:3300/0 conn(0x7fc8d8160710 0x7fc8d80d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:19:34.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.575+0000 7fc8d7fff700 1 --2- 172.21.15.114:0/682817933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8d80d2e00 0x7fc8d80b6e00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc8d80d2420 tx=0x7fc8c8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9103c20cd7a1627 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:34.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.575+0000 7fc8d77fe700 1 -- 172.21.15.114:0/682817933 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8011830 con 0x7fc8d80d2e00 2023-10-18T12:19:34.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.575+0000 7fc8d77fe700 1 -- 172.21.15.114:0/682817933 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c8011990 con 0x7fc8d80d2e00 2023-10-18T12:19:34.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.575+0000 7fc8d77fe700 1 -- 172.21.15.114:0/682817933 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8011d40 con 0x7fc8d80d2e00 2023-10-18T12:19:34.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.579+0000 7fc8dd55f700 1 -- 172.21.15.114:0/682817933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8d80d2e00 msgr2=0x7fc8d80b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:34.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.579+0000 7fc8dd55f700 1 --2- 172.21.15.114:0/682817933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8d80d2e00 0x7fc8d80b6e00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc8d80d2420 tx=0x7fc8c8009b30 comp rx=0 tx=0).stop 2023-10-18T12:19:34.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.579+0000 7fc8dd55f700 1 -- 172.21.15.114:0/682817933 shutdown_connections 2023-10-18T12:19:34.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.579+0000 7fc8dd55f700 1 --2- 172.21.15.114:0/682817933 >> v2:172.21.15.172:3300/0 conn(0x7fc8d8160710 0x7fc8d80d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:34.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.579+0000 7fc8dd55f700 1 --2- 172.21.15.114:0/682817933 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8d80d2e00 0x7fc8d80b6e00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:34.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.579+0000 7fc8dd55f700 1 -- 172.21.15.114:0/682817933 >> 172.21.15.114:0/682817933 conn(0x7fc8d8069f20 msgr2=0x7fc8d806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:34.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.579+0000 7fc8dd55f700 1 -- 172.21.15.114:0/682817933 shutdown_connections 2023-10-18T12:19:34.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.579+0000 7fc8dd55f700 1 -- 172.21.15.114:0/682817933 wait complete. 2023-10-18T12:19:34.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.579+0000 7fc8dd55f700 1 Processor -- start 2023-10-18T12:19:34.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.579+0000 7fc8dd55f700 1 -- start start 2023-10-18T12:19:34.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.583+0000 7fc8dd55f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8d80b5ae0 0x7fc8d81490b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:34.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.583+0000 7fc8dd55f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc8d80d2e00 0x7fc8d80af3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:34.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.583+0000 7fc8dd55f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8d8160710 0x7fc8d80af8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:34.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.583+0000 7fc8dd55f700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d81f2030 con 0x7fc8d8160710 2023-10-18T12:19:34.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.583+0000 7fc8dd55f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d81f2fe0 con 0x7fc8d80b5ae0 2023-10-18T12:19:34.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.583+0000 7fc8dd55f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d80aff80 con 0x7fc8d80d2e00 2023-10-18T12:19:34.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.583+0000 7fc8dcd5e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8d8160710 0x7fc8d80af8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:34.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.583+0000 7fc8d7fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8d80b5ae0 0x7fc8d81490b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:34.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.583+0000 7fc8dcd5e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8d8160710 0x7fc8d80af8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44226/0 (socket says 172.21.15.114:44226) 2023-10-18T12:19:34.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.583+0000 7fc8dcd5e700 1 -- 172.21.15.114:0/2047310131 learned_addr learned my addr 172.21.15.114:0/2047310131 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:34.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.583+0000 7fc8cf7fe700 1 --2- 172.21.15.114:0/2047310131 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc8d80d2e00 0x7fc8d80af3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:34.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.583+0000 7fc8dcd5e700 1 -- 172.21.15.114:0/2047310131 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc8d80d2e00 msgr2=0x7fc8d80af3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:34.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.583+0000 7fc8dcd5e700 1 --2- 172.21.15.114:0/2047310131 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc8d80d2e00 0x7fc8d80af3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:34.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.583+0000 7fc8dcd5e700 1 -- 172.21.15.114:0/2047310131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8d80b5ae0 msgr2=0x7fc8d81490b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:34.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.583+0000 7fc8dcd5e700 1 --2- 172.21.15.114:0/2047310131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8d80b5ae0 0x7fc8d81490b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:34.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.583+0000 7fc8dcd5e700 1 -- 172.21.15.114:0/2047310131 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c80094b0 con 0x7fc8d8160710 2023-10-18T12:19:34.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.583+0000 7fc8dcd5e700 1 --2- 172.21.15.114:0/2047310131 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8d8160710 0x7fc8d80af8f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc8d000ca20 tx=0x7fc8d000cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:34.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.583+0000 7fc8d57fa700 1 -- 172.21.15.114:0/2047310131 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d000a9e0 con 0x7fc8d8160710 2023-10-18T12:19:34.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.583+0000 7fc8d57fa700 1 -- 172.21.15.114:0/2047310131 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d000ab40 con 0x7fc8d8160710 2023-10-18T12:19:34.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.583+0000 7fc8dd55f700 1 -- 172.21.15.114:0/2047310131 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8d81f2220 con 0x7fc8d8160710 2023-10-18T12:19:34.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.583+0000 7fc8d57fa700 1 -- 172.21.15.114:0/2047310131 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d0012400 con 0x7fc8d8160710 2023-10-18T12:19:34.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.583+0000 7fc8dd55f700 1 -- 172.21.15.114:0/2047310131 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8d81f27e0 con 0x7fc8d8160710 2023-10-18T12:19:34.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.587+0000 7fc8dd55f700 1 -- 172.21.15.114:0/2047310131 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8d804e910 con 0x7fc8d8160710 2023-10-18T12:19:34.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.587+0000 7fc8d57fa700 1 -- 172.21.15.114:0/2047310131 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fc8d0005d50 con 0x7fc8d8160710 2023-10-18T12:19:34.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.591+0000 7fc8d57fa700 1 --2- 172.21.15.114:0/2047310131 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc8b80656f0 0x7fc8b8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:34.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.591+0000 7fc8d57fa700 1 -- 172.21.15.114:0/2047310131 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc8d00820e0 con 0x7fc8d8160710 2023-10-18T12:19:34.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.591+0000 7fc8d7fff700 1 --2- 172.21.15.114:0/2047310131 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc8b80656f0 0x7fc8b8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:34.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.591+0000 7fc8d7fff700 1 --2- 172.21.15.114:0/2047310131 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc8b80656f0 0x7fc8b8067bb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc8c80090b0 tx=0x7fc8c801c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:34.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.595+0000 7fc8d57fa700 1 -- 172.21.15.114:0/2047310131 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fc8d004fee0 con 0x7fc8d8160710 2023-10-18T12:19:34.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.775+0000 7fc8dd55f700 1 -- 172.21.15.114:0/2047310131 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc8d815d0d0 con 0x7fc8d8160710 2023-10-18T12:19:34.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.779+0000 7fc8d57fa700 1 -- 172.21.15.114:0/2047310131 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc8d815d0d0 con 0x7fc8d8160710 2023-10-18T12:19:34.784 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 8 2023-10-18T12:19:34.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.783+0000 7fc8dd55f700 1 -- 172.21.15.114:0/2047310131 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc8b80656f0 msgr2=0x7fc8b8067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:34.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.783+0000 7fc8dd55f700 1 --2- 172.21.15.114:0/2047310131 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc8b80656f0 0x7fc8b8067bb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc8c80090b0 tx=0x7fc8c801c040 comp rx=0 tx=0).stop 2023-10-18T12:19:34.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.783+0000 7fc8dd55f700 1 -- 172.21.15.114:0/2047310131 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8d8160710 msgr2=0x7fc8d80af8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:34.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.783+0000 7fc8dd55f700 1 --2- 172.21.15.114:0/2047310131 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8d8160710 0x7fc8d80af8f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc8d000ca20 tx=0x7fc8d000cd30 comp rx=0 tx=0).stop 2023-10-18T12:19:34.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.783+0000 7fc8dd55f700 1 -- 172.21.15.114:0/2047310131 shutdown_connections 2023-10-18T12:19:34.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.783+0000 7fc8dd55f700 1 --2- 172.21.15.114:0/2047310131 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc8b80656f0 0x7fc8b8067bb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:34.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.783+0000 7fc8dd55f700 1 --2- 172.21.15.114:0/2047310131 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc8d80d2e00 0x7fc8d80af3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:34.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.783+0000 7fc8dd55f700 1 --2- 172.21.15.114:0/2047310131 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8d8160710 0x7fc8d80af8f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:34.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.783+0000 7fc8dd55f700 1 --2- 172.21.15.114:0/2047310131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8d80b5ae0 0x7fc8d81490b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:34.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.783+0000 7fc8dd55f700 1 -- 172.21.15.114:0/2047310131 >> 172.21.15.114:0/2047310131 conn(0x7fc8d8069f20 msgr2=0x7fc8d806a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:34.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.783+0000 7fc8dd55f700 1 -- 172.21.15.114:0/2047310131 shutdown_connections 2023-10-18T12:19:34.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.783+0000 7fc8dd55f700 1 -- 172.21.15.114:0/2047310131 wait complete. 2023-10-18T12:19:34.810 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T12:19:34.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.975+0000 7f1ab2aa2700 1 Processor -- start 2023-10-18T12:19:34.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.979+0000 7f1ab2aa2700 1 -- start start 2023-10-18T12:19:34.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.979+0000 7f1ab2aa2700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1aac146800 0x7f1aac0b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:34.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.979+0000 7f1ab2aa2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1aac0700b0 0x7f1aac15eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:34.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.979+0000 7f1ab2aa2700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aac15e680 con 0x7f1aac15dd30 2023-10-18T12:19:34.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.979+0000 7f1ab2aa2700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aac0b6180 con 0x7f1aac146800 2023-10-18T12:19:34.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.979+0000 7f1ab2aa2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac0b6460 con 0x7f1aac0700b0 2023-10-18T12:19:34.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.979+0000 7f1ab083e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1aac146800 0x7f1aac0b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:34.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.979+0000 7f1ab083e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1aac146800 0x7f1aac0b5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44234/0 (socket says 172.21.15.114:44234) 2023-10-18T12:19:34.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.979+0000 7f1ab083e700 1 -- 172.21.15.114:0/2580681299 learned_addr learned my addr 172.21.15.114:0/2580681299 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:34.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.979+0000 7f1ab103f700 1 --2- 172.21.15.114:0/2580681299 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1aac0700b0 0x7f1aac15eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:34.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.979+0000 7f1ab083e700 1 -- 172.21.15.114:0/2580681299 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1aac0700b0 msgr2=0x7f1aac15eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:34.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.979+0000 7f1ab083e700 1 --2- 172.21.15.114:0/2580681299 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1aac0700b0 0x7f1aac15eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:34.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.979+0000 7f1ab083e700 1 -- 172.21.15.114:0/2580681299 >> v1:172.21.15.172:6789/0 conn(0x7f1aac15dd30 legacy=0x7f1aac06f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:34.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.979+0000 7f1ab083e700 1 -- 172.21.15.114:0/2580681299 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aac0b6740 con 0x7f1aac146800 2023-10-18T12:19:34.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.979+0000 7f1ab103f700 1 --2- 172.21.15.114:0/2580681299 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1aac0700b0 0x7f1aac15eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:19:34.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.983+0000 7f1ab083e700 1 --2- 172.21.15.114:0/2580681299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1aac146800 0x7f1aac0b5b80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0009910 tx=0x7f1aa0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d7c8e4bc2d265de server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:34.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.983+0000 7f1aab7fe700 1 -- 172.21.15.114:0/2580681299 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa0004230 con 0x7f1aac146800 2023-10-18T12:19:34.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.983+0000 7f1aab7fe700 1 -- 172.21.15.114:0/2580681299 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa0004390 con 0x7f1aac146800 2023-10-18T12:19:34.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.983+0000 7f1aab7fe700 1 -- 172.21.15.114:0/2580681299 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa0009e60 con 0x7f1aac146800 2023-10-18T12:19:34.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.983+0000 7f1ab2aa2700 1 -- 172.21.15.114:0/2580681299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1aac146800 msgr2=0x7f1aac0b5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:34.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.983+0000 7f1ab2aa2700 1 --2- 172.21.15.114:0/2580681299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1aac146800 0x7f1aac0b5b80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0009910 tx=0x7f1aa0009c20 comp rx=0 tx=0).stop 2023-10-18T12:19:34.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.983+0000 7f1ab2aa2700 1 -- 172.21.15.114:0/2580681299 shutdown_connections 2023-10-18T12:19:34.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.983+0000 7f1ab2aa2700 1 --2- 172.21.15.114:0/2580681299 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1aac0700b0 0x7f1aac15eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:34.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.983+0000 7f1ab2aa2700 1 --2- 172.21.15.114:0/2580681299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1aac146800 0x7f1aac0b5b80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:34.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.983+0000 7f1ab2aa2700 1 -- 172.21.15.114:0/2580681299 >> 172.21.15.114:0/2580681299 conn(0x7f1aac06a130 msgr2=0x7f1aac06a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:34.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.983+0000 7f1ab2aa2700 1 -- 172.21.15.114:0/2580681299 shutdown_connections 2023-10-18T12:19:34.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.983+0000 7f1ab2aa2700 1 -- 172.21.15.114:0/2580681299 wait complete. 2023-10-18T12:19:34.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.983+0000 7f1ab2aa2700 1 Processor -- start 2023-10-18T12:19:34.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.983+0000 7f1ab2aa2700 1 -- start start 2023-10-18T12:19:34.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.987+0000 7f1ab2aa2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1aac0700b0 0x7f1aac0cff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:34.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.987+0000 7f1ab2aa2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1aac146800 0x7f1aac0d0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:34.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.987+0000 7f1ab2aa2700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1aac15dd30 0x7f1aac0cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:34.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.987+0000 7f1ab2aa2700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac0d0d70 con 0x7f1aac15dd30 2023-10-18T12:19:34.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.987+0000 7f1ab2aa2700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac0d0a90 con 0x7f1aac0700b0 2023-10-18T12:19:34.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.987+0000 7f1ab2aa2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac0cb770 con 0x7f1aac146800 2023-10-18T12:19:34.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.987+0000 7f1ab103f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1aac15dd30 0x7f1aac0cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:34.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.987+0000 7f1ab103f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1aac15dd30 0x7f1aac0cdf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33678/0 (socket says 172.21.15.114:33678) 2023-10-18T12:19:34.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.987+0000 7f1ab103f700 1 -- 172.21.15.114:0/523865309 learned_addr learned my addr 172.21.15.114:0/523865309 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:34.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.987+0000 7f1ab083e700 1 --2- 172.21.15.114:0/523865309 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1aac0700b0 0x7f1aac0cff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:34.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.987+0000 7f1aabfff700 1 --2- 172.21.15.114:0/523865309 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1aac146800 0x7f1aac0d0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:34.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.987+0000 7f1ab103f700 1 -- 172.21.15.114:0/523865309 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1aac146800 msgr2=0x7f1aac0d0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:34.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.987+0000 7f1ab103f700 1 --2- 172.21.15.114:0/523865309 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1aac146800 0x7f1aac0d0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:34.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.987+0000 7f1ab103f700 1 -- 172.21.15.114:0/523865309 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1aac0700b0 msgr2=0x7f1aac0cff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:34.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.987+0000 7f1ab103f700 1 --2- 172.21.15.114:0/523865309 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1aac0700b0 0x7f1aac0cff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:34.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.987+0000 7f1ab103f700 1 -- 172.21.15.114:0/523865309 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa0009570 con 0x7f1aac15dd30 2023-10-18T12:19:34.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.987+0000 7f1ab103f700 1 --2- 172.21.15.114:0/523865309 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1aac15dd30 0x7f1aac0cdf10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1aa400ce70 tx=0x7f1aa400cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:34.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.987+0000 7f1aa97fa700 1 -- 172.21.15.114:0/523865309 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa400ae10 con 0x7f1aac15dd30 2023-10-18T12:19:34.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.987+0000 7f1aa97fa700 1 -- 172.21.15.114:0/523865309 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa4003a40 con 0x7f1aac15dd30 2023-10-18T12:19:34.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.987+0000 7f1ab2aa2700 1 -- 172.21.15.114:0/523865309 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aac0cba50 con 0x7f1aac15dd30 2023-10-18T12:19:34.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.987+0000 7f1aa97fa700 1 -- 172.21.15.114:0/523865309 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa4003df0 con 0x7f1aac15dd30 2023-10-18T12:19:34.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.987+0000 7f1ab2aa2700 1 -- 172.21.15.114:0/523865309 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aac15c6f0 con 0x7f1aac15dd30 2023-10-18T12:19:34.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.991+0000 7f1ab2aa2700 1 -- 172.21.15.114:0/523865309 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aac0d1a60 con 0x7f1aac15dd30 2023-10-18T12:19:34.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.991+0000 7f1aa97fa700 1 -- 172.21.15.114:0/523865309 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f1aa4003f50 con 0x7f1aac15dd30 2023-10-18T12:19:34.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.995+0000 7f1aa97fa700 1 --2- 172.21.15.114:0/523865309 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1a900656f0 0x7f1a90067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:35.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.995+0000 7f1aa97fa700 1 -- 172.21.15.114:0/523865309 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1aa4082fc0 con 0x7f1aac15dd30 2023-10-18T12:19:35.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.995+0000 7f1ab083e700 1 --2- 172.21.15.114:0/523865309 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1a900656f0 0x7f1a90067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:35.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.995+0000 7f1ab083e700 1 --2- 172.21.15.114:0/523865309 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1a900656f0 0x7f1a90067bb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0009910 tx=0x7f1aa0008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:35.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:34.999+0000 7f1aa97fa700 1 -- 172.21.15.114:0/523865309 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f1aa4050ca0 con 0x7f1aac15dd30 2023-10-18T12:19:35.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.223+0000 7f1ab2aa2700 1 -- 172.21.15.114:0/523865309 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1aac0cb5d0 con 0x7f1aac15dd30 2023-10-18T12:19:35.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.227+0000 7f1aa97fa700 1 -- 172.21.15.114:0/523865309 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3700 (secure 0 0 0) 0x7f1aac0cb5d0 con 0x7f1aac15dd30 2023-10-18T12:19:35.232 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:19:35.232 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1054658298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1054658298},{"type":"v1","addr":"172.21.15.172:6835","nonce":1054658298}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2715800167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2715800167},{"type":"v1","addr":"172.21.15.114:6833","nonce":2715800167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/22518579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":22518579},{"type":"v1","addr":"172.21.15.114:6835","nonce":22518579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4303,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/3028221887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3028221887},{"type":"v1","addr":"172.21.15.172:6837","nonce":3028221887}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-10-18T12:19:35.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.227+0000 7f1ab2aa2700 1 -- 172.21.15.114:0/523865309 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1a900656f0 msgr2=0x7f1a90067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:35.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.227+0000 7f1ab2aa2700 1 --2- 172.21.15.114:0/523865309 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1a900656f0 0x7f1a90067bb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0009910 tx=0x7f1aa0008030 comp rx=0 tx=0).stop 2023-10-18T12:19:35.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.227+0000 7f1ab2aa2700 1 -- 172.21.15.114:0/523865309 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1aac15dd30 msgr2=0x7f1aac0cdf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:35.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.227+0000 7f1ab2aa2700 1 --2- 172.21.15.114:0/523865309 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1aac15dd30 0x7f1aac0cdf10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1aa400ce70 tx=0x7f1aa400cf50 comp rx=0 tx=0).stop 2023-10-18T12:19:35.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.227+0000 7f1ab2aa2700 1 -- 172.21.15.114:0/523865309 shutdown_connections 2023-10-18T12:19:35.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.227+0000 7f1ab2aa2700 1 --2- 172.21.15.114:0/523865309 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1a900656f0 0x7f1a90067bb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:35.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.227+0000 7f1ab2aa2700 1 --2- 172.21.15.114:0/523865309 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1aac146800 0x7f1aac0d0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:35.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.227+0000 7f1ab2aa2700 1 --2- 172.21.15.114:0/523865309 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1aac15dd30 0x7f1aac0cdf10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:35.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.227+0000 7f1ab2aa2700 1 --2- 172.21.15.114:0/523865309 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1aac0700b0 0x7f1aac0cff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:35.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.227+0000 7f1ab2aa2700 1 -- 172.21.15.114:0/523865309 >> 172.21.15.114:0/523865309 conn(0x7f1aac06a130 msgr2=0x7f1aac15d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:35.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.227+0000 7f1ab2aa2700 1 -- 172.21.15.114:0/523865309 shutdown_connections 2023-10-18T12:19:35.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.227+0000 7f1ab2aa2700 1 -- 172.21.15.114:0/523865309 wait complete. 2023-10-18T12:19:35.237 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 3 2023-10-18T12:19:35.254 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T12:19:35.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.427+0000 7f9694b77700 1 Processor -- start 2023-10-18T12:19:35.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.427+0000 7f9694b77700 1 -- start start 2023-10-18T12:19:35.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.431+0000 7f9694b77700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9690160710 0x7f96900b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:35.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.431+0000 7f9694b77700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f96900b5ae0 0x7f969006db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:35.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.431+0000 7f9694b77700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f969015d0d0 con 0x7f96900d2e00 2023-10-18T12:19:35.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.431+0000 7f9694b77700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f969015df90 con 0x7f9690160710 2023-10-18T12:19:35.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.431+0000 7f9694b77700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f969006f0f0 con 0x7f96900b5ae0 2023-10-18T12:19:35.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.431+0000 7f968effd700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9690160710 0x7f96900b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:35.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.431+0000 7f968effd700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9690160710 0x7f96900b6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:39546/0 (socket says 172.21.15.114:39546) 2023-10-18T12:19:35.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.431+0000 7f968effd700 1 -- 172.21.15.114:0/3924437148 learned_addr learned my addr 172.21.15.114:0/3924437148 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:35.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.431+0000 7f968ffff700 1 --2- 172.21.15.114:0/3924437148 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f96900b5ae0 0x7f969006db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:35.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.431+0000 7f968effd700 1 -- 172.21.15.114:0/3924437148 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f96900b5ae0 msgr2=0x7f969006db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:35.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.431+0000 7f968effd700 1 --2- 172.21.15.114:0/3924437148 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f96900b5ae0 0x7f969006db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:35.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.431+0000 7f968effd700 1 -- 172.21.15.114:0/3924437148 >> v1:172.21.15.172:6789/0 conn(0x7f96900d2e00 legacy=0x7f96900d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:35.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.431+0000 7f968e7fc700 1 -- 172.21.15.114:0/3924437148 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3665935598 0 0) 0x7f9680001110 con 0x7f96900d2e00 2023-10-18T12:19:35.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.431+0000 7f968effd700 1 -- 172.21.15.114:0/3924437148 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f969015d310 con 0x7f9690160710 2023-10-18T12:19:35.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.431+0000 7f968effd700 1 --2- 172.21.15.114:0/3924437148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9690160710 0x7f96900b6e00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9684009910 tx=0x7f9684009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1492a0acfacdd49 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:35.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.435+0000 7f968e7fc700 1 -- 172.21.15.114:0/3924437148 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9684011830 con 0x7f9690160710 2023-10-18T12:19:35.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.435+0000 7f968e7fc700 1 -- 172.21.15.114:0/3924437148 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9684011990 con 0x7f9690160710 2023-10-18T12:19:35.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.435+0000 7f968e7fc700 1 -- 172.21.15.114:0/3924437148 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9684011d40 con 0x7f9690160710 2023-10-18T12:19:35.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.435+0000 7f9694b77700 1 -- 172.21.15.114:0/3924437148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9690160710 msgr2=0x7f96900b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:35.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.435+0000 7f9694b77700 1 --2- 172.21.15.114:0/3924437148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9690160710 0x7f96900b6e00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9684009910 tx=0x7f9684009c20 comp rx=0 tx=0).stop 2023-10-18T12:19:35.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.435+0000 7f9694b77700 1 -- 172.21.15.114:0/3924437148 shutdown_connections 2023-10-18T12:19:35.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.435+0000 7f9694b77700 1 --2- 172.21.15.114:0/3924437148 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f96900b5ae0 0x7f969006db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:35.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.435+0000 7f9694b77700 1 --2- 172.21.15.114:0/3924437148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9690160710 0x7f96900b6e00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:35.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.435+0000 7f9694b77700 1 -- 172.21.15.114:0/3924437148 >> 172.21.15.114:0/3924437148 conn(0x7f9690069f20 msgr2=0x7f969006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:35.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.435+0000 7f9694b77700 1 -- 172.21.15.114:0/3924437148 shutdown_connections 2023-10-18T12:19:35.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.435+0000 7f9694b77700 1 -- 172.21.15.114:0/3924437148 wait complete. 2023-10-18T12:19:35.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.439+0000 7f9694b77700 1 Processor -- start 2023-10-18T12:19:35.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.439+0000 7f9694b77700 1 -- start start 2023-10-18T12:19:35.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.439+0000 7f9694b77700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96900b5ae0 0x7f96901495e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:35.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.439+0000 7f9694b77700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96900d2e00 0x7f969015f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:35.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.439+0000 7f9694b77700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9690160710 0x7f969015fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:35.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.439+0000 7f9694b77700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f969014b750 con 0x7f96900b5ae0 2023-10-18T12:19:35.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.439+0000 7f9694b77700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9690149b20 con 0x7f96900d2e00 2023-10-18T12:19:35.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.439+0000 7f9694b77700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f969014aad0 con 0x7f9690160710 2023-10-18T12:19:35.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.439+0000 7f968f7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96900b5ae0 0x7f96901495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:35.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.439+0000 7f968f7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96900b5ae0 0x7f96901495e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33682/0 (socket says 172.21.15.114:33682) 2023-10-18T12:19:35.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.439+0000 7f968f7fe700 1 -- 172.21.15.114:0/1248618791 learned_addr learned my addr 172.21.15.114:0/1248618791 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:35.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.443+0000 7f968ffff700 1 --2- 172.21.15.114:0/1248618791 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9690160710 0x7f969015fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:35.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.443+0000 7f968effd700 1 --2- 172.21.15.114:0/1248618791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96900d2e00 0x7f969015f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:35.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.443+0000 7f968f7fe700 1 -- 172.21.15.114:0/1248618791 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9690160710 msgr2=0x7f969015fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:35.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.443+0000 7f968f7fe700 1 --2- 172.21.15.114:0/1248618791 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9690160710 0x7f969015fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:35.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.443+0000 7f968f7fe700 1 -- 172.21.15.114:0/1248618791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96900d2e00 msgr2=0x7f969015f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:35.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.443+0000 7f968f7fe700 1 --2- 172.21.15.114:0/1248618791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96900d2e00 0x7f969015f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:35.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.443+0000 7f968f7fe700 1 -- 172.21.15.114:0/1248618791 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9684009570 con 0x7f96900b5ae0 2023-10-18T12:19:35.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.443+0000 7f968f7fe700 1 --2- 172.21.15.114:0/1248618791 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96900b5ae0 0x7f96901495e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f968000c520 tx=0x7f968000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:35.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.443+0000 7f9677fff700 1 -- 172.21.15.114:0/1248618791 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96800054e0 con 0x7f96900b5ae0 2023-10-18T12:19:35.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.443+0000 7f9694b77700 1 -- 172.21.15.114:0/1248618791 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f969014adb0 con 0x7f96900b5ae0 2023-10-18T12:19:35.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.443+0000 7f9694b77700 1 -- 172.21.15.114:0/1248618791 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f969014b370 con 0x7f96900b5ae0 2023-10-18T12:19:35.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.443+0000 7f9677fff700 1 -- 172.21.15.114:0/1248618791 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96800036a0 con 0x7f96900b5ae0 2023-10-18T12:19:35.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.443+0000 7f9677fff700 1 -- 172.21.15.114:0/1248618791 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9680003a10 con 0x7f96900b5ae0 2023-10-18T12:19:35.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.443+0000 7f9694b77700 1 -- 172.21.15.114:0/1248618791 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9670005310 con 0x7f96900b5ae0 2023-10-18T12:19:35.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.447+0000 7f9677fff700 1 -- 172.21.15.114:0/1248618791 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f9680003b70 con 0x7f96900b5ae0 2023-10-18T12:19:35.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.447+0000 7f9677fff700 1 --2- 172.21.15.114:0/1248618791 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f967c065720 0x7f967c067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:35.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.447+0000 7f9677fff700 1 -- 172.21.15.114:0/1248618791 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9680081b60 con 0x7f96900b5ae0 2023-10-18T12:19:35.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.447+0000 7f968effd700 1 --2- 172.21.15.114:0/1248618791 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f967c065720 0x7f967c067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:35.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.447+0000 7f968effd700 1 --2- 172.21.15.114:0/1248618791 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f967c065720 0x7f967c067be0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9684009910 tx=0x7f9684008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:35.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.455+0000 7f9677fff700 1 -- 172.21.15.114:0/1248618791 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f968004f920 con 0x7f96900b5ae0 2023-10-18T12:19:35.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.635+0000 7f9694b77700 1 -- 172.21.15.114:0/1248618791 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96700055c0 con 0x7f96900b5ae0 2023-10-18T12:19:35.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.639+0000 7f9677fff700 1 -- 172.21.15.114:0/1248618791 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+14660 (secure 0 0 0) 0x7f9680052f40 con 0x7f96900b5ae0 2023-10-18T12:19:35.644 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:19:35.645 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"fsid":"240ea340-5d3d-4f52-a4bc-af075aca3deb","created":"2023-10-18T12:19:12.512994+0000","modified":"2023-10-18T12:19:34.527638+0000","last_up_change":"2023-10-18T12:19:25.286009+0000","last_in_change":"2023-10-18T12:19:15.850693+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T12:19:27.040638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-18T12:19:32.358094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c3578978-1a03-4857-b9d2-34a5da3d7731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6817","nonce":1506287862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6820","nonce":1506287862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6830","nonce":1506287862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6825","nonce":1506287862}]},"public_addr":"172.21.15.114:6817/1506287862","cluster_addr":"172.21.15.114:6820/1506287862","heartbeat_back_addr":"172.21.15.114:6830/1506287862","heartbeat_front_addr":"172.21.15.114:6825/1506287862","state":["exists","up"]},{"osd":1,"uuid":"43eb26a6-e2b3-4670-9559-bd053b5140d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6801","nonce":3302727047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6803","nonce":3302727047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6807","nonce":3302727047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6805","nonce":3302727047}]},"public_addr":"172.21.15.114:6801/3302727047","cluster_addr":"172.21.15.114:6803/3302727047","heartbeat_back_addr":"172.21.15.114:6807/3302727047","heartbeat_front_addr":"172.21.15.114:6805/3302727047","state":["exists","up"]},{"osd":2,"uuid":"f3d4dbd5-521c-4dd2-b687-5768cc7d0938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6809","nonce":2699151351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6811","nonce":2699151351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6815","nonce":2699151351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6813","nonce":2699151351}]},"public_addr":"172.21.15.114:6809/2699151351","cluster_addr":"172.21.15.114:6811/2699151351","heartbeat_back_addr":"172.21.15.114:6815/2699151351","heartbeat_front_addr":"172.21.15.114:6813/2699151351","state":["exists","up"]},{"osd":3,"uuid":"823e5802-92b7-4f0d-b32d-a5748993f1b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6821","nonce":1361608073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6824","nonce":1361608073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6829","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6831","nonce":1361608073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6827","nonce":1361608073}]},"public_addr":"172.21.15.114:6821/1361608073","cluster_addr":"172.21.15.114:6824/1361608073","heartbeat_back_addr":"172.21.15.114:6831/1361608073","heartbeat_front_addr":"172.21.15.114:6827/1361608073","state":["exists","up"]},{"osd":4,"uuid":"e47fb93e-13b4-44a4-b084-8c4384ceb41e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6801","nonce":930839681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6803","nonce":930839681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6807","nonce":930839681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6805","nonce":930839681}]},"public_addr":"172.21.15.172:6801/930839681","cluster_addr":"172.21.15.172:6803/930839681","heartbeat_back_addr":"172.21.15.172:6807/930839681","heartbeat_front_addr":"172.21.15.172:6805/930839681","state":["exists","up"]},{"osd":5,"uuid":"7561a973-f479-45a0-af40-f324728d622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6814","nonce":571761850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6818","nonce":571761850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6824","nonce":571761850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6821","nonce":571761850}]},"public_addr":"172.21.15.172:6814/571761850","cluster_addr":"172.21.15.172:6818/571761850","heartbeat_back_addr":"172.21.15.172:6824/571761850","heartbeat_front_addr":"172.21.15.172:6821/571761850","state":["exists","up"]},{"osd":6,"uuid":"51753f4b-7f06-4f1c-9ec7-6e18a66eb980","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6825","nonce":1680398853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6827","nonce":1680398853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6831","nonce":1680398853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6829","nonce":1680398853}]},"public_addr":"172.21.15.172:6825/1680398853","cluster_addr":"172.21.15.172:6827/1680398853","heartbeat_back_addr":"172.21.15.172:6831/1680398853","heartbeat_front_addr":"172.21.15.172:6829/1680398853","state":["exists","up"]},{"osd":7,"uuid":"4d8b1e15-143d-4d17-9074-59d92f0f9af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6809","nonce":349710101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6811","nonce":349710101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6819","nonce":349710101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6815","nonce":349710101}]},"public_addr":"172.21.15.172:6809/349710101","cluster_addr":"172.21.15.172:6811/349710101","heartbeat_back_addr":"172.21.15.172:6819/349710101","heartbeat_front_addr":"172.21.15.172:6815/349710101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.889460+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.475494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.911473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.648596+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.609994+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.636248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.854589+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.885826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T12:19:35.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.639+0000 7f9694b77700 1 -- 172.21.15.114:0/1248618791 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f967c065720 msgr2=0x7f967c067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:35.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.639+0000 7f9694b77700 1 --2- 172.21.15.114:0/1248618791 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f967c065720 0x7f967c067be0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9684009910 tx=0x7f9684008030 comp rx=0 tx=0).stop 2023-10-18T12:19:35.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.639+0000 7f9694b77700 1 -- 172.21.15.114:0/1248618791 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96900b5ae0 msgr2=0x7f96901495e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:35.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.639+0000 7f9694b77700 1 --2- 172.21.15.114:0/1248618791 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96900b5ae0 0x7f96901495e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f968000c520 tx=0x7f968000c830 comp rx=0 tx=0).stop 2023-10-18T12:19:35.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.639+0000 7f9694b77700 1 -- 172.21.15.114:0/1248618791 shutdown_connections 2023-10-18T12:19:35.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.639+0000 7f9694b77700 1 --2- 172.21.15.114:0/1248618791 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f967c065720 0x7f967c067be0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:35.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.639+0000 7f9694b77700 1 --2- 172.21.15.114:0/1248618791 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9690160710 0x7f969015fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:35.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.639+0000 7f9694b77700 1 --2- 172.21.15.114:0/1248618791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96900d2e00 0x7f969015f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:35.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.639+0000 7f9694b77700 1 --2- 172.21.15.114:0/1248618791 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f96900b5ae0 0x7f96901495e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:35.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.639+0000 7f9694b77700 1 -- 172.21.15.114:0/1248618791 >> 172.21.15.114:0/1248618791 conn(0x7f9690069f20 msgr2=0x7f969015c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:35.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.643+0000 7f9694b77700 1 -- 172.21.15.114:0/1248618791 shutdown_connections 2023-10-18T12:19:35.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.643+0000 7f9694b77700 1 -- 172.21.15.114:0/1248618791 wait complete. 2023-10-18T12:19:35.667 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-18T12:19:27.040638+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-18T12:19:32.358094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-18T12:19:35.668 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-18T12:19:35.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.831+0000 7f7ad7fff700 1 Processor -- start 2023-10-18T12:19:35.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.835+0000 7f7ad7fff700 1 -- start start 2023-10-18T12:19:35.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.835+0000 7f7ad7fff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7ad806d090 0x7f7ad80b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:35.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.835+0000 7f7ad7fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7ad806d470 0x7f7ad8070a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:35.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.835+0000 7f7ad7fff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7ad8070f50 0x7f7ad815a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:35.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.835+0000 7f7ad7fff700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ad815f4f0 con 0x7f7ad806d470 2023-10-18T12:19:35.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.835+0000 7f7ad7fff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ad815e990 con 0x7f7ad8070f50 2023-10-18T12:19:35.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.835+0000 7f7ad7fff700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad815ec50 con 0x7f7ad806d090 2023-10-18T12:19:35.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.835+0000 7f7acffff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7ad806d470 0x7f7ad8070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:35.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.835+0000 7f7acffff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7ad806d470 0x7f7ad8070a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33696/0 (socket says 172.21.15.114:33696) 2023-10-18T12:19:35.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.835+0000 7f7acffff700 1 -- 172.21.15.114:0/2410789938 learned_addr learned my addr 172.21.15.114:0/2410789938 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:35.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.835+0000 7f7ad6ffd700 1 --2- 172.21.15.114:0/2410789938 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7ad806d090 0x7f7ad80b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:35.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.835+0000 7f7ad77fe700 1 --2- 172.21.15.114:0/2410789938 >> v2:172.21.15.172:3300/0 conn(0x7f7ad8070f50 0x7f7ad815a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:35.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.835+0000 7f7acffff700 1 -- 172.21.15.114:0/2410789938 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7ad806d090 msgr2=0x7f7ad80b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:35.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.835+0000 7f7acffff700 1 --2- 172.21.15.114:0/2410789938 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7ad806d090 0x7f7ad80b2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:35.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.835+0000 7f7acffff700 1 -- 172.21.15.114:0/2410789938 >> v2:172.21.15.172:3300/0 conn(0x7f7ad8070f50 msgr2=0x7f7ad815a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:35.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.835+0000 7f7acffff700 1 --2- 172.21.15.114:0/2410789938 >> v2:172.21.15.172:3300/0 conn(0x7f7ad8070f50 0x7f7ad815a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:35.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.835+0000 7f7acffff700 1 -- 172.21.15.114:0/2410789938 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad815ef30 con 0x7f7ad806d470 2023-10-18T12:19:35.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.835+0000 7f7ad77fe700 1 --2- 172.21.15.114:0/2410789938 >> v2:172.21.15.172:3300/0 conn(0x7f7ad8070f50 0x7f7ad815a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:19:35.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.835+0000 7f7acffff700 1 --2- 172.21.15.114:0/2410789938 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ad806d470 0x7f7ad8070a10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7ad80b1b10 tx=0x7f7ac0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a74d9a271256d43 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:35.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.839+0000 7f7ad67fc700 1 -- 172.21.15.114:0/2410789938 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac0011830 con 0x7f7ad806d470 2023-10-18T12:19:35.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.839+0000 7f7ad67fc700 1 -- 172.21.15.114:0/2410789938 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac0011990 con 0x7f7ad806d470 2023-10-18T12:19:35.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.839+0000 7f7ad67fc700 1 -- 172.21.15.114:0/2410789938 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac0011d20 con 0x7f7ad806d470 2023-10-18T12:19:35.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.839+0000 7f7ad7fff700 1 -- 172.21.15.114:0/2410789938 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ad806d470 msgr2=0x7f7ad8070a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:35.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.839+0000 7f7ad7fff700 1 --2- 172.21.15.114:0/2410789938 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ad806d470 0x7f7ad8070a10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7ad80b1b10 tx=0x7f7ac0009bf0 comp rx=0 tx=0).stop 2023-10-18T12:19:35.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.839+0000 7f7ad7fff700 1 -- 172.21.15.114:0/2410789938 shutdown_connections 2023-10-18T12:19:35.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.839+0000 7f7ad7fff700 1 --2- 172.21.15.114:0/2410789938 >> v2:172.21.15.172:3300/0 conn(0x7f7ad8070f50 0x7f7ad815a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:35.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.839+0000 7f7ad7fff700 1 --2- 172.21.15.114:0/2410789938 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ad806d470 0x7f7ad8070a10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:35.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.839+0000 7f7ad7fff700 1 --2- 172.21.15.114:0/2410789938 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7ad806d090 0x7f7ad80b2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:35.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.839+0000 7f7ad7fff700 1 -- 172.21.15.114:0/2410789938 >> 172.21.15.114:0/2410789938 conn(0x7f7ad80ce5c0 msgr2=0x7f7ad80ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:35.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.839+0000 7f7ad7fff700 1 -- 172.21.15.114:0/2410789938 shutdown_connections 2023-10-18T12:19:35.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.839+0000 7f7ad7fff700 1 -- 172.21.15.114:0/2410789938 wait complete. 2023-10-18T12:19:35.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.839+0000 7f7ad7fff700 1 Processor -- start 2023-10-18T12:19:35.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.839+0000 7f7ad7fff700 1 -- start start 2023-10-18T12:19:35.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.843+0000 7f7ad7fff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7ad806d090 0x7f7ad8152d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:35.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.843+0000 7f7ad7fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ad806d470 0x7f7ad8159260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:35.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.843+0000 7f7ad7fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ad8070f50 0x7f7ad8148cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:35.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.843+0000 7f7ad7fff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad8153240 con 0x7f7ad806d470 2023-10-18T12:19:35.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.843+0000 7f7ad7fff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad8155f80 con 0x7f7ad8070f50 2023-10-18T12:19:35.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.843+0000 7f7ad7fff700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad81f9f80 con 0x7f7ad806d090 2023-10-18T12:19:35.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.843+0000 7f7acffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ad806d470 0x7f7ad8159260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:35.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.843+0000 7f7acffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ad806d470 0x7f7ad8159260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33704/0 (socket says 172.21.15.114:33704) 2023-10-18T12:19:35.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.843+0000 7f7acffff700 1 -- 172.21.15.114:0/576727499 learned_addr learned my addr 172.21.15.114:0/576727499 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:35.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.843+0000 7f7ad6ffd700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7ad806d090 0x7f7ad8152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:35.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.843+0000 7f7ad77fe700 1 --2- 172.21.15.114:0/576727499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ad8070f50 0x7f7ad8148cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:35.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.843+0000 7f7acffff700 1 -- 172.21.15.114:0/576727499 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7ad806d090 msgr2=0x7f7ad8152d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:35.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.843+0000 7f7acffff700 1 --2- 172.21.15.114:0/576727499 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7ad806d090 0x7f7ad8152d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:35.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.843+0000 7f7acffff700 1 -- 172.21.15.114:0/576727499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ad8070f50 msgr2=0x7f7ad8148cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:35.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.843+0000 7f7acffff700 1 --2- 172.21.15.114:0/576727499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ad8070f50 0x7f7ad8148cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:35.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.843+0000 7f7acffff700 1 -- 172.21.15.114:0/576727499 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac0009570 con 0x7f7ad806d470 2023-10-18T12:19:35.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.843+0000 7f7ad77fe700 1 --2- 172.21.15.114:0/576727499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ad8070f50 0x7f7ad8148cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:19:35.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.843+0000 7f7acffff700 1 --2- 172.21.15.114:0/576727499 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ad806d470 0x7f7ad8159260 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7ad806b190 tx=0x7f7ac0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:35.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.843+0000 7f7ad4ff9700 1 -- 172.21.15.114:0/576727499 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac0004240 con 0x7f7ad806d470 2023-10-18T12:19:35.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.843+0000 7f7ad4ff9700 1 -- 172.21.15.114:0/576727499 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac001f070 con 0x7f7ad806d470 2023-10-18T12:19:35.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.843+0000 7f7ad4ff9700 1 -- 172.21.15.114:0/576727499 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac00045e0 con 0x7f7ad806d470 2023-10-18T12:19:35.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.843+0000 7f7ad7fff700 1 -- 172.21.15.114:0/576727499 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ad81fa260 con 0x7f7ad806d470 2023-10-18T12:19:35.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.843+0000 7f7ad7fff700 1 -- 172.21.15.114:0/576727499 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ad81fa820 con 0x7f7ad806d470 2023-10-18T12:19:35.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.847+0000 7f7ad7fff700 1 -- 172.21.15.114:0/576727499 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ad81faa00 con 0x7f7ad806d470 2023-10-18T12:19:35.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.847+0000 7f7ad4ff9700 1 -- 172.21.15.114:0/576727499 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f7ac0021030 con 0x7f7ad806d470 2023-10-18T12:19:35.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.851+0000 7f7ad4ff9700 1 --2- 172.21.15.114:0/576727499 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7ab80656f0 0x7f7ab8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:35.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.851+0000 7f7ad4ff9700 1 -- 172.21.15.114:0/576727499 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7ac0083a00 con 0x7f7ad806d470 2023-10-18T12:19:35.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.851+0000 7f7ad6ffd700 1 --2- 172.21.15.114:0/576727499 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7ab80656f0 0x7f7ab8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:35.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.851+0000 7f7ad6ffd700 1 --2- 172.21.15.114:0/576727499 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7ab80656f0 0x7f7ab8067bb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8009b70 tx=0x7f7ac8009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:35.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:35.855+0000 7f7ad4ff9700 1 -- 172.21.15.114:0/576727499 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f7ac0051960 con 0x7f7ad806d470 2023-10-18T12:19:36.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.031+0000 7f7ad7fff700 1 -- 172.21.15.114:0/576727499 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7ad804e910 con 0x7f7ad806d470 2023-10-18T12:19:36.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.031+0000 7f7ad4ff9700 1 -- 172.21.15.114:0/576727499 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7ac00150a0 con 0x7f7ad806d470 2023-10-18T12:19:36.038 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-10-18T12:19:36.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.035+0000 7f7ad7fff700 1 -- 172.21.15.114:0/576727499 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7ab80656f0 msgr2=0x7f7ab8067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:36.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.035+0000 7f7ad7fff700 1 --2- 172.21.15.114:0/576727499 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7ab80656f0 0x7f7ab8067bb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8009b70 tx=0x7f7ac8009240 comp rx=0 tx=0).stop 2023-10-18T12:19:36.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.035+0000 7f7ad7fff700 1 -- 172.21.15.114:0/576727499 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ad806d470 msgr2=0x7f7ad8159260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:36.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.035+0000 7f7ad7fff700 1 --2- 172.21.15.114:0/576727499 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ad806d470 0x7f7ad8159260 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7ad806b190 tx=0x7f7ac0004770 comp rx=0 tx=0).stop 2023-10-18T12:19:36.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.035+0000 7f7ad7fff700 1 -- 172.21.15.114:0/576727499 shutdown_connections 2023-10-18T12:19:36.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.035+0000 7f7ad7fff700 1 --2- 172.21.15.114:0/576727499 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7ab80656f0 0x7f7ab8067bb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:36.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.035+0000 7f7ad7fff700 1 --2- 172.21.15.114:0/576727499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ad8070f50 0x7f7ad8148cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:36.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.035+0000 7f7ad7fff700 1 --2- 172.21.15.114:0/576727499 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ad806d470 0x7f7ad8159260 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:36.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.035+0000 7f7ad7fff700 1 --2- 172.21.15.114:0/576727499 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7ad806d090 0x7f7ad8152d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:36.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.035+0000 7f7ad7fff700 1 -- 172.21.15.114:0/576727499 >> 172.21.15.114:0/576727499 conn(0x7f7ad80ce5c0 msgr2=0x7f7ad80caf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:36.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.035+0000 7f7ad7fff700 1 -- 172.21.15.114:0/576727499 shutdown_connections 2023-10-18T12:19:36.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.035+0000 7f7ad7fff700 1 -- 172.21.15.114:0/576727499 wait complete. 2023-10-18T12:19:36.064 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-18T12:19:36.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.239+0000 7fde61c7d700 1 Processor -- start 2023-10-18T12:19:36.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.239+0000 7fde61c7d700 1 -- start start 2023-10-18T12:19:36.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.243+0000 7fde61c7d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fde5c0d2e00 0x7fde5c0b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:36.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.243+0000 7fde61c7d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fde5c0b5ae0 0x7fde5c06db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:36.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.243+0000 7fde61c7d700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde5c15d0d0 con 0x7fde5c160710 2023-10-18T12:19:36.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.243+0000 7fde61c7d700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde5c15df90 con 0x7fde5c0d2e00 2023-10-18T12:19:36.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.243+0000 7fde61c7d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c06f0f0 con 0x7fde5c0b5ae0 2023-10-18T12:19:36.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.243+0000 7fde60c7b700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fde5c0d2e00 0x7fde5c0b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:36.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.243+0000 7fde5bfff700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fde5c160710 0x7fde5c0d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.114:50202/0 (socket says 172.21.15.114:50202) 2023-10-18T12:19:36.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.243+0000 7fde5bfff700 1 -- 172.21.15.114:0/4294394055 learned_addr learned my addr 172.21.15.114:0/4294394055 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:19:36.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.243+0000 7fde6147c700 1 --2- 172.21.15.114:0/4294394055 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fde5c0b5ae0 0x7fde5c06db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:36.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.243+0000 7fde5b7fe700 1 -- 172.21.15.114:0/4294394055 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3992725370 0 0) 0x7fde48001110 con 0x7fde5c160710 2023-10-18T12:19:36.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.243+0000 7fde60c7b700 1 -- 172.21.15.114:0/4294394055 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fde5c0b5ae0 msgr2=0x7fde5c06db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:36.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.243+0000 7fde60c7b700 1 --2- 172.21.15.114:0/4294394055 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fde5c0b5ae0 0x7fde5c06db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:36.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.243+0000 7fde60c7b700 1 -- 172.21.15.114:0/4294394055 >> v1:172.21.15.172:6789/0 conn(0x7fde5c160710 legacy=0x7fde5c0d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:36.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.243+0000 7fde60c7b700 1 -- 172.21.15.114:0/4294394055 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5c15d310 con 0x7fde5c0d2e00 2023-10-18T12:19:36.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.247+0000 7fde60c7b700 1 --2- 172.21.15.114:0/4294394055 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde5c0d2e00 0x7fde5c0b6e00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fde50009850 tx=0x7fde50009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c07df90b1addf41e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:36.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.247+0000 7fde5b7fe700 1 -- 172.21.15.114:0/4294394055 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde50011830 con 0x7fde5c0d2e00 2023-10-18T12:19:36.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.247+0000 7fde5b7fe700 1 -- 172.21.15.114:0/4294394055 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde50011990 con 0x7fde5c0d2e00 2023-10-18T12:19:36.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.247+0000 7fde5b7fe700 1 -- 172.21.15.114:0/4294394055 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde50011d40 con 0x7fde5c0d2e00 2023-10-18T12:19:36.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.247+0000 7fde61c7d700 1 -- 172.21.15.114:0/4294394055 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde5c0d2e00 msgr2=0x7fde5c0b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:36.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.247+0000 7fde61c7d700 1 --2- 172.21.15.114:0/4294394055 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde5c0d2e00 0x7fde5c0b6e00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fde50009850 tx=0x7fde50009b60 comp rx=0 tx=0).stop 2023-10-18T12:19:36.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.247+0000 7fde61c7d700 1 -- 172.21.15.114:0/4294394055 shutdown_connections 2023-10-18T12:19:36.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.247+0000 7fde61c7d700 1 --2- 172.21.15.114:0/4294394055 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fde5c0b5ae0 0x7fde5c06db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:36.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.247+0000 7fde61c7d700 1 --2- 172.21.15.114:0/4294394055 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde5c0d2e00 0x7fde5c0b6e00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:36.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.247+0000 7fde61c7d700 1 -- 172.21.15.114:0/4294394055 >> 172.21.15.114:0/4294394055 conn(0x7fde5c069f20 msgr2=0x7fde5c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:36.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.247+0000 7fde61c7d700 1 -- 172.21.15.114:0/4294394055 shutdown_connections 2023-10-18T12:19:36.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.247+0000 7fde61c7d700 1 -- 172.21.15.114:0/4294394055 wait complete. 2023-10-18T12:19:36.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.251+0000 7fde61c7d700 1 Processor -- start 2023-10-18T12:19:36.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.251+0000 7fde61c7d700 1 -- start start 2023-10-18T12:19:36.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.251+0000 7fde61c7d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde5c0b5ae0 0x7fde5c1f4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:36.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.251+0000 7fde61c7d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fde5c0d2e00 0x7fde5c0d13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:36.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.255+0000 7fde61c7d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde5c160710 0x7fde5c15a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:36.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.255+0000 7fde61c7d700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c0d18f0 con 0x7fde5c160710 2023-10-18T12:19:36.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.255+0000 7fde61c7d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c1f4fe0 con 0x7fde5c0b5ae0 2023-10-18T12:19:36.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.255+0000 7fde61c7d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c1f52c0 con 0x7fde5c0d2e00 2023-10-18T12:19:36.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.255+0000 7fde6147c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde5c160710 0x7fde5c15a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:36.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.255+0000 7fde5bfff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fde5c0d2e00 0x7fde5c0d13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:36.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.255+0000 7fde60c7b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde5c0b5ae0 0x7fde5c1f4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:36.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.255+0000 7fde5bfff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fde5c0d2e00 0x7fde5c0d13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.114:43160/0 (socket says 172.21.15.114:43160) 2023-10-18T12:19:36.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.255+0000 7fde5bfff700 1 -- 172.21.15.114:0/2634168746 learned_addr learned my addr 172.21.15.114:0/2634168746 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:36.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.255+0000 7fde6147c700 1 -- 172.21.15.114:0/2634168746 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fde5c0d2e00 msgr2=0x7fde5c0d13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:36.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.255+0000 7fde6147c700 1 --2- 172.21.15.114:0/2634168746 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fde5c0d2e00 0x7fde5c0d13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:36.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.255+0000 7fde6147c700 1 -- 172.21.15.114:0/2634168746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde5c0b5ae0 msgr2=0x7fde5c1f4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:36.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.255+0000 7fde6147c700 1 --2- 172.21.15.114:0/2634168746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde5c0b5ae0 0x7fde5c1f4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:36.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.255+0000 7fde6147c700 1 -- 172.21.15.114:0/2634168746 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde500094b0 con 0x7fde5c160710 2023-10-18T12:19:36.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.255+0000 7fde5bfff700 1 --2- 172.21.15.114:0/2634168746 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fde5c0d2e00 0x7fde5c0d13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:19:36.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.255+0000 7fde6147c700 1 --2- 172.21.15.114:0/2634168746 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde5c160710 0x7fde5c15a7a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fde5400eba0 tx=0x7fde5400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:36.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.255+0000 7fde597fa700 1 -- 172.21.15.114:0/2634168746 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde54009a80 con 0x7fde5c160710 2023-10-18T12:19:36.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.255+0000 7fde597fa700 1 -- 172.21.15.114:0/2634168746 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde5400f040 con 0x7fde5c160710 2023-10-18T12:19:36.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.255+0000 7fde61c7d700 1 -- 172.21.15.114:0/2634168746 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde5c1f55a0 con 0x7fde5c160710 2023-10-18T12:19:36.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.255+0000 7fde597fa700 1 -- 172.21.15.114:0/2634168746 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5400cc40 con 0x7fde5c160710 2023-10-18T12:19:36.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.255+0000 7fde61c7d700 1 -- 172.21.15.114:0/2634168746 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde5c0acc10 con 0x7fde5c160710 2023-10-18T12:19:36.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.259+0000 7fde61c7d700 1 -- 172.21.15.114:0/2634168746 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde5c04e910 con 0x7fde5c160710 2023-10-18T12:19:36.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.259+0000 7fde597fa700 1 -- 172.21.15.114:0/2634168746 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fde54014480 con 0x7fde5c160710 2023-10-18T12:19:36.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.259+0000 7fde597fa700 1 --2- 172.21.15.114:0/2634168746 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fde400656f0 0x7fde40067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:36.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.259+0000 7fde597fa700 1 -- 172.21.15.114:0/2634168746 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fde54006e40 con 0x7fde5c160710 2023-10-18T12:19:36.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.263+0000 7fde60c7b700 1 --2- 172.21.15.114:0/2634168746 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fde400656f0 0x7fde40067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:36.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.263+0000 7fde60c7b700 1 --2- 172.21.15.114:0/2634168746 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fde400656f0 0x7fde40067bb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fde500090b0 tx=0x7fde5001c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:36.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.267+0000 7fde597fa700 1 -- 172.21.15.114:0/2634168746 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fde54054db0 con 0x7fde5c160710 2023-10-18T12:19:36.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.443+0000 7fde61c7d700 1 -- 172.21.15.114:0/2634168746 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fde5c06d3e0 con 0x7fde5c160710 2023-10-18T12:19:36.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.443+0000 7fde597fa700 1 -- 172.21.15.114:0/2634168746 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7fde54018020 con 0x7fde5c160710 2023-10-18T12:19:36.450 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 8 2023-10-18T12:19:36.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.447+0000 7fde61c7d700 1 -- 172.21.15.114:0/2634168746 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fde400656f0 msgr2=0x7fde40067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:36.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.447+0000 7fde61c7d700 1 --2- 172.21.15.114:0/2634168746 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fde400656f0 0x7fde40067bb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fde500090b0 tx=0x7fde5001c040 comp rx=0 tx=0).stop 2023-10-18T12:19:36.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.447+0000 7fde61c7d700 1 -- 172.21.15.114:0/2634168746 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde5c160710 msgr2=0x7fde5c15a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:36.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.447+0000 7fde61c7d700 1 --2- 172.21.15.114:0/2634168746 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde5c160710 0x7fde5c15a7a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fde5400eba0 tx=0x7fde5400eeb0 comp rx=0 tx=0).stop 2023-10-18T12:19:36.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.447+0000 7fde61c7d700 1 -- 172.21.15.114:0/2634168746 shutdown_connections 2023-10-18T12:19:36.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.447+0000 7fde61c7d700 1 --2- 172.21.15.114:0/2634168746 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fde400656f0 0x7fde40067bb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:36.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.447+0000 7fde61c7d700 1 --2- 172.21.15.114:0/2634168746 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fde5c0d2e00 0x7fde5c0d13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:36.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.447+0000 7fde61c7d700 1 --2- 172.21.15.114:0/2634168746 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fde5c160710 0x7fde5c15a7a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:36.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.447+0000 7fde61c7d700 1 --2- 172.21.15.114:0/2634168746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde5c0b5ae0 0x7fde5c1f4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:36.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.447+0000 7fde61c7d700 1 -- 172.21.15.114:0/2634168746 >> 172.21.15.114:0/2634168746 conn(0x7fde5c069f20 msgr2=0x7fde5c06e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:36.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.447+0000 7fde61c7d700 1 -- 172.21.15.114:0/2634168746 shutdown_connections 2023-10-18T12:19:36.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.447+0000 7fde61c7d700 1 -- 172.21.15.114:0/2634168746 wait complete. 2023-10-18T12:19:36.474 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-18T12:19:36.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.647+0000 7f8ee359e700 1 Processor -- start 2023-10-18T12:19:36.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.647+0000 7f8ee359e700 1 -- start start 2023-10-18T12:19:36.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.651+0000 7f8ee359e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8ee4164a20 0x7f8ee40cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:36.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.651+0000 7f8ee359e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8ee406ce20 0x7f8ee406d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:36.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.651+0000 7f8ee359e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ee406d7b0 con 0x7f8ee40b3d40 2023-10-18T12:19:36.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.651+0000 7f8ee359e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ee406e2d0 con 0x7f8ee4164a20 2023-10-18T12:19:36.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.651+0000 7f8ee359e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee40ca4c0 con 0x7f8ee406ce20 2023-10-18T12:19:36.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.651+0000 7f8ee259c700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f8ee40b3d40 0x7f8ee40c9cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:59694/0 (socket says 172.21.15.114:59694) 2023-10-18T12:19:36.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.651+0000 7f8ee259c700 1 -- 172.21.15.114:0/1138264618 learned_addr learned my addr 172.21.15.114:0/1138264618 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:19:36.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.651+0000 7f8ee2d9d700 1 --2- 172.21.15.114:0/1138264618 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8ee406ce20 0x7f8ee406d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:36.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.651+0000 7f8ee1d9b700 1 --2- 172.21.15.114:0/1138264618 >> v2:172.21.15.172:3300/0 conn(0x7f8ee4164a20 0x7f8ee40cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:36.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.651+0000 7f8ee159a700 1 -- 172.21.15.114:0/1138264618 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 103669239 0 0) 0x7f8ed4001110 con 0x7f8ee40b3d40 2023-10-18T12:19:36.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.651+0000 7f8ee159a700 1 -- 172.21.15.114:0/1138264618 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ecc0035d0 con 0x7f8ee40b3d40 2023-10-18T12:19:36.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.651+0000 7f8ee2d9d700 1 -- 172.21.15.114:0/1138264618 >> v2:172.21.15.172:3300/0 conn(0x7f8ee4164a20 msgr2=0x7f8ee40cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:36.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.651+0000 7f8ee2d9d700 1 --2- 172.21.15.114:0/1138264618 >> v2:172.21.15.172:3300/0 conn(0x7f8ee4164a20 0x7f8ee40cc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:36.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.651+0000 7f8ee2d9d700 1 -- 172.21.15.114:0/1138264618 >> v1:172.21.15.114:6789/0 conn(0x7f8ee40b3d40 legacy=0x7f8ee40c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:36.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.651+0000 7f8ee2d9d700 1 -- 172.21.15.114:0/1138264618 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee40ca7a0 con 0x7f8ee406ce20 2023-10-18T12:19:36.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.655+0000 7f8ee2d9d700 1 --2- 172.21.15.114:0/1138264618 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8ee406ce20 0x7f8ee406d270 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8edc009d90 tx=0x7f8edc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7768632ceeeeb67 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:36.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.655+0000 7f8ee159a700 1 -- 172.21.15.114:0/1138264618 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8edc00e070 con 0x7f8ee406ce20 2023-10-18T12:19:36.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.655+0000 7f8ee159a700 1 -- 172.21.15.114:0/1138264618 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8edc00bb20 con 0x7f8ee406ce20 2023-10-18T12:19:36.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.655+0000 7f8ee159a700 1 -- 172.21.15.114:0/1138264618 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8edc00be90 con 0x7f8ee406ce20 2023-10-18T12:19:36.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.655+0000 7f8ee359e700 1 -- 172.21.15.114:0/1138264618 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8ee406ce20 msgr2=0x7f8ee406d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:36.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.655+0000 7f8ee359e700 1 --2- 172.21.15.114:0/1138264618 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8ee406ce20 0x7f8ee406d270 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8edc009d90 tx=0x7f8edc00b330 comp rx=0 tx=0).stop 2023-10-18T12:19:36.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.655+0000 7f8ee359e700 1 -- 172.21.15.114:0/1138264618 shutdown_connections 2023-10-18T12:19:36.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.655+0000 7f8ee359e700 1 --2- 172.21.15.114:0/1138264618 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8ee406ce20 0x7f8ee406d270 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:36.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.655+0000 7f8ee359e700 1 --2- 172.21.15.114:0/1138264618 >> v2:172.21.15.172:3300/0 conn(0x7f8ee4164a20 0x7f8ee40cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:36.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.655+0000 7f8ee359e700 1 -- 172.21.15.114:0/1138264618 >> 172.21.15.114:0/1138264618 conn(0x7f8ee40ce5c0 msgr2=0x7f8ee40ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:36.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.655+0000 7f8ee359e700 1 -- 172.21.15.114:0/1138264618 shutdown_connections 2023-10-18T12:19:36.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.655+0000 7f8ee359e700 1 -- 172.21.15.114:0/1138264618 wait complete. 2023-10-18T12:19:36.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.659+0000 7f8ee359e700 1 Processor -- start 2023-10-18T12:19:36.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.659+0000 7f8ee359e700 1 -- start start 2023-10-18T12:19:36.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.659+0000 7f8ee359e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ee406ce20 0x7f8ee4155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:36.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.659+0000 7f8ee359e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ee40b3d40 0x7f8ee40caf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:36.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.659+0000 7f8ee359e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8ee4164a20 0x7f8ee40cb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:36.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.659+0000 7f8ee359e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee41ebdf0 con 0x7f8ee40b3d40 2023-10-18T12:19:36.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.659+0000 7f8ee359e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee41ec970 con 0x7f8ee406ce20 2023-10-18T12:19:36.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.659+0000 7f8ee359e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ee41ec040 con 0x7f8ee4164a20 2023-10-18T12:19:36.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.659+0000 7f8ee1d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ee40b3d40 0x7f8ee40caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:36.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.659+0000 7f8ee1d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ee40b3d40 0x7f8ee40caf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33724/0 (socket says 172.21.15.114:33724) 2023-10-18T12:19:36.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.659+0000 7f8ee1d9b700 1 -- 172.21.15.114:0/296050299 learned_addr learned my addr 172.21.15.114:0/296050299 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:36.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.659+0000 7f8ee2d9d700 1 --2- 172.21.15.114:0/296050299 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8ee4164a20 0x7f8ee40cb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:36.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.659+0000 7f8ee259c700 1 --2- 172.21.15.114:0/296050299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ee406ce20 0x7f8ee4155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:36.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.659+0000 7f8ee2d9d700 1 -- 172.21.15.114:0/296050299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ee406ce20 msgr2=0x7f8ee4155260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:36.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.659+0000 7f8ee2d9d700 1 --2- 172.21.15.114:0/296050299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ee406ce20 0x7f8ee4155260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:36.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.659+0000 7f8ee2d9d700 1 -- 172.21.15.114:0/296050299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ee40b3d40 msgr2=0x7f8ee40caf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:36.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.659+0000 7f8ee2d9d700 1 --2- 172.21.15.114:0/296050299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ee40b3d40 0x7f8ee40caf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:36.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.659+0000 7f8ee2d9d700 1 -- 172.21.15.114:0/296050299 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8edc009a70 con 0x7f8ee4164a20 2023-10-18T12:19:36.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.659+0000 7f8ee1d9b700 1 --2- 172.21.15.114:0/296050299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ee40b3d40 0x7f8ee40caf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:19:36.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.659+0000 7f8ee2d9d700 1 --2- 172.21.15.114:0/296050299 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8ee4164a20 0x7f8ee40cb4c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8edc016000 tx=0x7f8edc004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:36.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.663+0000 7f8ed2ffd700 1 -- 172.21.15.114:0/296050299 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8edc007000 con 0x7f8ee4164a20 2023-10-18T12:19:36.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.663+0000 7f8ed2ffd700 1 -- 172.21.15.114:0/296050299 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8edc004980 con 0x7f8ee4164a20 2023-10-18T12:19:36.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.663+0000 7f8ed2ffd700 1 -- 172.21.15.114:0/296050299 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8edc0128b0 con 0x7f8ee4164a20 2023-10-18T12:19:36.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.663+0000 7f8ee359e700 1 -- 172.21.15.114:0/296050299 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ee41ec320 con 0x7f8ee4164a20 2023-10-18T12:19:36.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.663+0000 7f8ee359e700 1 -- 172.21.15.114:0/296050299 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ee4155b20 con 0x7f8ee4164a20 2023-10-18T12:19:36.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.663+0000 7f8ee359e700 1 -- 172.21.15.114:0/296050299 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ee41ecb00 con 0x7f8ee4164a20 2023-10-18T12:19:36.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.663+0000 7f8ed2ffd700 1 -- 172.21.15.114:0/296050299 <== mon.2 v2:172.21.15.172:3301/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f8edc012a10 con 0x7f8ee4164a20 2023-10-18T12:19:36.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.667+0000 7f8ed2ffd700 1 --2- 172.21.15.114:0/296050299 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8ec40656f0 0x7f8ec4067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:36.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.667+0000 7f8ed2ffd700 1 -- 172.21.15.114:0/296050299 <== mon.2 v2:172.21.15.172:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8edc084890 con 0x7f8ee4164a20 2023-10-18T12:19:36.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.667+0000 7f8ee259c700 1 --2- 172.21.15.114:0/296050299 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8ec40656f0 0x7f8ec4067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:36.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.667+0000 7f8ee259c700 1 --2- 172.21.15.114:0/296050299 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8ec40656f0 0x7f8ec4067bb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4007fd0 tx=0x7f8ed4007c60 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:36.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.675+0000 7f8ed2ffd700 1 -- 172.21.15.114:0/296050299 <== mon.2 v2:172.21.15.172:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f8edc052900 con 0x7f8ee4164a20 2023-10-18T12:19:36.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.855+0000 7f8ee359e700 1 -- 172.21.15.114:0/296050299 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8ee41ec180 con 0x7f8ee4164a20 2023-10-18T12:19:36.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.855+0000 7f8ed2ffd700 1 -- 172.21.15.114:0/296050299 <== mon.2 v2:172.21.15.172:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v20) v1 ==== 84+0+126 (secure 0 0 0) 0x7f8edc02b090 con 0x7f8ee4164a20 2023-10-18T12:19:36.861 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:19:36.861 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2023-10-18T12:19:36.862 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T12:19:36.862 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 1, 2023-10-18T12:19:36.862 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": ".mgr" 2023-10-18T12:19:36.862 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T12:19:36.862 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T12:19:36.863 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 2, 2023-10-18T12:19:36.863 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": "rbd" 2023-10-18T12:19:36.863 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T12:19:36.863 INFO:teuthology.orchestra.run.smithi114.stdout:] 2023-10-18T12:19:36.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.859+0000 7f8ee359e700 1 -- 172.21.15.114:0/296050299 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8ec40656f0 msgr2=0x7f8ec4067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:36.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.859+0000 7f8ee359e700 1 --2- 172.21.15.114:0/296050299 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8ec40656f0 0x7f8ec4067bb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8ed4007fd0 tx=0x7f8ed4007c60 comp rx=0 tx=0).stop 2023-10-18T12:19:36.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.859+0000 7f8ee359e700 1 -- 172.21.15.114:0/296050299 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8ee4164a20 msgr2=0x7f8ee40cb4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:36.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.859+0000 7f8ee359e700 1 --2- 172.21.15.114:0/296050299 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8ee4164a20 0x7f8ee40cb4c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8edc016000 tx=0x7f8edc004af0 comp rx=0 tx=0).stop 2023-10-18T12:19:36.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.859+0000 7f8ee359e700 1 -- 172.21.15.114:0/296050299 shutdown_connections 2023-10-18T12:19:36.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.859+0000 7f8ee359e700 1 --2- 172.21.15.114:0/296050299 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8ec40656f0 0x7f8ec4067bb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:36.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.859+0000 7f8ee359e700 1 --2- 172.21.15.114:0/296050299 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8ee4164a20 0x7f8ee40cb4c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:36.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.859+0000 7f8ee359e700 1 --2- 172.21.15.114:0/296050299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8ee40b3d40 0x7f8ee40caf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:36.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.859+0000 7f8ee359e700 1 --2- 172.21.15.114:0/296050299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ee406ce20 0x7f8ee4155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:36.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.859+0000 7f8ee359e700 1 -- 172.21.15.114:0/296050299 >> 172.21.15.114:0/296050299 conn(0x7f8ee40ce5c0 msgr2=0x7f8ee4070960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:36.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.859+0000 7f8ee359e700 1 -- 172.21.15.114:0/296050299 shutdown_connections 2023-10-18T12:19:36.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:36.859+0000 7f8ee359e700 1 -- 172.21.15.114:0/296050299 wait complete. 2023-10-18T12:19:36.887 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-18T12:19:36.887 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-18T12:19:37.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.059+0000 7f92717f6700 1 Processor -- start 2023-10-18T12:19:37.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.059+0000 7f92717f6700 1 -- start start 2023-10-18T12:19:37.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.063+0000 7f92717f6700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f926c158f20 0x7f926c0b0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:37.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.063+0000 7f92717f6700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f926c073540 0x7f926c15d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:37.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.063+0000 7f92717f6700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f926c06f5f0 con 0x7f926c070370 2023-10-18T12:19:37.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.063+0000 7f92717f6700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f926c15d930 con 0x7f926c073540 2023-10-18T12:19:37.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.063+0000 7f92717f6700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f926c06f890 con 0x7f926c158f20 2023-10-18T12:19:37.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.063+0000 7f926bfff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f926c158f20 0x7f926c0b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:37.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.063+0000 7f926bfff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f926c158f20 0x7f926c0b0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.114:43198/0 (socket says 172.21.15.114:43198) 2023-10-18T12:19:37.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.063+0000 7f926bfff700 1 -- 172.21.15.114:0/4093845840 learned_addr learned my addr 172.21.15.114:0/4093845840 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:37.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.063+0000 7f9270ff5700 1 --2- 172.21.15.114:0/4093845840 >> v2:172.21.15.172:3300/0 conn(0x7f926c073540 0x7f926c15d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:37.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.063+0000 7f926bfff700 1 -- 172.21.15.114:0/4093845840 >> v2:172.21.15.172:3300/0 conn(0x7f926c073540 msgr2=0x7f926c15d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:37.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.063+0000 7f926bfff700 1 --2- 172.21.15.114:0/4093845840 >> v2:172.21.15.172:3300/0 conn(0x7f926c073540 0x7f926c15d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:37.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.063+0000 7f926bfff700 1 -- 172.21.15.114:0/4093845840 >> v1:172.21.15.172:6789/0 conn(0x7f926c070370 legacy=0x7f926c15cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:37.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.063+0000 7f926bfff700 1 -- 172.21.15.114:0/4093845840 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f926c06fb70 con 0x7f926c158f20 2023-10-18T12:19:37.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.063+0000 7f926bfff700 1 --2- 172.21.15.114:0/4093845840 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f926c158f20 0x7f926c0b0570 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f925c009910 tx=0x7f925c009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92cddea7c874b6b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:37.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.067+0000 7f926b7fe700 1 -- 172.21.15.114:0/4093845840 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c011830 con 0x7f926c158f20 2023-10-18T12:19:37.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.067+0000 7f926b7fe700 1 -- 172.21.15.114:0/4093845840 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925c011990 con 0x7f926c158f20 2023-10-18T12:19:37.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.067+0000 7f926b7fe700 1 -- 172.21.15.114:0/4093845840 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c011d40 con 0x7f926c158f20 2023-10-18T12:19:37.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.067+0000 7f92717f6700 1 -- 172.21.15.114:0/4093845840 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f926c158f20 msgr2=0x7f926c0b0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:37.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.067+0000 7f92717f6700 1 --2- 172.21.15.114:0/4093845840 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f926c158f20 0x7f926c0b0570 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f925c009910 tx=0x7f925c009c20 comp rx=0 tx=0).stop 2023-10-18T12:19:37.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.067+0000 7f92717f6700 1 -- 172.21.15.114:0/4093845840 shutdown_connections 2023-10-18T12:19:37.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.067+0000 7f92717f6700 1 --2- 172.21.15.114:0/4093845840 >> v2:172.21.15.172:3300/0 conn(0x7f926c073540 0x7f926c15d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:37.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.067+0000 7f92717f6700 1 --2- 172.21.15.114:0/4093845840 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f926c158f20 0x7f926c0b0570 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:37.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.067+0000 7f92717f6700 1 -- 172.21.15.114:0/4093845840 >> 172.21.15.114:0/4093845840 conn(0x7f926c0cea70 msgr2=0x7f926c0cee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:37.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.067+0000 7f92717f6700 1 -- 172.21.15.114:0/4093845840 shutdown_connections 2023-10-18T12:19:37.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.067+0000 7f92717f6700 1 -- 172.21.15.114:0/4093845840 wait complete. 2023-10-18T12:19:37.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.071+0000 7f92717f6700 1 Processor -- start 2023-10-18T12:19:37.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.071+0000 7f92717f6700 1 -- start start 2023-10-18T12:19:37.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.071+0000 7f92717f6700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f926c070370 0x7f926c0c4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:37.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.071+0000 7f92717f6700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f926c073540 0x7f926c14ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:37.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.071+0000 7f92717f6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f926c158f20 0x7f926c15a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:37.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.071+0000 7f92717f6700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926c0c46d0 con 0x7f926c073540 2023-10-18T12:19:37.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.071+0000 7f92717f6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926c14f5a0 con 0x7f926c158f20 2023-10-18T12:19:37.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.071+0000 7f92717f6700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f926c0c6f50 con 0x7f926c070370 2023-10-18T12:19:37.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.075+0000 7f9263fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f926c073540 0x7f926c14ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:37.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.075+0000 7f9263fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f926c073540 0x7f926c14ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33732/0 (socket says 172.21.15.114:33732) 2023-10-18T12:19:37.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.075+0000 7f9263fff700 1 -- 172.21.15.114:0/4139436139 learned_addr learned my addr 172.21.15.114:0/4139436139 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:37.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.075+0000 7f9270ff5700 1 --2- 172.21.15.114:0/4139436139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f926c158f20 0x7f926c15a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:37.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.075+0000 7f926bfff700 1 --2- 172.21.15.114:0/4139436139 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f926c070370 0x7f926c0c4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:37.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.075+0000 7f9263fff700 1 -- 172.21.15.114:0/4139436139 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f926c070370 msgr2=0x7f926c0c4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:37.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.075+0000 7f9263fff700 1 --2- 172.21.15.114:0/4139436139 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f926c070370 0x7f926c0c4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:37.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.075+0000 7f9263fff700 1 -- 172.21.15.114:0/4139436139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f926c158f20 msgr2=0x7f926c15a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:37.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.075+0000 7f9263fff700 1 --2- 172.21.15.114:0/4139436139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f926c158f20 0x7f926c15a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:37.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.075+0000 7f9263fff700 1 -- 172.21.15.114:0/4139436139 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f925c009570 con 0x7f926c073540 2023-10-18T12:19:37.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.075+0000 7f9263fff700 1 --2- 172.21.15.114:0/4139436139 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f926c073540 0x7f926c14ebc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f925400c500 tx=0x7f925400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:37.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.075+0000 7f92697fa700 1 -- 172.21.15.114:0/4139436139 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92540052d0 con 0x7f926c073540 2023-10-18T12:19:37.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.075+0000 7f92697fa700 1 -- 172.21.15.114:0/4139436139 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9254005430 con 0x7f926c073540 2023-10-18T12:19:37.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.075+0000 7f92697fa700 1 -- 172.21.15.114:0/4139436139 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92540055a0 con 0x7f926c073540 2023-10-18T12:19:37.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.075+0000 7f92717f6700 1 -- 172.21.15.114:0/4139436139 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f926c0c7230 con 0x7f926c073540 2023-10-18T12:19:37.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.075+0000 7f92717f6700 1 -- 172.21.15.114:0/4139436139 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f926c0c77f0 con 0x7f926c073540 2023-10-18T12:19:37.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.075+0000 7f92717f6700 1 -- 172.21.15.114:0/4139436139 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f926c072e60 con 0x7f926c073540 2023-10-18T12:19:37.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.079+0000 7f92697fa700 1 -- 172.21.15.114:0/4139436139 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f92540038e0 con 0x7f926c073540 2023-10-18T12:19:37.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.079+0000 7f92697fa700 1 --2- 172.21.15.114:0/4139436139 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f924c0656f0 0x7f924c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:37.087 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.079+0000 7f92697fa700 1 -- 172.21.15.114:0/4139436139 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9254081ec0 con 0x7f926c073540 2023-10-18T12:19:37.087 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.083+0000 7f926bfff700 1 --2- 172.21.15.114:0/4139436139 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f924c0656f0 0x7f924c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:37.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.083+0000 7f926bfff700 1 --2- 172.21.15.114:0/4139436139 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f924c0656f0 0x7f924c067bb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f925c014040 tx=0x7f925c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:37.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.087+0000 7f92697fa700 1 -- 172.21.15.114:0/4139436139 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f925404fc30 con 0x7f926c073540 2023-10-18T12:19:37.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.263+0000 7f92717f6700 1 -- 172.21.15.114:0/4139436139 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f926c0cf8f0 con 0x7f926c073540 2023-10-18T12:19:37.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.555+0000 7f92697fa700 1 -- 172.21.15.114:0/4139436139 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v21) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9254053250 con 0x7f926c073540 2023-10-18T12:19:37.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.563+0000 7f92717f6700 1 -- 172.21.15.114:0/4139436139 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f924c0656f0 msgr2=0x7f924c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:37.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.563+0000 7f92717f6700 1 --2- 172.21.15.114:0/4139436139 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f924c0656f0 0x7f924c067bb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f925c014040 tx=0x7f925c008030 comp rx=0 tx=0).stop 2023-10-18T12:19:37.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.563+0000 7f92717f6700 1 -- 172.21.15.114:0/4139436139 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f926c073540 msgr2=0x7f926c14ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:37.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.563+0000 7f92717f6700 1 --2- 172.21.15.114:0/4139436139 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f926c073540 0x7f926c14ebc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f925400c500 tx=0x7f925400c810 comp rx=0 tx=0).stop 2023-10-18T12:19:37.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.563+0000 7f92717f6700 1 -- 172.21.15.114:0/4139436139 shutdown_connections 2023-10-18T12:19:37.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.563+0000 7f92717f6700 1 --2- 172.21.15.114:0/4139436139 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f924c0656f0 0x7f924c067bb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:37.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.563+0000 7f92717f6700 1 --2- 172.21.15.114:0/4139436139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f926c158f20 0x7f926c15a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:37.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.563+0000 7f92717f6700 1 --2- 172.21.15.114:0/4139436139 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f926c073540 0x7f926c14ebc0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:37.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.563+0000 7f92717f6700 1 --2- 172.21.15.114:0/4139436139 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f926c070370 0x7f926c0c4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:37.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.563+0000 7f92717f6700 1 -- 172.21.15.114:0/4139436139 >> 172.21.15.114:0/4139436139 conn(0x7f926c0cea70 msgr2=0x7f926c0c49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:37.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.563+0000 7f92717f6700 1 -- 172.21.15.114:0/4139436139 shutdown_connections 2023-10-18T12:19:37.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.563+0000 7f92717f6700 1 -- 172.21.15.114:0/4139436139 wait complete. 2023-10-18T12:19:37.573 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' created 2023-10-18T12:19:37.592 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-10-18T12:19:37.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.775+0000 7f5fb6847700 1 Processor -- start 2023-10-18T12:19:37.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.775+0000 7f5fb6847700 1 -- start start 2023-10-18T12:19:37.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.779+0000 7f5fb6847700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5fb00b4770 0x7f5fb00b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:37.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.779+0000 7f5fb6847700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5fb00d0ff0 0x7f5fb01607f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:37.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.779+0000 7f5fb6847700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fb00d0b60 con 0x7f5fb0160d30 2023-10-18T12:19:37.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.779+0000 7f5fb6847700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fb0161800 con 0x7f5fb00d0ff0 2023-10-18T12:19:37.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.779+0000 7f5fb6847700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fb00b5090 con 0x7f5fb00b4770 2023-10-18T12:19:37.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.779+0000 7f5fb6046700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f5fb0160d30 0x7f5fb00cd270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:59708/0 (socket says 172.21.15.114:59708) 2023-10-18T12:19:37.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.779+0000 7f5fb6046700 1 -- 172.21.15.114:0/1707610981 learned_addr learned my addr 172.21.15.114:0/1707610981 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:19:37.787 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.779+0000 7f5fb5044700 1 --2- 172.21.15.114:0/1707610981 >> v2:172.21.15.114:3300/0 conn(0x7f5fb00d0ff0 0x7f5fb01607f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:37.787 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.779+0000 7f5fb5845700 1 --2- 172.21.15.114:0/1707610981 >> v2:172.21.15.172:3300/0 conn(0x7f5fb00b4770 0x7f5fb00b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:37.787 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.779+0000 7f5fb5044700 1 -- 172.21.15.114:0/1707610981 >> v2:172.21.15.172:3300/0 conn(0x7f5fb00b4770 msgr2=0x7f5fb00b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:37.787 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.779+0000 7f5fb5044700 1 --2- 172.21.15.114:0/1707610981 >> v2:172.21.15.172:3300/0 conn(0x7f5fb00b4770 0x7f5fb00b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:37.787 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.779+0000 7f5fb5044700 1 -- 172.21.15.114:0/1707610981 >> v1:172.21.15.114:6789/0 conn(0x7f5fb0160d30 legacy=0x7f5fb00cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:37.787 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.779+0000 7f5fb5044700 1 -- 172.21.15.114:0/1707610981 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb0161240 con 0x7f5fb00d0ff0 2023-10-18T12:19:37.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.779+0000 7f5fb4843700 1 -- 172.21.15.114:0/1707610981 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1322741831 0 0) 0x7f5fb00d0b60 con 0x7f5fb0160d30 2023-10-18T12:19:37.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.779+0000 7f5fb5044700 1 --2- 172.21.15.114:0/1707610981 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fb00d0ff0 0x7f5fb01607f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5fb00d3aa0 tx=0x7f5fa4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=492ebf5b9370749d server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:37.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.779+0000 7f5fb4843700 1 -- 172.21.15.114:0/1707610981 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa4005e50 con 0x7f5fb00d0ff0 2023-10-18T12:19:37.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.779+0000 7f5fb4843700 1 -- 172.21.15.114:0/1707610981 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa4006030 con 0x7f5fb00d0ff0 2023-10-18T12:19:37.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.779+0000 7f5fb4843700 1 -- 172.21.15.114:0/1707610981 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa40063c0 con 0x7f5fb00d0ff0 2023-10-18T12:19:37.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.779+0000 7f5fb6847700 1 -- 172.21.15.114:0/1707610981 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fb00d0ff0 msgr2=0x7f5fb01607f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:37.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.779+0000 7f5fb6847700 1 --2- 172.21.15.114:0/1707610981 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fb00d0ff0 0x7f5fb01607f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5fb00d3aa0 tx=0x7f5fa4009b20 comp rx=0 tx=0).stop 2023-10-18T12:19:37.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.779+0000 7f5fb6847700 1 -- 172.21.15.114:0/1707610981 shutdown_connections 2023-10-18T12:19:37.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.779+0000 7f5fb6847700 1 --2- 172.21.15.114:0/1707610981 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fb00d0ff0 0x7f5fb01607f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:37.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.779+0000 7f5fb6847700 1 --2- 172.21.15.114:0/1707610981 >> v2:172.21.15.172:3300/0 conn(0x7f5fb00b4770 0x7f5fb00b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:37.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.779+0000 7f5fb6847700 1 -- 172.21.15.114:0/1707610981 >> 172.21.15.114:0/1707610981 conn(0x7f5fb00d2b10 msgr2=0x7f5fb00d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:37.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.783+0000 7f5fb6847700 1 -- 172.21.15.114:0/1707610981 shutdown_connections 2023-10-18T12:19:37.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.783+0000 7f5fb6847700 1 -- 172.21.15.114:0/1707610981 wait complete. 2023-10-18T12:19:37.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.783+0000 7f5fb6847700 1 Processor -- start 2023-10-18T12:19:37.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.783+0000 7f5fb6847700 1 -- start start 2023-10-18T12:19:37.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.783+0000 7f5fb6847700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fb00b4770 0x7f5fb00caa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:37.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.783+0000 7f5fb6847700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5fb00d0ff0 0x7f5fb00cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:37.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.783+0000 7f5fb6847700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fb0160d30 0x7f5fb00c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:37.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.783+0000 7f5fb6847700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb00c7d30 con 0x7f5fb00b4770 2023-10-18T12:19:37.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.783+0000 7f5fb6847700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb01f2880 con 0x7f5fb0160d30 2023-10-18T12:19:37.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.783+0000 7f5fb6847700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb00cc7f0 con 0x7f5fb00d0ff0 2023-10-18T12:19:37.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.783+0000 7f5fb5845700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fb00b4770 0x7f5fb00caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:37.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.783+0000 7f5fb5845700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fb00b4770 0x7f5fb00caa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33752/0 (socket says 172.21.15.114:33752) 2023-10-18T12:19:37.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.783+0000 7f5fb5845700 1 -- 172.21.15.114:0/318261230 learned_addr learned my addr 172.21.15.114:0/318261230 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:37.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.783+0000 7f5fb6046700 1 --2- 172.21.15.114:0/318261230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fb0160d30 0x7f5fb00c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:37.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.783+0000 7f5fb5044700 1 --2- 172.21.15.114:0/318261230 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5fb00d0ff0 0x7f5fb00cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:37.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.787+0000 7f5fb5845700 1 -- 172.21.15.114:0/318261230 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5fb00d0ff0 msgr2=0x7f5fb00cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:37.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.787+0000 7f5fb5845700 1 --2- 172.21.15.114:0/318261230 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5fb00d0ff0 0x7f5fb00cc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:37.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.787+0000 7f5fb5845700 1 -- 172.21.15.114:0/318261230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fb0160d30 msgr2=0x7f5fb00c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:37.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.787+0000 7f5fb5845700 1 --2- 172.21.15.114:0/318261230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fb0160d30 0x7f5fb00c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:37.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.787+0000 7f5fb5845700 1 -- 172.21.15.114:0/318261230 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa4009450 con 0x7f5fb00b4770 2023-10-18T12:19:37.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.787+0000 7f5fb6046700 1 --2- 172.21.15.114:0/318261230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fb0160d30 0x7f5fb00c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:19:37.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.787+0000 7f5fb5845700 1 --2- 172.21.15.114:0/318261230 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fb00b4770 0x7f5fb00caa00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5fac00e9b0 tx=0x7f5fac00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:37.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.787+0000 7f5fa27fc700 1 -- 172.21.15.114:0/318261230 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fac009710 con 0x7f5fb00b4770 2023-10-18T12:19:37.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.787+0000 7f5fa27fc700 1 -- 172.21.15.114:0/318261230 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fac00c850 con 0x7f5fb00b4770 2023-10-18T12:19:37.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.787+0000 7f5fa27fc700 1 -- 172.21.15.114:0/318261230 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fac00cbc0 con 0x7f5fb00b4770 2023-10-18T12:19:37.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.787+0000 7f5fb6847700 1 -- 172.21.15.114:0/318261230 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fb01f6380 con 0x7f5fb00b4770 2023-10-18T12:19:37.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.787+0000 7f5fb6847700 1 -- 172.21.15.114:0/318261230 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fb01f6940 con 0x7f5fb00b4770 2023-10-18T12:19:37.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.787+0000 7f5fb6847700 1 -- 172.21.15.114:0/318261230 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fb01f29f0 con 0x7f5fb00b4770 2023-10-18T12:19:37.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.791+0000 7f5fa27fc700 1 -- 172.21.15.114:0/318261230 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f5fac00cd20 con 0x7f5fb00b4770 2023-10-18T12:19:37.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.791+0000 7f5fa27fc700 1 --2- 172.21.15.114:0/318261230 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5f940656f0 0x7f5f94067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:37.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.791+0000 7f5fa27fc700 1 -- 172.21.15.114:0/318261230 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f5fac083110 con 0x7f5fb00b4770 2023-10-18T12:19:37.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.791+0000 7f5fb5044700 1 --2- 172.21.15.114:0/318261230 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5f940656f0 0x7f5f94067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:37.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.791+0000 7f5fb5044700 1 --2- 172.21.15.114:0/318261230 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5f940656f0 0x7f5f94067bb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4009b60 tx=0x7f5fa4008070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:37.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.799+0000 7f5fa27fc700 1 -- 172.21.15.114:0/318261230 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f5fac054840 con 0x7f5fb00b4770 2023-10-18T12:19:37.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:37.983+0000 7f5fb6847700 1 -- 172.21.15.114:0/318261230 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f5fb004e910 con 0x7f5fb00b4770 2023-10-18T12:19:38.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.567+0000 7f5fa27fc700 1 -- 172.21.15.114:0/318261230 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v22) v1 ==== 171+0+0 (secure 0 0 0) 0x7f5fac0543d0 con 0x7f5fb00b4770 2023-10-18T12:19:38.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.579+0000 7f5fb6847700 1 -- 172.21.15.114:0/318261230 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5f940656f0 msgr2=0x7f5f94067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:38.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.579+0000 7f5fb6847700 1 --2- 172.21.15.114:0/318261230 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5f940656f0 0x7f5f94067bb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4009b60 tx=0x7f5fa4008070 comp rx=0 tx=0).stop 2023-10-18T12:19:38.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.579+0000 7f5fb6847700 1 -- 172.21.15.114:0/318261230 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fb00b4770 msgr2=0x7f5fb00caa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:38.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.579+0000 7f5fb6847700 1 --2- 172.21.15.114:0/318261230 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fb00b4770 0x7f5fb00caa00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5fac00e9b0 tx=0x7f5fac00ed70 comp rx=0 tx=0).stop 2023-10-18T12:19:38.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.583+0000 7f5fb6847700 1 -- 172.21.15.114:0/318261230 shutdown_connections 2023-10-18T12:19:38.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.583+0000 7f5fb6847700 1 --2- 172.21.15.114:0/318261230 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5f940656f0 0x7f5f94067bb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:38.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.583+0000 7f5fb6847700 1 --2- 172.21.15.114:0/318261230 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5fb00d0ff0 0x7f5fb00cc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:38.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.583+0000 7f5fb6847700 1 --2- 172.21.15.114:0/318261230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fb0160d30 0x7f5fb00c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:38.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.583+0000 7f5fb6847700 1 --2- 172.21.15.114:0/318261230 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5fb00b4770 0x7f5fb00caa00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:38.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.583+0000 7f5fb6847700 1 -- 172.21.15.114:0/318261230 >> 172.21.15.114:0/318261230 conn(0x7f5fb00d2b10 msgr2=0x7f5fb006dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:38.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.583+0000 7f5fb6847700 1 -- 172.21.15.114:0/318261230 shutdown_connections 2023-10-18T12:19:38.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.587+0000 7f5fb6847700 1 -- 172.21.15.114:0/318261230 wait complete. 2023-10-18T12:19:38.602 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' created 2023-10-18T12:19:38.624 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-18T12:19:38.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.799+0000 7f7a1f537700 1 Processor -- start 2023-10-18T12:19:38.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.803+0000 7f7a1f537700 1 -- start start 2023-10-18T12:19:38.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.803+0000 7f7a1f537700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7a18159750 0x7f7a18070560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:38.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.803+0000 7f7a1f537700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7a180ce040 0x7f7a1806cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:38.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.803+0000 7f7a1f537700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a18070f00 con 0x7f7a18070aa0 2023-10-18T12:19:38.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.803+0000 7f7a1f537700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a180c9aa0 con 0x7f7a180ce040 2023-10-18T12:19:38.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.803+0000 7f7a1f537700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a180b14f0 con 0x7f7a18159750 2023-10-18T12:19:38.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.807+0000 7f7a1ed36700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7a180ce040 0x7f7a1806cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:38.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.807+0000 7f7a1dd34700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f7a18070aa0 0x7f7a180cd930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:59714/0 (socket says 172.21.15.114:59714) 2023-10-18T12:19:38.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.807+0000 7f7a1dd34700 1 -- 172.21.15.114:0/3091535975 learned_addr learned my addr 172.21.15.114:0/3091535975 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:19:38.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.807+0000 7f7a1e535700 1 --2- 172.21.15.114:0/3091535975 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7a18159750 0x7f7a18070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:38.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.807+0000 7f7a1d533700 1 -- 172.21.15.114:0/3091535975 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3723264800 0 0) 0x7f7a18070f00 con 0x7f7a18070aa0 2023-10-18T12:19:38.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.807+0000 7f7a1d533700 1 -- 172.21.15.114:0/3091535975 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a040035d0 con 0x7f7a18070aa0 2023-10-18T12:19:38.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.807+0000 7f7a1e535700 1 -- 172.21.15.114:0/3091535975 >> v2:172.21.15.114:3300/0 conn(0x7f7a180ce040 msgr2=0x7f7a1806cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:38.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.807+0000 7f7a1e535700 1 --2- 172.21.15.114:0/3091535975 >> v2:172.21.15.114:3300/0 conn(0x7f7a180ce040 0x7f7a1806cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:38.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.807+0000 7f7a1e535700 1 -- 172.21.15.114:0/3091535975 >> v1:172.21.15.114:6789/0 conn(0x7f7a18070aa0 legacy=0x7f7a180cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:38.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.807+0000 7f7a1e535700 1 -- 172.21.15.114:0/3091535975 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a1815d590 con 0x7f7a18159750 2023-10-18T12:19:38.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.807+0000 7f7a1e535700 1 --2- 172.21.15.114:0/3091535975 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7a18159750 0x7f7a18070560 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7a14009850 tx=0x7f7a14009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=726ba0e2a6722695 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:38.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.807+0000 7f7a1d533700 1 -- 172.21.15.114:0/3091535975 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a14011830 con 0x7f7a18159750 2023-10-18T12:19:38.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.807+0000 7f7a1d533700 1 -- 172.21.15.114:0/3091535975 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a14011990 con 0x7f7a18159750 2023-10-18T12:19:38.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.807+0000 7f7a1d533700 1 -- 172.21.15.114:0/3091535975 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a14011d00 con 0x7f7a18159750 2023-10-18T12:19:38.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.807+0000 7f7a1f537700 1 -- 172.21.15.114:0/3091535975 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7a18159750 msgr2=0x7f7a18070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:38.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.807+0000 7f7a1f537700 1 --2- 172.21.15.114:0/3091535975 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7a18159750 0x7f7a18070560 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7a14009850 tx=0x7f7a14009b60 comp rx=0 tx=0).stop 2023-10-18T12:19:38.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.807+0000 7f7a1f537700 1 -- 172.21.15.114:0/3091535975 shutdown_connections 2023-10-18T12:19:38.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.807+0000 7f7a1f537700 1 --2- 172.21.15.114:0/3091535975 >> v2:172.21.15.114:3300/0 conn(0x7f7a180ce040 0x7f7a1806cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:38.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.807+0000 7f7a1f537700 1 --2- 172.21.15.114:0/3091535975 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7a18159750 0x7f7a18070560 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:38.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.807+0000 7f7a1f537700 1 -- 172.21.15.114:0/3091535975 >> 172.21.15.114:0/3091535975 conn(0x7f7a180ce5c0 msgr2=0x7f7a180ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:38.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.807+0000 7f7a1f537700 1 -- 172.21.15.114:0/3091535975 shutdown_connections 2023-10-18T12:19:38.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.807+0000 7f7a1f537700 1 -- 172.21.15.114:0/3091535975 wait complete. 2023-10-18T12:19:38.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.811+0000 7f7a1f537700 1 Processor -- start 2023-10-18T12:19:38.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.811+0000 7f7a1f537700 1 -- start start 2023-10-18T12:19:38.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.815+0000 7f7a1f537700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7a18070aa0 0x7f7a1814a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:38.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.815+0000 7f7a1f537700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a180ce040 0x7f7a18158830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:38.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.815+0000 7f7a1f537700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a18159750 0x7f7a180cc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:38.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.815+0000 7f7a1f537700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1814a890 con 0x7f7a18159750 2023-10-18T12:19:38.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.815+0000 7f7a1f537700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a181f4210 con 0x7f7a180ce040 2023-10-18T12:19:38.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.815+0000 7f7a1f537700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a181f44f0 con 0x7f7a18070aa0 2023-10-18T12:19:38.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.815+0000 7f7a1ed36700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a18159750 0x7f7a180cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:38.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.815+0000 7f7a1ed36700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a18159750 0x7f7a180cc850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33758/0 (socket says 172.21.15.114:33758) 2023-10-18T12:19:38.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.815+0000 7f7a1ed36700 1 -- 172.21.15.114:0/430774971 learned_addr learned my addr 172.21.15.114:0/430774971 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:38.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.815+0000 7f7a1dd34700 1 --2- 172.21.15.114:0/430774971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a180ce040 0x7f7a18158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:38.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.815+0000 7f7a1e535700 1 --2- 172.21.15.114:0/430774971 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7a18070aa0 0x7f7a1814a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:38.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.815+0000 7f7a1ed36700 1 -- 172.21.15.114:0/430774971 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7a18070aa0 msgr2=0x7f7a1814a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:38.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.815+0000 7f7a1ed36700 1 --2- 172.21.15.114:0/430774971 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7a18070aa0 0x7f7a1814a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:38.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.815+0000 7f7a1ed36700 1 -- 172.21.15.114:0/430774971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a180ce040 msgr2=0x7f7a18158830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:38.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.815+0000 7f7a1ed36700 1 --2- 172.21.15.114:0/430774971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a180ce040 0x7f7a18158830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:38.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.815+0000 7f7a1ed36700 1 -- 172.21.15.114:0/430774971 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a140094b0 con 0x7f7a18159750 2023-10-18T12:19:38.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.815+0000 7f7a1ed36700 1 --2- 172.21.15.114:0/430774971 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a18159750 0x7f7a180cc850 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7a1000efc0 tx=0x7f7a1000c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:38.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.815+0000 7f7a0effd700 1 -- 172.21.15.114:0/430774971 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1000cb80 con 0x7f7a18159750 2023-10-18T12:19:38.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.815+0000 7f7a0effd700 1 -- 172.21.15.114:0/430774971 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a1000f040 con 0x7f7a18159750 2023-10-18T12:19:38.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.815+0000 7f7a1f537700 1 -- 172.21.15.114:0/430774971 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a181f47d0 con 0x7f7a18159750 2023-10-18T12:19:38.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.815+0000 7f7a0effd700 1 -- 172.21.15.114:0/430774971 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a10014480 con 0x7f7a18159750 2023-10-18T12:19:38.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.815+0000 7f7a1f537700 1 -- 172.21.15.114:0/430774971 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a181f3d80 con 0x7f7a18159750 2023-10-18T12:19:38.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.819+0000 7f7a1f537700 1 -- 172.21.15.114:0/430774971 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a181f4cf0 con 0x7f7a18159750 2023-10-18T12:19:38.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.819+0000 7f7a0effd700 1 -- 172.21.15.114:0/430774971 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f7a100145e0 con 0x7f7a18159750 2023-10-18T12:19:38.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.823+0000 7f7a0effd700 1 --2- 172.21.15.114:0/430774971 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f79fc0656f0 0x7f79fc067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:38.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.823+0000 7f7a0effd700 1 -- 172.21.15.114:0/430774971 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f7a10083e00 con 0x7f7a18159750 2023-10-18T12:19:38.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.823+0000 7f7a1e535700 1 --2- 172.21.15.114:0/430774971 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f79fc0656f0 0x7f79fc067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:38.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.823+0000 7f7a1e535700 1 --2- 172.21.15.114:0/430774971 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f79fc0656f0 0x7f79fc067bb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7a140090b0 tx=0x7f7a14008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:38.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:38.827+0000 7f7a0effd700 1 -- 172.21.15.114:0/430774971 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f7a10051920 con 0x7f7a18159750 2023-10-18T12:19:39.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.070+0000 7f7a1f537700 1 -- 172.21.15.114:0/430774971 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7a18070790 con 0x7f7a18159750 2023-10-18T12:19:39.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.590+0000 7f7a0effd700 1 -- 172.21.15.114:0/430774971 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f7a10054f40 con 0x7f7a18159750 2023-10-18T12:19:39.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.598+0000 7f7a1f537700 1 -- 172.21.15.114:0/430774971 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f79fc0656f0 msgr2=0x7f79fc067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:39.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.598+0000 7f7a1f537700 1 --2- 172.21.15.114:0/430774971 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f79fc0656f0 0x7f79fc067bb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7a140090b0 tx=0x7f7a14008030 comp rx=0 tx=0).stop 2023-10-18T12:19:39.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.598+0000 7f7a1f537700 1 -- 172.21.15.114:0/430774971 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a18159750 msgr2=0x7f7a180cc850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:39.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.598+0000 7f7a1f537700 1 --2- 172.21.15.114:0/430774971 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a18159750 0x7f7a180cc850 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7a1000efc0 tx=0x7f7a1000c0c0 comp rx=0 tx=0).stop 2023-10-18T12:19:39.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.598+0000 7f7a1f537700 1 -- 172.21.15.114:0/430774971 shutdown_connections 2023-10-18T12:19:39.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.598+0000 7f7a1f537700 1 --2- 172.21.15.114:0/430774971 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f79fc0656f0 0x7f79fc067bb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:39.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.598+0000 7f7a1f537700 1 --2- 172.21.15.114:0/430774971 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7a18159750 0x7f7a180cc850 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:39.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.598+0000 7f7a1f537700 1 --2- 172.21.15.114:0/430774971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a180ce040 0x7f7a18158830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:39.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.598+0000 7f7a1f537700 1 --2- 172.21.15.114:0/430774971 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7a18070aa0 0x7f7a1814a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:39.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.598+0000 7f7a1f537700 1 -- 172.21.15.114:0/430774971 >> 172.21.15.114:0/430774971 conn(0x7f7a180ce5c0 msgr2=0x7f7a180c3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:39.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.602+0000 7f7a1f537700 1 -- 172.21.15.114:0/430774971 shutdown_connections 2023-10-18T12:19:39.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.606+0000 7f7a1f537700 1 -- 172.21.15.114:0/430774971 wait complete. 2023-10-18T12:19:39.616 INFO:teuthology.orchestra.run.smithi114.stderr:new fs with metadata pool 3 and data pool 4 2023-10-18T12:19:39.638 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-10-18T12:19:39.638 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-10-18T12:19:39.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.814+0000 7fa69d956700 1 Processor -- start 2023-10-18T12:19:39.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.814+0000 7fa69d956700 1 -- start start 2023-10-18T12:19:39.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.818+0000 7fa69d956700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa6980afd60 0x7fa6980cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:39.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.818+0000 7fa69d956700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa6980cb210 0x7fa6980cb620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:39.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.818+0000 7fa69d956700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6980cbb60 con 0x7fa69815adc0 2023-10-18T12:19:39.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.818+0000 7fa69d956700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6980cfc20 con 0x7fa6980afd60 2023-10-18T12:19:39.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.818+0000 7fa69d956700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa69815b1a0 con 0x7fa6980cb210 2023-10-18T12:19:39.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.818+0000 7fa68ffff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa6980afd60 0x7fa6980cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:39.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.818+0000 7fa68ffff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa6980afd60 0x7fa6980cf590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33764/0 (socket says 172.21.15.114:33764) 2023-10-18T12:19:39.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.818+0000 7fa68ffff700 1 -- 172.21.15.114:0/667034364 learned_addr learned my addr 172.21.15.114:0/667034364 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:39.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.818+0000 7fa6977fe700 1 --2- 172.21.15.114:0/667034364 >> v2:172.21.15.172:3300/0 conn(0x7fa6980cb210 0x7fa6980cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:39.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.818+0000 7fa68ffff700 1 -- 172.21.15.114:0/667034364 >> v2:172.21.15.172:3300/0 conn(0x7fa6980cb210 msgr2=0x7fa6980cb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:39.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.818+0000 7fa68ffff700 1 --2- 172.21.15.114:0/667034364 >> v2:172.21.15.172:3300/0 conn(0x7fa6980cb210 0x7fa6980cb620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:39.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.818+0000 7fa68ffff700 1 -- 172.21.15.114:0/667034364 >> v1:172.21.15.172:6789/0 conn(0x7fa69815adc0 legacy=0x7fa6980b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:39.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.818+0000 7fa68ffff700 1 -- 172.21.15.114:0/667034364 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa69806ff00 con 0x7fa6980afd60 2023-10-18T12:19:39.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.818+0000 7fa6977fe700 1 --2- 172.21.15.114:0/667034364 >> v2:172.21.15.172:3300/0 conn(0x7fa6980cb210 0x7fa6980cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:19:39.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.818+0000 7fa68ffff700 1 --2- 172.21.15.114:0/667034364 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6980afd60 0x7fa6980cf590 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa6980c7a30 tx=0x7fa680009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49ea6f15549d2d7c server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:39.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.818+0000 7fa6967fc700 1 -- 172.21.15.114:0/667034364 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68000b8a0 con 0x7fa6980afd60 2023-10-18T12:19:39.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.818+0000 7fa6967fc700 1 -- 172.21.15.114:0/667034364 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68000ba00 con 0x7fa6980afd60 2023-10-18T12:19:39.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.818+0000 7fa6967fc700 1 -- 172.21.15.114:0/667034364 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68000bd90 con 0x7fa6980afd60 2023-10-18T12:19:39.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.822+0000 7fa69d956700 1 -- 172.21.15.114:0/667034364 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6980afd60 msgr2=0x7fa6980cf590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:39.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.822+0000 7fa69d956700 1 --2- 172.21.15.114:0/667034364 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6980afd60 0x7fa6980cf590 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa6980c7a30 tx=0x7fa680009bf0 comp rx=0 tx=0).stop 2023-10-18T12:19:39.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.822+0000 7fa69d956700 1 -- 172.21.15.114:0/667034364 shutdown_connections 2023-10-18T12:19:39.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.822+0000 7fa69d956700 1 --2- 172.21.15.114:0/667034364 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6980afd60 0x7fa6980cf590 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:39.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.822+0000 7fa69d956700 1 --2- 172.21.15.114:0/667034364 >> v2:172.21.15.172:3300/0 conn(0x7fa6980cb210 0x7fa6980cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:39.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.822+0000 7fa69d956700 1 -- 172.21.15.114:0/667034364 >> 172.21.15.114:0/667034364 conn(0x7fa6980d09b0 msgr2=0x7fa6980d0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:39.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.822+0000 7fa69d956700 1 -- 172.21.15.114:0/667034364 shutdown_connections 2023-10-18T12:19:39.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.822+0000 7fa69d956700 1 -- 172.21.15.114:0/667034364 wait complete. 2023-10-18T12:19:39.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.822+0000 7fa69d956700 1 Processor -- start 2023-10-18T12:19:39.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.822+0000 7fa69d956700 1 -- start start 2023-10-18T12:19:39.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.826+0000 7fa69d956700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6980afd60 0x7fa6980c5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:39.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.826+0000 7fa69d956700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa6980cb210 0x7fa698156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:39.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.826+0000 7fa69d956700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa69815adc0 0x7fa6980c3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:39.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.826+0000 7fa69d956700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6980c48c0 con 0x7fa6980afd60 2023-10-18T12:19:39.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.826+0000 7fa69d956700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6980c4ba0 con 0x7fa69815adc0 2023-10-18T12:19:39.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.826+0000 7fa69d956700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6980c4e80 con 0x7fa6980cb210 2023-10-18T12:19:39.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.826+0000 7fa696ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6980afd60 0x7fa6980c5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:39.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.826+0000 7fa696ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6980afd60 0x7fa6980c5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33770/0 (socket says 172.21.15.114:33770) 2023-10-18T12:19:39.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.826+0000 7fa696ffd700 1 -- 172.21.15.114:0/2081611419 learned_addr learned my addr 172.21.15.114:0/2081611419 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:39.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.826+0000 7fa68ffff700 1 --2- 172.21.15.114:0/2081611419 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa6980cb210 0x7fa698156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:39.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.826+0000 7fa696ffd700 1 -- 172.21.15.114:0/2081611419 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa6980cb210 msgr2=0x7fa698156fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:39.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.826+0000 7fa696ffd700 1 --2- 172.21.15.114:0/2081611419 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa6980cb210 0x7fa698156fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:39.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.826+0000 7fa6977fe700 1 --2- 172.21.15.114:0/2081611419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa69815adc0 0x7fa6980c3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:39.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.826+0000 7fa696ffd700 1 -- 172.21.15.114:0/2081611419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa69815adc0 msgr2=0x7fa6980c3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:39.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.826+0000 7fa696ffd700 1 --2- 172.21.15.114:0/2081611419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa69815adc0 0x7fa6980c3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:39.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.826+0000 7fa696ffd700 1 -- 172.21.15.114:0/2081611419 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa680009570 con 0x7fa6980afd60 2023-10-18T12:19:39.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.826+0000 7fa6977fe700 1 --2- 172.21.15.114:0/2081611419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa69815adc0 0x7fa6980c3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:19:39.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.826+0000 7fa696ffd700 1 --2- 172.21.15.114:0/2081611419 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6980afd60 0x7fa6980c5960 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa68800c500 tx=0x7fa68800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:39.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.826+0000 7fa694ff9700 1 -- 172.21.15.114:0/2081611419 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6880052d0 con 0x7fa6980afd60 2023-10-18T12:19:39.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.826+0000 7fa694ff9700 1 -- 172.21.15.114:0/2081611419 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa688005430 con 0x7fa6980afd60 2023-10-18T12:19:39.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.826+0000 7fa69d956700 1 -- 172.21.15.114:0/2081611419 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6980c5160 con 0x7fa6980afd60 2023-10-18T12:19:39.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.826+0000 7fa694ff9700 1 -- 172.21.15.114:0/2081611419 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6880055a0 con 0x7fa6980afd60 2023-10-18T12:19:39.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.830+0000 7fa69d956700 1 -- 172.21.15.114:0/2081611419 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6980c5ea0 con 0x7fa6980afd60 2023-10-18T12:19:39.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.830+0000 7fa69d956700 1 -- 172.21.15.114:0/2081611419 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6980c5680 con 0x7fa6980afd60 2023-10-18T12:19:39.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.830+0000 7fa694ff9700 1 -- 172.21.15.114:0/2081611419 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fa6880038e0 con 0x7fa6980afd60 2023-10-18T12:19:39.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.834+0000 7fa694ff9700 1 --2- 172.21.15.114:0/2081611419 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa6780656f0 0x7fa678067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:39.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.834+0000 7fa694ff9700 1 -- 172.21.15.114:0/2081611419 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa6880823a0 con 0x7fa6980afd60 2023-10-18T12:19:39.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.834+0000 7fa68ffff700 1 --2- 172.21.15.114:0/2081611419 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa6780656f0 0x7fa678067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:39.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.834+0000 7fa68ffff700 1 --2- 172.21.15.114:0/2081611419 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa6780656f0 0x7fa678067bb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa680014040 tx=0x7fa680008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:39.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:39.842+0000 7fa694ff9700 1 -- 172.21.15.114:0/2081611419 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fa6980c5680 con 0x7fa6980afd60 2023-10-18T12:19:40.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.034+0000 7fa69d956700 1 -- 172.21.15.114:0/2081611419 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fa698073f00 con 0x7fa6980afd60 2023-10-18T12:19:40.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.590+0000 7fa694ff9700 1 -- 172.21.15.114:0/2081611419 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v24) v1 ==== 157+0+0 (secure 0 0 0) 0x7fa68804fdc0 con 0x7fa6980afd60 2023-10-18T12:19:40.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.594+0000 7fa69d956700 1 -- 172.21.15.114:0/2081611419 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa6780656f0 msgr2=0x7fa678067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:40.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.594+0000 7fa69d956700 1 --2- 172.21.15.114:0/2081611419 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa6780656f0 0x7fa678067bb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa680014040 tx=0x7fa680008030 comp rx=0 tx=0).stop 2023-10-18T12:19:40.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.594+0000 7fa69d956700 1 -- 172.21.15.114:0/2081611419 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6980afd60 msgr2=0x7fa6980c5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:40.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.594+0000 7fa69d956700 1 --2- 172.21.15.114:0/2081611419 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6980afd60 0x7fa6980c5960 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa68800c500 tx=0x7fa68800c8c0 comp rx=0 tx=0).stop 2023-10-18T12:19:40.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.594+0000 7fa69d956700 1 -- 172.21.15.114:0/2081611419 shutdown_connections 2023-10-18T12:19:40.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.594+0000 7fa69d956700 1 --2- 172.21.15.114:0/2081611419 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa6780656f0 0x7fa678067bb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:40.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.594+0000 7fa69d956700 1 --2- 172.21.15.114:0/2081611419 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa6980cb210 0x7fa698156fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:40.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.594+0000 7fa69d956700 1 --2- 172.21.15.114:0/2081611419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa69815adc0 0x7fa6980c3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:40.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.594+0000 7fa69d956700 1 --2- 172.21.15.114:0/2081611419 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa6980afd60 0x7fa6980c5960 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:40.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.594+0000 7fa69d956700 1 -- 172.21.15.114:0/2081611419 >> 172.21.15.114:0/2081611419 conn(0x7fa6980d09b0 msgr2=0x7fa6980702e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:40.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.594+0000 7fa69d956700 1 -- 172.21.15.114:0/2081611419 shutdown_connections 2023-10-18T12:19:40.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.594+0000 7fa69d956700 1 -- 172.21.15.114:0/2081611419 wait complete. 2023-10-18T12:19:40.626 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-10-18T12:19:40.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.802+0000 7f4a6547d700 1 Processor -- start 2023-10-18T12:19:40.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.802+0000 7f4a6547d700 1 -- start start 2023-10-18T12:19:40.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.802+0000 7f4a6547d700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4a60157240 0x7f4a6015dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:40.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.802+0000 7f4a6547d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4a60070b70 0x7f4a60069d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:40.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.802+0000 7f4a6547d700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a600d0be0 con 0x7f4a600d1610 2023-10-18T12:19:40.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.802+0000 7f4a6547d700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a6006e0b0 con 0x7f4a60157240 2023-10-18T12:19:40.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.802+0000 7f4a6547d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6015e1b0 con 0x7f4a60070b70 2023-10-18T12:19:40.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.802+0000 7f4a64c7c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4a60070b70 0x7f4a60069d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:40.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.802+0000 7f4a64c7c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4a60070b70 0x7f4a60069d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.114:43246/0 (socket says 172.21.15.114:43246) 2023-10-18T12:19:40.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.802+0000 7f4a64c7c700 1 -- 172.21.15.114:0/2830702396 learned_addr learned my addr 172.21.15.114:0/2830702396 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:40.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.802+0000 7f4a5ffff700 1 --2- 172.21.15.114:0/2830702396 >> v2:172.21.15.172:3300/0 conn(0x7f4a60157240 0x7f4a6015dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:40.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.806+0000 7f4a64c7c700 1 -- 172.21.15.114:0/2830702396 >> v2:172.21.15.172:3300/0 conn(0x7f4a60157240 msgr2=0x7f4a6015dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:40.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.806+0000 7f4a64c7c700 1 --2- 172.21.15.114:0/2830702396 >> v2:172.21.15.172:3300/0 conn(0x7f4a60157240 0x7f4a6015dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:40.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.806+0000 7f4a64c7c700 1 -- 172.21.15.114:0/2830702396 >> v1:172.21.15.172:6789/0 conn(0x7f4a600d1610 legacy=0x7f4a60070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:40.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.806+0000 7f4a64c7c700 1 -- 172.21.15.114:0/2830702396 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a6006daf0 con 0x7f4a60070b70 2023-10-18T12:19:40.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.806+0000 7f4a5ffff700 1 --2- 172.21.15.114:0/2830702396 >> v2:172.21.15.172:3300/0 conn(0x7f4a60157240 0x7f4a6015dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:19:40.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.806+0000 7f4a64c7c700 1 --2- 172.21.15.114:0/2830702396 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4a60070b70 0x7f4a60069d10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4a58009e50 tx=0x7f4a5800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a38bc8e8ce39c1a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:40.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.806+0000 7f4a5effd700 1 -- 172.21.15.114:0/2830702396 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5800e070 con 0x7f4a60070b70 2023-10-18T12:19:40.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.806+0000 7f4a5effd700 1 -- 172.21.15.114:0/2830702396 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a5800b9c0 con 0x7f4a60070b70 2023-10-18T12:19:40.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.806+0000 7f4a5effd700 1 -- 172.21.15.114:0/2830702396 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5800bd70 con 0x7f4a60070b70 2023-10-18T12:19:40.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.806+0000 7f4a6547d700 1 -- 172.21.15.114:0/2830702396 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4a60070b70 msgr2=0x7f4a60069d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:40.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.806+0000 7f4a6547d700 1 --2- 172.21.15.114:0/2830702396 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4a60070b70 0x7f4a60069d10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4a58009e50 tx=0x7f4a5800b330 comp rx=0 tx=0).stop 2023-10-18T12:19:40.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.806+0000 7f4a6547d700 1 -- 172.21.15.114:0/2830702396 shutdown_connections 2023-10-18T12:19:40.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.806+0000 7f4a6547d700 1 --2- 172.21.15.114:0/2830702396 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4a60070b70 0x7f4a60069d10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:40.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.806+0000 7f4a6547d700 1 --2- 172.21.15.114:0/2830702396 >> v2:172.21.15.172:3300/0 conn(0x7f4a60157240 0x7f4a6015dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:40.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.806+0000 7f4a6547d700 1 -- 172.21.15.114:0/2830702396 >> 172.21.15.114:0/2830702396 conn(0x7f4a600b47e0 msgr2=0x7f4a600b4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:40.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.806+0000 7f4a6547d700 1 -- 172.21.15.114:0/2830702396 shutdown_connections 2023-10-18T12:19:40.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.806+0000 7f4a6547d700 1 -- 172.21.15.114:0/2830702396 wait complete. 2023-10-18T12:19:40.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.810+0000 7f4a6547d700 1 Processor -- start 2023-10-18T12:19:40.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.810+0000 7f4a6547d700 1 -- start start 2023-10-18T12:19:40.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.810+0000 7f4a6547d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a60070b70 0x7f4a6014f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:40.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.814+0000 7f4a6547d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a600d1610 0x7f4a600b6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:40.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.814+0000 7f4a6547d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4a60157240 0x7f4a600b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:40.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.814+0000 7f4a6547d700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6015a4f0 con 0x7f4a60070b70 2023-10-18T12:19:40.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.814+0000 7f4a6547d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6008a130 con 0x7f4a600d1610 2023-10-18T12:19:40.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.814+0000 7f4a6547d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6008a3d0 con 0x7f4a60157240 2023-10-18T12:19:40.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.814+0000 7f4a5ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a60070b70 0x7f4a6014f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:40.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.814+0000 7f4a5ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a60070b70 0x7f4a6014f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33786/0 (socket says 172.21.15.114:33786) 2023-10-18T12:19:40.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.814+0000 7f4a5ffff700 1 -- 172.21.15.114:0/3652905269 learned_addr learned my addr 172.21.15.114:0/3652905269 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:40.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.814+0000 7f4a64c7c700 1 --2- 172.21.15.114:0/3652905269 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4a60157240 0x7f4a600b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:40.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.814+0000 7f4a5f7fe700 1 --2- 172.21.15.114:0/3652905269 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a600d1610 0x7f4a600b6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:40.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.814+0000 7f4a5ffff700 1 -- 172.21.15.114:0/3652905269 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4a60157240 msgr2=0x7f4a600b7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:40.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.814+0000 7f4a5ffff700 1 --2- 172.21.15.114:0/3652905269 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4a60157240 0x7f4a600b7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:40.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.814+0000 7f4a5ffff700 1 -- 172.21.15.114:0/3652905269 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a600d1610 msgr2=0x7f4a600b6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:40.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.814+0000 7f4a5ffff700 1 --2- 172.21.15.114:0/3652905269 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a600d1610 0x7f4a600b6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:40.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.814+0000 7f4a5ffff700 1 -- 172.21.15.114:0/3652905269 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a58009b30 con 0x7f4a60070b70 2023-10-18T12:19:40.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.814+0000 7f4a5f7fe700 1 --2- 172.21.15.114:0/3652905269 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a600d1610 0x7f4a600b6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:19:40.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.814+0000 7f4a5ffff700 1 --2- 172.21.15.114:0/3652905269 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a60070b70 0x7f4a6014f080 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4a5000e810 tx=0x7f4a5000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:40.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.814+0000 7f4a5cff9700 1 -- 172.21.15.114:0/3652905269 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a50005c40 con 0x7f4a60070b70 2023-10-18T12:19:40.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.814+0000 7f4a5cff9700 1 -- 172.21.15.114:0/3652905269 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a50005da0 con 0x7f4a60070b70 2023-10-18T12:19:40.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.814+0000 7f4a6547d700 1 -- 172.21.15.114:0/3652905269 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a6008a6b0 con 0x7f4a60070b70 2023-10-18T12:19:40.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.814+0000 7f4a5cff9700 1 -- 172.21.15.114:0/3652905269 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a50004250 con 0x7f4a60070b70 2023-10-18T12:19:40.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.814+0000 7f4a6547d700 1 -- 172.21.15.114:0/3652905269 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a6014f5c0 con 0x7f4a60070b70 2023-10-18T12:19:40.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.814+0000 7f4a6547d700 1 -- 172.21.15.114:0/3652905269 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a60072e60 con 0x7f4a60070b70 2023-10-18T12:19:40.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.818+0000 7f4a5cff9700 1 -- 172.21.15.114:0/3652905269 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f4a500043b0 con 0x7f4a60070b70 2023-10-18T12:19:40.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.818+0000 7f4a5cff9700 1 --2- 172.21.15.114:0/3652905269 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4a4c0656f0 0x7f4a4c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:40.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.818+0000 7f4a5cff9700 1 -- 172.21.15.114:0/3652905269 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6288+0+0 (secure 0 0 0) 0x7f4a50082cd0 con 0x7f4a60070b70 2023-10-18T12:19:40.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.822+0000 7f4a5f7fe700 1 --2- 172.21.15.114:0/3652905269 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4a4c0656f0 0x7f4a4c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:40.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.822+0000 7f4a5f7fe700 1 --2- 172.21.15.114:0/3652905269 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4a4c0656f0 0x7f4a4c067bb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4a6008d180 tx=0x7f4a54009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:40.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:40.826+0000 7f4a5cff9700 1 -- 172.21.15.114:0/3652905269 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f4a500506c0 con 0x7f4a60070b70 2023-10-18T12:19:41.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:41.010+0000 7f4a6547d700 1 -- 172.21.15.114:0/3652905269 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f4a600b8bb0 con 0x7f4a60070b70 2023-10-18T12:19:42.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.618+0000 7f4a5cff9700 1 -- 172.21.15.114:0/3652905269 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v26) v1 ==== 228+0+0 (secure 0 0 0) 0x7f4a50053ce0 con 0x7f4a60070b70 2023-10-18T12:19:42.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.622+0000 7f4a6547d700 1 -- 172.21.15.114:0/3652905269 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4a4c0656f0 msgr2=0x7f4a4c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:42.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.622+0000 7f4a6547d700 1 --2- 172.21.15.114:0/3652905269 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4a4c0656f0 0x7f4a4c067bb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4a6008d180 tx=0x7f4a54009040 comp rx=0 tx=0).stop 2023-10-18T12:19:42.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.622+0000 7f4a6547d700 1 -- 172.21.15.114:0/3652905269 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a60070b70 msgr2=0x7f4a6014f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:42.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.622+0000 7f4a6547d700 1 --2- 172.21.15.114:0/3652905269 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a60070b70 0x7f4a6014f080 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4a5000e810 tx=0x7f4a5000ebd0 comp rx=0 tx=0).stop 2023-10-18T12:19:42.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.622+0000 7f4a6547d700 1 -- 172.21.15.114:0/3652905269 shutdown_connections 2023-10-18T12:19:42.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.622+0000 7f4a6547d700 1 --2- 172.21.15.114:0/3652905269 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4a4c0656f0 0x7f4a4c067bb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:42.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.622+0000 7f4a6547d700 1 --2- 172.21.15.114:0/3652905269 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4a60157240 0x7f4a600b7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:42.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.622+0000 7f4a6547d700 1 --2- 172.21.15.114:0/3652905269 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a600d1610 0x7f4a600b6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:42.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.622+0000 7f4a6547d700 1 --2- 172.21.15.114:0/3652905269 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a60070b70 0x7f4a6014f080 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:42.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.622+0000 7f4a6547d700 1 -- 172.21.15.114:0/3652905269 >> 172.21.15.114:0/3652905269 conn(0x7f4a600b47e0 msgr2=0x7f4a6015ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:42.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.622+0000 7f4a6547d700 1 -- 172.21.15.114:0/3652905269 shutdown_connections 2023-10-18T12:19:42.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.626+0000 7f4a6547d700 1 -- 172.21.15.114:0/3652905269 wait complete. 2023-10-18T12:19:42.642 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data_ec' created 2023-10-18T12:19:42.660 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-10-18T12:19:42.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.842+0000 7efd4d200700 1 Processor -- start 2023-10-18T12:19:42.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.842+0000 7efd4d200700 1 -- start start 2023-10-18T12:19:42.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.846+0000 7efd4d200700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7efd481467a0 0x7efd480b5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:42.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.846+0000 7efd4d200700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efd480cf490 0x7efd4806fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:42.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.846+0000 7efd4d200700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd4806f5f0 con 0x7efd480b5560 2023-10-18T12:19:42.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.846+0000 7efd4d200700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd480cf9f0 con 0x7efd480cf490 2023-10-18T12:19:42.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.846+0000 7efd4d200700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd480d2200 con 0x7efd481467a0 2023-10-18T12:19:42.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.846+0000 7efd477fe700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7efd480b5560 0x7efd480ced80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:59724/0 (socket says 172.21.15.114:59724) 2023-10-18T12:19:42.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.846+0000 7efd477fe700 1 -- 172.21.15.114:0/3598276484 learned_addr learned my addr 172.21.15.114:0/3598276484 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:19:42.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.846+0000 7efd4c9ff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efd480cf490 0x7efd4806fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:42.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.846+0000 7efd47fff700 1 --2- 172.21.15.114:0/3598276484 >> v2:172.21.15.172:3300/0 conn(0x7efd481467a0 0x7efd480b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:42.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.846+0000 7efd4c9ff700 1 -- 172.21.15.114:0/3598276484 >> v2:172.21.15.172:3300/0 conn(0x7efd481467a0 msgr2=0x7efd480b5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:42.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.846+0000 7efd4c9ff700 1 --2- 172.21.15.114:0/3598276484 >> v2:172.21.15.172:3300/0 conn(0x7efd481467a0 0x7efd480b5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:42.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.846+0000 7efd4c9ff700 1 -- 172.21.15.114:0/3598276484 >> v1:172.21.15.114:6789/0 conn(0x7efd480b5560 legacy=0x7efd480ced80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:42.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.846+0000 7efd4c9ff700 1 -- 172.21.15.114:0/3598276484 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd480d1960 con 0x7efd480cf490 2023-10-18T12:19:42.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.846+0000 7efd46ffd700 1 -- 172.21.15.114:0/3598276484 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3838302113 0 0) 0x7efd4806f5f0 con 0x7efd480b5560 2023-10-18T12:19:42.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.850+0000 7efd4c9ff700 1 --2- 172.21.15.114:0/3598276484 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd480cf490 0x7efd4806fad0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efd480b4ff0 tx=0x7efd4000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68207a77b8104018 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:42.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.850+0000 7efd46ffd700 1 -- 172.21.15.114:0/3598276484 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4000e070 con 0x7efd480cf490 2023-10-18T12:19:42.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.850+0000 7efd46ffd700 1 -- 172.21.15.114:0/3598276484 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd4000bae0 con 0x7efd480cf490 2023-10-18T12:19:42.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.850+0000 7efd46ffd700 1 -- 172.21.15.114:0/3598276484 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4000be90 con 0x7efd480cf490 2023-10-18T12:19:42.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.850+0000 7efd4d200700 1 -- 172.21.15.114:0/3598276484 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd480cf490 msgr2=0x7efd4806fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:42.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.850+0000 7efd4d200700 1 --2- 172.21.15.114:0/3598276484 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd480cf490 0x7efd4806fad0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efd480b4ff0 tx=0x7efd4000b330 comp rx=0 tx=0).stop 2023-10-18T12:19:42.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.850+0000 7efd4d200700 1 -- 172.21.15.114:0/3598276484 shutdown_connections 2023-10-18T12:19:42.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.850+0000 7efd4d200700 1 --2- 172.21.15.114:0/3598276484 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd480cf490 0x7efd4806fad0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:42.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.850+0000 7efd4d200700 1 --2- 172.21.15.114:0/3598276484 >> v2:172.21.15.172:3300/0 conn(0x7efd481467a0 0x7efd480b5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:42.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.850+0000 7efd4d200700 1 -- 172.21.15.114:0/3598276484 >> 172.21.15.114:0/3598276484 conn(0x7efd4806ce90 msgr2=0x7efd480b7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:42.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.850+0000 7efd4d200700 1 -- 172.21.15.114:0/3598276484 shutdown_connections 2023-10-18T12:19:42.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.850+0000 7efd4d200700 1 -- 172.21.15.114:0/3598276484 wait complete. 2023-10-18T12:19:42.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.854+0000 7efd4d200700 1 Processor -- start 2023-10-18T12:19:42.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.854+0000 7efd4d200700 1 -- start start 2023-10-18T12:19:42.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.854+0000 7efd4d200700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd480b5560 0x7efd481f2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:42.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.854+0000 7efd4d200700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efd480cf490 0x7efd4815c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:42.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.854+0000 7efd4d200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd481467a0 0x7efd481f5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:42.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.854+0000 7efd4d200700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd481f21f0 con 0x7efd480b5560 2023-10-18T12:19:42.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.854+0000 7efd4d200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd4815cbb0 con 0x7efd481467a0 2023-10-18T12:19:42.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.854+0000 7efd4d200700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd481f5c90 con 0x7efd480cf490 2023-10-18T12:19:42.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.858+0000 7efd47fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd480b5560 0x7efd481f2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:42.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.858+0000 7efd47fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd480b5560 0x7efd481f2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33814/0 (socket says 172.21.15.114:33814) 2023-10-18T12:19:42.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.858+0000 7efd47fff700 1 -- 172.21.15.114:0/3807091995 learned_addr learned my addr 172.21.15.114:0/3807091995 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:42.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.858+0000 7efd4c9ff700 1 --2- 172.21.15.114:0/3807091995 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd481467a0 0x7efd481f5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:42.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.858+0000 7efd477fe700 1 --2- 172.21.15.114:0/3807091995 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efd480cf490 0x7efd4815c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:42.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.858+0000 7efd47fff700 1 -- 172.21.15.114:0/3807091995 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efd480cf490 msgr2=0x7efd4815c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:42.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.858+0000 7efd47fff700 1 --2- 172.21.15.114:0/3807091995 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efd480cf490 0x7efd4815c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:42.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.858+0000 7efd47fff700 1 -- 172.21.15.114:0/3807091995 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd481467a0 msgr2=0x7efd481f5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:42.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.858+0000 7efd47fff700 1 --2- 172.21.15.114:0/3807091995 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd481467a0 0x7efd481f5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:42.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.858+0000 7efd47fff700 1 -- 172.21.15.114:0/3807091995 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd40009a70 con 0x7efd480b5560 2023-10-18T12:19:42.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.858+0000 7efd4c9ff700 1 --2- 172.21.15.114:0/3807091995 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd481467a0 0x7efd481f5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:19:42.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.858+0000 7efd47fff700 1 --2- 172.21.15.114:0/3807091995 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd480b5560 0x7efd481f2680 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efd3800e9d0 tx=0x7efd3800ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:42.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.858+0000 7efd44ff9700 1 -- 172.21.15.114:0/3807091995 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd38009720 con 0x7efd480b5560 2023-10-18T12:19:42.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.858+0000 7efd44ff9700 1 -- 172.21.15.114:0/3807091995 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd3800c850 con 0x7efd480b5560 2023-10-18T12:19:42.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.858+0000 7efd4d200700 1 -- 172.21.15.114:0/3807091995 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd481f5f70 con 0x7efd480b5560 2023-10-18T12:19:42.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.858+0000 7efd44ff9700 1 -- 172.21.15.114:0/3807091995 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3800cbc0 con 0x7efd480b5560 2023-10-18T12:19:42.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.858+0000 7efd4d200700 1 -- 172.21.15.114:0/3807091995 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd481409e0 con 0x7efd480b5560 2023-10-18T12:19:42.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.862+0000 7efd4d200700 1 -- 172.21.15.114:0/3807091995 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd48072e60 con 0x7efd480b5560 2023-10-18T12:19:42.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.862+0000 7efd44ff9700 1 -- 172.21.15.114:0/3807091995 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7efd3800cd20 con 0x7efd480b5560 2023-10-18T12:19:42.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.862+0000 7efd44ff9700 1 --2- 172.21.15.114:0/3807091995 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7efd340656f0 0x7efd34067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:42.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.862+0000 7efd44ff9700 1 -- 172.21.15.114:0/3807091995 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6781+0+0 (secure 0 0 0) 0x7efd380839d0 con 0x7efd480b5560 2023-10-18T12:19:42.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.866+0000 7efd477fe700 1 --2- 172.21.15.114:0/3807091995 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7efd340656f0 0x7efd34067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:42.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.866+0000 7efd477fe700 1 --2- 172.21.15.114:0/3807091995 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7efd340656f0 0x7efd34067bb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efd481ef720 tx=0x7efd3c007cb0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:42.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:42.870+0000 7efd44ff9700 1 -- 172.21.15.114:0/3807091995 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7efd38054cb0 con 0x7efd480b5560 2023-10-18T12:19:43.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.050+0000 7efd4d200700 1 -- 172.21.15.114:0/3807091995 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7efd480b3bf0 con 0x7efd480b5560 2023-10-18T12:19:43.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.634+0000 7efd44ff9700 1 -- 172.21.15.114:0/3807091995 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v27) v1 ==== 169+0+0 (secure 0 0 0) 0x7efd38054840 con 0x7efd480b5560 2023-10-18T12:19:43.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.642+0000 7efd4d200700 1 -- 172.21.15.114:0/3807091995 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7efd340656f0 msgr2=0x7efd34067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:43.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.642+0000 7efd4d200700 1 --2- 172.21.15.114:0/3807091995 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7efd340656f0 0x7efd34067bb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efd481ef720 tx=0x7efd3c007cb0 comp rx=0 tx=0).stop 2023-10-18T12:19:43.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.642+0000 7efd4d200700 1 -- 172.21.15.114:0/3807091995 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd480b5560 msgr2=0x7efd481f2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:43.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.642+0000 7efd4d200700 1 --2- 172.21.15.114:0/3807091995 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd480b5560 0x7efd481f2680 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efd3800e9d0 tx=0x7efd3800ed90 comp rx=0 tx=0).stop 2023-10-18T12:19:43.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.642+0000 7efd4d200700 1 -- 172.21.15.114:0/3807091995 shutdown_connections 2023-10-18T12:19:43.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.642+0000 7efd4d200700 1 --2- 172.21.15.114:0/3807091995 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7efd340656f0 0x7efd34067bb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:43.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.642+0000 7efd4d200700 1 --2- 172.21.15.114:0/3807091995 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efd480cf490 0x7efd4815c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:43.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.642+0000 7efd4d200700 1 --2- 172.21.15.114:0/3807091995 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd481467a0 0x7efd481f5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:43.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.642+0000 7efd4d200700 1 --2- 172.21.15.114:0/3807091995 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efd480b5560 0x7efd481f2680 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7efd3800e9d0 tx=0x7efd3800ed90 comp rx=0 tx=0).stop 2023-10-18T12:19:43.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.642+0000 7efd4d200700 1 -- 172.21.15.114:0/3807091995 >> 172.21.15.114:0/3807091995 conn(0x7efd4806ce90 msgr2=0x7efd480706e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:43.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.650+0000 7efd4d200700 1 -- 172.21.15.114:0/3807091995 shutdown_connections 2023-10-18T12:19:43.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.654+0000 7efd4d200700 1 -- 172.21.15.114:0/3807091995 wait complete. 2023-10-18T12:19:43.667 INFO:teuthology.orchestra.run.smithi114.stderr:set pool 5 allow_ec_overwrites to true 2023-10-18T12:19:43.695 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-10-18T12:19:43.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.874+0000 7fac3dccd700 1 Processor -- start 2023-10-18T12:19:43.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.874+0000 7fac3dccd700 1 -- start start 2023-10-18T12:19:43.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.874+0000 7fac3dccd700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fac380b5b80 0x7fac3815d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:43.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.878+0000 7fac3dccd700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac38146ba0 con 0x7fac3806f9a0 2023-10-18T12:19:43.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.878+0000 7fac3dccd700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac380d0920 con 0x7fac381467c0 2023-10-18T12:19:43.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.878+0000 7fac3dccd700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac380b6160 con 0x7fac380b5b80 2023-10-18T12:19:43.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.878+0000 7fac37fff700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fac3806f9a0 0x7fac380d0db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:59734/0 (socket says 172.21.15.114:59734) 2023-10-18T12:19:43.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.878+0000 7fac37fff700 1 -- 172.21.15.114:0/1658019923 learned_addr learned my addr 172.21.15.114:0/1658019923 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:19:43.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.878+0000 7fac36ffd700 1 --2- 172.21.15.114:0/1658019923 >> v2:172.21.15.172:3300/0 conn(0x7fac380b5b80 0x7fac3815d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:43.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.878+0000 7fac367fc700 1 -- 172.21.15.114:0/1658019923 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1812797201 0 0) 0x7fac38146ba0 con 0x7fac3806f9a0 2023-10-18T12:19:43.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.878+0000 7fac367fc700 1 -- 172.21.15.114:0/1658019923 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac200035d0 con 0x7fac3806f9a0 2023-10-18T12:19:43.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.878+0000 7fac367fc700 1 -- 172.21.15.114:0/1658019923 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3962351727 0 0) 0x7fac380d0920 con 0x7fac381467c0 2023-10-18T12:19:43.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.878+0000 7fac367fc700 1 -- 172.21.15.114:0/1658019923 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac38146ba0 con 0x7fac381467c0 2023-10-18T12:19:43.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.878+0000 7fac36ffd700 1 -- 172.21.15.114:0/1658019923 >> v1:172.21.15.172:6789/0 conn(0x7fac381467c0 legacy=0x7fac381612e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:43.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.878+0000 7fac36ffd700 1 -- 172.21.15.114:0/1658019923 >> v1:172.21.15.114:6789/0 conn(0x7fac3806f9a0 legacy=0x7fac380d0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:43.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.878+0000 7fac36ffd700 1 -- 172.21.15.114:0/1658019923 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac380b6440 con 0x7fac380b5b80 2023-10-18T12:19:43.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.878+0000 7fac36ffd700 1 --2- 172.21.15.114:0/1658019923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac380b5b80 0x7fac3815d310 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fac2c009850 tx=0x7fac2c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1ce317348eb5ac server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:43.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.878+0000 7fac367fc700 1 -- 172.21.15.114:0/1658019923 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2c011830 con 0x7fac380b5b80 2023-10-18T12:19:43.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.878+0000 7fac367fc700 1 -- 172.21.15.114:0/1658019923 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2c011990 con 0x7fac380b5b80 2023-10-18T12:19:43.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.878+0000 7fac367fc700 1 -- 172.21.15.114:0/1658019923 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2c011d40 con 0x7fac380b5b80 2023-10-18T12:19:43.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.878+0000 7fac3dccd700 1 -- 172.21.15.114:0/1658019923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac380b5b80 msgr2=0x7fac3815d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:43.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.878+0000 7fac3dccd700 1 --2- 172.21.15.114:0/1658019923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac380b5b80 0x7fac3815d310 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fac2c009850 tx=0x7fac2c009b60 comp rx=0 tx=0).stop 2023-10-18T12:19:43.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.882+0000 7fac3dccd700 1 -- 172.21.15.114:0/1658019923 shutdown_connections 2023-10-18T12:19:43.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.882+0000 7fac3dccd700 1 --2- 172.21.15.114:0/1658019923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac380b5b80 0x7fac3815d310 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:43.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.882+0000 7fac3dccd700 1 -- 172.21.15.114:0/1658019923 >> 172.21.15.114:0/1658019923 conn(0x7fac3806a130 msgr2=0x7fac3806a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:43.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.882+0000 7fac3dccd700 1 -- 172.21.15.114:0/1658019923 shutdown_connections 2023-10-18T12:19:43.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.882+0000 7fac3dccd700 1 -- 172.21.15.114:0/1658019923 wait complete. 2023-10-18T12:19:43.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.882+0000 7fac3dccd700 1 Processor -- start 2023-10-18T12:19:43.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.882+0000 7fac3dccd700 1 -- start start 2023-10-18T12:19:43.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.886+0000 7fac3dccd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac3806f9a0 0x7fac381f2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:43.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.886+0000 7fac3dccd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac380b5b80 0x7fac3815c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:43.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.886+0000 7fac3dccd700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac381467c0 0x7fac3815c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:43.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.886+0000 7fac3dccd700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3815cd50 con 0x7fac3806f9a0 2023-10-18T12:19:43.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.886+0000 7fac3dccd700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac380caea0 con 0x7fac380b5b80 2023-10-18T12:19:43.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.886+0000 7fac3dccd700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac380ac5a0 con 0x7fac381467c0 2023-10-18T12:19:43.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.886+0000 7fac377fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac3806f9a0 0x7fac381f2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:43.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.886+0000 7fac377fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac3806f9a0 0x7fac381f2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33816/0 (socket says 172.21.15.114:33816) 2023-10-18T12:19:43.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.886+0000 7fac377fe700 1 -- 172.21.15.114:0/3892401391 learned_addr learned my addr 172.21.15.114:0/3892401391 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:43.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.886+0000 7fac37fff700 1 --2- 172.21.15.114:0/3892401391 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac381467c0 0x7fac3815c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:43.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.886+0000 7fac36ffd700 1 --2- 172.21.15.114:0/3892401391 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac380b5b80 0x7fac3815c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:43.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.886+0000 7fac377fe700 1 -- 172.21.15.114:0/3892401391 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac381467c0 msgr2=0x7fac3815c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:43.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.886+0000 7fac377fe700 1 --2- 172.21.15.114:0/3892401391 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac381467c0 0x7fac3815c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:43.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.886+0000 7fac377fe700 1 -- 172.21.15.114:0/3892401391 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac380b5b80 msgr2=0x7fac3815c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:43.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.886+0000 7fac377fe700 1 --2- 172.21.15.114:0/3892401391 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac380b5b80 0x7fac3815c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:43.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.886+0000 7fac377fe700 1 -- 172.21.15.114:0/3892401391 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac2c0094b0 con 0x7fac3806f9a0 2023-10-18T12:19:43.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.886+0000 7fac36ffd700 1 --2- 172.21.15.114:0/3892401391 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac380b5b80 0x7fac3815c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:19:43.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.886+0000 7fac377fe700 1 --2- 172.21.15.114:0/3892401391 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac3806f9a0 0x7fac381f2920 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fac2800c490 tx=0x7fac2800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:43.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.886+0000 7fac1ffff700 1 -- 172.21.15.114:0/3892401391 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac280052d0 con 0x7fac3806f9a0 2023-10-18T12:19:43.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.886+0000 7fac1ffff700 1 -- 172.21.15.114:0/3892401391 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac28005450 con 0x7fac3806f9a0 2023-10-18T12:19:43.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.886+0000 7fac3dccd700 1 -- 172.21.15.114:0/3892401391 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac380ac880 con 0x7fac3806f9a0 2023-10-18T12:19:43.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.886+0000 7fac1ffff700 1 -- 172.21.15.114:0/3892401391 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac280038e0 con 0x7fac3806f9a0 2023-10-18T12:19:43.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.886+0000 7fac3dccd700 1 -- 172.21.15.114:0/3892401391 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac380cb0f0 con 0x7fac3806f9a0 2023-10-18T12:19:43.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.890+0000 7fac3dccd700 1 -- 172.21.15.114:0/3892401391 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac38072e60 con 0x7fac3806f9a0 2023-10-18T12:19:43.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.890+0000 7fac1ffff700 1 -- 172.21.15.114:0/3892401391 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fac28003a40 con 0x7fac3806f9a0 2023-10-18T12:19:43.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.890+0000 7fac1ffff700 1 --2- 172.21.15.114:0/3892401391 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fac24065720 0x7fac24067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:43.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.890+0000 7fac1ffff700 1 -- 172.21.15.114:0/3892401391 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6781+0+0 (secure 0 0 0) 0x7fac280825e0 con 0x7fac3806f9a0 2023-10-18T12:19:43.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.890+0000 7fac36ffd700 1 --2- 172.21.15.114:0/3892401391 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fac24065720 0x7fac24067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:43.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.894+0000 7fac36ffd700 1 --2- 172.21.15.114:0/3892401391 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fac24065720 0x7fac24067be0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fac2c0090b0 tx=0x7fac2c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:43.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:43.898+0000 7fac1ffff700 1 -- 172.21.15.114:0/3892401391 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fac2804fd30 con 0x7fac3806f9a0 2023-10-18T12:19:44.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.430+0000 7fac3dccd700 1 -- 172.21.15.114:0/3892401391 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fac380b7200 con 0x7fac3806f9a0 2023-10-18T12:19:44.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.642+0000 7fac1ffff700 1 -- 172.21.15.114:0/3892401391 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7fac28053350 con 0x7fac3806f9a0 2023-10-18T12:19:44.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.646+0000 7fac3dccd700 1 -- 172.21.15.114:0/3892401391 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fac24065720 msgr2=0x7fac24067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:44.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.646+0000 7fac3dccd700 1 --2- 172.21.15.114:0/3892401391 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fac24065720 0x7fac24067be0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fac2c0090b0 tx=0x7fac2c008030 comp rx=0 tx=0).stop 2023-10-18T12:19:44.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.646+0000 7fac3dccd700 1 -- 172.21.15.114:0/3892401391 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac3806f9a0 msgr2=0x7fac381f2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:44.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.646+0000 7fac3dccd700 1 --2- 172.21.15.114:0/3892401391 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac3806f9a0 0x7fac381f2920 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fac2800c490 tx=0x7fac2800c850 comp rx=0 tx=0).stop 2023-10-18T12:19:44.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.646+0000 7fac3dccd700 1 -- 172.21.15.114:0/3892401391 shutdown_connections 2023-10-18T12:19:44.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.646+0000 7fac3dccd700 1 --2- 172.21.15.114:0/3892401391 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fac24065720 0x7fac24067be0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:44.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.646+0000 7fac3dccd700 1 --2- 172.21.15.114:0/3892401391 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac381467c0 0x7fac3815c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:44.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.646+0000 7fac3dccd700 1 --2- 172.21.15.114:0/3892401391 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac380b5b80 0x7fac3815c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:44.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.646+0000 7fac3dccd700 1 --2- 172.21.15.114:0/3892401391 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac3806f9a0 0x7fac381f2920 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:44.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.646+0000 7fac3dccd700 1 -- 172.21.15.114:0/3892401391 >> 172.21.15.114:0/3892401391 conn(0x7fac3806a130 msgr2=0x7fac38145af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:44.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.646+0000 7fac3dccd700 1 -- 172.21.15.114:0/3892401391 shutdown_connections 2023-10-18T12:19:44.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.646+0000 7fac3dccd700 1 -- 172.21.15.114:0/3892401391 wait complete. 2023-10-18T12:19:44.657 INFO:teuthology.orchestra.run.smithi114.stderr:added data pool 5 to fsmap 2023-10-18T12:19:44.675 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T12:19:44.708 INFO:tasks.ceph.mds.b.smithi172.stderr:2023-10-18T12:19:44.700+0000 7f26b49b5700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-18T12:19:44.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.842+0000 7f42db756700 1 Processor -- start 2023-10-18T12:19:44.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.846+0000 7f42db756700 1 -- start start 2023-10-18T12:19:44.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.846+0000 7f42db756700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f42d40b5b80 0x7f42d406f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:44.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.846+0000 7f42db756700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f42d406fee0 0x7f42d415eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:44.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.846+0000 7f42db756700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42d415e680 con 0x7f42d4146800 2023-10-18T12:19:44.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.846+0000 7f42db756700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42d4070350 con 0x7f42d40b5b80 2023-10-18T12:19:44.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.846+0000 7f42db756700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d40b6180 con 0x7f42d406fee0 2023-10-18T12:19:44.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.850+0000 7f42d94f2700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f42d4146800 0x7f42d415dd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:59740/0 (socket says 172.21.15.114:59740) 2023-10-18T12:19:44.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.850+0000 7f42d94f2700 1 -- 172.21.15.114:0/911212254 learned_addr learned my addr 172.21.15.114:0/911212254 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:19:44.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.850+0000 7f42d8cf1700 1 --2- 172.21.15.114:0/911212254 >> v2:172.21.15.172:3300/0 conn(0x7f42d40b5b80 0x7f42d406f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:44.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.850+0000 7f42d9cf3700 1 --2- 172.21.15.114:0/911212254 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f42d406fee0 0x7f42d415eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:44.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.850+0000 7f42cbfff700 1 -- 172.21.15.114:0/911212254 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 520015474 0 0) 0x7f42d415e680 con 0x7f42d4146800 2023-10-18T12:19:44.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.850+0000 7f42cbfff700 1 -- 172.21.15.114:0/911212254 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42c00035d0 con 0x7f42d4146800 2023-10-18T12:19:44.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.850+0000 7f42d8cf1700 1 -- 172.21.15.114:0/911212254 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f42d406fee0 msgr2=0x7f42d415eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:44.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.850+0000 7f42d8cf1700 1 --2- 172.21.15.114:0/911212254 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f42d406fee0 0x7f42d415eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:44.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.850+0000 7f42d8cf1700 1 -- 172.21.15.114:0/911212254 >> v1:172.21.15.114:6789/0 conn(0x7f42d4146800 legacy=0x7f42d415dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:44.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.850+0000 7f42d8cf1700 1 -- 172.21.15.114:0/911212254 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d40b6460 con 0x7f42d40b5b80 2023-10-18T12:19:44.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.850+0000 7f42d9cf3700 1 --2- 172.21.15.114:0/911212254 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f42d406fee0 0x7f42d415eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:19:44.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.850+0000 7f42d8cf1700 1 --2- 172.21.15.114:0/911212254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42d40b5b80 0x7f42d406f9a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f42c4009850 tx=0x7f42c4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0b1420ec80d87c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:44.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.850+0000 7f42cbfff700 1 -- 172.21.15.114:0/911212254 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c4011830 con 0x7f42d40b5b80 2023-10-18T12:19:44.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.850+0000 7f42cbfff700 1 -- 172.21.15.114:0/911212254 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c4011990 con 0x7f42d40b5b80 2023-10-18T12:19:44.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.850+0000 7f42cbfff700 1 -- 172.21.15.114:0/911212254 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c4011d00 con 0x7f42d40b5b80 2023-10-18T12:19:44.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.850+0000 7f42db756700 1 -- 172.21.15.114:0/911212254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42d40b5b80 msgr2=0x7f42d406f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:44.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.850+0000 7f42db756700 1 --2- 172.21.15.114:0/911212254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42d40b5b80 0x7f42d406f9a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f42c4009850 tx=0x7f42c4009b60 comp rx=0 tx=0).stop 2023-10-18T12:19:44.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.850+0000 7f42db756700 1 -- 172.21.15.114:0/911212254 shutdown_connections 2023-10-18T12:19:44.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.850+0000 7f42db756700 1 --2- 172.21.15.114:0/911212254 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f42d406fee0 0x7f42d415eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:44.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.850+0000 7f42db756700 1 --2- 172.21.15.114:0/911212254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42d40b5b80 0x7f42d406f9a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:44.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.850+0000 7f42db756700 1 -- 172.21.15.114:0/911212254 >> 172.21.15.114:0/911212254 conn(0x7f42d406a130 msgr2=0x7f42d406a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:44.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.854+0000 7f42db756700 1 -- 172.21.15.114:0/911212254 shutdown_connections 2023-10-18T12:19:44.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.854+0000 7f42db756700 1 -- 172.21.15.114:0/911212254 wait complete. 2023-10-18T12:19:44.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.854+0000 7f42db756700 1 Processor -- start 2023-10-18T12:19:44.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.854+0000 7f42db756700 1 -- start start 2023-10-18T12:19:44.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.854+0000 7f42db756700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f42d406fee0 0x7f42d413d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:44.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.854+0000 7f42db756700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42d40b5b80 0x7f42d40ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:44.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.854+0000 7f42db756700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42d4146800 0x7f42d40abe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:44.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.854+0000 7f42db756700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d413b120 con 0x7f42d40b5b80 2023-10-18T12:19:44.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.854+0000 7f42db756700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d413f310 con 0x7f42d4146800 2023-10-18T12:19:44.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.854+0000 7f42db756700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d413f5f0 con 0x7f42d406fee0 2023-10-18T12:19:44.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.854+0000 7f42d8cf1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42d40b5b80 0x7f42d40ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:44.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.854+0000 7f42d8cf1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42d40b5b80 0x7f42d40ab8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33824/0 (socket says 172.21.15.114:33824) 2023-10-18T12:19:44.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.854+0000 7f42d8cf1700 1 -- 172.21.15.114:0/1036150565 learned_addr learned my addr 172.21.15.114:0/1036150565 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:44.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.858+0000 7f42d9cf3700 1 --2- 172.21.15.114:0/1036150565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42d4146800 0x7f42d40abe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:44.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.858+0000 7f42d94f2700 1 --2- 172.21.15.114:0/1036150565 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f42d406fee0 0x7f42d413d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:44.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.858+0000 7f42d8cf1700 1 -- 172.21.15.114:0/1036150565 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f42d406fee0 msgr2=0x7f42d413d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:44.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.858+0000 7f42d8cf1700 1 --2- 172.21.15.114:0/1036150565 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f42d406fee0 0x7f42d413d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:44.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.858+0000 7f42d8cf1700 1 -- 172.21.15.114:0/1036150565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42d4146800 msgr2=0x7f42d40abe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:44.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.858+0000 7f42d8cf1700 1 --2- 172.21.15.114:0/1036150565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42d4146800 0x7f42d40abe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:44.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.858+0000 7f42d8cf1700 1 -- 172.21.15.114:0/1036150565 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42cc009a70 con 0x7f42d40b5b80 2023-10-18T12:19:44.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.858+0000 7f42d94f2700 1 --2- 172.21.15.114:0/1036150565 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f42d406fee0 0x7f42d413d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:19:44.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.858+0000 7f42d8cf1700 1 --2- 172.21.15.114:0/1036150565 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42d40b5b80 0x7f42d40ab8e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f42c40090b0 tx=0x7f42c4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:44.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.858+0000 7f42c9ffb700 1 -- 172.21.15.114:0/1036150565 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c40045d0 con 0x7f42d40b5b80 2023-10-18T12:19:44.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.858+0000 7f42c9ffb700 1 -- 172.21.15.114:0/1036150565 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c401f070 con 0x7f42d40b5b80 2023-10-18T12:19:44.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.858+0000 7f42db756700 1 -- 172.21.15.114:0/1036150565 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42c40094b0 con 0x7f42d40b5b80 2023-10-18T12:19:44.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.858+0000 7f42c9ffb700 1 -- 172.21.15.114:0/1036150565 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c40038e0 con 0x7f42d40b5b80 2023-10-18T12:19:44.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.858+0000 7f42db756700 1 -- 172.21.15.114:0/1036150565 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d413fbb0 con 0x7f42d40b5b80 2023-10-18T12:19:44.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.858+0000 7f42db756700 1 -- 172.21.15.114:0/1036150565 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42d4072e60 con 0x7f42d40b5b80 2023-10-18T12:19:44.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.862+0000 7f42c9ffb700 1 -- 172.21.15.114:0/1036150565 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f42c4003a40 con 0x7f42d40b5b80 2023-10-18T12:19:44.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.862+0000 7f42c9ffb700 1 --2- 172.21.15.114:0/1036150565 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f42b8065720 0x7f42b8067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:44.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.862+0000 7f42c9ffb700 1 -- 172.21.15.114:0/1036150565 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f42c4021070 con 0x7f42d40b5b80 2023-10-18T12:19:44.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.862+0000 7f42d94f2700 1 --2- 172.21.15.114:0/1036150565 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f42b8065720 0x7f42b8067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:44.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.862+0000 7f42d94f2700 1 --2- 172.21.15.114:0/1036150565 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f42b8065720 0x7f42b8067be0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f42d0005930 tx=0x7f42d0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:44.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:44.866+0000 7f42c9ffb700 1 -- 172.21.15.114:0/1036150565 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f42c4052110 con 0x7f42d40b5b80 2023-10-18T12:19:45.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.090+0000 7f42db756700 1 -- 172.21.15.114:0/1036150565 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42d40b71e0 con 0x7f42d40b5b80 2023-10-18T12:19:45.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.094+0000 7f42c9ffb700 1 -- 172.21.15.114:0/1036150565 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4877 (secure 0 0 0) 0x7f42c4055730 con 0x7f42d40b5b80 2023-10-18T12:19:45.101 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:19:45.101 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1054658298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1054658298},{"type":"v1","addr":"172.21.15.172:6835","nonce":1054658298}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2715800167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2715800167},{"type":"v1","addr":"172.21.15.114:6833","nonce":2715800167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/22518579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":22518579},{"type":"v1","addr":"172.21.15.114:6835","nonce":22518579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T12:19:39.077734+0000","modified":"2023-10-18T12:19:44.632195+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4303":{"gid":4303,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3028221887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3028221887},{"type":"v1","addr":"172.21.15.172:6837","nonce":3028221887}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-10-18T12:19:45.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.094+0000 7f42db756700 1 -- 172.21.15.114:0/1036150565 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f42b8065720 msgr2=0x7f42b8067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:45.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.094+0000 7f42db756700 1 --2- 172.21.15.114:0/1036150565 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f42b8065720 0x7f42b8067be0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f42d0005930 tx=0x7f42d0009040 comp rx=0 tx=0).stop 2023-10-18T12:19:45.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.094+0000 7f42db756700 1 -- 172.21.15.114:0/1036150565 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42d40b5b80 msgr2=0x7f42d40ab8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:45.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.094+0000 7f42db756700 1 --2- 172.21.15.114:0/1036150565 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42d40b5b80 0x7f42d40ab8e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f42c40090b0 tx=0x7f42c4004770 comp rx=0 tx=0).stop 2023-10-18T12:19:45.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.094+0000 7f42db756700 1 -- 172.21.15.114:0/1036150565 shutdown_connections 2023-10-18T12:19:45.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.094+0000 7f42db756700 1 --2- 172.21.15.114:0/1036150565 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f42b8065720 0x7f42b8067be0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:45.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.094+0000 7f42db756700 1 --2- 172.21.15.114:0/1036150565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42d4146800 0x7f42d40abe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:45.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.094+0000 7f42db756700 1 --2- 172.21.15.114:0/1036150565 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42d40b5b80 0x7f42d40ab8e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:45.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.094+0000 7f42db756700 1 --2- 172.21.15.114:0/1036150565 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f42d406fee0 0x7f42d413d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:45.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.094+0000 7f42db756700 1 -- 172.21.15.114:0/1036150565 >> 172.21.15.114:0/1036150565 conn(0x7f42d406a130 msgr2=0x7f42d406a510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:45.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.098+0000 7f42db756700 1 -- 172.21.15.114:0/1036150565 shutdown_connections 2023-10-18T12:19:45.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.098+0000 7f42db756700 1 -- 172.21.15.114:0/1036150565 wait complete. 2023-10-18T12:19:45.106 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 7 2023-10-18T12:19:45.124 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T12:19:45.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.294+0000 7fb52d7c1700 1 Processor -- start 2023-10-18T12:19:45.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.294+0000 7fb52d7c1700 1 -- start start 2023-10-18T12:19:45.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.294+0000 7fb52d7c1700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb5280b5b80 0x7fb52806f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:45.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.294+0000 7fb52d7c1700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb52815e680 con 0x7fb528146800 2023-10-18T12:19:45.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.294+0000 7fb52d7c1700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb528070310 con 0x7fb52806fee0 2023-10-18T12:19:45.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.294+0000 7fb52d7c1700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5280b6180 con 0x7fb5280b5b80 2023-10-18T12:19:45.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.294+0000 7fb5267fc700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb5280b5b80 0x7fb52806f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:45.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.294+0000 7fb526ffd700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fb528146800 0x7fb52815dd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52084/0 (socket says 172.21.15.114:52084) 2023-10-18T12:19:45.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.294+0000 7fb526ffd700 1 -- 172.21.15.114:0/3773253467 learned_addr learned my addr 172.21.15.114:0/3773253467 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:19:45.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.298+0000 7fb5267fc700 1 -- 172.21.15.114:0/3773253467 >> v1:172.21.15.172:6789/0 conn(0x7fb52806fee0 legacy=0x7fb52815eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:45.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.298+0000 7fb5267fc700 1 -- 172.21.15.114:0/3773253467 >> v1:172.21.15.114:6789/0 conn(0x7fb528146800 legacy=0x7fb52815dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:45.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.298+0000 7fb5267fc700 1 -- 172.21.15.114:0/3773253467 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5280b6460 con 0x7fb5280b5b80 2023-10-18T12:19:45.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.298+0000 7fb5267fc700 1 --2- 172.21.15.114:0/3773253467 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5280b5b80 0x7fb52806f9a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb51c009850 tx=0x7fb51c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=130e7b1e6b308784 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:45.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.298+0000 7fb525ffb700 1 -- 172.21.15.114:0/3773253467 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51c011830 con 0x7fb5280b5b80 2023-10-18T12:19:45.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.298+0000 7fb525ffb700 1 -- 172.21.15.114:0/3773253467 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb51c011990 con 0x7fb5280b5b80 2023-10-18T12:19:45.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.298+0000 7fb525ffb700 1 -- 172.21.15.114:0/3773253467 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51c011d20 con 0x7fb5280b5b80 2023-10-18T12:19:45.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.298+0000 7fb52d7c1700 1 -- 172.21.15.114:0/3773253467 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5280b5b80 msgr2=0x7fb52806f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:45.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.298+0000 7fb52d7c1700 1 --2- 172.21.15.114:0/3773253467 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5280b5b80 0x7fb52806f9a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb51c009850 tx=0x7fb51c009b60 comp rx=0 tx=0).stop 2023-10-18T12:19:45.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.298+0000 7fb52d7c1700 1 -- 172.21.15.114:0/3773253467 shutdown_connections 2023-10-18T12:19:45.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.298+0000 7fb52d7c1700 1 --2- 172.21.15.114:0/3773253467 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb5280b5b80 0x7fb52806f9a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:45.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.298+0000 7fb52d7c1700 1 -- 172.21.15.114:0/3773253467 >> 172.21.15.114:0/3773253467 conn(0x7fb52806a130 msgr2=0x7fb52806a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:45.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.298+0000 7fb52d7c1700 1 -- 172.21.15.114:0/3773253467 shutdown_connections 2023-10-18T12:19:45.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.298+0000 7fb52d7c1700 1 -- 172.21.15.114:0/3773253467 wait complete. 2023-10-18T12:19:45.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.302+0000 7fb52d7c1700 1 Processor -- start 2023-10-18T12:19:45.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.302+0000 7fb52d7c1700 1 -- start start 2023-10-18T12:19:45.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.302+0000 7fb52d7c1700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb52806fee0 0x7fb5281e7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:45.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.302+0000 7fb52d7c1700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5280b5b80 0x7fb52813e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:45.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.302+0000 7fb52d7c1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb528146800 0x7fb52813e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:45.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.302+0000 7fb52d7c1700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb528141880 con 0x7fb528146800 2023-10-18T12:19:45.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.302+0000 7fb52d7c1700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb528140c70 con 0x7fb5280b5b80 2023-10-18T12:19:45.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.302+0000 7fb52d7c1700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb528140f50 con 0x7fb52806fee0 2023-10-18T12:19:45.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.302+0000 7fb5277fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb528146800 0x7fb52813e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:45.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.302+0000 7fb5267fc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5280b5b80 0x7fb52813e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:45.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.302+0000 7fb5277fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb528146800 0x7fb52813e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51240/0 (socket says 172.21.15.114:51240) 2023-10-18T12:19:45.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.302+0000 7fb5277fe700 1 -- 172.21.15.114:0/2887082666 learned_addr learned my addr 172.21.15.114:0/2887082666 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:45.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.306+0000 7fb526ffd700 1 --2- 172.21.15.114:0/2887082666 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb52806fee0 0x7fb5281e7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:45.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.306+0000 7fb5277fe700 1 -- 172.21.15.114:0/2887082666 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb52806fee0 msgr2=0x7fb5281e7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:45.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.306+0000 7fb5277fe700 1 --2- 172.21.15.114:0/2887082666 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb52806fee0 0x7fb5281e7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:45.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.306+0000 7fb5277fe700 1 -- 172.21.15.114:0/2887082666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5280b5b80 msgr2=0x7fb52813e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:45.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.306+0000 7fb5277fe700 1 --2- 172.21.15.114:0/2887082666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5280b5b80 0x7fb52813e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:45.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.306+0000 7fb5277fe700 1 -- 172.21.15.114:0/2887082666 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb51c0094b0 con 0x7fb528146800 2023-10-18T12:19:45.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.306+0000 7fb5267fc700 1 --2- 172.21.15.114:0/2887082666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5280b5b80 0x7fb52813e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:19:45.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.306+0000 7fb5277fe700 1 --2- 172.21.15.114:0/2887082666 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb528146800 0x7fb52813e790 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb52000cc50 tx=0x7fb52000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:45.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.306+0000 7fb50f7fe700 1 -- 172.21.15.114:0/2887082666 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb520003c20 con 0x7fb528146800 2023-10-18T12:19:45.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.306+0000 7fb50f7fe700 1 -- 172.21.15.114:0/2887082666 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb520003d80 con 0x7fb528146800 2023-10-18T12:19:45.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.306+0000 7fb52d7c1700 1 -- 172.21.15.114:0/2887082666 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb528141230 con 0x7fb528146800 2023-10-18T12:19:45.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.306+0000 7fb50f7fe700 1 -- 172.21.15.114:0/2887082666 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52000ab60 con 0x7fb528146800 2023-10-18T12:19:45.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.306+0000 7fb52d7c1700 1 -- 172.21.15.114:0/2887082666 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5281e8420 con 0x7fb528146800 2023-10-18T12:19:45.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.306+0000 7fb52d7c1700 1 -- 172.21.15.114:0/2887082666 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5281419f0 con 0x7fb528146800 2023-10-18T12:19:45.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.310+0000 7fb50f7fe700 1 -- 172.21.15.114:0/2887082666 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fb52000acc0 con 0x7fb528146800 2023-10-18T12:19:45.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.310+0000 7fb50f7fe700 1 --2- 172.21.15.114:0/2887082666 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb5140656f0 0x7fb514067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:45.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.310+0000 7fb50f7fe700 1 -- 172.21.15.114:0/2887082666 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb520083250 con 0x7fb528146800 2023-10-18T12:19:45.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.310+0000 7fb526ffd700 1 --2- 172.21.15.114:0/2887082666 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb5140656f0 0x7fb514067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:45.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.314+0000 7fb526ffd700 1 --2- 172.21.15.114:0/2887082666 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb5140656f0 0x7fb514067bb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb518005930 tx=0x7fb518009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:45.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.318+0000 7fb50f7fe700 1 -- 172.21.15.114:0/2887082666 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fb520050900 con 0x7fb528146800 2023-10-18T12:19:45.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.490+0000 7fb52d7c1700 1 -- 172.21.15.114:0/2887082666 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5280b6710 con 0x7fb528146800 2023-10-18T12:19:45.500 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.494+0000 7fb50f7fe700 1 -- 172.21.15.114:0/2887082666 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20144 (secure 0 0 0) 0x7fb520053f20 con 0x7fb528146800 2023-10-18T12:19:45.501 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:19:45.502 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":28,"fsid":"240ea340-5d3d-4f52-a4bc-af075aca3deb","created":"2023-10-18T12:19:12.512994+0000","modified":"2023-10-18T12:19:44.436656+0000","last_up_change":"2023-10-18T12:19:25.286009+0000","last_in_change":"2023-10-18T12:19:15.850693+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T12:19:27.040638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-18T12:19:32.358094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-18T12:19:37.333855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-18T12:19:38.055385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-18T12:19:41.679218+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c3578978-1a03-4857-b9d2-34a5da3d7731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6817","nonce":1506287862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6820","nonce":1506287862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6830","nonce":1506287862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6825","nonce":1506287862}]},"public_addr":"172.21.15.114:6817/1506287862","cluster_addr":"172.21.15.114:6820/1506287862","heartbeat_back_addr":"172.21.15.114:6830/1506287862","heartbeat_front_addr":"172.21.15.114:6825/1506287862","state":["exists","up"]},{"osd":1,"uuid":"43eb26a6-e2b3-4670-9559-bd053b5140d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6801","nonce":3302727047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6803","nonce":3302727047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6807","nonce":3302727047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6805","nonce":3302727047}]},"public_addr":"172.21.15.114:6801/3302727047","cluster_addr":"172.21.15.114:6803/3302727047","heartbeat_back_addr":"172.21.15.114:6807/3302727047","heartbeat_front_addr":"172.21.15.114:6805/3302727047","state":["exists","up"]},{"osd":2,"uuid":"f3d4dbd5-521c-4dd2-b687-5768cc7d0938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6809","nonce":2699151351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6811","nonce":2699151351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6815","nonce":2699151351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6813","nonce":2699151351}]},"public_addr":"172.21.15.114:6809/2699151351","cluster_addr":"172.21.15.114:6811/2699151351","heartbeat_back_addr":"172.21.15.114:6815/2699151351","heartbeat_front_addr":"172.21.15.114:6813/2699151351","state":["exists","up"]},{"osd":3,"uuid":"823e5802-92b7-4f0d-b32d-a5748993f1b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6821","nonce":1361608073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6824","nonce":1361608073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6829","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6831","nonce":1361608073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6827","nonce":1361608073}]},"public_addr":"172.21.15.114:6821/1361608073","cluster_addr":"172.21.15.114:6824/1361608073","heartbeat_back_addr":"172.21.15.114:6831/1361608073","heartbeat_front_addr":"172.21.15.114:6827/1361608073","state":["exists","up"]},{"osd":4,"uuid":"e47fb93e-13b4-44a4-b084-8c4384ceb41e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6801","nonce":930839681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6803","nonce":930839681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6807","nonce":930839681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6805","nonce":930839681}]},"public_addr":"172.21.15.172:6801/930839681","cluster_addr":"172.21.15.172:6803/930839681","heartbeat_back_addr":"172.21.15.172:6807/930839681","heartbeat_front_addr":"172.21.15.172:6805/930839681","state":["exists","up"]},{"osd":5,"uuid":"7561a973-f479-45a0-af40-f324728d622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6814","nonce":571761850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6818","nonce":571761850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6824","nonce":571761850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6821","nonce":571761850}]},"public_addr":"172.21.15.172:6814/571761850","cluster_addr":"172.21.15.172:6818/571761850","heartbeat_back_addr":"172.21.15.172:6824/571761850","heartbeat_front_addr":"172.21.15.172:6821/571761850","state":["exists","up"]},{"osd":6,"uuid":"51753f4b-7f06-4f1c-9ec7-6e18a66eb980","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6825","nonce":1680398853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6827","nonce":1680398853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6831","nonce":1680398853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6829","nonce":1680398853}]},"public_addr":"172.21.15.172:6825/1680398853","cluster_addr":"172.21.15.172:6827/1680398853","heartbeat_back_addr":"172.21.15.172:6831/1680398853","heartbeat_front_addr":"172.21.15.172:6829/1680398853","state":["exists","up"]},{"osd":7,"uuid":"4d8b1e15-143d-4d17-9074-59d92f0f9af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6809","nonce":349710101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6811","nonce":349710101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6819","nonce":349710101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6815","nonce":349710101}]},"public_addr":"172.21.15.172:6809/349710101","cluster_addr":"172.21.15.172:6811/349710101","heartbeat_back_addr":"172.21.15.172:6819/349710101","heartbeat_front_addr":"172.21.15.172:6815/349710101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.889460+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.475494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.911473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.648596+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.609994+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.636248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.854589+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.885826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T12:19:45.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.498+0000 7fb52d7c1700 1 -- 172.21.15.114:0/2887082666 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb5140656f0 msgr2=0x7fb514067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:45.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.498+0000 7fb52d7c1700 1 --2- 172.21.15.114:0/2887082666 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb5140656f0 0x7fb514067bb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb518005930 tx=0x7fb518009040 comp rx=0 tx=0).stop 2023-10-18T12:19:45.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.498+0000 7fb52d7c1700 1 -- 172.21.15.114:0/2887082666 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb528146800 msgr2=0x7fb52813e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:45.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.498+0000 7fb52d7c1700 1 --2- 172.21.15.114:0/2887082666 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb528146800 0x7fb52813e790 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb52000cc50 tx=0x7fb52000cf60 comp rx=0 tx=0).stop 2023-10-18T12:19:45.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.498+0000 7fb52d7c1700 1 -- 172.21.15.114:0/2887082666 shutdown_connections 2023-10-18T12:19:45.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.498+0000 7fb52d7c1700 1 --2- 172.21.15.114:0/2887082666 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb5140656f0 0x7fb514067bb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:45.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.498+0000 7fb52d7c1700 1 --2- 172.21.15.114:0/2887082666 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb528146800 0x7fb52813e790 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:45.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.498+0000 7fb52d7c1700 1 --2- 172.21.15.114:0/2887082666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb5280b5b80 0x7fb52813e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:45.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.498+0000 7fb52d7c1700 1 --2- 172.21.15.114:0/2887082666 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb52806fee0 0x7fb5281e7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:45.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.498+0000 7fb52d7c1700 1 -- 172.21.15.114:0/2887082666 >> 172.21.15.114:0/2887082666 conn(0x7fb52806a130 msgr2=0x7fb52815f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:45.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.498+0000 7fb52d7c1700 1 -- 172.21.15.114:0/2887082666 shutdown_connections 2023-10-18T12:19:45.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.498+0000 7fb52d7c1700 1 -- 172.21.15.114:0/2887082666 wait complete. 2023-10-18T12:19:45.530 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T12:19:45.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.698+0000 7fd2f4a3d700 1 Processor -- start 2023-10-18T12:19:45.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.698+0000 7fd2f4a3d700 1 -- start start 2023-10-18T12:19:45.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.698+0000 7fd2f4a3d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd2f006d090 0x7fd2f00b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:45.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.698+0000 7fd2f4a3d700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd2f006d470 0x7fd2f0070a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:45.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.698+0000 7fd2f4a3d700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2f015e990 con 0x7fd2f0070f50 2023-10-18T12:19:45.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.698+0000 7fd2f4a3d700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2f015f4f0 con 0x7fd2f006d090 2023-10-18T12:19:45.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.698+0000 7fd2f4a3d700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2f015ec50 con 0x7fd2f006d470 2023-10-18T12:19:45.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.698+0000 7fd2ef59e700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd2f0070f50 0x7fd2f015a410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52090/0 (socket says 172.21.15.114:52090) 2023-10-18T12:19:45.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.698+0000 7fd2ef59e700 1 -- 172.21.15.114:0/746712535 learned_addr learned my addr 172.21.15.114:0/746712535 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:19:45.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.698+0000 7fd2eed9d700 1 --2- 172.21.15.114:0/746712535 >> v2:172.21.15.114:3300/0 conn(0x7fd2f006d090 0x7fd2f00b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:45.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.698+0000 7fd2ee59c700 1 --2- 172.21.15.114:0/746712535 >> v2:172.21.15.172:3300/0 conn(0x7fd2f006d470 0x7fd2f0070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:45.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.698+0000 7fd2edd9b700 1 -- 172.21.15.114:0/746712535 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1373579499 0 0) 0x7fd2f015e990 con 0x7fd2f0070f50 2023-10-18T12:19:45.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.702+0000 7fd2edd9b700 1 -- 172.21.15.114:0/746712535 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2d80035d0 con 0x7fd2f0070f50 2023-10-18T12:19:45.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.702+0000 7fd2eed9d700 1 -- 172.21.15.114:0/746712535 >> v2:172.21.15.172:3300/0 conn(0x7fd2f006d470 msgr2=0x7fd2f0070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:45.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.702+0000 7fd2eed9d700 1 --2- 172.21.15.114:0/746712535 >> v2:172.21.15.172:3300/0 conn(0x7fd2f006d470 0x7fd2f0070a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:45.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.702+0000 7fd2eed9d700 1 -- 172.21.15.114:0/746712535 >> v1:172.21.15.114:6789/0 conn(0x7fd2f0070f50 legacy=0x7fd2f015a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:45.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.702+0000 7fd2eed9d700 1 -- 172.21.15.114:0/746712535 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f015ef30 con 0x7fd2f006d090 2023-10-18T12:19:45.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.702+0000 7fd2eed9d700 1 --2- 172.21.15.114:0/746712535 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2f006d090 0x7fd2f00b2590 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd2f00b2100 tx=0x7fd2e0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e36e1b8495ec7d39 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:45.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.702+0000 7fd2edd9b700 1 -- 172.21.15.114:0/746712535 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e0011830 con 0x7fd2f006d090 2023-10-18T12:19:45.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.702+0000 7fd2edd9b700 1 -- 172.21.15.114:0/746712535 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e0011990 con 0x7fd2f006d090 2023-10-18T12:19:45.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.702+0000 7fd2edd9b700 1 -- 172.21.15.114:0/746712535 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e0011d20 con 0x7fd2f006d090 2023-10-18T12:19:45.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.702+0000 7fd2f4a3d700 1 -- 172.21.15.114:0/746712535 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2f006d090 msgr2=0x7fd2f00b2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:45.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.702+0000 7fd2f4a3d700 1 --2- 172.21.15.114:0/746712535 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2f006d090 0x7fd2f00b2590 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd2f00b2100 tx=0x7fd2e0009b30 comp rx=0 tx=0).stop 2023-10-18T12:19:45.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.702+0000 7fd2f4a3d700 1 -- 172.21.15.114:0/746712535 shutdown_connections 2023-10-18T12:19:45.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.702+0000 7fd2f4a3d700 1 --2- 172.21.15.114:0/746712535 >> v2:172.21.15.172:3300/0 conn(0x7fd2f006d470 0x7fd2f0070a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:45.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.702+0000 7fd2f4a3d700 1 --2- 172.21.15.114:0/746712535 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2f006d090 0x7fd2f00b2590 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:45.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.702+0000 7fd2f4a3d700 1 -- 172.21.15.114:0/746712535 >> 172.21.15.114:0/746712535 conn(0x7fd2f00ce5c0 msgr2=0x7fd2f00ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:45.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.702+0000 7fd2f4a3d700 1 -- 172.21.15.114:0/746712535 shutdown_connections 2023-10-18T12:19:45.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.702+0000 7fd2f4a3d700 1 -- 172.21.15.114:0/746712535 wait complete. 2023-10-18T12:19:45.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.706+0000 7fd2f4a3d700 1 Processor -- start 2023-10-18T12:19:45.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.706+0000 7fd2f4a3d700 1 -- start start 2023-10-18T12:19:45.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.706+0000 7fd2f4a3d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2f006d090 0x7fd2f01599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:45.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.710+0000 7fd2f4a3d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd2f006d470 0x7fd2f015b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:45.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.710+0000 7fd2f4a3d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f0070f50 0x7fd2f00c44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:45.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.710+0000 7fd2f4a3d700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f0159f10 con 0x7fd2f006d090 2023-10-18T12:19:45.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.710+0000 7fd2f4a3d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f015d7e0 con 0x7fd2f0070f50 2023-10-18T12:19:45.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.710+0000 7fd2f4a3d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f00cce40 con 0x7fd2f006d470 2023-10-18T12:19:45.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.710+0000 7fd2eed9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2f006d090 0x7fd2f01599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:45.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.710+0000 7fd2eed9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2f006d090 0x7fd2f01599d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51250/0 (socket says 172.21.15.114:51250) 2023-10-18T12:19:45.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.710+0000 7fd2eed9d700 1 -- 172.21.15.114:0/181536214 learned_addr learned my addr 172.21.15.114:0/181536214 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:45.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.710+0000 7fd2eed9d700 1 -- 172.21.15.114:0/181536214 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd2f006d470 msgr2=0x7fd2f015b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:45.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.710+0000 7fd2eed9d700 1 --2- 172.21.15.114:0/181536214 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd2f006d470 0x7fd2f015b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:45.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.710+0000 7fd2eed9d700 1 -- 172.21.15.114:0/181536214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f0070f50 msgr2=0x7fd2f00c44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:45.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.710+0000 7fd2eed9d700 1 --2- 172.21.15.114:0/181536214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f0070f50 0x7fd2f00c44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:45.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.710+0000 7fd2eed9d700 1 -- 172.21.15.114:0/181536214 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e00094b0 con 0x7fd2f006d090 2023-10-18T12:19:45.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.710+0000 7fd2eed9d700 1 --2- 172.21.15.114:0/181536214 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2f006d090 0x7fd2f01599d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd2e00090b0 tx=0x7fd2e0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:45.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.710+0000 7fd2d77fe700 1 -- 172.21.15.114:0/181536214 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e0004610 con 0x7fd2f006d090 2023-10-18T12:19:45.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.710+0000 7fd2d77fe700 1 -- 172.21.15.114:0/181536214 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e001f070 con 0x7fd2f006d090 2023-10-18T12:19:45.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.710+0000 7fd2f4a3d700 1 -- 172.21.15.114:0/181536214 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2f00cc230 con 0x7fd2f006d090 2023-10-18T12:19:45.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.710+0000 7fd2d77fe700 1 -- 172.21.15.114:0/181536214 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e00038e0 con 0x7fd2f006d090 2023-10-18T12:19:45.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.710+0000 7fd2f4a3d700 1 -- 172.21.15.114:0/181536214 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2f00cc7f0 con 0x7fd2f006d090 2023-10-18T12:19:45.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.710+0000 7fd2f4a3d700 1 -- 172.21.15.114:0/181536214 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2f0072e60 con 0x7fd2f006d090 2023-10-18T12:19:45.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.710+0000 7fd2d77fe700 1 -- 172.21.15.114:0/181536214 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fd2e0003a40 con 0x7fd2f006d090 2023-10-18T12:19:45.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.714+0000 7fd2d77fe700 1 --2- 172.21.15.114:0/181536214 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd2dc0656f0 0x7fd2dc067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:45.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.714+0000 7fd2d77fe700 1 -- 172.21.15.114:0/181536214 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd2e0021070 con 0x7fd2f006d090 2023-10-18T12:19:45.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.714+0000 7fd2ee59c700 1 --2- 172.21.15.114:0/181536214 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd2dc0656f0 0x7fd2dc067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:45.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.714+0000 7fd2ee59c700 1 --2- 172.21.15.114:0/181536214 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd2dc0656f0 0x7fd2dc067bb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd2f00c51e0 tx=0x7fd2e4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:45.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.718+0000 7fd2d77fe700 1 -- 172.21.15.114:0/181536214 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fd2e0052120 con 0x7fd2f006d090 2023-10-18T12:19:45.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.902+0000 7fd2f4a3d700 1 -- 172.21.15.114:0/181536214 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2f00b2620 con 0x7fd2f006d090 2023-10-18T12:19:45.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.906+0000 7fd2d77fe700 1 -- 172.21.15.114:0/181536214 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20144 (secure 0 0 0) 0x7fd2e0072ec0 con 0x7fd2f006d090 2023-10-18T12:19:45.913 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:19:45.913 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":28,"fsid":"240ea340-5d3d-4f52-a4bc-af075aca3deb","created":"2023-10-18T12:19:12.512994+0000","modified":"2023-10-18T12:19:44.436656+0000","last_up_change":"2023-10-18T12:19:25.286009+0000","last_in_change":"2023-10-18T12:19:15.850693+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T12:19:27.040638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-18T12:19:32.358094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-18T12:19:37.333855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-18T12:19:38.055385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-18T12:19:41.679218+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c3578978-1a03-4857-b9d2-34a5da3d7731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6817","nonce":1506287862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6820","nonce":1506287862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6830","nonce":1506287862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6825","nonce":1506287862}]},"public_addr":"172.21.15.114:6817/1506287862","cluster_addr":"172.21.15.114:6820/1506287862","heartbeat_back_addr":"172.21.15.114:6830/1506287862","heartbeat_front_addr":"172.21.15.114:6825/1506287862","state":["exists","up"]},{"osd":1,"uuid":"43eb26a6-e2b3-4670-9559-bd053b5140d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6801","nonce":3302727047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6803","nonce":3302727047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6807","nonce":3302727047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6805","nonce":3302727047}]},"public_addr":"172.21.15.114:6801/3302727047","cluster_addr":"172.21.15.114:6803/3302727047","heartbeat_back_addr":"172.21.15.114:6807/3302727047","heartbeat_front_addr":"172.21.15.114:6805/3302727047","state":["exists","up"]},{"osd":2,"uuid":"f3d4dbd5-521c-4dd2-b687-5768cc7d0938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6809","nonce":2699151351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6811","nonce":2699151351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6815","nonce":2699151351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6813","nonce":2699151351}]},"public_addr":"172.21.15.114:6809/2699151351","cluster_addr":"172.21.15.114:6811/2699151351","heartbeat_back_addr":"172.21.15.114:6815/2699151351","heartbeat_front_addr":"172.21.15.114:6813/2699151351","state":["exists","up"]},{"osd":3,"uuid":"823e5802-92b7-4f0d-b32d-a5748993f1b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6821","nonce":1361608073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6824","nonce":1361608073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6829","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6831","nonce":1361608073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6827","nonce":1361608073}]},"public_addr":"172.21.15.114:6821/1361608073","cluster_addr":"172.21.15.114:6824/1361608073","heartbeat_back_addr":"172.21.15.114:6831/1361608073","heartbeat_front_addr":"172.21.15.114:6827/1361608073","state":["exists","up"]},{"osd":4,"uuid":"e47fb93e-13b4-44a4-b084-8c4384ceb41e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6801","nonce":930839681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6803","nonce":930839681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6807","nonce":930839681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6805","nonce":930839681}]},"public_addr":"172.21.15.172:6801/930839681","cluster_addr":"172.21.15.172:6803/930839681","heartbeat_back_addr":"172.21.15.172:6807/930839681","heartbeat_front_addr":"172.21.15.172:6805/930839681","state":["exists","up"]},{"osd":5,"uuid":"7561a973-f479-45a0-af40-f324728d622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6814","nonce":571761850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6818","nonce":571761850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6824","nonce":571761850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6821","nonce":571761850}]},"public_addr":"172.21.15.172:6814/571761850","cluster_addr":"172.21.15.172:6818/571761850","heartbeat_back_addr":"172.21.15.172:6824/571761850","heartbeat_front_addr":"172.21.15.172:6821/571761850","state":["exists","up"]},{"osd":6,"uuid":"51753f4b-7f06-4f1c-9ec7-6e18a66eb980","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6825","nonce":1680398853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6827","nonce":1680398853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6831","nonce":1680398853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6829","nonce":1680398853}]},"public_addr":"172.21.15.172:6825/1680398853","cluster_addr":"172.21.15.172:6827/1680398853","heartbeat_back_addr":"172.21.15.172:6831/1680398853","heartbeat_front_addr":"172.21.15.172:6829/1680398853","state":["exists","up"]},{"osd":7,"uuid":"4d8b1e15-143d-4d17-9074-59d92f0f9af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6809","nonce":349710101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6811","nonce":349710101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6819","nonce":349710101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6815","nonce":349710101}]},"public_addr":"172.21.15.172:6809/349710101","cluster_addr":"172.21.15.172:6811/349710101","heartbeat_back_addr":"172.21.15.172:6819/349710101","heartbeat_front_addr":"172.21.15.172:6815/349710101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.889460+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.475494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.911473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.648596+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.609994+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.636248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.854589+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.885826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T12:19:45.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.906+0000 7fd2f4a3d700 1 -- 172.21.15.114:0/181536214 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd2dc0656f0 msgr2=0x7fd2dc067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:45.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.906+0000 7fd2f4a3d700 1 --2- 172.21.15.114:0/181536214 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd2dc0656f0 0x7fd2dc067bb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd2f00c51e0 tx=0x7fd2e4008040 comp rx=0 tx=0).stop 2023-10-18T12:19:45.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.906+0000 7fd2f4a3d700 1 -- 172.21.15.114:0/181536214 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2f006d090 msgr2=0x7fd2f01599d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:45.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.906+0000 7fd2f4a3d700 1 --2- 172.21.15.114:0/181536214 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2f006d090 0x7fd2f01599d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd2e00090b0 tx=0x7fd2e0004770 comp rx=0 tx=0).stop 2023-10-18T12:19:45.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.906+0000 7fd2f4a3d700 1 -- 172.21.15.114:0/181536214 shutdown_connections 2023-10-18T12:19:45.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.906+0000 7fd2f4a3d700 1 --2- 172.21.15.114:0/181536214 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd2dc0656f0 0x7fd2dc067bb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:45.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.906+0000 7fd2f4a3d700 1 --2- 172.21.15.114:0/181536214 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd2f006d470 0x7fd2f015b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:45.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.906+0000 7fd2f4a3d700 1 --2- 172.21.15.114:0/181536214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f0070f50 0x7fd2f00c44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:45.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.906+0000 7fd2f4a3d700 1 --2- 172.21.15.114:0/181536214 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2f006d090 0x7fd2f01599d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:45.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.906+0000 7fd2f4a3d700 1 -- 172.21.15.114:0/181536214 >> 172.21.15.114:0/181536214 conn(0x7fd2f00ce5c0 msgr2=0x7fd2f00ca530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:45.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.906+0000 7fd2f4a3d700 1 -- 172.21.15.114:0/181536214 shutdown_connections 2023-10-18T12:19:45.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:45.910+0000 7fd2f4a3d700 1 -- 172.21.15.114:0/181536214 wait complete. 2023-10-18T12:19:45.951 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T12:19:46.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.118+0000 7f0224fbb700 1 Processor -- start 2023-10-18T12:19:46.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.118+0000 7f0224fbb700 1 -- start start 2023-10-18T12:19:46.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.122+0000 7f0224fbb700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f022006d090 0x7f02200b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:46.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.122+0000 7f0224fbb700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f022015a410 0x7f022015a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:46.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.122+0000 7f0224fbb700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0220071120 con 0x7f022006d470 2023-10-18T12:19:46.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.122+0000 7f0224fbb700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f022015f4f0 con 0x7f022015a410 2023-10-18T12:19:46.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.122+0000 7f0224fbb700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f022015e990 con 0x7f022006d090 2023-10-18T12:19:46.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.122+0000 7f021ffff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f022015a410 0x7f022015a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:46.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.122+0000 7f021ffff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f022015a410 0x7f022015a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51258/0 (socket says 172.21.15.114:51258) 2023-10-18T12:19:46.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.122+0000 7f021ffff700 1 -- 172.21.15.114:0/3820845405 learned_addr learned my addr 172.21.15.114:0/3820845405 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:46.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.122+0000 7f021f7fe700 1 --2- 172.21.15.114:0/3820845405 >> v2:172.21.15.172:3300/0 conn(0x7f022006d090 0x7f02200b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:46.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.122+0000 7f021ffff700 1 -- 172.21.15.114:0/3820845405 >> v2:172.21.15.172:3300/0 conn(0x7f022006d090 msgr2=0x7f02200b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:46.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.122+0000 7f021ffff700 1 --2- 172.21.15.114:0/3820845405 >> v2:172.21.15.172:3300/0 conn(0x7f022006d090 0x7f02200b2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:46.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.122+0000 7f021ffff700 1 -- 172.21.15.114:0/3820845405 >> v1:172.21.15.172:6789/0 conn(0x7f022006d470 legacy=0x7f0220070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:46.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.122+0000 7f021ffff700 1 -- 172.21.15.114:0/3820845405 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f022015ec50 con 0x7f022015a410 2023-10-18T12:19:46.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.122+0000 7f021f7fe700 1 --2- 172.21.15.114:0/3820845405 >> v2:172.21.15.172:3300/0 conn(0x7f022006d090 0x7f02200b2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:19:46.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.122+0000 7f021ffff700 1 --2- 172.21.15.114:0/3820845405 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f022015a410 0x7f022015a8c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f02200cf440 tx=0x7f0218009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc09d602035e445c server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:46.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.122+0000 7f021effd700 1 -- 172.21.15.114:0/3820845405 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021800b8a0 con 0x7f022015a410 2023-10-18T12:19:46.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.122+0000 7f021effd700 1 -- 172.21.15.114:0/3820845405 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021800ba00 con 0x7f022015a410 2023-10-18T12:19:46.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.122+0000 7f021effd700 1 -- 172.21.15.114:0/3820845405 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021800bd90 con 0x7f022015a410 2023-10-18T12:19:46.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.126+0000 7f0224fbb700 1 -- 172.21.15.114:0/3820845405 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f022015a410 msgr2=0x7f022015a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:46.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.126+0000 7f0224fbb700 1 --2- 172.21.15.114:0/3820845405 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f022015a410 0x7f022015a8c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f02200cf440 tx=0x7f0218009bf0 comp rx=0 tx=0).stop 2023-10-18T12:19:46.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.126+0000 7f0224fbb700 1 -- 172.21.15.114:0/3820845405 shutdown_connections 2023-10-18T12:19:46.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.126+0000 7f0224fbb700 1 --2- 172.21.15.114:0/3820845405 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f022015a410 0x7f022015a8c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:46.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.126+0000 7f0224fbb700 1 --2- 172.21.15.114:0/3820845405 >> v2:172.21.15.172:3300/0 conn(0x7f022006d090 0x7f02200b2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:46.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.126+0000 7f0224fbb700 1 -- 172.21.15.114:0/3820845405 >> 172.21.15.114:0/3820845405 conn(0x7f02200ce5c0 msgr2=0x7f02200ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:46.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.126+0000 7f0224fbb700 1 -- 172.21.15.114:0/3820845405 shutdown_connections 2023-10-18T12:19:46.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.126+0000 7f0224fbb700 1 -- 172.21.15.114:0/3820845405 wait complete. 2023-10-18T12:19:46.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.126+0000 7f0224fbb700 1 Processor -- start 2023-10-18T12:19:46.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.126+0000 7f0224fbb700 1 -- start start 2023-10-18T12:19:46.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.130+0000 7f0224fbb700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f022006d090 0x7f02200cda00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:46.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.130+0000 7f0224fbb700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f022006d470 0x7f02200c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:46.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.130+0000 7f0224fbb700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f022015a410 0x7f02200c36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:46.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.130+0000 7f0224fbb700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02201544f0 con 0x7f022006d090 2023-10-18T12:19:46.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.130+0000 7f0224fbb700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02200cdf40 con 0x7f022015a410 2023-10-18T12:19:46.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.130+0000 7f0224fbb700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02200c4be0 con 0x7f022006d470 2023-10-18T12:19:46.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.130+0000 7f021f7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f022006d090 0x7f02200cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:46.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.130+0000 7f021f7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f022006d090 0x7f02200cda00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51264/0 (socket says 172.21.15.114:51264) 2023-10-18T12:19:46.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.130+0000 7f021f7fe700 1 -- 172.21.15.114:0/1867799481 learned_addr learned my addr 172.21.15.114:0/1867799481 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:46.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.130+0000 7f021ffff700 1 --2- 172.21.15.114:0/1867799481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f022015a410 0x7f02200c36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:46.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.130+0000 7f0216ffd700 1 --2- 172.21.15.114:0/1867799481 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f022006d470 0x7f02200c46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:46.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.130+0000 7f021f7fe700 1 -- 172.21.15.114:0/1867799481 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f022006d470 msgr2=0x7f02200c46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:46.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.130+0000 7f021f7fe700 1 --2- 172.21.15.114:0/1867799481 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f022006d470 0x7f02200c46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:46.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.130+0000 7f021f7fe700 1 -- 172.21.15.114:0/1867799481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f022015a410 msgr2=0x7f02200c36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:46.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.130+0000 7f021f7fe700 1 --2- 172.21.15.114:0/1867799481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f022015a410 0x7f02200c36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:46.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.130+0000 7f021f7fe700 1 -- 172.21.15.114:0/1867799481 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0218009570 con 0x7f022006d090 2023-10-18T12:19:46.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.130+0000 7f021ffff700 1 --2- 172.21.15.114:0/1867799481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f022015a410 0x7f02200c36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:19:46.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.130+0000 7f021f7fe700 1 --2- 172.21.15.114:0/1867799481 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f022006d090 0x7f02200cda00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0210007ef0 tx=0x7f021000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:46.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.130+0000 7f021cff9700 1 -- 172.21.15.114:0/1867799481 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021000de60 con 0x7f022006d090 2023-10-18T12:19:46.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.130+0000 7f021cff9700 1 -- 172.21.15.114:0/1867799481 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021000f040 con 0x7f022006d090 2023-10-18T12:19:46.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.130+0000 7f021cff9700 1 -- 172.21.15.114:0/1867799481 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0210003c60 con 0x7f022006d090 2023-10-18T12:19:46.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.130+0000 7f0224fbb700 1 -- 172.21.15.114:0/1867799481 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02200c7d00 con 0x7f022006d090 2023-10-18T12:19:46.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.130+0000 7f0224fbb700 1 -- 172.21.15.114:0/1867799481 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02200ccf20 con 0x7f022006d090 2023-10-18T12:19:46.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.134+0000 7f0224fbb700 1 -- 172.21.15.114:0/1867799481 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0220072e60 con 0x7f022006d090 2023-10-18T12:19:46.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.134+0000 7f021cff9700 1 -- 172.21.15.114:0/1867799481 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f0210004030 con 0x7f022006d090 2023-10-18T12:19:46.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.134+0000 7f021cff9700 1 --2- 172.21.15.114:0/1867799481 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0200065720 0x7f0200067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:46.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.134+0000 7f021cff9700 1 -- 172.21.15.114:0/1867799481 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0210083040 con 0x7f022006d090 2023-10-18T12:19:46.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.134+0000 7f0216ffd700 1 --2- 172.21.15.114:0/1867799481 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0200065720 0x7f0200067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:46.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.138+0000 7f0216ffd700 1 --2- 172.21.15.114:0/1867799481 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0200065720 0x7f0200067be0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f02201f5c40 tx=0x7f0208009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:46.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.142+0000 7f021cff9700 1 -- 172.21.15.114:0/1867799481 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f02100543e0 con 0x7f022006d090 2023-10-18T12:19:46.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.370+0000 7f0224fbb700 1 -- 172.21.15.114:0/1867799481 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f022006e030 con 0x7f022006d090 2023-10-18T12:19:46.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.370+0000 7f021cff9700 1 -- 172.21.15.114:0/1867799481 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4877 (secure 0 0 0) 0x7f0210053f70 con 0x7f022006d090 2023-10-18T12:19:46.377 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:19:46.377 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1054658298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1054658298},{"type":"v1","addr":"172.21.15.172:6835","nonce":1054658298}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2715800167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2715800167},{"type":"v1","addr":"172.21.15.114:6833","nonce":2715800167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/22518579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":22518579},{"type":"v1","addr":"172.21.15.114:6835","nonce":22518579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T12:19:39.077734+0000","modified":"2023-10-18T12:19:44.632195+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4303":{"gid":4303,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3028221887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3028221887},{"type":"v1","addr":"172.21.15.172:6837","nonce":3028221887}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-10-18T12:19:46.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.374+0000 7f0224fbb700 1 -- 172.21.15.114:0/1867799481 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0200065720 msgr2=0x7f0200067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:46.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.374+0000 7f0224fbb700 1 --2- 172.21.15.114:0/1867799481 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0200065720 0x7f0200067be0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f02201f5c40 tx=0x7f0208009040 comp rx=0 tx=0).stop 2023-10-18T12:19:46.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.374+0000 7f0224fbb700 1 -- 172.21.15.114:0/1867799481 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f022006d090 msgr2=0x7f02200cda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:46.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.374+0000 7f0224fbb700 1 --2- 172.21.15.114:0/1867799481 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f022006d090 0x7f02200cda00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0210007ef0 tx=0x7f021000d3b0 comp rx=0 tx=0).stop 2023-10-18T12:19:46.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.374+0000 7f0224fbb700 1 -- 172.21.15.114:0/1867799481 shutdown_connections 2023-10-18T12:19:46.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.374+0000 7f0224fbb700 1 --2- 172.21.15.114:0/1867799481 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0200065720 0x7f0200067be0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:46.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.374+0000 7f0224fbb700 1 --2- 172.21.15.114:0/1867799481 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f022006d470 0x7f02200c46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:46.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.374+0000 7f0224fbb700 1 --2- 172.21.15.114:0/1867799481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f022015a410 0x7f02200c36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:46.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.374+0000 7f0224fbb700 1 --2- 172.21.15.114:0/1867799481 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f022006d090 0x7f02200cda00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:46.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.374+0000 7f0224fbb700 1 -- 172.21.15.114:0/1867799481 >> 172.21.15.114:0/1867799481 conn(0x7f02200ce5c0 msgr2=0x7f02200c9690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:46.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.374+0000 7f0224fbb700 1 -- 172.21.15.114:0/1867799481 shutdown_connections 2023-10-18T12:19:46.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.374+0000 7f0224fbb700 1 -- 172.21.15.114:0/1867799481 wait complete. 2023-10-18T12:19:46.383 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 7 2023-10-18T12:19:46.399 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T12:19:46.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.566+0000 7f8c8b637700 1 Processor -- start 2023-10-18T12:19:46.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.566+0000 7f8c8b637700 1 -- start start 2023-10-18T12:19:46.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.570+0000 7f8c8b637700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c8415bf00 0x7f8c840cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:46.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.570+0000 7f8c8b637700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8c840b0f90 0x7f8c840ce150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:46.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.570+0000 7f8c8b637700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c840cbc80 con 0x7f8c84155420 2023-10-18T12:19:46.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.570+0000 7f8c8b637700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c84155800 con 0x7f8c840b0f90 2023-10-18T12:19:46.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.570+0000 7f8c8b637700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c840cb9a0 con 0x7f8c8415bf00 2023-10-18T12:19:46.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.570+0000 7f8c88bd2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c8415bf00 0x7f8c840cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:46.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.570+0000 7f8c88bd2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c8415bf00 0x7f8c840cdc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.114:60616/0 (socket says 172.21.15.114:60616) 2023-10-18T12:19:46.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.570+0000 7f8c88bd2700 1 -- 172.21.15.114:0/252869918 learned_addr learned my addr 172.21.15.114:0/252869918 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:46.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.570+0000 7f8c893d3700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f8c84155420 0x7f8c840cb150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.114:45040/0 (socket says 172.21.15.114:45040) 2023-10-18T12:19:46.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.570+0000 7f8c89bd4700 1 --2- 172.21.15.114:0/252869918 >> v2:172.21.15.172:3300/0 conn(0x7f8c840b0f90 0x7f8c840ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:46.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.570+0000 7f8c88bd2700 1 -- 172.21.15.114:0/252869918 >> v2:172.21.15.172:3300/0 conn(0x7f8c840b0f90 msgr2=0x7f8c840ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:46.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.570+0000 7f8c7bfff700 1 -- 172.21.15.114:0/252869918 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2497466553 0 0) 0x7f8c840cbc80 con 0x7f8c84155420 2023-10-18T12:19:46.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.570+0000 7f8c88bd2700 1 --2- 172.21.15.114:0/252869918 >> v2:172.21.15.172:3300/0 conn(0x7f8c840b0f90 0x7f8c840ce150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:46.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.570+0000 7f8c88bd2700 1 -- 172.21.15.114:0/252869918 >> v1:172.21.15.172:6789/0 conn(0x7f8c84155420 legacy=0x7f8c840cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:46.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.570+0000 7f8c88bd2700 1 -- 172.21.15.114:0/252869918 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c8415b420 con 0x7f8c8415bf00 2023-10-18T12:19:46.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.574+0000 7f8c88bd2700 1 --2- 172.21.15.114:0/252869918 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c8415bf00 0x7f8c840cdc10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8c74009910 tx=0x7f8c74009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=226841e94bddeef1 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:46.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.574+0000 7f8c7bfff700 1 -- 172.21.15.114:0/252869918 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c74011830 con 0x7f8c8415bf00 2023-10-18T12:19:46.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.574+0000 7f8c7bfff700 1 -- 172.21.15.114:0/252869918 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c74011990 con 0x7f8c8415bf00 2023-10-18T12:19:46.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.574+0000 7f8c7bfff700 1 -- 172.21.15.114:0/252869918 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c74011d40 con 0x7f8c8415bf00 2023-10-18T12:19:46.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.574+0000 7f8c8b637700 1 -- 172.21.15.114:0/252869918 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c8415bf00 msgr2=0x7f8c840cdc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:46.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.574+0000 7f8c8b637700 1 --2- 172.21.15.114:0/252869918 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c8415bf00 0x7f8c840cdc10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8c74009910 tx=0x7f8c74009c20 comp rx=0 tx=0).stop 2023-10-18T12:19:46.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.574+0000 7f8c8b637700 1 -- 172.21.15.114:0/252869918 shutdown_connections 2023-10-18T12:19:46.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.574+0000 7f8c8b637700 1 --2- 172.21.15.114:0/252869918 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c8415bf00 0x7f8c840cdc10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:46.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.574+0000 7f8c8b637700 1 --2- 172.21.15.114:0/252869918 >> v2:172.21.15.172:3300/0 conn(0x7f8c840b0f90 0x7f8c840ce150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:46.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.574+0000 7f8c8b637700 1 -- 172.21.15.114:0/252869918 >> 172.21.15.114:0/252869918 conn(0x7f8c8406a340 msgr2=0x7f8c840b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:46.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.574+0000 7f8c8b637700 1 -- 172.21.15.114:0/252869918 shutdown_connections 2023-10-18T12:19:46.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.574+0000 7f8c8b637700 1 -- 172.21.15.114:0/252869918 wait complete. 2023-10-18T12:19:46.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.578+0000 7f8c8b637700 1 Processor -- start 2023-10-18T12:19:46.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.578+0000 7f8c8b637700 1 -- start start 2023-10-18T12:19:46.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.578+0000 7f8c8b637700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c840b0f90 0x7f8c841e6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:46.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.578+0000 7f8c8b637700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c84155420 0x7f8c841e6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:46.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.578+0000 7f8c8b637700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c8415bf00 0x7f8c840ae740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:46.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.578+0000 7f8c8b637700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c841f3ae0 con 0x7f8c840b0f90 2023-10-18T12:19:46.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.578+0000 7f8c8b637700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c841e5bb0 con 0x7f8c8415bf00 2023-10-18T12:19:46.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.578+0000 7f8c8b637700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c840af320 con 0x7f8c84155420 2023-10-18T12:19:46.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.578+0000 7f8c893d3700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c840b0f90 0x7f8c841e6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:46.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.578+0000 7f8c893d3700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c840b0f90 0x7f8c841e6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51276/0 (socket says 172.21.15.114:51276) 2023-10-18T12:19:46.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.578+0000 7f8c893d3700 1 -- 172.21.15.114:0/660927633 learned_addr learned my addr 172.21.15.114:0/660927633 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:46.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.582+0000 7f8c88bd2700 1 --2- 172.21.15.114:0/660927633 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c84155420 0x7f8c841e6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:46.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.582+0000 7f8c893d3700 1 -- 172.21.15.114:0/660927633 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c84155420 msgr2=0x7f8c841e6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:46.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.582+0000 7f8c893d3700 1 --2- 172.21.15.114:0/660927633 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c84155420 0x7f8c841e6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:46.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.582+0000 7f8c89bd4700 1 --2- 172.21.15.114:0/660927633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c8415bf00 0x7f8c840ae740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:46.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.582+0000 7f8c893d3700 1 -- 172.21.15.114:0/660927633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c8415bf00 msgr2=0x7f8c840ae740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:46.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.582+0000 7f8c893d3700 1 --2- 172.21.15.114:0/660927633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c8415bf00 0x7f8c840ae740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:46.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.582+0000 7f8c893d3700 1 -- 172.21.15.114:0/660927633 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c74009570 con 0x7f8c840b0f90 2023-10-18T12:19:46.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.582+0000 7f8c88bd2700 1 --2- 172.21.15.114:0/660927633 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c84155420 0x7f8c841e6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:19:46.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.582+0000 7f8c89bd4700 1 --2- 172.21.15.114:0/660927633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c8415bf00 0x7f8c840ae740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:19:46.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.582+0000 7f8c893d3700 1 --2- 172.21.15.114:0/660927633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c840b0f90 0x7f8c841e6030 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8c80001f80 tx=0x7f8c8000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:46.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.582+0000 7f8c79ffb700 1 -- 172.21.15.114:0/660927633 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8000ad80 con 0x7f8c840b0f90 2023-10-18T12:19:46.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.582+0000 7f8c79ffb700 1 -- 172.21.15.114:0/660927633 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c800070d0 con 0x7f8c840b0f90 2023-10-18T12:19:46.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.582+0000 7f8c8b637700 1 -- 172.21.15.114:0/660927633 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c840af600 con 0x7f8c840b0f90 2023-10-18T12:19:46.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.582+0000 7f8c79ffb700 1 -- 172.21.15.114:0/660927633 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c80007480 con 0x7f8c840b0f90 2023-10-18T12:19:46.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.582+0000 7f8c8b637700 1 -- 172.21.15.114:0/660927633 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c841f3d30 con 0x7f8c840b0f90 2023-10-18T12:19:46.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.582+0000 7f8c8b637700 1 -- 172.21.15.114:0/660927633 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c841f3f50 con 0x7f8c840b0f90 2023-10-18T12:19:46.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.586+0000 7f8c79ffb700 1 -- 172.21.15.114:0/660927633 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f8c800075e0 con 0x7f8c840b0f90 2023-10-18T12:19:46.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.586+0000 7f8c79ffb700 1 --2- 172.21.15.114:0/660927633 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8c680656f0 0x7f8c68067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:46.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.586+0000 7f8c79ffb700 1 -- 172.21.15.114:0/660927633 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8c800830a0 con 0x7f8c840b0f90 2023-10-18T12:19:46.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.586+0000 7f8c88bd2700 1 --2- 172.21.15.114:0/660927633 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8c680656f0 0x7f8c68067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:46.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.586+0000 7f8c88bd2700 1 --2- 172.21.15.114:0/660927633 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8c680656f0 0x7f8c68067bb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8c84143f50 tx=0x7f8c74008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:46.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.590+0000 7f8c79ffb700 1 -- 172.21.15.114:0/660927633 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f8c800507d0 con 0x7f8c840b0f90 2023-10-18T12:19:46.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.766+0000 7f8c8b637700 1 -- 172.21.15.114:0/660927633 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c84072e60 con 0x7f8c840b0f90 2023-10-18T12:19:46.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.770+0000 7f8c79ffb700 1 -- 172.21.15.114:0/660927633 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20144 (secure 0 0 0) 0x7f8c80053df0 con 0x7f8c840b0f90 2023-10-18T12:19:46.779 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:19:46.779 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":28,"fsid":"240ea340-5d3d-4f52-a4bc-af075aca3deb","created":"2023-10-18T12:19:12.512994+0000","modified":"2023-10-18T12:19:44.436656+0000","last_up_change":"2023-10-18T12:19:25.286009+0000","last_in_change":"2023-10-18T12:19:15.850693+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T12:19:27.040638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-18T12:19:32.358094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-18T12:19:37.333855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-18T12:19:38.055385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-18T12:19:41.679218+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c3578978-1a03-4857-b9d2-34a5da3d7731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6817","nonce":1506287862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6820","nonce":1506287862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6830","nonce":1506287862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6825","nonce":1506287862}]},"public_addr":"172.21.15.114:6817/1506287862","cluster_addr":"172.21.15.114:6820/1506287862","heartbeat_back_addr":"172.21.15.114:6830/1506287862","heartbeat_front_addr":"172.21.15.114:6825/1506287862","state":["exists","up"]},{"osd":1,"uuid":"43eb26a6-e2b3-4670-9559-bd053b5140d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6801","nonce":3302727047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6803","nonce":3302727047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6807","nonce":3302727047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6805","nonce":3302727047}]},"public_addr":"172.21.15.114:6801/3302727047","cluster_addr":"172.21.15.114:6803/3302727047","heartbeat_back_addr":"172.21.15.114:6807/3302727047","heartbeat_front_addr":"172.21.15.114:6805/3302727047","state":["exists","up"]},{"osd":2,"uuid":"f3d4dbd5-521c-4dd2-b687-5768cc7d0938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6809","nonce":2699151351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6811","nonce":2699151351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6815","nonce":2699151351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6813","nonce":2699151351}]},"public_addr":"172.21.15.114:6809/2699151351","cluster_addr":"172.21.15.114:6811/2699151351","heartbeat_back_addr":"172.21.15.114:6815/2699151351","heartbeat_front_addr":"172.21.15.114:6813/2699151351","state":["exists","up"]},{"osd":3,"uuid":"823e5802-92b7-4f0d-b32d-a5748993f1b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6821","nonce":1361608073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6824","nonce":1361608073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6829","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6831","nonce":1361608073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6827","nonce":1361608073}]},"public_addr":"172.21.15.114:6821/1361608073","cluster_addr":"172.21.15.114:6824/1361608073","heartbeat_back_addr":"172.21.15.114:6831/1361608073","heartbeat_front_addr":"172.21.15.114:6827/1361608073","state":["exists","up"]},{"osd":4,"uuid":"e47fb93e-13b4-44a4-b084-8c4384ceb41e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6801","nonce":930839681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6803","nonce":930839681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6807","nonce":930839681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6805","nonce":930839681}]},"public_addr":"172.21.15.172:6801/930839681","cluster_addr":"172.21.15.172:6803/930839681","heartbeat_back_addr":"172.21.15.172:6807/930839681","heartbeat_front_addr":"172.21.15.172:6805/930839681","state":["exists","up"]},{"osd":5,"uuid":"7561a973-f479-45a0-af40-f324728d622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6814","nonce":571761850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6818","nonce":571761850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6824","nonce":571761850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6821","nonce":571761850}]},"public_addr":"172.21.15.172:6814/571761850","cluster_addr":"172.21.15.172:6818/571761850","heartbeat_back_addr":"172.21.15.172:6824/571761850","heartbeat_front_addr":"172.21.15.172:6821/571761850","state":["exists","up"]},{"osd":6,"uuid":"51753f4b-7f06-4f1c-9ec7-6e18a66eb980","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6825","nonce":1680398853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6827","nonce":1680398853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6831","nonce":1680398853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6829","nonce":1680398853}]},"public_addr":"172.21.15.172:6825/1680398853","cluster_addr":"172.21.15.172:6827/1680398853","heartbeat_back_addr":"172.21.15.172:6831/1680398853","heartbeat_front_addr":"172.21.15.172:6829/1680398853","state":["exists","up"]},{"osd":7,"uuid":"4d8b1e15-143d-4d17-9074-59d92f0f9af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6809","nonce":349710101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6811","nonce":349710101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6819","nonce":349710101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6815","nonce":349710101}]},"public_addr":"172.21.15.172:6809/349710101","cluster_addr":"172.21.15.172:6811/349710101","heartbeat_back_addr":"172.21.15.172:6819/349710101","heartbeat_front_addr":"172.21.15.172:6815/349710101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.889460+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.475494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.911473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.648596+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.609994+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.636248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.854589+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.885826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T12:19:46.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.774+0000 7f8c8b637700 1 -- 172.21.15.114:0/660927633 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8c680656f0 msgr2=0x7f8c68067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:46.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.774+0000 7f8c8b637700 1 --2- 172.21.15.114:0/660927633 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8c680656f0 0x7f8c68067bb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8c84143f50 tx=0x7f8c74008030 comp rx=0 tx=0).stop 2023-10-18T12:19:46.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.774+0000 7f8c8b637700 1 -- 172.21.15.114:0/660927633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c840b0f90 msgr2=0x7f8c841e6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:46.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.774+0000 7f8c8b637700 1 --2- 172.21.15.114:0/660927633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c840b0f90 0x7f8c841e6030 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8c80001f80 tx=0x7f8c8000a340 comp rx=0 tx=0).stop 2023-10-18T12:19:46.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.774+0000 7f8c8b637700 1 -- 172.21.15.114:0/660927633 shutdown_connections 2023-10-18T12:19:46.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.774+0000 7f8c8b637700 1 --2- 172.21.15.114:0/660927633 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8c680656f0 0x7f8c68067bb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:46.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.774+0000 7f8c8b637700 1 --2- 172.21.15.114:0/660927633 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c84155420 0x7f8c841e6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:46.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.774+0000 7f8c8b637700 1 --2- 172.21.15.114:0/660927633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c8415bf00 0x7f8c840ae740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:46.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.774+0000 7f8c8b637700 1 --2- 172.21.15.114:0/660927633 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c840b0f90 0x7f8c841e6030 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:46.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.774+0000 7f8c8b637700 1 -- 172.21.15.114:0/660927633 >> 172.21.15.114:0/660927633 conn(0x7f8c8406a340 msgr2=0x7f8c840cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:46.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.774+0000 7f8c8b637700 1 -- 172.21.15.114:0/660927633 shutdown_connections 2023-10-18T12:19:46.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:46.774+0000 7f8c8b637700 1 -- 172.21.15.114:0/660927633 wait complete. 2023-10-18T12:19:47.206 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-18T12:19:39.077734+0000', 'modified': '2023-10-18T12:19:44.632195+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4303}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4303': {'gid': 4303, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.172:6837/3028221887', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6836', 'nonce': 3028221887}, {'type': 'v1', 'addr': '172.21.15.172:6837', 'nonce': 3028221887}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-10-18T12:19:47.206 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-18T12:19:47.206 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-18T12:19:47.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.382+0000 7f85b5e61700 1 Processor -- start 2023-10-18T12:19:47.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.382+0000 7f85b5e61700 1 -- start start 2023-10-18T12:19:47.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.382+0000 7f85b5e61700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f85b0144150 0x7f85b00cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:47.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.382+0000 7f85b5e61700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85b0070de0 con 0x7f85b00cbfb0 2023-10-18T12:19:47.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.382+0000 7f85b5e61700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85b00701d0 con 0x7f85b00ce1a0 2023-10-18T12:19:47.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.382+0000 7f85b5e61700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85b00704b0 con 0x7f85b0144150 2023-10-18T12:19:47.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.382+0000 7f85b5660700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f85b00cbfb0 0x7f85b00b22f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52104/0 (socket says 172.21.15.114:52104) 2023-10-18T12:19:47.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.382+0000 7f85b5660700 1 -- 172.21.15.114:0/1266377949 learned_addr learned my addr 172.21.15.114:0/1266377949 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:19:47.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.386+0000 7f85b4e5f700 1 --2- 172.21.15.114:0/1266377949 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f85b0144150 0x7f85b00cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:47.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.386+0000 7f85af7fe700 1 -- 172.21.15.114:0/1266377949 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3414603124 0 0) 0x7f85b0070de0 con 0x7f85b00cbfb0 2023-10-18T12:19:47.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.386+0000 7f85af7fe700 1 -- 172.21.15.114:0/1266377949 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85a00035d0 con 0x7f85b00cbfb0 2023-10-18T12:19:47.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.386+0000 7f85af7fe700 1 -- 172.21.15.114:0/1266377949 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1819185560 0 0) 0x7f85b00701d0 con 0x7f85b00ce1a0 2023-10-18T12:19:47.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.386+0000 7f85af7fe700 1 -- 172.21.15.114:0/1266377949 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85b0070de0 con 0x7f85b00ce1a0 2023-10-18T12:19:47.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.386+0000 7f85b4e5f700 1 -- 172.21.15.114:0/1266377949 >> v1:172.21.15.172:6789/0 conn(0x7f85b00ce1a0 legacy=0x7f85b00cb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:47.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.386+0000 7f85b4e5f700 1 -- 172.21.15.114:0/1266377949 >> v1:172.21.15.114:6789/0 conn(0x7f85b00cbfb0 legacy=0x7f85b00b22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:47.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.386+0000 7f85b4e5f700 1 -- 172.21.15.114:0/1266377949 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b0070790 con 0x7f85b0144150 2023-10-18T12:19:47.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.386+0000 7f85b4e5f700 1 --2- 172.21.15.114:0/1266377949 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f85b0144150 0x7f85b00cdc60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f85a4009880 tx=0x7f85a4009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2795463154120910 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:47.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.386+0000 7f85af7fe700 1 -- 172.21.15.114:0/1266377949 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a4011830 con 0x7f85b0144150 2023-10-18T12:19:47.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.386+0000 7f85af7fe700 1 -- 172.21.15.114:0/1266377949 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a4011990 con 0x7f85b0144150 2023-10-18T12:19:47.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.386+0000 7f85af7fe700 1 -- 172.21.15.114:0/1266377949 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a4011d20 con 0x7f85b0144150 2023-10-18T12:19:47.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.386+0000 7f85b5e61700 1 -- 172.21.15.114:0/1266377949 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f85b0144150 msgr2=0x7f85b00cdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:47.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.386+0000 7f85b5e61700 1 --2- 172.21.15.114:0/1266377949 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f85b0144150 0x7f85b00cdc60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f85a4009880 tx=0x7f85a4009b90 comp rx=0 tx=0).stop 2023-10-18T12:19:47.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.390+0000 7f85b5e61700 1 -- 172.21.15.114:0/1266377949 shutdown_connections 2023-10-18T12:19:47.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.390+0000 7f85b5e61700 1 --2- 172.21.15.114:0/1266377949 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f85b0144150 0x7f85b00cdc60 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:47.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.390+0000 7f85b5e61700 1 -- 172.21.15.114:0/1266377949 >> 172.21.15.114:0/1266377949 conn(0x7f85b00b0bf0 msgr2=0x7f85b00ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:47.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.390+0000 7f85b5e61700 1 -- 172.21.15.114:0/1266377949 shutdown_connections 2023-10-18T12:19:47.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.390+0000 7f85b5e61700 1 -- 172.21.15.114:0/1266377949 wait complete. 2023-10-18T12:19:47.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.390+0000 7f85b5e61700 1 Processor -- start 2023-10-18T12:19:47.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.390+0000 7f85b5e61700 1 -- start start 2023-10-18T12:19:47.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.394+0000 7f85b5e61700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f85b00cbfb0 0x7f85b0159e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:47.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.394+0000 7f85b5e61700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85b00ce1a0 0x7f85b0159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:47.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.394+0000 7f85b5e61700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85b0144150 0x7f85b015c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:47.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.394+0000 7f85b5e61700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b0159c70 con 0x7f85b0144150 2023-10-18T12:19:47.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.394+0000 7f85b5e61700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b0141100 con 0x7f85b00ce1a0 2023-10-18T12:19:47.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.394+0000 7f85b5e61700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85b013f690 con 0x7f85b00cbfb0 2023-10-18T12:19:47.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.394+0000 7f85b5660700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85b0144150 0x7f85b015c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:47.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.394+0000 7f85b5660700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85b0144150 0x7f85b015c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51292/0 (socket says 172.21.15.114:51292) 2023-10-18T12:19:47.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.394+0000 7f85b5660700 1 -- 172.21.15.114:0/2320885559 learned_addr learned my addr 172.21.15.114:0/2320885559 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:47.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.394+0000 7f85b4e5f700 1 --2- 172.21.15.114:0/2320885559 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f85b00cbfb0 0x7f85b0159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:47.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.394+0000 7f85affff700 1 --2- 172.21.15.114:0/2320885559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85b00ce1a0 0x7f85b0159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:47.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.394+0000 7f85b5660700 1 -- 172.21.15.114:0/2320885559 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f85b00cbfb0 msgr2=0x7f85b0159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:47.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.394+0000 7f85b5660700 1 --2- 172.21.15.114:0/2320885559 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f85b00cbfb0 0x7f85b0159e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:47.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.394+0000 7f85b5660700 1 -- 172.21.15.114:0/2320885559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85b00ce1a0 msgr2=0x7f85b0159730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:47.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.394+0000 7f85b5660700 1 --2- 172.21.15.114:0/2320885559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85b00ce1a0 0x7f85b0159730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:47.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.394+0000 7f85b5660700 1 -- 172.21.15.114:0/2320885559 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a40094b0 con 0x7f85b0144150 2023-10-18T12:19:47.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.394+0000 7f85b5660700 1 --2- 172.21.15.114:0/2320885559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85b0144150 0x7f85b015c9e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f85a800ca80 tx=0x7f85a800cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:47.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.394+0000 7f85ad7fa700 1 -- 172.21.15.114:0/2320885559 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a8007500 con 0x7f85b0144150 2023-10-18T12:19:47.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.394+0000 7f85ad7fa700 1 -- 172.21.15.114:0/2320885559 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a8007660 con 0x7f85b0144150 2023-10-18T12:19:47.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.394+0000 7f85ad7fa700 1 -- 172.21.15.114:0/2320885559 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a80079d0 con 0x7f85b0144150 2023-10-18T12:19:47.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.394+0000 7f85b5e61700 1 -- 172.21.15.114:0/2320885559 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85b013f970 con 0x7f85b0144150 2023-10-18T12:19:47.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.394+0000 7f85b5e61700 1 -- 172.21.15.114:0/2320885559 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85b013ff30 con 0x7f85b0144150 2023-10-18T12:19:47.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.398+0000 7f85ad7fa700 1 -- 172.21.15.114:0/2320885559 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f85a8012400 con 0x7f85b0144150 2023-10-18T12:19:47.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.402+0000 7f85ba359740 1 Processor -- start 2023-10-18T12:19:47.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.402+0000 7f85ad7fa700 1 --2- 172.21.15.114:0/2320885559 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f85940656f0 0x7f8594067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:47.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.402+0000 7f85ad7fa700 1 -- 172.21.15.114:0/2320885559 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f85a8082880 con 0x7f85b0144150 2023-10-18T12:19:47.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.402+0000 7f85ba359740 1 -- start start 2023-10-18T12:19:47.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.402+0000 7f85b4e5f700 1 --2- 172.21.15.114:0/2320885559 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f85940656f0 0x7f8594067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:47.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.402+0000 7f85b4e5f700 1 --2- 172.21.15.114:0/2320885559 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f85940656f0 0x7f8594067bb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f85a40090b0 tx=0x7f85a401c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:47.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.402+0000 7f85ba359740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x27ab4a0 0x27ab880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:47.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.402+0000 7f85ba359740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x27d4ad0 0x27d4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:47.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.402+0000 7f85ba359740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x27f1d30 0x27f2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:47.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.402+0000 7f85ba359740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x271df90 con 0x27f1d30 2023-10-18T12:19:47.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.402+0000 7f85ba359740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x271b680 con 0x27d4ad0 2023-10-18T12:19:47.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.402+0000 7f85ba359740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x2716f70 con 0x27ab4a0 2023-10-18T12:19:47.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.402+0000 7f85b5660700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x27f1d30 0x27f2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:47.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.402+0000 7f85b5660700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x27f1d30 0x27f2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51306/0 (socket says 172.21.15.114:51306) 2023-10-18T12:19:47.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.402+0000 7f85b5660700 1 -- 172.21.15.114:0/3388710094 learned_addr learned my addr 172.21.15.114:0/3388710094 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:47.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.402+0000 7f85b4e5f700 1 --2- 172.21.15.114:0/3388710094 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x27ab4a0 0x27ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:47.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.402+0000 7f85affff700 1 --2- 172.21.15.114:0/3388710094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x27d4ad0 0x27d4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:47.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.402+0000 7f85b5660700 1 -- 172.21.15.114:0/3388710094 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x27ab4a0 msgr2=0x27ab880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:47.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.402+0000 7f85b5660700 1 --2- 172.21.15.114:0/3388710094 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x27ab4a0 0x27ab880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:47.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.402+0000 7f85b5660700 1 -- 172.21.15.114:0/3388710094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x27d4ad0 msgr2=0x27d4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:47.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.402+0000 7f85b5660700 1 --2- 172.21.15.114:0/3388710094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x27d4ad0 0x27d4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:47.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.402+0000 7f85b5660700 1 -- 172.21.15.114:0/3388710094 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x273c1a0 con 0x27f1d30 2023-10-18T12:19:47.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.402+0000 7f85b4e5f700 1 --2- 172.21.15.114:0/3388710094 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x27ab4a0 0x27ab880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:19:47.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.406+0000 7f85b5660700 1 --2- 172.21.15.114:0/3388710094 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x27f1d30 0x27f2110 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f85a805b4e0 tx=0x7f85a8067190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f357efe657873c server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:47.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.406+0000 7f859a7fc700 1 -- 172.21.15.114:0/3388710094 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a8052150 con 0x27f1d30 2023-10-18T12:19:47.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.406+0000 7f859a7fc700 1 -- 172.21.15.114:0/3388710094 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a80504c0 con 0x27f1d30 2023-10-18T12:19:47.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.406+0000 7f859a7fc700 1 -- 172.21.15.114:0/3388710094 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a80534a0 con 0x27f1d30 2023-10-18T12:19:47.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.406+0000 7f85ba359740 1 -- 172.21.15.114:0/3388710094 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x27f1d30 msgr2=0x27f2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:47.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.406+0000 7f85ba359740 1 --2- 172.21.15.114:0/3388710094 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x27f1d30 0x27f2110 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f85a805b4e0 tx=0x7f85a8067190 comp rx=0 tx=0).stop 2023-10-18T12:19:47.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.406+0000 7f85ba359740 1 -- 172.21.15.114:0/3388710094 shutdown_connections 2023-10-18T12:19:47.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.406+0000 7f85ba359740 1 --2- 172.21.15.114:0/3388710094 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x27f1d30 0x27f2110 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:47.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.406+0000 7f85ba359740 1 --2- 172.21.15.114:0/3388710094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x27d4ad0 0x27d4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:47.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.406+0000 7f85ba359740 1 --2- 172.21.15.114:0/3388710094 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x27ab4a0 0x27ab880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:47.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.406+0000 7f85ba359740 1 -- 172.21.15.114:0/3388710094 >> 172.21.15.114:0/3388710094 conn(0x253d550 msgr2=0x27d7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:47.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.406+0000 7f85ba359740 1 -- 172.21.15.114:0/3388710094 shutdown_connections 2023-10-18T12:19:47.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.406+0000 7f85ba359740 1 -- 172.21.15.114:0/3388710094 wait complete. 2023-10-18T12:19:47.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.406+0000 7f85ba359740 1 -- start start 2023-10-18T12:19:47.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.406+0000 7f85ba359740 1 Processor -- start 2023-10-18T12:19:47.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.406+0000 7f85ba359740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x27ab4a0 0x27ae9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:47.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.406+0000 7f85ba359740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x27d4ad0 0x27af630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:47.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.410+0000 7f85ba359740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x27f1d30 0x27d3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:47.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.410+0000 7f85ba359740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x26d7b00 con 0x27f1d30 2023-10-18T12:19:47.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.410+0000 7f85ba359740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x26d6470 con 0x27ab4a0 2023-10-18T12:19:47.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.410+0000 7f85ba359740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x25c1b20 con 0x27d4ad0 2023-10-18T12:19:47.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.410+0000 7f85ba359740 10 client.0 _ll_register_callbacks cb 0x2710810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T12:19:47.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.410+0000 7f85b5660700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x27f1d30 0x27d3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:47.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.410+0000 7f85b5660700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x27f1d30 0x27d3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51314/0 (socket says 172.21.15.114:51314) 2023-10-18T12:19:47.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.410+0000 7f85b5660700 1 -- 172.21.15.114:0/4061365514 learned_addr learned my addr 172.21.15.114:0/4061365514 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:47.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.410+0000 7f85affff700 1 --2- 172.21.15.114:0/4061365514 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x27d4ad0 0x27af630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:47.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.410+0000 7f85b4e5f700 1 --2- 172.21.15.114:0/4061365514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x27ab4a0 0x27ae9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:47.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.410+0000 7f85b5660700 1 -- 172.21.15.114:0/4061365514 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x27d4ad0 msgr2=0x27af630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:47.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.410+0000 7f85b5660700 1 --2- 172.21.15.114:0/4061365514 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x27d4ad0 0x27af630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:47.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.410+0000 7f85b5660700 1 -- 172.21.15.114:0/4061365514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x27ab4a0 msgr2=0x27ae9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:47.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.410+0000 7f85b5660700 1 --2- 172.21.15.114:0/4061365514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x27ab4a0 0x27ae9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:47.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.410+0000 7f85b5660700 1 -- 172.21.15.114:0/4061365514 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85b013ff30 con 0x27f1d30 2023-10-18T12:19:47.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.410+0000 7f85b5660700 1 --2- 172.21.15.114:0/4061365514 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x27f1d30 0x27d3f90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f85a8059010 tx=0x7f85a80014d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76703133259d1379 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:47.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.410+0000 7f858f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T12:19:47.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.410+0000 7f858f7fe700 1 -- 172.21.15.114:0/4061365514 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a805b580 con 0x27f1d30 2023-10-18T12:19:47.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.410+0000 7f858f7fe700 1 -- 172.21.15.114:0/4061365514 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f85a806e020 con 0x27f1d30 2023-10-18T12:19:47.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.410+0000 7f85ba359740 1 -- 172.21.15.114:0/4061365514 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x270ff50 con 0x27f1d30 2023-10-18T12:19:47.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.410+0000 7f858f7fe700 1 -- 172.21.15.114:0/4061365514 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85a805b6e0 con 0x27f1d30 2023-10-18T12:19:47.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.410+0000 7f85ba359740 10 client.4446 fetch_fsmap learned FSMap version 7 2023-10-18T12:19:47.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.410+0000 7f85ba359740 1 -- 172.21.15.114:0/4061365514 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x25889e0 con 0x27f1d30 2023-10-18T12:19:47.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.410+0000 7f858f7fe700 1 -- 172.21.15.114:0/4061365514 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x270ff50 con 0x27f1d30 2023-10-18T12:19:47.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.410+0000 7f858f7fe700 1 -- 172.21.15.114:0/4061365514 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f85a8080d20 con 0x27f1d30 2023-10-18T12:19:47.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.410+0000 7f85ba359740 10 client.4446 fetch_fsmap finished waiting for FSMap version 7 2023-10-18T12:19:47.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.410+0000 7f85ba359740 10 client.4446 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-18T12:19:47.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.410+0000 7f85ba359740 20 client.4446 populate_metadata read hostname 'smithi114' 2023-10-18T12:19:47.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.410+0000 7f85ba359740 1 --2- 172.21.15.114:0/4061365514 >> [v2:172.21.15.172:6836/3028221887,v1:172.21.15.172:6837/3028221887] conn(0x27fbc40 0x27fc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:47.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.410+0000 7f85ba359740 4 client.4446 mds_command: new command op to 4303 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-18T12:19:47.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.410+0000 7f85ba359740 1 -- 172.21.15.114:0/4061365514 --> [v2:172.21.15.172:6836/3028221887,v1:172.21.15.172:6837/3028221887] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x270fc70 con 0x27fbc40 2023-10-18T12:19:47.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.410+0000 7f85b4e5f700 1 --2- 172.21.15.114:0/4061365514 >> [v2:172.21.15.172:6836/3028221887,v1:172.21.15.172:6837/3028221887] conn(0x27fbc40 0x27fc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:47.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.414+0000 7f85b4e5f700 1 --2- 172.21.15.114:0/4061365514 >> [v2:172.21.15.172:6836/3028221887,v1:172.21.15.172:6837/3028221887] conn(0x27fbc40 0x27fc020 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b03c310d3e8296b8 server_cookie=8ce1a5a0b0fd5df2 in_seq=0 out_seq=0 2023-10-18T12:19:47.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.414+0000 7f858f7fe700 10 client.4446 ms_handle_connect on v2:172.21.15.172:6836/3028221887 2023-10-18T12:19:47.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.414+0000 7f858f7fe700 1 -- 172.21.15.114:0/4061365514 <== mds.0 v2:172.21.15.172:6836/3028221887 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x270fc70 con 0x27fbc40 2023-10-18T12:19:47.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.414+0000 7f858f7fe700 10 client.4446 handle_command_reply: tid=0 2023-10-18T12:19:47.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.414+0000 7f85ba359740 1 client.4446 shutdown 2023-10-18T12:19:47.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.414+0000 7f85ba359740 1 -- 172.21.15.114:0/4061365514 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x27f1d30 msgr2=0x27d3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:47.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.414+0000 7f85ba359740 1 --2- 172.21.15.114:0/4061365514 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x27f1d30 0x27d3f90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f85a8059010 tx=0x7f85a80014d0 comp rx=0 tx=0).stop 2023-10-18T12:19:47.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.414+0000 7f85ba359740 1 -- 172.21.15.114:0/4061365514 shutdown_connections 2023-10-18T12:19:47.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.414+0000 7f85ba359740 1 --2- 172.21.15.114:0/4061365514 >> [v2:172.21.15.172:6836/3028221887,v1:172.21.15.172:6837/3028221887] conn(0x27fbc40 0x27fc020 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:47.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.414+0000 7f85ba359740 1 --2- 172.21.15.114:0/4061365514 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x27d4ad0 0x27af630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:47.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.414+0000 7f85ba359740 1 --2- 172.21.15.114:0/4061365514 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x27f1d30 0x27d3f90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:47.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.414+0000 7f85ba359740 1 --2- 172.21.15.114:0/4061365514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x27ab4a0 0x27ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:47.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.414+0000 7f858f7fe700 0 client.4446 ms_handle_reset on v2:172.21.15.172:6836/3028221887 2023-10-18T12:19:47.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.414+0000 7f85ba359740 1 -- 172.21.15.114:0/4061365514 >> 172.21.15.114:0/4061365514 conn(0x253d550 msgr2=0x27aa9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:47.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.414+0000 7f85ba359740 1 -- 172.21.15.114:0/4061365514 shutdown_connections 2023-10-18T12:19:47.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.414+0000 7f85ba359740 1 -- 172.21.15.114:0/4061365514 wait complete. 2023-10-18T12:19:47.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.414+0000 7f85ba359740 20 client.4446 trim_cache size 0 max 16384 2023-10-18T12:19:47.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.438+0000 7f85ba359740 1 Processor -- start 2023-10-18T12:19:47.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.438+0000 7f85ba359740 1 -- start start 2023-10-18T12:19:47.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.438+0000 7f85ba359740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x27ab4a0 0x27d82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:47.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.438+0000 7f85ba359740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x27d4ad0 0x2805170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:47.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.438+0000 7f85ba359740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x27f1d30 0x28056b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:47.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.438+0000 7f85ba359740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x271af70 con 0x27f1d30 2023-10-18T12:19:47.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.438+0000 7f85ba359740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x2719ad0 con 0x27ab4a0 2023-10-18T12:19:47.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.438+0000 7f85ba359740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x26bb330 con 0x27d4ad0 2023-10-18T12:19:47.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.438+0000 7f85b5660700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x27f1d30 0x28056b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:47.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.438+0000 7f85b5660700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x27f1d30 0x28056b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51330/0 (socket says 172.21.15.114:51330) 2023-10-18T12:19:47.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.438+0000 7f85b5660700 1 -- 172.21.15.114:0/958010042 learned_addr learned my addr 172.21.15.114:0/958010042 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:47.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.438+0000 7f85affff700 1 --2- 172.21.15.114:0/958010042 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x27d4ad0 0x2805170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:47.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.438+0000 7f85b4e5f700 1 --2- 172.21.15.114:0/958010042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x27ab4a0 0x27d82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:47.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.438+0000 7f85b5660700 1 -- 172.21.15.114:0/958010042 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x27d4ad0 msgr2=0x2805170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:47.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.438+0000 7f85b5660700 1 --2- 172.21.15.114:0/958010042 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x27d4ad0 0x2805170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:47.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.438+0000 7f85b5660700 1 -- 172.21.15.114:0/958010042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x27ab4a0 msgr2=0x27d82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:47.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.438+0000 7f85b5660700 1 --2- 172.21.15.114:0/958010042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x27ab4a0 0x27d82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:47.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.438+0000 7f85b5660700 1 -- 172.21.15.114:0/958010042 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b0140f10 con 0x27f1d30 2023-10-18T12:19:47.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.438+0000 7f85b4e5f700 1 --2- 172.21.15.114:0/958010042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x27ab4a0 0x27d82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:19:47.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.438+0000 7f85b5660700 1 --2- 172.21.15.114:0/958010042 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x27f1d30 0x28056b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f85a800a040 tx=0x7f85a8056070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c34e8396220b242f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:47.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.438+0000 7f859affd700 1 -- 172.21.15.114:0/958010042 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a800e040 con 0x27f1d30 2023-10-18T12:19:47.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.438+0000 7f859affd700 1 -- 172.21.15.114:0/958010042 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a80500f0 con 0x27f1d30 2023-10-18T12:19:47.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.438+0000 7f859affd700 1 -- 172.21.15.114:0/958010042 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a8080ce0 con 0x27f1d30 2023-10-18T12:19:47.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.442+0000 7f85ba359740 1 -- 172.21.15.114:0/958010042 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x27f1d30 msgr2=0x28056b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:47.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.442+0000 7f85ba359740 1 --2- 172.21.15.114:0/958010042 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x27f1d30 0x28056b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f85a800a040 tx=0x7f85a8056070 comp rx=0 tx=0).stop 2023-10-18T12:19:47.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.442+0000 7f85ba359740 1 -- 172.21.15.114:0/958010042 shutdown_connections 2023-10-18T12:19:47.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.442+0000 7f85ba359740 1 --2- 172.21.15.114:0/958010042 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x27d4ad0 0x2805170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:47.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.442+0000 7f85ba359740 1 --2- 172.21.15.114:0/958010042 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x27f1d30 0x28056b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:47.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.442+0000 7f85ba359740 1 --2- 172.21.15.114:0/958010042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x27ab4a0 0x27d82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:47.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.442+0000 7f85ba359740 1 -- 172.21.15.114:0/958010042 >> 172.21.15.114:0/958010042 conn(0x253d550 msgr2=0x27fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:47.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.442+0000 7f85ba359740 1 -- 172.21.15.114:0/958010042 shutdown_connections 2023-10-18T12:19:47.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.442+0000 7f85ba359740 1 -- 172.21.15.114:0/958010042 wait complete. 2023-10-18T12:19:47.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.442+0000 7f85ba359740 1 -- start start 2023-10-18T12:19:47.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.442+0000 7f85ba359740 1 Processor -- start 2023-10-18T12:19:47.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.442+0000 7f85ba359740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x27ab4a0 0x27a9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:47.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.442+0000 7f85ba359740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x27d4ad0 0x280dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:47.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.442+0000 7f85ba359740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x27f1d30 0x280e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:47.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.442+0000 7f85ba359740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x271f560 con 0x27ab4a0 2023-10-18T12:19:47.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.442+0000 7f85ba359740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x2715e00 con 0x27f1d30 2023-10-18T12:19:47.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.442+0000 7f85ba359740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x2720c30 con 0x27d4ad0 2023-10-18T12:19:47.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.442+0000 7f85ba359740 10 client.0 _ll_register_callbacks cb 0x26c3120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T12:19:47.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.442+0000 7f85b4e5f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x27ab4a0 0x27a9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:47.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.442+0000 7f85b4e5f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x27ab4a0 0x27a9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51336/0 (socket says 172.21.15.114:51336) 2023-10-18T12:19:47.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.442+0000 7f85b4e5f700 1 -- 172.21.15.114:0/1971079432 learned_addr learned my addr 172.21.15.114:0/1971079432 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:47.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.446+0000 7f85b5660700 1 --2- 172.21.15.114:0/1971079432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x27f1d30 0x280e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:47.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.446+0000 7f85affff700 1 --2- 172.21.15.114:0/1971079432 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x27d4ad0 0x280dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:47.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.446+0000 7f85b4e5f700 1 -- 172.21.15.114:0/1971079432 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x27d4ad0 msgr2=0x280dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:47.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.446+0000 7f85b4e5f700 1 --2- 172.21.15.114:0/1971079432 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x27d4ad0 0x280dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:47.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.446+0000 7f85b4e5f700 1 -- 172.21.15.114:0/1971079432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x27f1d30 msgr2=0x280e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:47.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.446+0000 7f85b4e5f700 1 --2- 172.21.15.114:0/1971079432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x27f1d30 0x280e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:47.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.446+0000 7f85b4e5f700 1 -- 172.21.15.114:0/1971079432 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x25889e0 con 0x27ab4a0 2023-10-18T12:19:47.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.446+0000 7f85b4e5f700 1 --2- 172.21.15.114:0/1971079432 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x27ab4a0 0x27a9a10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f85a4009bd0 tx=0x7f85a40047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed7ccebf83e38798 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:47.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.446+0000 7f858f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T12:19:47.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.446+0000 7f858f7fe700 1 -- 172.21.15.114:0/1971079432 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a403b640 con 0x27ab4a0 2023-10-18T12:19:47.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.446+0000 7f858f7fe700 1 -- 172.21.15.114:0/1971079432 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f85a401f070 con 0x27ab4a0 2023-10-18T12:19:47.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.446+0000 7f85ba359740 1 -- 172.21.15.114:0/1971079432 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x25944e0 con 0x27ab4a0 2023-10-18T12:19:47.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.446+0000 7f858f7fe700 1 -- 172.21.15.114:0/1971079432 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85a403b7a0 con 0x27ab4a0 2023-10-18T12:19:47.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.446+0000 7f85ba359740 10 client.4452 fetch_fsmap learned FSMap version 7 2023-10-18T12:19:47.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.446+0000 7f85ba359740 1 -- 172.21.15.114:0/1971079432 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x26db250 con 0x27ab4a0 2023-10-18T12:19:47.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.446+0000 7f858f7fe700 1 -- 172.21.15.114:0/1971079432 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x25944e0 con 0x27ab4a0 2023-10-18T12:19:47.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.446+0000 7f858f7fe700 1 -- 172.21.15.114:0/1971079432 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f85a403b900 con 0x27ab4a0 2023-10-18T12:19:47.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.446+0000 7f85ba359740 10 client.4452 fetch_fsmap finished waiting for FSMap version 7 2023-10-18T12:19:47.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.446+0000 7f85ba359740 10 client.4452 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-18T12:19:47.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.446+0000 7f85ba359740 20 client.4452 populate_metadata read hostname 'smithi114' 2023-10-18T12:19:47.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.446+0000 7f85ba359740 1 --2- 172.21.15.114:0/1971079432 >> [v2:172.21.15.172:6836/3028221887,v1:172.21.15.172:6837/3028221887] conn(0x280d140 0x280ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:47.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.446+0000 7f85ba359740 4 client.4452 mds_command: new command op to 4303 tid=0[{"prefix": "status"}] 2023-10-18T12:19:47.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.446+0000 7f85ba359740 1 -- 172.21.15.114:0/1971079432 --> [v2:172.21.15.172:6836/3028221887,v1:172.21.15.172:6837/3028221887] -- command(tid 0: {"prefix": "status"}) v1 -- 0x25b9260 con 0x280d140 2023-10-18T12:19:47.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.446+0000 7f85affff700 1 --2- 172.21.15.114:0/1971079432 >> [v2:172.21.15.172:6836/3028221887,v1:172.21.15.172:6837/3028221887] conn(0x280d140 0x280ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:47.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.450+0000 7f858f7fe700 10 client.4452 ms_handle_connect on v2:172.21.15.172:6836/3028221887 2023-10-18T12:19:47.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.450+0000 7f85affff700 1 --2- 172.21.15.114:0/1971079432 >> [v2:172.21.15.172:6836/3028221887,v1:172.21.15.172:6837/3028221887] conn(0x280d140 0x280ad40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fc0e354a216fa44 server_cookie=193efd1807b8cc7c in_seq=0 out_seq=0 2023-10-18T12:19:47.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.450+0000 7f858f7fe700 1 -- 172.21.15.114:0/1971079432 <== mds.0 v2:172.21.15.172:6836/3028221887 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x25b9260 con 0x280d140 2023-10-18T12:19:47.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.450+0000 7f858f7fe700 10 client.4452 handle_command_reply: tid=0 2023-10-18T12:19:47.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.450+0000 7f85ba359740 1 client.4452 shutdown 2023-10-18T12:19:47.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.450+0000 7f85ba359740 1 -- 172.21.15.114:0/1971079432 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x27ab4a0 msgr2=0x27a9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:47.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.450+0000 7f85ba359740 1 --2- 172.21.15.114:0/1971079432 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x27ab4a0 0x27a9a10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f85a4009bd0 tx=0x7f85a40047e0 comp rx=0 tx=0).stop 2023-10-18T12:19:47.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.450+0000 7f85ba359740 1 -- 172.21.15.114:0/1971079432 shutdown_connections 2023-10-18T12:19:47.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.450+0000 7f85ba359740 1 --2- 172.21.15.114:0/1971079432 >> [v2:172.21.15.172:6836/3028221887,v1:172.21.15.172:6837/3028221887] conn(0x280d140 0x280ad40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:47.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.450+0000 7f85ba359740 1 --2- 172.21.15.114:0/1971079432 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x27d4ad0 0x280dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:47.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.450+0000 7f85ba359740 1 --2- 172.21.15.114:0/1971079432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x27f1d30 0x280e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:47.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.450+0000 7f85ba359740 1 --2- 172.21.15.114:0/1971079432 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x27ab4a0 0x27a9a10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:47.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.450+0000 7f858f7fe700 0 client.4452 ms_handle_reset on v2:172.21.15.172:6836/3028221887 2023-10-18T12:19:47.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.450+0000 7f85ba359740 1 -- 172.21.15.114:0/1971079432 >> 172.21.15.114:0/1971079432 conn(0x253d550 msgr2=0x2805a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:47.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.450+0000 7f85ba359740 1 -- 172.21.15.114:0/1971079432 shutdown_connections 2023-10-18T12:19:47.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.450+0000 7f85ba359740 1 -- 172.21.15.114:0/1971079432 wait complete. 2023-10-18T12:19:47.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.450+0000 7f85ba359740 20 client.4452 trim_cache size 0 max 16384 2023-10-18T12:19:47.466 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T12:19:47.466 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "240ea340-5d3d-4f52-a4bc-af075aca3deb", 2023-10-18T12:19:47.467 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 0, 2023-10-18T12:19:47.467 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4303, 2023-10-18T12:19:47.467 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2023-10-18T12:19:47.467 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2023-10-18T12:19:47.467 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2023-10-18T12:19:47.467 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 7.8586230529999996, 2023-10-18T12:19:47.468 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 7, 2023-10-18T12:19:47.468 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 28, 2023-10-18T12:19:47.468 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 28, 2023-10-18T12:19:47.468 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 13.746096551999999 2023-10-18T12:19:47.468 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T12:19:47.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.450+0000 7f85b5e61700 1 -- 172.21.15.114:0/2320885559 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f85940656f0 msgr2=0x7f8594067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:47.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.450+0000 7f85b5e61700 1 --2- 172.21.15.114:0/2320885559 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f85940656f0 0x7f8594067bb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f85a40090b0 tx=0x7f85a401c040 comp rx=0 tx=0).stop 2023-10-18T12:19:47.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.450+0000 7f85b5e61700 1 -- 172.21.15.114:0/2320885559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85b0144150 msgr2=0x7f85b015c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:47.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.450+0000 7f85b5e61700 1 --2- 172.21.15.114:0/2320885559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85b0144150 0x7f85b015c9e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f85a800ca80 tx=0x7f85a800cab0 comp rx=0 tx=0).stop 2023-10-18T12:19:47.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.450+0000 7f85b5e61700 1 -- 172.21.15.114:0/2320885559 shutdown_connections 2023-10-18T12:19:47.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.450+0000 7f85b5e61700 1 --2- 172.21.15.114:0/2320885559 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f85940656f0 0x7f8594067bb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:47.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.450+0000 7f85b5e61700 1 --2- 172.21.15.114:0/2320885559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85b0144150 0x7f85b015c9e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:47.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.450+0000 7f85b5e61700 1 --2- 172.21.15.114:0/2320885559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85b00ce1a0 0x7f85b0159730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:47.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.450+0000 7f85b5e61700 1 --2- 172.21.15.114:0/2320885559 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f85b00cbfb0 0x7f85b0159e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:47.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.450+0000 7f85b5e61700 1 -- 172.21.15.114:0/2320885559 >> 172.21.15.114:0/2320885559 conn(0x7f85b00b0bf0 msgr2=0x7f85b00aec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:47.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.450+0000 7f85b5e61700 1 -- 172.21.15.114:0/2320885559 shutdown_connections 2023-10-18T12:19:47.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.450+0000 7f85b5e61700 1 -- 172.21.15.114:0/2320885559 wait complete. 2023-10-18T12:19:47.481 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-18T12:19:47.482 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-18T12:19:47.483 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-18T12:19:47.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.650+0000 7f0e8118b700 1 Processor -- start 2023-10-18T12:19:47.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.650+0000 7f0e8118b700 1 -- start start 2023-10-18T12:19:47.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.654+0000 7f0e8118b700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0e7c0cba90 0x7f0e7c164930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:47.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.654+0000 7f0e8118b700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e7c0caef0 con 0x7f0e7c0adb20 2023-10-18T12:19:47.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.654+0000 7f0e8118b700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e7c0ae3c0 con 0x7f0e7c15ceb0 2023-10-18T12:19:47.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.654+0000 7f0e8118b700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e7c0cbf00 con 0x7f0e7c0cba90 2023-10-18T12:19:47.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.654+0000 7f0e7b7fe700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f0e7c0adb20 0x7f0e7c0cb380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52108/0 (socket says 172.21.15.114:52108) 2023-10-18T12:19:47.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.654+0000 7f0e7b7fe700 1 -- 172.21.15.114:0/3977982480 learned_addr learned my addr 172.21.15.114:0/3977982480 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:19:47.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.654+0000 7f0e8098a700 1 --2- 172.21.15.114:0/3977982480 >> v2:172.21.15.114:3300/0 conn(0x7f0e7c0cba90 0x7f0e7c164930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:47.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.654+0000 7f0e7affd700 1 -- 172.21.15.114:0/3977982480 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 136758182 0 0) 0x7f0e7c0caef0 con 0x7f0e7c0adb20 2023-10-18T12:19:47.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.654+0000 7f0e7affd700 1 -- 172.21.15.114:0/3977982480 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e640035d0 con 0x7f0e7c0adb20 2023-10-18T12:19:47.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.654+0000 7f0e7affd700 1 -- 172.21.15.114:0/3977982480 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1345173500 0 0) 0x7f0e640035d0 con 0x7f0e7c0adb20 2023-10-18T12:19:47.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.654+0000 7f0e8098a700 1 -- 172.21.15.114:0/3977982480 >> v1:172.21.15.172:6789/0 conn(0x7f0e7c15ceb0 legacy=0x7f0e7c0cc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:47.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.654+0000 7f0e8098a700 1 -- 172.21.15.114:0/3977982480 >> v1:172.21.15.114:6789/0 conn(0x7f0e7c0adb20 legacy=0x7f0e7c0cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:47.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.654+0000 7f0e8098a700 1 -- 172.21.15.114:0/3977982480 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e7c0ca5c0 con 0x7f0e7c0cba90 2023-10-18T12:19:47.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.654+0000 7f0e8098a700 1 --2- 172.21.15.114:0/3977982480 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e7c0cba90 0x7f0e7c164930 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0e74009d90 tx=0x7f0e7400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b95d4822d0e38e72 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:47.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.658+0000 7f0e7affd700 1 -- 172.21.15.114:0/3977982480 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7400e070 con 0x7f0e7c0cba90 2023-10-18T12:19:47.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.658+0000 7f0e7affd700 1 -- 172.21.15.114:0/3977982480 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e74003a40 con 0x7f0e7c0cba90 2023-10-18T12:19:47.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.658+0000 7f0e7affd700 1 -- 172.21.15.114:0/3977982480 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e70001670 con 0x7f0e7c0cba90 2023-10-18T12:19:47.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.658+0000 7f0e8118b700 1 -- 172.21.15.114:0/3977982480 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e7c0cba90 msgr2=0x7f0e7c164930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:47.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.658+0000 7f0e8118b700 1 --2- 172.21.15.114:0/3977982480 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e7c0cba90 0x7f0e7c164930 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0e74009d90 tx=0x7f0e7400b330 comp rx=0 tx=0).stop 2023-10-18T12:19:47.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.658+0000 7f0e8118b700 1 -- 172.21.15.114:0/3977982480 shutdown_connections 2023-10-18T12:19:47.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.658+0000 7f0e8118b700 1 --2- 172.21.15.114:0/3977982480 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e7c0cba90 0x7f0e7c164930 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:47.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.658+0000 7f0e8118b700 1 -- 172.21.15.114:0/3977982480 >> 172.21.15.114:0/3977982480 conn(0x7f0e7c0b06c0 msgr2=0x7f0e7c0b0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:47.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.658+0000 7f0e8118b700 1 -- 172.21.15.114:0/3977982480 shutdown_connections 2023-10-18T12:19:47.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.658+0000 7f0e8118b700 1 -- 172.21.15.114:0/3977982480 wait complete. 2023-10-18T12:19:47.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.658+0000 7f0e8118b700 1 Processor -- start 2023-10-18T12:19:47.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.662+0000 7f0e8118b700 1 -- start start 2023-10-18T12:19:47.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.662+0000 7f0e8118b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e7c0adb20 0x7f0e7c0a74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:47.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.662+0000 7f0e8118b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0e7c0cba90 0x7f0e7c156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:47.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.662+0000 7f0e8118b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e7c15ceb0 0x7f0e7c0a9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:47.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.662+0000 7f0e8118b700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c0ab3b0 con 0x7f0e7c15ceb0 2023-10-18T12:19:47.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.662+0000 7f0e8118b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c0a7ac0 con 0x7f0e7c0adb20 2023-10-18T12:19:47.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.662+0000 7f0e8118b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c0a7da0 con 0x7f0e7c0cba90 2023-10-18T12:19:47.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.662+0000 7f0e8098a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e7c15ceb0 0x7f0e7c0a9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:47.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.662+0000 7f0e8098a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e7c15ceb0 0x7f0e7c0a9960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51356/0 (socket says 172.21.15.114:51356) 2023-10-18T12:19:47.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.662+0000 7f0e8098a700 1 -- 172.21.15.114:0/3096144750 learned_addr learned my addr 172.21.15.114:0/3096144750 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:47.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.662+0000 7f0e7b7fe700 1 --2- 172.21.15.114:0/3096144750 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0e7c0cba90 0x7f0e7c156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:47.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.662+0000 7f0e7bfff700 1 --2- 172.21.15.114:0/3096144750 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e7c0adb20 0x7f0e7c0a74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:47.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.662+0000 7f0e8098a700 1 -- 172.21.15.114:0/3096144750 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0e7c0cba90 msgr2=0x7f0e7c156390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:47.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.662+0000 7f0e8098a700 1 --2- 172.21.15.114:0/3096144750 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0e7c0cba90 0x7f0e7c156390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:47.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.662+0000 7f0e8098a700 1 -- 172.21.15.114:0/3096144750 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e7c0adb20 msgr2=0x7f0e7c0a74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:47.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.662+0000 7f0e8098a700 1 --2- 172.21.15.114:0/3096144750 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e7c0adb20 0x7f0e7c0a74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:47.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.662+0000 7f0e8098a700 1 -- 172.21.15.114:0/3096144750 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e74009a70 con 0x7f0e7c15ceb0 2023-10-18T12:19:47.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.662+0000 7f0e8098a700 1 --2- 172.21.15.114:0/3096144750 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e7c15ceb0 0x7f0e7c0a9960 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0e7400b370 tx=0x7f0e74004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:47.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.662+0000 7f0e78ff9700 1 -- 172.21.15.114:0/3096144750 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e74009450 con 0x7f0e7c15ceb0 2023-10-18T12:19:47.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.662+0000 7f0e78ff9700 1 -- 172.21.15.114:0/3096144750 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e740045e0 con 0x7f0e7c15ceb0 2023-10-18T12:19:47.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.662+0000 7f0e78ff9700 1 -- 172.21.15.114:0/3096144750 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e74004990 con 0x7f0e7c15ceb0 2023-10-18T12:19:47.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.662+0000 7f0e8118b700 1 -- 172.21.15.114:0/3096144750 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e7c0a8080 con 0x7f0e7c15ceb0 2023-10-18T12:19:47.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.662+0000 7f0e8118b700 1 -- 172.21.15.114:0/3096144750 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e7c0a9ea0 con 0x7f0e7c15ceb0 2023-10-18T12:19:47.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.666+0000 7f0e8118b700 1 -- 172.21.15.114:0/3096144750 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e7c0ab520 con 0x7f0e7c15ceb0 2023-10-18T12:19:47.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.666+0000 7f0e78ff9700 1 -- 172.21.15.114:0/3096144750 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f0e74027450 con 0x7f0e7c15ceb0 2023-10-18T12:19:47.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.670+0000 7f0e78ff9700 1 --2- 172.21.15.114:0/3096144750 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0e680656f0 0x7f0e68067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:47.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.670+0000 7f0e78ff9700 1 -- 172.21.15.114:0/3096144750 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0e74084bb0 con 0x7f0e7c15ceb0 2023-10-18T12:19:47.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.670+0000 7f0e7bfff700 1 --2- 172.21.15.114:0/3096144750 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0e680656f0 0x7f0e68067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:47.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.670+0000 7f0e7bfff700 1 --2- 172.21.15.114:0/3096144750 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0e680656f0 0x7f0e68067bb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c000f60 tx=0x7f0e6c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:47.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.674+0000 7f0e78ff9700 1 -- 172.21.15.114:0/3096144750 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f0e74055d80 con 0x7f0e7c15ceb0 2023-10-18T12:19:47.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.982+0000 7f0e8118b700 1 -- 172.21.15.114:0/3096144750 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0e7c072e60 con 0x7f0e7c15ceb0 2023-10-18T12:19:47.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.982+0000 7f0e78ff9700 1 -- 172.21.15.114:0/3096144750 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f0e74055910 con 0x7f0e7c15ceb0 2023-10-18T12:19:47.991 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-18T12:19:47.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.986+0000 7f0e8118b700 1 -- 172.21.15.114:0/3096144750 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0e680656f0 msgr2=0x7f0e68067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:47.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.986+0000 7f0e8118b700 1 --2- 172.21.15.114:0/3096144750 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0e680656f0 0x7f0e68067bb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c000f60 tx=0x7f0e6c009040 comp rx=0 tx=0).stop 2023-10-18T12:19:47.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.986+0000 7f0e8118b700 1 -- 172.21.15.114:0/3096144750 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e7c15ceb0 msgr2=0x7f0e7c0a9960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:47.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.986+0000 7f0e8118b700 1 --2- 172.21.15.114:0/3096144750 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e7c15ceb0 0x7f0e7c0a9960 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0e7400b370 tx=0x7f0e74004af0 comp rx=0 tx=0).stop 2023-10-18T12:19:47.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.986+0000 7f0e8118b700 1 -- 172.21.15.114:0/3096144750 shutdown_connections 2023-10-18T12:19:47.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.986+0000 7f0e8118b700 1 --2- 172.21.15.114:0/3096144750 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0e680656f0 0x7f0e68067bb0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:47.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.986+0000 7f0e8118b700 1 --2- 172.21.15.114:0/3096144750 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0e7c0cba90 0x7f0e7c156390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:47.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.986+0000 7f0e8118b700 1 --2- 172.21.15.114:0/3096144750 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0e7c15ceb0 0x7f0e7c0a9960 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:47.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.986+0000 7f0e8118b700 1 --2- 172.21.15.114:0/3096144750 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e7c0adb20 0x7f0e7c0a74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:47.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.986+0000 7f0e8118b700 1 -- 172.21.15.114:0/3096144750 >> 172.21.15.114:0/3096144750 conn(0x7f0e7c0b06c0 msgr2=0x7f0e7c0cf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:47.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.986+0000 7f0e8118b700 1 -- 172.21.15.114:0/3096144750 shutdown_connections 2023-10-18T12:19:47.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:47.986+0000 7f0e8118b700 1 -- 172.21.15.114:0/3096144750 wait complete. 2023-10-18T12:19:48.011 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-18T12:19:48.011 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-18T12:19:48.012 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2023-10-18T12:19:48.012 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-10-18T12:19:48.012 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-18T12:19:48.012 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-18T12:19:48.013 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-18T12:19:48.013 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-18T12:19:48.013 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-10-18T12:19:48.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:19:48.014 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2023-10-18T12:19:48.032 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-18T12:19:48.032 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-18T12:19:48.032 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2023-10-18T12:19:48.032 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:19:48.032 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2023-10-18T12:19:48.033 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:19:48.033 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-18T12:19:48.033 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2023-10-18T12:19:48.033 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2023-10-18T12:19:48.033 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-18T12:19:48.033 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2023-10-18T12:19:48.034 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2023-10-18T12:19:48.034 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-18T12:19:48.034 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2023-10-18T12:19:48.034 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-18T12:19:48.034 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2023-10-18T12:19:48.034 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-18T12:19:48.035 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42363sec preferred_lft 42363sec 2023-10-18T12:19:48.035 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2023-10-18T12:19:48.035 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:19:48.035 INFO:teuthology.orchestra.run.smithi114.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-18T12:19:48.035 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 02:42:85:ed:49:1d brd ff:ff:ff:ff:ff:ff 2023-10-18T12:19:48.036 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-18T12:19:48.036 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:19:48.036 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-18T12:19:48.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:19:48.037 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-10-18T12:19:48.037 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-10-18T12:19:48.037 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link add name ceph-brx type bridge 2023-10-18T12:19:48.038 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip addr flush dev ceph-brx 2023-10-18T12:19:48.038 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set ceph-brx up 2023-10-18T12:19:48.039 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-18T12:19:48.039 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-10-18T12:19:48.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:19:48.182 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-18T12:19:48.208 INFO:teuthology.orchestra.run.smithi114.stdout:1 2023-10-18T12:19:48.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:19:48.212 DEBUG:teuthology.orchestra.run.smithi114:> route 2023-10-18T12:19:49.057 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2023-10-18T12:19:49.057 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-18T12:19:49.057 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-18T12:19:49.058 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-18T12:19:49.058 INFO:teuthology.orchestra.run.smithi114.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-18T12:19:49.058 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-10-18T12:19:49.058 INFO:teuthology.orchestra.run.smithi114.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-18T12:19:49.058 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-18T12:19:49.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:19:49.059 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-10-18T12:19:49.060 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-10-18T12:19:49.060 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-18T12:19:49.060 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-18T12:19:49.060 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-18T12:19:49.061 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-10-18T12:19:49.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:19:49.157 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2023-10-18T12:19:49.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:19:49.177 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list-id 2023-10-18T12:19:49.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:19:49.245 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-10-18T12:19:49.245 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-10-18T12:19:49.246 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-18T12:19:49.246 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-10-18T12:19:49.246 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-10-18T12:19:49.356 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-10-18T12:19:49.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:19:49.357 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-10-18T12:19:49.357 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-10-18T12:19:49.358 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-10-18T12:19:49.358 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-18T12:19:49.358 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-10-18T12:19:49.359 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-10-18T12:19:49.359 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-10-18T12:19:49.359 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-10-18T12:19:49.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:19:49.527 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-10-18T12:19:49.528 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-10-18T12:19:49.528 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2023-10-18T12:19:49.528 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set dev brx.0 master ceph-brx 2023-10-18T12:19:49.529 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-10-18T12:19:49.599 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-10-18T12:19:49.599 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-18T12:19:49.600 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-10-18T12:19:49.612 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-10-18T12:19:49.613 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-18T12:19:49.614 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-10-18T12:19:49.676 DEBUG:teuthology.orchestra.run.smithi114:> sudo modprobe fuse 2023-10-18T12:19:49.756 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-18T12:19:49.757 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-18T12:19:49.836 INFO:teuthology.orchestra.run.smithi114.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-18T12:19:49.839 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-18T12:19:49.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:19:49.840 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2023-10-18T12:19:49.904 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-18T12:19:49.904 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-10-18T12:19:49.953 DEBUG:teuthology.orchestra.run.smithi114:> sudo modprobe fuse 2023-10-18T12:19:49.990 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-18T12:19:49.991 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-18T12:19:50.065 INFO:teuthology.orchestra.run.smithi114.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-18T12:19:50.067 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-18T12:19:50.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:19:50.068 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2023-10-18T12:19:50.095 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi114.stderr:2023-10-18T12:19:50.090+0000 7f9705c4f640 -1 init, newargv = 0x5634d7f13d60 newargc=15 2023-10-18T12:19:50.095 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi114.stderr:ceph-fuse[41634]: starting ceph client 2023-10-18T12:19:50.111 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi114.stderr:ceph-fuse[41634]: starting fuse 2023-10-18T12:19:51.208 DEBUG:teuthology.orchestra.run.smithi114:> sudo modprobe fuse 2023-10-18T12:19:51.246 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-18T12:19:51.247 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-18T12:19:51.323 INFO:teuthology.orchestra.run.smithi114.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-18T12:19:51.325 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-18T12:19:51.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:19:51.327 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2023-10-18T12:19:51.389 INFO:teuthology.orchestra.run.smithi114.stdout:49 2023-10-18T12:19:51.390 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2023-10-18T12:19:51.390 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer -- python3 -c ' 2023-10-18T12:19:51.390 DEBUG:teuthology.orchestra.run.smithi114:> import glob 2023-10-18T12:19:51.391 DEBUG:teuthology.orchestra.run.smithi114:> import re 2023-10-18T12:19:51.391 DEBUG:teuthology.orchestra.run.smithi114:> import os 2023-10-18T12:19:51.391 DEBUG:teuthology.orchestra.run.smithi114:> import subprocess 2023-10-18T12:19:51.392 DEBUG:teuthology.orchestra.run.smithi114:> 2023-10-18T12:19:51.392 DEBUG:teuthology.orchestra.run.smithi114:> def _find_admin_socket(client_name): 2023-10-18T12:19:51.392 DEBUG:teuthology.orchestra.run.smithi114:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-10-18T12:19:51.393 DEBUG:teuthology.orchestra.run.smithi114:> files = glob.glob(asok_path) 2023-10-18T12:19:51.393 DEBUG:teuthology.orchestra.run.smithi114:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-10-18T12:19:51.393 DEBUG:teuthology.orchestra.run.smithi114:> 2023-10-18T12:19:51.394 DEBUG:teuthology.orchestra.run.smithi114:> # Given a non-glob path, it better be there 2023-10-18T12:19:51.394 DEBUG:teuthology.orchestra.run.smithi114:> if "*" not in asok_path: 2023-10-18T12:19:51.394 DEBUG:teuthology.orchestra.run.smithi114:> assert(len(files) == 1) 2023-10-18T12:19:51.394 DEBUG:teuthology.orchestra.run.smithi114:> return files[0] 2023-10-18T12:19:51.395 DEBUG:teuthology.orchestra.run.smithi114:> 2023-10-18T12:19:51.395 DEBUG:teuthology.orchestra.run.smithi114:> for f in files: 2023-10-18T12:19:51.395 DEBUG:teuthology.orchestra.run.smithi114:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-18T12:19:51.396 DEBUG:teuthology.orchestra.run.smithi114:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-18T12:19:51.396 DEBUG:teuthology.orchestra.run.smithi114:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-18T12:19:51.396 DEBUG:teuthology.orchestra.run.smithi114:> contents = proc_f.read() 2023-10-18T12:19:51.397 DEBUG:teuthology.orchestra.run.smithi114:> if mountpoint in contents: 2023-10-18T12:19:51.397 DEBUG:teuthology.orchestra.run.smithi114:> return f 2023-10-18T12:19:51.397 DEBUG:teuthology.orchestra.run.smithi114:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-18T12:19:51.398 DEBUG:teuthology.orchestra.run.smithi114:> 2023-10-18T12:19:51.398 DEBUG:teuthology.orchestra.run.smithi114:> print(_find_admin_socket("client.admin")) 2023-10-18T12:19:51.398 DEBUG:teuthology.orchestra.run.smithi114:> ' 2023-10-18T12:19:51.555 INFO:teuthology.orchestra.run.smithi114.stdout:/var/run/ceph/ceph-client.admin.41634.asok 2023-10-18T12:19:51.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-18T12:19:51.579 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.41634.asok 2023-10-18T12:19:51.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:19:51.579 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.41634.asok status 2023-10-18T12:19:51.773 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T12:19:51.774 INFO:teuthology.orchestra.run.smithi114.stdout: "metadata": { 2023-10-18T12:19:51.774 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_sha1": "6f3e6b48891b9b50415c0822b6b870797fcda16d", 2023-10-18T12:19:51.774 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_version": "ceph version 18.0.0-5610-g6f3e6b48 (6f3e6b48891b9b50415c0822b6b870797fcda16d) reef (dev)", 2023-10-18T12:19:51.774 INFO:teuthology.orchestra.run.smithi114.stdout: "entity_id": "admin", 2023-10-18T12:19:51.774 INFO:teuthology.orchestra.run.smithi114.stdout: "hostname": "smithi114", 2023-10-18T12:19:51.774 INFO:teuthology.orchestra.run.smithi114.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-10-18T12:19:51.775 INFO:teuthology.orchestra.run.smithi114.stdout: "pid": "41634", 2023-10-18T12:19:51.775 INFO:teuthology.orchestra.run.smithi114.stdout: "root": "/" 2023-10-18T12:19:51.775 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T12:19:51.775 INFO:teuthology.orchestra.run.smithi114.stdout: "dentry_count": 0, 2023-10-18T12:19:51.775 INFO:teuthology.orchestra.run.smithi114.stdout: "dentry_pinned_count": 0, 2023-10-18T12:19:51.776 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4467, 2023-10-18T12:19:51.776 INFO:teuthology.orchestra.run.smithi114.stdout: "inst": { 2023-10-18T12:19:51.776 INFO:teuthology.orchestra.run.smithi114.stdout: "name": { 2023-10-18T12:19:51.776 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "client", 2023-10-18T12:19:51.776 INFO:teuthology.orchestra.run.smithi114.stdout: "num": 4467 2023-10-18T12:19:51.776 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T12:19:51.777 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": { 2023-10-18T12:19:51.777 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v1", 2023-10-18T12:19:51.777 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "192.168.0.1:0", 2023-10-18T12:19:51.777 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 225040256 2023-10-18T12:19:51.777 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T12:19:51.778 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T12:19:51.778 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": { 2023-10-18T12:19:51.778 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v1", 2023-10-18T12:19:51.778 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "192.168.0.1:0", 2023-10-18T12:19:51.778 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 225040256 2023-10-18T12:19:51.778 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T12:19:51.779 INFO:teuthology.orchestra.run.smithi114.stdout: "inst_str": "client.4467 192.168.0.1:0/225040256", 2023-10-18T12:19:51.779 INFO:teuthology.orchestra.run.smithi114.stdout: "addr_str": "192.168.0.1:0/225040256", 2023-10-18T12:19:51.779 INFO:teuthology.orchestra.run.smithi114.stdout: "inode_count": 1, 2023-10-18T12:19:51.779 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_epoch": 7, 2023-10-18T12:19:51.779 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_epoch": 28, 2023-10-18T12:19:51.779 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_epoch_barrier": 0, 2023-10-18T12:19:51.780 INFO:teuthology.orchestra.run.smithi114.stdout: "blocklisted": false, 2023-10-18T12:19:51.780 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs" 2023-10-18T12:19:51.780 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T12:19:51.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:19:51.788 DEBUG:teuthology.orchestra.run.smithi114:> stat --file-system '--printf=%T 2023-10-18T12:19:51.788 DEBUG:teuthology.orchestra.run.smithi114:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-10-18T12:19:51.807 INFO:teuthology.orchestra.run.smithi114.stdout:fuseblk 2023-10-18T12:19:51.807 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-10-18T12:19:51.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:19:51.808 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-10-18T12:19:51.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:19:51.889 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-10-18T12:19:52.012 INFO:teuthology.orchestra.run.smithi114.stdout:# file: . 2023-10-18T12:19:52.012 INFO:teuthology.orchestra.run.smithi114.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-10-18T12:19:52.012 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:19:52.014 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:19:52.014 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-18T12:19:52.031 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T12:19:52.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.258+0000 7f57f1cbc700 1 Processor -- start 2023-10-18T12:19:52.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.258+0000 7f57f1cbc700 1 -- start start 2023-10-18T12:19:52.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.262+0000 7f57f1cbc700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f57ec06e8a0 0x7f57ec0cb190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:52.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.262+0000 7f57f1cbc700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f57ec0cb6d0 0x7f57ec06f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:52.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.262+0000 7f57f1cbc700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57ec15e130 con 0x7f57ec154040 2023-10-18T12:19:52.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.262+0000 7f57f1cbc700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57ec0cbb60 con 0x7f57ec0cb6d0 2023-10-18T12:19:52.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.262+0000 7f57f1cbc700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57ec0cdfa0 con 0x7f57ec06e8a0 2023-10-18T12:19:52.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.262+0000 7f57ebfff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f57ec0cb6d0 0x7f57ec06f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:52.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.262+0000 7f57ebfff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f57ec0cb6d0 0x7f57ec06f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51366/0 (socket says 172.21.15.114:51366) 2023-10-18T12:19:52.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.262+0000 7f57ebfff700 1 -- 172.21.15.114:0/3176122777 learned_addr learned my addr 172.21.15.114:0/3176122777 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:52.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.262+0000 7f57e3fff700 1 --2- 172.21.15.114:0/3176122777 >> v2:172.21.15.172:3300/0 conn(0x7f57ec06e8a0 0x7f57ec0cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:52.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.262+0000 7f57ebfff700 1 -- 172.21.15.114:0/3176122777 >> v2:172.21.15.172:3300/0 conn(0x7f57ec06e8a0 msgr2=0x7f57ec0cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:52.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.262+0000 7f57ebfff700 1 --2- 172.21.15.114:0/3176122777 >> v2:172.21.15.172:3300/0 conn(0x7f57ec06e8a0 0x7f57ec0cb190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:52.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.262+0000 7f57ebfff700 1 -- 172.21.15.114:0/3176122777 >> v1:172.21.15.172:6789/0 conn(0x7f57ec154040 legacy=0x7f57ec0cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:52.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.262+0000 7f57ebfff700 1 -- 172.21.15.114:0/3176122777 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57ec0ce1b0 con 0x7f57ec0cb6d0 2023-10-18T12:19:52.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.262+0000 7f57ebfff700 1 --2- 172.21.15.114:0/3176122777 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57ec0cb6d0 0x7f57ec06f970 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f57ec06b010 tx=0x7f57e400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2176b199693146d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:52.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.262+0000 7f57eaffd700 1 -- 172.21.15.114:0/3176122777 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e400e070 con 0x7f57ec0cb6d0 2023-10-18T12:19:52.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.262+0000 7f57eaffd700 1 -- 172.21.15.114:0/3176122777 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57e400b9c0 con 0x7f57ec0cb6d0 2023-10-18T12:19:52.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.262+0000 7f57eaffd700 1 -- 172.21.15.114:0/3176122777 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e400bd70 con 0x7f57ec0cb6d0 2023-10-18T12:19:52.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.262+0000 7f57f1cbc700 1 -- 172.21.15.114:0/3176122777 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57ec0cb6d0 msgr2=0x7f57ec06f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:52.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.262+0000 7f57f1cbc700 1 --2- 172.21.15.114:0/3176122777 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57ec0cb6d0 0x7f57ec06f970 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f57ec06b010 tx=0x7f57e400b330 comp rx=0 tx=0).stop 2023-10-18T12:19:52.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.266+0000 7f57f1cbc700 1 -- 172.21.15.114:0/3176122777 shutdown_connections 2023-10-18T12:19:52.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.266+0000 7f57f1cbc700 1 --2- 172.21.15.114:0/3176122777 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57ec0cb6d0 0x7f57ec06f970 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:52.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.266+0000 7f57f1cbc700 1 --2- 172.21.15.114:0/3176122777 >> v2:172.21.15.172:3300/0 conn(0x7f57ec06e8a0 0x7f57ec0cb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:52.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.266+0000 7f57f1cbc700 1 -- 172.21.15.114:0/3176122777 >> 172.21.15.114:0/3176122777 conn(0x7f57ec06a340 msgr2=0x7f57ec0b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:52.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.266+0000 7f57f1cbc700 1 -- 172.21.15.114:0/3176122777 shutdown_connections 2023-10-18T12:19:52.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.266+0000 7f57f1cbc700 1 -- 172.21.15.114:0/3176122777 wait complete. 2023-10-18T12:19:52.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.266+0000 7f57f1cbc700 1 Processor -- start 2023-10-18T12:19:52.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.266+0000 7f57f1cbc700 1 -- start start 2023-10-18T12:19:52.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.270+0000 7f57f1cbc700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f57ec06e8a0 0x7f57ec1485d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:52.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.270+0000 7f57f1cbc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57ec0cb6d0 0x7f57ec14ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:52.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.270+0000 7f57f1cbc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57ec154040 0x7f57ec150650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:52.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.270+0000 7f57f1cbc700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57ec157200 con 0x7f57ec0cb6d0 2023-10-18T12:19:52.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.270+0000 7f57f1cbc700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57ec1515b0 con 0x7f57ec154040 2023-10-18T12:19:52.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.270+0000 7f57f1cbc700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57ec151890 con 0x7f57ec06e8a0 2023-10-18T12:19:52.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.270+0000 7f57e3fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57ec0cb6d0 0x7f57ec14ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:52.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.270+0000 7f57e3fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57ec0cb6d0 0x7f57ec14ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51374/0 (socket says 172.21.15.114:51374) 2023-10-18T12:19:52.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.270+0000 7f57e3fff700 1 -- 172.21.15.114:0/4154114122 learned_addr learned my addr 172.21.15.114:0/4154114122 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:52.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.270+0000 7f57ebfff700 1 --2- 172.21.15.114:0/4154114122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57ec154040 0x7f57ec150650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:52.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.270+0000 7f57eb7fe700 1 --2- 172.21.15.114:0/4154114122 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f57ec06e8a0 0x7f57ec1485d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:52.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.270+0000 7f57e3fff700 1 -- 172.21.15.114:0/4154114122 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f57ec06e8a0 msgr2=0x7f57ec1485d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:52.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.270+0000 7f57e3fff700 1 --2- 172.21.15.114:0/4154114122 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f57ec06e8a0 0x7f57ec1485d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:52.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.270+0000 7f57e3fff700 1 -- 172.21.15.114:0/4154114122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57ec154040 msgr2=0x7f57ec150650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:52.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.270+0000 7f57e3fff700 1 --2- 172.21.15.114:0/4154114122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57ec154040 0x7f57ec150650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:52.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.270+0000 7f57e3fff700 1 -- 172.21.15.114:0/4154114122 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e4009b30 con 0x7f57ec0cb6d0 2023-10-18T12:19:52.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.270+0000 7f57e3fff700 1 --2- 172.21.15.114:0/4154114122 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57ec0cb6d0 0x7f57ec14ea50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f57d400e760 tx=0x7f57d400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:52.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.270+0000 7f57e8ff9700 1 -- 172.21.15.114:0/4154114122 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d400c070 con 0x7f57ec0cb6d0 2023-10-18T12:19:52.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.270+0000 7f57e8ff9700 1 -- 172.21.15.114:0/4154114122 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d4013610 con 0x7f57ec0cb6d0 2023-10-18T12:19:52.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.270+0000 7f57f1cbc700 1 -- 172.21.15.114:0/4154114122 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57ec151b70 con 0x7f57ec0cb6d0 2023-10-18T12:19:52.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.270+0000 7f57e8ff9700 1 -- 172.21.15.114:0/4154114122 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d4013980 con 0x7f57ec0cb6d0 2023-10-18T12:19:52.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.274+0000 7f57f1cbc700 1 -- 172.21.15.114:0/4154114122 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57ec148b10 con 0x7f57ec0cb6d0 2023-10-18T12:19:52.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.274+0000 7f57f1cbc700 1 -- 172.21.15.114:0/4154114122 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57ec151db0 con 0x7f57ec0cb6d0 2023-10-18T12:19:52.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.274+0000 7f57e8ff9700 1 -- 172.21.15.114:0/4154114122 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f57d4013ae0 con 0x7f57ec0cb6d0 2023-10-18T12:19:52.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.278+0000 7f57e8ff9700 1 --2- 172.21.15.114:0/4154114122 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f57cc065720 0x7f57cc067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:52.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.278+0000 7f57e8ff9700 1 -- 172.21.15.114:0/4154114122 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f57d4082e70 con 0x7f57ec0cb6d0 2023-10-18T12:19:52.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.278+0000 7f57eb7fe700 1 --2- 172.21.15.114:0/4154114122 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f57cc065720 0x7f57cc067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:52.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.278+0000 7f57eb7fe700 1 --2- 172.21.15.114:0/4154114122 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f57cc065720 0x7f57cc067be0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f57dc000f60 tx=0x7f57dc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:52.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.282+0000 7f57e8ff9700 1 -- 172.21.15.114:0/4154114122 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f57ec151db0 con 0x7f57ec0cb6d0 2023-10-18T12:19:52.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.470+0000 7f57f1cbc700 1 -- 172.21.15.114:0/4154114122 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57ec0b0ca0 con 0x7f57ec0cb6d0 2023-10-18T12:19:52.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.470+0000 7f57e8ff9700 1 -- 172.21.15.114:0/4154114122 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20144 (secure 0 0 0) 0x7f57d4054030 con 0x7f57ec0cb6d0 2023-10-18T12:19:52.475 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:19:52.475 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":28,"fsid":"240ea340-5d3d-4f52-a4bc-af075aca3deb","created":"2023-10-18T12:19:12.512994+0000","modified":"2023-10-18T12:19:44.436656+0000","last_up_change":"2023-10-18T12:19:25.286009+0000","last_in_change":"2023-10-18T12:19:15.850693+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T12:19:27.040638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-18T12:19:32.358094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-18T12:19:37.333855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-18T12:19:38.055385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-18T12:19:41.679218+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c3578978-1a03-4857-b9d2-34a5da3d7731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6817","nonce":1506287862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6820","nonce":1506287862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6830","nonce":1506287862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6825","nonce":1506287862}]},"public_addr":"172.21.15.114:6817/1506287862","cluster_addr":"172.21.15.114:6820/1506287862","heartbeat_back_addr":"172.21.15.114:6830/1506287862","heartbeat_front_addr":"172.21.15.114:6825/1506287862","state":["exists","up"]},{"osd":1,"uuid":"43eb26a6-e2b3-4670-9559-bd053b5140d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6801","nonce":3302727047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6803","nonce":3302727047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6807","nonce":3302727047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6805","nonce":3302727047}]},"public_addr":"172.21.15.114:6801/3302727047","cluster_addr":"172.21.15.114:6803/3302727047","heartbeat_back_addr":"172.21.15.114:6807/3302727047","heartbeat_front_addr":"172.21.15.114:6805/3302727047","state":["exists","up"]},{"osd":2,"uuid":"f3d4dbd5-521c-4dd2-b687-5768cc7d0938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6809","nonce":2699151351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6811","nonce":2699151351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6815","nonce":2699151351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6813","nonce":2699151351}]},"public_addr":"172.21.15.114:6809/2699151351","cluster_addr":"172.21.15.114:6811/2699151351","heartbeat_back_addr":"172.21.15.114:6815/2699151351","heartbeat_front_addr":"172.21.15.114:6813/2699151351","state":["exists","up"]},{"osd":3,"uuid":"823e5802-92b7-4f0d-b32d-a5748993f1b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6821","nonce":1361608073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6824","nonce":1361608073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6829","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6831","nonce":1361608073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6827","nonce":1361608073}]},"public_addr":"172.21.15.114:6821/1361608073","cluster_addr":"172.21.15.114:6824/1361608073","heartbeat_back_addr":"172.21.15.114:6831/1361608073","heartbeat_front_addr":"172.21.15.114:6827/1361608073","state":["exists","up"]},{"osd":4,"uuid":"e47fb93e-13b4-44a4-b084-8c4384ceb41e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6801","nonce":930839681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6803","nonce":930839681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6807","nonce":930839681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6805","nonce":930839681}]},"public_addr":"172.21.15.172:6801/930839681","cluster_addr":"172.21.15.172:6803/930839681","heartbeat_back_addr":"172.21.15.172:6807/930839681","heartbeat_front_addr":"172.21.15.172:6805/930839681","state":["exists","up"]},{"osd":5,"uuid":"7561a973-f479-45a0-af40-f324728d622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6814","nonce":571761850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6818","nonce":571761850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6824","nonce":571761850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6821","nonce":571761850}]},"public_addr":"172.21.15.172:6814/571761850","cluster_addr":"172.21.15.172:6818/571761850","heartbeat_back_addr":"172.21.15.172:6824/571761850","heartbeat_front_addr":"172.21.15.172:6821/571761850","state":["exists","up"]},{"osd":6,"uuid":"51753f4b-7f06-4f1c-9ec7-6e18a66eb980","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6825","nonce":1680398853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6827","nonce":1680398853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6831","nonce":1680398853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6829","nonce":1680398853}]},"public_addr":"172.21.15.172:6825/1680398853","cluster_addr":"172.21.15.172:6827/1680398853","heartbeat_back_addr":"172.21.15.172:6831/1680398853","heartbeat_front_addr":"172.21.15.172:6829/1680398853","state":["exists","up"]},{"osd":7,"uuid":"4d8b1e15-143d-4d17-9074-59d92f0f9af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6809","nonce":349710101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6811","nonce":349710101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6819","nonce":349710101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6815","nonce":349710101}]},"public_addr":"172.21.15.172:6809/349710101","cluster_addr":"172.21.15.172:6811/349710101","heartbeat_back_addr":"172.21.15.172:6819/349710101","heartbeat_front_addr":"172.21.15.172:6815/349710101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.889460+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.475494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.911473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.648596+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.609994+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.636248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.854589+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.885826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T12:19:52.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.474+0000 7f57f1cbc700 1 -- 172.21.15.114:0/4154114122 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f57cc065720 msgr2=0x7f57cc067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:52.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.474+0000 7f57f1cbc700 1 --2- 172.21.15.114:0/4154114122 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f57cc065720 0x7f57cc067be0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f57dc000f60 tx=0x7f57dc009040 comp rx=0 tx=0).stop 2023-10-18T12:19:52.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.474+0000 7f57f1cbc700 1 -- 172.21.15.114:0/4154114122 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57ec0cb6d0 msgr2=0x7f57ec14ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:52.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.474+0000 7f57f1cbc700 1 --2- 172.21.15.114:0/4154114122 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57ec0cb6d0 0x7f57ec14ea50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f57d400e760 tx=0x7f57d400ea70 comp rx=0 tx=0).stop 2023-10-18T12:19:52.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.474+0000 7f57f1cbc700 1 -- 172.21.15.114:0/4154114122 shutdown_connections 2023-10-18T12:19:52.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.474+0000 7f57f1cbc700 1 --2- 172.21.15.114:0/4154114122 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f57cc065720 0x7f57cc067be0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:52.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.474+0000 7f57f1cbc700 1 --2- 172.21.15.114:0/4154114122 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f57ec154040 0x7f57ec150650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:52.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.474+0000 7f57f1cbc700 1 --2- 172.21.15.114:0/4154114122 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57ec0cb6d0 0x7f57ec14ea50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:52.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.474+0000 7f57f1cbc700 1 --2- 172.21.15.114:0/4154114122 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f57ec06e8a0 0x7f57ec1485d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:52.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.474+0000 7f57f1cbc700 1 -- 172.21.15.114:0/4154114122 >> 172.21.15.114:0/4154114122 conn(0x7f57ec06a340 msgr2=0x7f57ec0af8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:52.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.478+0000 7f57f1cbc700 1 -- 172.21.15.114:0/4154114122 shutdown_connections 2023-10-18T12:19:52.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.478+0000 7f57f1cbc700 1 -- 172.21.15.114:0/4154114122 wait complete. 2023-10-18T12:19:52.502 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-18T12:19:27.040638+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-18T12:19:32.358094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-18T12:19:37.333855+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-18T12:19:38.055385+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-18T12:19:41.679218+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-18T12:19:52.503 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-18T12:19:52.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.674+0000 7f908655d700 1 Processor -- start 2023-10-18T12:19:52.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.674+0000 7f908655d700 1 -- start start 2023-10-18T12:19:52.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.674+0000 7f908655d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f90801467c0 0x7f90800b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:52.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.674+0000 7f908655d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f908006f9a0 0x7f908006fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:52.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.678+0000 7f908655d700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9080146ba0 con 0x7f90801612e0 2023-10-18T12:19:52.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.678+0000 7f908655d700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90800d0920 con 0x7f90801467c0 2023-10-18T12:19:52.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.678+0000 7f908655d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9080070320 con 0x7f908006f9a0 2023-10-18T12:19:52.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.678+0000 7f907ffff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f90801467c0 0x7f90800b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:52.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.678+0000 7f907ffff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f90801467c0 0x7f90800b5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51384/0 (socket says 172.21.15.114:51384) 2023-10-18T12:19:52.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.678+0000 7f907ffff700 1 -- 172.21.15.114:0/101720025 learned_addr learned my addr 172.21.15.114:0/101720025 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:52.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.678+0000 7f9084afa700 1 --2- 172.21.15.114:0/101720025 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f908006f9a0 0x7f908006fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:52.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.678+0000 7f907ffff700 1 -- 172.21.15.114:0/101720025 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f908006f9a0 msgr2=0x7f908006fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:52.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.678+0000 7f907ffff700 1 --2- 172.21.15.114:0/101720025 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f908006f9a0 0x7f908006fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:52.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.678+0000 7f907ffff700 1 -- 172.21.15.114:0/101720025 >> v1:172.21.15.172:6789/0 conn(0x7f90801612e0 legacy=0x7f908015d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:52.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.678+0000 7f907ffff700 1 -- 172.21.15.114:0/101720025 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90800b6160 con 0x7f90801467c0 2023-10-18T12:19:52.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.678+0000 7f907ffff700 1 --2- 172.21.15.114:0/101720025 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90801467c0 0x7f90800b5b80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9070009910 tx=0x7f9070009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aac6bf9d1182f38 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:52.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.678+0000 7f907f7fe700 1 -- 172.21.15.114:0/101720025 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9070011830 con 0x7f90801467c0 2023-10-18T12:19:52.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.678+0000 7f907f7fe700 1 -- 172.21.15.114:0/101720025 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9070011990 con 0x7f90801467c0 2023-10-18T12:19:52.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.678+0000 7f907f7fe700 1 -- 172.21.15.114:0/101720025 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9070011d40 con 0x7f90801467c0 2023-10-18T12:19:52.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.678+0000 7f908655d700 1 -- 172.21.15.114:0/101720025 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90801467c0 msgr2=0x7f90800b5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:52.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.678+0000 7f908655d700 1 --2- 172.21.15.114:0/101720025 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90801467c0 0x7f90800b5b80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9070009910 tx=0x7f9070009c20 comp rx=0 tx=0).stop 2023-10-18T12:19:52.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.678+0000 7f908655d700 1 -- 172.21.15.114:0/101720025 shutdown_connections 2023-10-18T12:19:52.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.678+0000 7f908655d700 1 --2- 172.21.15.114:0/101720025 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f908006f9a0 0x7f908006fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:52.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.678+0000 7f908655d700 1 --2- 172.21.15.114:0/101720025 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90801467c0 0x7f90800b5b80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:52.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.678+0000 7f908655d700 1 -- 172.21.15.114:0/101720025 >> 172.21.15.114:0/101720025 conn(0x7f908006a130 msgr2=0x7f908006a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:52.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.678+0000 7f908655d700 1 -- 172.21.15.114:0/101720025 shutdown_connections 2023-10-18T12:19:52.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.678+0000 7f908655d700 1 -- 172.21.15.114:0/101720025 wait complete. 2023-10-18T12:19:52.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.682+0000 7f908655d700 1 Processor -- start 2023-10-18T12:19:52.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.682+0000 7f908655d700 1 -- start start 2023-10-18T12:19:52.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.686+0000 7f908655d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f908006f9a0 0x7f908015cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:52.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.686+0000 7f908655d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90801467c0 0x7f90800b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:52.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.686+0000 7f908655d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90801612e0 0x7f908015ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:52.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.686+0000 7f908655d700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908015d190 con 0x7f90801467c0 2023-10-18T12:19:52.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.686+0000 7f908655d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90800b45f0 con 0x7f90801612e0 2023-10-18T12:19:52.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.686+0000 7f908655d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90800c8020 con 0x7f908006f9a0 2023-10-18T12:19:52.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.686+0000 7f90777fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90801467c0 0x7f90800b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:52.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.686+0000 7f90777fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90801467c0 0x7f90800b3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51388/0 (socket says 172.21.15.114:51388) 2023-10-18T12:19:52.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.686+0000 7f90777fe700 1 -- 172.21.15.114:0/1616198762 learned_addr learned my addr 172.21.15.114:0/1616198762 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:52.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.686+0000 7f907ffff700 1 --2- 172.21.15.114:0/1616198762 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f908006f9a0 0x7f908015cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:52.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.686+0000 7f9084afa700 1 --2- 172.21.15.114:0/1616198762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90801612e0 0x7f908015ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:52.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.686+0000 7f90777fe700 1 -- 172.21.15.114:0/1616198762 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f908006f9a0 msgr2=0x7f908015cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:52.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.686+0000 7f90777fe700 1 --2- 172.21.15.114:0/1616198762 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f908006f9a0 0x7f908015cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:52.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.686+0000 7f90777fe700 1 -- 172.21.15.114:0/1616198762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90801612e0 msgr2=0x7f908015ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:52.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.686+0000 7f90777fe700 1 --2- 172.21.15.114:0/1616198762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90801612e0 0x7f908015ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:52.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.686+0000 7f90777fe700 1 -- 172.21.15.114:0/1616198762 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9070009570 con 0x7f90801467c0 2023-10-18T12:19:52.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.686+0000 7f90777fe700 1 --2- 172.21.15.114:0/1616198762 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90801467c0 0x7f90800b3c80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f906800c500 tx=0x7f906800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:52.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.686+0000 7f907d7fa700 1 -- 172.21.15.114:0/1616198762 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90680052d0 con 0x7f90801467c0 2023-10-18T12:19:52.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.686+0000 7f907d7fa700 1 -- 172.21.15.114:0/1616198762 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9068005430 con 0x7f90801467c0 2023-10-18T12:19:52.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.686+0000 7f908655d700 1 -- 172.21.15.114:0/1616198762 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90800c8300 con 0x7f90801467c0 2023-10-18T12:19:52.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.686+0000 7f907d7fa700 1 -- 172.21.15.114:0/1616198762 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90680055a0 con 0x7f90801467c0 2023-10-18T12:19:52.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.686+0000 7f908655d700 1 -- 172.21.15.114:0/1616198762 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90800b41c0 con 0x7f90801467c0 2023-10-18T12:19:52.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.690+0000 7f908655d700 1 -- 172.21.15.114:0/1616198762 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90800c7e80 con 0x7f90801467c0 2023-10-18T12:19:52.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.690+0000 7f907d7fa700 1 -- 172.21.15.114:0/1616198762 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f90680038e0 con 0x7f90801467c0 2023-10-18T12:19:52.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.690+0000 7f907d7fa700 1 --2- 172.21.15.114:0/1616198762 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f90600656f0 0x7f9060067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:52.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.690+0000 7f907d7fa700 1 -- 172.21.15.114:0/1616198762 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9068082370 con 0x7f90801467c0 2023-10-18T12:19:52.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.690+0000 7f907ffff700 1 --2- 172.21.15.114:0/1616198762 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f90600656f0 0x7f9060067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:52.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.694+0000 7f907ffff700 1 --2- 172.21.15.114:0/1616198762 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f90600656f0 0x7f9060067bb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9070000c00 tx=0x7f9070008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:52.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.698+0000 7f907d7fa700 1 -- 172.21.15.114:0/1616198762 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f90800c7e80 con 0x7f90801467c0 2023-10-18T12:19:52.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.874+0000 7f908655d700 1 -- 172.21.15.114:0/1616198762 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f90800c7e80 con 0x7f90801467c0 2023-10-18T12:19:52.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.874+0000 7f907d7fa700 1 -- 172.21.15.114:0/1616198762 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f90800c7e80 con 0x7f90801467c0 2023-10-18T12:19:52.878 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-10-18T12:19:52.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.878+0000 7f908655d700 1 -- 172.21.15.114:0/1616198762 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f90600656f0 msgr2=0x7f9060067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:52.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.878+0000 7f908655d700 1 --2- 172.21.15.114:0/1616198762 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f90600656f0 0x7f9060067bb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9070000c00 tx=0x7f9070008030 comp rx=0 tx=0).stop 2023-10-18T12:19:52.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.878+0000 7f908655d700 1 -- 172.21.15.114:0/1616198762 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90801467c0 msgr2=0x7f90800b3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:52.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.878+0000 7f908655d700 1 --2- 172.21.15.114:0/1616198762 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90801467c0 0x7f90800b3c80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f906800c500 tx=0x7f906800c810 comp rx=0 tx=0).stop 2023-10-18T12:19:52.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.878+0000 7f908655d700 1 -- 172.21.15.114:0/1616198762 shutdown_connections 2023-10-18T12:19:52.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.878+0000 7f908655d700 1 --2- 172.21.15.114:0/1616198762 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f90600656f0 0x7f9060067bb0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:52.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.878+0000 7f908655d700 1 --2- 172.21.15.114:0/1616198762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90801612e0 0x7f908015ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:52.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.878+0000 7f908655d700 1 --2- 172.21.15.114:0/1616198762 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90801467c0 0x7f90800b3c80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:52.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.878+0000 7f908655d700 1 --2- 172.21.15.114:0/1616198762 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f908006f9a0 0x7f908015cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:52.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.878+0000 7f908655d700 1 -- 172.21.15.114:0/1616198762 >> 172.21.15.114:0/1616198762 conn(0x7f908006a130 msgr2=0x7f908006cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:52.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.878+0000 7f908655d700 1 -- 172.21.15.114:0/1616198762 shutdown_connections 2023-10-18T12:19:52.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:52.878+0000 7f908655d700 1 -- 172.21.15.114:0/1616198762 wait complete. 2023-10-18T12:19:52.904 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-18T12:19:53.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.086+0000 7f2854b91700 1 Processor -- start 2023-10-18T12:19:53.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.090+0000 7f2854b91700 1 -- start start 2023-10-18T12:19:53.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.090+0000 7f2854b91700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f28501467c0 0x7f28500b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:53.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.090+0000 7f2854b91700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f285006f9a0 0x7f285006fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:53.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.090+0000 7f2854b91700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2850146ba0 con 0x7f28501612e0 2023-10-18T12:19:53.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.090+0000 7f2854b91700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28500d0920 con 0x7f28501467c0 2023-10-18T12:19:53.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.090+0000 7f2854b91700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2850070320 con 0x7f285006f9a0 2023-10-18T12:19:53.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.090+0000 7f284dd9b700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f28501612e0 0x7f285015d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52110/0 (socket says 172.21.15.114:52110) 2023-10-18T12:19:53.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.090+0000 7f284dd9b700 1 -- 172.21.15.114:0/1379318616 learned_addr learned my addr 172.21.15.114:0/1379318616 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:19:53.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.090+0000 7f284e59c700 1 --2- 172.21.15.114:0/1379318616 >> v2:172.21.15.114:3300/0 conn(0x7f28501467c0 0x7f28500b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:53.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.090+0000 7f284ed9d700 1 --2- 172.21.15.114:0/1379318616 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f285006f9a0 0x7f285006fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:53.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.094+0000 7f284d59a700 1 -- 172.21.15.114:0/1379318616 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3141204720 0 0) 0x7f2850146ba0 con 0x7f28501612e0 2023-10-18T12:19:53.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.094+0000 7f284d59a700 1 -- 172.21.15.114:0/1379318616 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28380035d0 con 0x7f28501612e0 2023-10-18T12:19:53.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.094+0000 7f284e59c700 1 -- 172.21.15.114:0/1379318616 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f285006f9a0 msgr2=0x7f285006fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:53.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.094+0000 7f284e59c700 1 --2- 172.21.15.114:0/1379318616 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f285006f9a0 0x7f285006fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:53.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.094+0000 7f284e59c700 1 -- 172.21.15.114:0/1379318616 >> v1:172.21.15.114:6789/0 conn(0x7f28501612e0 legacy=0x7f285015d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:53.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.094+0000 7f284e59c700 1 -- 172.21.15.114:0/1379318616 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28500b6160 con 0x7f28501467c0 2023-10-18T12:19:53.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.094+0000 7f284e59c700 1 --2- 172.21.15.114:0/1379318616 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28501467c0 0x7f28500b5b80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2840009850 tx=0x7f2840009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1841e784bcae98d server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:53.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.094+0000 7f284d59a700 1 -- 172.21.15.114:0/1379318616 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2840011830 con 0x7f28501467c0 2023-10-18T12:19:53.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.094+0000 7f284d59a700 1 -- 172.21.15.114:0/1379318616 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2840011990 con 0x7f28501467c0 2023-10-18T12:19:53.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.094+0000 7f284d59a700 1 -- 172.21.15.114:0/1379318616 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2840011d00 con 0x7f28501467c0 2023-10-18T12:19:53.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.094+0000 7f2854b91700 1 -- 172.21.15.114:0/1379318616 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28501467c0 msgr2=0x7f28500b5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:53.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.094+0000 7f2854b91700 1 --2- 172.21.15.114:0/1379318616 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28501467c0 0x7f28500b5b80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2840009850 tx=0x7f2840009b60 comp rx=0 tx=0).stop 2023-10-18T12:19:53.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.094+0000 7f2854b91700 1 -- 172.21.15.114:0/1379318616 shutdown_connections 2023-10-18T12:19:53.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.094+0000 7f2854b91700 1 --2- 172.21.15.114:0/1379318616 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f285006f9a0 0x7f285006fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:53.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.094+0000 7f2854b91700 1 --2- 172.21.15.114:0/1379318616 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28501467c0 0x7f28500b5b80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:53.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.094+0000 7f2854b91700 1 -- 172.21.15.114:0/1379318616 >> 172.21.15.114:0/1379318616 conn(0x7f285006a130 msgr2=0x7f285006a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:53.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.094+0000 7f2854b91700 1 -- 172.21.15.114:0/1379318616 shutdown_connections 2023-10-18T12:19:53.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.094+0000 7f2854b91700 1 -- 172.21.15.114:0/1379318616 wait complete. 2023-10-18T12:19:53.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.098+0000 7f2854b91700 1 Processor -- start 2023-10-18T12:19:53.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.098+0000 7f2854b91700 1 -- start start 2023-10-18T12:19:53.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.102+0000 7f2854b91700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f285006f9a0 0x7f285015e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:53.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.102+0000 7f2854b91700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f28501467c0 0x7f2850140300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:53.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.102+0000 7f2854b91700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28501612e0 0x7f2850140840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:53.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.102+0000 7f2854b91700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28501f2530 con 0x7f28501612e0 2023-10-18T12:19:53.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.102+0000 7f2854b91700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28500cedb0 con 0x7f285006f9a0 2023-10-18T12:19:53.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.102+0000 7f2854b91700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f285015ed50 con 0x7f28501467c0 2023-10-18T12:19:53.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.102+0000 7f284ed9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28501612e0 0x7f2850140840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:53.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.102+0000 7f284ed9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28501612e0 0x7f2850140840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51406/0 (socket says 172.21.15.114:51406) 2023-10-18T12:19:53.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.102+0000 7f284ed9d700 1 -- 172.21.15.114:0/3594485636 learned_addr learned my addr 172.21.15.114:0/3594485636 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:53.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.102+0000 7f284dd9b700 1 --2- 172.21.15.114:0/3594485636 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f28501467c0 0x7f2850140300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:53.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.102+0000 7f284e59c700 1 --2- 172.21.15.114:0/3594485636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f285006f9a0 0x7f285015e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:53.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.102+0000 7f284ed9d700 1 -- 172.21.15.114:0/3594485636 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f28501467c0 msgr2=0x7f2850140300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:53.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.102+0000 7f284ed9d700 1 --2- 172.21.15.114:0/3594485636 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f28501467c0 0x7f2850140300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:53.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.102+0000 7f284ed9d700 1 -- 172.21.15.114:0/3594485636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f285006f9a0 msgr2=0x7f285015e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:53.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.102+0000 7f284ed9d700 1 --2- 172.21.15.114:0/3594485636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f285006f9a0 0x7f285015e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:53.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.102+0000 7f284ed9d700 1 -- 172.21.15.114:0/3594485636 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28400094b0 con 0x7f28501612e0 2023-10-18T12:19:53.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.102+0000 7f284ed9d700 1 --2- 172.21.15.114:0/3594485636 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28501612e0 0x7f2850140840 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f284800efc0 tx=0x7f284800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:53.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.102+0000 7f283effd700 1 -- 172.21.15.114:0/3594485636 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284800cd40 con 0x7f28501612e0 2023-10-18T12:19:53.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.102+0000 7f283effd700 1 -- 172.21.15.114:0/3594485636 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f284800f040 con 0x7f28501612e0 2023-10-18T12:19:53.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.102+0000 7f283effd700 1 -- 172.21.15.114:0/3594485636 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28480146c0 con 0x7f28501612e0 2023-10-18T12:19:53.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.102+0000 7f2854b91700 1 -- 172.21.15.114:0/3594485636 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f285015f030 con 0x7f28501612e0 2023-10-18T12:19:53.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.102+0000 7f2854b91700 1 -- 172.21.15.114:0/3594485636 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f285015f5f0 con 0x7f28501612e0 2023-10-18T12:19:53.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.106+0000 7f2854b91700 1 -- 172.21.15.114:0/3594485636 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2850072e60 con 0x7f28501612e0 2023-10-18T12:19:53.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.106+0000 7f283effd700 1 -- 172.21.15.114:0/3594485636 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f2848014820 con 0x7f28501612e0 2023-10-18T12:19:53.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.106+0000 7f283effd700 1 --2- 172.21.15.114:0/3594485636 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f28300656f0 0x7f2830067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:53.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.106+0000 7f283effd700 1 -- 172.21.15.114:0/3594485636 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2848083d50 con 0x7f28501612e0 2023-10-18T12:19:53.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.110+0000 7f284e59c700 1 --2- 172.21.15.114:0/3594485636 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f28300656f0 0x7f2830067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:53.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.110+0000 7f284e59c700 1 --2- 172.21.15.114:0/3594485636 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f28300656f0 0x7f2830067bb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f28400090b0 tx=0x7f2840008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:53.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.114+0000 7f283effd700 1 -- 172.21.15.114:0/3594485636 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f2848054f10 con 0x7f28501612e0 2023-10-18T12:19:53.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.290+0000 7f2854b91700 1 -- 172.21.15.114:0/3594485636 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f28500b7200 con 0x7f28501612e0 2023-10-18T12:19:53.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.290+0000 7f283effd700 1 -- 172.21.15.114:0/3594485636 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2848018020 con 0x7f28501612e0 2023-10-18T12:19:53.294 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 8 2023-10-18T12:19:53.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.294+0000 7f2854b91700 1 -- 172.21.15.114:0/3594485636 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f28300656f0 msgr2=0x7f2830067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:53.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.294+0000 7f2854b91700 1 --2- 172.21.15.114:0/3594485636 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f28300656f0 0x7f2830067bb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f28400090b0 tx=0x7f2840008030 comp rx=0 tx=0).stop 2023-10-18T12:19:53.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.294+0000 7f2854b91700 1 -- 172.21.15.114:0/3594485636 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28501612e0 msgr2=0x7f2850140840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:53.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.294+0000 7f2854b91700 1 --2- 172.21.15.114:0/3594485636 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28501612e0 0x7f2850140840 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f284800efc0 tx=0x7f284800c3a0 comp rx=0 tx=0).stop 2023-10-18T12:19:53.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.294+0000 7f2854b91700 1 -- 172.21.15.114:0/3594485636 shutdown_connections 2023-10-18T12:19:53.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.294+0000 7f2854b91700 1 --2- 172.21.15.114:0/3594485636 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f28300656f0 0x7f2830067bb0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:53.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.294+0000 7f2854b91700 1 --2- 172.21.15.114:0/3594485636 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f28501467c0 0x7f2850140300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:53.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.294+0000 7f2854b91700 1 --2- 172.21.15.114:0/3594485636 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28501612e0 0x7f2850140840 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:53.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.294+0000 7f2854b91700 1 --2- 172.21.15.114:0/3594485636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f285006f9a0 0x7f285015e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:53.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.294+0000 7f2854b91700 1 -- 172.21.15.114:0/3594485636 >> 172.21.15.114:0/3594485636 conn(0x7f285006a130 msgr2=0x7f285006cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:53.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.294+0000 7f2854b91700 1 -- 172.21.15.114:0/3594485636 shutdown_connections 2023-10-18T12:19:53.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.294+0000 7f2854b91700 1 -- 172.21.15.114:0/3594485636 wait complete. 2023-10-18T12:19:53.317 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-18T12:19:53.503 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.498+0000 7f646b977700 1 Processor -- start 2023-10-18T12:19:53.503 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.498+0000 7f646b977700 1 -- start start 2023-10-18T12:19:53.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.502+0000 7f646b977700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f64640b7d60 0x7f646406f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:53.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.502+0000 7f646b977700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f64641468c0 0x7f646406fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:53.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.502+0000 7f646b977700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64640b5d20 con 0x7f64641464e0 2023-10-18T12:19:53.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.502+0000 7f646b977700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64640b6000 con 0x7f64641468c0 2023-10-18T12:19:53.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.502+0000 7f646b977700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64640b62e0 con 0x7f64640b7d60 2023-10-18T12:19:53.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.502+0000 7f6469713700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f64641464e0 0x7f64640b7650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52116/0 (socket says 172.21.15.114:52116) 2023-10-18T12:19:53.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.502+0000 7f6469713700 1 -- 172.21.15.114:0/36248591 learned_addr learned my addr 172.21.15.114:0/36248591 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:19:53.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.502+0000 7f6469f14700 1 --2- 172.21.15.114:0/36248591 >> v2:172.21.15.114:3300/0 conn(0x7f64641468c0 0x7f646406fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:53.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.502+0000 7f6468f12700 1 --2- 172.21.15.114:0/36248591 >> v2:172.21.15.172:3300/0 conn(0x7f64640b7d60 0x7f646406f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:53.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.502+0000 7f645bfff700 1 -- 172.21.15.114:0/36248591 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2905505593 0 0) 0x7f64640b5d20 con 0x7f64641464e0 2023-10-18T12:19:53.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.502+0000 7f645bfff700 1 -- 172.21.15.114:0/36248591 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64500035d0 con 0x7f64641464e0 2023-10-18T12:19:53.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.502+0000 7f6469f14700 1 -- 172.21.15.114:0/36248591 >> v2:172.21.15.172:3300/0 conn(0x7f64640b7d60 msgr2=0x7f646406f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:53.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.502+0000 7f6469f14700 1 --2- 172.21.15.114:0/36248591 >> v2:172.21.15.172:3300/0 conn(0x7f64640b7d60 0x7f646406f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:53.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.502+0000 7f6469f14700 1 -- 172.21.15.114:0/36248591 >> v1:172.21.15.114:6789/0 conn(0x7f64641464e0 legacy=0x7f64640b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:53.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.502+0000 7f6469f14700 1 -- 172.21.15.114:0/36248591 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64640b65c0 con 0x7f64641468c0 2023-10-18T12:19:53.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.502+0000 7f6468f12700 1 --2- 172.21.15.114:0/36248591 >> v2:172.21.15.172:3300/0 conn(0x7f64640b7d60 0x7f646406f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:19:53.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.502+0000 7f6469f14700 1 --2- 172.21.15.114:0/36248591 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64641468c0 0x7f646406fef0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f64640d3c00 tx=0x7f645c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b318f9718cdff435 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:53.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.502+0000 7f645bfff700 1 -- 172.21.15.114:0/36248591 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c00e070 con 0x7f64641468c0 2023-10-18T12:19:53.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.502+0000 7f645bfff700 1 -- 172.21.15.114:0/36248591 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645c00bb20 con 0x7f64641468c0 2023-10-18T12:19:53.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.502+0000 7f645bfff700 1 -- 172.21.15.114:0/36248591 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c012430 con 0x7f64641468c0 2023-10-18T12:19:53.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.502+0000 7f646b977700 1 -- 172.21.15.114:0/36248591 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64641468c0 msgr2=0x7f646406fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:53.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.502+0000 7f646b977700 1 --2- 172.21.15.114:0/36248591 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64641468c0 0x7f646406fef0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f64640d3c00 tx=0x7f645c00b330 comp rx=0 tx=0).stop 2023-10-18T12:19:53.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.502+0000 7f646b977700 1 -- 172.21.15.114:0/36248591 shutdown_connections 2023-10-18T12:19:53.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.502+0000 7f646b977700 1 --2- 172.21.15.114:0/36248591 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64641468c0 0x7f646406fef0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:53.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.502+0000 7f646b977700 1 --2- 172.21.15.114:0/36248591 >> v2:172.21.15.172:3300/0 conn(0x7f64640b7d60 0x7f646406f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:53.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.502+0000 7f646b977700 1 -- 172.21.15.114:0/36248591 >> 172.21.15.114:0/36248591 conn(0x7f646406a130 msgr2=0x7f646406a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:53.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.506+0000 7f646b977700 1 -- 172.21.15.114:0/36248591 shutdown_connections 2023-10-18T12:19:53.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.506+0000 7f646b977700 1 -- 172.21.15.114:0/36248591 wait complete. 2023-10-18T12:19:53.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.506+0000 7f646b977700 1 Processor -- start 2023-10-18T12:19:53.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.506+0000 7f646b977700 1 -- start start 2023-10-18T12:19:53.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.506+0000 7f646b977700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64640b7d60 0x7f64640d3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:53.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.506+0000 7f646b977700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64641464e0 0x7f646413b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:53.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.506+0000 7f646b977700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f64641468c0 0x7f646415ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:53.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.506+0000 7f646b977700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6464160170 con 0x7f64641464e0 2023-10-18T12:19:53.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.506+0000 7f646b977700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646415ba60 con 0x7f64640b7d60 2023-10-18T12:19:53.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.506+0000 7f646b977700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f646415bd40 con 0x7f64641468c0 2023-10-18T12:19:53.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.506+0000 7f6468f12700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64641464e0 0x7f646413b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:53.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.506+0000 7f6468f12700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64641464e0 0x7f646413b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51424/0 (socket says 172.21.15.114:51424) 2023-10-18T12:19:53.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.506+0000 7f6468f12700 1 -- 172.21.15.114:0/3132753010 learned_addr learned my addr 172.21.15.114:0/3132753010 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:53.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.510+0000 7f6469713700 1 --2- 172.21.15.114:0/3132753010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64640b7d60 0x7f64640d3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:53.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.510+0000 7f6469f14700 1 --2- 172.21.15.114:0/3132753010 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f64641468c0 0x7f646415ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:53.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.510+0000 7f6468f12700 1 -- 172.21.15.114:0/3132753010 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f64641468c0 msgr2=0x7f646415ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:53.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.510+0000 7f6468f12700 1 --2- 172.21.15.114:0/3132753010 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f64641468c0 0x7f646415ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:53.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.510+0000 7f6468f12700 1 -- 172.21.15.114:0/3132753010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64640b7d60 msgr2=0x7f64640d3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:53.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.510+0000 7f6468f12700 1 --2- 172.21.15.114:0/3132753010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64640b7d60 0x7f64640d3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:53.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.510+0000 7f6468f12700 1 -- 172.21.15.114:0/3132753010 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f645c009a70 con 0x7f64641464e0 2023-10-18T12:19:53.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.510+0000 7f6469f14700 1 --2- 172.21.15.114:0/3132753010 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f64641468c0 0x7f646415ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:19:53.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.510+0000 7f6468f12700 1 --2- 172.21.15.114:0/3132753010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64641464e0 0x7f646413b450 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f645400e880 tx=0x7f645400eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:53.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.510+0000 7f6459ffb700 1 -- 172.21.15.114:0/3132753010 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6454013610 con 0x7f64641464e0 2023-10-18T12:19:53.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.510+0000 7f6459ffb700 1 -- 172.21.15.114:0/3132753010 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6454013770 con 0x7f64641464e0 2023-10-18T12:19:53.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.510+0000 7f6459ffb700 1 -- 172.21.15.114:0/3132753010 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6454013b00 con 0x7f64641464e0 2023-10-18T12:19:53.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.510+0000 7f646b977700 1 -- 172.21.15.114:0/3132753010 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f646415c020 con 0x7f64641464e0 2023-10-18T12:19:53.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.510+0000 7f646b977700 1 -- 172.21.15.114:0/3132753010 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f646413b990 con 0x7f64641464e0 2023-10-18T12:19:53.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.514+0000 7f646b977700 1 -- 172.21.15.114:0/3132753010 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6464072e60 con 0x7f64641464e0 2023-10-18T12:19:53.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.514+0000 7f6459ffb700 1 -- 172.21.15.114:0/3132753010 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f6454013c60 con 0x7f64641464e0 2023-10-18T12:19:53.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.514+0000 7f6459ffb700 1 --2- 172.21.15.114:0/3132753010 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6448065720 0x7f6448067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:53.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.514+0000 7f6459ffb700 1 -- 172.21.15.114:0/3132753010 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6454082ce0 con 0x7f64641464e0 2023-10-18T12:19:53.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.518+0000 7f6469713700 1 --2- 172.21.15.114:0/3132753010 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6448065720 0x7f6448067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:53.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.518+0000 7f6469713700 1 --2- 172.21.15.114:0/3132753010 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6448065720 0x7f6448067be0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6460007fd0 tx=0x7f6460007de0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:53.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.522+0000 7f6459ffb700 1 -- 172.21.15.114:0/3132753010 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f6454050410 con 0x7f64641464e0 2023-10-18T12:19:53.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.750+0000 7f646b977700 1 -- 172.21.15.114:0/3132753010 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f64640d3680 con 0x7f64641464e0 2023-10-18T12:19:53.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.754+0000 7f6459ffb700 1 -- 172.21.15.114:0/3132753010 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6454053a30 con 0x7f64641464e0 2023-10-18T12:19:53.757 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-10-18T12:19:53.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.758+0000 7f646b977700 1 -- 172.21.15.114:0/3132753010 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6448065720 msgr2=0x7f6448067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:53.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.758+0000 7f646b977700 1 --2- 172.21.15.114:0/3132753010 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6448065720 0x7f6448067be0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6460007fd0 tx=0x7f6460007de0 comp rx=0 tx=0).stop 2023-10-18T12:19:53.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.758+0000 7f646b977700 1 -- 172.21.15.114:0/3132753010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64641464e0 msgr2=0x7f646413b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:53.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.758+0000 7f646b977700 1 --2- 172.21.15.114:0/3132753010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64641464e0 0x7f646413b450 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f645400e880 tx=0x7f645400eb90 comp rx=0 tx=0).stop 2023-10-18T12:19:53.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.758+0000 7f646b977700 1 -- 172.21.15.114:0/3132753010 shutdown_connections 2023-10-18T12:19:53.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.758+0000 7f646b977700 1 --2- 172.21.15.114:0/3132753010 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6448065720 0x7f6448067be0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:53.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.758+0000 7f646b977700 1 --2- 172.21.15.114:0/3132753010 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f64641468c0 0x7f646415ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:53.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.758+0000 7f646b977700 1 --2- 172.21.15.114:0/3132753010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64641464e0 0x7f646413b450 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:53.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.758+0000 7f646b977700 1 --2- 172.21.15.114:0/3132753010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64640b7d60 0x7f64640d3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:53.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.758+0000 7f646b977700 1 -- 172.21.15.114:0/3132753010 >> 172.21.15.114:0/3132753010 conn(0x7f646406a130 msgr2=0x7f64640b5190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:53.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.758+0000 7f646b977700 1 -- 172.21.15.114:0/3132753010 shutdown_connections 2023-10-18T12:19:53.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.758+0000 7f646b977700 1 -- 172.21.15.114:0/3132753010 wait complete. 2023-10-18T12:19:53.783 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-18T12:19:53.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.950+0000 7f5eb67e6700 1 Processor -- start 2023-10-18T12:19:53.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.950+0000 7f5eb67e6700 1 -- start start 2023-10-18T12:19:53.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.950+0000 7f5eb67e6700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5eb00d36b0 0x7f5eb006e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:53.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.950+0000 7f5eb67e6700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eb00d29f0 con 0x7f5eb00d2610 2023-10-18T12:19:53.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.950+0000 7f5eb67e6700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eb00b64b0 con 0x7f5eb015e7d0 2023-10-18T12:19:53.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.950+0000 7f5eb67e6700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eb00b6750 con 0x7f5eb00d36b0 2023-10-18T12:19:53.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.950+0000 7f5eaffff700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f5eb00d2610 0x7f5eb00d2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52126/0 (socket says 172.21.15.114:52126) 2023-10-18T12:19:53.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.950+0000 7f5eaffff700 1 -- 172.21.15.114:0/1348575775 learned_addr learned my addr 172.21.15.114:0/1348575775 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:19:53.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.950+0000 7f5eaf7fe700 1 --2- 172.21.15.114:0/1348575775 >> v2:172.21.15.172:3300/0 conn(0x7f5eb00d36b0 0x7f5eb006e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:53.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.954+0000 7f5eaf7fe700 1 -- 172.21.15.114:0/1348575775 >> v1:172.21.15.172:6789/0 conn(0x7f5eb015e7d0 legacy=0x7f5eb015d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:53.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.954+0000 7f5eaf7fe700 1 -- 172.21.15.114:0/1348575775 >> v1:172.21.15.114:6789/0 conn(0x7f5eb00d2610 legacy=0x7f5eb00d2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:53.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.954+0000 7f5eaf7fe700 1 -- 172.21.15.114:0/1348575775 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb00b6a30 con 0x7f5eb00d36b0 2023-10-18T12:19:53.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.954+0000 7f5eaeffd700 1 -- 172.21.15.114:0/1348575775 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1208397442 0 0) 0x7f5eb00d29f0 con 0x7f5eb00d2610 2023-10-18T12:19:53.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.954+0000 7f5eaf7fe700 1 --2- 172.21.15.114:0/1348575775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5eb00d36b0 0x7f5eb006e6f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4009850 tx=0x7f5ea4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=554e51653c4bd5f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:53.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.954+0000 7f5eaeffd700 1 -- 172.21.15.114:0/1348575775 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea4011830 con 0x7f5eb00d36b0 2023-10-18T12:19:53.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.954+0000 7f5eaeffd700 1 -- 172.21.15.114:0/1348575775 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea4011990 con 0x7f5eb00d36b0 2023-10-18T12:19:53.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.954+0000 7f5eaeffd700 1 -- 172.21.15.114:0/1348575775 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea4011d20 con 0x7f5eb00d36b0 2023-10-18T12:19:53.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.954+0000 7f5eb67e6700 1 -- 172.21.15.114:0/1348575775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5eb00d36b0 msgr2=0x7f5eb006e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:53.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.954+0000 7f5eb67e6700 1 --2- 172.21.15.114:0/1348575775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5eb00d36b0 0x7f5eb006e6f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4009850 tx=0x7f5ea4009b60 comp rx=0 tx=0).stop 2023-10-18T12:19:53.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.954+0000 7f5eb67e6700 1 -- 172.21.15.114:0/1348575775 shutdown_connections 2023-10-18T12:19:53.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.954+0000 7f5eb67e6700 1 --2- 172.21.15.114:0/1348575775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5eb00d36b0 0x7f5eb006e6f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:53.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.954+0000 7f5eb67e6700 1 -- 172.21.15.114:0/1348575775 >> 172.21.15.114:0/1348575775 conn(0x7f5eb0069f20 msgr2=0x7f5eb006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:53.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.954+0000 7f5eb67e6700 1 -- 172.21.15.114:0/1348575775 shutdown_connections 2023-10-18T12:19:53.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.954+0000 7f5eb67e6700 1 -- 172.21.15.114:0/1348575775 wait complete. 2023-10-18T12:19:53.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.958+0000 7f5eb67e6700 1 Processor -- start 2023-10-18T12:19:53.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.958+0000 7f5eb67e6700 1 -- start start 2023-10-18T12:19:53.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.958+0000 7f5eb67e6700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5eb00d2610 0x7f5eb00afcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:53.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.958+0000 7f5eb67e6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5eb00d36b0 0x7f5eb00c8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:53.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.958+0000 7f5eb67e6700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5eb015e7d0 0x7f5eb00af320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:53.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.958+0000 7f5eb67e6700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb00c8880 con 0x7f5eb00d2610 2023-10-18T12:19:53.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.958+0000 7f5eb67e6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb01f5ae0 con 0x7f5eb00d36b0 2023-10-18T12:19:53.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.958+0000 7f5eb67e6700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb01f5dc0 con 0x7f5eb015e7d0 2023-10-18T12:19:53.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.958+0000 7f5eaffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5eb00d2610 0x7f5eb00afcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:53.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.958+0000 7f5eaffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5eb00d2610 0x7f5eb00afcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51438/0 (socket says 172.21.15.114:51438) 2023-10-18T12:19:53.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.958+0000 7f5eaffff700 1 -- 172.21.15.114:0/2195137656 learned_addr learned my addr 172.21.15.114:0/2195137656 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:53.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.962+0000 7f5eb4d83700 1 --2- 172.21.15.114:0/2195137656 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5eb015e7d0 0x7f5eb00af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:53.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.962+0000 7f5eaf7fe700 1 --2- 172.21.15.114:0/2195137656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5eb00d36b0 0x7f5eb00c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:53.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.962+0000 7f5eaffff700 1 -- 172.21.15.114:0/2195137656 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5eb015e7d0 msgr2=0x7f5eb00af320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:53.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.962+0000 7f5eaffff700 1 --2- 172.21.15.114:0/2195137656 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5eb015e7d0 0x7f5eb00af320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:53.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.962+0000 7f5eaffff700 1 -- 172.21.15.114:0/2195137656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5eb00d36b0 msgr2=0x7f5eb00c8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:53.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.962+0000 7f5eaffff700 1 --2- 172.21.15.114:0/2195137656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5eb00d36b0 0x7f5eb00c8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:53.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.962+0000 7f5eaffff700 1 -- 172.21.15.114:0/2195137656 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea40094b0 con 0x7f5eb00d2610 2023-10-18T12:19:53.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.962+0000 7f5eaffff700 1 --2- 172.21.15.114:0/2195137656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5eb00d2610 0x7f5eb00afcb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5ea000c550 tx=0x7f5ea000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:53.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.962+0000 7f5eacff9700 1 -- 172.21.15.114:0/2195137656 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea0004ca0 con 0x7f5eb00d2610 2023-10-18T12:19:53.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.962+0000 7f5eacff9700 1 -- 172.21.15.114:0/2195137656 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea0004e00 con 0x7f5eb00d2610 2023-10-18T12:19:53.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.962+0000 7f5eacff9700 1 -- 172.21.15.114:0/2195137656 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea0007310 con 0x7f5eb00d2610 2023-10-18T12:19:53.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.962+0000 7f5eb67e6700 1 -- 172.21.15.114:0/2195137656 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eb01f60a0 con 0x7f5eb00d2610 2023-10-18T12:19:53.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.962+0000 7f5eb67e6700 1 -- 172.21.15.114:0/2195137656 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eb01f6660 con 0x7f5eb00d2610 2023-10-18T12:19:53.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.962+0000 7f5eb67e6700 1 -- 172.21.15.114:0/2195137656 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eb00adab0 con 0x7f5eb00d2610 2023-10-18T12:19:53.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.966+0000 7f5eacff9700 1 -- 172.21.15.114:0/2195137656 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f5ea0007470 con 0x7f5eb00d2610 2023-10-18T12:19:53.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.966+0000 7f5eacff9700 1 --2- 172.21.15.114:0/2195137656 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5e9c065720 0x7f5e9c067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:53.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.966+0000 7f5eacff9700 1 -- 172.21.15.114:0/2195137656 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5ea0082e50 con 0x7f5eb00d2610 2023-10-18T12:19:53.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.970+0000 7f5eaf7fe700 1 --2- 172.21.15.114:0/2195137656 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5e9c065720 0x7f5e9c067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:53.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.970+0000 7f5eaf7fe700 1 --2- 172.21.15.114:0/2195137656 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5e9c065720 0x7f5e9c067be0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5eb00d3b80 tx=0x7f5ea4008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:53.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:53.974+0000 7f5eacff9700 1 -- 172.21.15.114:0/2195137656 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f5eb00adab0 con 0x7f5eb00d2610 2023-10-18T12:19:54.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.150+0000 7f5eb67e6700 1 -- 172.21.15.114:0/2195137656 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5eb0072e60 con 0x7f5eb00d2610 2023-10-18T12:19:54.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.150+0000 7f5eacff9700 1 -- 172.21.15.114:0/2195137656 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5ea0050610 con 0x7f5eb00d2610 2023-10-18T12:19:54.156 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-10-18T12:19:54.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.154+0000 7f5eb67e6700 1 -- 172.21.15.114:0/2195137656 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5e9c065720 msgr2=0x7f5e9c067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:54.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.154+0000 7f5eb67e6700 1 --2- 172.21.15.114:0/2195137656 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5e9c065720 0x7f5e9c067be0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5eb00d3b80 tx=0x7f5ea4008030 comp rx=0 tx=0).stop 2023-10-18T12:19:54.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.154+0000 7f5eb67e6700 1 -- 172.21.15.114:0/2195137656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5eb00d2610 msgr2=0x7f5eb00afcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:54.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.154+0000 7f5eb67e6700 1 --2- 172.21.15.114:0/2195137656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5eb00d2610 0x7f5eb00afcb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5ea000c550 tx=0x7f5ea000c910 comp rx=0 tx=0).stop 2023-10-18T12:19:54.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.154+0000 7f5eb67e6700 1 -- 172.21.15.114:0/2195137656 shutdown_connections 2023-10-18T12:19:54.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.154+0000 7f5eb67e6700 1 --2- 172.21.15.114:0/2195137656 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5e9c065720 0x7f5e9c067be0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:54.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.154+0000 7f5eb67e6700 1 --2- 172.21.15.114:0/2195137656 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5eb015e7d0 0x7f5eb00af320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:54.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.154+0000 7f5eb67e6700 1 --2- 172.21.15.114:0/2195137656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5eb00d36b0 0x7f5eb00c8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:54.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.154+0000 7f5eb67e6700 1 --2- 172.21.15.114:0/2195137656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5eb00d2610 0x7f5eb00afcb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:54.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.154+0000 7f5eb67e6700 1 -- 172.21.15.114:0/2195137656 >> 172.21.15.114:0/2195137656 conn(0x7f5eb0069f20 msgr2=0x7f5eb00b3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:54.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.154+0000 7f5eb67e6700 1 -- 172.21.15.114:0/2195137656 shutdown_connections 2023-10-18T12:19:54.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.154+0000 7f5eb67e6700 1 -- 172.21.15.114:0/2195137656 wait complete. 2023-10-18T12:19:54.182 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-18T12:19:54.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.350+0000 7f62f63af700 1 Processor -- start 2023-10-18T12:19:54.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.350+0000 7f62f63af700 1 -- start start 2023-10-18T12:19:54.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.354+0000 7f62f63af700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f62f0164a20 0x7f62f00cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:54.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.354+0000 7f62f63af700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f62f006ce20 0x7f62f006d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:54.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.354+0000 7f62f63af700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62f00ca4c0 con 0x7f62f00b3d40 2023-10-18T12:19:54.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.354+0000 7f62f63af700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62f006e2d0 con 0x7f62f006ce20 2023-10-18T12:19:54.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.354+0000 7f62f63af700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f006d7d0 con 0x7f62f0164a20 2023-10-18T12:19:54.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.354+0000 7f62f53ad700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f62f00b3d40 0x7f62f00c9cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52132/0 (socket says 172.21.15.114:52132) 2023-10-18T12:19:54.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.354+0000 7f62f53ad700 1 -- 172.21.15.114:0/3201427516 learned_addr learned my addr 172.21.15.114:0/3201427516 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:19:54.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.354+0000 7f62f5bae700 1 --2- 172.21.15.114:0/3201427516 >> v2:172.21.15.172:3300/0 conn(0x7f62f006ce20 0x7f62f006d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:54.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.354+0000 7f62f4bac700 1 --2- 172.21.15.114:0/3201427516 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f62f0164a20 0x7f62f00cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:54.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.354+0000 7f62e7fff700 1 -- 172.21.15.114:0/3201427516 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1598933753 0 0) 0x7f62f00ca4c0 con 0x7f62f00b3d40 2023-10-18T12:19:54.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.354+0000 7f62e7fff700 1 -- 172.21.15.114:0/3201427516 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62dc0035d0 con 0x7f62f00b3d40 2023-10-18T12:19:54.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.354+0000 7f62f5bae700 1 -- 172.21.15.114:0/3201427516 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f62f0164a20 msgr2=0x7f62f00cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:54.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.354+0000 7f62f5bae700 1 --2- 172.21.15.114:0/3201427516 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f62f0164a20 0x7f62f00cc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:54.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.354+0000 7f62f5bae700 1 -- 172.21.15.114:0/3201427516 >> v1:172.21.15.114:6789/0 conn(0x7f62f00b3d40 legacy=0x7f62f00c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:54.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.354+0000 7f62f5bae700 1 -- 172.21.15.114:0/3201427516 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f00ca7a0 con 0x7f62f006ce20 2023-10-18T12:19:54.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.354+0000 7f62f5bae700 1 --2- 172.21.15.114:0/3201427516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62f006ce20 0x7f62f006d290 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f62e8009d90 tx=0x7f62e800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bedfebf7c2c2b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:54.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.354+0000 7f62e7fff700 1 -- 172.21.15.114:0/3201427516 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e800e070 con 0x7f62f006ce20 2023-10-18T12:19:54.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.354+0000 7f62e7fff700 1 -- 172.21.15.114:0/3201427516 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e800bb20 con 0x7f62f006ce20 2023-10-18T12:19:54.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.354+0000 7f62e7fff700 1 -- 172.21.15.114:0/3201427516 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e800be90 con 0x7f62f006ce20 2023-10-18T12:19:54.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.358+0000 7f62f63af700 1 -- 172.21.15.114:0/3201427516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62f006ce20 msgr2=0x7f62f006d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:54.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.358+0000 7f62f63af700 1 --2- 172.21.15.114:0/3201427516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62f006ce20 0x7f62f006d290 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f62e8009d90 tx=0x7f62e800b330 comp rx=0 tx=0).stop 2023-10-18T12:19:54.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.358+0000 7f62f63af700 1 -- 172.21.15.114:0/3201427516 shutdown_connections 2023-10-18T12:19:54.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.358+0000 7f62f63af700 1 --2- 172.21.15.114:0/3201427516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62f006ce20 0x7f62f006d290 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:54.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.358+0000 7f62f63af700 1 --2- 172.21.15.114:0/3201427516 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f62f0164a20 0x7f62f00cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:54.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.358+0000 7f62f63af700 1 -- 172.21.15.114:0/3201427516 >> 172.21.15.114:0/3201427516 conn(0x7f62f00ce5c0 msgr2=0x7f62f00ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:54.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.358+0000 7f62f63af700 1 -- 172.21.15.114:0/3201427516 shutdown_connections 2023-10-18T12:19:54.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.358+0000 7f62f63af700 1 -- 172.21.15.114:0/3201427516 wait complete. 2023-10-18T12:19:54.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.358+0000 7f62f63af700 1 Processor -- start 2023-10-18T12:19:54.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.358+0000 7f62f63af700 1 -- start start 2023-10-18T12:19:54.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.362+0000 7f62f63af700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62f006ce20 0x7f62f01f9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:54.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.362+0000 7f62f63af700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f62f00b3d40 0x7f62f01fa370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:54.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.362+0000 7f62f63af700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62f0164a20 0x7f62f0162620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:54.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.362+0000 7f62f63af700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f0163350 con 0x7f62f006ce20 2023-10-18T12:19:54.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.362+0000 7f62f63af700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f0163630 con 0x7f62f0164a20 2023-10-18T12:19:54.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.362+0000 7f62f63af700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f0163910 con 0x7f62f00b3d40 2023-10-18T12:19:54.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.362+0000 7f62f53ad700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62f006ce20 0x7f62f01f9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:54.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.362+0000 7f62f4bac700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f62f00b3d40 0x7f62f01fa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:54.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.362+0000 7f62f5bae700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62f0164a20 0x7f62f0162620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:54.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.362+0000 7f62f53ad700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62f006ce20 0x7f62f01f9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51452/0 (socket says 172.21.15.114:51452) 2023-10-18T12:19:54.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.362+0000 7f62f53ad700 1 -- 172.21.15.114:0/2577010975 learned_addr learned my addr 172.21.15.114:0/2577010975 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:54.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.362+0000 7f62f53ad700 1 -- 172.21.15.114:0/2577010975 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f62f00b3d40 msgr2=0x7f62f01fa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:54.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.362+0000 7f62f53ad700 1 --2- 172.21.15.114:0/2577010975 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f62f00b3d40 0x7f62f01fa370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:54.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.362+0000 7f62f53ad700 1 -- 172.21.15.114:0/2577010975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62f0164a20 msgr2=0x7f62f0162620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:54.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.362+0000 7f62f53ad700 1 --2- 172.21.15.114:0/2577010975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62f0164a20 0x7f62f0162620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:54.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.362+0000 7f62f53ad700 1 -- 172.21.15.114:0/2577010975 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e8009a70 con 0x7f62f006ce20 2023-10-18T12:19:54.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.362+0000 7f62f5bae700 1 --2- 172.21.15.114:0/2577010975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62f0164a20 0x7f62f0162620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:19:54.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.362+0000 7f62f53ad700 1 --2- 172.21.15.114:0/2577010975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62f006ce20 0x7f62f01f9e30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f62ec00c4f0 tx=0x7f62ec00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:54.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.362+0000 7f62e5ffb700 1 -- 172.21.15.114:0/2577010975 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec005d90 con 0x7f62f006ce20 2023-10-18T12:19:54.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.362+0000 7f62e5ffb700 1 -- 172.21.15.114:0/2577010975 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ec0070d0 con 0x7f62f006ce20 2023-10-18T12:19:54.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.362+0000 7f62f63af700 1 -- 172.21.15.114:0/2577010975 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62f0163bf0 con 0x7f62f006ce20 2023-10-18T12:19:54.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.362+0000 7f62e5ffb700 1 -- 172.21.15.114:0/2577010975 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec007440 con 0x7f62f006ce20 2023-10-18T12:19:54.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.362+0000 7f62f63af700 1 -- 172.21.15.114:0/2577010975 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62f0162d40 con 0x7f62f006ce20 2023-10-18T12:19:54.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.366+0000 7f62f63af700 1 -- 172.21.15.114:0/2577010975 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62f004e910 con 0x7f62f006ce20 2023-10-18T12:19:54.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.366+0000 7f62e5ffb700 1 -- 172.21.15.114:0/2577010975 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f62ec0075a0 con 0x7f62f006ce20 2023-10-18T12:19:54.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.370+0000 7f62e5ffb700 1 --2- 172.21.15.114:0/2577010975 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f62d40656f0 0x7f62d4067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:54.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.370+0000 7f62e5ffb700 1 -- 172.21.15.114:0/2577010975 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f62ec082480 con 0x7f62f006ce20 2023-10-18T12:19:54.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.370+0000 7f62f4bac700 1 --2- 172.21.15.114:0/2577010975 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f62d40656f0 0x7f62d4067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:54.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.370+0000 7f62f4bac700 1 --2- 172.21.15.114:0/2577010975 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f62d40656f0 0x7f62d4067bb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f62f0164060 tx=0x7f62e0009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:54.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.374+0000 7f62e5ffb700 1 -- 172.21.15.114:0/2577010975 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f62ec04fc60 con 0x7f62f006ce20 2023-10-18T12:19:54.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.554+0000 7f62f63af700 1 -- 172.21.15.114:0/2577010975 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f62f00c5670 con 0x7f62f006ce20 2023-10-18T12:19:54.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.554+0000 7f62e5ffb700 1 -- 172.21.15.114:0/2577010975 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f62ec053280 con 0x7f62f006ce20 2023-10-18T12:19:54.560 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-10-18T12:19:54.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.558+0000 7f62f63af700 1 -- 172.21.15.114:0/2577010975 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f62d40656f0 msgr2=0x7f62d4067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:54.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.558+0000 7f62f63af700 1 --2- 172.21.15.114:0/2577010975 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f62d40656f0 0x7f62d4067bb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f62f0164060 tx=0x7f62e0009240 comp rx=0 tx=0).stop 2023-10-18T12:19:54.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.558+0000 7f62f63af700 1 -- 172.21.15.114:0/2577010975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62f006ce20 msgr2=0x7f62f01f9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:54.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.558+0000 7f62f63af700 1 --2- 172.21.15.114:0/2577010975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62f006ce20 0x7f62f01f9e30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f62ec00c4f0 tx=0x7f62ec00c800 comp rx=0 tx=0).stop 2023-10-18T12:19:54.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.558+0000 7f62f63af700 1 -- 172.21.15.114:0/2577010975 shutdown_connections 2023-10-18T12:19:54.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.558+0000 7f62f63af700 1 --2- 172.21.15.114:0/2577010975 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f62d40656f0 0x7f62d4067bb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:54.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.558+0000 7f62f63af700 1 --2- 172.21.15.114:0/2577010975 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f62f00b3d40 0x7f62f01fa370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:54.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.558+0000 7f62f63af700 1 --2- 172.21.15.114:0/2577010975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62f0164a20 0x7f62f0162620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:54.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.558+0000 7f62f63af700 1 --2- 172.21.15.114:0/2577010975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62f006ce20 0x7f62f01f9e30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:54.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.558+0000 7f62f63af700 1 -- 172.21.15.114:0/2577010975 >> 172.21.15.114:0/2577010975 conn(0x7f62f00ce5c0 msgr2=0x7f62f0070a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:54.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.558+0000 7f62f63af700 1 -- 172.21.15.114:0/2577010975 shutdown_connections 2023-10-18T12:19:54.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.558+0000 7f62f63af700 1 -- 172.21.15.114:0/2577010975 wait complete. 2023-10-18T12:19:54.583 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-18T12:19:54.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.758+0000 7f2129a40700 1 Processor -- start 2023-10-18T12:19:54.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.758+0000 7f2129a40700 1 -- start start 2023-10-18T12:19:54.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.758+0000 7f2129a40700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f21240b5ae0 0x7f212406a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:54.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.762+0000 7f2129a40700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f212406e390 con 0x7f21240b6c70 2023-10-18T12:19:54.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.762+0000 7f2129a40700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f212415cfb0 con 0x7f212415cbd0 2023-10-18T12:19:54.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.762+0000 7f2129a40700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21240b6050 con 0x7f21240b5ae0 2023-10-18T12:19:54.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.762+0000 7f2123fff700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f21240b6c70 0x7f212406a0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:52134/0 (socket says 172.21.15.114:52134) 2023-10-18T12:19:54.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.762+0000 7f2123fff700 1 -- 172.21.15.114:0/3899674592 learned_addr learned my addr 172.21.15.114:0/3899674592 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:19:54.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.762+0000 7f2128a3e700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f212415cbd0 0x7f21240b6560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.114:45090/0 (socket says 172.21.15.114:45090) 2023-10-18T12:19:54.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.762+0000 7f212923f700 1 --2- 172.21.15.114:0/3899674592 >> v2:172.21.15.172:3300/0 conn(0x7f21240b5ae0 0x7f212406a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:54.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.762+0000 7f21237fe700 1 -- 172.21.15.114:0/3899674592 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 388630327 0 0) 0x7f212406e390 con 0x7f21240b6c70 2023-10-18T12:19:54.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.762+0000 7f21237fe700 1 -- 172.21.15.114:0/3899674592 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21140035d0 con 0x7f21240b6c70 2023-10-18T12:19:54.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.762+0000 7f21237fe700 1 -- 172.21.15.114:0/3899674592 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3782191752 0 0) 0x7f212415cfb0 con 0x7f212415cbd0 2023-10-18T12:19:54.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.762+0000 7f21237fe700 1 -- 172.21.15.114:0/3899674592 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f212406e390 con 0x7f212415cbd0 2023-10-18T12:19:54.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.762+0000 7f212923f700 1 -- 172.21.15.114:0/3899674592 >> v1:172.21.15.172:6789/0 conn(0x7f212415cbd0 legacy=0x7f21240b6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:54.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.762+0000 7f212923f700 1 -- 172.21.15.114:0/3899674592 >> v1:172.21.15.114:6789/0 conn(0x7f21240b6c70 legacy=0x7f212406a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:54.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.762+0000 7f212923f700 1 -- 172.21.15.114:0/3899674592 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f212406e5e0 con 0x7f21240b5ae0 2023-10-18T12:19:54.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.762+0000 7f212923f700 1 --2- 172.21.15.114:0/3899674592 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21240b5ae0 0x7f212406a7e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f211c009d90 tx=0x7f211c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=408cbfd3aed9f672 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:54.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.762+0000 7f21237fe700 1 -- 172.21.15.114:0/3899674592 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211c00e070 con 0x7f21240b5ae0 2023-10-18T12:19:54.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.762+0000 7f21237fe700 1 -- 172.21.15.114:0/3899674592 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211c00bb20 con 0x7f21240b5ae0 2023-10-18T12:19:54.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.762+0000 7f21237fe700 1 -- 172.21.15.114:0/3899674592 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211c012430 con 0x7f21240b5ae0 2023-10-18T12:19:54.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.766+0000 7f2129a40700 1 -- 172.21.15.114:0/3899674592 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21240b5ae0 msgr2=0x7f212406a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:54.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.766+0000 7f2129a40700 1 --2- 172.21.15.114:0/3899674592 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21240b5ae0 0x7f212406a7e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f211c009d90 tx=0x7f211c00b330 comp rx=0 tx=0).stop 2023-10-18T12:19:54.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.766+0000 7f2129a40700 1 -- 172.21.15.114:0/3899674592 shutdown_connections 2023-10-18T12:19:54.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.766+0000 7f2129a40700 1 --2- 172.21.15.114:0/3899674592 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21240b5ae0 0x7f212406a7e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:54.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.766+0000 7f2129a40700 1 -- 172.21.15.114:0/3899674592 >> 172.21.15.114:0/3899674592 conn(0x7f212406f450 msgr2=0x7f212406f860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:54.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.766+0000 7f2129a40700 1 -- 172.21.15.114:0/3899674592 shutdown_connections 2023-10-18T12:19:54.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.766+0000 7f2129a40700 1 -- 172.21.15.114:0/3899674592 wait complete. 2023-10-18T12:19:54.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.766+0000 7f2129a40700 1 Processor -- start 2023-10-18T12:19:54.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.766+0000 7f2129a40700 1 -- start start 2023-10-18T12:19:54.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.766+0000 7f2129a40700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21240b5ae0 0x7f2124159df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:54.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.766+0000 7f2129a40700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21240b6c70 0x7f2124153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:54.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.766+0000 7f2129a40700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f212415cbd0 0x7f2124152310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:54.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.766+0000 7f2129a40700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2124152d60 con 0x7f21240b6c70 2023-10-18T12:19:54.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.766+0000 7f2129a40700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2124153040 con 0x7f21240b5ae0 2023-10-18T12:19:54.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.766+0000 7f2129a40700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f212414f0c0 con 0x7f212415cbd0 2023-10-18T12:19:54.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.770+0000 7f2123fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21240b6c70 0x7f2124153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:54.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.770+0000 7f2123fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21240b6c70 0x7f2124153f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51464/0 (socket says 172.21.15.114:51464) 2023-10-18T12:19:54.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.770+0000 7f2123fff700 1 -- 172.21.15.114:0/3008386056 learned_addr learned my addr 172.21.15.114:0/3008386056 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:54.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.770+0000 7f2128a3e700 1 --2- 172.21.15.114:0/3008386056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21240b5ae0 0x7f2124159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:54.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.770+0000 7f212923f700 1 --2- 172.21.15.114:0/3008386056 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f212415cbd0 0x7f2124152310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:54.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.770+0000 7f2123fff700 1 -- 172.21.15.114:0/3008386056 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f212415cbd0 msgr2=0x7f2124152310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:54.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.770+0000 7f2123fff700 1 --2- 172.21.15.114:0/3008386056 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f212415cbd0 0x7f2124152310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:54.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.770+0000 7f2123fff700 1 -- 172.21.15.114:0/3008386056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21240b5ae0 msgr2=0x7f2124159df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:54.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.770+0000 7f2123fff700 1 --2- 172.21.15.114:0/3008386056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21240b5ae0 0x7f2124159df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:54.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.770+0000 7f2123fff700 1 -- 172.21.15.114:0/3008386056 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f211c009a70 con 0x7f21240b6c70 2023-10-18T12:19:54.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.770+0000 7f212923f700 1 --2- 172.21.15.114:0/3008386056 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f212415cbd0 0x7f2124152310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:19:54.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.770+0000 7f2123fff700 1 --2- 172.21.15.114:0/3008386056 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21240b6c70 0x7f2124153f40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f211000c580 tx=0x7f211000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:54.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.770+0000 7f21217fa700 1 -- 172.21.15.114:0/3008386056 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2110005d90 con 0x7f21240b6c70 2023-10-18T12:19:54.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.770+0000 7f21217fa700 1 -- 172.21.15.114:0/3008386056 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21100070d0 con 0x7f21240b6c70 2023-10-18T12:19:54.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.770+0000 7f2129a40700 1 -- 172.21.15.114:0/3008386056 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f212414f3a0 con 0x7f21240b6c70 2023-10-18T12:19:54.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.770+0000 7f21217fa700 1 -- 172.21.15.114:0/3008386056 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2110007460 con 0x7f21240b6c70 2023-10-18T12:19:54.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.770+0000 7f2129a40700 1 -- 172.21.15.114:0/3008386056 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2124158760 con 0x7f21240b6c70 2023-10-18T12:19:54.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.770+0000 7f2129a40700 1 -- 172.21.15.114:0/3008386056 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21240d2490 con 0x7f21240b6c70 2023-10-18T12:19:54.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.774+0000 7f21217fa700 1 -- 172.21.15.114:0/3008386056 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f21100075c0 con 0x7f21240b6c70 2023-10-18T12:19:54.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.774+0000 7f21217fa700 1 --2- 172.21.15.114:0/3008386056 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f21080656f0 0x7f2108067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:54.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.774+0000 7f21217fa700 1 -- 172.21.15.114:0/3008386056 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f21100827f0 con 0x7f21240b6c70 2023-10-18T12:19:54.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.774+0000 7f2128a3e700 1 --2- 172.21.15.114:0/3008386056 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f21080656f0 0x7f2108067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:54.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.774+0000 7f2128a3e700 1 --2- 172.21.15.114:0/3008386056 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f21080656f0 0x7f2108067bb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2118007fd0 tx=0x7f2118007c20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:54.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.778+0000 7f21217fa700 1 -- 172.21.15.114:0/3008386056 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f211004fea0 con 0x7f21240b6c70 2023-10-18T12:19:54.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.982+0000 7f2129a40700 1 -- 172.21.15.114:0/3008386056 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2124072e60 con 0x7f21240b6c70 2023-10-18T12:19:54.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.986+0000 7f21217fa700 1 -- 172.21.15.114:0/3008386056 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f21100534c0 con 0x7f21240b6c70 2023-10-18T12:19:54.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.986+0000 7f2129a40700 1 -- 172.21.15.114:0/3008386056 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f21080656f0 msgr2=0x7f2108067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:54.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.986+0000 7f2129a40700 1 --2- 172.21.15.114:0/3008386056 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f21080656f0 0x7f2108067bb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2118007fd0 tx=0x7f2118007c20 comp rx=0 tx=0).stop 2023-10-18T12:19:54.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.986+0000 7f2129a40700 1 -- 172.21.15.114:0/3008386056 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21240b6c70 msgr2=0x7f2124153f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:54.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.986+0000 7f2129a40700 1 --2- 172.21.15.114:0/3008386056 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21240b6c70 0x7f2124153f40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f211000c580 tx=0x7f211000c940 comp rx=0 tx=0).stop 2023-10-18T12:19:54.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.986+0000 7f2129a40700 1 -- 172.21.15.114:0/3008386056 shutdown_connections 2023-10-18T12:19:54.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.986+0000 7f2129a40700 1 --2- 172.21.15.114:0/3008386056 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f21080656f0 0x7f2108067bb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:54.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.986+0000 7f2129a40700 1 --2- 172.21.15.114:0/3008386056 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f212415cbd0 0x7f2124152310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:54.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.986+0000 7f2129a40700 1 --2- 172.21.15.114:0/3008386056 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21240b6c70 0x7f2124153f40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:54.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.986+0000 7f2129a40700 1 --2- 172.21.15.114:0/3008386056 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21240b5ae0 0x7f2124159df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:54.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.986+0000 7f2129a40700 1 -- 172.21.15.114:0/3008386056 >> 172.21.15.114:0/3008386056 conn(0x7f212406f450 msgr2=0x7f2124069fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:54.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.986+0000 7f2129a40700 1 -- 172.21.15.114:0/3008386056 shutdown_connections 2023-10-18T12:19:54.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:54.986+0000 7f2129a40700 1 -- 172.21.15.114:0/3008386056 wait complete. 2023-10-18T12:19:54.994 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2023-10-18T12:19:55.012 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:19:55.012 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-18T12:19:55.029 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T12:19:55.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.246+0000 7f413d515700 1 Processor -- start 2023-10-18T12:19:55.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.246+0000 7f413d515700 1 -- start start 2023-10-18T12:19:55.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.250+0000 7f413d515700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4138070c70 0x7f41380cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:55.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.250+0000 7f413d515700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41380b14f0 con 0x7f4138159750 2023-10-18T12:19:55.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.250+0000 7f413d515700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41380ce2e0 con 0x7f41380cde70 2023-10-18T12:19:55.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.250+0000 7f413d515700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41380c9aa0 con 0x7f4138070c70 2023-10-18T12:19:55.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.250+0000 7f4137fff700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f4138159750 0x7f4138070560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41536/0 (socket says 172.21.15.114:41536) 2023-10-18T12:19:55.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.250+0000 7f4137fff700 1 -- 172.21.15.114:0/2032579003 learned_addr learned my addr 172.21.15.114:0/2032579003 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:19:55.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.250+0000 7f41377fe700 1 --2- 172.21.15.114:0/2032579003 >> v2:172.21.15.172:3300/0 conn(0x7f4138070c70 0x7f41380cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:55.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.250+0000 7f4136ffd700 1 -- 172.21.15.114:0/2032579003 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2982704486 0 0) 0x7f41380b14f0 con 0x7f4138159750 2023-10-18T12:19:55.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.250+0000 7f4136ffd700 1 -- 172.21.15.114:0/2032579003 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41200035d0 con 0x7f4138159750 2023-10-18T12:19:55.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.250+0000 7f4136ffd700 1 -- 172.21.15.114:0/2032579003 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 38074810 0 0) 0x7f41200035d0 con 0x7f4138159750 2023-10-18T12:19:55.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.250+0000 7f4136ffd700 1 -- 172.21.15.114:0/2032579003 >> v2:172.21.15.172:3300/0 conn(0x7f4138070c70 msgr2=0x7f41380cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:55.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.250+0000 7f4136ffd700 1 --2- 172.21.15.114:0/2032579003 >> v2:172.21.15.172:3300/0 conn(0x7f4138070c70 0x7f41380cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:55.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.250+0000 7f4136ffd700 1 -- 172.21.15.114:0/2032579003 >> v1:172.21.15.172:6789/0 conn(0x7f41380cde70 legacy=0x7f413806cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:55.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.250+0000 7f4136ffd700 1 -- 172.21.15.114:0/2032579003 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f413815d590 con 0x7f4138159750 2023-10-18T12:19:55.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.250+0000 7f4136ffd700 1 -- 172.21.15.114:0/2032579003 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3368469509 0 0) 0x7f4128001670 con 0x7f4138159750 2023-10-18T12:19:55.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.250+0000 7f4136ffd700 1 -- 172.21.15.114:0/2032579003 >> v1:172.21.15.114:6789/0 conn(0x7f4138159750 legacy=0x7f4138070560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:55.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.250+0000 7f4136ffd700 1 --2- 172.21.15.114:0/2032579003 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4120003a70 0x7f4120003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:55.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.254+0000 7f4136ffd700 1 --2- 172.21.15.114:0/2032579003 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4120004870 0x7f4120004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:55.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.254+0000 7f4136ffd700 1 --2- 172.21.15.114:0/2032579003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4120005280 0x7f412000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:55.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.254+0000 7f4136ffd700 1 -- 172.21.15.114:0/2032579003 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41380c9aa0 con 0x7f4120005280 2023-10-18T12:19:55.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.254+0000 7f4136ffd700 1 -- 172.21.15.114:0/2032579003 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412000c1d0 con 0x7f4120004870 2023-10-18T12:19:55.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.254+0000 7f4136ffd700 1 -- 172.21.15.114:0/2032579003 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f412000c390 con 0x7f4120003a70 2023-10-18T12:19:55.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.254+0000 7f413cd14700 1 --2- 172.21.15.114:0/2032579003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4120005280 0x7f412000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:55.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.254+0000 7f4137fff700 1 --2- 172.21.15.114:0/2032579003 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4120003a70 0x7f4120003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:55.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.254+0000 7f41377fe700 1 --2- 172.21.15.114:0/2032579003 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4120004870 0x7f4120004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:55.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.254+0000 7f413cd14700 1 -- 172.21.15.114:0/2032579003 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4120003a70 msgr2=0x7f4120003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:55.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.254+0000 7f413cd14700 1 --2- 172.21.15.114:0/2032579003 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4120003a70 0x7f4120003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:55.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.254+0000 7f413cd14700 1 -- 172.21.15.114:0/2032579003 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4120004870 msgr2=0x7f4120004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:55.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.254+0000 7f413cd14700 1 --2- 172.21.15.114:0/2032579003 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4120004870 0x7f4120004cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:55.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.254+0000 7f413cd14700 1 -- 172.21.15.114:0/2032579003 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41200035d0 con 0x7f4120005280 2023-10-18T12:19:55.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.254+0000 7f413cd14700 1 -- 172.21.15.114:0/2032579003 reap_dead start 2023-10-18T12:19:55.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.254+0000 7f413cd14700 1 --2- 172.21.15.114:0/2032579003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4120005280 0x7f412000ba30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f413000c160 tx=0x7f41200058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2e2424ffd58dfce server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:55.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.254+0000 7f4136ffd700 1 -- 172.21.15.114:0/2032579003 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4130001db0 con 0x7f4120005280 2023-10-18T12:19:55.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.254+0000 7f4136ffd700 1 -- 172.21.15.114:0/2032579003 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413000ccc0 con 0x7f4120005280 2023-10-18T12:19:55.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.254+0000 7f4136ffd700 1 -- 172.21.15.114:0/2032579003 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4130003c60 con 0x7f4120005280 2023-10-18T12:19:55.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.254+0000 7f413d515700 1 -- 172.21.15.114:0/2032579003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4120005280 msgr2=0x7f412000ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:55.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.254+0000 7f413d515700 1 --2- 172.21.15.114:0/2032579003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4120005280 0x7f412000ba30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f413000c160 tx=0x7f41200058a0 comp rx=0 tx=0).stop 2023-10-18T12:19:55.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.254+0000 7f413d515700 1 -- 172.21.15.114:0/2032579003 shutdown_connections 2023-10-18T12:19:55.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.254+0000 7f413d515700 1 --2- 172.21.15.114:0/2032579003 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4120005280 0x7f412000ba30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:55.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.254+0000 7f413d515700 1 -- 172.21.15.114:0/2032579003 >> 172.21.15.114:0/2032579003 conn(0x7f41380ce5c0 msgr2=0x7f41380ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:55.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.254+0000 7f413d515700 1 -- 172.21.15.114:0/2032579003 shutdown_connections 2023-10-18T12:19:55.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.254+0000 7f413d515700 1 -- 172.21.15.114:0/2032579003 wait complete. 2023-10-18T12:19:55.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.258+0000 7f413d515700 1 Processor -- start 2023-10-18T12:19:55.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.258+0000 7f413d515700 1 -- start start 2023-10-18T12:19:55.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.258+0000 7f413d515700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4120005280 0x7f41380b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:55.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.258+0000 7f413d515700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f41380c5690 0x7f41380c4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:55.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.258+0000 7f413d515700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41380c5b10 0x7f4138153e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:55.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.258+0000 7f413d515700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41380b1d10 con 0x7f41380c5b10 2023-10-18T12:19:55.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.258+0000 7f413d515700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41381f69c0 con 0x7f4120005280 2023-10-18T12:19:55.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.258+0000 7f413d515700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41381f5b10 con 0x7f41380c5690 2023-10-18T12:19:55.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.262+0000 7f413cd14700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41380c5b10 0x7f4138153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:55.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.262+0000 7f413cd14700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41380c5b10 0x7f4138153e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46634/0 (socket says 172.21.15.114:46634) 2023-10-18T12:19:55.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.262+0000 7f413cd14700 1 -- 172.21.15.114:0/2262777301 learned_addr learned my addr 172.21.15.114:0/2262777301 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:55.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.262+0000 7f41377fe700 1 --2- 172.21.15.114:0/2262777301 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f41380c5690 0x7f41380c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:55.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.262+0000 7f4137fff700 1 --2- 172.21.15.114:0/2262777301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4120005280 0x7f41380b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:55.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.262+0000 7f413cd14700 1 -- 172.21.15.114:0/2262777301 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f41380c5690 msgr2=0x7f41380c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:55.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.262+0000 7f413cd14700 1 --2- 172.21.15.114:0/2262777301 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f41380c5690 0x7f41380c4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:55.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.262+0000 7f413cd14700 1 -- 172.21.15.114:0/2262777301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4120005280 msgr2=0x7f41380b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:55.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.262+0000 7f413cd14700 1 --2- 172.21.15.114:0/2262777301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4120005280 0x7f41380b17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:55.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.262+0000 7f413cd14700 1 -- 172.21.15.114:0/2262777301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41381f5db0 con 0x7f41380c5b10 2023-10-18T12:19:55.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.262+0000 7f4137fff700 1 --2- 172.21.15.114:0/2262777301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4120005280 0x7f41380b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:19:55.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.262+0000 7f413cd14700 1 --2- 172.21.15.114:0/2262777301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41380c5b10 0x7f4138153e40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f41380ca6f0 tx=0x7f41300014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:55.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.262+0000 7f4134ff9700 1 -- 172.21.15.114:0/2262777301 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4130005070 con 0x7f41380c5b10 2023-10-18T12:19:55.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.262+0000 7f4134ff9700 1 -- 172.21.15.114:0/2262777301 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41300051d0 con 0x7f41380c5b10 2023-10-18T12:19:55.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.262+0000 7f4134ff9700 1 -- 172.21.15.114:0/2262777301 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4130005540 con 0x7f41380c5b10 2023-10-18T12:19:55.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.262+0000 7f413d515700 1 -- 172.21.15.114:0/2262777301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41381f6090 con 0x7f41380c5b10 2023-10-18T12:19:55.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.262+0000 7f413d515700 1 -- 172.21.15.114:0/2262777301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41381f6650 con 0x7f41380c5b10 2023-10-18T12:19:55.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.262+0000 7f413d515700 1 -- 172.21.15.114:0/2262777301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4138072e60 con 0x7f41380c5b10 2023-10-18T12:19:55.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.266+0000 7f4134ff9700 1 -- 172.21.15.114:0/2262777301 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f41300056a0 con 0x7f41380c5b10 2023-10-18T12:19:55.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.266+0000 7f4134ff9700 1 --2- 172.21.15.114:0/2262777301 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f41240656f0 0x7f4124067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:55.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.266+0000 7f4134ff9700 1 -- 172.21.15.114:0/2262777301 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f41300845d0 con 0x7f41380c5b10 2023-10-18T12:19:55.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.266+0000 7f4137fff700 1 --2- 172.21.15.114:0/2262777301 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f41240656f0 0x7f4124067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:55.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.270+0000 7f4137fff700 1 --2- 172.21.15.114:0/2262777301 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f41240656f0 0x7f4124067bb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4128001eb0 tx=0x7f4128009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:55.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.274+0000 7f4134ff9700 1 -- 172.21.15.114:0/2262777301 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f4130051d10 con 0x7f41380c5b10 2023-10-18T12:19:55.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.454+0000 7f413d515700 1 -- 172.21.15.114:0/2262777301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41381f2570 con 0x7f41380c5b10 2023-10-18T12:19:55.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.458+0000 7f4134ff9700 1 -- 172.21.15.114:0/2262777301 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20144 (secure 0 0 0) 0x7f4130055330 con 0x7f41380c5b10 2023-10-18T12:19:55.460 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:19:55.460 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":28,"fsid":"240ea340-5d3d-4f52-a4bc-af075aca3deb","created":"2023-10-18T12:19:12.512994+0000","modified":"2023-10-18T12:19:44.436656+0000","last_up_change":"2023-10-18T12:19:25.286009+0000","last_in_change":"2023-10-18T12:19:15.850693+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T12:19:27.040638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-18T12:19:32.358094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-18T12:19:37.333855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-18T12:19:38.055385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-18T12:19:41.679218+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c3578978-1a03-4857-b9d2-34a5da3d7731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6817","nonce":1506287862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6820","nonce":1506287862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6830","nonce":1506287862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6825","nonce":1506287862}]},"public_addr":"172.21.15.114:6817/1506287862","cluster_addr":"172.21.15.114:6820/1506287862","heartbeat_back_addr":"172.21.15.114:6830/1506287862","heartbeat_front_addr":"172.21.15.114:6825/1506287862","state":["exists","up"]},{"osd":1,"uuid":"43eb26a6-e2b3-4670-9559-bd053b5140d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6801","nonce":3302727047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6803","nonce":3302727047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6807","nonce":3302727047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6805","nonce":3302727047}]},"public_addr":"172.21.15.114:6801/3302727047","cluster_addr":"172.21.15.114:6803/3302727047","heartbeat_back_addr":"172.21.15.114:6807/3302727047","heartbeat_front_addr":"172.21.15.114:6805/3302727047","state":["exists","up"]},{"osd":2,"uuid":"f3d4dbd5-521c-4dd2-b687-5768cc7d0938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6809","nonce":2699151351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6811","nonce":2699151351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6815","nonce":2699151351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6813","nonce":2699151351}]},"public_addr":"172.21.15.114:6809/2699151351","cluster_addr":"172.21.15.114:6811/2699151351","heartbeat_back_addr":"172.21.15.114:6815/2699151351","heartbeat_front_addr":"172.21.15.114:6813/2699151351","state":["exists","up"]},{"osd":3,"uuid":"823e5802-92b7-4f0d-b32d-a5748993f1b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6821","nonce":1361608073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6824","nonce":1361608073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6829","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6831","nonce":1361608073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6827","nonce":1361608073}]},"public_addr":"172.21.15.114:6821/1361608073","cluster_addr":"172.21.15.114:6824/1361608073","heartbeat_back_addr":"172.21.15.114:6831/1361608073","heartbeat_front_addr":"172.21.15.114:6827/1361608073","state":["exists","up"]},{"osd":4,"uuid":"e47fb93e-13b4-44a4-b084-8c4384ceb41e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6801","nonce":930839681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6803","nonce":930839681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6807","nonce":930839681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6805","nonce":930839681}]},"public_addr":"172.21.15.172:6801/930839681","cluster_addr":"172.21.15.172:6803/930839681","heartbeat_back_addr":"172.21.15.172:6807/930839681","heartbeat_front_addr":"172.21.15.172:6805/930839681","state":["exists","up"]},{"osd":5,"uuid":"7561a973-f479-45a0-af40-f324728d622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6814","nonce":571761850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6818","nonce":571761850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6824","nonce":571761850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6821","nonce":571761850}]},"public_addr":"172.21.15.172:6814/571761850","cluster_addr":"172.21.15.172:6818/571761850","heartbeat_back_addr":"172.21.15.172:6824/571761850","heartbeat_front_addr":"172.21.15.172:6821/571761850","state":["exists","up"]},{"osd":6,"uuid":"51753f4b-7f06-4f1c-9ec7-6e18a66eb980","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6825","nonce":1680398853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6827","nonce":1680398853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6831","nonce":1680398853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6829","nonce":1680398853}]},"public_addr":"172.21.15.172:6825/1680398853","cluster_addr":"172.21.15.172:6827/1680398853","heartbeat_back_addr":"172.21.15.172:6831/1680398853","heartbeat_front_addr":"172.21.15.172:6829/1680398853","state":["exists","up"]},{"osd":7,"uuid":"4d8b1e15-143d-4d17-9074-59d92f0f9af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6809","nonce":349710101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6811","nonce":349710101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6819","nonce":349710101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6815","nonce":349710101}]},"public_addr":"172.21.15.172:6809/349710101","cluster_addr":"172.21.15.172:6811/349710101","heartbeat_back_addr":"172.21.15.172:6819/349710101","heartbeat_front_addr":"172.21.15.172:6815/349710101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.889460+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.475494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.911473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.648596+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.609994+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.636248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.854589+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.885826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T12:19:55.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.458+0000 7f413d515700 1 -- 172.21.15.114:0/2262777301 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f41240656f0 msgr2=0x7f4124067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:55.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.458+0000 7f413d515700 1 --2- 172.21.15.114:0/2262777301 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f41240656f0 0x7f4124067bb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4128001eb0 tx=0x7f4128009040 comp rx=0 tx=0).stop 2023-10-18T12:19:55.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.458+0000 7f413d515700 1 -- 172.21.15.114:0/2262777301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41380c5b10 msgr2=0x7f4138153e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:55.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.458+0000 7f413d515700 1 --2- 172.21.15.114:0/2262777301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41380c5b10 0x7f4138153e40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f41380ca6f0 tx=0x7f41300014a0 comp rx=0 tx=0).stop 2023-10-18T12:19:55.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.458+0000 7f413d515700 1 -- 172.21.15.114:0/2262777301 shutdown_connections 2023-10-18T12:19:55.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.458+0000 7f413d515700 1 --2- 172.21.15.114:0/2262777301 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f41240656f0 0x7f4124067bb0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:55.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.458+0000 7f413d515700 1 --2- 172.21.15.114:0/2262777301 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f41380c5690 0x7f41380c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:55.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.458+0000 7f413d515700 1 --2- 172.21.15.114:0/2262777301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41380c5b10 0x7f4138153e40 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:55.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.458+0000 7f413d515700 1 --2- 172.21.15.114:0/2262777301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4120005280 0x7f41380b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:55.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.458+0000 7f413d515700 1 -- 172.21.15.114:0/2262777301 >> 172.21.15.114:0/2262777301 conn(0x7f41380ce5c0 msgr2=0x7f4138155390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:55.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.458+0000 7f413d515700 1 -- 172.21.15.114:0/2262777301 shutdown_connections 2023-10-18T12:19:55.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.458+0000 7f413d515700 1 -- 172.21.15.114:0/2262777301 wait complete. 2023-10-18T12:19:55.491 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-18T12:19:27.040638+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-18T12:19:32.358094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-18T12:19:37.333855+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-18T12:19:38.055385+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-18T12:19:41.679218+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-18T12:19:55.492 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-18T12:19:55.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.670+0000 7f8007474700 1 Processor -- start 2023-10-18T12:19:55.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.670+0000 7f8007474700 1 -- start start 2023-10-18T12:19:55.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.674+0000 7f8007474700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8000160710 0x7f80000b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:55.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.674+0000 7f8007474700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f80000b5ae0 0x7f800006db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:55.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.674+0000 7f8007474700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f800015d0d0 con 0x7f80000d2e00 2023-10-18T12:19:55.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.674+0000 7f8007474700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f800015df90 con 0x7f8000160710 2023-10-18T12:19:55.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.674+0000 7f8007474700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f800006f0f0 con 0x7f80000b5ae0 2023-10-18T12:19:55.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.674+0000 7f8005c71700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8000160710 0x7f80000b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:55.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.674+0000 7f8005c71700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8000160710 0x7f80000b6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46650/0 (socket says 172.21.15.114:46650) 2023-10-18T12:19:55.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.674+0000 7f8005c71700 1 -- 172.21.15.114:0/2188384065 learned_addr learned my addr 172.21.15.114:0/2188384065 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:55.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.674+0000 7f8006c73700 1 --2- 172.21.15.114:0/2188384065 >> v2:172.21.15.172:3300/0 conn(0x7f80000b5ae0 0x7f800006db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:55.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.674+0000 7f8005c71700 1 -- 172.21.15.114:0/2188384065 >> v2:172.21.15.172:3300/0 conn(0x7f80000b5ae0 msgr2=0x7f800006db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:55.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.674+0000 7f8005c71700 1 --2- 172.21.15.114:0/2188384065 >> v2:172.21.15.172:3300/0 conn(0x7f80000b5ae0 0x7f800006db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:55.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.674+0000 7f8005c71700 1 -- 172.21.15.114:0/2188384065 >> v1:172.21.15.172:6789/0 conn(0x7f80000d2e00 legacy=0x7f80000d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:55.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.674+0000 7f8005c71700 1 -- 172.21.15.114:0/2188384065 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f800015d310 con 0x7f8000160710 2023-10-18T12:19:55.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.674+0000 7f8006c73700 1 --2- 172.21.15.114:0/2188384065 >> v2:172.21.15.172:3300/0 conn(0x7f80000b5ae0 0x7f800006db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:19:55.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.674+0000 7f8005c71700 1 --2- 172.21.15.114:0/2188384065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8000160710 0x7f80000b6e00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f800006d040 tx=0x7f7ff0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f86fd36489835985 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:55.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.674+0000 7f8005470700 1 -- 172.21.15.114:0/2188384065 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff000b8a0 con 0x7f8000160710 2023-10-18T12:19:55.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.678+0000 7f8005470700 1 -- 172.21.15.114:0/2188384065 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff000ba00 con 0x7f8000160710 2023-10-18T12:19:55.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.678+0000 7f8005470700 1 -- 172.21.15.114:0/2188384065 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff000bd90 con 0x7f8000160710 2023-10-18T12:19:55.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.678+0000 7f8007474700 1 -- 172.21.15.114:0/2188384065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8000160710 msgr2=0x7f80000b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:55.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.678+0000 7f8007474700 1 --2- 172.21.15.114:0/2188384065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8000160710 0x7f80000b6e00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f800006d040 tx=0x7f7ff0009bf0 comp rx=0 tx=0).stop 2023-10-18T12:19:55.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.678+0000 7f8007474700 1 -- 172.21.15.114:0/2188384065 shutdown_connections 2023-10-18T12:19:55.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.678+0000 7f8007474700 1 --2- 172.21.15.114:0/2188384065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8000160710 0x7f80000b6e00 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:55.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.678+0000 7f8007474700 1 --2- 172.21.15.114:0/2188384065 >> v2:172.21.15.172:3300/0 conn(0x7f80000b5ae0 0x7f800006db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:55.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.678+0000 7f8007474700 1 -- 172.21.15.114:0/2188384065 >> 172.21.15.114:0/2188384065 conn(0x7f8000069f20 msgr2=0x7f800006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:55.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.678+0000 7f8007474700 1 -- 172.21.15.114:0/2188384065 shutdown_connections 2023-10-18T12:19:55.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.678+0000 7f8007474700 1 -- 172.21.15.114:0/2188384065 wait complete. 2023-10-18T12:19:55.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.682+0000 7f8007474700 1 Processor -- start 2023-10-18T12:19:55.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.682+0000 7f8007474700 1 -- start start 2023-10-18T12:19:55.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.682+0000 7f8007474700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f80000b5ae0 0x7f8000146660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:55.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.682+0000 7f8007474700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80000d2e00 0x7f8000159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:55.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.682+0000 7f8007474700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8000160710 0x7f80000b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:55.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.682+0000 7f8007474700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8000155490 con 0x7f80000d2e00 2023-10-18T12:19:55.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.682+0000 7f8007474700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8000159820 con 0x7f8000160710 2023-10-18T12:19:55.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.682+0000 7f8007474700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8000159260 con 0x7f80000b5ae0 2023-10-18T12:19:55.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.682+0000 7f8005c71700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80000d2e00 0x7f8000159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:55.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.682+0000 7f8005c71700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80000d2e00 0x7f8000159bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46666/0 (socket says 172.21.15.114:46666) 2023-10-18T12:19:55.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.682+0000 7f8005c71700 1 -- 172.21.15.114:0/532837168 learned_addr learned my addr 172.21.15.114:0/532837168 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:55.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.686+0000 7f8006472700 1 --2- 172.21.15.114:0/532837168 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f80000b5ae0 0x7f8000146660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:55.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.686+0000 7f8006c73700 1 --2- 172.21.15.114:0/532837168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8000160710 0x7f80000b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:55.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.686+0000 7f8005c71700 1 -- 172.21.15.114:0/532837168 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f80000b5ae0 msgr2=0x7f8000146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:55.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.686+0000 7f8005c71700 1 --2- 172.21.15.114:0/532837168 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f80000b5ae0 0x7f8000146660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:55.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.686+0000 7f8005c71700 1 -- 172.21.15.114:0/532837168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8000160710 msgr2=0x7f80000b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:55.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.686+0000 7f8005c71700 1 --2- 172.21.15.114:0/532837168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8000160710 0x7f80000b47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:55.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.686+0000 7f8005c71700 1 -- 172.21.15.114:0/532837168 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff0009570 con 0x7f80000d2e00 2023-10-18T12:19:55.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.686+0000 7f8006c73700 1 --2- 172.21.15.114:0/532837168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8000160710 0x7f80000b47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:19:55.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.686+0000 7f8005c71700 1 --2- 172.21.15.114:0/532837168 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80000d2e00 0x7f8000159bd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0013000 tx=0x7f7ff0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:55.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.686+0000 7f7ff6ffd700 1 -- 172.21.15.114:0/532837168 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff0011b80 con 0x7f80000d2e00 2023-10-18T12:19:55.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.686+0000 7f7ff6ffd700 1 -- 172.21.15.114:0/532837168 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff001f070 con 0x7f80000d2e00 2023-10-18T12:19:55.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.686+0000 7f7ff6ffd700 1 -- 172.21.15.114:0/532837168 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff0004020 con 0x7f80000d2e00 2023-10-18T12:19:55.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.686+0000 7f8007474700 1 -- 172.21.15.114:0/532837168 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8000159540 con 0x7f80000d2e00 2023-10-18T12:19:55.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.686+0000 7f8007474700 1 -- 172.21.15.114:0/532837168 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8000158f10 con 0x7f80000d2e00 2023-10-18T12:19:55.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.686+0000 7f8007474700 1 -- 172.21.15.114:0/532837168 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f800004e910 con 0x7f80000d2e00 2023-10-18T12:19:55.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.690+0000 7f7ff6ffd700 1 -- 172.21.15.114:0/532837168 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f7ff0021030 con 0x7f80000d2e00 2023-10-18T12:19:55.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.690+0000 7f7ff6ffd700 1 --2- 172.21.15.114:0/532837168 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7fe40656f0 0x7f7fe4067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:55.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.690+0000 7f7ff6ffd700 1 -- 172.21.15.114:0/532837168 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7ff00846a0 con 0x7f80000d2e00 2023-10-18T12:19:55.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.690+0000 7f8006472700 1 --2- 172.21.15.114:0/532837168 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7fe40656f0 0x7f7fe4067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:55.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.690+0000 7f8006472700 1 --2- 172.21.15.114:0/532837168 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7fe40656f0 0x7f7fe4067bb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc000f60 tx=0x7f7ffc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:55.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.698+0000 7f7ff6ffd700 1 -- 172.21.15.114:0/532837168 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f7ff0051f00 con 0x7f80000d2e00 2023-10-18T12:19:55.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.886+0000 7f8007474700 1 -- 172.21.15.114:0/532837168 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8000161460 con 0x7f80000d2e00 2023-10-18T12:19:55.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.886+0000 7f7ff6ffd700 1 -- 172.21.15.114:0/532837168 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7ff0055520 con 0x7f80000d2e00 2023-10-18T12:19:55.890 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-10-18T12:19:55.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.890+0000 7f8007474700 1 -- 172.21.15.114:0/532837168 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7fe40656f0 msgr2=0x7f7fe4067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:55.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.890+0000 7f8007474700 1 --2- 172.21.15.114:0/532837168 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7fe40656f0 0x7f7fe4067bb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc000f60 tx=0x7f7ffc009040 comp rx=0 tx=0).stop 2023-10-18T12:19:55.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.890+0000 7f8007474700 1 -- 172.21.15.114:0/532837168 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80000d2e00 msgr2=0x7f8000159bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:55.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.890+0000 7f8007474700 1 --2- 172.21.15.114:0/532837168 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80000d2e00 0x7f8000159bd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0013000 tx=0x7f7ff0004770 comp rx=0 tx=0).stop 2023-10-18T12:19:55.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.890+0000 7f8007474700 1 -- 172.21.15.114:0/532837168 shutdown_connections 2023-10-18T12:19:55.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.890+0000 7f8007474700 1 --2- 172.21.15.114:0/532837168 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7fe40656f0 0x7f7fe4067bb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:55.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.890+0000 7f8007474700 1 --2- 172.21.15.114:0/532837168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8000160710 0x7f80000b47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:55.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.890+0000 7f8007474700 1 --2- 172.21.15.114:0/532837168 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80000d2e00 0x7f8000159bd0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:55.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.890+0000 7f8007474700 1 --2- 172.21.15.114:0/532837168 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f80000b5ae0 0x7f8000146660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:55.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.890+0000 7f8007474700 1 -- 172.21.15.114:0/532837168 >> 172.21.15.114:0/532837168 conn(0x7f8000069f20 msgr2=0x7f800006f450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:55.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.890+0000 7f8007474700 1 -- 172.21.15.114:0/532837168 shutdown_connections 2023-10-18T12:19:55.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:55.890+0000 7f8007474700 1 -- 172.21.15.114:0/532837168 wait complete. 2023-10-18T12:19:55.914 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-18T12:19:56.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.086+0000 7f5238425700 1 Processor -- start 2023-10-18T12:19:56.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.086+0000 7f5238425700 1 -- start start 2023-10-18T12:19:56.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.090+0000 7f5238425700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52300cad50 0x7f523006e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:56.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.090+0000 7f5238425700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f523006ea50 0x7f52300c9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:56.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.090+0000 7f5238425700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52300cc3f0 con 0x7f52300c1e30 2023-10-18T12:19:56.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.090+0000 7f5238425700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52300c2210 con 0x7f523006ea50 2023-10-18T12:19:56.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.090+0000 7f5238425700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f523006d820 con 0x7f52300cad50 2023-10-18T12:19:56.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.090+0000 7f52361c1700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f52300c1e30 0x7f523006f450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41544/0 (socket says 172.21.15.114:41544) 2023-10-18T12:19:56.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.090+0000 7f52361c1700 1 -- 172.21.15.114:0/2788734180 learned_addr learned my addr 172.21.15.114:0/2788734180 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:19:56.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.090+0000 7f52369c2700 1 --2- 172.21.15.114:0/2788734180 >> v2:172.21.15.114:3300/0 conn(0x7f523006ea50 0x7f52300c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:56.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.090+0000 7f52359c0700 1 --2- 172.21.15.114:0/2788734180 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52300cad50 0x7f523006e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:56.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.090+0000 7f52351bf700 1 -- 172.21.15.114:0/2788734180 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3812472346 0 0) 0x7f52300cc3f0 con 0x7f52300c1e30 2023-10-18T12:19:56.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.090+0000 7f52351bf700 1 -- 172.21.15.114:0/2788734180 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f521c0035d0 con 0x7f52300c1e30 2023-10-18T12:19:56.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.090+0000 7f52359c0700 1 -- 172.21.15.114:0/2788734180 >> v2:172.21.15.114:3300/0 conn(0x7f523006ea50 msgr2=0x7f52300c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:56.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.090+0000 7f52359c0700 1 --2- 172.21.15.114:0/2788734180 >> v2:172.21.15.114:3300/0 conn(0x7f523006ea50 0x7f52300c9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:56.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.090+0000 7f52359c0700 1 -- 172.21.15.114:0/2788734180 >> v1:172.21.15.114:6789/0 conn(0x7f52300c1e30 legacy=0x7f523006f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:56.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.090+0000 7f52359c0700 1 -- 172.21.15.114:0/2788734180 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f523006e080 con 0x7f52300cad50 2023-10-18T12:19:56.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.094+0000 7f52359c0700 1 --2- 172.21.15.114:0/2788734180 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52300cad50 0x7f523006e510 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5220009850 tx=0x7f5220009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88d9fb4b1a9c5c99 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:56.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.094+0000 7f52351bf700 1 -- 172.21.15.114:0/2788734180 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5220011830 con 0x7f52300cad50 2023-10-18T12:19:56.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.094+0000 7f52351bf700 1 -- 172.21.15.114:0/2788734180 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5220011990 con 0x7f52300cad50 2023-10-18T12:19:56.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.094+0000 7f52351bf700 1 -- 172.21.15.114:0/2788734180 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5220011d40 con 0x7f52300cad50 2023-10-18T12:19:56.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.094+0000 7f5238425700 1 -- 172.21.15.114:0/2788734180 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52300cad50 msgr2=0x7f523006e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:56.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.094+0000 7f5238425700 1 --2- 172.21.15.114:0/2788734180 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52300cad50 0x7f523006e510 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5220009850 tx=0x7f5220009b60 comp rx=0 tx=0).stop 2023-10-18T12:19:56.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.094+0000 7f5238425700 1 -- 172.21.15.114:0/2788734180 shutdown_connections 2023-10-18T12:19:56.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.094+0000 7f5238425700 1 --2- 172.21.15.114:0/2788734180 >> v2:172.21.15.114:3300/0 conn(0x7f523006ea50 0x7f52300c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:56.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.094+0000 7f5238425700 1 --2- 172.21.15.114:0/2788734180 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52300cad50 0x7f523006e510 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:56.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.094+0000 7f5238425700 1 -- 172.21.15.114:0/2788734180 >> 172.21.15.114:0/2788734180 conn(0x7f52300ce820 msgr2=0x7f52300cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:56.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.094+0000 7f5238425700 1 -- 172.21.15.114:0/2788734180 shutdown_connections 2023-10-18T12:19:56.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.094+0000 7f5238425700 1 -- 172.21.15.114:0/2788734180 wait complete. 2023-10-18T12:19:56.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.098+0000 7f5238425700 1 Processor -- start 2023-10-18T12:19:56.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.098+0000 7f5238425700 1 -- start start 2023-10-18T12:19:56.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.098+0000 7f5238425700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f523006ea50 0x7f52301f7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:56.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.098+0000 7f5238425700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52300c1e30 0x7f52300c48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:56.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.098+0000 7f5238425700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52300cad50 0x7f52300c4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:56.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.098+0000 7f5238425700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52301585f0 con 0x7f52300cad50 2023-10-18T12:19:56.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.098+0000 7f5238425700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52301f6e40 con 0x7f523006ea50 2023-10-18T12:19:56.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.098+0000 7f5238425700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52300c8980 con 0x7f52300c1e30 2023-10-18T12:19:56.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.098+0000 7f52369c2700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52300cad50 0x7f52300c4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:56.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.098+0000 7f52369c2700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52300cad50 0x7f52300c4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46676/0 (socket says 172.21.15.114:46676) 2023-10-18T12:19:56.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.098+0000 7f52369c2700 1 -- 172.21.15.114:0/180369619 learned_addr learned my addr 172.21.15.114:0/180369619 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:56.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.098+0000 7f52359c0700 1 --2- 172.21.15.114:0/180369619 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52300c1e30 0x7f52300c48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:56.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.098+0000 7f52361c1700 1 --2- 172.21.15.114:0/180369619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f523006ea50 0x7f52301f7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:56.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.098+0000 7f52369c2700 1 -- 172.21.15.114:0/180369619 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52300c1e30 msgr2=0x7f52300c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:56.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.098+0000 7f52369c2700 1 --2- 172.21.15.114:0/180369619 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52300c1e30 0x7f52300c48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:56.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.098+0000 7f52369c2700 1 -- 172.21.15.114:0/180369619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f523006ea50 msgr2=0x7f52301f7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:56.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.098+0000 7f52369c2700 1 --2- 172.21.15.114:0/180369619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f523006ea50 0x7f52301f7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:56.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.098+0000 7f52369c2700 1 -- 172.21.15.114:0/180369619 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52200094b0 con 0x7f52300cad50 2023-10-18T12:19:56.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.098+0000 7f52369c2700 1 --2- 172.21.15.114:0/180369619 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52300cad50 0x7f52300c4e20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5228009dd0 tx=0x7f522800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:56.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.098+0000 7f5226ffd700 1 -- 172.21.15.114:0/180369619 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5228009c40 con 0x7f52300cad50 2023-10-18T12:19:56.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.102+0000 7f5226ffd700 1 -- 172.21.15.114:0/180369619 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522800f040 con 0x7f52300cad50 2023-10-18T12:19:56.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.102+0000 7f5238425700 1 -- 172.21.15.114:0/180369619 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5230158030 con 0x7f52300cad50 2023-10-18T12:19:56.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.102+0000 7f5226ffd700 1 -- 172.21.15.114:0/180369619 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522800ceb0 con 0x7f52300cad50 2023-10-18T12:19:56.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.102+0000 7f5238425700 1 -- 172.21.15.114:0/180369619 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52301f7050 con 0x7f52300cad50 2023-10-18T12:19:56.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.102+0000 7f5238425700 1 -- 172.21.15.114:0/180369619 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5230072e60 con 0x7f52300cad50 2023-10-18T12:19:56.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.102+0000 7f5226ffd700 1 -- 172.21.15.114:0/180369619 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f5228014480 con 0x7f52300cad50 2023-10-18T12:19:56.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.106+0000 7f5226ffd700 1 --2- 172.21.15.114:0/180369619 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f52140656f0 0x7f5214067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:56.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.106+0000 7f5226ffd700 1 -- 172.21.15.114:0/180369619 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5228083860 con 0x7f52300cad50 2023-10-18T12:19:56.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.106+0000 7f52361c1700 1 --2- 172.21.15.114:0/180369619 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f52140656f0 0x7f5214067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:56.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.106+0000 7f52361c1700 1 --2- 172.21.15.114:0/180369619 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f52140656f0 0x7f5214067bb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f522c007fd0 tx=0x7f522c007de0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:56.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.110+0000 7f5226ffd700 1 -- 172.21.15.114:0/180369619 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f5228054ac0 con 0x7f52300cad50 2023-10-18T12:19:56.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.286+0000 7f5238425700 1 -- 172.21.15.114:0/180369619 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f523006d0f0 con 0x7f52300cad50 2023-10-18T12:19:56.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.286+0000 7f5226ffd700 1 -- 172.21.15.114:0/180369619 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5228018020 con 0x7f52300cad50 2023-10-18T12:19:56.291 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 8 2023-10-18T12:19:56.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.290+0000 7f5238425700 1 -- 172.21.15.114:0/180369619 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f52140656f0 msgr2=0x7f5214067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:56.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.290+0000 7f5238425700 1 --2- 172.21.15.114:0/180369619 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f52140656f0 0x7f5214067bb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f522c007fd0 tx=0x7f522c007de0 comp rx=0 tx=0).stop 2023-10-18T12:19:56.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.290+0000 7f5238425700 1 -- 172.21.15.114:0/180369619 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52300cad50 msgr2=0x7f52300c4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:56.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.290+0000 7f5238425700 1 --2- 172.21.15.114:0/180369619 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52300cad50 0x7f52300c4e20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5228009dd0 tx=0x7f522800c3a0 comp rx=0 tx=0).stop 2023-10-18T12:19:56.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.290+0000 7f5238425700 1 -- 172.21.15.114:0/180369619 shutdown_connections 2023-10-18T12:19:56.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.290+0000 7f5238425700 1 --2- 172.21.15.114:0/180369619 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f52140656f0 0x7f5214067bb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:56.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.290+0000 7f5238425700 1 --2- 172.21.15.114:0/180369619 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f52300c1e30 0x7f52300c48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:56.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.290+0000 7f5238425700 1 --2- 172.21.15.114:0/180369619 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52300cad50 0x7f52300c4e20 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:56.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.290+0000 7f5238425700 1 --2- 172.21.15.114:0/180369619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f523006ea50 0x7f52301f7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:56.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.290+0000 7f5238425700 1 -- 172.21.15.114:0/180369619 >> 172.21.15.114:0/180369619 conn(0x7f52300ce820 msgr2=0x7f52300cc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:56.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.290+0000 7f5238425700 1 -- 172.21.15.114:0/180369619 shutdown_connections 2023-10-18T12:19:56.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.290+0000 7f5238425700 1 -- 172.21.15.114:0/180369619 wait complete. 2023-10-18T12:19:56.315 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-18T12:19:56.502 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.498+0000 7fa9258fb700 1 Processor -- start 2023-10-18T12:19:56.502 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.498+0000 7fa9258fb700 1 -- start start 2023-10-18T12:19:56.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.502+0000 7fa9258fb700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa9200d2e00 0x7fa9200b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:56.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.502+0000 7fa9258fb700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa9200b5ae0 0x7fa92006db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:56.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.502+0000 7fa9258fb700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa92015d0d0 con 0x7fa920160710 2023-10-18T12:19:56.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.502+0000 7fa9258fb700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa92015df90 con 0x7fa9200b5ae0 2023-10-18T12:19:56.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.502+0000 7fa9258fb700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa92006f0f0 con 0x7fa9200d2e00 2023-10-18T12:19:56.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.502+0000 7fa9250fa700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa9200b5ae0 0x7fa92006db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:56.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.502+0000 7fa91ffff700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa920160710 0x7fa9200d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41548/0 (socket says 172.21.15.114:41548) 2023-10-18T12:19:56.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.502+0000 7fa91ffff700 1 -- 172.21.15.114:0/464689532 learned_addr learned my addr 172.21.15.114:0/464689532 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:19:56.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.502+0000 7fa9248f9700 1 --2- 172.21.15.114:0/464689532 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa9200d2e00 0x7fa9200b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:56.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.502+0000 7fa9250fa700 1 -- 172.21.15.114:0/464689532 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa9200d2e00 msgr2=0x7fa9200b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:56.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.502+0000 7fa9250fa700 1 --2- 172.21.15.114:0/464689532 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa9200d2e00 0x7fa9200b6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:56.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.502+0000 7fa9250fa700 1 -- 172.21.15.114:0/464689532 >> v1:172.21.15.114:6789/0 conn(0x7fa920160710 legacy=0x7fa9200d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:56.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.502+0000 7fa9250fa700 1 -- 172.21.15.114:0/464689532 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa92015d310 con 0x7fa9200b5ae0 2023-10-18T12:19:56.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.502+0000 7fa9250fa700 1 --2- 172.21.15.114:0/464689532 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9200b5ae0 0x7fa92006db60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa918009dc0 tx=0x7fa91800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac0d2a99f89ddc30 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:56.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.502+0000 7fa91f7fe700 1 -- 172.21.15.114:0/464689532 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91800e070 con 0x7fa9200b5ae0 2023-10-18T12:19:56.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.502+0000 7fa91f7fe700 1 -- 172.21.15.114:0/464689532 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa91800bae0 con 0x7fa9200b5ae0 2023-10-18T12:19:56.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.502+0000 7fa91f7fe700 1 -- 172.21.15.114:0/464689532 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91800be90 con 0x7fa9200b5ae0 2023-10-18T12:19:56.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.506+0000 7fa9258fb700 1 -- 172.21.15.114:0/464689532 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9200b5ae0 msgr2=0x7fa92006db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:56.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.506+0000 7fa9258fb700 1 --2- 172.21.15.114:0/464689532 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9200b5ae0 0x7fa92006db60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa918009dc0 tx=0x7fa91800b330 comp rx=0 tx=0).stop 2023-10-18T12:19:56.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.506+0000 7fa9258fb700 1 -- 172.21.15.114:0/464689532 shutdown_connections 2023-10-18T12:19:56.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.506+0000 7fa9258fb700 1 --2- 172.21.15.114:0/464689532 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9200b5ae0 0x7fa92006db60 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:56.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.506+0000 7fa9258fb700 1 --2- 172.21.15.114:0/464689532 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa9200d2e00 0x7fa9200b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:56.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.506+0000 7fa9258fb700 1 -- 172.21.15.114:0/464689532 >> 172.21.15.114:0/464689532 conn(0x7fa920069f20 msgr2=0x7fa92006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:56.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.506+0000 7fa9258fb700 1 -- 172.21.15.114:0/464689532 shutdown_connections 2023-10-18T12:19:56.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.506+0000 7fa9258fb700 1 -- 172.21.15.114:0/464689532 wait complete. 2023-10-18T12:19:56.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.506+0000 7fa9258fb700 1 Processor -- start 2023-10-18T12:19:56.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.506+0000 7fa9258fb700 1 -- start start 2023-10-18T12:19:56.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.510+0000 7fa9258fb700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa9200b5ae0 0x7fa9200b4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:56.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.510+0000 7fa9258fb700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9200d2e00 0x7fa9200ad0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:56.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.510+0000 7fa9258fb700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa920160710 0x7fa920157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:56.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.510+0000 7fa9258fb700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9200b2e10 con 0x7fa9200d2e00 2023-10-18T12:19:56.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.510+0000 7fa9258fb700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9200ac820 con 0x7fa920160710 2023-10-18T12:19:56.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.510+0000 7fa9258fb700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9200acb00 con 0x7fa9200b5ae0 2023-10-18T12:19:56.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.510+0000 7fa91ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9200d2e00 0x7fa9200ad0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:56.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.510+0000 7fa91ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9200d2e00 0x7fa9200ad0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46682/0 (socket says 172.21.15.114:46682) 2023-10-18T12:19:56.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.510+0000 7fa91ffff700 1 -- 172.21.15.114:0/29822687 learned_addr learned my addr 172.21.15.114:0/29822687 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:56.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.510+0000 7fa9248f9700 1 --2- 172.21.15.114:0/29822687 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa9200b5ae0 0x7fa9200b4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:56.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.510+0000 7fa9250fa700 1 --2- 172.21.15.114:0/29822687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa920160710 0x7fa920157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:56.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.510+0000 7fa91ffff700 1 -- 172.21.15.114:0/29822687 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa9200b5ae0 msgr2=0x7fa9200b4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:56.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.510+0000 7fa91ffff700 1 --2- 172.21.15.114:0/29822687 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa9200b5ae0 0x7fa9200b4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:56.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.510+0000 7fa91ffff700 1 -- 172.21.15.114:0/29822687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa920160710 msgr2=0x7fa920157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:56.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.510+0000 7fa91ffff700 1 --2- 172.21.15.114:0/29822687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa920160710 0x7fa920157590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:56.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.510+0000 7fa91ffff700 1 -- 172.21.15.114:0/29822687 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa918009a70 con 0x7fa9200d2e00 2023-10-18T12:19:56.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.510+0000 7fa9250fa700 1 --2- 172.21.15.114:0/29822687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa920160710 0x7fa920157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:19:56.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.510+0000 7fa91ffff700 1 --2- 172.21.15.114:0/29822687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9200d2e00 0x7fa9200ad0a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa90c001eb0 tx=0x7fa90c00c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:56.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.510+0000 7fa91d7fa700 1 -- 172.21.15.114:0/29822687 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90c005d90 con 0x7fa9200d2e00 2023-10-18T12:19:56.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.510+0000 7fa91d7fa700 1 -- 172.21.15.114:0/29822687 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa90c0070d0 con 0x7fa9200d2e00 2023-10-18T12:19:56.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.510+0000 7fa91d7fa700 1 -- 172.21.15.114:0/29822687 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90c007440 con 0x7fa9200d2e00 2023-10-18T12:19:56.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.510+0000 7fa9258fb700 1 -- 172.21.15.114:0/29822687 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9200b2750 con 0x7fa9200d2e00 2023-10-18T12:19:56.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.510+0000 7fa9258fb700 1 -- 172.21.15.114:0/29822687 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9200b4b80 con 0x7fa9200d2e00 2023-10-18T12:19:56.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.514+0000 7fa9258fb700 1 -- 172.21.15.114:0/29822687 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9200b2f50 con 0x7fa9200d2e00 2023-10-18T12:19:56.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.514+0000 7fa91d7fa700 1 -- 172.21.15.114:0/29822687 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fa90c0075a0 con 0x7fa9200d2e00 2023-10-18T12:19:56.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.518+0000 7fa91d7fa700 1 --2- 172.21.15.114:0/29822687 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa9040656f0 0x7fa904067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:56.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.518+0000 7fa91d7fa700 1 -- 172.21.15.114:0/29822687 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa90c0821a0 con 0x7fa9200d2e00 2023-10-18T12:19:56.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.518+0000 7fa9248f9700 1 --2- 172.21.15.114:0/29822687 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa9040656f0 0x7fa904067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:56.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.518+0000 7fa9248f9700 1 --2- 172.21.15.114:0/29822687 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa9040656f0 0x7fa904067bb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa914009b50 tx=0x7fa914009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:56.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.522+0000 7fa91d7fa700 1 -- 172.21.15.114:0/29822687 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fa9200b2f50 con 0x7fa9200d2e00 2023-10-18T12:19:56.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.714+0000 7fa9258fb700 1 -- 172.21.15.114:0/29822687 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa92015d0d0 con 0x7fa9200d2e00 2023-10-18T12:19:56.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.714+0000 7fa91d7fa700 1 -- 172.21.15.114:0/29822687 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa92015d0d0 con 0x7fa9200d2e00 2023-10-18T12:19:56.717 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-10-18T12:19:56.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.714+0000 7fa9258fb700 1 -- 172.21.15.114:0/29822687 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa9040656f0 msgr2=0x7fa904067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:56.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.714+0000 7fa9258fb700 1 --2- 172.21.15.114:0/29822687 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa9040656f0 0x7fa904067bb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa914009b50 tx=0x7fa914009240 comp rx=0 tx=0).stop 2023-10-18T12:19:56.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.714+0000 7fa9258fb700 1 -- 172.21.15.114:0/29822687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9200d2e00 msgr2=0x7fa9200ad0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:56.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.714+0000 7fa9258fb700 1 --2- 172.21.15.114:0/29822687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9200d2e00 0x7fa9200ad0a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa90c001eb0 tx=0x7fa90c00c7b0 comp rx=0 tx=0).stop 2023-10-18T12:19:56.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.718+0000 7fa9258fb700 1 -- 172.21.15.114:0/29822687 shutdown_connections 2023-10-18T12:19:56.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.718+0000 7fa9258fb700 1 --2- 172.21.15.114:0/29822687 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa9040656f0 0x7fa904067bb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:56.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.718+0000 7fa9258fb700 1 --2- 172.21.15.114:0/29822687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa920160710 0x7fa920157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:56.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.718+0000 7fa9258fb700 1 --2- 172.21.15.114:0/29822687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9200d2e00 0x7fa9200ad0a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:56.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.718+0000 7fa9258fb700 1 --2- 172.21.15.114:0/29822687 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa9200b5ae0 0x7fa9200b4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:56.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.718+0000 7fa9258fb700 1 -- 172.21.15.114:0/29822687 >> 172.21.15.114:0/29822687 conn(0x7fa920069f20 msgr2=0x7fa9200b5fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:56.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.718+0000 7fa9258fb700 1 -- 172.21.15.114:0/29822687 shutdown_connections 2023-10-18T12:19:56.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.718+0000 7fa9258fb700 1 -- 172.21.15.114:0/29822687 wait complete. 2023-10-18T12:19:56.740 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-18T12:19:56.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.914+0000 7febf4c89700 1 Processor -- start 2023-10-18T12:19:56.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.914+0000 7febf4c89700 1 -- start start 2023-10-18T12:19:56.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.918+0000 7febf4c89700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7febf00c1e30 0x7febf006f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:56.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.918+0000 7febf4c89700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febf00cad50 0x7febf006e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:56.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.918+0000 7febf4c89700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febf00cc3f0 con 0x7febf006ea50 2023-10-18T12:19:56.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.918+0000 7febf4c89700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febf00c2210 con 0x7febf00c1e30 2023-10-18T12:19:56.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.918+0000 7febf4c89700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf006d820 con 0x7febf00cad50 2023-10-18T12:19:56.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.918+0000 7febee59c700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7febf00c1e30 0x7febf006f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:56.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.918+0000 7febee59c700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7febf00c1e30 0x7febf006f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46692/0 (socket says 172.21.15.114:46692) 2023-10-18T12:19:56.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.918+0000 7febee59c700 1 -- 172.21.15.114:0/322400790 learned_addr learned my addr 172.21.15.114:0/322400790 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:56.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.918+0000 7febe5d9b700 1 --2- 172.21.15.114:0/322400790 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febf00cad50 0x7febf006e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:56.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.918+0000 7febee59c700 1 -- 172.21.15.114:0/322400790 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febf00cad50 msgr2=0x7febf006e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:56.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.918+0000 7febee59c700 1 --2- 172.21.15.114:0/322400790 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febf00cad50 0x7febf006e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:56.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.918+0000 7febee59c700 1 -- 172.21.15.114:0/322400790 >> v1:172.21.15.172:6789/0 conn(0x7febf006ea50 legacy=0x7febf0164ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:56.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.918+0000 7febee59c700 1 -- 172.21.15.114:0/322400790 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf006e080 con 0x7febf00c1e30 2023-10-18T12:19:56.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.918+0000 7febee59c700 1 --2- 172.21.15.114:0/322400790 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febf00c1e30 0x7febf006f450 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7febe0009910 tx=0x7febe0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2b7b692eb8b6820 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:56.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.918+0000 7febedd9b700 1 -- 172.21.15.114:0/322400790 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe000ba60 con 0x7febf00c1e30 2023-10-18T12:19:56.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.918+0000 7febedd9b700 1 -- 172.21.15.114:0/322400790 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe000bbc0 con 0x7febf00c1e30 2023-10-18T12:19:56.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.918+0000 7febedd9b700 1 -- 172.21.15.114:0/322400790 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe0009e60 con 0x7febf00c1e30 2023-10-18T12:19:56.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.922+0000 7febf4c89700 1 -- 172.21.15.114:0/322400790 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febf00c1e30 msgr2=0x7febf006f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:56.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.922+0000 7febf4c89700 1 --2- 172.21.15.114:0/322400790 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febf00c1e30 0x7febf006f450 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7febe0009910 tx=0x7febe0009c20 comp rx=0 tx=0).stop 2023-10-18T12:19:56.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.922+0000 7febf4c89700 1 -- 172.21.15.114:0/322400790 shutdown_connections 2023-10-18T12:19:56.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.922+0000 7febf4c89700 1 --2- 172.21.15.114:0/322400790 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febf00cad50 0x7febf006e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:56.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.922+0000 7febf4c89700 1 --2- 172.21.15.114:0/322400790 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febf00c1e30 0x7febf006f450 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:56.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.922+0000 7febf4c89700 1 -- 172.21.15.114:0/322400790 >> 172.21.15.114:0/322400790 conn(0x7febf00ce820 msgr2=0x7febf00cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:56.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.922+0000 7febf4c89700 1 -- 172.21.15.114:0/322400790 shutdown_connections 2023-10-18T12:19:56.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.922+0000 7febf4c89700 1 -- 172.21.15.114:0/322400790 wait complete. 2023-10-18T12:19:56.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.926+0000 7febf4c89700 1 Processor -- start 2023-10-18T12:19:56.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.926+0000 7febf4c89700 1 -- start start 2023-10-18T12:19:56.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.926+0000 7febf4c89700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febf006ea50 0x7febf00b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:56.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.926+0000 7febf4c89700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febf00c1e30 0x7febf00af560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:56.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.926+0000 7febf4c89700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febf00cad50 0x7febf00afaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:56.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.926+0000 7febf4c89700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf0163ef0 con 0x7febf00c1e30 2023-10-18T12:19:56.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.926+0000 7febf4c89700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf00b2250 con 0x7febf006ea50 2023-10-18T12:19:56.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.926+0000 7febf4c89700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf00b26e0 con 0x7febf00cad50 2023-10-18T12:19:56.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.926+0000 7febe5d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febf00c1e30 0x7febf00af560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:56.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.926+0000 7febe5d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febf00c1e30 0x7febf00af560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46700/0 (socket says 172.21.15.114:46700) 2023-10-18T12:19:56.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.926+0000 7febe5d9b700 1 -- 172.21.15.114:0/2631545235 learned_addr learned my addr 172.21.15.114:0/2631545235 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:56.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.926+0000 7febeed9d700 1 --2- 172.21.15.114:0/2631545235 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febf00cad50 0x7febf00afaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:56.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.926+0000 7febee59c700 1 --2- 172.21.15.114:0/2631545235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febf006ea50 0x7febf00b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:56.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.930+0000 7febe5d9b700 1 -- 172.21.15.114:0/2631545235 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febf00cad50 msgr2=0x7febf00afaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:56.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.930+0000 7febe5d9b700 1 --2- 172.21.15.114:0/2631545235 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febf00cad50 0x7febf00afaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:56.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.930+0000 7febe5d9b700 1 -- 172.21.15.114:0/2631545235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febf006ea50 msgr2=0x7febf00b3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:56.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.930+0000 7febe5d9b700 1 --2- 172.21.15.114:0/2631545235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febf006ea50 0x7febf00b3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:56.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.930+0000 7febe5d9b700 1 -- 172.21.15.114:0/2631545235 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe0009570 con 0x7febf00c1e30 2023-10-18T12:19:56.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.930+0000 7febeed9d700 1 --2- 172.21.15.114:0/2631545235 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febf00cad50 0x7febf00afaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:19:56.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.930+0000 7febee59c700 1 --2- 172.21.15.114:0/2631545235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febf006ea50 0x7febf00b3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:19:56.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.930+0000 7febe5d9b700 1 --2- 172.21.15.114:0/2631545235 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febf00c1e30 0x7febf00af560 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7febd800d800 tx=0x7febd800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:56.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.930+0000 7febe77fe700 1 -- 172.21.15.114:0/2631545235 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd80125f0 con 0x7febf00c1e30 2023-10-18T12:19:56.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.930+0000 7febf4c89700 1 -- 172.21.15.114:0/2631545235 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febf00b1360 con 0x7febf00c1e30 2023-10-18T12:19:56.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.930+0000 7febe77fe700 1 -- 172.21.15.114:0/2631545235 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd8012750 con 0x7febf00c1e30 2023-10-18T12:19:56.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.930+0000 7febe77fe700 1 -- 172.21.15.114:0/2631545235 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd8012b00 con 0x7febf00c1e30 2023-10-18T12:19:56.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.930+0000 7febf4c89700 1 -- 172.21.15.114:0/2631545235 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febf00b1920 con 0x7febf00c1e30 2023-10-18T12:19:56.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.930+0000 7febf4c89700 1 -- 172.21.15.114:0/2631545235 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febf00c1630 con 0x7febf00c1e30 2023-10-18T12:19:56.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.934+0000 7febe77fe700 1 -- 172.21.15.114:0/2631545235 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7febd8012c60 con 0x7febf00c1e30 2023-10-18T12:19:56.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.934+0000 7febe77fe700 1 --2- 172.21.15.114:0/2631545235 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7febd0065720 0x7febd0067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:56.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.934+0000 7febe77fe700 1 -- 172.21.15.114:0/2631545235 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7febd8083cc0 con 0x7febf00c1e30 2023-10-18T12:19:56.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.934+0000 7febee59c700 1 --2- 172.21.15.114:0/2631545235 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7febd0065720 0x7febd0067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:56.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.934+0000 7febee59c700 1 --2- 172.21.15.114:0/2631545235 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7febd0065720 0x7febd0067be0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7febe0009c60 tx=0x7febe0008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:56.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:56.938+0000 7febe77fe700 1 -- 172.21.15.114:0/2631545235 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7febd8051490 con 0x7febf00c1e30 2023-10-18T12:19:57.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.114+0000 7febf4c89700 1 -- 172.21.15.114:0/2631545235 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7febf0072e60 con 0x7febf00c1e30 2023-10-18T12:19:57.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.114+0000 7febe77fe700 1 -- 172.21.15.114:0/2631545235 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7febd805a070 con 0x7febf00c1e30 2023-10-18T12:19:57.118 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-10-18T12:19:57.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.118+0000 7febf4c89700 1 -- 172.21.15.114:0/2631545235 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7febd0065720 msgr2=0x7febd0067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:57.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.118+0000 7febf4c89700 1 --2- 172.21.15.114:0/2631545235 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7febd0065720 0x7febd0067be0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7febe0009c60 tx=0x7febe0008030 comp rx=0 tx=0).stop 2023-10-18T12:19:57.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.118+0000 7febf4c89700 1 -- 172.21.15.114:0/2631545235 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febf00c1e30 msgr2=0x7febf00af560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:57.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.118+0000 7febf4c89700 1 --2- 172.21.15.114:0/2631545235 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febf00c1e30 0x7febf00af560 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7febd800d800 tx=0x7febd800db10 comp rx=0 tx=0).stop 2023-10-18T12:19:57.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.118+0000 7febf4c89700 1 -- 172.21.15.114:0/2631545235 shutdown_connections 2023-10-18T12:19:57.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.118+0000 7febf4c89700 1 --2- 172.21.15.114:0/2631545235 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7febd0065720 0x7febd0067be0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:57.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.118+0000 7febf4c89700 1 --2- 172.21.15.114:0/2631545235 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7febf00cad50 0x7febf00afaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:57.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.118+0000 7febf4c89700 1 --2- 172.21.15.114:0/2631545235 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febf00c1e30 0x7febf00af560 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:57.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.118+0000 7febf4c89700 1 --2- 172.21.15.114:0/2631545235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febf006ea50 0x7febf00b3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:57.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.118+0000 7febf4c89700 1 -- 172.21.15.114:0/2631545235 >> 172.21.15.114:0/2631545235 conn(0x7febf00ce820 msgr2=0x7febf0160cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:57.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.118+0000 7febf4c89700 1 -- 172.21.15.114:0/2631545235 shutdown_connections 2023-10-18T12:19:57.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.118+0000 7febf4c89700 1 -- 172.21.15.114:0/2631545235 wait complete. 2023-10-18T12:19:57.144 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-18T12:19:57.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.318+0000 7f9b3612f700 1 Processor -- start 2023-10-18T12:19:57.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.322+0000 7f9b3612f700 1 -- start start 2023-10-18T12:19:57.326 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.322+0000 7f9b3612f700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9b300b4310 0x7f9b300ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:57.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.322+0000 7f9b3612f700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b3015e000 con 0x7f9b300cc190 2023-10-18T12:19:57.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.322+0000 7f9b3612f700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b300ce170 con 0x7f9b300cdd90 2023-10-18T12:19:57.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.322+0000 7f9b3612f700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b3015d3f0 con 0x7f9b300b4310 2023-10-18T12:19:57.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.322+0000 7f9b3592e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9b300b4310 0x7f9b300ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:57.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.322+0000 7f9b3512d700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f9b300cdd90 0x7f9b3006d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.114:59704/0 (socket says 172.21.15.114:59704) 2023-10-18T12:19:57.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.322+0000 7f9b3512d700 1 -- 172.21.15.114:0/1345725771 learned_addr learned my addr 172.21.15.114:0/1345725771 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:19:57.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.322+0000 7f9b3492c700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f9b300cc190 0x7f9b300b3c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41554/0 (socket says 172.21.15.114:41554) 2023-10-18T12:19:57.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.326+0000 7f9b3592e700 1 -- 172.21.15.114:0/1345725771 >> v1:172.21.15.172:6789/0 conn(0x7f9b300cdd90 legacy=0x7f9b3006d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:57.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.326+0000 7f9b3592e700 1 -- 172.21.15.114:0/1345725771 >> v1:172.21.15.114:6789/0 conn(0x7f9b300cc190 legacy=0x7f9b300b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:57.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.326+0000 7f9b3592e700 1 -- 172.21.15.114:0/1345725771 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b3015d6d0 con 0x7f9b300b4310 2023-10-18T12:19:57.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.326+0000 7f9b3592e700 1 --2- 172.21.15.114:0/1345725771 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b300b4310 0x7f9b300ca0a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9b28009d90 tx=0x7f9b2800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f9765a85aca6754 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:57.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.326+0000 7f9b27fff700 1 -- 172.21.15.114:0/1345725771 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2800e070 con 0x7f9b300b4310 2023-10-18T12:19:57.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.326+0000 7f9b27fff700 1 -- 172.21.15.114:0/1345725771 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2800bbd0 con 0x7f9b300b4310 2023-10-18T12:19:57.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.326+0000 7f9b27fff700 1 -- 172.21.15.114:0/1345725771 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b28012430 con 0x7f9b300b4310 2023-10-18T12:19:57.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.326+0000 7f9b3612f700 1 -- 172.21.15.114:0/1345725771 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b300b4310 msgr2=0x7f9b300ca0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:57.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.326+0000 7f9b3612f700 1 --2- 172.21.15.114:0/1345725771 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b300b4310 0x7f9b300ca0a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9b28009d90 tx=0x7f9b2800b330 comp rx=0 tx=0).stop 2023-10-18T12:19:57.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.326+0000 7f9b3612f700 1 -- 172.21.15.114:0/1345725771 shutdown_connections 2023-10-18T12:19:57.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.326+0000 7f9b3612f700 1 --2- 172.21.15.114:0/1345725771 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b300b4310 0x7f9b300ca0a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:57.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.326+0000 7f9b3612f700 1 -- 172.21.15.114:0/1345725771 >> 172.21.15.114:0/1345725771 conn(0x7f9b300ce5c0 msgr2=0x7f9b300ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:57.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.326+0000 7f9b3612f700 1 -- 172.21.15.114:0/1345725771 shutdown_connections 2023-10-18T12:19:57.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.326+0000 7f9b3612f700 1 -- 172.21.15.114:0/1345725771 wait complete. 2023-10-18T12:19:57.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.330+0000 7f9b3612f700 1 Processor -- start 2023-10-18T12:19:57.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.330+0000 7f9b3612f700 1 -- start start 2023-10-18T12:19:57.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.330+0000 7f9b3612f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9b300b4310 0x7f9b301483a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:57.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.330+0000 7f9b3612f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b300cc190 0x7f9b300c3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:57.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.330+0000 7f9b3612f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b300cdd90 0x7f9b300c4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:57.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.330+0000 7f9b3612f700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b301488e0 con 0x7f9b300cdd90 2023-10-18T12:19:57.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.330+0000 7f9b3612f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b301584b0 con 0x7f9b300cc190 2023-10-18T12:19:57.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.330+0000 7f9b3612f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3014f880 con 0x7f9b300b4310 2023-10-18T12:19:57.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.330+0000 7f9b3592e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b300cdd90 0x7f9b300c4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:57.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.330+0000 7f9b3592e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b300cdd90 0x7f9b300c4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46708/0 (socket says 172.21.15.114:46708) 2023-10-18T12:19:57.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.330+0000 7f9b3592e700 1 -- 172.21.15.114:0/486536645 learned_addr learned my addr 172.21.15.114:0/486536645 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:57.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.330+0000 7f9b3492c700 1 --2- 172.21.15.114:0/486536645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b300cc190 0x7f9b300c3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:57.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.330+0000 7f9b3512d700 1 --2- 172.21.15.114:0/486536645 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9b300b4310 0x7f9b301483a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:57.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.330+0000 7f9b3592e700 1 -- 172.21.15.114:0/486536645 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9b300b4310 msgr2=0x7f9b301483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:57.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.330+0000 7f9b3592e700 1 --2- 172.21.15.114:0/486536645 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9b300b4310 0x7f9b301483a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:57.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.330+0000 7f9b3592e700 1 -- 172.21.15.114:0/486536645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b300cc190 msgr2=0x7f9b300c3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:57.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.330+0000 7f9b3592e700 1 --2- 172.21.15.114:0/486536645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b300cc190 0x7f9b300c3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:57.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.330+0000 7f9b3592e700 1 -- 172.21.15.114:0/486536645 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b28009a70 con 0x7f9b300cdd90 2023-10-18T12:19:57.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.330+0000 7f9b3492c700 1 --2- 172.21.15.114:0/486536645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b300cc190 0x7f9b300c3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:19:57.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.330+0000 7f9b3592e700 1 --2- 172.21.15.114:0/486536645 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b300cdd90 0x7f9b300c4170 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9b300cf100 tx=0x7f9b28004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:57.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.330+0000 7f9b25ffb700 1 -- 172.21.15.114:0/486536645 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b280098f0 con 0x7f9b300cdd90 2023-10-18T12:19:57.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.330+0000 7f9b25ffb700 1 -- 172.21.15.114:0/486536645 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b28020070 con 0x7f9b300cdd90 2023-10-18T12:19:57.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.330+0000 7f9b25ffb700 1 -- 172.21.15.114:0/486536645 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b28004280 con 0x7f9b300cdd90 2023-10-18T12:19:57.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.330+0000 7f9b3612f700 1 -- 172.21.15.114:0/486536645 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b301578a0 con 0x7f9b300cdd90 2023-10-18T12:19:57.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.334+0000 7f9b3612f700 1 -- 172.21.15.114:0/486536645 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b30157e60 con 0x7f9b300cdd90 2023-10-18T12:19:57.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.334+0000 7f9b3612f700 1 -- 172.21.15.114:0/486536645 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b3004e910 con 0x7f9b300cdd90 2023-10-18T12:19:57.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.334+0000 7f9b25ffb700 1 -- 172.21.15.114:0/486536645 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f9b280043e0 con 0x7f9b300cdd90 2023-10-18T12:19:57.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.338+0000 7f9b25ffb700 1 --2- 172.21.15.114:0/486536645 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9b140656f0 0x7f9b14067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:57.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.338+0000 7f9b25ffb700 1 -- 172.21.15.114:0/486536645 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9b28022070 con 0x7f9b300cdd90 2023-10-18T12:19:57.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.338+0000 7f9b3512d700 1 --2- 172.21.15.114:0/486536645 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9b140656f0 0x7f9b14067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:57.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.338+0000 7f9b3512d700 1 --2- 172.21.15.114:0/486536645 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9b140656f0 0x7f9b14067bb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c005930 tx=0x7f9b2c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:57.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.342+0000 7f9b25ffb700 1 -- 172.21.15.114:0/486536645 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f9b28052740 con 0x7f9b300cdd90 2023-10-18T12:19:57.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.522+0000 7f9b3612f700 1 -- 172.21.15.114:0/486536645 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9b301585f0 con 0x7f9b300cdd90 2023-10-18T12:19:57.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.522+0000 7f9b25ffb700 1 -- 172.21.15.114:0/486536645 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9b2802c0a0 con 0x7f9b300cdd90 2023-10-18T12:19:57.528 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-10-18T12:19:57.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.526+0000 7f9b3612f700 1 -- 172.21.15.114:0/486536645 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9b140656f0 msgr2=0x7f9b14067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:57.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.526+0000 7f9b3612f700 1 --2- 172.21.15.114:0/486536645 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9b140656f0 0x7f9b14067bb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c005930 tx=0x7f9b2c009040 comp rx=0 tx=0).stop 2023-10-18T12:19:57.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.526+0000 7f9b3612f700 1 -- 172.21.15.114:0/486536645 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b300cdd90 msgr2=0x7f9b300c4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:57.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.526+0000 7f9b3612f700 1 --2- 172.21.15.114:0/486536645 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b300cdd90 0x7f9b300c4170 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9b300cf100 tx=0x7f9b28004af0 comp rx=0 tx=0).stop 2023-10-18T12:19:57.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.526+0000 7f9b3612f700 1 -- 172.21.15.114:0/486536645 shutdown_connections 2023-10-18T12:19:57.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.526+0000 7f9b3612f700 1 --2- 172.21.15.114:0/486536645 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9b140656f0 0x7f9b14067bb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:57.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.526+0000 7f9b3612f700 1 --2- 172.21.15.114:0/486536645 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9b300cdd90 0x7f9b300c4170 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:57.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.526+0000 7f9b3612f700 1 --2- 172.21.15.114:0/486536645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b300cc190 0x7f9b300c3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:57.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.526+0000 7f9b3612f700 1 --2- 172.21.15.114:0/486536645 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9b300b4310 0x7f9b301483a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:57.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.526+0000 7f9b3612f700 1 -- 172.21.15.114:0/486536645 >> 172.21.15.114:0/486536645 conn(0x7f9b300ce5c0 msgr2=0x7f9b30159490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:57.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.526+0000 7f9b3612f700 1 -- 172.21.15.114:0/486536645 shutdown_connections 2023-10-18T12:19:57.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.526+0000 7f9b3612f700 1 -- 172.21.15.114:0/486536645 wait complete. 2023-10-18T12:19:57.551 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-18T12:19:57.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.714+0000 7f9e1d1ef700 1 Processor -- start 2023-10-18T12:19:57.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.714+0000 7f9e1d1ef700 1 -- start start 2023-10-18T12:19:57.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.714+0000 7f9e1d1ef700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9e180cb8a0 0x7f9e180cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:57.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.714+0000 7f9e1d1ef700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9e180b22f0 0x7f9e180b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:57.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.714+0000 7f9e1d1ef700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e180cc240 con 0x7f9e18144150 2023-10-18T12:19:57.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.714+0000 7f9e1d1ef700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e18070de0 con 0x7f9e180b22f0 2023-10-18T12:19:57.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.714+0000 7f9e1d1ef700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e180701d0 con 0x7f9e180cb8a0 2023-10-18T12:19:57.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.718+0000 7f9e17fff700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f9e18144150 0x7f9e180cdc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41556/0 (socket says 172.21.15.114:41556) 2023-10-18T12:19:57.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.718+0000 7f9e17fff700 1 -- 172.21.15.114:0/4043872116 learned_addr learned my addr 172.21.15.114:0/4043872116 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:19:57.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.718+0000 7f9e1c9ee700 1 --2- 172.21.15.114:0/4043872116 >> v2:172.21.15.114:3300/0 conn(0x7f9e180b22f0 0x7f9e180b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:57.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.718+0000 7f9e0ffff700 1 --2- 172.21.15.114:0/4043872116 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9e180cb8a0 0x7f9e180cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:57.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.718+0000 7f9e1c9ee700 1 -- 172.21.15.114:0/4043872116 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9e180cb8a0 msgr2=0x7f9e180cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:57.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.718+0000 7f9e1c9ee700 1 --2- 172.21.15.114:0/4043872116 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9e180cb8a0 0x7f9e180cbd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:57.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.718+0000 7f9e1c9ee700 1 -- 172.21.15.114:0/4043872116 >> v1:172.21.15.114:6789/0 conn(0x7f9e18144150 legacy=0x7f9e180cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:57.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.718+0000 7f9e1c9ee700 1 -- 172.21.15.114:0/4043872116 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e180704b0 con 0x7f9e180b22f0 2023-10-18T12:19:57.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.718+0000 7f9e177fe700 1 -- 172.21.15.114:0/4043872116 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2796472094 0 0) 0x7f9e180cc240 con 0x7f9e18144150 2023-10-18T12:19:57.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.718+0000 7f9e1c9ee700 1 --2- 172.21.15.114:0/4043872116 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e180b22f0 0x7f9e180b2780 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9e10009850 tx=0x7f9e10009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95afc0e3b484d2fe server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:57.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.718+0000 7f9e177fe700 1 -- 172.21.15.114:0/4043872116 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e10011830 con 0x7f9e180b22f0 2023-10-18T12:19:57.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.718+0000 7f9e177fe700 1 -- 172.21.15.114:0/4043872116 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e10011990 con 0x7f9e180b22f0 2023-10-18T12:19:57.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.718+0000 7f9e177fe700 1 -- 172.21.15.114:0/4043872116 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e10011d40 con 0x7f9e180b22f0 2023-10-18T12:19:57.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.718+0000 7f9e1d1ef700 1 -- 172.21.15.114:0/4043872116 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e180b22f0 msgr2=0x7f9e180b2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:57.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.718+0000 7f9e1d1ef700 1 --2- 172.21.15.114:0/4043872116 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e180b22f0 0x7f9e180b2780 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9e10009850 tx=0x7f9e10009b60 comp rx=0 tx=0).stop 2023-10-18T12:19:57.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.718+0000 7f9e1d1ef700 1 -- 172.21.15.114:0/4043872116 shutdown_connections 2023-10-18T12:19:57.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.718+0000 7f9e1d1ef700 1 --2- 172.21.15.114:0/4043872116 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e180b22f0 0x7f9e180b2780 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:57.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.718+0000 7f9e1d1ef700 1 --2- 172.21.15.114:0/4043872116 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9e180cb8a0 0x7f9e180cbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:57.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.718+0000 7f9e1d1ef700 1 -- 172.21.15.114:0/4043872116 >> 172.21.15.114:0/4043872116 conn(0x7f9e180b0bf0 msgr2=0x7f9e180ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:57.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.718+0000 7f9e1d1ef700 1 -- 172.21.15.114:0/4043872116 shutdown_connections 2023-10-18T12:19:57.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.718+0000 7f9e1d1ef700 1 -- 172.21.15.114:0/4043872116 wait complete. 2023-10-18T12:19:57.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.722+0000 7f9e1d1ef700 1 Processor -- start 2023-10-18T12:19:57.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.726+0000 7f9e1d1ef700 1 -- start start 2023-10-18T12:19:57.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.726+0000 7f9e1d1ef700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e180b22f0 0x7f9e1806e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:57.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.726+0000 7f9e1d1ef700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e180cb8a0 0x7f9e180abb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:57.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.726+0000 7f9e1d1ef700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9e18144150 0x7f9e1813dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:57.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.726+0000 7f9e1d1ef700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e180ad260 con 0x7f9e180cb8a0 2023-10-18T12:19:57.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.726+0000 7f9e1d1ef700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1806ee60 con 0x7f9e180b22f0 2023-10-18T12:19:57.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.726+0000 7f9e1d1ef700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e180acf50 con 0x7f9e18144150 2023-10-18T12:19:57.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.726+0000 7f9e0ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e180cb8a0 0x7f9e180abb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:57.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.726+0000 7f9e0ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e180cb8a0 0x7f9e180abb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46716/0 (socket says 172.21.15.114:46716) 2023-10-18T12:19:57.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.726+0000 7f9e0ffff700 1 -- 172.21.15.114:0/221769547 learned_addr learned my addr 172.21.15.114:0/221769547 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:57.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.726+0000 7f9e17fff700 1 --2- 172.21.15.114:0/221769547 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e180b22f0 0x7f9e1806e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:57.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.726+0000 7f9e1c9ee700 1 --2- 172.21.15.114:0/221769547 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9e18144150 0x7f9e1813dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:57.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.726+0000 7f9e0ffff700 1 -- 172.21.15.114:0/221769547 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9e18144150 msgr2=0x7f9e1813dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:57.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.726+0000 7f9e0ffff700 1 --2- 172.21.15.114:0/221769547 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9e18144150 0x7f9e1813dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:57.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.726+0000 7f9e0ffff700 1 -- 172.21.15.114:0/221769547 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e180b22f0 msgr2=0x7f9e1806e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:57.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.726+0000 7f9e0ffff700 1 --2- 172.21.15.114:0/221769547 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e180b22f0 0x7f9e1806e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:57.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.726+0000 7f9e0ffff700 1 -- 172.21.15.114:0/221769547 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e100094b0 con 0x7f9e180cb8a0 2023-10-18T12:19:57.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.726+0000 7f9e0ffff700 1 --2- 172.21.15.114:0/221769547 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e180cb8a0 0x7f9e180abb50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9e0000e840 tx=0x7f9e0000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:57.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.730+0000 7f9e157fa700 1 -- 172.21.15.114:0/221769547 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e000095a0 con 0x7f9e180cb8a0 2023-10-18T12:19:57.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.730+0000 7f9e157fa700 1 -- 172.21.15.114:0/221769547 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e0000c690 con 0x7f9e180cb8a0 2023-10-18T12:19:57.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.730+0000 7f9e1d1ef700 1 -- 172.21.15.114:0/221769547 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e18141f80 con 0x7f9e180cb8a0 2023-10-18T12:19:57.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.730+0000 7f9e157fa700 1 -- 172.21.15.114:0/221769547 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0000ca00 con 0x7f9e180cb8a0 2023-10-18T12:19:57.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.730+0000 7f9e1d1ef700 1 -- 172.21.15.114:0/221769547 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e181f2010 con 0x7f9e180cb8a0 2023-10-18T12:19:57.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.730+0000 7f9e1d1ef700 1 -- 172.21.15.114:0/221769547 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e18072e60 con 0x7f9e180cb8a0 2023-10-18T12:19:57.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.730+0000 7f9e157fa700 1 -- 172.21.15.114:0/221769547 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f9e0000cb60 con 0x7f9e180cb8a0 2023-10-18T12:19:57.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.734+0000 7f9e157fa700 1 --2- 172.21.15.114:0/221769547 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9df8065740 0x7f9df8067c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:57.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.734+0000 7f9e157fa700 1 -- 172.21.15.114:0/221769547 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9e00082fa0 con 0x7f9e180cb8a0 2023-10-18T12:19:57.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.734+0000 7f9e17fff700 1 --2- 172.21.15.114:0/221769547 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9df8065740 0x7f9df8067c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:57.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.734+0000 7f9e17fff700 1 --2- 172.21.15.114:0/221769547 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9df8065740 0x7f9df8067c00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9e080012e0 tx=0x7f9e080018c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:57.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.738+0000 7f9e157fa700 1 -- 172.21.15.114:0/221769547 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f9e00054270 con 0x7f9e180cb8a0 2023-10-18T12:19:57.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.934+0000 7f9e1d1ef700 1 -- 172.21.15.114:0/221769547 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9e1815dbd0 con 0x7f9e180cb8a0 2023-10-18T12:19:57.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.934+0000 7f9e157fa700 1 -- 172.21.15.114:0/221769547 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9e00082070 con 0x7f9e180cb8a0 2023-10-18T12:19:57.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.938+0000 7f9e1d1ef700 1 -- 172.21.15.114:0/221769547 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9df8065740 msgr2=0x7f9df8067c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:57.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.938+0000 7f9e1d1ef700 1 --2- 172.21.15.114:0/221769547 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9df8065740 0x7f9df8067c00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9e080012e0 tx=0x7f9e080018c0 comp rx=0 tx=0).stop 2023-10-18T12:19:57.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.938+0000 7f9e1d1ef700 1 -- 172.21.15.114:0/221769547 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e180cb8a0 msgr2=0x7f9e180abb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:57.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.938+0000 7f9e1d1ef700 1 --2- 172.21.15.114:0/221769547 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e180cb8a0 0x7f9e180abb50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9e0000e840 tx=0x7f9e0000ec00 comp rx=0 tx=0).stop 2023-10-18T12:19:57.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.938+0000 7f9e1d1ef700 1 -- 172.21.15.114:0/221769547 shutdown_connections 2023-10-18T12:19:57.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.938+0000 7f9e1d1ef700 1 --2- 172.21.15.114:0/221769547 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9df8065740 0x7f9df8067c00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:57.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.938+0000 7f9e1d1ef700 1 --2- 172.21.15.114:0/221769547 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9e18144150 0x7f9e1813dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:57.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.938+0000 7f9e1d1ef700 1 --2- 172.21.15.114:0/221769547 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9e180cb8a0 0x7f9e180abb50 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:57.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.938+0000 7f9e1d1ef700 1 --2- 172.21.15.114:0/221769547 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e180b22f0 0x7f9e1806e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:57.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.938+0000 7f9e1d1ef700 1 -- 172.21.15.114:0/221769547 >> 172.21.15.114:0/221769547 conn(0x7f9e180b0bf0 msgr2=0x7f9e180ae310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:57.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.938+0000 7f9e1d1ef700 1 -- 172.21.15.114:0/221769547 shutdown_connections 2023-10-18T12:19:57.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:57.938+0000 7f9e1d1ef700 1 -- 172.21.15.114:0/221769547 wait complete. 2023-10-18T12:19:57.943 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2023-10-18T12:19:57.965 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi114.front.sepia.ceph.com... 2023-10-18T12:19:57.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:19:57.966 DEBUG:teuthology.orchestra.run.smithi114:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-10-18T12:19:57.998 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi114.stderr:ceph-fuse[41634]: fuse finished with error 0 and tester_r 0 2023-10-18T12:19:58.004 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T12:19:58.083 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2023-10-18T12:19:58.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:19:58.084 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-10-18T12:19:58.108 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T12:19:58.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.330+0000 7ff64f59e700 1 Processor -- start 2023-10-18T12:19:58.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.330+0000 7ff64f59e700 1 -- start start 2023-10-18T12:19:58.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.330+0000 7ff64f59e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff6500d2e00 0x7ff6500b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:58.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.330+0000 7ff64f59e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff6500b5ae0 0x7ff65006db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:58.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.330+0000 7ff64f59e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff65015d0d0 con 0x7ff650160710 2023-10-18T12:19:58.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.330+0000 7ff64f59e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff65015df90 con 0x7ff6500b5ae0 2023-10-18T12:19:58.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.330+0000 7ff64f59e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff65006f0f0 con 0x7ff6500d2e00 2023-10-18T12:19:58.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.330+0000 7ff64e59c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff6500d2e00 0x7ff6500b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:58.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.330+0000 7ff64dd9b700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff650160710 0x7ff6500d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41562/0 (socket says 172.21.15.114:41562) 2023-10-18T12:19:58.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.330+0000 7ff64dd9b700 1 -- 172.21.15.114:0/2530923494 learned_addr learned my addr 172.21.15.114:0/2530923494 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:19:58.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.330+0000 7ff64ed9d700 1 --2- 172.21.15.114:0/2530923494 >> v2:172.21.15.114:3300/0 conn(0x7ff6500b5ae0 0x7ff65006db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:58.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.334+0000 7ff64ed9d700 1 -- 172.21.15.114:0/2530923494 >> v2:172.21.15.172:3300/0 conn(0x7ff6500d2e00 msgr2=0x7ff6500b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:58.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.334+0000 7ff64ed9d700 1 --2- 172.21.15.114:0/2530923494 >> v2:172.21.15.172:3300/0 conn(0x7ff6500d2e00 0x7ff6500b6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:58.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.334+0000 7ff64ed9d700 1 -- 172.21.15.114:0/2530923494 >> v1:172.21.15.114:6789/0 conn(0x7ff650160710 legacy=0x7ff6500d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:58.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.334+0000 7ff64ed9d700 1 -- 172.21.15.114:0/2530923494 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff65015d310 con 0x7ff6500b5ae0 2023-10-18T12:19:58.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.334+0000 7ff64ed9d700 1 --2- 172.21.15.114:0/2530923494 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6500b5ae0 0x7ff65006db60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff650070660 tx=0x7ff64800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be914e41f10f35be server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:58.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.334+0000 7ff64d59a700 1 -- 172.21.15.114:0/2530923494 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64800e070 con 0x7ff6500b5ae0 2023-10-18T12:19:58.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.334+0000 7ff64d59a700 1 -- 172.21.15.114:0/2530923494 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff64800bb20 con 0x7ff6500b5ae0 2023-10-18T12:19:58.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.334+0000 7ff64d59a700 1 -- 172.21.15.114:0/2530923494 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff648012430 con 0x7ff6500b5ae0 2023-10-18T12:19:58.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.334+0000 7ff64f59e700 1 -- 172.21.15.114:0/2530923494 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6500b5ae0 msgr2=0x7ff65006db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:58.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.334+0000 7ff64f59e700 1 --2- 172.21.15.114:0/2530923494 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6500b5ae0 0x7ff65006db60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff650070660 tx=0x7ff64800b330 comp rx=0 tx=0).stop 2023-10-18T12:19:58.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.334+0000 7ff64f59e700 1 -- 172.21.15.114:0/2530923494 shutdown_connections 2023-10-18T12:19:58.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.334+0000 7ff64f59e700 1 --2- 172.21.15.114:0/2530923494 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6500b5ae0 0x7ff65006db60 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:58.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.334+0000 7ff64f59e700 1 --2- 172.21.15.114:0/2530923494 >> v2:172.21.15.172:3300/0 conn(0x7ff6500d2e00 0x7ff6500b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:58.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.334+0000 7ff64f59e700 1 -- 172.21.15.114:0/2530923494 >> 172.21.15.114:0/2530923494 conn(0x7ff650069f20 msgr2=0x7ff65006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:58.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.334+0000 7ff64f59e700 1 -- 172.21.15.114:0/2530923494 shutdown_connections 2023-10-18T12:19:58.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.334+0000 7ff64f59e700 1 -- 172.21.15.114:0/2530923494 wait complete. 2023-10-18T12:19:58.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.338+0000 7ff64f59e700 1 Processor -- start 2023-10-18T12:19:58.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.338+0000 7ff64f59e700 1 -- start start 2023-10-18T12:19:58.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.338+0000 7ff64f59e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6500b5ae0 0x7ff65014c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:58.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.338+0000 7ff64f59e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff6500d2e00 0x7ff6501490b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:58.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.338+0000 7ff64f59e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff650160710 0x7ff6500aee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:58.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.338+0000 7ff64f59e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6501f2350 con 0x7ff6500b5ae0 2023-10-18T12:19:58.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.338+0000 7ff64f59e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6500af550 con 0x7ff650160710 2023-10-18T12:19:58.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.338+0000 7ff64f59e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6500af830 con 0x7ff6500d2e00 2023-10-18T12:19:58.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.338+0000 7ff64e59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6500b5ae0 0x7ff65014c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:58.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.338+0000 7ff64e59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6500b5ae0 0x7ff65014c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46738/0 (socket says 172.21.15.114:46738) 2023-10-18T12:19:58.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.338+0000 7ff64e59c700 1 -- 172.21.15.114:0/1719639220 learned_addr learned my addr 172.21.15.114:0/1719639220 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:58.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.342+0000 7ff64ed9d700 1 --2- 172.21.15.114:0/1719639220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff650160710 0x7ff6500aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:58.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.342+0000 7ff64dd9b700 1 --2- 172.21.15.114:0/1719639220 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff6500d2e00 0x7ff6501490b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:58.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.342+0000 7ff64e59c700 1 -- 172.21.15.114:0/1719639220 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff6500d2e00 msgr2=0x7ff6501490b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:58.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.342+0000 7ff64e59c700 1 --2- 172.21.15.114:0/1719639220 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff6500d2e00 0x7ff6501490b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:58.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.342+0000 7ff64e59c700 1 -- 172.21.15.114:0/1719639220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff650160710 msgr2=0x7ff6500aee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:58.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.342+0000 7ff64e59c700 1 --2- 172.21.15.114:0/1719639220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff650160710 0x7ff6500aee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:58.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.342+0000 7ff64e59c700 1 -- 172.21.15.114:0/1719639220 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff648009a70 con 0x7ff6500b5ae0 2023-10-18T12:19:58.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.342+0000 7ff64e59c700 1 --2- 172.21.15.114:0/1719639220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6500b5ae0 0x7ff65014c340 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff64000e840 tx=0x7ff64000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:58.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.342+0000 7ff63effd700 1 -- 172.21.15.114:0/1719639220 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6400095a0 con 0x7ff6500b5ae0 2023-10-18T12:19:58.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.342+0000 7ff63effd700 1 -- 172.21.15.114:0/1719639220 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff64000c690 con 0x7ff6500b5ae0 2023-10-18T12:19:58.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.342+0000 7ff63effd700 1 -- 172.21.15.114:0/1719639220 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64000ca00 con 0x7ff6500b5ae0 2023-10-18T12:19:58.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.342+0000 7ff64f59e700 1 -- 172.21.15.114:0/1719639220 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff65014b860 con 0x7ff6500b5ae0 2023-10-18T12:19:58.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.342+0000 7ff64f59e700 1 -- 172.21.15.114:0/1719639220 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff65014be20 con 0x7ff6500b5ae0 2023-10-18T12:19:58.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.342+0000 7ff64f59e700 1 -- 172.21.15.114:0/1719639220 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff65014bfe0 con 0x7ff6500b5ae0 2023-10-18T12:19:58.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.346+0000 7ff63effd700 1 -- 172.21.15.114:0/1719639220 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff64000cb60 con 0x7ff6500b5ae0 2023-10-18T12:19:58.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.346+0000 7ff63effd700 1 --2- 172.21.15.114:0/1719639220 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff6300656f0 0x7ff630067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:58.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.346+0000 7ff63effd700 1 -- 172.21.15.114:0/1719639220 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff640083150 con 0x7ff6500b5ae0 2023-10-18T12:19:58.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.346+0000 7ff64dd9b700 1 --2- 172.21.15.114:0/1719639220 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff6300656f0 0x7ff630067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:58.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.346+0000 7ff64dd9b700 1 --2- 172.21.15.114:0/1719639220 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff6300656f0 0x7ff630067bb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff65015a890 tx=0x7ff644009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:58.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.350+0000 7ff63effd700 1 -- 172.21.15.114:0/1719639220 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7ff640054310 con 0x7ff6500b5ae0 2023-10-18T12:19:58.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.538+0000 7ff64f59e700 1 -- 172.21.15.114:0/1719639220 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff650072e60 con 0x7ff6500b5ae0 2023-10-18T12:19:58.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.538+0000 7ff63effd700 1 -- 172.21.15.114:0/1719639220 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20144 (secure 0 0 0) 0x7ff640053ea0 con 0x7ff6500b5ae0 2023-10-18T12:19:58.543 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:19:58.543 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":28,"fsid":"240ea340-5d3d-4f52-a4bc-af075aca3deb","created":"2023-10-18T12:19:12.512994+0000","modified":"2023-10-18T12:19:44.436656+0000","last_up_change":"2023-10-18T12:19:25.286009+0000","last_in_change":"2023-10-18T12:19:15.850693+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T12:19:27.040638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-18T12:19:32.358094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-18T12:19:37.333855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-18T12:19:38.055385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-18T12:19:41.679218+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c3578978-1a03-4857-b9d2-34a5da3d7731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6817","nonce":1506287862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6820","nonce":1506287862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6830","nonce":1506287862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6825","nonce":1506287862}]},"public_addr":"172.21.15.114:6817/1506287862","cluster_addr":"172.21.15.114:6820/1506287862","heartbeat_back_addr":"172.21.15.114:6830/1506287862","heartbeat_front_addr":"172.21.15.114:6825/1506287862","state":["exists","up"]},{"osd":1,"uuid":"43eb26a6-e2b3-4670-9559-bd053b5140d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6801","nonce":3302727047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6803","nonce":3302727047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6807","nonce":3302727047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6805","nonce":3302727047}]},"public_addr":"172.21.15.114:6801/3302727047","cluster_addr":"172.21.15.114:6803/3302727047","heartbeat_back_addr":"172.21.15.114:6807/3302727047","heartbeat_front_addr":"172.21.15.114:6805/3302727047","state":["exists","up"]},{"osd":2,"uuid":"f3d4dbd5-521c-4dd2-b687-5768cc7d0938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6809","nonce":2699151351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6811","nonce":2699151351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6815","nonce":2699151351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6813","nonce":2699151351}]},"public_addr":"172.21.15.114:6809/2699151351","cluster_addr":"172.21.15.114:6811/2699151351","heartbeat_back_addr":"172.21.15.114:6815/2699151351","heartbeat_front_addr":"172.21.15.114:6813/2699151351","state":["exists","up"]},{"osd":3,"uuid":"823e5802-92b7-4f0d-b32d-a5748993f1b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6821","nonce":1361608073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6824","nonce":1361608073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6829","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6831","nonce":1361608073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6827","nonce":1361608073}]},"public_addr":"172.21.15.114:6821/1361608073","cluster_addr":"172.21.15.114:6824/1361608073","heartbeat_back_addr":"172.21.15.114:6831/1361608073","heartbeat_front_addr":"172.21.15.114:6827/1361608073","state":["exists","up"]},{"osd":4,"uuid":"e47fb93e-13b4-44a4-b084-8c4384ceb41e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6801","nonce":930839681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6803","nonce":930839681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6807","nonce":930839681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6805","nonce":930839681}]},"public_addr":"172.21.15.172:6801/930839681","cluster_addr":"172.21.15.172:6803/930839681","heartbeat_back_addr":"172.21.15.172:6807/930839681","heartbeat_front_addr":"172.21.15.172:6805/930839681","state":["exists","up"]},{"osd":5,"uuid":"7561a973-f479-45a0-af40-f324728d622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6814","nonce":571761850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6818","nonce":571761850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6824","nonce":571761850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6821","nonce":571761850}]},"public_addr":"172.21.15.172:6814/571761850","cluster_addr":"172.21.15.172:6818/571761850","heartbeat_back_addr":"172.21.15.172:6824/571761850","heartbeat_front_addr":"172.21.15.172:6821/571761850","state":["exists","up"]},{"osd":6,"uuid":"51753f4b-7f06-4f1c-9ec7-6e18a66eb980","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6825","nonce":1680398853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6827","nonce":1680398853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6831","nonce":1680398853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6829","nonce":1680398853}]},"public_addr":"172.21.15.172:6825/1680398853","cluster_addr":"172.21.15.172:6827/1680398853","heartbeat_back_addr":"172.21.15.172:6831/1680398853","heartbeat_front_addr":"172.21.15.172:6829/1680398853","state":["exists","up"]},{"osd":7,"uuid":"4d8b1e15-143d-4d17-9074-59d92f0f9af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6809","nonce":349710101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6811","nonce":349710101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6819","nonce":349710101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6815","nonce":349710101}]},"public_addr":"172.21.15.172:6809/349710101","cluster_addr":"172.21.15.172:6811/349710101","heartbeat_back_addr":"172.21.15.172:6819/349710101","heartbeat_front_addr":"172.21.15.172:6815/349710101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.889460+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.475494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.911473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.648596+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.609994+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.636248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.854589+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.885826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T12:19:58.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.542+0000 7ff64f59e700 1 -- 172.21.15.114:0/1719639220 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff6300656f0 msgr2=0x7ff630067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:58.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.542+0000 7ff64f59e700 1 --2- 172.21.15.114:0/1719639220 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff6300656f0 0x7ff630067bb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff65015a890 tx=0x7ff644009040 comp rx=0 tx=0).stop 2023-10-18T12:19:58.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.542+0000 7ff64f59e700 1 -- 172.21.15.114:0/1719639220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6500b5ae0 msgr2=0x7ff65014c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:58.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.542+0000 7ff64f59e700 1 --2- 172.21.15.114:0/1719639220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6500b5ae0 0x7ff65014c340 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff64000e840 tx=0x7ff64000ec00 comp rx=0 tx=0).stop 2023-10-18T12:19:58.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.546+0000 7ff64f59e700 1 -- 172.21.15.114:0/1719639220 shutdown_connections 2023-10-18T12:19:58.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.546+0000 7ff64f59e700 1 --2- 172.21.15.114:0/1719639220 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff6300656f0 0x7ff630067bb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:58.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.546+0000 7ff64f59e700 1 --2- 172.21.15.114:0/1719639220 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff6500d2e00 0x7ff6501490b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:58.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.546+0000 7ff64f59e700 1 --2- 172.21.15.114:0/1719639220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff650160710 0x7ff6500aee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:58.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.546+0000 7ff64f59e700 1 --2- 172.21.15.114:0/1719639220 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6500b5ae0 0x7ff65014c340 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:58.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.546+0000 7ff64f59e700 1 -- 172.21.15.114:0/1719639220 >> 172.21.15.114:0/1719639220 conn(0x7ff650069f20 msgr2=0x7ff6500b2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:58.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.546+0000 7ff64f59e700 1 -- 172.21.15.114:0/1719639220 shutdown_connections 2023-10-18T12:19:58.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.546+0000 7ff64f59e700 1 -- 172.21.15.114:0/1719639220 wait complete. 2023-10-18T12:19:58.571 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T12:19:58.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.734+0000 7f459c2a2700 1 Processor -- start 2023-10-18T12:19:58.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.734+0000 7f459c2a2700 1 -- start start 2023-10-18T12:19:58.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.738+0000 7f459c2a2700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f45940b5b80 0x7f459406f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:58.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.738+0000 7f459c2a2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f459406fee0 0x7f459415eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:58.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.738+0000 7f459c2a2700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f459415e680 con 0x7f4594146800 2023-10-18T12:19:58.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.738+0000 7f459c2a2700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4594070350 con 0x7f45940b5b80 2023-10-18T12:19:58.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.738+0000 7f459c2a2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45940b6180 con 0x7f459406fee0 2023-10-18T12:19:58.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.738+0000 7f459983d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f45940b5b80 0x7f459406f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:58.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.738+0000 7f459983d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f45940b5b80 0x7f459406f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46746/0 (socket says 172.21.15.114:46746) 2023-10-18T12:19:58.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.738+0000 7f459983d700 1 -- 172.21.15.114:0/178778914 learned_addr learned my addr 172.21.15.114:0/178778914 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:58.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.738+0000 7f459983d700 1 -- 172.21.15.114:0/178778914 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f459406fee0 msgr2=0x7f459415eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:58.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.738+0000 7f459983d700 1 --2- 172.21.15.114:0/178778914 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f459406fee0 0x7f459415eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:58.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.738+0000 7f459983d700 1 -- 172.21.15.114:0/178778914 >> v1:172.21.15.172:6789/0 conn(0x7f4594146800 legacy=0x7f459415dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:58.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.738+0000 7f459983d700 1 -- 172.21.15.114:0/178778914 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45940b6460 con 0x7f45940b5b80 2023-10-18T12:19:58.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.738+0000 7f459983d700 1 --2- 172.21.15.114:0/178778914 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45940b5b80 0x7f459406f9a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4584009910 tx=0x7f4584009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e9122aedab45710 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:58.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.738+0000 7f459903c700 1 -- 172.21.15.114:0/178778914 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4584004230 con 0x7f45940b5b80 2023-10-18T12:19:58.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.738+0000 7f459903c700 1 -- 172.21.15.114:0/178778914 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4584004390 con 0x7f45940b5b80 2023-10-18T12:19:58.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.738+0000 7f459903c700 1 -- 172.21.15.114:0/178778914 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4584009e60 con 0x7f45940b5b80 2023-10-18T12:19:58.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.742+0000 7f459c2a2700 1 -- 172.21.15.114:0/178778914 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45940b5b80 msgr2=0x7f459406f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:58.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.742+0000 7f459c2a2700 1 --2- 172.21.15.114:0/178778914 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45940b5b80 0x7f459406f9a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4584009910 tx=0x7f4584009c20 comp rx=0 tx=0).stop 2023-10-18T12:19:58.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.742+0000 7f459c2a2700 1 -- 172.21.15.114:0/178778914 shutdown_connections 2023-10-18T12:19:58.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.742+0000 7f459c2a2700 1 --2- 172.21.15.114:0/178778914 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f459406fee0 0x7f459415eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:58.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.742+0000 7f459c2a2700 1 --2- 172.21.15.114:0/178778914 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45940b5b80 0x7f459406f9a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:58.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.742+0000 7f459c2a2700 1 -- 172.21.15.114:0/178778914 >> 172.21.15.114:0/178778914 conn(0x7f459406a130 msgr2=0x7f459406a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:58.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.742+0000 7f459c2a2700 1 -- 172.21.15.114:0/178778914 shutdown_connections 2023-10-18T12:19:58.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.742+0000 7f459c2a2700 1 -- 172.21.15.114:0/178778914 wait complete. 2023-10-18T12:19:58.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.746+0000 7f459c2a2700 1 Processor -- start 2023-10-18T12:19:58.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.746+0000 7f459c2a2700 1 -- start start 2023-10-18T12:19:58.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.746+0000 7f459c2a2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f459406fee0 0x7f459415c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:58.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.746+0000 7f459c2a2700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45940b5b80 0x7f459413ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:58.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.746+0000 7f459c2a2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4594146800 0x7f45940ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:58.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.746+0000 7f459c2a2700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459415c930 con 0x7f45940b5b80 2023-10-18T12:19:58.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.746+0000 7f459c2a2700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45941409b0 con 0x7f4594146800 2023-10-18T12:19:58.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.746+0000 7f459c2a2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4594140c90 con 0x7f459406fee0 2023-10-18T12:19:58.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.746+0000 7f459983d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45940b5b80 0x7f459413ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:58.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.746+0000 7f459983d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45940b5b80 0x7f459413ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46756/0 (socket says 172.21.15.114:46756) 2023-10-18T12:19:58.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.746+0000 7f459983d700 1 -- 172.21.15.114:0/1700067052 learned_addr learned my addr 172.21.15.114:0/1700067052 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:58.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.746+0000 7f459a03e700 1 --2- 172.21.15.114:0/1700067052 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f459406fee0 0x7f459415c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:58.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.746+0000 7f459a83f700 1 --2- 172.21.15.114:0/1700067052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4594146800 0x7f45940ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:58.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.746+0000 7f459983d700 1 -- 172.21.15.114:0/1700067052 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f459406fee0 msgr2=0x7f459415c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:58.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.746+0000 7f459983d700 1 --2- 172.21.15.114:0/1700067052 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f459406fee0 0x7f459415c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:58.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.746+0000 7f459983d700 1 -- 172.21.15.114:0/1700067052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4594146800 msgr2=0x7f45940ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:58.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.746+0000 7f459983d700 1 --2- 172.21.15.114:0/1700067052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4594146800 0x7f45940ab8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:58.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.746+0000 7f459983d700 1 -- 172.21.15.114:0/1700067052 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4584009570 con 0x7f45940b5b80 2023-10-18T12:19:58.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.746+0000 7f459a83f700 1 --2- 172.21.15.114:0/1700067052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4594146800 0x7f45940ab8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:19:58.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.746+0000 7f459983d700 1 --2- 172.21.15.114:0/1700067052 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45940b5b80 0x7f459413ffa0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4584008000 tx=0x7f4584004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:58.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.746+0000 7f458affd700 1 -- 172.21.15.114:0/1700067052 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45840045d0 con 0x7f45940b5b80 2023-10-18T12:19:58.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.746+0000 7f458affd700 1 -- 172.21.15.114:0/1700067052 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f458401f070 con 0x7f45940b5b80 2023-10-18T12:19:58.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.746+0000 7f459c2a2700 1 -- 172.21.15.114:0/1700067052 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f459413c2b0 con 0x7f45940b5b80 2023-10-18T12:19:58.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.746+0000 7f458affd700 1 -- 172.21.15.114:0/1700067052 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4584003900 con 0x7f45940b5b80 2023-10-18T12:19:58.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.746+0000 7f459c2a2700 1 -- 172.21.15.114:0/1700067052 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4594140f70 con 0x7f45940b5b80 2023-10-18T12:19:58.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.750+0000 7f459c2a2700 1 -- 172.21.15.114:0/1700067052 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f459413c7d0 con 0x7f45940b5b80 2023-10-18T12:19:58.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.750+0000 7f458affd700 1 -- 172.21.15.114:0/1700067052 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f4584021030 con 0x7f45940b5b80 2023-10-18T12:19:58.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.754+0000 7f458affd700 1 --2- 172.21.15.114:0/1700067052 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f45780656f0 0x7f4578067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:58.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.754+0000 7f458affd700 1 -- 172.21.15.114:0/1700067052 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f45840848d0 con 0x7f45940b5b80 2023-10-18T12:19:58.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.754+0000 7f459a03e700 1 --2- 172.21.15.114:0/1700067052 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f45780656f0 0x7f4578067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:58.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.754+0000 7f459a03e700 1 --2- 172.21.15.114:0/1700067052 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f45780656f0 0x7f4578067bb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4590009890 tx=0x7f4590008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:58.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.758+0000 7f458affd700 1 -- 172.21.15.114:0/1700067052 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f459413c7d0 con 0x7f45940b5b80 2023-10-18T12:19:58.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.934+0000 7f459c2a2700 1 -- 172.21.15.114:0/1700067052 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f459413c7d0 con 0x7f45940b5b80 2023-10-18T12:19:58.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.934+0000 7f458affd700 1 -- 172.21.15.114:0/1700067052 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20144 (secure 0 0 0) 0x7f459413c7d0 con 0x7f45940b5b80 2023-10-18T12:19:58.939 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:19:58.939 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":28,"fsid":"240ea340-5d3d-4f52-a4bc-af075aca3deb","created":"2023-10-18T12:19:12.512994+0000","modified":"2023-10-18T12:19:44.436656+0000","last_up_change":"2023-10-18T12:19:25.286009+0000","last_in_change":"2023-10-18T12:19:15.850693+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T12:19:27.040638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-18T12:19:32.358094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-18T12:19:37.333855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-18T12:19:38.055385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-18T12:19:41.679218+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c3578978-1a03-4857-b9d2-34a5da3d7731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6817","nonce":1506287862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6820","nonce":1506287862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6830","nonce":1506287862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6825","nonce":1506287862}]},"public_addr":"172.21.15.114:6817/1506287862","cluster_addr":"172.21.15.114:6820/1506287862","heartbeat_back_addr":"172.21.15.114:6830/1506287862","heartbeat_front_addr":"172.21.15.114:6825/1506287862","state":["exists","up"]},{"osd":1,"uuid":"43eb26a6-e2b3-4670-9559-bd053b5140d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6801","nonce":3302727047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6803","nonce":3302727047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6807","nonce":3302727047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6805","nonce":3302727047}]},"public_addr":"172.21.15.114:6801/3302727047","cluster_addr":"172.21.15.114:6803/3302727047","heartbeat_back_addr":"172.21.15.114:6807/3302727047","heartbeat_front_addr":"172.21.15.114:6805/3302727047","state":["exists","up"]},{"osd":2,"uuid":"f3d4dbd5-521c-4dd2-b687-5768cc7d0938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6809","nonce":2699151351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6811","nonce":2699151351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6815","nonce":2699151351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6813","nonce":2699151351}]},"public_addr":"172.21.15.114:6809/2699151351","cluster_addr":"172.21.15.114:6811/2699151351","heartbeat_back_addr":"172.21.15.114:6815/2699151351","heartbeat_front_addr":"172.21.15.114:6813/2699151351","state":["exists","up"]},{"osd":3,"uuid":"823e5802-92b7-4f0d-b32d-a5748993f1b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6821","nonce":1361608073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6824","nonce":1361608073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6829","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6831","nonce":1361608073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6827","nonce":1361608073}]},"public_addr":"172.21.15.114:6821/1361608073","cluster_addr":"172.21.15.114:6824/1361608073","heartbeat_back_addr":"172.21.15.114:6831/1361608073","heartbeat_front_addr":"172.21.15.114:6827/1361608073","state":["exists","up"]},{"osd":4,"uuid":"e47fb93e-13b4-44a4-b084-8c4384ceb41e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6801","nonce":930839681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6803","nonce":930839681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6807","nonce":930839681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6805","nonce":930839681}]},"public_addr":"172.21.15.172:6801/930839681","cluster_addr":"172.21.15.172:6803/930839681","heartbeat_back_addr":"172.21.15.172:6807/930839681","heartbeat_front_addr":"172.21.15.172:6805/930839681","state":["exists","up"]},{"osd":5,"uuid":"7561a973-f479-45a0-af40-f324728d622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6814","nonce":571761850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6818","nonce":571761850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6824","nonce":571761850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6821","nonce":571761850}]},"public_addr":"172.21.15.172:6814/571761850","cluster_addr":"172.21.15.172:6818/571761850","heartbeat_back_addr":"172.21.15.172:6824/571761850","heartbeat_front_addr":"172.21.15.172:6821/571761850","state":["exists","up"]},{"osd":6,"uuid":"51753f4b-7f06-4f1c-9ec7-6e18a66eb980","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6825","nonce":1680398853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6827","nonce":1680398853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6831","nonce":1680398853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6829","nonce":1680398853}]},"public_addr":"172.21.15.172:6825/1680398853","cluster_addr":"172.21.15.172:6827/1680398853","heartbeat_back_addr":"172.21.15.172:6831/1680398853","heartbeat_front_addr":"172.21.15.172:6829/1680398853","state":["exists","up"]},{"osd":7,"uuid":"4d8b1e15-143d-4d17-9074-59d92f0f9af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6809","nonce":349710101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6811","nonce":349710101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6819","nonce":349710101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6815","nonce":349710101}]},"public_addr":"172.21.15.172:6809/349710101","cluster_addr":"172.21.15.172:6811/349710101","heartbeat_back_addr":"172.21.15.172:6819/349710101","heartbeat_front_addr":"172.21.15.172:6815/349710101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.889460+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.475494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.911473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.648596+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.609994+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.636248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.854589+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.885826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T12:19:58.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.938+0000 7f459c2a2700 1 -- 172.21.15.114:0/1700067052 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f45780656f0 msgr2=0x7f4578067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:58.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.938+0000 7f459c2a2700 1 --2- 172.21.15.114:0/1700067052 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f45780656f0 0x7f4578067bb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4590009890 tx=0x7f4590008040 comp rx=0 tx=0).stop 2023-10-18T12:19:58.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.938+0000 7f459c2a2700 1 -- 172.21.15.114:0/1700067052 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45940b5b80 msgr2=0x7f459413ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:58.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.938+0000 7f459c2a2700 1 --2- 172.21.15.114:0/1700067052 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45940b5b80 0x7f459413ffa0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4584008000 tx=0x7f4584004770 comp rx=0 tx=0).stop 2023-10-18T12:19:58.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.938+0000 7f459c2a2700 1 -- 172.21.15.114:0/1700067052 shutdown_connections 2023-10-18T12:19:58.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.938+0000 7f459c2a2700 1 --2- 172.21.15.114:0/1700067052 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f45780656f0 0x7f4578067bb0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:58.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.938+0000 7f459c2a2700 1 --2- 172.21.15.114:0/1700067052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4594146800 0x7f45940ab8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:58.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.938+0000 7f459c2a2700 1 --2- 172.21.15.114:0/1700067052 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45940b5b80 0x7f459413ffa0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:58.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.938+0000 7f459c2a2700 1 --2- 172.21.15.114:0/1700067052 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f459406fee0 0x7f459415c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:58.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.938+0000 7f459c2a2700 1 -- 172.21.15.114:0/1700067052 >> 172.21.15.114:0/1700067052 conn(0x7f459406a130 msgr2=0x7f45940b4dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:58.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.938+0000 7f459c2a2700 1 -- 172.21.15.114:0/1700067052 shutdown_connections 2023-10-18T12:19:58.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:58.938+0000 7f459c2a2700 1 -- 172.21.15.114:0/1700067052 wait complete. 2023-10-18T12:19:58.966 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-18T12:19:59.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.134+0000 7f192ebfc700 1 Processor -- start 2023-10-18T12:19:59.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.138+0000 7f192ebfc700 1 -- start start 2023-10-18T12:19:59.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.138+0000 7f192ebfc700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f19280cdd90 0x7f19280cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:59.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.138+0000 7f192ebfc700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f19280b4310 0x7f192806d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:59.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.138+0000 7f192ebfc700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f192815e000 con 0x7f192806d060 2023-10-18T12:19:59.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.138+0000 7f192ebfc700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19280ce170 con 0x7f19280cdd90 2023-10-18T12:19:59.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.138+0000 7f192ebfc700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f192815d3f0 con 0x7f19280b4310 2023-10-18T12:19:59.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.138+0000 7f192d3f9700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f192806d060 0x7f19280b3c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41570/0 (socket says 172.21.15.114:41570) 2023-10-18T12:19:59.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.138+0000 7f192d3f9700 1 -- 172.21.15.114:0/2603271891 learned_addr learned my addr 172.21.15.114:0/2603271891 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:19:59.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.138+0000 7f192dbfa700 1 --2- 172.21.15.114:0/2603271891 >> v2:172.21.15.114:3300/0 conn(0x7f19280cdd90 0x7f19280cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:59.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.138+0000 7f192e3fb700 1 --2- 172.21.15.114:0/2603271891 >> v2:172.21.15.172:3300/0 conn(0x7f19280b4310 0x7f192806d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:59.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.142+0000 7f192dbfa700 1 -- 172.21.15.114:0/2603271891 >> v2:172.21.15.172:3300/0 conn(0x7f19280b4310 msgr2=0x7f192806d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:19:59.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.142+0000 7f192cbf8700 1 -- 172.21.15.114:0/2603271891 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2890117040 0 0) 0x7f192815e000 con 0x7f192806d060 2023-10-18T12:19:59.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.142+0000 7f192dbfa700 1 --2- 172.21.15.114:0/2603271891 >> v2:172.21.15.172:3300/0 conn(0x7f19280b4310 0x7f192806d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:59.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.142+0000 7f192dbfa700 1 -- 172.21.15.114:0/2603271891 >> v1:172.21.15.114:6789/0 conn(0x7f192806d060 legacy=0x7f19280b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:59.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.142+0000 7f192dbfa700 1 -- 172.21.15.114:0/2603271891 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f192815d6d0 con 0x7f19280cdd90 2023-10-18T12:19:59.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.142+0000 7f192dbfa700 1 --2- 172.21.15.114:0/2603271891 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19280cdd90 0x7f19280cc190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f192806af70 tx=0x7f192400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54f37924a5600fc9 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:59.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.142+0000 7f192cbf8700 1 -- 172.21.15.114:0/2603271891 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192400e070 con 0x7f19280cdd90 2023-10-18T12:19:59.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.142+0000 7f192cbf8700 1 -- 172.21.15.114:0/2603271891 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192400bbd0 con 0x7f19280cdd90 2023-10-18T12:19:59.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.142+0000 7f192cbf8700 1 -- 172.21.15.114:0/2603271891 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1924012430 con 0x7f19280cdd90 2023-10-18T12:19:59.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.142+0000 7f192ebfc700 1 -- 172.21.15.114:0/2603271891 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19280cdd90 msgr2=0x7f19280cc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:59.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.142+0000 7f192ebfc700 1 --2- 172.21.15.114:0/2603271891 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19280cdd90 0x7f19280cc190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f192806af70 tx=0x7f192400b330 comp rx=0 tx=0).stop 2023-10-18T12:19:59.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.142+0000 7f192ebfc700 1 -- 172.21.15.114:0/2603271891 shutdown_connections 2023-10-18T12:19:59.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.142+0000 7f192ebfc700 1 --2- 172.21.15.114:0/2603271891 >> v2:172.21.15.172:3300/0 conn(0x7f19280b4310 0x7f192806d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:59.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.142+0000 7f192ebfc700 1 --2- 172.21.15.114:0/2603271891 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19280cdd90 0x7f19280cc190 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:59.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.142+0000 7f192ebfc700 1 -- 172.21.15.114:0/2603271891 >> 172.21.15.114:0/2603271891 conn(0x7f19280ce5c0 msgr2=0x7f19280ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:19:59.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.142+0000 7f192ebfc700 1 -- 172.21.15.114:0/2603271891 shutdown_connections 2023-10-18T12:19:59.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.142+0000 7f192ebfc700 1 -- 172.21.15.114:0/2603271891 wait complete. 2023-10-18T12:19:59.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.146+0000 7f192ebfc700 1 Processor -- start 2023-10-18T12:19:59.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.146+0000 7f192ebfc700 1 -- start start 2023-10-18T12:19:59.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.146+0000 7f192ebfc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f192806d060 0x7f1928151b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:59.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.146+0000 7f192ebfc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19280b4310 0x7f19280c44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:59.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.146+0000 7f192ebfc700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f19280cdd90 0x7f19280c49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:59.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.146+0000 7f192ebfc700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19281f7a30 con 0x7f192806d060 2023-10-18T12:19:59.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.146+0000 7f192ebfc700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1928152090 con 0x7f19280b4310 2023-10-18T12:19:59.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.146+0000 7f192ebfc700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19281f6e20 con 0x7f19280cdd90 2023-10-18T12:19:59.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.146+0000 7f192dbfa700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f192806d060 0x7f1928151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:59.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.146+0000 7f192dbfa700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f192806d060 0x7f1928151b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46772/0 (socket says 172.21.15.114:46772) 2023-10-18T12:19:59.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.146+0000 7f192dbfa700 1 -- 172.21.15.114:0/1393007965 learned_addr learned my addr 172.21.15.114:0/1393007965 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:19:59.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.146+0000 7f192d3f9700 1 --2- 172.21.15.114:0/1393007965 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19280b4310 0x7f19280c44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:59.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.146+0000 7f192e3fb700 1 --2- 172.21.15.114:0/1393007965 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f19280cdd90 0x7f19280c49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:59.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.146+0000 7f192dbfa700 1 -- 172.21.15.114:0/1393007965 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f19280cdd90 msgr2=0x7f19280c49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:59.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.146+0000 7f192dbfa700 1 --2- 172.21.15.114:0/1393007965 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f19280cdd90 0x7f19280c49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:59.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.146+0000 7f192dbfa700 1 -- 172.21.15.114:0/1393007965 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19280b4310 msgr2=0x7f19280c44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:19:59.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.146+0000 7f192dbfa700 1 --2- 172.21.15.114:0/1393007965 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19280b4310 0x7f19280c44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:19:59.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.146+0000 7f192dbfa700 1 -- 172.21.15.114:0/1393007965 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1924009a70 con 0x7f192806d060 2023-10-18T12:19:59.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.150+0000 7f192dbfa700 1 --2- 172.21.15.114:0/1393007965 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f192806d060 0x7f1928151b50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f19280cf100 tx=0x7f1924004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:59.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.150+0000 7f191e7fc700 1 -- 172.21.15.114:0/1393007965 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1924012430 con 0x7f192806d060 2023-10-18T12:19:59.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.150+0000 7f191e7fc700 1 -- 172.21.15.114:0/1393007965 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1924020070 con 0x7f192806d060 2023-10-18T12:19:59.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.150+0000 7f192ebfc700 1 -- 172.21.15.114:0/1393007965 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19281f7100 con 0x7f192806d060 2023-10-18T12:19:59.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.150+0000 7f191e7fc700 1 -- 172.21.15.114:0/1393007965 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1924004280 con 0x7f192806d060 2023-10-18T12:19:59.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.150+0000 7f192ebfc700 1 -- 172.21.15.114:0/1393007965 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19281f76c0 con 0x7f192806d060 2023-10-18T12:19:59.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.150+0000 7f192ebfc700 1 -- 172.21.15.114:0/1393007965 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f192804e910 con 0x7f192806d060 2023-10-18T12:19:59.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.150+0000 7f191e7fc700 1 -- 172.21.15.114:0/1393007965 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f19240043e0 con 0x7f192806d060 2023-10-18T12:19:59.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.154+0000 7f191e7fc700 1 --2- 172.21.15.114:0/1393007965 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f190c065720 0x7f190c067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:19:59.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.154+0000 7f191e7fc700 1 -- 172.21.15.114:0/1393007965 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1924022070 con 0x7f192806d060 2023-10-18T12:19:59.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.154+0000 7f192d3f9700 1 --2- 172.21.15.114:0/1393007965 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f190c065720 0x7f190c067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:19:59.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.154+0000 7f192d3f9700 1 --2- 172.21.15.114:0/1393007965 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f190c065720 0x7f190c067be0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f19280c79e0 tx=0x7f1918007e90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:19:59.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.158+0000 7f191e7fc700 1 -- 172.21.15.114:0/1393007965 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f19240525b0 con 0x7f192806d060 2023-10-18T12:19:59.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:19:59.450+0000 7f192ebfc700 1 -- 172.21.15.114:0/1393007965 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1928070b70 con 0x7f192806d060 2023-10-18T12:20:00.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.446+0000 7f191e7fc700 1 -- 172.21.15.114:0/1393007965 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f192402c0b0 con 0x7f192806d060 2023-10-18T12:20:00.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.450+0000 7f192ebfc700 1 -- 172.21.15.114:0/1393007965 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f190c065720 msgr2=0x7f190c067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:00.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.450+0000 7f192ebfc700 1 --2- 172.21.15.114:0/1393007965 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f190c065720 0x7f190c067be0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f19280c79e0 tx=0x7f1918007e90 comp rx=0 tx=0).stop 2023-10-18T12:20:00.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.450+0000 7f192ebfc700 1 -- 172.21.15.114:0/1393007965 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f192806d060 msgr2=0x7f1928151b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:00.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.450+0000 7f192ebfc700 1 --2- 172.21.15.114:0/1393007965 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f192806d060 0x7f1928151b50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f19280cf100 tx=0x7f1924004af0 comp rx=0 tx=0).stop 2023-10-18T12:20:00.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.450+0000 7f192ebfc700 1 -- 172.21.15.114:0/1393007965 shutdown_connections 2023-10-18T12:20:00.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.450+0000 7f192ebfc700 1 --2- 172.21.15.114:0/1393007965 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f190c065720 0x7f190c067be0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:00.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.450+0000 7f192ebfc700 1 --2- 172.21.15.114:0/1393007965 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f19280cdd90 0x7f19280c49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:00.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.450+0000 7f192ebfc700 1 --2- 172.21.15.114:0/1393007965 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19280b4310 0x7f19280c44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:00.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.450+0000 7f192ebfc700 1 --2- 172.21.15.114:0/1393007965 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f192806d060 0x7f1928151b50 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:00.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.450+0000 7f192ebfc700 1 -- 172.21.15.114:0/1393007965 >> 172.21.15.114:0/1393007965 conn(0x7f19280ce5c0 msgr2=0x7f19280ca0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:00.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.450+0000 7f192ebfc700 1 -- 172.21.15.114:0/1393007965 shutdown_connections 2023-10-18T12:20:00.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.450+0000 7f192ebfc700 1 -- 172.21.15.114:0/1393007965 wait complete. 2023-10-18T12:20:00.481 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-10-18T12:20:00.482 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-18T12:20:00.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.662+0000 7f35af1af700 1 Processor -- start 2023-10-18T12:20:00.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.662+0000 7f35af1af700 1 -- start start 2023-10-18T12:20:00.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.666+0000 7f35af1af700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35a806a420 0x7f35a806d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:00.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.666+0000 7f35af1af700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a80c7a50 con 0x7f35a80b1e00 2023-10-18T12:20:00.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.666+0000 7f35af1af700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a80c8740 con 0x7f35a815cc70 2023-10-18T12:20:00.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.666+0000 7f35af1af700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a80c8bd0 con 0x7f35a806a420 2023-10-18T12:20:00.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.666+0000 7f35ae9ae700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f35a80b1e00 0x7f35a80d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41580/0 (socket says 172.21.15.114:41580) 2023-10-18T12:20:00.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.666+0000 7f35ae1ad700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f35a815cc70 0x7f35a8069d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.114:59726/0 (socket says 172.21.15.114:59726) 2023-10-18T12:20:00.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.666+0000 7f35ae9ae700 1 -- 172.21.15.114:0/1711010739 learned_addr learned my addr 172.21.15.114:0/1711010739 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:00.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.666+0000 7f35ad9ac700 1 --2- 172.21.15.114:0/1711010739 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35a806a420 0x7f35a806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:00.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.666+0000 7f35ad1ab700 1 -- 172.21.15.114:0/1711010739 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1108621806 0 0) 0x7f35a80c8740 con 0x7f35a815cc70 2023-10-18T12:20:00.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.666+0000 7f35ad1ab700 1 -- 172.21.15.114:0/1711010739 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35940035d0 con 0x7f35a815cc70 2023-10-18T12:20:00.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.666+0000 7f35ad9ac700 1 -- 172.21.15.114:0/1711010739 >> v1:172.21.15.172:6789/0 conn(0x7f35a815cc70 legacy=0x7f35a8069d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:00.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.666+0000 7f35ad1ab700 1 -- 172.21.15.114:0/1711010739 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1380378535 0 0) 0x7f35a80c7a50 con 0x7f35a80b1e00 2023-10-18T12:20:00.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.666+0000 7f35ad9ac700 1 -- 172.21.15.114:0/1711010739 >> v1:172.21.15.114:6789/0 conn(0x7f35a80b1e00 legacy=0x7f35a80d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:00.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.666+0000 7f35ad9ac700 1 -- 172.21.15.114:0/1711010739 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a80c7ca0 con 0x7f35a806a420 2023-10-18T12:20:00.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.666+0000 7f35ad9ac700 1 --2- 172.21.15.114:0/1711010739 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35a806a420 0x7f35a806d870 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3598009880 tx=0x7f3598009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7abae9371f6096ae server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:00.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.666+0000 7f35ad1ab700 1 -- 172.21.15.114:0/1711010739 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3598011830 con 0x7f35a806a420 2023-10-18T12:20:00.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.666+0000 7f35ad1ab700 1 -- 172.21.15.114:0/1711010739 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3598011990 con 0x7f35a806a420 2023-10-18T12:20:00.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.666+0000 7f35ad1ab700 1 -- 172.21.15.114:0/1711010739 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3598011d20 con 0x7f35a806a420 2023-10-18T12:20:00.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.666+0000 7f35af1af700 1 -- 172.21.15.114:0/1711010739 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35a806a420 msgr2=0x7f35a806d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:00.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.666+0000 7f35af1af700 1 --2- 172.21.15.114:0/1711010739 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35a806a420 0x7f35a806d870 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3598009880 tx=0x7f3598009b90 comp rx=0 tx=0).stop 2023-10-18T12:20:00.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.666+0000 7f35af1af700 1 -- 172.21.15.114:0/1711010739 shutdown_connections 2023-10-18T12:20:00.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.666+0000 7f35af1af700 1 --2- 172.21.15.114:0/1711010739 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35a806a420 0x7f35a806d870 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:00.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.666+0000 7f35af1af700 1 -- 172.21.15.114:0/1711010739 >> 172.21.15.114:0/1711010739 conn(0x7f35a80d2bd0 msgr2=0x7f35a80d2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:00.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.666+0000 7f35af1af700 1 -- 172.21.15.114:0/1711010739 shutdown_connections 2023-10-18T12:20:00.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.670+0000 7f35af1af700 1 -- 172.21.15.114:0/1711010739 wait complete. 2023-10-18T12:20:00.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.670+0000 7f35af1af700 1 Processor -- start 2023-10-18T12:20:00.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.670+0000 7f35af1af700 1 -- start start 2023-10-18T12:20:00.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.674+0000 7f35af1af700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35a806a420 0x7f35a81555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:00.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.674+0000 7f35af1af700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35a80b1e00 0x7f35a806ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:00.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.674+0000 7f35af1af700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35a815cc70 0x7f35a80704b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:00.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.674+0000 7f35af1af700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a80b6840 con 0x7f35a80b1e00 2023-10-18T12:20:00.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.674+0000 7f35af1af700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a80b57c0 con 0x7f35a806a420 2023-10-18T12:20:00.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.674+0000 7f35af1af700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a80b5a80 con 0x7f35a815cc70 2023-10-18T12:20:00.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.674+0000 7f35ad9ac700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35a80b1e00 0x7f35a806ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:00.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.674+0000 7f35ad9ac700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35a80b1e00 0x7f35a806ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46782/0 (socket says 172.21.15.114:46782) 2023-10-18T12:20:00.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.674+0000 7f35ad9ac700 1 -- 172.21.15.114:0/831456438 learned_addr learned my addr 172.21.15.114:0/831456438 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:00.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.674+0000 7f35ae1ad700 1 --2- 172.21.15.114:0/831456438 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35a806a420 0x7f35a81555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:00.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.674+0000 7f35ae9ae700 1 --2- 172.21.15.114:0/831456438 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35a815cc70 0x7f35a80704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:00.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.674+0000 7f35ad9ac700 1 -- 172.21.15.114:0/831456438 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35a815cc70 msgr2=0x7f35a80704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:00.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.674+0000 7f35ad9ac700 1 --2- 172.21.15.114:0/831456438 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35a815cc70 0x7f35a80704b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:00.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.674+0000 7f35ad9ac700 1 -- 172.21.15.114:0/831456438 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35a806a420 msgr2=0x7f35a81555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:00.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.674+0000 7f35ad9ac700 1 --2- 172.21.15.114:0/831456438 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35a806a420 0x7f35a81555f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:00.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.674+0000 7f35ad9ac700 1 -- 172.21.15.114:0/831456438 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35980094b0 con 0x7f35a80b1e00 2023-10-18T12:20:00.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.674+0000 7f35ad9ac700 1 --2- 172.21.15.114:0/831456438 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35a80b1e00 0x7f35a806ff70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3598013040 tx=0x7f3598004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:00.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.674+0000 7f359effd700 1 -- 172.21.15.114:0/831456438 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35980198d0 con 0x7f35a80b1e00 2023-10-18T12:20:00.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.674+0000 7f359effd700 1 -- 172.21.15.114:0/831456438 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359801e070 con 0x7f35a80b1e00 2023-10-18T12:20:00.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.674+0000 7f359effd700 1 -- 172.21.15.114:0/831456438 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3598019c50 con 0x7f35a80b1e00 2023-10-18T12:20:00.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.674+0000 7f35af1af700 1 -- 172.21.15.114:0/831456438 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a80b5d60 con 0x7f35a80b1e00 2023-10-18T12:20:00.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.678+0000 7f35af1af700 1 -- 172.21.15.114:0/831456438 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a80b6320 con 0x7f35a80b1e00 2023-10-18T12:20:00.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.678+0000 7f35af1af700 1 -- 172.21.15.114:0/831456438 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a8072e60 con 0x7f35a80b1e00 2023-10-18T12:20:00.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.678+0000 7f359effd700 1 -- 172.21.15.114:0/831456438 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f359802d450 con 0x7f35a80b1e00 2023-10-18T12:20:00.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.678+0000 7f359effd700 1 --2- 172.21.15.114:0/831456438 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f358c0656f0 0x7f358c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:00.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.678+0000 7f359effd700 1 -- 172.21.15.114:0/831456438 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3598083f30 con 0x7f35a80b1e00 2023-10-18T12:20:00.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.682+0000 7f35ae1ad700 1 --2- 172.21.15.114:0/831456438 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f358c0656f0 0x7f358c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:00.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.682+0000 7f35ae1ad700 1 --2- 172.21.15.114:0/831456438 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f358c0656f0 0x7f358c067bb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f35a4007fd0 tx=0x7f35a4007de0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:00.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.686+0000 7f359effd700 1 -- 172.21.15.114:0/831456438 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f3598051840 con 0x7f35a80b1e00 2023-10-18T12:20:00.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:00.926+0000 7f35af1af700 1 -- 172.21.15.114:0/831456438 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f35a806e290 con 0x7f35a80b1e00 2023-10-18T12:20:01.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.462+0000 7f359effd700 1 -- 172.21.15.114:0/831456438 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3598020020 con 0x7f35a80b1e00 2023-10-18T12:20:01.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.466+0000 7f35af1af700 1 -- 172.21.15.114:0/831456438 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f358c0656f0 msgr2=0x7f358c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:01.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.466+0000 7f35af1af700 1 --2- 172.21.15.114:0/831456438 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f358c0656f0 0x7f358c067bb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f35a4007fd0 tx=0x7f35a4007de0 comp rx=0 tx=0).stop 2023-10-18T12:20:01.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.466+0000 7f35af1af700 1 -- 172.21.15.114:0/831456438 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35a80b1e00 msgr2=0x7f35a806ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:01.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.466+0000 7f35af1af700 1 --2- 172.21.15.114:0/831456438 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35a80b1e00 0x7f35a806ff70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3598013040 tx=0x7f3598004770 comp rx=0 tx=0).stop 2023-10-18T12:20:01.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.466+0000 7f35af1af700 1 -- 172.21.15.114:0/831456438 shutdown_connections 2023-10-18T12:20:01.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.466+0000 7f35af1af700 1 --2- 172.21.15.114:0/831456438 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f358c0656f0 0x7f358c067bb0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:01.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.466+0000 7f35af1af700 1 --2- 172.21.15.114:0/831456438 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35a815cc70 0x7f35a80704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:01.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.466+0000 7f35af1af700 1 --2- 172.21.15.114:0/831456438 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35a80b1e00 0x7f35a806ff70 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:01.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.466+0000 7f35af1af700 1 --2- 172.21.15.114:0/831456438 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35a806a420 0x7f35a81555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:01.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.466+0000 7f35af1af700 1 -- 172.21.15.114:0/831456438 >> 172.21.15.114:0/831456438 conn(0x7f35a80d2bd0 msgr2=0x7f35a81564b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:01.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.466+0000 7f35af1af700 1 -- 172.21.15.114:0/831456438 shutdown_connections 2023-10-18T12:20:01.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.466+0000 7f35af1af700 1 -- 172.21.15.114:0/831456438 wait complete. 2023-10-18T12:20:01.494 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-18T12:20:01.495 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T12:20:01.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.670+0000 7f06a072d700 1 Processor -- start 2023-10-18T12:20:01.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.670+0000 7f06a072d700 1 -- start start 2023-10-18T12:20:01.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.674+0000 7f06a072d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f06980b5b80 0x7f069806f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:01.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.674+0000 7f06a072d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f069806fee0 0x7f069815eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:01.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.674+0000 7f06a072d700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f069815e680 con 0x7f0698146800 2023-10-18T12:20:01.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.674+0000 7f06a072d700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0698070370 con 0x7f069806fee0 2023-10-18T12:20:01.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.674+0000 7f06a072d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06980b6180 con 0x7f06980b5b80 2023-10-18T12:20:01.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.674+0000 7f069e4c9700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f0698146800 0x7f069815dd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41588/0 (socket says 172.21.15.114:41588) 2023-10-18T12:20:01.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.674+0000 7f069e4c9700 1 -- 172.21.15.114:0/2954447353 learned_addr learned my addr 172.21.15.114:0/2954447353 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:01.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.674+0000 7f069ecca700 1 --2- 172.21.15.114:0/2954447353 >> v2:172.21.15.114:3300/0 conn(0x7f069806fee0 0x7f069815eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:01.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.674+0000 7f069dcc8700 1 --2- 172.21.15.114:0/2954447353 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f06980b5b80 0x7f069806f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:01.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.674+0000 7f069dcc8700 1 -- 172.21.15.114:0/2954447353 >> v2:172.21.15.114:3300/0 conn(0x7f069806fee0 msgr2=0x7f069815eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:01.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.674+0000 7f069dcc8700 1 --2- 172.21.15.114:0/2954447353 >> v2:172.21.15.114:3300/0 conn(0x7f069806fee0 0x7f069815eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:01.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.674+0000 7f069dcc8700 1 -- 172.21.15.114:0/2954447353 >> v1:172.21.15.114:6789/0 conn(0x7f0698146800 legacy=0x7f069815dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:01.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.674+0000 7f069dcc8700 1 -- 172.21.15.114:0/2954447353 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06980b6460 con 0x7f06980b5b80 2023-10-18T12:20:01.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.674+0000 7f069d4c7700 1 -- 172.21.15.114:0/2954447353 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 806162955 0 0) 0x7f069815e680 con 0x7f0698146800 2023-10-18T12:20:01.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.674+0000 7f069dcc8700 1 --2- 172.21.15.114:0/2954447353 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f06980b5b80 0x7f069806f9a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0688009850 tx=0x7f0688009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a907440313e9ec70 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:01.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.674+0000 7f069d4c7700 1 -- 172.21.15.114:0/2954447353 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0688011830 con 0x7f06980b5b80 2023-10-18T12:20:01.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.674+0000 7f069d4c7700 1 -- 172.21.15.114:0/2954447353 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0688011990 con 0x7f06980b5b80 2023-10-18T12:20:01.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.674+0000 7f069d4c7700 1 -- 172.21.15.114:0/2954447353 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0688011d40 con 0x7f06980b5b80 2023-10-18T12:20:01.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.674+0000 7f06a072d700 1 -- 172.21.15.114:0/2954447353 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f06980b5b80 msgr2=0x7f069806f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:01.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.674+0000 7f06a072d700 1 --2- 172.21.15.114:0/2954447353 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f06980b5b80 0x7f069806f9a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0688009850 tx=0x7f0688009b60 comp rx=0 tx=0).stop 2023-10-18T12:20:01.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.678+0000 7f06a072d700 1 -- 172.21.15.114:0/2954447353 shutdown_connections 2023-10-18T12:20:01.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.678+0000 7f06a072d700 1 --2- 172.21.15.114:0/2954447353 >> v2:172.21.15.114:3300/0 conn(0x7f069806fee0 0x7f069815eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:01.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.678+0000 7f06a072d700 1 --2- 172.21.15.114:0/2954447353 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f06980b5b80 0x7f069806f9a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:01.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.678+0000 7f06a072d700 1 -- 172.21.15.114:0/2954447353 >> 172.21.15.114:0/2954447353 conn(0x7f069806a130 msgr2=0x7f069806a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:01.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.678+0000 7f06a072d700 1 -- 172.21.15.114:0/2954447353 shutdown_connections 2023-10-18T12:20:01.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.678+0000 7f06a072d700 1 -- 172.21.15.114:0/2954447353 wait complete. 2023-10-18T12:20:01.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.678+0000 7f06a072d700 1 Processor -- start 2023-10-18T12:20:01.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.678+0000 7f06a072d700 1 -- start start 2023-10-18T12:20:01.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.678+0000 7f06a072d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f069806fee0 0x7f0698137f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:01.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.678+0000 7f06a072d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f06980b5b80 0x7f069813f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:01.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.678+0000 7f06a072d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0698146800 0x7f0698138510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:01.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.678+0000 7f06a072d700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06981409b0 con 0x7f069806fee0 2023-10-18T12:20:01.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.678+0000 7f06a072d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069813f910 con 0x7f0698146800 2023-10-18T12:20:01.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.678+0000 7f06a072d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f069813fbf0 con 0x7f06980b5b80 2023-10-18T12:20:01.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.682+0000 7f069e4c9700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f069806fee0 0x7f0698137f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:01.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.682+0000 7f069e4c9700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f069806fee0 0x7f0698137f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46808/0 (socket says 172.21.15.114:46808) 2023-10-18T12:20:01.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.682+0000 7f069e4c9700 1 -- 172.21.15.114:0/1680600979 learned_addr learned my addr 172.21.15.114:0/1680600979 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:01.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.682+0000 7f069ecca700 1 --2- 172.21.15.114:0/1680600979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0698146800 0x7f0698138510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:01.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.682+0000 7f069dcc8700 1 --2- 172.21.15.114:0/1680600979 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f06980b5b80 0x7f069813f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:01.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.682+0000 7f069e4c9700 1 -- 172.21.15.114:0/1680600979 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f06980b5b80 msgr2=0x7f069813f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:01.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.682+0000 7f069e4c9700 1 --2- 172.21.15.114:0/1680600979 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f06980b5b80 0x7f069813f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:01.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.682+0000 7f069e4c9700 1 -- 172.21.15.114:0/1680600979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0698146800 msgr2=0x7f0698138510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:01.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.682+0000 7f069e4c9700 1 --2- 172.21.15.114:0/1680600979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0698146800 0x7f0698138510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:01.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.682+0000 7f069e4c9700 1 -- 172.21.15.114:0/1680600979 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06880094b0 con 0x7f069806fee0 2023-10-18T12:20:01.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.682+0000 7f069ecca700 1 --2- 172.21.15.114:0/1680600979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0698146800 0x7f0698138510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:20:01.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.682+0000 7f069e4c9700 1 --2- 172.21.15.114:0/1680600979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f069806fee0 0x7f0698137f10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f069400c4e0 tx=0x7f069400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:01.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.682+0000 7f068effd700 1 -- 172.21.15.114:0/1680600979 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0694004ca0 con 0x7f069806fee0 2023-10-18T12:20:01.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.682+0000 7f068effd700 1 -- 172.21.15.114:0/1680600979 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0694004e20 con 0x7f069806fee0 2023-10-18T12:20:01.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.682+0000 7f068effd700 1 -- 172.21.15.114:0/1680600979 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0694007310 con 0x7f069806fee0 2023-10-18T12:20:01.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.682+0000 7f06a072d700 1 -- 172.21.15.114:0/1680600979 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f069813fed0 con 0x7f069806fee0 2023-10-18T12:20:01.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.682+0000 7f06a072d700 1 -- 172.21.15.114:0/1680600979 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0698140490 con 0x7f069806fee0 2023-10-18T12:20:01.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.682+0000 7f06a072d700 1 -- 172.21.15.114:0/1680600979 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06980b6720 con 0x7f069806fee0 2023-10-18T12:20:01.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.686+0000 7f068effd700 1 -- 172.21.15.114:0/1680600979 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f0694007470 con 0x7f069806fee0 2023-10-18T12:20:01.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.686+0000 7f068effd700 1 --2- 172.21.15.114:0/1680600979 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f067c0656f0 0x7f067c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:01.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.686+0000 7f068effd700 1 -- 172.21.15.114:0/1680600979 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0694082d60 con 0x7f069806fee0 2023-10-18T12:20:01.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.686+0000 7f069dcc8700 1 --2- 172.21.15.114:0/1680600979 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f067c0656f0 0x7f067c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:01.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.690+0000 7f069dcc8700 1 --2- 172.21.15.114:0/1680600979 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f067c0656f0 0x7f067c067bb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0688009ba0 tx=0x7f0688008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:01.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.694+0000 7f068effd700 1 -- 172.21.15.114:0/1680600979 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f06980b6720 con 0x7f069806fee0 2023-10-18T12:20:01.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.922+0000 7f06a072d700 1 -- 172.21.15.114:0/1680600979 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06980b6720 con 0x7f069806fee0 2023-10-18T12:20:01.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.922+0000 7f068effd700 1 -- 172.21.15.114:0/1680600979 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4877 (secure 0 0 0) 0x7f06980b6720 con 0x7f069806fee0 2023-10-18T12:20:01.927 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:20:01.927 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1054658298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1054658298},{"type":"v1","addr":"172.21.15.172:6835","nonce":1054658298}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2715800167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2715800167},{"type":"v1","addr":"172.21.15.114:6833","nonce":2715800167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/22518579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":22518579},{"type":"v1","addr":"172.21.15.114:6835","nonce":22518579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T12:19:39.077734+0000","modified":"2023-10-18T12:20:01.448709+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4303":{"gid":4303,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3028221887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3028221887},{"type":"v1","addr":"172.21.15.172:6837","nonce":3028221887}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-18T12:20:01.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.926+0000 7f06a072d700 1 -- 172.21.15.114:0/1680600979 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f067c0656f0 msgr2=0x7f067c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:01.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.926+0000 7f06a072d700 1 --2- 172.21.15.114:0/1680600979 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f067c0656f0 0x7f067c067bb0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0688009ba0 tx=0x7f0688008030 comp rx=0 tx=0).stop 2023-10-18T12:20:01.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.926+0000 7f06a072d700 1 -- 172.21.15.114:0/1680600979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f069806fee0 msgr2=0x7f0698137f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:01.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.926+0000 7f06a072d700 1 --2- 172.21.15.114:0/1680600979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f069806fee0 0x7f0698137f10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f069400c4e0 tx=0x7f069400c7f0 comp rx=0 tx=0).stop 2023-10-18T12:20:01.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.926+0000 7f06a072d700 1 -- 172.21.15.114:0/1680600979 shutdown_connections 2023-10-18T12:20:01.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.926+0000 7f06a072d700 1 --2- 172.21.15.114:0/1680600979 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f067c0656f0 0x7f067c067bb0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:01.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.926+0000 7f06a072d700 1 --2- 172.21.15.114:0/1680600979 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f06980b5b80 0x7f069813f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:01.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.926+0000 7f06a072d700 1 --2- 172.21.15.114:0/1680600979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0698146800 0x7f0698138510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:01.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.926+0000 7f06a072d700 1 --2- 172.21.15.114:0/1680600979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f069806fee0 0x7f0698137f10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:01.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.926+0000 7f06a072d700 1 -- 172.21.15.114:0/1680600979 >> 172.21.15.114:0/1680600979 conn(0x7f069806a130 msgr2=0x7f069806e460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:01.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.926+0000 7f06a072d700 1 -- 172.21.15.114:0/1680600979 shutdown_connections 2023-10-18T12:20:01.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:01.926+0000 7f06a072d700 1 -- 172.21.15.114:0/1680600979 wait complete. 2023-10-18T12:20:01.932 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 9 2023-10-18T12:20:01.948 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T12:20:02.009 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:20:02.016 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:20:02.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.122+0000 7fa0c3d13700 1 Processor -- start 2023-10-18T12:20:02.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.122+0000 7fa0c3d13700 1 -- start start 2023-10-18T12:20:02.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.126+0000 7fa0c3d13700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa0bc15ee50 0x7fa0bc0cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:02.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.126+0000 7fa0c3d13700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa0bc06e8a0 0x7fa0bc0caf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:02.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.126+0000 7fa0c3d13700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa0bc0cb470 0x7fa0bc06f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:02.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.126+0000 7fa0c3d13700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0bc06d4e0 con 0x7fa0bc06e8a0 2023-10-18T12:20:02.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.126+0000 7fa0c3d13700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0bc162780 con 0x7fa0bc15ee50 2023-10-18T12:20:02.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.126+0000 7fa0c3d13700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0bc06f450 con 0x7fa0bc0cb470 2023-10-18T12:20:02.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.126+0000 7fa0c12ae700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa0bc06e8a0 0x7fa0bc0caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:02.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.126+0000 7fa0c12ae700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa0bc06e8a0 0x7fa0bc0caf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46814/0 (socket says 172.21.15.114:46814) 2023-10-18T12:20:02.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.126+0000 7fa0c12ae700 1 -- 172.21.15.114:0/4143159582 learned_addr learned my addr 172.21.15.114:0/4143159582 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:02.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.126+0000 7fa0c1aaf700 1 --2- 172.21.15.114:0/4143159582 >> v2:172.21.15.172:3300/0 conn(0x7fa0bc15ee50 0x7fa0bc0cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:02.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.126+0000 7fa0c22b0700 1 --2- 172.21.15.114:0/4143159582 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa0bc0cb470 0x7fa0bc06f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:02.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.126+0000 7fa0c12ae700 1 -- 172.21.15.114:0/4143159582 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa0bc0cb470 msgr2=0x7fa0bc06f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:02.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.126+0000 7fa0c12ae700 1 --2- 172.21.15.114:0/4143159582 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa0bc0cb470 0x7fa0bc06f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:02.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.126+0000 7fa0c12ae700 1 -- 172.21.15.114:0/4143159582 >> v2:172.21.15.172:3300/0 conn(0x7fa0bc15ee50 msgr2=0x7fa0bc0cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:02.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.126+0000 7fa0c12ae700 1 --2- 172.21.15.114:0/4143159582 >> v2:172.21.15.172:3300/0 conn(0x7fa0bc15ee50 0x7fa0bc0cc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:02.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.126+0000 7fa0c12ae700 1 -- 172.21.15.114:0/4143159582 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0bc0cb8a0 con 0x7fa0bc06e8a0 2023-10-18T12:20:02.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.126+0000 7fa0c12ae700 1 --2- 172.21.15.114:0/4143159582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0bc06e8a0 0x7fa0bc0caf30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc06b360 tx=0x7fa0ac009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d1b8c4922c1a043 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:02.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.130+0000 7fa0c0aad700 1 -- 172.21.15.114:0/4143159582 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac011830 con 0x7fa0bc06e8a0 2023-10-18T12:20:02.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.130+0000 7fa0c0aad700 1 -- 172.21.15.114:0/4143159582 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0ac011990 con 0x7fa0bc06e8a0 2023-10-18T12:20:02.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.130+0000 7fa0c0aad700 1 -- 172.21.15.114:0/4143159582 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac011d20 con 0x7fa0bc06e8a0 2023-10-18T12:20:02.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.130+0000 7fa0c3d13700 1 -- 172.21.15.114:0/4143159582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0bc06e8a0 msgr2=0x7fa0bc0caf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:02.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.130+0000 7fa0c3d13700 1 --2- 172.21.15.114:0/4143159582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0bc06e8a0 0x7fa0bc0caf30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc06b360 tx=0x7fa0ac009bf0 comp rx=0 tx=0).stop 2023-10-18T12:20:02.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.130+0000 7fa0c3d13700 1 -- 172.21.15.114:0/4143159582 shutdown_connections 2023-10-18T12:20:02.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.130+0000 7fa0c3d13700 1 --2- 172.21.15.114:0/4143159582 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa0bc0cb470 0x7fa0bc06f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:02.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.130+0000 7fa0c3d13700 1 --2- 172.21.15.114:0/4143159582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0bc06e8a0 0x7fa0bc0caf30 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:02.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.130+0000 7fa0c3d13700 1 --2- 172.21.15.114:0/4143159582 >> v2:172.21.15.172:3300/0 conn(0x7fa0bc15ee50 0x7fa0bc0cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:02.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.130+0000 7fa0c3d13700 1 -- 172.21.15.114:0/4143159582 >> 172.21.15.114:0/4143159582 conn(0x7fa0bc06a340 msgr2=0x7fa0bc0b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:02.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.130+0000 7fa0c3d13700 1 -- 172.21.15.114:0/4143159582 shutdown_connections 2023-10-18T12:20:02.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.130+0000 7fa0c3d13700 1 -- 172.21.15.114:0/4143159582 wait complete. 2023-10-18T12:20:02.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.134+0000 7fa0c3d13700 1 Processor -- start 2023-10-18T12:20:02.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.134+0000 7fa0c3d13700 1 -- start start 2023-10-18T12:20:02.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.134+0000 7fa0c3d13700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0bc06e8a0 0x7fa0bc0cd000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:02.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.134+0000 7fa0c3d13700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0bc0cb470 0x7fa0bc1f5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:02.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.134+0000 7fa0c3d13700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa0bc15ee50 0x7fa0bc1f5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:02.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.134+0000 7fa0c3d13700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0bc15c2e0 con 0x7fa0bc0cb470 2023-10-18T12:20:02.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.134+0000 7fa0c3d13700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0bc1f6530 con 0x7fa0bc06e8a0 2023-10-18T12:20:02.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.134+0000 7fa0c3d13700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0bc15be50 con 0x7fa0bc15ee50 2023-10-18T12:20:02.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.134+0000 7fa0c12ae700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0bc0cb470 0x7fa0bc1f5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:02.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.134+0000 7fa0c12ae700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0bc0cb470 0x7fa0bc1f5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46824/0 (socket says 172.21.15.114:46824) 2023-10-18T12:20:02.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.134+0000 7fa0c12ae700 1 -- 172.21.15.114:0/3951644576 learned_addr learned my addr 172.21.15.114:0/3951644576 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:02.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.134+0000 7fa0c1aaf700 1 --2- 172.21.15.114:0/3951644576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0bc06e8a0 0x7fa0bc0cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:02.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.134+0000 7fa0c22b0700 1 --2- 172.21.15.114:0/3951644576 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa0bc15ee50 0x7fa0bc1f5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:02.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.134+0000 7fa0c12ae700 1 -- 172.21.15.114:0/3951644576 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa0bc15ee50 msgr2=0x7fa0bc1f5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:02.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.134+0000 7fa0c12ae700 1 --2- 172.21.15.114:0/3951644576 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa0bc15ee50 0x7fa0bc1f5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:02.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.134+0000 7fa0c12ae700 1 -- 172.21.15.114:0/3951644576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0bc06e8a0 msgr2=0x7fa0bc0cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:02.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.134+0000 7fa0c12ae700 1 --2- 172.21.15.114:0/3951644576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0bc06e8a0 0x7fa0bc0cd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:02.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.134+0000 7fa0c12ae700 1 -- 172.21.15.114:0/3951644576 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0ac009570 con 0x7fa0bc0cb470 2023-10-18T12:20:02.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.134+0000 7fa0c1aaf700 1 --2- 172.21.15.114:0/3951644576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0bc06e8a0 0x7fa0bc0cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:02.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.134+0000 7fa0c22b0700 1 --2- 172.21.15.114:0/3951644576 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa0bc15ee50 0x7fa0bc1f5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:20:02.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.134+0000 7fa0c12ae700 1 --2- 172.21.15.114:0/3951644576 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0bc0cb470 0x7fa0bc1f5ab0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc06b390 tx=0x7fa0ac004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:02.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.138+0000 7fa0b27fc700 1 -- 172.21.15.114:0/3951644576 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac004510 con 0x7fa0bc0cb470 2023-10-18T12:20:02.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.138+0000 7fa0b27fc700 1 -- 172.21.15.114:0/3951644576 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0ac01e070 con 0x7fa0bc0cb470 2023-10-18T12:20:02.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.138+0000 7fa0b27fc700 1 -- 172.21.15.114:0/3951644576 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac003900 con 0x7fa0bc0cb470 2023-10-18T12:20:02.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.138+0000 7fa0c3d13700 1 -- 172.21.15.114:0/3951644576 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0bc15b280 con 0x7fa0bc0cb470 2023-10-18T12:20:02.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.138+0000 7fa0c3d13700 1 -- 172.21.15.114:0/3951644576 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0bc15b800 con 0x7fa0bc0cb470 2023-10-18T12:20:02.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.138+0000 7fa0c3d13700 1 -- 172.21.15.114:0/3951644576 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0bc072e60 con 0x7fa0bc0cb470 2023-10-18T12:20:02.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.138+0000 7fa0b27fc700 1 -- 172.21.15.114:0/3951644576 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fa0ac003a60 con 0x7fa0bc0cb470 2023-10-18T12:20:02.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.142+0000 7fa0b27fc700 1 --2- 172.21.15.114:0/3951644576 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa0a00656f0 0x7fa0a0067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:02.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.142+0000 7fa0b27fc700 1 -- 172.21.15.114:0/3951644576 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa0ac083f80 con 0x7fa0bc0cb470 2023-10-18T12:20:02.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.142+0000 7fa0c1aaf700 1 --2- 172.21.15.114:0/3951644576 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa0a00656f0 0x7fa0a0067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:02.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.142+0000 7fa0c1aaf700 1 --2- 172.21.15.114:0/3951644576 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa0a00656f0 0x7fa0a0067bb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8009bc0 tx=0x7fa0b8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:02.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.142+0000 7fa0b27fc700 1 -- 172.21.15.114:0/3951644576 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fa0ac0b4d40 con 0x7fa0bc0cb470 2023-10-18T12:20:02.326 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.322+0000 7fa0c3d13700 1 -- 172.21.15.114:0/3951644576 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0bc15bf90 con 0x7fa0bc0cb470 2023-10-18T12:20:02.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.322+0000 7fa0b27fc700 1 -- 172.21.15.114:0/3951644576 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20144 (secure 0 0 0) 0x7fa0ac0517c0 con 0x7fa0bc0cb470 2023-10-18T12:20:02.328 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:20:02.328 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":28,"fsid":"240ea340-5d3d-4f52-a4bc-af075aca3deb","created":"2023-10-18T12:19:12.512994+0000","modified":"2023-10-18T12:19:44.436656+0000","last_up_change":"2023-10-18T12:19:25.286009+0000","last_in_change":"2023-10-18T12:19:15.850693+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T12:19:27.040638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-18T12:19:32.358094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-18T12:19:37.333855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-18T12:19:38.055385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-18T12:19:41.679218+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c3578978-1a03-4857-b9d2-34a5da3d7731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6817","nonce":1506287862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6820","nonce":1506287862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6830","nonce":1506287862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6825","nonce":1506287862}]},"public_addr":"172.21.15.114:6817/1506287862","cluster_addr":"172.21.15.114:6820/1506287862","heartbeat_back_addr":"172.21.15.114:6830/1506287862","heartbeat_front_addr":"172.21.15.114:6825/1506287862","state":["exists","up"]},{"osd":1,"uuid":"43eb26a6-e2b3-4670-9559-bd053b5140d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6801","nonce":3302727047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6803","nonce":3302727047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6807","nonce":3302727047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6805","nonce":3302727047}]},"public_addr":"172.21.15.114:6801/3302727047","cluster_addr":"172.21.15.114:6803/3302727047","heartbeat_back_addr":"172.21.15.114:6807/3302727047","heartbeat_front_addr":"172.21.15.114:6805/3302727047","state":["exists","up"]},{"osd":2,"uuid":"f3d4dbd5-521c-4dd2-b687-5768cc7d0938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6809","nonce":2699151351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6811","nonce":2699151351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6815","nonce":2699151351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6813","nonce":2699151351}]},"public_addr":"172.21.15.114:6809/2699151351","cluster_addr":"172.21.15.114:6811/2699151351","heartbeat_back_addr":"172.21.15.114:6815/2699151351","heartbeat_front_addr":"172.21.15.114:6813/2699151351","state":["exists","up"]},{"osd":3,"uuid":"823e5802-92b7-4f0d-b32d-a5748993f1b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6821","nonce":1361608073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6824","nonce":1361608073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6829","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6831","nonce":1361608073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6827","nonce":1361608073}]},"public_addr":"172.21.15.114:6821/1361608073","cluster_addr":"172.21.15.114:6824/1361608073","heartbeat_back_addr":"172.21.15.114:6831/1361608073","heartbeat_front_addr":"172.21.15.114:6827/1361608073","state":["exists","up"]},{"osd":4,"uuid":"e47fb93e-13b4-44a4-b084-8c4384ceb41e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6801","nonce":930839681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6803","nonce":930839681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6807","nonce":930839681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6805","nonce":930839681}]},"public_addr":"172.21.15.172:6801/930839681","cluster_addr":"172.21.15.172:6803/930839681","heartbeat_back_addr":"172.21.15.172:6807/930839681","heartbeat_front_addr":"172.21.15.172:6805/930839681","state":["exists","up"]},{"osd":5,"uuid":"7561a973-f479-45a0-af40-f324728d622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6814","nonce":571761850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6818","nonce":571761850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6824","nonce":571761850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6821","nonce":571761850}]},"public_addr":"172.21.15.172:6814/571761850","cluster_addr":"172.21.15.172:6818/571761850","heartbeat_back_addr":"172.21.15.172:6824/571761850","heartbeat_front_addr":"172.21.15.172:6821/571761850","state":["exists","up"]},{"osd":6,"uuid":"51753f4b-7f06-4f1c-9ec7-6e18a66eb980","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6825","nonce":1680398853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6827","nonce":1680398853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6831","nonce":1680398853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6829","nonce":1680398853}]},"public_addr":"172.21.15.172:6825/1680398853","cluster_addr":"172.21.15.172:6827/1680398853","heartbeat_back_addr":"172.21.15.172:6831/1680398853","heartbeat_front_addr":"172.21.15.172:6829/1680398853","state":["exists","up"]},{"osd":7,"uuid":"4d8b1e15-143d-4d17-9074-59d92f0f9af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6809","nonce":349710101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6811","nonce":349710101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6819","nonce":349710101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6815","nonce":349710101}]},"public_addr":"172.21.15.172:6809/349710101","cluster_addr":"172.21.15.172:6811/349710101","heartbeat_back_addr":"172.21.15.172:6819/349710101","heartbeat_front_addr":"172.21.15.172:6815/349710101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.889460+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.475494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.911473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.648596+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.609994+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.636248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.854589+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.885826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T12:20:02.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.326+0000 7fa0c3d13700 1 -- 172.21.15.114:0/3951644576 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa0a00656f0 msgr2=0x7fa0a0067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:02.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.326+0000 7fa0c3d13700 1 --2- 172.21.15.114:0/3951644576 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa0a00656f0 0x7fa0a0067bb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8009bc0 tx=0x7fa0b8008040 comp rx=0 tx=0).stop 2023-10-18T12:20:02.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.326+0000 7fa0c3d13700 1 -- 172.21.15.114:0/3951644576 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0bc0cb470 msgr2=0x7fa0bc1f5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:02.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.326+0000 7fa0c3d13700 1 --2- 172.21.15.114:0/3951644576 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0bc0cb470 0x7fa0bc1f5ab0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc06b390 tx=0x7fa0ac004770 comp rx=0 tx=0).stop 2023-10-18T12:20:02.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.326+0000 7fa0c3d13700 1 -- 172.21.15.114:0/3951644576 shutdown_connections 2023-10-18T12:20:02.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.326+0000 7fa0c3d13700 1 --2- 172.21.15.114:0/3951644576 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa0a00656f0 0x7fa0a0067bb0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:02.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.326+0000 7fa0c3d13700 1 --2- 172.21.15.114:0/3951644576 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa0bc15ee50 0x7fa0bc1f5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:02.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.326+0000 7fa0c3d13700 1 --2- 172.21.15.114:0/3951644576 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0bc0cb470 0x7fa0bc1f5ab0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:02.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.326+0000 7fa0c3d13700 1 --2- 172.21.15.114:0/3951644576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0bc06e8a0 0x7fa0bc0cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:02.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.326+0000 7fa0c3d13700 1 -- 172.21.15.114:0/3951644576 >> 172.21.15.114:0/3951644576 conn(0x7fa0bc06a340 msgr2=0x7fa0bc0afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:02.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.326+0000 7fa0c3d13700 1 -- 172.21.15.114:0/3951644576 shutdown_connections 2023-10-18T12:20:02.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.326+0000 7fa0c3d13700 1 -- 172.21.15.114:0/3951644576 wait complete. 2023-10-18T12:20:02.353 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-18T12:20:02.353 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-18T12:20:02.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.518+0000 7f63a769e700 1 Processor -- start 2023-10-18T12:20:02.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.518+0000 7f63a769e700 1 -- start start 2023-10-18T12:20:02.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.518+0000 7f63a769e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f63a0155420 0x7f63a00cb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:02.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.518+0000 7f63a769e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f63a015bf00 0x7f63a00cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:02.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.518+0000 7f63a769e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63a00cbc80 con 0x7f63a00b0f90 2023-10-18T12:20:02.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.518+0000 7f63a769e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63a0155800 con 0x7f63a015bf00 2023-10-18T12:20:02.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.518+0000 7f63a769e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63a00cb9a0 con 0x7f63a0155420 2023-10-18T12:20:02.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.522+0000 7f63a4c39700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f63a015bf00 0x7f63a00cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:02.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.522+0000 7f63a4c39700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f63a015bf00 0x7f63a00cdc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46834/0 (socket says 172.21.15.114:46834) 2023-10-18T12:20:02.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.522+0000 7f63a4c39700 1 -- 172.21.15.114:0/350166600 learned_addr learned my addr 172.21.15.114:0/350166600 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:02.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.522+0000 7f63a543a700 1 --2- 172.21.15.114:0/350166600 >> v2:172.21.15.172:3300/0 conn(0x7f63a0155420 0x7f63a00cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:02.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.522+0000 7f63a4c39700 1 -- 172.21.15.114:0/350166600 >> v2:172.21.15.172:3300/0 conn(0x7f63a0155420 msgr2=0x7f63a00cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:02.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.522+0000 7f63a4c39700 1 --2- 172.21.15.114:0/350166600 >> v2:172.21.15.172:3300/0 conn(0x7f63a0155420 0x7f63a00cb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:02.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.522+0000 7f63a4c39700 1 -- 172.21.15.114:0/350166600 >> v1:172.21.15.172:6789/0 conn(0x7f63a00b0f90 legacy=0x7f63a00cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:02.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.522+0000 7f63a4c39700 1 -- 172.21.15.114:0/350166600 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a015b420 con 0x7f63a015bf00 2023-10-18T12:20:02.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.522+0000 7f63a4c39700 1 --2- 172.21.15.114:0/350166600 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63a015bf00 0x7f63a00cdc10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f63a006acf0 tx=0x7f6390009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61cdf66b2aa3a87f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:02.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.522+0000 7f6397fff700 1 -- 172.21.15.114:0/350166600 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6390011830 con 0x7f63a015bf00 2023-10-18T12:20:02.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.522+0000 7f6397fff700 1 -- 172.21.15.114:0/350166600 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6390011990 con 0x7f63a015bf00 2023-10-18T12:20:02.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.522+0000 7f6397fff700 1 -- 172.21.15.114:0/350166600 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6390011d20 con 0x7f63a015bf00 2023-10-18T12:20:02.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.522+0000 7f63a769e700 1 -- 172.21.15.114:0/350166600 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63a015bf00 msgr2=0x7f63a00cdc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:02.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.522+0000 7f63a769e700 1 --2- 172.21.15.114:0/350166600 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63a015bf00 0x7f63a00cdc10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f63a006acf0 tx=0x7f6390009bf0 comp rx=0 tx=0).stop 2023-10-18T12:20:02.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.522+0000 7f63a769e700 1 -- 172.21.15.114:0/350166600 shutdown_connections 2023-10-18T12:20:02.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.522+0000 7f63a769e700 1 --2- 172.21.15.114:0/350166600 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63a015bf00 0x7f63a00cdc10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:02.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.522+0000 7f63a769e700 1 --2- 172.21.15.114:0/350166600 >> v2:172.21.15.172:3300/0 conn(0x7f63a0155420 0x7f63a00cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:02.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.522+0000 7f63a769e700 1 -- 172.21.15.114:0/350166600 >> 172.21.15.114:0/350166600 conn(0x7f63a006a340 msgr2=0x7f63a00b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:02.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.522+0000 7f63a769e700 1 -- 172.21.15.114:0/350166600 shutdown_connections 2023-10-18T12:20:02.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.522+0000 7f63a769e700 1 -- 172.21.15.114:0/350166600 wait complete. 2023-10-18T12:20:02.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.526+0000 7f63a769e700 1 Processor -- start 2023-10-18T12:20:02.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.526+0000 7f63a769e700 1 -- start start 2023-10-18T12:20:02.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.530+0000 7f63a769e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63a00b0f90 0x7f63a0154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:02.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.530+0000 7f63a769e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63a0155420 0x7f63a0142730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:02.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.530+0000 7f63a769e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63a015bf00 0x7f63a0142c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:02.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.530+0000 7f63a769e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a0130bb0 con 0x7f63a0155420 2023-10-18T12:20:02.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.530+0000 7f63a769e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a0130e90 con 0x7f63a015bf00 2023-10-18T12:20:02.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.530+0000 7f63a769e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a0131170 con 0x7f63a00b0f90 2023-10-18T12:20:02.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.530+0000 7f63a4c39700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63a0155420 0x7f63a0142730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:02.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.530+0000 7f63a4c39700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63a0155420 0x7f63a0142730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46838/0 (socket says 172.21.15.114:46838) 2023-10-18T12:20:02.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.530+0000 7f63a4c39700 1 -- 172.21.15.114:0/3896590669 learned_addr learned my addr 172.21.15.114:0/3896590669 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:02.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.530+0000 7f63a543a700 1 --2- 172.21.15.114:0/3896590669 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63a00b0f90 0x7f63a0154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:02.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.530+0000 7f63a4c39700 1 -- 172.21.15.114:0/3896590669 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63a00b0f90 msgr2=0x7f63a0154770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:02.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.530+0000 7f63a4c39700 1 --2- 172.21.15.114:0/3896590669 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63a00b0f90 0x7f63a0154770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:02.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.530+0000 7f63a5c3b700 1 --2- 172.21.15.114:0/3896590669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63a015bf00 0x7f63a0142c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:02.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.530+0000 7f63a4c39700 1 -- 172.21.15.114:0/3896590669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63a015bf00 msgr2=0x7f63a0142c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:02.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.530+0000 7f63a4c39700 1 --2- 172.21.15.114:0/3896590669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63a015bf00 0x7f63a0142c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:02.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.530+0000 7f63a4c39700 1 -- 172.21.15.114:0/3896590669 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6390009570 con 0x7f63a0155420 2023-10-18T12:20:02.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.530+0000 7f63a543a700 1 --2- 172.21.15.114:0/3896590669 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63a00b0f90 0x7f63a0154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:20:02.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.530+0000 7f63a5c3b700 1 --2- 172.21.15.114:0/3896590669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63a015bf00 0x7f63a0142c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:20:02.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.530+0000 7f63a4c39700 1 --2- 172.21.15.114:0/3896590669 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63a0155420 0x7f63a0142730 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f63a006afc0 tx=0x7f6390004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:02.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.530+0000 7f6395ffb700 1 -- 172.21.15.114:0/3896590669 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6390004520 con 0x7f63a0155420 2023-10-18T12:20:02.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.530+0000 7f6395ffb700 1 -- 172.21.15.114:0/3896590669 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f639001f070 con 0x7f63a0155420 2023-10-18T12:20:02.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.530+0000 7f6395ffb700 1 -- 172.21.15.114:0/3896590669 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6390003900 con 0x7f63a0155420 2023-10-18T12:20:02.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.530+0000 7f63a769e700 1 -- 172.21.15.114:0/3896590669 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63a0131450 con 0x7f63a0155420 2023-10-18T12:20:02.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.530+0000 7f63a769e700 1 -- 172.21.15.114:0/3896590669 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63a01f18e0 con 0x7f63a0155420 2023-10-18T12:20:02.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.534+0000 7f63a769e700 1 -- 172.21.15.114:0/3896590669 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63a0072e60 con 0x7f63a0155420 2023-10-18T12:20:02.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.534+0000 7f6395ffb700 1 -- 172.21.15.114:0/3896590669 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f6390003a60 con 0x7f63a0155420 2023-10-18T12:20:02.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.538+0000 7f6395ffb700 1 --2- 172.21.15.114:0/3896590669 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6384065720 0x7f6384067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:02.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.538+0000 7f6395ffb700 1 -- 172.21.15.114:0/3896590669 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6390021070 con 0x7f63a0155420 2023-10-18T12:20:02.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.538+0000 7f63a543a700 1 --2- 172.21.15.114:0/3896590669 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6384065720 0x7f6384067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:02.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.538+0000 7f63a543a700 1 --2- 172.21.15.114:0/3896590669 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6384065720 0x7f6384067be0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f63a0141a40 tx=0x7f639c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:02.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.542+0000 7f6395ffb700 1 -- 172.21.15.114:0/3896590669 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f6390051e40 con 0x7f63a0155420 2023-10-18T12:20:02.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.722+0000 7f63a769e700 1 -- 172.21.15.114:0/3896590669 --> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f63a0131000 con 0x7f6384065720 2023-10-18T12:20:02.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.742+0000 7f6395ffb700 1 -- 172.21.15.114:0/3896590669 <== mgr.4108 v2:172.21.15.172:6832/461408666 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367182 (secure 0 0 0) 0x7f63a0131000 con 0x7f6384065720 2023-10-18T12:20:02.753 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:20:02.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.750+0000 7f63a769e700 1 -- 172.21.15.114:0/3896590669 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6384065720 msgr2=0x7f6384067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:02.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.750+0000 7f63a769e700 1 --2- 172.21.15.114:0/3896590669 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6384065720 0x7f6384067be0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f63a0141a40 tx=0x7f639c008040 comp rx=0 tx=0).stop 2023-10-18T12:20:02.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.750+0000 7f63a769e700 1 -- 172.21.15.114:0/3896590669 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63a0155420 msgr2=0x7f63a0142730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:02.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.750+0000 7f63a769e700 1 --2- 172.21.15.114:0/3896590669 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63a0155420 0x7f63a0142730 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f63a006afc0 tx=0x7f6390004770 comp rx=0 tx=0).stop 2023-10-18T12:20:02.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.750+0000 7f63a769e700 1 -- 172.21.15.114:0/3896590669 shutdown_connections 2023-10-18T12:20:02.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.750+0000 7f63a769e700 1 --2- 172.21.15.114:0/3896590669 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6384065720 0x7f6384067be0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:02.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.750+0000 7f63a769e700 1 --2- 172.21.15.114:0/3896590669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63a015bf00 0x7f63a0142c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:02.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.750+0000 7f63a769e700 1 --2- 172.21.15.114:0/3896590669 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63a0155420 0x7f63a0142730 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:02.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.750+0000 7f63a769e700 1 --2- 172.21.15.114:0/3896590669 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63a00b0f90 0x7f63a0154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:02.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.750+0000 7f63a769e700 1 -- 172.21.15.114:0/3896590669 >> 172.21.15.114:0/3896590669 conn(0x7f63a006a340 msgr2=0x7f63a00cdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:02.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.754+0000 7f63a769e700 1 -- 172.21.15.114:0/3896590669 shutdown_connections 2023-10-18T12:20:02.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.754+0000 7f63a769e700 1 -- 172.21.15.114:0/3896590669 wait complete. 2023-10-18T12:20:02.759 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2023-10-18T12:20:02.777 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2023-10-18T12:20:00.961079+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594866,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219744,"kb_used_data":3592,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754976,"statfs":{"total":773094113280,"available":772869095424,"internally_reserved":0,"allocated":3678208,"data_stored":2186308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2088,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004754"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.644127+0000","last_change":"2023-10-18T12:19:43.671541+0000","last_active":"2023-10-18T12:19:44.644127+0000","last_peered":"2023-10-18T12:19:44.644127+0000","last_clean":"2023-10-18T12:19:44.644127+0000","last_became_active":"2023-10-18T12:19:43.671125+0000","last_became_peered":"2023-10-18T12:19:43.671125+0000","last_unstale":"2023-10-18T12:19:44.644127+0000","last_undegraded":"2023-10-18T12:19:44.644127+0000","last_fullsized":"2023-10-18T12:19:44.644127+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:18:29.969594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696898+0000","last_change":"2023-10-18T12:19:38.598603+0000","last_active":"2023-10-18T12:19:44.696898+0000","last_peered":"2023-10-18T12:19:44.696898+0000","last_clean":"2023-10-18T12:19:44.696898+0000","last_became_active":"2023-10-18T12:19:38.598010+0000","last_became_peered":"2023-10-18T12:19:38.598010+0000","last_unstale":"2023-10-18T12:19:44.696898+0000","last_undegraded":"2023-10-18T12:19:44.696898+0000","last_fullsized":"2023-10-18T12:19:44.696898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:32:58.240366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695834+0000","last_change":"2023-10-18T12:19:39.616496+0000","last_active":"2023-10-18T12:19:44.695834+0000","last_peered":"2023-10-18T12:19:44.695834+0000","last_clean":"2023-10-18T12:19:44.695834+0000","last_became_active":"2023-10-18T12:19:39.615133+0000","last_became_peered":"2023-10-18T12:19:39.615133+0000","last_unstale":"2023-10-18T12:19:44.695834+0000","last_undegraded":"2023-10-18T12:19:44.695834+0000","last_fullsized":"2023-10-18T12:19:44.695834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:20:49.513519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695684+0000","last_change":"2023-10-18T12:19:43.666992+0000","last_active":"2023-10-18T12:19:44.695684+0000","last_peered":"2023-10-18T12:19:44.695684+0000","last_clean":"2023-10-18T12:19:44.695684+0000","last_became_active":"2023-10-18T12:19:43.666294+0000","last_became_peered":"2023-10-18T12:19:43.666294+0000","last_unstale":"2023-10-18T12:19:44.695684+0000","last_undegraded":"2023-10-18T12:19:44.695684+0000","last_fullsized":"2023-10-18T12:19:44.695684+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:22:06.215999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645491+0000","last_change":"2023-10-18T12:19:38.593588+0000","last_active":"2023-10-18T12:19:44.645491+0000","last_peered":"2023-10-18T12:19:44.645491+0000","last_clean":"2023-10-18T12:19:44.645491+0000","last_became_active":"2023-10-18T12:19:38.592964+0000","last_became_peered":"2023-10-18T12:19:38.592964+0000","last_unstale":"2023-10-18T12:19:44.645491+0000","last_undegraded":"2023-10-18T12:19:44.645491+0000","last_fullsized":"2023-10-18T12:19:44.645491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:43:42.560410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.644558+0000","last_change":"2023-10-18T12:19:39.607852+0000","last_active":"2023-10-18T12:19:44.644558+0000","last_peered":"2023-10-18T12:19:44.644558+0000","last_clean":"2023-10-18T12:19:44.644558+0000","last_became_active":"2023-10-18T12:19:39.603891+0000","last_became_peered":"2023-10-18T12:19:39.603891+0000","last_unstale":"2023-10-18T12:19:44.644558+0000","last_undegraded":"2023-10-18T12:19:44.644558+0000","last_fullsized":"2023-10-18T12:19:44.644558+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:34:44.895130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696905+0000","last_change":"2023-10-18T12:19:43.675386+0000","last_active":"2023-10-18T12:19:44.696905+0000","last_peered":"2023-10-18T12:19:44.696905+0000","last_clean":"2023-10-18T12:19:44.696905+0000","last_became_active":"2023-10-18T12:19:43.675017+0000","last_became_peered":"2023-10-18T12:19:43.675017+0000","last_unstale":"2023-10-18T12:19:44.696905+0000","last_undegraded":"2023-10-18T12:19:44.696905+0000","last_fullsized":"2023-10-18T12:19:44.696905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:32:33.537768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698148+0000","last_change":"2023-10-18T12:19:38.608909+0000","last_active":"2023-10-18T12:19:44.698148+0000","last_peered":"2023-10-18T12:19:44.698148+0000","last_clean":"2023-10-18T12:19:44.698148+0000","last_became_active":"2023-10-18T12:19:38.608524+0000","last_became_peered":"2023-10-18T12:19:38.608524+0000","last_unstale":"2023-10-18T12:19:44.698148+0000","last_undegraded":"2023-10-18T12:19:44.698148+0000","last_fullsized":"2023-10-18T12:19:44.698148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:05:31.346619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697032+0000","last_change":"2023-10-18T12:19:39.619005+0000","last_active":"2023-10-18T12:19:44.697032+0000","last_peered":"2023-10-18T12:19:44.697032+0000","last_clean":"2023-10-18T12:19:44.697032+0000","last_became_active":"2023-10-18T12:19:39.618668+0000","last_became_peered":"2023-10-18T12:19:39.618668+0000","last_unstale":"2023-10-18T12:19:44.697032+0000","last_undegraded":"2023-10-18T12:19:44.697032+0000","last_fullsized":"2023-10-18T12:19:44.697032+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:09:08.461295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.642816+0000","last_change":"2023-10-18T12:19:43.668706+0000","last_active":"2023-10-18T12:19:44.642816+0000","last_peered":"2023-10-18T12:19:44.642816+0000","last_clean":"2023-10-18T12:19:44.642816+0000","last_became_active":"2023-10-18T12:19:43.667712+0000","last_became_peered":"2023-10-18T12:19:43.667712+0000","last_unstale":"2023-10-18T12:19:44.642816+0000","last_undegraded":"2023-10-18T12:19:44.642816+0000","last_fullsized":"2023-10-18T12:19:44.642816+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:59:50.719856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698543+0000","last_change":"2023-10-18T12:19:38.612065+0000","last_active":"2023-10-18T12:19:44.698543+0000","last_peered":"2023-10-18T12:19:44.698543+0000","last_clean":"2023-10-18T12:19:44.698543+0000","last_became_active":"2023-10-18T12:19:38.611721+0000","last_became_peered":"2023-10-18T12:19:38.611721+0000","last_unstale":"2023-10-18T12:19:44.698543+0000","last_undegraded":"2023-10-18T12:19:44.698543+0000","last_fullsized":"2023-10-18T12:19:44.698543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:36:40.183265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698329+0000","last_change":"2023-10-18T12:19:39.620814+0000","last_active":"2023-10-18T12:19:44.698329+0000","last_peered":"2023-10-18T12:19:44.698329+0000","last_clean":"2023-10-18T12:19:44.698329+0000","last_became_active":"2023-10-18T12:19:39.620615+0000","last_became_peered":"2023-10-18T12:19:39.620615+0000","last_unstale":"2023-10-18T12:19:44.698329+0000","last_undegraded":"2023-10-18T12:19:44.698329+0000","last_fullsized":"2023-10-18T12:19:44.698329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:33:13.475249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645822+0000","last_change":"2023-10-18T12:19:43.674472+0000","last_active":"2023-10-18T12:19:44.645822+0000","last_peered":"2023-10-18T12:19:44.645822+0000","last_clean":"2023-10-18T12:19:44.645822+0000","last_became_active":"2023-10-18T12:19:43.673978+0000","last_became_peered":"2023-10-18T12:19:43.673978+0000","last_unstale":"2023-10-18T12:19:44.645822+0000","last_undegraded":"2023-10-18T12:19:44.645822+0000","last_fullsized":"2023-10-18T12:19:44.645822+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:09:05.460432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696271+0000","last_change":"2023-10-18T12:19:38.606249+0000","last_active":"2023-10-18T12:19:44.696271+0000","last_peered":"2023-10-18T12:19:44.696271+0000","last_clean":"2023-10-18T12:19:44.696271+0000","last_became_active":"2023-10-18T12:19:38.605978+0000","last_became_peered":"2023-10-18T12:19:38.605978+0000","last_unstale":"2023-10-18T12:19:44.696271+0000","last_undegraded":"2023-10-18T12:19:44.696271+0000","last_fullsized":"2023-10-18T12:19:44.696271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:01:12.525756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697183+0000","last_change":"2023-10-18T12:19:39.601641+0000","last_active":"2023-10-18T12:19:44.697183+0000","last_peered":"2023-10-18T12:19:44.697183+0000","last_clean":"2023-10-18T12:19:44.697183+0000","last_became_active":"2023-10-18T12:19:39.601275+0000","last_became_peered":"2023-10-18T12:19:39.601275+0000","last_unstale":"2023-10-18T12:19:44.697183+0000","last_undegraded":"2023-10-18T12:19:44.697183+0000","last_fullsized":"2023-10-18T12:19:44.697183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:43:39.713506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.699565+0000","last_change":"2023-10-18T12:19:43.665457+0000","last_active":"2023-10-18T12:19:44.699565+0000","last_peered":"2023-10-18T12:19:44.699565+0000","last_clean":"2023-10-18T12:19:44.699565+0000","last_became_active":"2023-10-18T12:19:43.665040+0000","last_became_peered":"2023-10-18T12:19:43.665040+0000","last_unstale":"2023-10-18T12:19:44.699565+0000","last_undegraded":"2023-10-18T12:19:44.699565+0000","last_fullsized":"2023-10-18T12:19:44.699565+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:45:20.383309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697555+0000","last_change":"2023-10-18T12:19:38.605141+0000","last_active":"2023-10-18T12:19:44.697555+0000","last_peered":"2023-10-18T12:19:44.697555+0000","last_clean":"2023-10-18T12:19:44.697555+0000","last_became_active":"2023-10-18T12:19:38.602562+0000","last_became_peered":"2023-10-18T12:19:38.602562+0000","last_unstale":"2023-10-18T12:19:44.697555+0000","last_undegraded":"2023-10-18T12:19:44.697555+0000","last_fullsized":"2023-10-18T12:19:44.697555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:27:56.749766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.646701+0000","last_change":"2023-10-18T12:19:39.610888+0000","last_active":"2023-10-18T12:19:44.646701+0000","last_peered":"2023-10-18T12:19:44.646701+0000","last_clean":"2023-10-18T12:19:44.646701+0000","last_became_active":"2023-10-18T12:19:39.610423+0000","last_became_peered":"2023-10-18T12:19:39.610423+0000","last_unstale":"2023-10-18T12:19:44.646701+0000","last_undegraded":"2023-10-18T12:19:44.646701+0000","last_fullsized":"2023-10-18T12:19:44.646701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:05:32.356553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698846+0000","last_change":"2023-10-18T12:19:43.660927+0000","last_active":"2023-10-18T12:19:44.698846+0000","last_peered":"2023-10-18T12:19:44.698846+0000","last_clean":"2023-10-18T12:19:44.698846+0000","last_became_active":"2023-10-18T12:19:43.660484+0000","last_became_peered":"2023-10-18T12:19:43.660484+0000","last_unstale":"2023-10-18T12:19:44.698846+0000","last_undegraded":"2023-10-18T12:19:44.698846+0000","last_fullsized":"2023-10-18T12:19:44.698846+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:23:40.463847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645234+0000","last_change":"2023-10-18T12:19:38.605794+0000","last_active":"2023-10-18T12:19:44.645234+0000","last_peered":"2023-10-18T12:19:44.645234+0000","last_clean":"2023-10-18T12:19:44.645234+0000","last_became_active":"2023-10-18T12:19:38.605484+0000","last_became_peered":"2023-10-18T12:19:38.605484+0000","last_unstale":"2023-10-18T12:19:44.645234+0000","last_undegraded":"2023-10-18T12:19:44.645234+0000","last_fullsized":"2023-10-18T12:19:44.645234+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:59:45.652080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696594+0000","last_change":"2023-10-18T12:19:39.611319+0000","last_active":"2023-10-18T12:19:44.696594+0000","last_peered":"2023-10-18T12:19:44.696594+0000","last_clean":"2023-10-18T12:19:44.696594+0000","last_became_active":"2023-10-18T12:19:39.610259+0000","last_became_peered":"2023-10-18T12:19:39.610259+0000","last_unstale":"2023-10-18T12:19:44.696594+0000","last_undegraded":"2023-10-18T12:19:44.696594+0000","last_fullsized":"2023-10-18T12:19:44.696594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:32:29.479925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696566+0000","last_change":"2023-10-18T12:19:43.660372+0000","last_active":"2023-10-18T12:19:44.696566+0000","last_peered":"2023-10-18T12:19:44.696566+0000","last_clean":"2023-10-18T12:19:44.696566+0000","last_became_active":"2023-10-18T12:19:43.659923+0000","last_became_peered":"2023-10-18T12:19:43.659923+0000","last_unstale":"2023-10-18T12:19:44.696566+0000","last_undegraded":"2023-10-18T12:19:44.696566+0000","last_fullsized":"2023-10-18T12:19:44.696566+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:18:29.969594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643863+0000","last_change":"2023-10-18T12:19:38.600796+0000","last_active":"2023-10-18T12:19:44.643863+0000","last_peered":"2023-10-18T12:19:44.643863+0000","last_clean":"2023-10-18T12:19:44.643863+0000","last_became_active":"2023-10-18T12:19:38.599899+0000","last_became_peered":"2023-10-18T12:19:38.599899+0000","last_unstale":"2023-10-18T12:19:44.643863+0000","last_undegraded":"2023-10-18T12:19:44.643863+0000","last_fullsized":"2023-10-18T12:19:44.643863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:01:12.525756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.699060+0000","last_change":"2023-10-18T12:19:39.607533+0000","last_active":"2023-10-18T12:19:44.699060+0000","last_peered":"2023-10-18T12:19:44.699060+0000","last_clean":"2023-10-18T12:19:44.699060+0000","last_became_active":"2023-10-18T12:19:39.604286+0000","last_became_peered":"2023-10-18T12:19:39.604286+0000","last_unstale":"2023-10-18T12:19:44.699060+0000","last_undegraded":"2023-10-18T12:19:44.699060+0000","last_fullsized":"2023-10-18T12:19:44.699060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:30:22.876433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643667+0000","last_change":"2023-10-18T12:19:39.621418+0000","last_active":"2023-10-18T12:19:44.643667+0000","last_peered":"2023-10-18T12:19:44.643667+0000","last_clean":"2023-10-18T12:19:44.643667+0000","last_became_active":"2023-10-18T12:19:39.621162+0000","last_became_peered":"2023-10-18T12:19:39.621162+0000","last_unstale":"2023-10-18T12:19:44.643667+0000","last_undegraded":"2023-10-18T12:19:44.643667+0000","last_fullsized":"2023-10-18T12:19:44.643667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:31:24.099669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697070+0000","last_change":"2023-10-18T12:19:38.602741+0000","last_active":"2023-10-18T12:19:44.697070+0000","last_peered":"2023-10-18T12:19:44.697070+0000","last_clean":"2023-10-18T12:19:44.697070+0000","last_became_active":"2023-10-18T12:19:38.598808+0000","last_became_peered":"2023-10-18T12:19:38.598808+0000","last_unstale":"2023-10-18T12:19:44.697070+0000","last_undegraded":"2023-10-18T12:19:44.697070+0000","last_fullsized":"2023-10-18T12:19:44.697070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:09:00.392656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697485+0000","last_change":"2023-10-18T12:19:43.662507+0000","last_active":"2023-10-18T12:19:44.697485+0000","last_peered":"2023-10-18T12:19:44.697485+0000","last_clean":"2023-10-18T12:19:44.697485+0000","last_became_active":"2023-10-18T12:19:43.662090+0000","last_became_peered":"2023-10-18T12:19:43.662090+0000","last_unstale":"2023-10-18T12:19:44.697485+0000","last_undegraded":"2023-10-18T12:19:44.697485+0000","last_fullsized":"2023-10-18T12:19:44.697485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:36:54.990254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.644101+0000","last_change":"2023-10-18T12:19:39.612100+0000","last_active":"2023-10-18T12:19:44.644101+0000","last_peered":"2023-10-18T12:19:44.644101+0000","last_clean":"2023-10-18T12:19:44.644101+0000","last_became_active":"2023-10-18T12:19:39.611788+0000","last_became_peered":"2023-10-18T12:19:39.611788+0000","last_unstale":"2023-10-18T12:19:44.644101+0000","last_undegraded":"2023-10-18T12:19:44.644101+0000","last_fullsized":"2023-10-18T12:19:44.644101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:18:25.911752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697553+0000","last_change":"2023-10-18T12:19:38.609638+0000","last_active":"2023-10-18T12:19:44.697553+0000","last_peered":"2023-10-18T12:19:44.697553+0000","last_clean":"2023-10-18T12:19:44.697553+0000","last_became_active":"2023-10-18T12:19:38.609318+0000","last_became_peered":"2023-10-18T12:19:38.609318+0000","last_unstale":"2023-10-18T12:19:44.697553+0000","last_undegraded":"2023-10-18T12:19:44.697553+0000","last_fullsized":"2023-10-18T12:19:44.697553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:58:15.868092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.641909+0000","last_change":"2023-10-18T12:19:43.668265+0000","last_active":"2023-10-18T12:19:44.641909+0000","last_peered":"2023-10-18T12:19:44.641909+0000","last_clean":"2023-10-18T12:19:44.641909+0000","last_became_active":"2023-10-18T12:19:43.667706+0000","last_became_peered":"2023-10-18T12:19:43.667706+0000","last_unstale":"2023-10-18T12:19:44.641909+0000","last_undegraded":"2023-10-18T12:19:44.641909+0000","last_fullsized":"2023-10-18T12:19:44.641909+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:49:04.109094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643379+0000","last_change":"2023-10-18T12:19:38.601819+0000","last_active":"2023-10-18T12:19:44.643379+0000","last_peered":"2023-10-18T12:19:44.643379+0000","last_clean":"2023-10-18T12:19:44.643379+0000","last_became_active":"2023-10-18T12:19:38.601414+0000","last_became_peered":"2023-10-18T12:19:38.601414+0000","last_unstale":"2023-10-18T12:19:44.643379+0000","last_undegraded":"2023-10-18T12:19:44.643379+0000","last_fullsized":"2023-10-18T12:19:44.643379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:43:42.560410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645163+0000","last_change":"2023-10-18T12:19:39.601170+0000","last_active":"2023-10-18T12:19:44.645163+0000","last_peered":"2023-10-18T12:19:44.645163+0000","last_clean":"2023-10-18T12:19:44.645163+0000","last_became_active":"2023-10-18T12:19:39.600901+0000","last_became_peered":"2023-10-18T12:19:39.600901+0000","last_unstale":"2023-10-18T12:19:44.645163+0000","last_undegraded":"2023-10-18T12:19:44.645163+0000","last_fullsized":"2023-10-18T12:19:44.645163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:23:37.730513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.644364+0000","last_change":"2023-10-18T12:19:43.668816+0000","last_active":"2023-10-18T12:19:44.644364+0000","last_peered":"2023-10-18T12:19:44.644364+0000","last_clean":"2023-10-18T12:19:44.644364+0000","last_became_active":"2023-10-18T12:19:43.668451+0000","last_became_peered":"2023-10-18T12:19:43.668451+0000","last_unstale":"2023-10-18T12:19:44.644364+0000","last_undegraded":"2023-10-18T12:19:44.644364+0000","last_fullsized":"2023-10-18T12:19:44.644364+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:32:33.537768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"28'8","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:50.107134+0000","last_change":"2023-10-18T12:19:38.605016+0000","last_active":"2023-10-18T12:19:50.107134+0000","last_peered":"2023-10-18T12:19:50.107134+0000","last_clean":"2023-10-18T12:19:50.107134+0000","last_became_active":"2023-10-18T12:19:38.604703+0000","last_became_peered":"2023-10-18T12:19:38.604703+0000","last_unstale":"2023-10-18T12:19:50.107134+0000","last_undegraded":"2023-10-18T12:19:50.107134+0000","last_fullsized":"2023-10-18T12:19:50.107134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:02:17.952362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3700,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698575+0000","last_change":"2023-10-18T12:19:39.615377+0000","last_active":"2023-10-18T12:19:44.698575+0000","last_peered":"2023-10-18T12:19:44.698575+0000","last_clean":"2023-10-18T12:19:44.698575+0000","last_became_active":"2023-10-18T12:19:39.610424+0000","last_became_peered":"2023-10-18T12:19:39.610424+0000","last_unstale":"2023-10-18T12:19:44.698575+0000","last_undegraded":"2023-10-18T12:19:44.698575+0000","last_fullsized":"2023-10-18T12:19:44.698575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:28:58.787021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645013+0000","last_change":"2023-10-18T12:19:43.680946+0000","last_active":"2023-10-18T12:19:44.645013+0000","last_peered":"2023-10-18T12:19:44.645013+0000","last_clean":"2023-10-18T12:19:44.645013+0000","last_became_active":"2023-10-18T12:19:43.680542+0000","last_became_peered":"2023-10-18T12:19:43.680542+0000","last_unstale":"2023-10-18T12:19:44.645013+0000","last_undegraded":"2023-10-18T12:19:44.645013+0000","last_fullsized":"2023-10-18T12:19:44.645013+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:32:33.537768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696164+0000","last_change":"2023-10-18T12:19:39.602742+0000","last_active":"2023-10-18T12:19:44.696164+0000","last_peered":"2023-10-18T12:19:44.696164+0000","last_clean":"2023-10-18T12:19:44.696164+0000","last_became_active":"2023-10-18T12:19:39.602504+0000","last_became_peered":"2023-10-18T12:19:39.602504+0000","last_unstale":"2023-10-18T12:19:44.696164+0000","last_undegraded":"2023-10-18T12:19:44.696164+0000","last_fullsized":"2023-10-18T12:19:44.696164+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:55:47.767344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.699228+0000","last_change":"2023-10-18T12:19:33.531672+0000","last_active":"2023-10-18T12:19:44.699228+0000","last_peered":"2023-10-18T12:19:44.699228+0000","last_clean":"2023-10-18T12:19:44.699228+0000","last_became_active":"2023-10-18T12:19:33.530907+0000","last_became_peered":"2023-10-18T12:19:33.530907+0000","last_unstale":"2023-10-18T12:19:44.699228+0000","last_undegraded":"2023-10-18T12:19:44.699228+0000","last_fullsized":"2023-10-18T12:19:44.699228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:22:58.092944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696857+0000","last_change":"2023-10-18T12:19:38.601615+0000","last_active":"2023-10-18T12:19:44.696857+0000","last_peered":"2023-10-18T12:19:44.696857+0000","last_clean":"2023-10-18T12:19:44.696857+0000","last_became_active":"2023-10-18T12:19:38.601084+0000","last_became_peered":"2023-10-18T12:19:38.601084+0000","last_unstale":"2023-10-18T12:19:44.696857+0000","last_undegraded":"2023-10-18T12:19:44.696857+0000","last_fullsized":"2023-10-18T12:19:44.696857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:34:43.885197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643565+0000","last_change":"2023-10-18T12:19:43.679066+0000","last_active":"2023-10-18T12:19:44.643565+0000","last_peered":"2023-10-18T12:19:44.643565+0000","last_clean":"2023-10-18T12:19:44.643565+0000","last_became_active":"2023-10-18T12:19:43.673105+0000","last_became_peered":"2023-10-18T12:19:43.673105+0000","last_unstale":"2023-10-18T12:19:44.643565+0000","last_undegraded":"2023-10-18T12:19:44.643565+0000","last_fullsized":"2023-10-18T12:19:44.643565+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:25:02.951956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643788+0000","last_change":"2023-10-18T12:19:39.620976+0000","last_active":"2023-10-18T12:19:44.643788+0000","last_peered":"2023-10-18T12:19:44.643788+0000","last_clean":"2023-10-18T12:19:44.643788+0000","last_became_active":"2023-10-18T12:19:39.620577+0000","last_became_peered":"2023-10-18T12:19:39.620577+0000","last_unstale":"2023-10-18T12:19:44.643788+0000","last_undegraded":"2023-10-18T12:19:44.643788+0000","last_fullsized":"2023-10-18T12:19:44.643788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:49:00.051251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.646821+0000","last_change":"2023-10-18T12:19:33.529329+0000","last_active":"2023-10-18T12:19:44.646821+0000","last_peered":"2023-10-18T12:19:44.646821+0000","last_clean":"2023-10-18T12:19:44.646821+0000","last_became_active":"2023-10-18T12:19:33.528930+0000","last_became_peered":"2023-10-18T12:19:33.528930+0000","last_unstale":"2023-10-18T12:19:44.646821+0000","last_undegraded":"2023-10-18T12:19:44.646821+0000","last_fullsized":"2023-10-18T12:19:44.646821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:59:29.698792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.646312+0000","last_change":"2023-10-18T12:19:38.602384+0000","last_active":"2023-10-18T12:19:44.646312+0000","last_peered":"2023-10-18T12:19:44.646312+0000","last_clean":"2023-10-18T12:19:44.646312+0000","last_became_active":"2023-10-18T12:19:38.602036+0000","last_became_peered":"2023-10-18T12:19:38.602036+0000","last_unstale":"2023-10-18T12:19:44.646312+0000","last_undegraded":"2023-10-18T12:19:44.646312+0000","last_fullsized":"2023-10-18T12:19:44.646312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:31:40.396673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695771+0000","last_change":"2023-10-18T12:19:43.665880+0000","last_active":"2023-10-18T12:19:44.695771+0000","last_peered":"2023-10-18T12:19:44.695771+0000","last_clean":"2023-10-18T12:19:44.695771+0000","last_became_active":"2023-10-18T12:19:43.665304+0000","last_became_peered":"2023-10-18T12:19:43.665304+0000","last_unstale":"2023-10-18T12:19:44.695771+0000","last_undegraded":"2023-10-18T12:19:44.695771+0000","last_fullsized":"2023-10-18T12:19:44.695771+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:41:00.366869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696091+0000","last_change":"2023-10-18T12:19:39.610495+0000","last_active":"2023-10-18T12:19:44.696091+0000","last_peered":"2023-10-18T12:19:44.696091+0000","last_clean":"2023-10-18T12:19:44.696091+0000","last_became_active":"2023-10-18T12:19:39.610070+0000","last_became_peered":"2023-10-18T12:19:39.610070+0000","last_unstale":"2023-10-18T12:19:44.696091+0000","last_undegraded":"2023-10-18T12:19:44.696091+0000","last_fullsized":"2023-10-18T12:19:44.696091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:49:00.051251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643554+0000","last_change":"2023-10-18T12:19:33.703565+0000","last_active":"2023-10-18T12:19:44.643554+0000","last_peered":"2023-10-18T12:19:44.643554+0000","last_clean":"2023-10-18T12:19:44.643554+0000","last_became_active":"2023-10-18T12:19:33.703276+0000","last_became_peered":"2023-10-18T12:19:33.703276+0000","last_unstale":"2023-10-18T12:19:44.643554+0000","last_undegraded":"2023-10-18T12:19:44.643554+0000","last_fullsized":"2023-10-18T12:19:44.643554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:42:02.281340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645909+0000","last_change":"2023-10-18T12:19:38.596831+0000","last_active":"2023-10-18T12:19:44.645909+0000","last_peered":"2023-10-18T12:19:44.645909+0000","last_clean":"2023-10-18T12:19:44.645909+0000","last_became_active":"2023-10-18T12:19:38.595274+0000","last_became_peered":"2023-10-18T12:19:38.595274+0000","last_unstale":"2023-10-18T12:19:44.645909+0000","last_undegraded":"2023-10-18T12:19:44.645909+0000","last_fullsized":"2023-10-18T12:19:44.645909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:43:42.560410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697865+0000","last_change":"2023-10-18T12:19:43.684545+0000","last_active":"2023-10-18T12:19:44.697865+0000","last_peered":"2023-10-18T12:19:44.697865+0000","last_clean":"2023-10-18T12:19:44.697865+0000","last_became_active":"2023-10-18T12:19:43.684147+0000","last_became_peered":"2023-10-18T12:19:43.684147+0000","last_unstale":"2023-10-18T12:19:44.697865+0000","last_undegraded":"2023-10-18T12:19:44.697865+0000","last_fullsized":"2023-10-18T12:19:44.697865+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:35:30.070714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645280+0000","last_change":"2023-10-18T12:19:39.611289+0000","last_active":"2023-10-18T12:19:44.645280+0000","last_peered":"2023-10-18T12:19:44.645280+0000","last_clean":"2023-10-18T12:19:44.645280+0000","last_became_active":"2023-10-18T12:19:39.610978+0000","last_became_peered":"2023-10-18T12:19:39.610978+0000","last_unstale":"2023-10-18T12:19:44.645280+0000","last_undegraded":"2023-10-18T12:19:44.645280+0000","last_fullsized":"2023-10-18T12:19:44.645280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:34:44.895130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.646099+0000","last_change":"2023-10-18T12:19:33.703109+0000","last_active":"2023-10-18T12:19:44.646099+0000","last_peered":"2023-10-18T12:19:44.646099+0000","last_clean":"2023-10-18T12:19:44.646099+0000","last_became_active":"2023-10-18T12:19:33.702456+0000","last_became_peered":"2023-10-18T12:19:33.702456+0000","last_unstale":"2023-10-18T12:19:44.646099+0000","last_undegraded":"2023-10-18T12:19:44.646099+0000","last_fullsized":"2023-10-18T12:19:44.646099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:31:35.345173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698372+0000","last_change":"2023-10-18T12:19:38.608530+0000","last_active":"2023-10-18T12:19:44.698372+0000","last_peered":"2023-10-18T12:19:44.698372+0000","last_clean":"2023-10-18T12:19:44.698372+0000","last_became_active":"2023-10-18T12:19:38.608220+0000","last_became_peered":"2023-10-18T12:19:38.608220+0000","last_unstale":"2023-10-18T12:19:44.698372+0000","last_undegraded":"2023-10-18T12:19:44.698372+0000","last_fullsized":"2023-10-18T12:19:44.698372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:18:53.495055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695872+0000","last_change":"2023-10-18T12:19:43.675239+0000","last_active":"2023-10-18T12:19:44.695872+0000","last_peered":"2023-10-18T12:19:44.695872+0000","last_clean":"2023-10-18T12:19:44.695872+0000","last_became_active":"2023-10-18T12:19:43.674815+0000","last_became_peered":"2023-10-18T12:19:43.674815+0000","last_unstale":"2023-10-18T12:19:44.695872+0000","last_undegraded":"2023-10-18T12:19:44.695872+0000","last_fullsized":"2023-10-18T12:19:44.695872+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:31:28.157512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645878+0000","last_change":"2023-10-18T12:19:39.603090+0000","last_active":"2023-10-18T12:19:44.645878+0000","last_peered":"2023-10-18T12:19:44.645878+0000","last_clean":"2023-10-18T12:19:44.645878+0000","last_became_active":"2023-10-18T12:19:39.602663+0000","last_became_peered":"2023-10-18T12:19:39.602663+0000","last_unstale":"2023-10-18T12:19:44.645878+0000","last_undegraded":"2023-10-18T12:19:44.645878+0000","last_fullsized":"2023-10-18T12:19:44.645878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:38:42.744745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698813+0000","last_change":"2023-10-18T12:19:38.605786+0000","last_active":"2023-10-18T12:19:44.698813+0000","last_peered":"2023-10-18T12:19:44.698813+0000","last_clean":"2023-10-18T12:19:44.698813+0000","last_became_active":"2023-10-18T12:19:38.605372+0000","last_became_peered":"2023-10-18T12:19:38.605372+0000","last_unstale":"2023-10-18T12:19:44.698813+0000","last_undegraded":"2023-10-18T12:19:44.698813+0000","last_fullsized":"2023-10-18T12:19:44.698813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:50:26.536151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696981+0000","last_change":"2023-10-18T12:19:33.533449+0000","last_active":"2023-10-18T12:19:44.696981+0000","last_peered":"2023-10-18T12:19:44.696981+0000","last_clean":"2023-10-18T12:19:44.696981+0000","last_became_active":"2023-10-18T12:19:33.533051+0000","last_became_peered":"2023-10-18T12:19:33.533051+0000","last_unstale":"2023-10-18T12:19:44.696981+0000","last_undegraded":"2023-10-18T12:19:44.696981+0000","last_fullsized":"2023-10-18T12:19:44.696981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:59:40.600580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696368+0000","last_change":"2023-10-18T12:19:43.667926+0000","last_active":"2023-10-18T12:19:44.696368+0000","last_peered":"2023-10-18T12:19:44.696368+0000","last_clean":"2023-10-18T12:19:44.696368+0000","last_became_active":"2023-10-18T12:19:43.663720+0000","last_became_peered":"2023-10-18T12:19:43.663720+0000","last_unstale":"2023-10-18T12:19:44.696368+0000","last_undegraded":"2023-10-18T12:19:44.696368+0000","last_fullsized":"2023-10-18T12:19:44.696368+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:45.224238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.646131+0000","last_change":"2023-10-18T12:19:39.611317+0000","last_active":"2023-10-18T12:19:44.646131+0000","last_peered":"2023-10-18T12:19:44.646131+0000","last_clean":"2023-10-18T12:19:44.646131+0000","last_became_active":"2023-10-18T12:19:39.610493+0000","last_became_peered":"2023-10-18T12:19:39.610493+0000","last_unstale":"2023-10-18T12:19:44.646131+0000","last_undegraded":"2023-10-18T12:19:44.646131+0000","last_fullsized":"2023-10-18T12:19:44.646131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:05:32.356553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.644024+0000","last_change":"2023-10-18T12:19:38.600081+0000","last_active":"2023-10-18T12:19:44.644024+0000","last_peered":"2023-10-18T12:19:44.644024+0000","last_clean":"2023-10-18T12:19:44.644024+0000","last_became_active":"2023-10-18T12:19:38.599770+0000","last_became_peered":"2023-10-18T12:19:38.599770+0000","last_unstale":"2023-10-18T12:19:44.644024+0000","last_undegraded":"2023-10-18T12:19:44.644024+0000","last_fullsized":"2023-10-18T12:19:44.644024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:40.156462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.694556+0000","last_change":"2023-10-18T12:19:33.530766+0000","last_active":"2023-10-18T12:19:44.694556+0000","last_peered":"2023-10-18T12:19:44.694556+0000","last_clean":"2023-10-18T12:19:44.694556+0000","last_became_active":"2023-10-18T12:19:33.530346+0000","last_became_peered":"2023-10-18T12:19:33.530346+0000","last_unstale":"2023-10-18T12:19:44.694556+0000","last_undegraded":"2023-10-18T12:19:44.694556+0000","last_fullsized":"2023-10-18T12:19:44.694556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:37:23.298891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697536+0000","last_change":"2023-10-18T12:19:43.670666+0000","last_active":"2023-10-18T12:19:44.697536+0000","last_peered":"2023-10-18T12:19:44.697536+0000","last_clean":"2023-10-18T12:19:44.697536+0000","last_became_active":"2023-10-18T12:19:43.667345+0000","last_became_peered":"2023-10-18T12:19:43.667345+0000","last_unstale":"2023-10-18T12:19:44.697536+0000","last_undegraded":"2023-10-18T12:19:44.697536+0000","last_fullsized":"2023-10-18T12:19:44.697536+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:49:32.050231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696679+0000","last_change":"2023-10-18T12:19:39.619910+0000","last_active":"2023-10-18T12:19:44.696679+0000","last_peered":"2023-10-18T12:19:44.696679+0000","last_clean":"2023-10-18T12:19:44.696679+0000","last_became_active":"2023-10-18T12:19:39.619657+0000","last_became_peered":"2023-10-18T12:19:39.619657+0000","last_unstale":"2023-10-18T12:19:44.696679+0000","last_undegraded":"2023-10-18T12:19:44.696679+0000","last_fullsized":"2023-10-18T12:19:44.696679+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:59:46.662013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695598+0000","last_change":"2023-10-18T12:19:38.605421+0000","last_active":"2023-10-18T12:19:44.695598+0000","last_peered":"2023-10-18T12:19:44.695598+0000","last_clean":"2023-10-18T12:19:44.695598+0000","last_became_active":"2023-10-18T12:19:38.605087+0000","last_became_peered":"2023-10-18T12:19:38.605087+0000","last_unstale":"2023-10-18T12:19:44.695598+0000","last_undegraded":"2023-10-18T12:19:44.695598+0000","last_fullsized":"2023-10-18T12:19:44.695598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:24:57.884181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.642271+0000","last_change":"2023-10-18T12:19:33.528538+0000","last_active":"2023-10-18T12:19:44.642271+0000","last_peered":"2023-10-18T12:19:44.642271+0000","last_clean":"2023-10-18T12:19:44.642271+0000","last_became_active":"2023-10-18T12:19:33.528214+0000","last_became_peered":"2023-10-18T12:19:33.528214+0000","last_unstale":"2023-10-18T12:19:44.642271+0000","last_undegraded":"2023-10-18T12:19:44.642271+0000","last_fullsized":"2023-10-18T12:19:44.642271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:16:35.962010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697181+0000","last_change":"2023-10-18T12:19:43.676292+0000","last_active":"2023-10-18T12:19:44.697181+0000","last_peered":"2023-10-18T12:19:44.697181+0000","last_clean":"2023-10-18T12:19:44.697181+0000","last_became_active":"2023-10-18T12:19:43.674659+0000","last_became_peered":"2023-10-18T12:19:43.674659+0000","last_unstale":"2023-10-18T12:19:44.697181+0000","last_undegraded":"2023-10-18T12:19:44.697181+0000","last_fullsized":"2023-10-18T12:19:44.697181+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:33:03.308142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.699094+0000","last_change":"2023-10-18T12:19:39.623370+0000","last_active":"2023-10-18T12:19:44.699094+0000","last_peered":"2023-10-18T12:19:44.699094+0000","last_clean":"2023-10-18T12:19:44.699094+0000","last_became_active":"2023-10-18T12:19:39.623099+0000","last_became_peered":"2023-10-18T12:19:39.623099+0000","last_unstale":"2023-10-18T12:19:44.699094+0000","last_undegraded":"2023-10-18T12:19:44.699094+0000","last_fullsized":"2023-10-18T12:19:44.699094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:08:54.031805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.644370+0000","last_change":"2023-10-18T12:19:38.601266+0000","last_active":"2023-10-18T12:19:44.644370+0000","last_peered":"2023-10-18T12:19:44.644370+0000","last_clean":"2023-10-18T12:19:44.644370+0000","last_became_active":"2023-10-18T12:19:38.600945+0000","last_became_peered":"2023-10-18T12:19:38.600945+0000","last_unstale":"2023-10-18T12:19:44.644370+0000","last_undegraded":"2023-10-18T12:19:44.644370+0000","last_fullsized":"2023-10-18T12:19:44.644370+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:23:36.720579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697162+0000","last_change":"2023-10-18T12:19:33.531214+0000","last_active":"2023-10-18T12:19:44.697162+0000","last_peered":"2023-10-18T12:19:44.697162+0000","last_clean":"2023-10-18T12:19:44.697162+0000","last_became_active":"2023-10-18T12:19:33.530795+0000","last_became_peered":"2023-10-18T12:19:33.530795+0000","last_unstale":"2023-10-18T12:19:44.697162+0000","last_undegraded":"2023-10-18T12:19:44.697162+0000","last_fullsized":"2023-10-18T12:19:44.697162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:08:55.341156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":181,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.642373+0000","last_change":"2023-10-18T12:19:28.825371+0000","last_active":"2023-10-18T12:19:44.642373+0000","last_peered":"2023-10-18T12:19:44.642373+0000","last_clean":"2023-10-18T12:19:44.642373+0000","last_became_active":"2023-10-18T12:19:28.822484+0000","last_became_peered":"2023-10-18T12:19:28.822484+0000","last_unstale":"2023-10-18T12:19:44.642373+0000","last_undegraded":"2023-10-18T12:19:44.642373+0000","last_fullsized":"2023-10-18T12:19:44.642373+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:27.318899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:27.318899+0000","last_clean_scrub_stamp":"2023-10-18T12:19:27.318899+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:18:14.674282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643196+0000","last_change":"2023-10-18T12:19:43.657137+0000","last_active":"2023-10-18T12:19:44.643196+0000","last_peered":"2023-10-18T12:19:44.643196+0000","last_clean":"2023-10-18T12:19:44.643196+0000","last_became_active":"2023-10-18T12:19:43.656656+0000","last_became_peered":"2023-10-18T12:19:43.656656+0000","last_unstale":"2023-10-18T12:19:44.643196+0000","last_undegraded":"2023-10-18T12:19:44.643196+0000","last_fullsized":"2023-10-18T12:19:44.643196+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:38:46.802588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.646062+0000","last_change":"2023-10-18T12:19:39.616876+0000","last_active":"2023-10-18T12:19:44.646062+0000","last_peered":"2023-10-18T12:19:44.646062+0000","last_clean":"2023-10-18T12:19:44.646062+0000","last_became_active":"2023-10-18T12:19:39.616565+0000","last_became_peered":"2023-10-18T12:19:39.616565+0000","last_unstale":"2023-10-18T12:19:44.646062+0000","last_undegraded":"2023-10-18T12:19:44.646062+0000","last_fullsized":"2023-10-18T12:19:44.646062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:42:08.342773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643925+0000","last_change":"2023-10-18T12:19:38.594539+0000","last_active":"2023-10-18T12:19:44.643925+0000","last_peered":"2023-10-18T12:19:44.643925+0000","last_clean":"2023-10-18T12:19:44.643925+0000","last_became_active":"2023-10-18T12:19:38.594225+0000","last_became_peered":"2023-10-18T12:19:38.594225+0000","last_unstale":"2023-10-18T12:19:44.643925+0000","last_undegraded":"2023-10-18T12:19:44.643925+0000","last_fullsized":"2023-10-18T12:19:44.643925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:16:41.013510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.700323+0000","last_change":"2023-10-18T12:19:43.671582+0000","last_active":"2023-10-18T12:19:44.700323+0000","last_peered":"2023-10-18T12:19:44.700323+0000","last_clean":"2023-10-18T12:19:44.700323+0000","last_became_active":"2023-10-18T12:19:43.671279+0000","last_became_peered":"2023-10-18T12:19:43.671279+0000","last_unstale":"2023-10-18T12:19:44.700323+0000","last_undegraded":"2023-10-18T12:19:44.700323+0000","last_fullsized":"2023-10-18T12:19:44.700323+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:54:13.369092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.700346+0000","last_change":"2023-10-18T12:19:39.624301+0000","last_active":"2023-10-18T12:19:44.700346+0000","last_peered":"2023-10-18T12:19:44.700346+0000","last_clean":"2023-10-18T12:19:44.700346+0000","last_became_active":"2023-10-18T12:19:39.624019+0000","last_became_peered":"2023-10-18T12:19:39.624019+0000","last_unstale":"2023-10-18T12:19:44.700346+0000","last_undegraded":"2023-10-18T12:19:44.700346+0000","last_fullsized":"2023-10-18T12:19:44.700346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:21:14.469134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696174+0000","last_change":"2023-10-18T12:19:38.605246+0000","last_active":"2023-10-18T12:19:44.696174+0000","last_peered":"2023-10-18T12:19:44.696174+0000","last_clean":"2023-10-18T12:19:44.696174+0000","last_became_active":"2023-10-18T12:19:38.604738+0000","last_became_peered":"2023-10-18T12:19:38.604738+0000","last_unstale":"2023-10-18T12:19:44.696174+0000","last_undegraded":"2023-10-18T12:19:44.696174+0000","last_fullsized":"2023-10-18T12:19:44.696174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:00:56.609231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696949+0000","last_change":"2023-10-18T12:19:43.682631+0000","last_active":"2023-10-18T12:19:44.696949+0000","last_peered":"2023-10-18T12:19:44.696949+0000","last_clean":"2023-10-18T12:19:44.696949+0000","last_became_active":"2023-10-18T12:19:43.681887+0000","last_became_peered":"2023-10-18T12:19:43.681887+0000","last_unstale":"2023-10-18T12:19:44.696949+0000","last_undegraded":"2023-10-18T12:19:44.696949+0000","last_fullsized":"2023-10-18T12:19:44.696949+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:23:41.788355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.700050+0000","last_change":"2023-10-18T12:19:39.611350+0000","last_active":"2023-10-18T12:19:44.700050+0000","last_peered":"2023-10-18T12:19:44.700050+0000","last_clean":"2023-10-18T12:19:44.700050+0000","last_became_active":"2023-10-18T12:19:39.610723+0000","last_became_peered":"2023-10-18T12:19:39.610723+0000","last_unstale":"2023-10-18T12:19:44.700050+0000","last_undegraded":"2023-10-18T12:19:44.700050+0000","last_fullsized":"2023-10-18T12:19:44.700050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:06:02.990692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698303+0000","last_change":"2023-10-18T12:19:38.606971+0000","last_active":"2023-10-18T12:19:44.698303+0000","last_peered":"2023-10-18T12:19:44.698303+0000","last_clean":"2023-10-18T12:19:44.698303+0000","last_became_active":"2023-10-18T12:19:38.606625+0000","last_became_peered":"2023-10-18T12:19:38.606625+0000","last_unstale":"2023-10-18T12:19:44.698303+0000","last_undegraded":"2023-10-18T12:19:44.698303+0000","last_fullsized":"2023-10-18T12:19:44.698303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:28:59.066223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645449+0000","last_change":"2023-10-18T12:19:43.674060+0000","last_active":"2023-10-18T12:19:44.645449+0000","last_peered":"2023-10-18T12:19:44.645449+0000","last_clean":"2023-10-18T12:19:44.645449+0000","last_became_active":"2023-10-18T12:19:43.672680+0000","last_became_peered":"2023-10-18T12:19:43.672680+0000","last_unstale":"2023-10-18T12:19:44.645449+0000","last_undegraded":"2023-10-18T12:19:44.645449+0000","last_fullsized":"2023-10-18T12:19:44.645449+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:33:03.308142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.699845+0000","last_change":"2023-10-18T12:19:39.620744+0000","last_active":"2023-10-18T12:19:44.699845+0000","last_peered":"2023-10-18T12:19:44.699845+0000","last_clean":"2023-10-18T12:19:44.699845+0000","last_became_active":"2023-10-18T12:19:39.619969+0000","last_became_peered":"2023-10-18T12:19:39.619969+0000","last_unstale":"2023-10-18T12:19:44.699845+0000","last_undegraded":"2023-10-18T12:19:44.699845+0000","last_fullsized":"2023-10-18T12:19:44.699845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:49:43.494684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.644662+0000","last_change":"2023-10-18T12:19:38.602475+0000","last_active":"2023-10-18T12:19:44.644662+0000","last_peered":"2023-10-18T12:19:44.644662+0000","last_clean":"2023-10-18T12:19:44.644662+0000","last_became_active":"2023-10-18T12:19:38.602195+0000","last_became_peered":"2023-10-18T12:19:38.602195+0000","last_unstale":"2023-10-18T12:19:44.644662+0000","last_undegraded":"2023-10-18T12:19:44.644662+0000","last_fullsized":"2023-10-18T12:19:44.644662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:32:58.240366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696887+0000","last_change":"2023-10-18T12:19:43.682795+0000","last_active":"2023-10-18T12:19:44.696887+0000","last_peered":"2023-10-18T12:19:44.696887+0000","last_clean":"2023-10-18T12:19:44.696887+0000","last_became_active":"2023-10-18T12:19:43.680710+0000","last_became_peered":"2023-10-18T12:19:43.680710+0000","last_unstale":"2023-10-18T12:19:44.696887+0000","last_undegraded":"2023-10-18T12:19:44.696887+0000","last_fullsized":"2023-10-18T12:19:44.696887+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:00:53.354798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695979+0000","last_change":"2023-10-18T12:19:39.620575+0000","last_active":"2023-10-18T12:19:44.695979+0000","last_peered":"2023-10-18T12:19:44.695979+0000","last_clean":"2023-10-18T12:19:44.695979+0000","last_became_active":"2023-10-18T12:19:39.620291+0000","last_became_peered":"2023-10-18T12:19:39.620291+0000","last_unstale":"2023-10-18T12:19:44.695979+0000","last_undegraded":"2023-10-18T12:19:44.695979+0000","last_fullsized":"2023-10-18T12:19:44.695979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:08:55.947222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698645+0000","last_change":"2023-10-18T12:19:38.607039+0000","last_active":"2023-10-18T12:19:44.698645+0000","last_peered":"2023-10-18T12:19:44.698645+0000","last_clean":"2023-10-18T12:19:44.698645+0000","last_became_active":"2023-10-18T12:19:38.606732+0000","last_became_peered":"2023-10-18T12:19:38.606732+0000","last_unstale":"2023-10-18T12:19:44.698645+0000","last_undegraded":"2023-10-18T12:19:44.698645+0000","last_fullsized":"2023-10-18T12:19:44.698645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:59:34.750292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695219+0000","last_change":"2023-10-18T12:19:43.670138+0000","last_active":"2023-10-18T12:19:44.695219+0000","last_peered":"2023-10-18T12:19:44.695219+0000","last_clean":"2023-10-18T12:19:44.695219+0000","last_became_active":"2023-10-18T12:19:43.665610+0000","last_became_peered":"2023-10-18T12:19:43.665610+0000","last_unstale":"2023-10-18T12:19:44.695219+0000","last_undegraded":"2023-10-18T12:19:44.695219+0000","last_fullsized":"2023-10-18T12:19:44.695219+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:28:00.580454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697978+0000","last_change":"2023-10-18T12:19:39.595036+0000","last_active":"2023-10-18T12:19:44.697978+0000","last_peered":"2023-10-18T12:19:44.697978+0000","last_clean":"2023-10-18T12:19:44.697978+0000","last_became_active":"2023-10-18T12:19:39.594790+0000","last_became_peered":"2023-10-18T12:19:39.594790+0000","last_unstale":"2023-10-18T12:19:44.697978+0000","last_undegraded":"2023-10-18T12:19:44.697978+0000","last_fullsized":"2023-10-18T12:19:44.697978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:36:35.120486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643398+0000","last_change":"2023-10-18T12:19:38.600268+0000","last_active":"2023-10-18T12:19:44.643398+0000","last_peered":"2023-10-18T12:19:44.643398+0000","last_clean":"2023-10-18T12:19:44.643398+0000","last_became_active":"2023-10-18T12:19:38.599435+0000","last_became_peered":"2023-10-18T12:19:38.599435+0000","last_unstale":"2023-10-18T12:19:44.643398+0000","last_undegraded":"2023-10-18T12:19:44.643398+0000","last_fullsized":"2023-10-18T12:19:44.643398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:58:15.868092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.694660+0000","last_change":"2023-10-18T12:19:43.670918+0000","last_active":"2023-10-18T12:19:44.694660+0000","last_peered":"2023-10-18T12:19:44.694660+0000","last_clean":"2023-10-18T12:19:44.694660+0000","last_became_active":"2023-10-18T12:19:43.670175+0000","last_became_peered":"2023-10-18T12:19:43.670175+0000","last_unstale":"2023-10-18T12:19:44.694660+0000","last_undegraded":"2023-10-18T12:19:44.694660+0000","last_fullsized":"2023-10-18T12:19:44.694660+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:44:28.672709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696009+0000","last_change":"2023-10-18T12:19:39.610440+0000","last_active":"2023-10-18T12:19:44.696009+0000","last_peered":"2023-10-18T12:19:44.696009+0000","last_clean":"2023-10-18T12:19:44.696009+0000","last_became_active":"2023-10-18T12:19:39.610144+0000","last_became_peered":"2023-10-18T12:19:39.610144+0000","last_unstale":"2023-10-18T12:19:44.696009+0000","last_undegraded":"2023-10-18T12:19:44.696009+0000","last_fullsized":"2023-10-18T12:19:44.696009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:53:47.232582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.644062+0000","last_change":"2023-10-18T12:19:38.605732+0000","last_active":"2023-10-18T12:19:44.644062+0000","last_peered":"2023-10-18T12:19:44.644062+0000","last_clean":"2023-10-18T12:19:44.644062+0000","last_became_active":"2023-10-18T12:19:38.605308+0000","last_became_peered":"2023-10-18T12:19:38.605308+0000","last_unstale":"2023-10-18T12:19:44.644062+0000","last_undegraded":"2023-10-18T12:19:44.644062+0000","last_fullsized":"2023-10-18T12:19:44.644062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:31:40.396673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.694490+0000","last_change":"2023-10-18T12:19:43.670657+0000","last_active":"2023-10-18T12:19:44.694490+0000","last_peered":"2023-10-18T12:19:44.694490+0000","last_clean":"2023-10-18T12:19:44.694490+0000","last_became_active":"2023-10-18T12:19:43.670163+0000","last_became_peered":"2023-10-18T12:19:43.670163+0000","last_unstale":"2023-10-18T12:19:44.694490+0000","last_undegraded":"2023-10-18T12:19:44.694490+0000","last_fullsized":"2023-10-18T12:19:44.694490+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:34:08.780931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695903+0000","last_change":"2023-10-18T12:19:39.602738+0000","last_active":"2023-10-18T12:19:44.695903+0000","last_peered":"2023-10-18T12:19:44.695903+0000","last_clean":"2023-10-18T12:19:44.695903+0000","last_became_active":"2023-10-18T12:19:39.602448+0000","last_became_peered":"2023-10-18T12:19:39.602448+0000","last_unstale":"2023-10-18T12:19:44.695903+0000","last_undegraded":"2023-10-18T12:19:44.695903+0000","last_fullsized":"2023-10-18T12:19:44.695903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:16:42.023443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.644202+0000","last_change":"2023-10-18T12:19:38.603192+0000","last_active":"2023-10-18T12:19:44.644202+0000","last_peered":"2023-10-18T12:19:44.644202+0000","last_clean":"2023-10-18T12:19:44.644202+0000","last_became_active":"2023-10-18T12:19:38.602904+0000","last_became_peered":"2023-10-18T12:19:38.602904+0000","last_unstale":"2023-10-18T12:19:44.644202+0000","last_undegraded":"2023-10-18T12:19:44.644202+0000","last_fullsized":"2023-10-18T12:19:44.644202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:05:31.346619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.642394+0000","last_change":"2023-10-18T12:19:43.664334+0000","last_active":"2023-10-18T12:19:44.642394+0000","last_peered":"2023-10-18T12:19:44.642394+0000","last_clean":"2023-10-18T12:19:44.642394+0000","last_became_active":"2023-10-18T12:19:43.663249+0000","last_became_peered":"2023-10-18T12:19:43.663249+0000","last_unstale":"2023-10-18T12:19:44.642394+0000","last_undegraded":"2023-10-18T12:19:44.642394+0000","last_fullsized":"2023-10-18T12:19:44.642394+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:45.224238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696836+0000","last_change":"2023-10-18T12:19:43.672616+0000","last_active":"2023-10-18T12:19:44.696836+0000","last_peered":"2023-10-18T12:19:44.696836+0000","last_clean":"2023-10-18T12:19:44.696836+0000","last_became_active":"2023-10-18T12:19:43.672218+0000","last_became_peered":"2023-10-18T12:19:43.672218+0000","last_unstale":"2023-10-18T12:19:44.696836+0000","last_undegraded":"2023-10-18T12:19:44.696836+0000","last_fullsized":"2023-10-18T12:19:44.696836+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:18:29.969594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698410+0000","last_change":"2023-10-18T12:19:38.592225+0000","last_active":"2023-10-18T12:19:44.698410+0000","last_peered":"2023-10-18T12:19:44.698410+0000","last_clean":"2023-10-18T12:19:44.698410+0000","last_became_active":"2023-10-18T12:19:38.591941+0000","last_became_peered":"2023-10-18T12:19:38.591941+0000","last_unstale":"2023-10-18T12:19:44.698410+0000","last_undegraded":"2023-10-18T12:19:44.698410+0000","last_fullsized":"2023-10-18T12:19:44.698410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:28:52.287011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.646062+0000","last_change":"2023-10-18T12:19:39.611861+0000","last_active":"2023-10-18T12:19:44.646062+0000","last_peered":"2023-10-18T12:19:44.646062+0000","last_clean":"2023-10-18T12:19:44.646062+0000","last_became_active":"2023-10-18T12:19:39.611576+0000","last_became_peered":"2023-10-18T12:19:39.611576+0000","last_unstale":"2023-10-18T12:19:44.646062+0000","last_undegraded":"2023-10-18T12:19:44.646062+0000","last_fullsized":"2023-10-18T12:19:44.646062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:42:08.342773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645692+0000","last_change":"2023-10-18T12:19:43.671295+0000","last_active":"2023-10-18T12:19:44.645692+0000","last_peered":"2023-10-18T12:19:44.645692+0000","last_clean":"2023-10-18T12:19:44.645692+0000","last_became_active":"2023-10-18T12:19:43.667280+0000","last_became_peered":"2023-10-18T12:19:43.667280+0000","last_unstale":"2023-10-18T12:19:44.645692+0000","last_undegraded":"2023-10-18T12:19:44.645692+0000","last_fullsized":"2023-10-18T12:19:44.645692+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:58:20.935868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.642799+0000","last_change":"2023-10-18T12:19:38.608977+0000","last_active":"2023-10-18T12:19:44.642799+0000","last_peered":"2023-10-18T12:19:44.642799+0000","last_clean":"2023-10-18T12:19:44.642799+0000","last_became_active":"2023-10-18T12:19:38.608614+0000","last_became_peered":"2023-10-18T12:19:38.608614+0000","last_unstale":"2023-10-18T12:19:44.642799+0000","last_undegraded":"2023-10-18T12:19:44.642799+0000","last_fullsized":"2023-10-18T12:19:44.642799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:34:43.885197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696721+0000","last_change":"2023-10-18T12:19:39.626624+0000","last_active":"2023-10-18T12:19:44.696721+0000","last_peered":"2023-10-18T12:19:44.696721+0000","last_clean":"2023-10-18T12:19:44.696721+0000","last_became_active":"2023-10-18T12:19:39.626353+0000","last_became_peered":"2023-10-18T12:19:39.626353+0000","last_unstale":"2023-10-18T12:19:44.696721+0000","last_undegraded":"2023-10-18T12:19:44.696721+0000","last_fullsized":"2023-10-18T12:19:44.696721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:38:42.744745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695480+0000","last_change":"2023-10-18T12:19:38.607392+0000","last_active":"2023-10-18T12:19:44.695480+0000","last_peered":"2023-10-18T12:19:44.695480+0000","last_clean":"2023-10-18T12:19:44.695480+0000","last_became_active":"2023-10-18T12:19:38.607074+0000","last_became_peered":"2023-10-18T12:19:38.607074+0000","last_unstale":"2023-10-18T12:19:44.695480+0000","last_undegraded":"2023-10-18T12:19:44.695480+0000","last_fullsized":"2023-10-18T12:19:44.695480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:39:22.962723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697929+0000","last_change":"2023-10-18T12:19:39.612978+0000","last_active":"2023-10-18T12:19:44.697929+0000","last_peered":"2023-10-18T12:19:44.697929+0000","last_clean":"2023-10-18T12:19:44.697929+0000","last_became_active":"2023-10-18T12:19:39.612414+0000","last_became_peered":"2023-10-18T12:19:39.612414+0000","last_unstale":"2023-10-18T12:19:44.697929+0000","last_undegraded":"2023-10-18T12:19:44.697929+0000","last_fullsized":"2023-10-18T12:19:44.697929+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:31:41.406606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.644993+0000","last_change":"2023-10-18T12:19:43.663874+0000","last_active":"2023-10-18T12:19:44.644993+0000","last_peered":"2023-10-18T12:19:44.644993+0000","last_clean":"2023-10-18T12:19:44.644993+0000","last_became_active":"2023-10-18T12:19:43.663482+0000","last_became_peered":"2023-10-18T12:19:43.663482+0000","last_unstale":"2023-10-18T12:19:44.644993+0000","last_undegraded":"2023-10-18T12:19:44.644993+0000","last_fullsized":"2023-10-18T12:19:44.644993+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:09:05.460432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643120+0000","last_change":"2023-10-18T12:19:38.608908+0000","last_active":"2023-10-18T12:19:44.643120+0000","last_peered":"2023-10-18T12:19:44.643120+0000","last_clean":"2023-10-18T12:19:44.643120+0000","last_became_active":"2023-10-18T12:19:38.608598+0000","last_became_peered":"2023-10-18T12:19:38.608598+0000","last_unstale":"2023-10-18T12:19:44.643120+0000","last_undegraded":"2023-10-18T12:19:44.643120+0000","last_fullsized":"2023-10-18T12:19:44.643120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:09:00.392656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645413+0000","last_change":"2023-10-18T12:19:39.610765+0000","last_active":"2023-10-18T12:19:44.645413+0000","last_peered":"2023-10-18T12:19:44.645413+0000","last_clean":"2023-10-18T12:19:44.645413+0000","last_became_active":"2023-10-18T12:19:39.610487+0000","last_became_peered":"2023-10-18T12:19:39.610487+0000","last_unstale":"2023-10-18T12:19:44.645413+0000","last_undegraded":"2023-10-18T12:19:44.645413+0000","last_fullsized":"2023-10-18T12:19:44.645413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:38:42.744745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697522+0000","last_change":"2023-10-18T12:19:43.676251+0000","last_active":"2023-10-18T12:19:44.697522+0000","last_peered":"2023-10-18T12:19:44.697522+0000","last_clean":"2023-10-18T12:19:44.697522+0000","last_became_active":"2023-10-18T12:19:43.675875+0000","last_became_peered":"2023-10-18T12:19:43.675875+0000","last_unstale":"2023-10-18T12:19:44.697522+0000","last_undegraded":"2023-10-18T12:19:44.697522+0000","last_fullsized":"2023-10-18T12:19:44.697522+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:43:47.628186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698036+0000","last_change":"2023-10-18T12:19:39.606335+0000","last_active":"2023-10-18T12:19:44.698036+0000","last_peered":"2023-10-18T12:19:44.698036+0000","last_clean":"2023-10-18T12:19:44.698036+0000","last_became_active":"2023-10-18T12:19:39.604624+0000","last_became_peered":"2023-10-18T12:19:39.604624+0000","last_unstale":"2023-10-18T12:19:44.698036+0000","last_undegraded":"2023-10-18T12:19:44.698036+0000","last_fullsized":"2023-10-18T12:19:44.698036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:00:59.306651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643934+0000","last_change":"2023-10-18T12:19:39.622414+0000","last_active":"2023-10-18T12:19:44.643934+0000","last_peered":"2023-10-18T12:19:44.643934+0000","last_clean":"2023-10-18T12:19:44.643934+0000","last_became_active":"2023-10-18T12:19:39.622099+0000","last_became_peered":"2023-10-18T12:19:39.622099+0000","last_unstale":"2023-10-18T12:19:44.643934+0000","last_undegraded":"2023-10-18T12:19:44.643934+0000","last_fullsized":"2023-10-18T12:19:44.643934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:41.166395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697300+0000","last_change":"2023-10-18T12:19:39.614498+0000","last_active":"2023-10-18T12:19:44.697300+0000","last_peered":"2023-10-18T12:19:44.697300+0000","last_clean":"2023-10-18T12:19:44.697300+0000","last_became_active":"2023-10-18T12:19:39.614221+0000","last_became_peered":"2023-10-18T12:19:39.614221+0000","last_unstale":"2023-10-18T12:19:44.697300+0000","last_undegraded":"2023-10-18T12:19:44.697300+0000","last_fullsized":"2023-10-18T12:19:44.697300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:50:20.465384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.644520+0000","last_change":"2023-10-18T12:19:39.622751+0000","last_active":"2023-10-18T12:19:44.644520+0000","last_peered":"2023-10-18T12:19:44.644520+0000","last_clean":"2023-10-18T12:19:44.644520+0000","last_became_active":"2023-10-18T12:19:39.612445+0000","last_became_peered":"2023-10-18T12:19:39.612445+0000","last_unstale":"2023-10-18T12:19:44.644520+0000","last_undegraded":"2023-10-18T12:19:44.644520+0000","last_fullsized":"2023-10-18T12:19:44.644520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:59:46.662013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.646131+0000","last_change":"2023-10-18T12:19:39.597414+0000","last_active":"2023-10-18T12:19:44.646131+0000","last_peered":"2023-10-18T12:19:44.646131+0000","last_clean":"2023-10-18T12:19:44.646131+0000","last_became_active":"2023-10-18T12:19:39.597142+0000","last_became_peered":"2023-10-18T12:19:39.597142+0000","last_unstale":"2023-10-18T12:19:44.646131+0000","last_undegraded":"2023-10-18T12:19:44.646131+0000","last_fullsized":"2023-10-18T12:19:44.646131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:18:54.504988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697649+0000","last_change":"2023-10-18T12:19:39.613135+0000","last_active":"2023-10-18T12:19:44.697649+0000","last_peered":"2023-10-18T12:19:44.697649+0000","last_clean":"2023-10-18T12:19:44.697649+0000","last_became_active":"2023-10-18T12:19:39.612747+0000","last_became_peered":"2023-10-18T12:19:39.612747+0000","last_unstale":"2023-10-18T12:19:44.697649+0000","last_undegraded":"2023-10-18T12:19:44.697649+0000","last_fullsized":"2023-10-18T12:19:44.697649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:42:08.342773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.646717+0000","last_change":"2023-10-18T12:19:39.602816+0000","last_active":"2023-10-18T12:19:44.646717+0000","last_peered":"2023-10-18T12:19:44.646717+0000","last_clean":"2023-10-18T12:19:44.646717+0000","last_became_active":"2023-10-18T12:19:39.602561+0000","last_became_peered":"2023-10-18T12:19:39.602561+0000","last_unstale":"2023-10-18T12:19:44.646717+0000","last_undegraded":"2023-10-18T12:19:44.646717+0000","last_fullsized":"2023-10-18T12:19:44.646717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:36:41.193198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645988+0000","last_change":"2023-10-18T12:19:39.600714+0000","last_active":"2023-10-18T12:19:44.645988+0000","last_peered":"2023-10-18T12:19:44.645988+0000","last_clean":"2023-10-18T12:19:44.645988+0000","last_became_active":"2023-10-18T12:19:39.600450+0000","last_became_peered":"2023-10-18T12:19:39.600450+0000","last_unstale":"2023-10-18T12:19:44.645988+0000","last_undegraded":"2023-10-18T12:19:44.645988+0000","last_fullsized":"2023-10-18T12:19:44.645988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:58:16.878025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.642145+0000","last_change":"2023-10-18T12:19:39.627407+0000","last_active":"2023-10-18T12:19:44.642145+0000","last_peered":"2023-10-18T12:19:44.642145+0000","last_clean":"2023-10-18T12:19:44.642145+0000","last_became_active":"2023-10-18T12:19:39.626211+0000","last_became_peered":"2023-10-18T12:19:39.626211+0000","last_unstale":"2023-10-18T12:19:44.642145+0000","last_undegraded":"2023-10-18T12:19:44.642145+0000","last_fullsized":"2023-10-18T12:19:44.642145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:01:13.535689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643733+0000","last_change":"2023-10-18T12:19:39.625985+0000","last_active":"2023-10-18T12:19:44.643733+0000","last_peered":"2023-10-18T12:19:44.643733+0000","last_clean":"2023-10-18T12:19:44.643733+0000","last_became_active":"2023-10-18T12:19:39.625675+0000","last_became_peered":"2023-10-18T12:19:39.625675+0000","last_unstale":"2023-10-18T12:19:44.643733+0000","last_undegraded":"2023-10-18T12:19:44.643733+0000","last_fullsized":"2023-10-18T12:19:44.643733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:08:55.947222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695201+0000","last_change":"2023-10-18T12:19:39.612565+0000","last_active":"2023-10-18T12:19:44.695201+0000","last_peered":"2023-10-18T12:19:44.695201+0000","last_clean":"2023-10-18T12:19:44.695201+0000","last_became_active":"2023-10-18T12:19:39.612238+0000","last_became_peered":"2023-10-18T12:19:39.612238+0000","last_unstale":"2023-10-18T12:19:44.695201+0000","last_undegraded":"2023-10-18T12:19:44.695201+0000","last_fullsized":"2023-10-18T12:19:44.695201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:20:41.018432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643039+0000","last_change":"2023-10-18T12:19:39.616276+0000","last_active":"2023-10-18T12:19:44.643039+0000","last_peered":"2023-10-18T12:19:44.643039+0000","last_clean":"2023-10-18T12:19:44.643039+0000","last_became_active":"2023-10-18T12:19:39.615850+0000","last_became_peered":"2023-10-18T12:19:39.615850+0000","last_unstale":"2023-10-18T12:19:44.643039+0000","last_undegraded":"2023-10-18T12:19:44.643039+0000","last_fullsized":"2023-10-18T12:19:44.643039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:32:59.250300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.699707+0000","last_change":"2023-10-18T12:19:39.623264+0000","last_active":"2023-10-18T12:19:44.699707+0000","last_peered":"2023-10-18T12:19:44.699707+0000","last_clean":"2023-10-18T12:19:44.699707+0000","last_became_active":"2023-10-18T12:19:39.621265+0000","last_became_peered":"2023-10-18T12:19:39.621265+0000","last_unstale":"2023-10-18T12:19:44.699707+0000","last_undegraded":"2023-10-18T12:19:44.699707+0000","last_fullsized":"2023-10-18T12:19:44.699707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:14:52.587185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697048+0000","last_change":"2023-10-18T12:19:39.601465+0000","last_active":"2023-10-18T12:19:44.697048+0000","last_peered":"2023-10-18T12:19:44.697048+0000","last_clean":"2023-10-18T12:19:44.697048+0000","last_became_active":"2023-10-18T12:19:39.601166+0000","last_became_peered":"2023-10-18T12:19:39.601166+0000","last_unstale":"2023-10-18T12:19:44.697048+0000","last_undegraded":"2023-10-18T12:19:44.697048+0000","last_fullsized":"2023-10-18T12:19:44.697048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:49:10.530935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.700144+0000","last_change":"2023-10-18T12:19:39.623799+0000","last_active":"2023-10-18T12:19:44.700144+0000","last_peered":"2023-10-18T12:19:44.700144+0000","last_clean":"2023-10-18T12:19:44.700144+0000","last_became_active":"2023-10-18T12:19:39.623178+0000","last_became_peered":"2023-10-18T12:19:39.623178+0000","last_unstale":"2023-10-18T12:19:44.700144+0000","last_undegraded":"2023-10-18T12:19:44.700144+0000","last_fullsized":"2023-10-18T12:19:44.700144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:41:05.788100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697167+0000","last_change":"2023-10-18T12:19:39.626941+0000","last_active":"2023-10-18T12:19:44.697167+0000","last_peered":"2023-10-18T12:19:44.697167+0000","last_clean":"2023-10-18T12:19:44.697167+0000","last_became_active":"2023-10-18T12:19:39.626282+0000","last_became_peered":"2023-10-18T12:19:39.626282+0000","last_unstale":"2023-10-18T12:19:44.697167+0000","last_undegraded":"2023-10-18T12:19:44.697167+0000","last_fullsized":"2023-10-18T12:19:44.697167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:43:43.570343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695706+0000","last_change":"2023-10-18T12:19:39.618114+0000","last_active":"2023-10-18T12:19:44.695706+0000","last_peered":"2023-10-18T12:19:44.695706+0000","last_clean":"2023-10-18T12:19:44.695706+0000","last_became_active":"2023-10-18T12:19:39.617493+0000","last_became_peered":"2023-10-18T12:19:39.617493+0000","last_unstale":"2023-10-18T12:19:44.695706+0000","last_undegraded":"2023-10-18T12:19:44.695706+0000","last_fullsized":"2023-10-18T12:19:44.695706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:51:48.593221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.642536+0000","last_change":"2023-10-18T12:19:39.593923+0000","last_active":"2023-10-18T12:19:44.642536+0000","last_peered":"2023-10-18T12:19:44.642536+0000","last_clean":"2023-10-18T12:19:44.642536+0000","last_became_active":"2023-10-18T12:19:39.593576+0000","last_became_peered":"2023-10-18T12:19:39.593576+0000","last_unstale":"2023-10-18T12:19:44.642536+0000","last_undegraded":"2023-10-18T12:19:44.642536+0000","last_fullsized":"2023-10-18T12:19:44.642536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:23:37.730513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696693+0000","last_change":"2023-10-18T12:19:39.608751+0000","last_active":"2023-10-18T12:19:44.696693+0000","last_peered":"2023-10-18T12:19:44.696693+0000","last_clean":"2023-10-18T12:19:44.696693+0000","last_became_active":"2023-10-18T12:19:39.608577+0000","last_became_peered":"2023-10-18T12:19:39.608577+0000","last_unstale":"2023-10-18T12:19:44.696693+0000","last_undegraded":"2023-10-18T12:19:44.696693+0000","last_fullsized":"2023-10-18T12:19:44.696693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:41.166395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.694826+0000","last_change":"2023-10-18T12:19:39.619193+0000","last_active":"2023-10-18T12:19:44.694826+0000","last_peered":"2023-10-18T12:19:44.694826+0000","last_clean":"2023-10-18T12:19:44.694826+0000","last_became_active":"2023-10-18T12:19:39.618875+0000","last_became_peered":"2023-10-18T12:19:39.618875+0000","last_unstale":"2023-10-18T12:19:44.694826+0000","last_undegraded":"2023-10-18T12:19:44.694826+0000","last_fullsized":"2023-10-18T12:19:44.694826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:09:05.600850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696932+0000","last_change":"2023-10-18T12:19:39.624583+0000","last_active":"2023-10-18T12:19:44.696932+0000","last_peered":"2023-10-18T12:19:44.696932+0000","last_clean":"2023-10-18T12:19:44.696932+0000","last_became_active":"2023-10-18T12:19:39.624245+0000","last_became_peered":"2023-10-18T12:19:39.624245+0000","last_unstale":"2023-10-18T12:19:44.696932+0000","last_undegraded":"2023-10-18T12:19:44.696932+0000","last_fullsized":"2023-10-18T12:19:44.696932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:30:21.637586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.699970+0000","last_change":"2023-10-18T12:19:39.611515+0000","last_active":"2023-10-18T12:19:44.699970+0000","last_peered":"2023-10-18T12:19:44.699970+0000","last_clean":"2023-10-18T12:19:44.699970+0000","last_became_active":"2023-10-18T12:19:39.611055+0000","last_became_peered":"2023-10-18T12:19:39.611055+0000","last_unstale":"2023-10-18T12:19:44.699970+0000","last_undegraded":"2023-10-18T12:19:44.699970+0000","last_fullsized":"2023-10-18T12:19:44.699970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:46:08.694186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697397+0000","last_change":"2023-10-18T12:19:39.616291+0000","last_active":"2023-10-18T12:19:44.697397+0000","last_peered":"2023-10-18T12:19:44.697397+0000","last_clean":"2023-10-18T12:19:44.697397+0000","last_became_active":"2023-10-18T12:19:39.615941+0000","last_became_peered":"2023-10-18T12:19:39.615941+0000","last_unstale":"2023-10-18T12:19:44.697397+0000","last_undegraded":"2023-10-18T12:19:44.697397+0000","last_fullsized":"2023-10-18T12:19:44.697397+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:38:42.744745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696621+0000","last_change":"2023-10-18T12:19:39.627115+0000","last_active":"2023-10-18T12:19:44.696621+0000","last_peered":"2023-10-18T12:19:44.696621+0000","last_clean":"2023-10-18T12:19:44.696621+0000","last_became_active":"2023-10-18T12:19:39.626676+0000","last_became_peered":"2023-10-18T12:19:39.626676+0000","last_unstale":"2023-10-18T12:19:44.696621+0000","last_undegraded":"2023-10-18T12:19:44.696621+0000","last_fullsized":"2023-10-18T12:19:44.696621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:23:37.730513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695588+0000","last_change":"2023-10-18T12:19:39.622702+0000","last_active":"2023-10-18T12:19:44.695588+0000","last_peered":"2023-10-18T12:19:44.695588+0000","last_clean":"2023-10-18T12:19:44.695588+0000","last_became_active":"2023-10-18T12:19:39.622413+0000","last_became_peered":"2023-10-18T12:19:39.622413+0000","last_unstale":"2023-10-18T12:19:44.695588+0000","last_undegraded":"2023-10-18T12:19:44.695588+0000","last_fullsized":"2023-10-18T12:19:44.695588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:01:13.535689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.642468+0000","last_change":"2023-10-18T12:19:39.590506+0000","last_active":"2023-10-18T12:19:44.642468+0000","last_peered":"2023-10-18T12:19:44.642468+0000","last_clean":"2023-10-18T12:19:44.642468+0000","last_became_active":"2023-10-18T12:19:39.590193+0000","last_became_peered":"2023-10-18T12:19:39.590193+0000","last_unstale":"2023-10-18T12:19:44.642468+0000","last_undegraded":"2023-10-18T12:19:44.642468+0000","last_fullsized":"2023-10-18T12:19:44.642468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:32:29.479925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696554+0000","last_change":"2023-10-18T12:19:39.623884+0000","last_active":"2023-10-18T12:19:44.696554+0000","last_peered":"2023-10-18T12:19:44.696554+0000","last_clean":"2023-10-18T12:19:44.696554+0000","last_became_active":"2023-10-18T12:19:39.621423+0000","last_became_peered":"2023-10-18T12:19:39.621423+0000","last_unstale":"2023-10-18T12:19:44.696554+0000","last_undegraded":"2023-10-18T12:19:44.696554+0000","last_fullsized":"2023-10-18T12:19:44.696554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:08:53.571323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696270+0000","last_change":"2023-10-18T12:19:39.613490+0000","last_active":"2023-10-18T12:19:44.696270+0000","last_peered":"2023-10-18T12:19:44.696270+0000","last_clean":"2023-10-18T12:19:44.696270+0000","last_became_active":"2023-10-18T12:19:39.613238+0000","last_became_peered":"2023-10-18T12:19:39.613238+0000","last_unstale":"2023-10-18T12:19:44.696270+0000","last_undegraded":"2023-10-18T12:19:44.696270+0000","last_fullsized":"2023-10-18T12:19:44.696270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:16:42.023443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698292+0000","last_change":"2023-10-18T12:19:39.616780+0000","last_active":"2023-10-18T12:19:44.698292+0000","last_peered":"2023-10-18T12:19:44.698292+0000","last_clean":"2023-10-18T12:19:44.698292+0000","last_became_active":"2023-10-18T12:19:39.612468+0000","last_became_peered":"2023-10-18T12:19:39.612468+0000","last_unstale":"2023-10-18T12:19:44.698292+0000","last_undegraded":"2023-10-18T12:19:44.698292+0000","last_fullsized":"2023-10-18T12:19:44.698292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:21:53.971574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.699940+0000","last_change":"2023-10-18T12:19:39.614291+0000","last_active":"2023-10-18T12:19:44.699940+0000","last_peered":"2023-10-18T12:19:44.699940+0000","last_clean":"2023-10-18T12:19:44.699940+0000","last_became_active":"2023-10-18T12:19:39.613988+0000","last_became_peered":"2023-10-18T12:19:39.613988+0000","last_unstale":"2023-10-18T12:19:44.699940+0000","last_undegraded":"2023-10-18T12:19:44.699940+0000","last_fullsized":"2023-10-18T12:19:44.699940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:54:49.791061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697127+0000","last_change":"2023-10-18T12:19:39.618591+0000","last_active":"2023-10-18T12:19:44.697127+0000","last_peered":"2023-10-18T12:19:44.697127+0000","last_clean":"2023-10-18T12:19:44.697127+0000","last_became_active":"2023-10-18T12:19:39.618040+0000","last_became_peered":"2023-10-18T12:19:39.618040+0000","last_unstale":"2023-10-18T12:19:44.697127+0000","last_undegraded":"2023-10-18T12:19:44.697127+0000","last_fullsized":"2023-10-18T12:19:44.697127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:34:44.895130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697567+0000","last_change":"2023-10-18T12:19:39.619158+0000","last_active":"2023-10-18T12:19:44.697567+0000","last_peered":"2023-10-18T12:19:44.697567+0000","last_clean":"2023-10-18T12:19:44.697567+0000","last_became_active":"2023-10-18T12:19:39.618867+0000","last_became_peered":"2023-10-18T12:19:39.618867+0000","last_unstale":"2023-10-18T12:19:44.697567+0000","last_undegraded":"2023-10-18T12:19:44.697567+0000","last_fullsized":"2023-10-18T12:19:44.697567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:27:24.632610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4498,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":925696,"data_stored":718856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3939999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1919999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.468}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.339}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.27}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4019999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.345}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.379}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5189999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":125224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.05}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.335}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.282}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1870000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4279999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":128328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0389999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":307200,"data_stored":124662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.389}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.532}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.357}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.038}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.448}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4770000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1180000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1839999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27900,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343940,"statfs":{"total":96636764160,"available":96608194560,"internally_reserved":0,"allocated":901120,"data_stored":715522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.153}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.409}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.236}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.27}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.365}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-18T12:20:02.785 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-18T12:20:03.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.998+0000 7f9bc93c1700 1 Processor -- start 2023-10-18T12:20:03.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:02.998+0000 7f9bc93c1700 1 -- start start 2023-10-18T12:20:03.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.002+0000 7f9bc93c1700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9bc415d5a0 0x7f9bc415d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:03.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.002+0000 7f9bc93c1700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9bc4070820 0x7f9bc40cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:03.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.002+0000 7f9bc93c1700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bc40cd260 con 0x7f9bc40cce40 2023-10-18T12:20:03.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.002+0000 7f9bc93c1700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bc406f780 con 0x7f9bc4070820 2023-10-18T12:20:03.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.002+0000 7f9bc93c1700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bc406fa60 con 0x7f9bc415d5a0 2023-10-18T12:20:03.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.002+0000 7f9bc27fc700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9bc4070820 0x7f9bc40cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:03.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.002+0000 7f9bc3fff700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f9bc40cce40 0x7f9bc41605f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41600/0 (socket says 172.21.15.114:41600) 2023-10-18T12:20:03.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.002+0000 7f9bc3fff700 1 -- 172.21.15.114:0/149662682 learned_addr learned my addr 172.21.15.114:0/149662682 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:03.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.002+0000 7f9bc2ffd700 1 --2- 172.21.15.114:0/149662682 >> v2:172.21.15.172:3300/0 conn(0x7f9bc415d5a0 0x7f9bc415d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:03.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.002+0000 7f9bc27fc700 1 -- 172.21.15.114:0/149662682 >> v2:172.21.15.172:3300/0 conn(0x7f9bc415d5a0 msgr2=0x7f9bc415d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:03.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.002+0000 7f9bc27fc700 1 --2- 172.21.15.114:0/149662682 >> v2:172.21.15.172:3300/0 conn(0x7f9bc415d5a0 0x7f9bc415d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:03.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.002+0000 7f9bc27fc700 1 -- 172.21.15.114:0/149662682 >> v1:172.21.15.114:6789/0 conn(0x7f9bc40cce40 legacy=0x7f9bc41605f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:03.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.002+0000 7f9bc27fc700 1 -- 172.21.15.114:0/149662682 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc406fd40 con 0x7f9bc4070820 2023-10-18T12:20:03.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.002+0000 7f9bc1ffb700 1 -- 172.21.15.114:0/149662682 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 125628451 0 0) 0x7f9bc40cd260 con 0x7f9bc40cce40 2023-10-18T12:20:03.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.002+0000 7f9bc2ffd700 1 --2- 172.21.15.114:0/149662682 >> v2:172.21.15.172:3300/0 conn(0x7f9bc415d5a0 0x7f9bc415d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:03.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.002+0000 7f9bc27fc700 1 --2- 172.21.15.114:0/149662682 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bc4070820 0x7f9bc40cc900 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9bc4067030 tx=0x7f9bb8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=583e1384c5f0148f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:03.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.002+0000 7f9bc1ffb700 1 -- 172.21.15.114:0/149662682 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb8011830 con 0x7f9bc4070820 2023-10-18T12:20:03.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.002+0000 7f9bc1ffb700 1 -- 172.21.15.114:0/149662682 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb8011990 con 0x7f9bc4070820 2023-10-18T12:20:03.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.002+0000 7f9bc1ffb700 1 -- 172.21.15.114:0/149662682 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb8011d40 con 0x7f9bc4070820 2023-10-18T12:20:03.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.006+0000 7f9bc93c1700 1 -- 172.21.15.114:0/149662682 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bc4070820 msgr2=0x7f9bc40cc900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:03.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.006+0000 7f9bc93c1700 1 --2- 172.21.15.114:0/149662682 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bc4070820 0x7f9bc40cc900 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9bc4067030 tx=0x7f9bb8009b30 comp rx=0 tx=0).stop 2023-10-18T12:20:03.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.006+0000 7f9bc93c1700 1 -- 172.21.15.114:0/149662682 shutdown_connections 2023-10-18T12:20:03.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.006+0000 7f9bc93c1700 1 --2- 172.21.15.114:0/149662682 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bc4070820 0x7f9bc40cc900 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:03.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.006+0000 7f9bc93c1700 1 --2- 172.21.15.114:0/149662682 >> v2:172.21.15.172:3300/0 conn(0x7f9bc415d5a0 0x7f9bc415d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:03.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.006+0000 7f9bc93c1700 1 -- 172.21.15.114:0/149662682 >> 172.21.15.114:0/149662682 conn(0x7f9bc40b1a50 msgr2=0x7f9bc40b1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:03.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.006+0000 7f9bc93c1700 1 -- 172.21.15.114:0/149662682 shutdown_connections 2023-10-18T12:20:03.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.006+0000 7f9bc93c1700 1 -- 172.21.15.114:0/149662682 wait complete. 2023-10-18T12:20:03.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.006+0000 7f9bc93c1700 1 Processor -- start 2023-10-18T12:20:03.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.010+0000 7f9bc93c1700 1 -- start start 2023-10-18T12:20:03.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.010+0000 7f9bc93c1700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bc40cce40 0x7f9bc4150570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:03.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.010+0000 7f9bc93c1700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bc415d5a0 0x7f9bc40ae540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:03.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.010+0000 7f9bc93c1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bc40aea80 0x7f9bc40ac3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:03.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.010+0000 7f9bc93c1700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc41f6840 con 0x7f9bc40aea80 2023-10-18T12:20:03.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.010+0000 7f9bc93c1700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc4150ab0 con 0x7f9bc415d5a0 2023-10-18T12:20:03.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.010+0000 7f9bc93c1700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc41f5c30 con 0x7f9bc40cce40 2023-10-18T12:20:03.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.010+0000 7f9bc3fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bc40aea80 0x7f9bc40ac3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:03.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.010+0000 7f9bc3fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bc40aea80 0x7f9bc40ac3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46864/0 (socket says 172.21.15.114:46864) 2023-10-18T12:20:03.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.010+0000 7f9bc3fff700 1 -- 172.21.15.114:0/494594724 learned_addr learned my addr 172.21.15.114:0/494594724 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:03.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.010+0000 7f9bc2ffd700 1 --2- 172.21.15.114:0/494594724 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bc40cce40 0x7f9bc4150570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:03.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.010+0000 7f9bc27fc700 1 --2- 172.21.15.114:0/494594724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bc415d5a0 0x7f9bc40ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:03.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.010+0000 7f9bc3fff700 1 -- 172.21.15.114:0/494594724 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bc40cce40 msgr2=0x7f9bc4150570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:03.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.010+0000 7f9bc3fff700 1 --2- 172.21.15.114:0/494594724 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bc40cce40 0x7f9bc4150570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:03.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.010+0000 7f9bc3fff700 1 -- 172.21.15.114:0/494594724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bc415d5a0 msgr2=0x7f9bc40ae540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:03.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.010+0000 7f9bc3fff700 1 --2- 172.21.15.114:0/494594724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bc415d5a0 0x7f9bc40ae540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:03.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.010+0000 7f9bc3fff700 1 -- 172.21.15.114:0/494594724 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb80094b0 con 0x7f9bc40aea80 2023-10-18T12:20:03.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.010+0000 7f9bc3fff700 1 --2- 172.21.15.114:0/494594724 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bc40aea80 0x7f9bc40ac3a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc002230 tx=0x7f9bbc00cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:03.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.010+0000 7f9bab7fe700 1 -- 172.21.15.114:0/494594724 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc00aac0 con 0x7f9bc40aea80 2023-10-18T12:20:03.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.010+0000 7f9bab7fe700 1 -- 172.21.15.114:0/494594724 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bbc00ac40 con 0x7f9bc40aea80 2023-10-18T12:20:03.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.010+0000 7f9bc93c1700 1 -- 172.21.15.114:0/494594724 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bc41f5f10 con 0x7f9bc40aea80 2023-10-18T12:20:03.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.010+0000 7f9bab7fe700 1 -- 172.21.15.114:0/494594724 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc0070d0 con 0x7f9bc40aea80 2023-10-18T12:20:03.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.014+0000 7f9bc93c1700 1 -- 172.21.15.114:0/494594724 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bc41f64d0 con 0x7f9bc40aea80 2023-10-18T12:20:03.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.014+0000 7f9bc93c1700 1 -- 172.21.15.114:0/494594724 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bc4072e60 con 0x7f9bc40aea80 2023-10-18T12:20:03.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.014+0000 7f9bab7fe700 1 -- 172.21.15.114:0/494594724 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f9bbc007250 con 0x7f9bc40aea80 2023-10-18T12:20:03.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.018+0000 7f9bab7fe700 1 --2- 172.21.15.114:0/494594724 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9bb0065720 0x7f9bb0067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:03.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.018+0000 7f9bab7fe700 1 -- 172.21.15.114:0/494594724 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9bbc082ea0 con 0x7f9bc40aea80 2023-10-18T12:20:03.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.018+0000 7f9bc2ffd700 1 --2- 172.21.15.114:0/494594724 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9bb0065720 0x7f9bb0067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:03.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.018+0000 7f9bc2ffd700 1 --2- 172.21.15.114:0/494594724 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9bb0065720 0x7f9bb0067be0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9bb40044b0 tx=0x7f9bb4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:03.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.022+0000 7f9bab7fe700 1 -- 172.21.15.114:0/494594724 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f9bbc050660 con 0x7f9bc40aea80 2023-10-18T12:20:03.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.198+0000 7f9bc93c1700 1 -- 172.21.15.114:0/494594724 --> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9bc4070300 con 0x7f9bb0065720 2023-10-18T12:20:03.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.214+0000 7f9bab7fe700 1 -- 172.21.15.114:0/494594724 <== mgr.4108 v2:172.21.15.172:6832/461408666 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367171 (secure 0 0 0) 0x7f9bb4004590 con 0x7f9bb0065720 2023-10-18T12:20:03.229 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:20:03.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.226+0000 7f9bc93c1700 1 -- 172.21.15.114:0/494594724 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9bb0065720 msgr2=0x7f9bb0067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:03.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.226+0000 7f9bc93c1700 1 --2- 172.21.15.114:0/494594724 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9bb0065720 0x7f9bb0067be0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9bb40044b0 tx=0x7f9bb4008040 comp rx=0 tx=0).stop 2023-10-18T12:20:03.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.226+0000 7f9bc93c1700 1 -- 172.21.15.114:0/494594724 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bc40aea80 msgr2=0x7f9bc40ac3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:03.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.226+0000 7f9bc93c1700 1 --2- 172.21.15.114:0/494594724 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bc40aea80 0x7f9bc40ac3a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc002230 tx=0x7f9bbc00cf50 comp rx=0 tx=0).stop 2023-10-18T12:20:03.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.226+0000 7f9bc93c1700 1 -- 172.21.15.114:0/494594724 shutdown_connections 2023-10-18T12:20:03.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.226+0000 7f9bc93c1700 1 --2- 172.21.15.114:0/494594724 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9bb0065720 0x7f9bb0067be0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:03.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.226+0000 7f9bc93c1700 1 --2- 172.21.15.114:0/494594724 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bc40aea80 0x7f9bc40ac3a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:03.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.226+0000 7f9bc93c1700 1 --2- 172.21.15.114:0/494594724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bc415d5a0 0x7f9bc40ae540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:03.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.226+0000 7f9bc93c1700 1 --2- 172.21.15.114:0/494594724 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bc40cce40 0x7f9bc4150570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:03.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.226+0000 7f9bc93c1700 1 -- 172.21.15.114:0/494594724 >> 172.21.15.114:0/494594724 conn(0x7f9bc40b1a50 msgr2=0x7f9bc40cab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:03.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.226+0000 7f9bc93c1700 1 -- 172.21.15.114:0/494594724 shutdown_connections 2023-10-18T12:20:03.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.226+0000 7f9bc93c1700 1 -- 172.21.15.114:0/494594724 wait complete. 2023-10-18T12:20:03.235 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2023-10-18T12:20:03.251 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2023-10-18T12:20:02.961650+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219744,"kb_used_data":3592,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754976,"statfs":{"total":773094113280,"available":772869095424,"internally_reserved":0,"allocated":3678208,"data_stored":2186590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004786"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.644127+0000","last_change":"2023-10-18T12:19:43.671541+0000","last_active":"2023-10-18T12:19:44.644127+0000","last_peered":"2023-10-18T12:19:44.644127+0000","last_clean":"2023-10-18T12:19:44.644127+0000","last_became_active":"2023-10-18T12:19:43.671125+0000","last_became_peered":"2023-10-18T12:19:43.671125+0000","last_unstale":"2023-10-18T12:19:44.644127+0000","last_undegraded":"2023-10-18T12:19:44.644127+0000","last_fullsized":"2023-10-18T12:19:44.644127+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:18:29.969594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696898+0000","last_change":"2023-10-18T12:19:38.598603+0000","last_active":"2023-10-18T12:19:44.696898+0000","last_peered":"2023-10-18T12:19:44.696898+0000","last_clean":"2023-10-18T12:19:44.696898+0000","last_became_active":"2023-10-18T12:19:38.598010+0000","last_became_peered":"2023-10-18T12:19:38.598010+0000","last_unstale":"2023-10-18T12:19:44.696898+0000","last_undegraded":"2023-10-18T12:19:44.696898+0000","last_fullsized":"2023-10-18T12:19:44.696898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:32:58.240366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695834+0000","last_change":"2023-10-18T12:19:39.616496+0000","last_active":"2023-10-18T12:19:44.695834+0000","last_peered":"2023-10-18T12:19:44.695834+0000","last_clean":"2023-10-18T12:19:44.695834+0000","last_became_active":"2023-10-18T12:19:39.615133+0000","last_became_peered":"2023-10-18T12:19:39.615133+0000","last_unstale":"2023-10-18T12:19:44.695834+0000","last_undegraded":"2023-10-18T12:19:44.695834+0000","last_fullsized":"2023-10-18T12:19:44.695834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:20:49.513519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695684+0000","last_change":"2023-10-18T12:19:43.666992+0000","last_active":"2023-10-18T12:19:44.695684+0000","last_peered":"2023-10-18T12:19:44.695684+0000","last_clean":"2023-10-18T12:19:44.695684+0000","last_became_active":"2023-10-18T12:19:43.666294+0000","last_became_peered":"2023-10-18T12:19:43.666294+0000","last_unstale":"2023-10-18T12:19:44.695684+0000","last_undegraded":"2023-10-18T12:19:44.695684+0000","last_fullsized":"2023-10-18T12:19:44.695684+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:22:06.215999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645491+0000","last_change":"2023-10-18T12:19:38.593588+0000","last_active":"2023-10-18T12:19:44.645491+0000","last_peered":"2023-10-18T12:19:44.645491+0000","last_clean":"2023-10-18T12:19:44.645491+0000","last_became_active":"2023-10-18T12:19:38.592964+0000","last_became_peered":"2023-10-18T12:19:38.592964+0000","last_unstale":"2023-10-18T12:19:44.645491+0000","last_undegraded":"2023-10-18T12:19:44.645491+0000","last_fullsized":"2023-10-18T12:19:44.645491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:43:42.560410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.644558+0000","last_change":"2023-10-18T12:19:39.607852+0000","last_active":"2023-10-18T12:19:44.644558+0000","last_peered":"2023-10-18T12:19:44.644558+0000","last_clean":"2023-10-18T12:19:44.644558+0000","last_became_active":"2023-10-18T12:19:39.603891+0000","last_became_peered":"2023-10-18T12:19:39.603891+0000","last_unstale":"2023-10-18T12:19:44.644558+0000","last_undegraded":"2023-10-18T12:19:44.644558+0000","last_fullsized":"2023-10-18T12:19:44.644558+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:34:44.895130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696905+0000","last_change":"2023-10-18T12:19:43.675386+0000","last_active":"2023-10-18T12:19:44.696905+0000","last_peered":"2023-10-18T12:19:44.696905+0000","last_clean":"2023-10-18T12:19:44.696905+0000","last_became_active":"2023-10-18T12:19:43.675017+0000","last_became_peered":"2023-10-18T12:19:43.675017+0000","last_unstale":"2023-10-18T12:19:44.696905+0000","last_undegraded":"2023-10-18T12:19:44.696905+0000","last_fullsized":"2023-10-18T12:19:44.696905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:32:33.537768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698148+0000","last_change":"2023-10-18T12:19:38.608909+0000","last_active":"2023-10-18T12:19:44.698148+0000","last_peered":"2023-10-18T12:19:44.698148+0000","last_clean":"2023-10-18T12:19:44.698148+0000","last_became_active":"2023-10-18T12:19:38.608524+0000","last_became_peered":"2023-10-18T12:19:38.608524+0000","last_unstale":"2023-10-18T12:19:44.698148+0000","last_undegraded":"2023-10-18T12:19:44.698148+0000","last_fullsized":"2023-10-18T12:19:44.698148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:05:31.346619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697032+0000","last_change":"2023-10-18T12:19:39.619005+0000","last_active":"2023-10-18T12:19:44.697032+0000","last_peered":"2023-10-18T12:19:44.697032+0000","last_clean":"2023-10-18T12:19:44.697032+0000","last_became_active":"2023-10-18T12:19:39.618668+0000","last_became_peered":"2023-10-18T12:19:39.618668+0000","last_unstale":"2023-10-18T12:19:44.697032+0000","last_undegraded":"2023-10-18T12:19:44.697032+0000","last_fullsized":"2023-10-18T12:19:44.697032+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:09:08.461295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.642816+0000","last_change":"2023-10-18T12:19:43.668706+0000","last_active":"2023-10-18T12:19:44.642816+0000","last_peered":"2023-10-18T12:19:44.642816+0000","last_clean":"2023-10-18T12:19:44.642816+0000","last_became_active":"2023-10-18T12:19:43.667712+0000","last_became_peered":"2023-10-18T12:19:43.667712+0000","last_unstale":"2023-10-18T12:19:44.642816+0000","last_undegraded":"2023-10-18T12:19:44.642816+0000","last_fullsized":"2023-10-18T12:19:44.642816+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:59:50.719856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698543+0000","last_change":"2023-10-18T12:19:38.612065+0000","last_active":"2023-10-18T12:19:44.698543+0000","last_peered":"2023-10-18T12:19:44.698543+0000","last_clean":"2023-10-18T12:19:44.698543+0000","last_became_active":"2023-10-18T12:19:38.611721+0000","last_became_peered":"2023-10-18T12:19:38.611721+0000","last_unstale":"2023-10-18T12:19:44.698543+0000","last_undegraded":"2023-10-18T12:19:44.698543+0000","last_fullsized":"2023-10-18T12:19:44.698543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:36:40.183265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698329+0000","last_change":"2023-10-18T12:19:39.620814+0000","last_active":"2023-10-18T12:19:44.698329+0000","last_peered":"2023-10-18T12:19:44.698329+0000","last_clean":"2023-10-18T12:19:44.698329+0000","last_became_active":"2023-10-18T12:19:39.620615+0000","last_became_peered":"2023-10-18T12:19:39.620615+0000","last_unstale":"2023-10-18T12:19:44.698329+0000","last_undegraded":"2023-10-18T12:19:44.698329+0000","last_fullsized":"2023-10-18T12:19:44.698329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:33:13.475249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645822+0000","last_change":"2023-10-18T12:19:43.674472+0000","last_active":"2023-10-18T12:19:44.645822+0000","last_peered":"2023-10-18T12:19:44.645822+0000","last_clean":"2023-10-18T12:19:44.645822+0000","last_became_active":"2023-10-18T12:19:43.673978+0000","last_became_peered":"2023-10-18T12:19:43.673978+0000","last_unstale":"2023-10-18T12:19:44.645822+0000","last_undegraded":"2023-10-18T12:19:44.645822+0000","last_fullsized":"2023-10-18T12:19:44.645822+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:09:05.460432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696271+0000","last_change":"2023-10-18T12:19:38.606249+0000","last_active":"2023-10-18T12:19:44.696271+0000","last_peered":"2023-10-18T12:19:44.696271+0000","last_clean":"2023-10-18T12:19:44.696271+0000","last_became_active":"2023-10-18T12:19:38.605978+0000","last_became_peered":"2023-10-18T12:19:38.605978+0000","last_unstale":"2023-10-18T12:19:44.696271+0000","last_undegraded":"2023-10-18T12:19:44.696271+0000","last_fullsized":"2023-10-18T12:19:44.696271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:01:12.525756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697183+0000","last_change":"2023-10-18T12:19:39.601641+0000","last_active":"2023-10-18T12:19:44.697183+0000","last_peered":"2023-10-18T12:19:44.697183+0000","last_clean":"2023-10-18T12:19:44.697183+0000","last_became_active":"2023-10-18T12:19:39.601275+0000","last_became_peered":"2023-10-18T12:19:39.601275+0000","last_unstale":"2023-10-18T12:19:44.697183+0000","last_undegraded":"2023-10-18T12:19:44.697183+0000","last_fullsized":"2023-10-18T12:19:44.697183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:43:39.713506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.699565+0000","last_change":"2023-10-18T12:19:43.665457+0000","last_active":"2023-10-18T12:19:44.699565+0000","last_peered":"2023-10-18T12:19:44.699565+0000","last_clean":"2023-10-18T12:19:44.699565+0000","last_became_active":"2023-10-18T12:19:43.665040+0000","last_became_peered":"2023-10-18T12:19:43.665040+0000","last_unstale":"2023-10-18T12:19:44.699565+0000","last_undegraded":"2023-10-18T12:19:44.699565+0000","last_fullsized":"2023-10-18T12:19:44.699565+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:45:20.383309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697555+0000","last_change":"2023-10-18T12:19:38.605141+0000","last_active":"2023-10-18T12:19:44.697555+0000","last_peered":"2023-10-18T12:19:44.697555+0000","last_clean":"2023-10-18T12:19:44.697555+0000","last_became_active":"2023-10-18T12:19:38.602562+0000","last_became_peered":"2023-10-18T12:19:38.602562+0000","last_unstale":"2023-10-18T12:19:44.697555+0000","last_undegraded":"2023-10-18T12:19:44.697555+0000","last_fullsized":"2023-10-18T12:19:44.697555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:27:56.749766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.646701+0000","last_change":"2023-10-18T12:19:39.610888+0000","last_active":"2023-10-18T12:19:44.646701+0000","last_peered":"2023-10-18T12:19:44.646701+0000","last_clean":"2023-10-18T12:19:44.646701+0000","last_became_active":"2023-10-18T12:19:39.610423+0000","last_became_peered":"2023-10-18T12:19:39.610423+0000","last_unstale":"2023-10-18T12:19:44.646701+0000","last_undegraded":"2023-10-18T12:19:44.646701+0000","last_fullsized":"2023-10-18T12:19:44.646701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:05:32.356553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698846+0000","last_change":"2023-10-18T12:19:43.660927+0000","last_active":"2023-10-18T12:19:44.698846+0000","last_peered":"2023-10-18T12:19:44.698846+0000","last_clean":"2023-10-18T12:19:44.698846+0000","last_became_active":"2023-10-18T12:19:43.660484+0000","last_became_peered":"2023-10-18T12:19:43.660484+0000","last_unstale":"2023-10-18T12:19:44.698846+0000","last_undegraded":"2023-10-18T12:19:44.698846+0000","last_fullsized":"2023-10-18T12:19:44.698846+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:23:40.463847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645234+0000","last_change":"2023-10-18T12:19:38.605794+0000","last_active":"2023-10-18T12:19:44.645234+0000","last_peered":"2023-10-18T12:19:44.645234+0000","last_clean":"2023-10-18T12:19:44.645234+0000","last_became_active":"2023-10-18T12:19:38.605484+0000","last_became_peered":"2023-10-18T12:19:38.605484+0000","last_unstale":"2023-10-18T12:19:44.645234+0000","last_undegraded":"2023-10-18T12:19:44.645234+0000","last_fullsized":"2023-10-18T12:19:44.645234+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:59:45.652080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696594+0000","last_change":"2023-10-18T12:19:39.611319+0000","last_active":"2023-10-18T12:19:44.696594+0000","last_peered":"2023-10-18T12:19:44.696594+0000","last_clean":"2023-10-18T12:19:44.696594+0000","last_became_active":"2023-10-18T12:19:39.610259+0000","last_became_peered":"2023-10-18T12:19:39.610259+0000","last_unstale":"2023-10-18T12:19:44.696594+0000","last_undegraded":"2023-10-18T12:19:44.696594+0000","last_fullsized":"2023-10-18T12:19:44.696594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:32:29.479925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696566+0000","last_change":"2023-10-18T12:19:43.660372+0000","last_active":"2023-10-18T12:19:44.696566+0000","last_peered":"2023-10-18T12:19:44.696566+0000","last_clean":"2023-10-18T12:19:44.696566+0000","last_became_active":"2023-10-18T12:19:43.659923+0000","last_became_peered":"2023-10-18T12:19:43.659923+0000","last_unstale":"2023-10-18T12:19:44.696566+0000","last_undegraded":"2023-10-18T12:19:44.696566+0000","last_fullsized":"2023-10-18T12:19:44.696566+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:18:29.969594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643863+0000","last_change":"2023-10-18T12:19:38.600796+0000","last_active":"2023-10-18T12:19:44.643863+0000","last_peered":"2023-10-18T12:19:44.643863+0000","last_clean":"2023-10-18T12:19:44.643863+0000","last_became_active":"2023-10-18T12:19:38.599899+0000","last_became_peered":"2023-10-18T12:19:38.599899+0000","last_unstale":"2023-10-18T12:19:44.643863+0000","last_undegraded":"2023-10-18T12:19:44.643863+0000","last_fullsized":"2023-10-18T12:19:44.643863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:01:12.525756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.699060+0000","last_change":"2023-10-18T12:19:39.607533+0000","last_active":"2023-10-18T12:19:44.699060+0000","last_peered":"2023-10-18T12:19:44.699060+0000","last_clean":"2023-10-18T12:19:44.699060+0000","last_became_active":"2023-10-18T12:19:39.604286+0000","last_became_peered":"2023-10-18T12:19:39.604286+0000","last_unstale":"2023-10-18T12:19:44.699060+0000","last_undegraded":"2023-10-18T12:19:44.699060+0000","last_fullsized":"2023-10-18T12:19:44.699060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:30:22.876433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643667+0000","last_change":"2023-10-18T12:19:39.621418+0000","last_active":"2023-10-18T12:19:44.643667+0000","last_peered":"2023-10-18T12:19:44.643667+0000","last_clean":"2023-10-18T12:19:44.643667+0000","last_became_active":"2023-10-18T12:19:39.621162+0000","last_became_peered":"2023-10-18T12:19:39.621162+0000","last_unstale":"2023-10-18T12:19:44.643667+0000","last_undegraded":"2023-10-18T12:19:44.643667+0000","last_fullsized":"2023-10-18T12:19:44.643667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:31:24.099669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697070+0000","last_change":"2023-10-18T12:19:38.602741+0000","last_active":"2023-10-18T12:19:44.697070+0000","last_peered":"2023-10-18T12:19:44.697070+0000","last_clean":"2023-10-18T12:19:44.697070+0000","last_became_active":"2023-10-18T12:19:38.598808+0000","last_became_peered":"2023-10-18T12:19:38.598808+0000","last_unstale":"2023-10-18T12:19:44.697070+0000","last_undegraded":"2023-10-18T12:19:44.697070+0000","last_fullsized":"2023-10-18T12:19:44.697070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:09:00.392656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697485+0000","last_change":"2023-10-18T12:19:43.662507+0000","last_active":"2023-10-18T12:19:44.697485+0000","last_peered":"2023-10-18T12:19:44.697485+0000","last_clean":"2023-10-18T12:19:44.697485+0000","last_became_active":"2023-10-18T12:19:43.662090+0000","last_became_peered":"2023-10-18T12:19:43.662090+0000","last_unstale":"2023-10-18T12:19:44.697485+0000","last_undegraded":"2023-10-18T12:19:44.697485+0000","last_fullsized":"2023-10-18T12:19:44.697485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:36:54.990254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.644101+0000","last_change":"2023-10-18T12:19:39.612100+0000","last_active":"2023-10-18T12:19:44.644101+0000","last_peered":"2023-10-18T12:19:44.644101+0000","last_clean":"2023-10-18T12:19:44.644101+0000","last_became_active":"2023-10-18T12:19:39.611788+0000","last_became_peered":"2023-10-18T12:19:39.611788+0000","last_unstale":"2023-10-18T12:19:44.644101+0000","last_undegraded":"2023-10-18T12:19:44.644101+0000","last_fullsized":"2023-10-18T12:19:44.644101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:18:25.911752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697553+0000","last_change":"2023-10-18T12:19:38.609638+0000","last_active":"2023-10-18T12:19:44.697553+0000","last_peered":"2023-10-18T12:19:44.697553+0000","last_clean":"2023-10-18T12:19:44.697553+0000","last_became_active":"2023-10-18T12:19:38.609318+0000","last_became_peered":"2023-10-18T12:19:38.609318+0000","last_unstale":"2023-10-18T12:19:44.697553+0000","last_undegraded":"2023-10-18T12:19:44.697553+0000","last_fullsized":"2023-10-18T12:19:44.697553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:58:15.868092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.641909+0000","last_change":"2023-10-18T12:19:43.668265+0000","last_active":"2023-10-18T12:19:44.641909+0000","last_peered":"2023-10-18T12:19:44.641909+0000","last_clean":"2023-10-18T12:19:44.641909+0000","last_became_active":"2023-10-18T12:19:43.667706+0000","last_became_peered":"2023-10-18T12:19:43.667706+0000","last_unstale":"2023-10-18T12:19:44.641909+0000","last_undegraded":"2023-10-18T12:19:44.641909+0000","last_fullsized":"2023-10-18T12:19:44.641909+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:49:04.109094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643379+0000","last_change":"2023-10-18T12:19:38.601819+0000","last_active":"2023-10-18T12:19:44.643379+0000","last_peered":"2023-10-18T12:19:44.643379+0000","last_clean":"2023-10-18T12:19:44.643379+0000","last_became_active":"2023-10-18T12:19:38.601414+0000","last_became_peered":"2023-10-18T12:19:38.601414+0000","last_unstale":"2023-10-18T12:19:44.643379+0000","last_undegraded":"2023-10-18T12:19:44.643379+0000","last_fullsized":"2023-10-18T12:19:44.643379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:43:42.560410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645163+0000","last_change":"2023-10-18T12:19:39.601170+0000","last_active":"2023-10-18T12:19:44.645163+0000","last_peered":"2023-10-18T12:19:44.645163+0000","last_clean":"2023-10-18T12:19:44.645163+0000","last_became_active":"2023-10-18T12:19:39.600901+0000","last_became_peered":"2023-10-18T12:19:39.600901+0000","last_unstale":"2023-10-18T12:19:44.645163+0000","last_undegraded":"2023-10-18T12:19:44.645163+0000","last_fullsized":"2023-10-18T12:19:44.645163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:23:37.730513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.644364+0000","last_change":"2023-10-18T12:19:43.668816+0000","last_active":"2023-10-18T12:19:44.644364+0000","last_peered":"2023-10-18T12:19:44.644364+0000","last_clean":"2023-10-18T12:19:44.644364+0000","last_became_active":"2023-10-18T12:19:43.668451+0000","last_became_peered":"2023-10-18T12:19:43.668451+0000","last_unstale":"2023-10-18T12:19:44.644364+0000","last_undegraded":"2023-10-18T12:19:44.644364+0000","last_fullsized":"2023-10-18T12:19:44.644364+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:32:33.537768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"28'10","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:58.003436+0000","last_change":"2023-10-18T12:19:38.605016+0000","last_active":"2023-10-18T12:19:58.003436+0000","last_peered":"2023-10-18T12:19:58.003436+0000","last_clean":"2023-10-18T12:19:58.003436+0000","last_became_active":"2023-10-18T12:19:38.604703+0000","last_became_peered":"2023-10-18T12:19:38.604703+0000","last_unstale":"2023-10-18T12:19:58.003436+0000","last_undegraded":"2023-10-18T12:19:58.003436+0000","last_fullsized":"2023-10-18T12:19:58.003436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:02:17.952362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698575+0000","last_change":"2023-10-18T12:19:39.615377+0000","last_active":"2023-10-18T12:19:44.698575+0000","last_peered":"2023-10-18T12:19:44.698575+0000","last_clean":"2023-10-18T12:19:44.698575+0000","last_became_active":"2023-10-18T12:19:39.610424+0000","last_became_peered":"2023-10-18T12:19:39.610424+0000","last_unstale":"2023-10-18T12:19:44.698575+0000","last_undegraded":"2023-10-18T12:19:44.698575+0000","last_fullsized":"2023-10-18T12:19:44.698575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:28:58.787021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645013+0000","last_change":"2023-10-18T12:19:43.680946+0000","last_active":"2023-10-18T12:19:44.645013+0000","last_peered":"2023-10-18T12:19:44.645013+0000","last_clean":"2023-10-18T12:19:44.645013+0000","last_became_active":"2023-10-18T12:19:43.680542+0000","last_became_peered":"2023-10-18T12:19:43.680542+0000","last_unstale":"2023-10-18T12:19:44.645013+0000","last_undegraded":"2023-10-18T12:19:44.645013+0000","last_fullsized":"2023-10-18T12:19:44.645013+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:32:33.537768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696164+0000","last_change":"2023-10-18T12:19:39.602742+0000","last_active":"2023-10-18T12:19:44.696164+0000","last_peered":"2023-10-18T12:19:44.696164+0000","last_clean":"2023-10-18T12:19:44.696164+0000","last_became_active":"2023-10-18T12:19:39.602504+0000","last_became_peered":"2023-10-18T12:19:39.602504+0000","last_unstale":"2023-10-18T12:19:44.696164+0000","last_undegraded":"2023-10-18T12:19:44.696164+0000","last_fullsized":"2023-10-18T12:19:44.696164+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:55:47.767344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.699228+0000","last_change":"2023-10-18T12:19:33.531672+0000","last_active":"2023-10-18T12:19:44.699228+0000","last_peered":"2023-10-18T12:19:44.699228+0000","last_clean":"2023-10-18T12:19:44.699228+0000","last_became_active":"2023-10-18T12:19:33.530907+0000","last_became_peered":"2023-10-18T12:19:33.530907+0000","last_unstale":"2023-10-18T12:19:44.699228+0000","last_undegraded":"2023-10-18T12:19:44.699228+0000","last_fullsized":"2023-10-18T12:19:44.699228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:22:58.092944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696857+0000","last_change":"2023-10-18T12:19:38.601615+0000","last_active":"2023-10-18T12:19:44.696857+0000","last_peered":"2023-10-18T12:19:44.696857+0000","last_clean":"2023-10-18T12:19:44.696857+0000","last_became_active":"2023-10-18T12:19:38.601084+0000","last_became_peered":"2023-10-18T12:19:38.601084+0000","last_unstale":"2023-10-18T12:19:44.696857+0000","last_undegraded":"2023-10-18T12:19:44.696857+0000","last_fullsized":"2023-10-18T12:19:44.696857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:34:43.885197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643565+0000","last_change":"2023-10-18T12:19:43.679066+0000","last_active":"2023-10-18T12:19:44.643565+0000","last_peered":"2023-10-18T12:19:44.643565+0000","last_clean":"2023-10-18T12:19:44.643565+0000","last_became_active":"2023-10-18T12:19:43.673105+0000","last_became_peered":"2023-10-18T12:19:43.673105+0000","last_unstale":"2023-10-18T12:19:44.643565+0000","last_undegraded":"2023-10-18T12:19:44.643565+0000","last_fullsized":"2023-10-18T12:19:44.643565+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:25:02.951956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643788+0000","last_change":"2023-10-18T12:19:39.620976+0000","last_active":"2023-10-18T12:19:44.643788+0000","last_peered":"2023-10-18T12:19:44.643788+0000","last_clean":"2023-10-18T12:19:44.643788+0000","last_became_active":"2023-10-18T12:19:39.620577+0000","last_became_peered":"2023-10-18T12:19:39.620577+0000","last_unstale":"2023-10-18T12:19:44.643788+0000","last_undegraded":"2023-10-18T12:19:44.643788+0000","last_fullsized":"2023-10-18T12:19:44.643788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:49:00.051251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.646821+0000","last_change":"2023-10-18T12:19:33.529329+0000","last_active":"2023-10-18T12:19:44.646821+0000","last_peered":"2023-10-18T12:19:44.646821+0000","last_clean":"2023-10-18T12:19:44.646821+0000","last_became_active":"2023-10-18T12:19:33.528930+0000","last_became_peered":"2023-10-18T12:19:33.528930+0000","last_unstale":"2023-10-18T12:19:44.646821+0000","last_undegraded":"2023-10-18T12:19:44.646821+0000","last_fullsized":"2023-10-18T12:19:44.646821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:59:29.698792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.646312+0000","last_change":"2023-10-18T12:19:38.602384+0000","last_active":"2023-10-18T12:19:44.646312+0000","last_peered":"2023-10-18T12:19:44.646312+0000","last_clean":"2023-10-18T12:19:44.646312+0000","last_became_active":"2023-10-18T12:19:38.602036+0000","last_became_peered":"2023-10-18T12:19:38.602036+0000","last_unstale":"2023-10-18T12:19:44.646312+0000","last_undegraded":"2023-10-18T12:19:44.646312+0000","last_fullsized":"2023-10-18T12:19:44.646312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:31:40.396673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695771+0000","last_change":"2023-10-18T12:19:43.665880+0000","last_active":"2023-10-18T12:19:44.695771+0000","last_peered":"2023-10-18T12:19:44.695771+0000","last_clean":"2023-10-18T12:19:44.695771+0000","last_became_active":"2023-10-18T12:19:43.665304+0000","last_became_peered":"2023-10-18T12:19:43.665304+0000","last_unstale":"2023-10-18T12:19:44.695771+0000","last_undegraded":"2023-10-18T12:19:44.695771+0000","last_fullsized":"2023-10-18T12:19:44.695771+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:41:00.366869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696091+0000","last_change":"2023-10-18T12:19:39.610495+0000","last_active":"2023-10-18T12:19:44.696091+0000","last_peered":"2023-10-18T12:19:44.696091+0000","last_clean":"2023-10-18T12:19:44.696091+0000","last_became_active":"2023-10-18T12:19:39.610070+0000","last_became_peered":"2023-10-18T12:19:39.610070+0000","last_unstale":"2023-10-18T12:19:44.696091+0000","last_undegraded":"2023-10-18T12:19:44.696091+0000","last_fullsized":"2023-10-18T12:19:44.696091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:49:00.051251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643554+0000","last_change":"2023-10-18T12:19:33.703565+0000","last_active":"2023-10-18T12:19:44.643554+0000","last_peered":"2023-10-18T12:19:44.643554+0000","last_clean":"2023-10-18T12:19:44.643554+0000","last_became_active":"2023-10-18T12:19:33.703276+0000","last_became_peered":"2023-10-18T12:19:33.703276+0000","last_unstale":"2023-10-18T12:19:44.643554+0000","last_undegraded":"2023-10-18T12:19:44.643554+0000","last_fullsized":"2023-10-18T12:19:44.643554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:42:02.281340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645909+0000","last_change":"2023-10-18T12:19:38.596831+0000","last_active":"2023-10-18T12:19:44.645909+0000","last_peered":"2023-10-18T12:19:44.645909+0000","last_clean":"2023-10-18T12:19:44.645909+0000","last_became_active":"2023-10-18T12:19:38.595274+0000","last_became_peered":"2023-10-18T12:19:38.595274+0000","last_unstale":"2023-10-18T12:19:44.645909+0000","last_undegraded":"2023-10-18T12:19:44.645909+0000","last_fullsized":"2023-10-18T12:19:44.645909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:43:42.560410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697865+0000","last_change":"2023-10-18T12:19:43.684545+0000","last_active":"2023-10-18T12:19:44.697865+0000","last_peered":"2023-10-18T12:19:44.697865+0000","last_clean":"2023-10-18T12:19:44.697865+0000","last_became_active":"2023-10-18T12:19:43.684147+0000","last_became_peered":"2023-10-18T12:19:43.684147+0000","last_unstale":"2023-10-18T12:19:44.697865+0000","last_undegraded":"2023-10-18T12:19:44.697865+0000","last_fullsized":"2023-10-18T12:19:44.697865+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:35:30.070714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645280+0000","last_change":"2023-10-18T12:19:39.611289+0000","last_active":"2023-10-18T12:19:44.645280+0000","last_peered":"2023-10-18T12:19:44.645280+0000","last_clean":"2023-10-18T12:19:44.645280+0000","last_became_active":"2023-10-18T12:19:39.610978+0000","last_became_peered":"2023-10-18T12:19:39.610978+0000","last_unstale":"2023-10-18T12:19:44.645280+0000","last_undegraded":"2023-10-18T12:19:44.645280+0000","last_fullsized":"2023-10-18T12:19:44.645280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:34:44.895130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.646099+0000","last_change":"2023-10-18T12:19:33.703109+0000","last_active":"2023-10-18T12:19:44.646099+0000","last_peered":"2023-10-18T12:19:44.646099+0000","last_clean":"2023-10-18T12:19:44.646099+0000","last_became_active":"2023-10-18T12:19:33.702456+0000","last_became_peered":"2023-10-18T12:19:33.702456+0000","last_unstale":"2023-10-18T12:19:44.646099+0000","last_undegraded":"2023-10-18T12:19:44.646099+0000","last_fullsized":"2023-10-18T12:19:44.646099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:31:35.345173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698372+0000","last_change":"2023-10-18T12:19:38.608530+0000","last_active":"2023-10-18T12:19:44.698372+0000","last_peered":"2023-10-18T12:19:44.698372+0000","last_clean":"2023-10-18T12:19:44.698372+0000","last_became_active":"2023-10-18T12:19:38.608220+0000","last_became_peered":"2023-10-18T12:19:38.608220+0000","last_unstale":"2023-10-18T12:19:44.698372+0000","last_undegraded":"2023-10-18T12:19:44.698372+0000","last_fullsized":"2023-10-18T12:19:44.698372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:18:53.495055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695872+0000","last_change":"2023-10-18T12:19:43.675239+0000","last_active":"2023-10-18T12:19:44.695872+0000","last_peered":"2023-10-18T12:19:44.695872+0000","last_clean":"2023-10-18T12:19:44.695872+0000","last_became_active":"2023-10-18T12:19:43.674815+0000","last_became_peered":"2023-10-18T12:19:43.674815+0000","last_unstale":"2023-10-18T12:19:44.695872+0000","last_undegraded":"2023-10-18T12:19:44.695872+0000","last_fullsized":"2023-10-18T12:19:44.695872+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:31:28.157512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645878+0000","last_change":"2023-10-18T12:19:39.603090+0000","last_active":"2023-10-18T12:19:44.645878+0000","last_peered":"2023-10-18T12:19:44.645878+0000","last_clean":"2023-10-18T12:19:44.645878+0000","last_became_active":"2023-10-18T12:19:39.602663+0000","last_became_peered":"2023-10-18T12:19:39.602663+0000","last_unstale":"2023-10-18T12:19:44.645878+0000","last_undegraded":"2023-10-18T12:19:44.645878+0000","last_fullsized":"2023-10-18T12:19:44.645878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:38:42.744745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698813+0000","last_change":"2023-10-18T12:19:38.605786+0000","last_active":"2023-10-18T12:19:44.698813+0000","last_peered":"2023-10-18T12:19:44.698813+0000","last_clean":"2023-10-18T12:19:44.698813+0000","last_became_active":"2023-10-18T12:19:38.605372+0000","last_became_peered":"2023-10-18T12:19:38.605372+0000","last_unstale":"2023-10-18T12:19:44.698813+0000","last_undegraded":"2023-10-18T12:19:44.698813+0000","last_fullsized":"2023-10-18T12:19:44.698813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:50:26.536151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696981+0000","last_change":"2023-10-18T12:19:33.533449+0000","last_active":"2023-10-18T12:19:44.696981+0000","last_peered":"2023-10-18T12:19:44.696981+0000","last_clean":"2023-10-18T12:19:44.696981+0000","last_became_active":"2023-10-18T12:19:33.533051+0000","last_became_peered":"2023-10-18T12:19:33.533051+0000","last_unstale":"2023-10-18T12:19:44.696981+0000","last_undegraded":"2023-10-18T12:19:44.696981+0000","last_fullsized":"2023-10-18T12:19:44.696981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:59:40.600580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696368+0000","last_change":"2023-10-18T12:19:43.667926+0000","last_active":"2023-10-18T12:19:44.696368+0000","last_peered":"2023-10-18T12:19:44.696368+0000","last_clean":"2023-10-18T12:19:44.696368+0000","last_became_active":"2023-10-18T12:19:43.663720+0000","last_became_peered":"2023-10-18T12:19:43.663720+0000","last_unstale":"2023-10-18T12:19:44.696368+0000","last_undegraded":"2023-10-18T12:19:44.696368+0000","last_fullsized":"2023-10-18T12:19:44.696368+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:45.224238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.646131+0000","last_change":"2023-10-18T12:19:39.611317+0000","last_active":"2023-10-18T12:19:44.646131+0000","last_peered":"2023-10-18T12:19:44.646131+0000","last_clean":"2023-10-18T12:19:44.646131+0000","last_became_active":"2023-10-18T12:19:39.610493+0000","last_became_peered":"2023-10-18T12:19:39.610493+0000","last_unstale":"2023-10-18T12:19:44.646131+0000","last_undegraded":"2023-10-18T12:19:44.646131+0000","last_fullsized":"2023-10-18T12:19:44.646131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:05:32.356553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.644024+0000","last_change":"2023-10-18T12:19:38.600081+0000","last_active":"2023-10-18T12:19:44.644024+0000","last_peered":"2023-10-18T12:19:44.644024+0000","last_clean":"2023-10-18T12:19:44.644024+0000","last_became_active":"2023-10-18T12:19:38.599770+0000","last_became_peered":"2023-10-18T12:19:38.599770+0000","last_unstale":"2023-10-18T12:19:44.644024+0000","last_undegraded":"2023-10-18T12:19:44.644024+0000","last_fullsized":"2023-10-18T12:19:44.644024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:40.156462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.694556+0000","last_change":"2023-10-18T12:19:33.530766+0000","last_active":"2023-10-18T12:19:44.694556+0000","last_peered":"2023-10-18T12:19:44.694556+0000","last_clean":"2023-10-18T12:19:44.694556+0000","last_became_active":"2023-10-18T12:19:33.530346+0000","last_became_peered":"2023-10-18T12:19:33.530346+0000","last_unstale":"2023-10-18T12:19:44.694556+0000","last_undegraded":"2023-10-18T12:19:44.694556+0000","last_fullsized":"2023-10-18T12:19:44.694556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:37:23.298891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697536+0000","last_change":"2023-10-18T12:19:43.670666+0000","last_active":"2023-10-18T12:19:44.697536+0000","last_peered":"2023-10-18T12:19:44.697536+0000","last_clean":"2023-10-18T12:19:44.697536+0000","last_became_active":"2023-10-18T12:19:43.667345+0000","last_became_peered":"2023-10-18T12:19:43.667345+0000","last_unstale":"2023-10-18T12:19:44.697536+0000","last_undegraded":"2023-10-18T12:19:44.697536+0000","last_fullsized":"2023-10-18T12:19:44.697536+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:49:32.050231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696679+0000","last_change":"2023-10-18T12:19:39.619910+0000","last_active":"2023-10-18T12:19:44.696679+0000","last_peered":"2023-10-18T12:19:44.696679+0000","last_clean":"2023-10-18T12:19:44.696679+0000","last_became_active":"2023-10-18T12:19:39.619657+0000","last_became_peered":"2023-10-18T12:19:39.619657+0000","last_unstale":"2023-10-18T12:19:44.696679+0000","last_undegraded":"2023-10-18T12:19:44.696679+0000","last_fullsized":"2023-10-18T12:19:44.696679+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:59:46.662013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695598+0000","last_change":"2023-10-18T12:19:38.605421+0000","last_active":"2023-10-18T12:19:44.695598+0000","last_peered":"2023-10-18T12:19:44.695598+0000","last_clean":"2023-10-18T12:19:44.695598+0000","last_became_active":"2023-10-18T12:19:38.605087+0000","last_became_peered":"2023-10-18T12:19:38.605087+0000","last_unstale":"2023-10-18T12:19:44.695598+0000","last_undegraded":"2023-10-18T12:19:44.695598+0000","last_fullsized":"2023-10-18T12:19:44.695598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:24:57.884181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.642271+0000","last_change":"2023-10-18T12:19:33.528538+0000","last_active":"2023-10-18T12:19:44.642271+0000","last_peered":"2023-10-18T12:19:44.642271+0000","last_clean":"2023-10-18T12:19:44.642271+0000","last_became_active":"2023-10-18T12:19:33.528214+0000","last_became_peered":"2023-10-18T12:19:33.528214+0000","last_unstale":"2023-10-18T12:19:44.642271+0000","last_undegraded":"2023-10-18T12:19:44.642271+0000","last_fullsized":"2023-10-18T12:19:44.642271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:16:35.962010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697181+0000","last_change":"2023-10-18T12:19:43.676292+0000","last_active":"2023-10-18T12:19:44.697181+0000","last_peered":"2023-10-18T12:19:44.697181+0000","last_clean":"2023-10-18T12:19:44.697181+0000","last_became_active":"2023-10-18T12:19:43.674659+0000","last_became_peered":"2023-10-18T12:19:43.674659+0000","last_unstale":"2023-10-18T12:19:44.697181+0000","last_undegraded":"2023-10-18T12:19:44.697181+0000","last_fullsized":"2023-10-18T12:19:44.697181+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:33:03.308142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.699094+0000","last_change":"2023-10-18T12:19:39.623370+0000","last_active":"2023-10-18T12:19:44.699094+0000","last_peered":"2023-10-18T12:19:44.699094+0000","last_clean":"2023-10-18T12:19:44.699094+0000","last_became_active":"2023-10-18T12:19:39.623099+0000","last_became_peered":"2023-10-18T12:19:39.623099+0000","last_unstale":"2023-10-18T12:19:44.699094+0000","last_undegraded":"2023-10-18T12:19:44.699094+0000","last_fullsized":"2023-10-18T12:19:44.699094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:08:54.031805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.644370+0000","last_change":"2023-10-18T12:19:38.601266+0000","last_active":"2023-10-18T12:19:44.644370+0000","last_peered":"2023-10-18T12:19:44.644370+0000","last_clean":"2023-10-18T12:19:44.644370+0000","last_became_active":"2023-10-18T12:19:38.600945+0000","last_became_peered":"2023-10-18T12:19:38.600945+0000","last_unstale":"2023-10-18T12:19:44.644370+0000","last_undegraded":"2023-10-18T12:19:44.644370+0000","last_fullsized":"2023-10-18T12:19:44.644370+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:23:36.720579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697162+0000","last_change":"2023-10-18T12:19:33.531214+0000","last_active":"2023-10-18T12:19:44.697162+0000","last_peered":"2023-10-18T12:19:44.697162+0000","last_clean":"2023-10-18T12:19:44.697162+0000","last_became_active":"2023-10-18T12:19:33.530795+0000","last_became_peered":"2023-10-18T12:19:33.530795+0000","last_unstale":"2023-10-18T12:19:44.697162+0000","last_undegraded":"2023-10-18T12:19:44.697162+0000","last_fullsized":"2023-10-18T12:19:44.697162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:08:55.341156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":181,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.642373+0000","last_change":"2023-10-18T12:19:28.825371+0000","last_active":"2023-10-18T12:19:44.642373+0000","last_peered":"2023-10-18T12:19:44.642373+0000","last_clean":"2023-10-18T12:19:44.642373+0000","last_became_active":"2023-10-18T12:19:28.822484+0000","last_became_peered":"2023-10-18T12:19:28.822484+0000","last_unstale":"2023-10-18T12:19:44.642373+0000","last_undegraded":"2023-10-18T12:19:44.642373+0000","last_fullsized":"2023-10-18T12:19:44.642373+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:27.318899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:27.318899+0000","last_clean_scrub_stamp":"2023-10-18T12:19:27.318899+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:18:14.674282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643196+0000","last_change":"2023-10-18T12:19:43.657137+0000","last_active":"2023-10-18T12:19:44.643196+0000","last_peered":"2023-10-18T12:19:44.643196+0000","last_clean":"2023-10-18T12:19:44.643196+0000","last_became_active":"2023-10-18T12:19:43.656656+0000","last_became_peered":"2023-10-18T12:19:43.656656+0000","last_unstale":"2023-10-18T12:19:44.643196+0000","last_undegraded":"2023-10-18T12:19:44.643196+0000","last_fullsized":"2023-10-18T12:19:44.643196+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:38:46.802588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.646062+0000","last_change":"2023-10-18T12:19:39.616876+0000","last_active":"2023-10-18T12:19:44.646062+0000","last_peered":"2023-10-18T12:19:44.646062+0000","last_clean":"2023-10-18T12:19:44.646062+0000","last_became_active":"2023-10-18T12:19:39.616565+0000","last_became_peered":"2023-10-18T12:19:39.616565+0000","last_unstale":"2023-10-18T12:19:44.646062+0000","last_undegraded":"2023-10-18T12:19:44.646062+0000","last_fullsized":"2023-10-18T12:19:44.646062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:42:08.342773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643925+0000","last_change":"2023-10-18T12:19:38.594539+0000","last_active":"2023-10-18T12:19:44.643925+0000","last_peered":"2023-10-18T12:19:44.643925+0000","last_clean":"2023-10-18T12:19:44.643925+0000","last_became_active":"2023-10-18T12:19:38.594225+0000","last_became_peered":"2023-10-18T12:19:38.594225+0000","last_unstale":"2023-10-18T12:19:44.643925+0000","last_undegraded":"2023-10-18T12:19:44.643925+0000","last_fullsized":"2023-10-18T12:19:44.643925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:16:41.013510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.700323+0000","last_change":"2023-10-18T12:19:43.671582+0000","last_active":"2023-10-18T12:19:44.700323+0000","last_peered":"2023-10-18T12:19:44.700323+0000","last_clean":"2023-10-18T12:19:44.700323+0000","last_became_active":"2023-10-18T12:19:43.671279+0000","last_became_peered":"2023-10-18T12:19:43.671279+0000","last_unstale":"2023-10-18T12:19:44.700323+0000","last_undegraded":"2023-10-18T12:19:44.700323+0000","last_fullsized":"2023-10-18T12:19:44.700323+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:54:13.369092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.700346+0000","last_change":"2023-10-18T12:19:39.624301+0000","last_active":"2023-10-18T12:19:44.700346+0000","last_peered":"2023-10-18T12:19:44.700346+0000","last_clean":"2023-10-18T12:19:44.700346+0000","last_became_active":"2023-10-18T12:19:39.624019+0000","last_became_peered":"2023-10-18T12:19:39.624019+0000","last_unstale":"2023-10-18T12:19:44.700346+0000","last_undegraded":"2023-10-18T12:19:44.700346+0000","last_fullsized":"2023-10-18T12:19:44.700346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:21:14.469134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696174+0000","last_change":"2023-10-18T12:19:38.605246+0000","last_active":"2023-10-18T12:19:44.696174+0000","last_peered":"2023-10-18T12:19:44.696174+0000","last_clean":"2023-10-18T12:19:44.696174+0000","last_became_active":"2023-10-18T12:19:38.604738+0000","last_became_peered":"2023-10-18T12:19:38.604738+0000","last_unstale":"2023-10-18T12:19:44.696174+0000","last_undegraded":"2023-10-18T12:19:44.696174+0000","last_fullsized":"2023-10-18T12:19:44.696174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:00:56.609231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696949+0000","last_change":"2023-10-18T12:19:43.682631+0000","last_active":"2023-10-18T12:19:44.696949+0000","last_peered":"2023-10-18T12:19:44.696949+0000","last_clean":"2023-10-18T12:19:44.696949+0000","last_became_active":"2023-10-18T12:19:43.681887+0000","last_became_peered":"2023-10-18T12:19:43.681887+0000","last_unstale":"2023-10-18T12:19:44.696949+0000","last_undegraded":"2023-10-18T12:19:44.696949+0000","last_fullsized":"2023-10-18T12:19:44.696949+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:23:41.788355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.700050+0000","last_change":"2023-10-18T12:19:39.611350+0000","last_active":"2023-10-18T12:19:44.700050+0000","last_peered":"2023-10-18T12:19:44.700050+0000","last_clean":"2023-10-18T12:19:44.700050+0000","last_became_active":"2023-10-18T12:19:39.610723+0000","last_became_peered":"2023-10-18T12:19:39.610723+0000","last_unstale":"2023-10-18T12:19:44.700050+0000","last_undegraded":"2023-10-18T12:19:44.700050+0000","last_fullsized":"2023-10-18T12:19:44.700050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:06:02.990692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698303+0000","last_change":"2023-10-18T12:19:38.606971+0000","last_active":"2023-10-18T12:19:44.698303+0000","last_peered":"2023-10-18T12:19:44.698303+0000","last_clean":"2023-10-18T12:19:44.698303+0000","last_became_active":"2023-10-18T12:19:38.606625+0000","last_became_peered":"2023-10-18T12:19:38.606625+0000","last_unstale":"2023-10-18T12:19:44.698303+0000","last_undegraded":"2023-10-18T12:19:44.698303+0000","last_fullsized":"2023-10-18T12:19:44.698303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:28:59.066223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645449+0000","last_change":"2023-10-18T12:19:43.674060+0000","last_active":"2023-10-18T12:19:44.645449+0000","last_peered":"2023-10-18T12:19:44.645449+0000","last_clean":"2023-10-18T12:19:44.645449+0000","last_became_active":"2023-10-18T12:19:43.672680+0000","last_became_peered":"2023-10-18T12:19:43.672680+0000","last_unstale":"2023-10-18T12:19:44.645449+0000","last_undegraded":"2023-10-18T12:19:44.645449+0000","last_fullsized":"2023-10-18T12:19:44.645449+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:33:03.308142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.699845+0000","last_change":"2023-10-18T12:19:39.620744+0000","last_active":"2023-10-18T12:19:44.699845+0000","last_peered":"2023-10-18T12:19:44.699845+0000","last_clean":"2023-10-18T12:19:44.699845+0000","last_became_active":"2023-10-18T12:19:39.619969+0000","last_became_peered":"2023-10-18T12:19:39.619969+0000","last_unstale":"2023-10-18T12:19:44.699845+0000","last_undegraded":"2023-10-18T12:19:44.699845+0000","last_fullsized":"2023-10-18T12:19:44.699845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:49:43.494684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.644662+0000","last_change":"2023-10-18T12:19:38.602475+0000","last_active":"2023-10-18T12:19:44.644662+0000","last_peered":"2023-10-18T12:19:44.644662+0000","last_clean":"2023-10-18T12:19:44.644662+0000","last_became_active":"2023-10-18T12:19:38.602195+0000","last_became_peered":"2023-10-18T12:19:38.602195+0000","last_unstale":"2023-10-18T12:19:44.644662+0000","last_undegraded":"2023-10-18T12:19:44.644662+0000","last_fullsized":"2023-10-18T12:19:44.644662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:32:58.240366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696887+0000","last_change":"2023-10-18T12:19:43.682795+0000","last_active":"2023-10-18T12:19:44.696887+0000","last_peered":"2023-10-18T12:19:44.696887+0000","last_clean":"2023-10-18T12:19:44.696887+0000","last_became_active":"2023-10-18T12:19:43.680710+0000","last_became_peered":"2023-10-18T12:19:43.680710+0000","last_unstale":"2023-10-18T12:19:44.696887+0000","last_undegraded":"2023-10-18T12:19:44.696887+0000","last_fullsized":"2023-10-18T12:19:44.696887+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:00:53.354798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695979+0000","last_change":"2023-10-18T12:19:39.620575+0000","last_active":"2023-10-18T12:19:44.695979+0000","last_peered":"2023-10-18T12:19:44.695979+0000","last_clean":"2023-10-18T12:19:44.695979+0000","last_became_active":"2023-10-18T12:19:39.620291+0000","last_became_peered":"2023-10-18T12:19:39.620291+0000","last_unstale":"2023-10-18T12:19:44.695979+0000","last_undegraded":"2023-10-18T12:19:44.695979+0000","last_fullsized":"2023-10-18T12:19:44.695979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:08:55.947222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698645+0000","last_change":"2023-10-18T12:19:38.607039+0000","last_active":"2023-10-18T12:19:44.698645+0000","last_peered":"2023-10-18T12:19:44.698645+0000","last_clean":"2023-10-18T12:19:44.698645+0000","last_became_active":"2023-10-18T12:19:38.606732+0000","last_became_peered":"2023-10-18T12:19:38.606732+0000","last_unstale":"2023-10-18T12:19:44.698645+0000","last_undegraded":"2023-10-18T12:19:44.698645+0000","last_fullsized":"2023-10-18T12:19:44.698645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:59:34.750292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695219+0000","last_change":"2023-10-18T12:19:43.670138+0000","last_active":"2023-10-18T12:19:44.695219+0000","last_peered":"2023-10-18T12:19:44.695219+0000","last_clean":"2023-10-18T12:19:44.695219+0000","last_became_active":"2023-10-18T12:19:43.665610+0000","last_became_peered":"2023-10-18T12:19:43.665610+0000","last_unstale":"2023-10-18T12:19:44.695219+0000","last_undegraded":"2023-10-18T12:19:44.695219+0000","last_fullsized":"2023-10-18T12:19:44.695219+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:28:00.580454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697978+0000","last_change":"2023-10-18T12:19:39.595036+0000","last_active":"2023-10-18T12:19:44.697978+0000","last_peered":"2023-10-18T12:19:44.697978+0000","last_clean":"2023-10-18T12:19:44.697978+0000","last_became_active":"2023-10-18T12:19:39.594790+0000","last_became_peered":"2023-10-18T12:19:39.594790+0000","last_unstale":"2023-10-18T12:19:44.697978+0000","last_undegraded":"2023-10-18T12:19:44.697978+0000","last_fullsized":"2023-10-18T12:19:44.697978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:36:35.120486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643398+0000","last_change":"2023-10-18T12:19:38.600268+0000","last_active":"2023-10-18T12:19:44.643398+0000","last_peered":"2023-10-18T12:19:44.643398+0000","last_clean":"2023-10-18T12:19:44.643398+0000","last_became_active":"2023-10-18T12:19:38.599435+0000","last_became_peered":"2023-10-18T12:19:38.599435+0000","last_unstale":"2023-10-18T12:19:44.643398+0000","last_undegraded":"2023-10-18T12:19:44.643398+0000","last_fullsized":"2023-10-18T12:19:44.643398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:58:15.868092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.694660+0000","last_change":"2023-10-18T12:19:43.670918+0000","last_active":"2023-10-18T12:19:44.694660+0000","last_peered":"2023-10-18T12:19:44.694660+0000","last_clean":"2023-10-18T12:19:44.694660+0000","last_became_active":"2023-10-18T12:19:43.670175+0000","last_became_peered":"2023-10-18T12:19:43.670175+0000","last_unstale":"2023-10-18T12:19:44.694660+0000","last_undegraded":"2023-10-18T12:19:44.694660+0000","last_fullsized":"2023-10-18T12:19:44.694660+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:44:28.672709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696009+0000","last_change":"2023-10-18T12:19:39.610440+0000","last_active":"2023-10-18T12:19:44.696009+0000","last_peered":"2023-10-18T12:19:44.696009+0000","last_clean":"2023-10-18T12:19:44.696009+0000","last_became_active":"2023-10-18T12:19:39.610144+0000","last_became_peered":"2023-10-18T12:19:39.610144+0000","last_unstale":"2023-10-18T12:19:44.696009+0000","last_undegraded":"2023-10-18T12:19:44.696009+0000","last_fullsized":"2023-10-18T12:19:44.696009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:53:47.232582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.644062+0000","last_change":"2023-10-18T12:19:38.605732+0000","last_active":"2023-10-18T12:19:44.644062+0000","last_peered":"2023-10-18T12:19:44.644062+0000","last_clean":"2023-10-18T12:19:44.644062+0000","last_became_active":"2023-10-18T12:19:38.605308+0000","last_became_peered":"2023-10-18T12:19:38.605308+0000","last_unstale":"2023-10-18T12:19:44.644062+0000","last_undegraded":"2023-10-18T12:19:44.644062+0000","last_fullsized":"2023-10-18T12:19:44.644062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:31:40.396673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.694490+0000","last_change":"2023-10-18T12:19:43.670657+0000","last_active":"2023-10-18T12:19:44.694490+0000","last_peered":"2023-10-18T12:19:44.694490+0000","last_clean":"2023-10-18T12:19:44.694490+0000","last_became_active":"2023-10-18T12:19:43.670163+0000","last_became_peered":"2023-10-18T12:19:43.670163+0000","last_unstale":"2023-10-18T12:19:44.694490+0000","last_undegraded":"2023-10-18T12:19:44.694490+0000","last_fullsized":"2023-10-18T12:19:44.694490+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:34:08.780931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695903+0000","last_change":"2023-10-18T12:19:39.602738+0000","last_active":"2023-10-18T12:19:44.695903+0000","last_peered":"2023-10-18T12:19:44.695903+0000","last_clean":"2023-10-18T12:19:44.695903+0000","last_became_active":"2023-10-18T12:19:39.602448+0000","last_became_peered":"2023-10-18T12:19:39.602448+0000","last_unstale":"2023-10-18T12:19:44.695903+0000","last_undegraded":"2023-10-18T12:19:44.695903+0000","last_fullsized":"2023-10-18T12:19:44.695903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:16:42.023443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.644202+0000","last_change":"2023-10-18T12:19:38.603192+0000","last_active":"2023-10-18T12:19:44.644202+0000","last_peered":"2023-10-18T12:19:44.644202+0000","last_clean":"2023-10-18T12:19:44.644202+0000","last_became_active":"2023-10-18T12:19:38.602904+0000","last_became_peered":"2023-10-18T12:19:38.602904+0000","last_unstale":"2023-10-18T12:19:44.644202+0000","last_undegraded":"2023-10-18T12:19:44.644202+0000","last_fullsized":"2023-10-18T12:19:44.644202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:05:31.346619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.642394+0000","last_change":"2023-10-18T12:19:43.664334+0000","last_active":"2023-10-18T12:19:44.642394+0000","last_peered":"2023-10-18T12:19:44.642394+0000","last_clean":"2023-10-18T12:19:44.642394+0000","last_became_active":"2023-10-18T12:19:43.663249+0000","last_became_peered":"2023-10-18T12:19:43.663249+0000","last_unstale":"2023-10-18T12:19:44.642394+0000","last_undegraded":"2023-10-18T12:19:44.642394+0000","last_fullsized":"2023-10-18T12:19:44.642394+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:45.224238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696836+0000","last_change":"2023-10-18T12:19:43.672616+0000","last_active":"2023-10-18T12:19:44.696836+0000","last_peered":"2023-10-18T12:19:44.696836+0000","last_clean":"2023-10-18T12:19:44.696836+0000","last_became_active":"2023-10-18T12:19:43.672218+0000","last_became_peered":"2023-10-18T12:19:43.672218+0000","last_unstale":"2023-10-18T12:19:44.696836+0000","last_undegraded":"2023-10-18T12:19:44.696836+0000","last_fullsized":"2023-10-18T12:19:44.696836+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:18:29.969594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698410+0000","last_change":"2023-10-18T12:19:38.592225+0000","last_active":"2023-10-18T12:19:44.698410+0000","last_peered":"2023-10-18T12:19:44.698410+0000","last_clean":"2023-10-18T12:19:44.698410+0000","last_became_active":"2023-10-18T12:19:38.591941+0000","last_became_peered":"2023-10-18T12:19:38.591941+0000","last_unstale":"2023-10-18T12:19:44.698410+0000","last_undegraded":"2023-10-18T12:19:44.698410+0000","last_fullsized":"2023-10-18T12:19:44.698410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:28:52.287011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.646062+0000","last_change":"2023-10-18T12:19:39.611861+0000","last_active":"2023-10-18T12:19:44.646062+0000","last_peered":"2023-10-18T12:19:44.646062+0000","last_clean":"2023-10-18T12:19:44.646062+0000","last_became_active":"2023-10-18T12:19:39.611576+0000","last_became_peered":"2023-10-18T12:19:39.611576+0000","last_unstale":"2023-10-18T12:19:44.646062+0000","last_undegraded":"2023-10-18T12:19:44.646062+0000","last_fullsized":"2023-10-18T12:19:44.646062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:42:08.342773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645692+0000","last_change":"2023-10-18T12:19:43.671295+0000","last_active":"2023-10-18T12:19:44.645692+0000","last_peered":"2023-10-18T12:19:44.645692+0000","last_clean":"2023-10-18T12:19:44.645692+0000","last_became_active":"2023-10-18T12:19:43.667280+0000","last_became_peered":"2023-10-18T12:19:43.667280+0000","last_unstale":"2023-10-18T12:19:44.645692+0000","last_undegraded":"2023-10-18T12:19:44.645692+0000","last_fullsized":"2023-10-18T12:19:44.645692+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:58:20.935868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.642799+0000","last_change":"2023-10-18T12:19:38.608977+0000","last_active":"2023-10-18T12:19:44.642799+0000","last_peered":"2023-10-18T12:19:44.642799+0000","last_clean":"2023-10-18T12:19:44.642799+0000","last_became_active":"2023-10-18T12:19:38.608614+0000","last_became_peered":"2023-10-18T12:19:38.608614+0000","last_unstale":"2023-10-18T12:19:44.642799+0000","last_undegraded":"2023-10-18T12:19:44.642799+0000","last_fullsized":"2023-10-18T12:19:44.642799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:34:43.885197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696721+0000","last_change":"2023-10-18T12:19:39.626624+0000","last_active":"2023-10-18T12:19:44.696721+0000","last_peered":"2023-10-18T12:19:44.696721+0000","last_clean":"2023-10-18T12:19:44.696721+0000","last_became_active":"2023-10-18T12:19:39.626353+0000","last_became_peered":"2023-10-18T12:19:39.626353+0000","last_unstale":"2023-10-18T12:19:44.696721+0000","last_undegraded":"2023-10-18T12:19:44.696721+0000","last_fullsized":"2023-10-18T12:19:44.696721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:38:42.744745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695480+0000","last_change":"2023-10-18T12:19:38.607392+0000","last_active":"2023-10-18T12:19:44.695480+0000","last_peered":"2023-10-18T12:19:44.695480+0000","last_clean":"2023-10-18T12:19:44.695480+0000","last_became_active":"2023-10-18T12:19:38.607074+0000","last_became_peered":"2023-10-18T12:19:38.607074+0000","last_unstale":"2023-10-18T12:19:44.695480+0000","last_undegraded":"2023-10-18T12:19:44.695480+0000","last_fullsized":"2023-10-18T12:19:44.695480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:39:22.962723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697929+0000","last_change":"2023-10-18T12:19:39.612978+0000","last_active":"2023-10-18T12:19:44.697929+0000","last_peered":"2023-10-18T12:19:44.697929+0000","last_clean":"2023-10-18T12:19:44.697929+0000","last_became_active":"2023-10-18T12:19:39.612414+0000","last_became_peered":"2023-10-18T12:19:39.612414+0000","last_unstale":"2023-10-18T12:19:44.697929+0000","last_undegraded":"2023-10-18T12:19:44.697929+0000","last_fullsized":"2023-10-18T12:19:44.697929+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:31:41.406606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.644993+0000","last_change":"2023-10-18T12:19:43.663874+0000","last_active":"2023-10-18T12:19:44.644993+0000","last_peered":"2023-10-18T12:19:44.644993+0000","last_clean":"2023-10-18T12:19:44.644993+0000","last_became_active":"2023-10-18T12:19:43.663482+0000","last_became_peered":"2023-10-18T12:19:43.663482+0000","last_unstale":"2023-10-18T12:19:44.644993+0000","last_undegraded":"2023-10-18T12:19:44.644993+0000","last_fullsized":"2023-10-18T12:19:44.644993+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:09:05.460432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643120+0000","last_change":"2023-10-18T12:19:38.608908+0000","last_active":"2023-10-18T12:19:44.643120+0000","last_peered":"2023-10-18T12:19:44.643120+0000","last_clean":"2023-10-18T12:19:44.643120+0000","last_became_active":"2023-10-18T12:19:38.608598+0000","last_became_peered":"2023-10-18T12:19:38.608598+0000","last_unstale":"2023-10-18T12:19:44.643120+0000","last_undegraded":"2023-10-18T12:19:44.643120+0000","last_fullsized":"2023-10-18T12:19:44.643120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:09:00.392656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645413+0000","last_change":"2023-10-18T12:19:39.610765+0000","last_active":"2023-10-18T12:19:44.645413+0000","last_peered":"2023-10-18T12:19:44.645413+0000","last_clean":"2023-10-18T12:19:44.645413+0000","last_became_active":"2023-10-18T12:19:39.610487+0000","last_became_peered":"2023-10-18T12:19:39.610487+0000","last_unstale":"2023-10-18T12:19:44.645413+0000","last_undegraded":"2023-10-18T12:19:44.645413+0000","last_fullsized":"2023-10-18T12:19:44.645413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:38:42.744745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697522+0000","last_change":"2023-10-18T12:19:43.676251+0000","last_active":"2023-10-18T12:19:44.697522+0000","last_peered":"2023-10-18T12:19:44.697522+0000","last_clean":"2023-10-18T12:19:44.697522+0000","last_became_active":"2023-10-18T12:19:43.675875+0000","last_became_peered":"2023-10-18T12:19:43.675875+0000","last_unstale":"2023-10-18T12:19:44.697522+0000","last_undegraded":"2023-10-18T12:19:44.697522+0000","last_fullsized":"2023-10-18T12:19:44.697522+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:43:47.628186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698036+0000","last_change":"2023-10-18T12:19:39.606335+0000","last_active":"2023-10-18T12:19:44.698036+0000","last_peered":"2023-10-18T12:19:44.698036+0000","last_clean":"2023-10-18T12:19:44.698036+0000","last_became_active":"2023-10-18T12:19:39.604624+0000","last_became_peered":"2023-10-18T12:19:39.604624+0000","last_unstale":"2023-10-18T12:19:44.698036+0000","last_undegraded":"2023-10-18T12:19:44.698036+0000","last_fullsized":"2023-10-18T12:19:44.698036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:00:59.306651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643934+0000","last_change":"2023-10-18T12:19:39.622414+0000","last_active":"2023-10-18T12:19:44.643934+0000","last_peered":"2023-10-18T12:19:44.643934+0000","last_clean":"2023-10-18T12:19:44.643934+0000","last_became_active":"2023-10-18T12:19:39.622099+0000","last_became_peered":"2023-10-18T12:19:39.622099+0000","last_unstale":"2023-10-18T12:19:44.643934+0000","last_undegraded":"2023-10-18T12:19:44.643934+0000","last_fullsized":"2023-10-18T12:19:44.643934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:41.166395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697300+0000","last_change":"2023-10-18T12:19:39.614498+0000","last_active":"2023-10-18T12:19:44.697300+0000","last_peered":"2023-10-18T12:19:44.697300+0000","last_clean":"2023-10-18T12:19:44.697300+0000","last_became_active":"2023-10-18T12:19:39.614221+0000","last_became_peered":"2023-10-18T12:19:39.614221+0000","last_unstale":"2023-10-18T12:19:44.697300+0000","last_undegraded":"2023-10-18T12:19:44.697300+0000","last_fullsized":"2023-10-18T12:19:44.697300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:50:20.465384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.644520+0000","last_change":"2023-10-18T12:19:39.622751+0000","last_active":"2023-10-18T12:19:44.644520+0000","last_peered":"2023-10-18T12:19:44.644520+0000","last_clean":"2023-10-18T12:19:44.644520+0000","last_became_active":"2023-10-18T12:19:39.612445+0000","last_became_peered":"2023-10-18T12:19:39.612445+0000","last_unstale":"2023-10-18T12:19:44.644520+0000","last_undegraded":"2023-10-18T12:19:44.644520+0000","last_fullsized":"2023-10-18T12:19:44.644520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:59:46.662013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.646131+0000","last_change":"2023-10-18T12:19:39.597414+0000","last_active":"2023-10-18T12:19:44.646131+0000","last_peered":"2023-10-18T12:19:44.646131+0000","last_clean":"2023-10-18T12:19:44.646131+0000","last_became_active":"2023-10-18T12:19:39.597142+0000","last_became_peered":"2023-10-18T12:19:39.597142+0000","last_unstale":"2023-10-18T12:19:44.646131+0000","last_undegraded":"2023-10-18T12:19:44.646131+0000","last_fullsized":"2023-10-18T12:19:44.646131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:18:54.504988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697649+0000","last_change":"2023-10-18T12:19:39.613135+0000","last_active":"2023-10-18T12:19:44.697649+0000","last_peered":"2023-10-18T12:19:44.697649+0000","last_clean":"2023-10-18T12:19:44.697649+0000","last_became_active":"2023-10-18T12:19:39.612747+0000","last_became_peered":"2023-10-18T12:19:39.612747+0000","last_unstale":"2023-10-18T12:19:44.697649+0000","last_undegraded":"2023-10-18T12:19:44.697649+0000","last_fullsized":"2023-10-18T12:19:44.697649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:42:08.342773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.646717+0000","last_change":"2023-10-18T12:19:39.602816+0000","last_active":"2023-10-18T12:19:44.646717+0000","last_peered":"2023-10-18T12:19:44.646717+0000","last_clean":"2023-10-18T12:19:44.646717+0000","last_became_active":"2023-10-18T12:19:39.602561+0000","last_became_peered":"2023-10-18T12:19:39.602561+0000","last_unstale":"2023-10-18T12:19:44.646717+0000","last_undegraded":"2023-10-18T12:19:44.646717+0000","last_fullsized":"2023-10-18T12:19:44.646717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:36:41.193198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645988+0000","last_change":"2023-10-18T12:19:39.600714+0000","last_active":"2023-10-18T12:19:44.645988+0000","last_peered":"2023-10-18T12:19:44.645988+0000","last_clean":"2023-10-18T12:19:44.645988+0000","last_became_active":"2023-10-18T12:19:39.600450+0000","last_became_peered":"2023-10-18T12:19:39.600450+0000","last_unstale":"2023-10-18T12:19:44.645988+0000","last_undegraded":"2023-10-18T12:19:44.645988+0000","last_fullsized":"2023-10-18T12:19:44.645988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:58:16.878025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.642145+0000","last_change":"2023-10-18T12:19:39.627407+0000","last_active":"2023-10-18T12:19:44.642145+0000","last_peered":"2023-10-18T12:19:44.642145+0000","last_clean":"2023-10-18T12:19:44.642145+0000","last_became_active":"2023-10-18T12:19:39.626211+0000","last_became_peered":"2023-10-18T12:19:39.626211+0000","last_unstale":"2023-10-18T12:19:44.642145+0000","last_undegraded":"2023-10-18T12:19:44.642145+0000","last_fullsized":"2023-10-18T12:19:44.642145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:01:13.535689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643733+0000","last_change":"2023-10-18T12:19:39.625985+0000","last_active":"2023-10-18T12:19:44.643733+0000","last_peered":"2023-10-18T12:19:44.643733+0000","last_clean":"2023-10-18T12:19:44.643733+0000","last_became_active":"2023-10-18T12:19:39.625675+0000","last_became_peered":"2023-10-18T12:19:39.625675+0000","last_unstale":"2023-10-18T12:19:44.643733+0000","last_undegraded":"2023-10-18T12:19:44.643733+0000","last_fullsized":"2023-10-18T12:19:44.643733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:08:55.947222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695201+0000","last_change":"2023-10-18T12:19:39.612565+0000","last_active":"2023-10-18T12:19:44.695201+0000","last_peered":"2023-10-18T12:19:44.695201+0000","last_clean":"2023-10-18T12:19:44.695201+0000","last_became_active":"2023-10-18T12:19:39.612238+0000","last_became_peered":"2023-10-18T12:19:39.612238+0000","last_unstale":"2023-10-18T12:19:44.695201+0000","last_undegraded":"2023-10-18T12:19:44.695201+0000","last_fullsized":"2023-10-18T12:19:44.695201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:20:41.018432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643039+0000","last_change":"2023-10-18T12:19:39.616276+0000","last_active":"2023-10-18T12:19:44.643039+0000","last_peered":"2023-10-18T12:19:44.643039+0000","last_clean":"2023-10-18T12:19:44.643039+0000","last_became_active":"2023-10-18T12:19:39.615850+0000","last_became_peered":"2023-10-18T12:19:39.615850+0000","last_unstale":"2023-10-18T12:19:44.643039+0000","last_undegraded":"2023-10-18T12:19:44.643039+0000","last_fullsized":"2023-10-18T12:19:44.643039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:32:59.250300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.699707+0000","last_change":"2023-10-18T12:19:39.623264+0000","last_active":"2023-10-18T12:19:44.699707+0000","last_peered":"2023-10-18T12:19:44.699707+0000","last_clean":"2023-10-18T12:19:44.699707+0000","last_became_active":"2023-10-18T12:19:39.621265+0000","last_became_peered":"2023-10-18T12:19:39.621265+0000","last_unstale":"2023-10-18T12:19:44.699707+0000","last_undegraded":"2023-10-18T12:19:44.699707+0000","last_fullsized":"2023-10-18T12:19:44.699707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:14:52.587185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697048+0000","last_change":"2023-10-18T12:19:39.601465+0000","last_active":"2023-10-18T12:19:44.697048+0000","last_peered":"2023-10-18T12:19:44.697048+0000","last_clean":"2023-10-18T12:19:44.697048+0000","last_became_active":"2023-10-18T12:19:39.601166+0000","last_became_peered":"2023-10-18T12:19:39.601166+0000","last_unstale":"2023-10-18T12:19:44.697048+0000","last_undegraded":"2023-10-18T12:19:44.697048+0000","last_fullsized":"2023-10-18T12:19:44.697048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:49:10.530935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.700144+0000","last_change":"2023-10-18T12:19:39.623799+0000","last_active":"2023-10-18T12:19:44.700144+0000","last_peered":"2023-10-18T12:19:44.700144+0000","last_clean":"2023-10-18T12:19:44.700144+0000","last_became_active":"2023-10-18T12:19:39.623178+0000","last_became_peered":"2023-10-18T12:19:39.623178+0000","last_unstale":"2023-10-18T12:19:44.700144+0000","last_undegraded":"2023-10-18T12:19:44.700144+0000","last_fullsized":"2023-10-18T12:19:44.700144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:41:05.788100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697167+0000","last_change":"2023-10-18T12:19:39.626941+0000","last_active":"2023-10-18T12:19:44.697167+0000","last_peered":"2023-10-18T12:19:44.697167+0000","last_clean":"2023-10-18T12:19:44.697167+0000","last_became_active":"2023-10-18T12:19:39.626282+0000","last_became_peered":"2023-10-18T12:19:39.626282+0000","last_unstale":"2023-10-18T12:19:44.697167+0000","last_undegraded":"2023-10-18T12:19:44.697167+0000","last_fullsized":"2023-10-18T12:19:44.697167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:43:43.570343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695706+0000","last_change":"2023-10-18T12:19:39.618114+0000","last_active":"2023-10-18T12:19:44.695706+0000","last_peered":"2023-10-18T12:19:44.695706+0000","last_clean":"2023-10-18T12:19:44.695706+0000","last_became_active":"2023-10-18T12:19:39.617493+0000","last_became_peered":"2023-10-18T12:19:39.617493+0000","last_unstale":"2023-10-18T12:19:44.695706+0000","last_undegraded":"2023-10-18T12:19:44.695706+0000","last_fullsized":"2023-10-18T12:19:44.695706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:51:48.593221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.642536+0000","last_change":"2023-10-18T12:19:39.593923+0000","last_active":"2023-10-18T12:19:44.642536+0000","last_peered":"2023-10-18T12:19:44.642536+0000","last_clean":"2023-10-18T12:19:44.642536+0000","last_became_active":"2023-10-18T12:19:39.593576+0000","last_became_peered":"2023-10-18T12:19:39.593576+0000","last_unstale":"2023-10-18T12:19:44.642536+0000","last_undegraded":"2023-10-18T12:19:44.642536+0000","last_fullsized":"2023-10-18T12:19:44.642536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:23:37.730513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696693+0000","last_change":"2023-10-18T12:19:39.608751+0000","last_active":"2023-10-18T12:19:44.696693+0000","last_peered":"2023-10-18T12:19:44.696693+0000","last_clean":"2023-10-18T12:19:44.696693+0000","last_became_active":"2023-10-18T12:19:39.608577+0000","last_became_peered":"2023-10-18T12:19:39.608577+0000","last_unstale":"2023-10-18T12:19:44.696693+0000","last_undegraded":"2023-10-18T12:19:44.696693+0000","last_fullsized":"2023-10-18T12:19:44.696693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:41.166395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.694826+0000","last_change":"2023-10-18T12:19:39.619193+0000","last_active":"2023-10-18T12:19:44.694826+0000","last_peered":"2023-10-18T12:19:44.694826+0000","last_clean":"2023-10-18T12:19:44.694826+0000","last_became_active":"2023-10-18T12:19:39.618875+0000","last_became_peered":"2023-10-18T12:19:39.618875+0000","last_unstale":"2023-10-18T12:19:44.694826+0000","last_undegraded":"2023-10-18T12:19:44.694826+0000","last_fullsized":"2023-10-18T12:19:44.694826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:09:05.600850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696932+0000","last_change":"2023-10-18T12:19:39.624583+0000","last_active":"2023-10-18T12:19:44.696932+0000","last_peered":"2023-10-18T12:19:44.696932+0000","last_clean":"2023-10-18T12:19:44.696932+0000","last_became_active":"2023-10-18T12:19:39.624245+0000","last_became_peered":"2023-10-18T12:19:39.624245+0000","last_unstale":"2023-10-18T12:19:44.696932+0000","last_undegraded":"2023-10-18T12:19:44.696932+0000","last_fullsized":"2023-10-18T12:19:44.696932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:30:21.637586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.699970+0000","last_change":"2023-10-18T12:19:39.611515+0000","last_active":"2023-10-18T12:19:44.699970+0000","last_peered":"2023-10-18T12:19:44.699970+0000","last_clean":"2023-10-18T12:19:44.699970+0000","last_became_active":"2023-10-18T12:19:39.611055+0000","last_became_peered":"2023-10-18T12:19:39.611055+0000","last_unstale":"2023-10-18T12:19:44.699970+0000","last_undegraded":"2023-10-18T12:19:44.699970+0000","last_fullsized":"2023-10-18T12:19:44.699970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:46:08.694186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697397+0000","last_change":"2023-10-18T12:19:39.616291+0000","last_active":"2023-10-18T12:19:44.697397+0000","last_peered":"2023-10-18T12:19:44.697397+0000","last_clean":"2023-10-18T12:19:44.697397+0000","last_became_active":"2023-10-18T12:19:39.615941+0000","last_became_peered":"2023-10-18T12:19:39.615941+0000","last_unstale":"2023-10-18T12:19:44.697397+0000","last_undegraded":"2023-10-18T12:19:44.697397+0000","last_fullsized":"2023-10-18T12:19:44.697397+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:38:42.744745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696621+0000","last_change":"2023-10-18T12:19:39.627115+0000","last_active":"2023-10-18T12:19:44.696621+0000","last_peered":"2023-10-18T12:19:44.696621+0000","last_clean":"2023-10-18T12:19:44.696621+0000","last_became_active":"2023-10-18T12:19:39.626676+0000","last_became_peered":"2023-10-18T12:19:39.626676+0000","last_unstale":"2023-10-18T12:19:44.696621+0000","last_undegraded":"2023-10-18T12:19:44.696621+0000","last_fullsized":"2023-10-18T12:19:44.696621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:23:37.730513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695588+0000","last_change":"2023-10-18T12:19:39.622702+0000","last_active":"2023-10-18T12:19:44.695588+0000","last_peered":"2023-10-18T12:19:44.695588+0000","last_clean":"2023-10-18T12:19:44.695588+0000","last_became_active":"2023-10-18T12:19:39.622413+0000","last_became_peered":"2023-10-18T12:19:39.622413+0000","last_unstale":"2023-10-18T12:19:44.695588+0000","last_undegraded":"2023-10-18T12:19:44.695588+0000","last_fullsized":"2023-10-18T12:19:44.695588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:01:13.535689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.642468+0000","last_change":"2023-10-18T12:19:39.590506+0000","last_active":"2023-10-18T12:19:44.642468+0000","last_peered":"2023-10-18T12:19:44.642468+0000","last_clean":"2023-10-18T12:19:44.642468+0000","last_became_active":"2023-10-18T12:19:39.590193+0000","last_became_peered":"2023-10-18T12:19:39.590193+0000","last_unstale":"2023-10-18T12:19:44.642468+0000","last_undegraded":"2023-10-18T12:19:44.642468+0000","last_fullsized":"2023-10-18T12:19:44.642468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:32:29.479925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696554+0000","last_change":"2023-10-18T12:19:39.623884+0000","last_active":"2023-10-18T12:19:44.696554+0000","last_peered":"2023-10-18T12:19:44.696554+0000","last_clean":"2023-10-18T12:19:44.696554+0000","last_became_active":"2023-10-18T12:19:39.621423+0000","last_became_peered":"2023-10-18T12:19:39.621423+0000","last_unstale":"2023-10-18T12:19:44.696554+0000","last_undegraded":"2023-10-18T12:19:44.696554+0000","last_fullsized":"2023-10-18T12:19:44.696554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:08:53.571323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696270+0000","last_change":"2023-10-18T12:19:39.613490+0000","last_active":"2023-10-18T12:19:44.696270+0000","last_peered":"2023-10-18T12:19:44.696270+0000","last_clean":"2023-10-18T12:19:44.696270+0000","last_became_active":"2023-10-18T12:19:39.613238+0000","last_became_peered":"2023-10-18T12:19:39.613238+0000","last_unstale":"2023-10-18T12:19:44.696270+0000","last_undegraded":"2023-10-18T12:19:44.696270+0000","last_fullsized":"2023-10-18T12:19:44.696270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:16:42.023443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698292+0000","last_change":"2023-10-18T12:19:39.616780+0000","last_active":"2023-10-18T12:19:44.698292+0000","last_peered":"2023-10-18T12:19:44.698292+0000","last_clean":"2023-10-18T12:19:44.698292+0000","last_became_active":"2023-10-18T12:19:39.612468+0000","last_became_peered":"2023-10-18T12:19:39.612468+0000","last_unstale":"2023-10-18T12:19:44.698292+0000","last_undegraded":"2023-10-18T12:19:44.698292+0000","last_fullsized":"2023-10-18T12:19:44.698292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:21:53.971574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.699940+0000","last_change":"2023-10-18T12:19:39.614291+0000","last_active":"2023-10-18T12:19:44.699940+0000","last_peered":"2023-10-18T12:19:44.699940+0000","last_clean":"2023-10-18T12:19:44.699940+0000","last_became_active":"2023-10-18T12:19:39.613988+0000","last_became_peered":"2023-10-18T12:19:39.613988+0000","last_unstale":"2023-10-18T12:19:44.699940+0000","last_undegraded":"2023-10-18T12:19:44.699940+0000","last_fullsized":"2023-10-18T12:19:44.699940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:54:49.791061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697127+0000","last_change":"2023-10-18T12:19:39.618591+0000","last_active":"2023-10-18T12:19:44.697127+0000","last_peered":"2023-10-18T12:19:44.697127+0000","last_clean":"2023-10-18T12:19:44.697127+0000","last_became_active":"2023-10-18T12:19:39.618040+0000","last_became_peered":"2023-10-18T12:19:39.618040+0000","last_unstale":"2023-10-18T12:19:44.697127+0000","last_undegraded":"2023-10-18T12:19:44.697127+0000","last_fullsized":"2023-10-18T12:19:44.697127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:34:44.895130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697567+0000","last_change":"2023-10-18T12:19:39.619158+0000","last_active":"2023-10-18T12:19:44.697567+0000","last_peered":"2023-10-18T12:19:44.697567+0000","last_clean":"2023-10-18T12:19:44.697567+0000","last_became_active":"2023-10-18T12:19:39.618867+0000","last_became_peered":"2023-10-18T12:19:39.618867+0000","last_unstale":"2023-10-18T12:19:44.697567+0000","last_undegraded":"2023-10-18T12:19:44.697567+0000","last_fullsized":"2023-10-18T12:19:44.697567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:27:24.632610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":925696,"data_stored":718997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.486}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3959999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.367}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.038}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.347}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5740000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.526}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":125224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.274}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2270000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.389}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.591}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5680000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":128469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.397}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":307200,"data_stored":124662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.248}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.367}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5660000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.474}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.409}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.274}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4410000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.369}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5740000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6830000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27900,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343940,"statfs":{"total":96636764160,"available":96608194560,"internally_reserved":0,"allocated":901120,"data_stored":715522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3440000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3129999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.264}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-18T12:20:03.258 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-18T12:20:03.259 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-18T12:20:03.259 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-18T12:20:03.259 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-18T12:20:03.260 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-18T12:20:03.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.462+0000 7f27eb9c1700 1 Processor -- start 2023-10-18T12:20:03.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.462+0000 7f27eb9c1700 1 -- start start 2023-10-18T12:20:03.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.466+0000 7f27eb9c1700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27e40b5b80 0x7f27e406f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:03.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.466+0000 7f27eb9c1700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f27e406fee0 0x7f27e415eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:03.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.466+0000 7f27eb9c1700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e415e680 con 0x7f27e4146800 2023-10-18T12:20:03.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.466+0000 7f27eb9c1700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27e4070370 con 0x7f27e406fee0 2023-10-18T12:20:03.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.466+0000 7f27eb9c1700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e40b6180 con 0x7f27e40b5b80 2023-10-18T12:20:03.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.466+0000 7f27e9f5e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f27e406fee0 0x7f27e415eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:03.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.466+0000 7f27e975d700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f27e4146800 0x7f27e415dd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.114:59750/0 (socket says 172.21.15.114:59750) 2023-10-18T12:20:03.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.466+0000 7f27e975d700 1 -- 172.21.15.114:0/880922529 learned_addr learned my addr 172.21.15.114:0/880922529 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:03.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.466+0000 7f27e8f5c700 1 --2- 172.21.15.114:0/880922529 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27e40b5b80 0x7f27e406f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:03.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.466+0000 7f27e9f5e700 1 -- 172.21.15.114:0/880922529 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27e40b5b80 msgr2=0x7f27e406f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:03.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.466+0000 7f27e9f5e700 1 --2- 172.21.15.114:0/880922529 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27e40b5b80 0x7f27e406f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:03.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.466+0000 7f27e9f5e700 1 -- 172.21.15.114:0/880922529 >> v1:172.21.15.172:6789/0 conn(0x7f27e4146800 legacy=0x7f27e415dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:03.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.466+0000 7f27e9f5e700 1 -- 172.21.15.114:0/880922529 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e40b6460 con 0x7f27e406fee0 2023-10-18T12:20:03.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.466+0000 7f27e9f5e700 1 --2- 172.21.15.114:0/880922529 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27e406fee0 0x7f27e415eb10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f27dc009d90 tx=0x7f27dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db8f645ed7d3122a server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:03.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.470+0000 7f27dbfff700 1 -- 172.21.15.114:0/880922529 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc00e070 con 0x7f27e406fee0 2023-10-18T12:20:03.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.470+0000 7f27dbfff700 1 -- 172.21.15.114:0/880922529 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27dc00bbd0 con 0x7f27e406fee0 2023-10-18T12:20:03.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.470+0000 7f27dbfff700 1 -- 172.21.15.114:0/880922529 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc012430 con 0x7f27e406fee0 2023-10-18T12:20:03.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.470+0000 7f27eb9c1700 1 -- 172.21.15.114:0/880922529 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27e406fee0 msgr2=0x7f27e415eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:03.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.470+0000 7f27eb9c1700 1 --2- 172.21.15.114:0/880922529 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27e406fee0 0x7f27e415eb10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f27dc009d90 tx=0x7f27dc00b330 comp rx=0 tx=0).stop 2023-10-18T12:20:03.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.470+0000 7f27eb9c1700 1 -- 172.21.15.114:0/880922529 shutdown_connections 2023-10-18T12:20:03.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.470+0000 7f27eb9c1700 1 --2- 172.21.15.114:0/880922529 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27e406fee0 0x7f27e415eb10 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:03.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.470+0000 7f27eb9c1700 1 --2- 172.21.15.114:0/880922529 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27e40b5b80 0x7f27e406f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:03.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.470+0000 7f27eb9c1700 1 -- 172.21.15.114:0/880922529 >> 172.21.15.114:0/880922529 conn(0x7f27e406a130 msgr2=0x7f27e406a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:03.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.470+0000 7f27eb9c1700 1 -- 172.21.15.114:0/880922529 shutdown_connections 2023-10-18T12:20:03.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.470+0000 7f27eb9c1700 1 -- 172.21.15.114:0/880922529 wait complete. 2023-10-18T12:20:03.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.474+0000 7f27eb9c1700 1 Processor -- start 2023-10-18T12:20:03.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.474+0000 7f27eb9c1700 1 -- start start 2023-10-18T12:20:03.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.474+0000 7f27eb9c1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27e406fee0 0x7f27e413f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:03.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.474+0000 7f27eb9c1700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27e40b5b80 0x7f27e40ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:03.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.474+0000 7f27eb9c1700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27e4146800 0x7f27e41f2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:03.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.474+0000 7f27eb9c1700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e40ac130 con 0x7f27e406fee0 2023-10-18T12:20:03.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.474+0000 7f27eb9c1700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e41405f0 con 0x7f27e40b5b80 2023-10-18T12:20:03.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.474+0000 7f27eb9c1700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e41408d0 con 0x7f27e4146800 2023-10-18T12:20:03.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.474+0000 7f27e975d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27e406fee0 0x7f27e413f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:03.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.474+0000 7f27e975d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27e406fee0 0x7f27e413f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46876/0 (socket says 172.21.15.114:46876) 2023-10-18T12:20:03.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.474+0000 7f27e975d700 1 -- 172.21.15.114:0/3287881891 learned_addr learned my addr 172.21.15.114:0/3287881891 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:03.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.474+0000 7f27e9f5e700 1 --2- 172.21.15.114:0/3287881891 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27e4146800 0x7f27e41f2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:03.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.474+0000 7f27e8f5c700 1 --2- 172.21.15.114:0/3287881891 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27e40b5b80 0x7f27e40ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:03.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.474+0000 7f27e975d700 1 -- 172.21.15.114:0/3287881891 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27e4146800 msgr2=0x7f27e41f2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:03.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.474+0000 7f27e975d700 1 --2- 172.21.15.114:0/3287881891 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27e4146800 0x7f27e41f2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:03.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.474+0000 7f27e975d700 1 -- 172.21.15.114:0/3287881891 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27e40b5b80 msgr2=0x7f27e40ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:03.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.474+0000 7f27e975d700 1 --2- 172.21.15.114:0/3287881891 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27e40b5b80 0x7f27e40ab8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:03.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.474+0000 7f27e975d700 1 -- 172.21.15.114:0/3287881891 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27dc009a70 con 0x7f27e406fee0 2023-10-18T12:20:03.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.474+0000 7f27e975d700 1 --2- 172.21.15.114:0/3287881891 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27e406fee0 0x7f27e413f450 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f27e000c410 tx=0x7f27e000c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:03.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.474+0000 7f27d9ffb700 1 -- 172.21.15.114:0/3287881891 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e0005d90 con 0x7f27e406fee0 2023-10-18T12:20:03.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.474+0000 7f27d9ffb700 1 -- 172.21.15.114:0/3287881891 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e00070d0 con 0x7f27e406fee0 2023-10-18T12:20:03.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.474+0000 7f27eb9c1700 1 -- 172.21.15.114:0/3287881891 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27e4140bb0 con 0x7f27e406fee0 2023-10-18T12:20:03.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.474+0000 7f27d9ffb700 1 -- 172.21.15.114:0/3287881891 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e0007460 con 0x7f27e406fee0 2023-10-18T12:20:03.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.474+0000 7f27eb9c1700 1 -- 172.21.15.114:0/3287881891 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e40abe20 con 0x7f27e406fee0 2023-10-18T12:20:03.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.478+0000 7f27eb9c1700 1 -- 172.21.15.114:0/3287881891 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27e40b6720 con 0x7f27e406fee0 2023-10-18T12:20:03.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.478+0000 7f27d9ffb700 1 -- 172.21.15.114:0/3287881891 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f27e00075c0 con 0x7f27e406fee0 2023-10-18T12:20:03.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.478+0000 7f27d9ffb700 1 --2- 172.21.15.114:0/3287881891 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f27c80656f0 0x7f27c8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:03.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.478+0000 7f27d9ffb700 1 -- 172.21.15.114:0/3287881891 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f27e0082510 con 0x7f27e406fee0 2023-10-18T12:20:03.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.482+0000 7f27e8f5c700 1 --2- 172.21.15.114:0/3287881891 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f27c80656f0 0x7f27c8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:03.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.482+0000 7f27e8f5c700 1 --2- 172.21.15.114:0/3287881891 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f27c80656f0 0x7f27c8067bb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f27e413f990 tx=0x7f27d4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:03.488 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.486+0000 7f27d9ffb700 1 -- 172.21.15.114:0/3287881891 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f27e40b6720 con 0x7f27e406fee0 2023-10-18T12:20:03.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.702+0000 7f27eb9c1700 1 -- 172.21.15.114:0/3287881891 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f27e40b6720 con 0x7f27e406fee0 2023-10-18T12:20:03.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.710+0000 7f27d9ffb700 1 -- 172.21.15.114:0/3287881891 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+162896 (secure 0 0 0) 0x7f27e40b6720 con 0x7f27e406fee0 2023-10-18T12:20:03.717 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:20:03.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.718+0000 7f27eb9c1700 1 -- 172.21.15.114:0/3287881891 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f27c80656f0 msgr2=0x7f27c8067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:03.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.718+0000 7f27eb9c1700 1 --2- 172.21.15.114:0/3287881891 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f27c80656f0 0x7f27c8067bb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f27e413f990 tx=0x7f27d4008040 comp rx=0 tx=0).stop 2023-10-18T12:20:03.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.718+0000 7f27eb9c1700 1 -- 172.21.15.114:0/3287881891 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27e406fee0 msgr2=0x7f27e413f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:03.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.718+0000 7f27eb9c1700 1 --2- 172.21.15.114:0/3287881891 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27e406fee0 0x7f27e413f450 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f27e000c410 tx=0x7f27e000c7d0 comp rx=0 tx=0).stop 2023-10-18T12:20:03.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.718+0000 7f27eb9c1700 1 -- 172.21.15.114:0/3287881891 shutdown_connections 2023-10-18T12:20:03.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.718+0000 7f27eb9c1700 1 --2- 172.21.15.114:0/3287881891 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f27c80656f0 0x7f27c8067bb0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:03.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.718+0000 7f27eb9c1700 1 --2- 172.21.15.114:0/3287881891 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27e4146800 0x7f27e41f2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:03.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.718+0000 7f27eb9c1700 1 --2- 172.21.15.114:0/3287881891 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27e40b5b80 0x7f27e40ab8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:03.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.718+0000 7f27eb9c1700 1 --2- 172.21.15.114:0/3287881891 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27e406fee0 0x7f27e413f450 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:03.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.718+0000 7f27eb9c1700 1 -- 172.21.15.114:0/3287881891 >> 172.21.15.114:0/3287881891 conn(0x7f27e406a130 msgr2=0x7f27e406da80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:03.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.718+0000 7f27eb9c1700 1 -- 172.21.15.114:0/3287881891 shutdown_connections 2023-10-18T12:20:03.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.718+0000 7f27eb9c1700 1 -- 172.21.15.114:0/3287881891 wait complete. 2023-10-18T12:20:03.742 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":5,"active_gid":4108,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":461408666},{"type":"v1","addr":"172.21.15.172:6833","nonce":461408666}]},"active_addr":"172.21.15.172:6833/461408666","active_change":"2023-10-18T12:19:18.930159+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.172:0","nonce":2590331160}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.172:0","nonce":1691576760}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.172:0","nonce":1166489492}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.172:0","nonce":1535090757}]}]} 2023-10-18T12:20:03.746 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-18T12:20:03.746 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-18T12:20:03.747 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T12:20:03.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.926+0000 7f3de359e700 1 Processor -- start 2023-10-18T12:20:03.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.926+0000 7f3de359e700 1 -- start start 2023-10-18T12:20:03.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.930+0000 7f3de359e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3de40d30e0 0x7f3de40d13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:03.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.930+0000 7f3de359e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3de415d060 con 0x7f3de415cc80 2023-10-18T12:20:03.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.930+0000 7f3de359e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3de406d830 con 0x7f3de40b1df0 2023-10-18T12:20:03.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.930+0000 7f3de359e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de406dd60 con 0x7f3de40d30e0 2023-10-18T12:20:03.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.930+0000 7f3de259c700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f3de415cc80 0x7f3de40d29d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41604/0 (socket says 172.21.15.114:41604) 2023-10-18T12:20:03.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.930+0000 7f3de259c700 1 -- 172.21.15.114:0/99745741 learned_addr learned my addr 172.21.15.114:0/99745741 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:03.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.930+0000 7f3dd9d9b700 1 --2- 172.21.15.114:0/99745741 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3de40d30e0 0x7f3de40d13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:03.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.930+0000 7f3de1d9b700 1 -- 172.21.15.114:0/99745741 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1045387739 0 0) 0x7f3de415d060 con 0x7f3de415cc80 2023-10-18T12:20:03.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.930+0000 7f3dd9d9b700 1 -- 172.21.15.114:0/99745741 >> v1:172.21.15.172:6789/0 conn(0x7f3de40b1df0 legacy=0x7f3de4160730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:03.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.930+0000 7f3dd9d9b700 1 -- 172.21.15.114:0/99745741 >> v1:172.21.15.114:6789/0 conn(0x7f3de415cc80 legacy=0x7f3de40d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:03.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.930+0000 7f3dd9d9b700 1 -- 172.21.15.114:0/99745741 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de406da80 con 0x7f3de40d30e0 2023-10-18T12:20:03.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.930+0000 7f3dd9d9b700 1 --2- 172.21.15.114:0/99745741 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3de40d30e0 0x7f3de40d13c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc009880 tx=0x7f3dcc009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18b737ca66831b0a server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:03.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.930+0000 7f3de1d9b700 1 -- 172.21.15.114:0/99745741 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc011830 con 0x7f3de40d30e0 2023-10-18T12:20:03.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.930+0000 7f3de1d9b700 1 -- 172.21.15.114:0/99745741 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dcc011990 con 0x7f3de40d30e0 2023-10-18T12:20:03.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.930+0000 7f3de1d9b700 1 -- 172.21.15.114:0/99745741 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc011d20 con 0x7f3de40d30e0 2023-10-18T12:20:03.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.934+0000 7f3de359e700 1 -- 172.21.15.114:0/99745741 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3de40d30e0 msgr2=0x7f3de40d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:03.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.934+0000 7f3de359e700 1 --2- 172.21.15.114:0/99745741 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3de40d30e0 0x7f3de40d13c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc009880 tx=0x7f3dcc009b90 comp rx=0 tx=0).stop 2023-10-18T12:20:03.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.934+0000 7f3de359e700 1 -- 172.21.15.114:0/99745741 shutdown_connections 2023-10-18T12:20:03.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.934+0000 7f3de359e700 1 --2- 172.21.15.114:0/99745741 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3de40d30e0 0x7f3de40d13c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:03.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.934+0000 7f3de359e700 1 -- 172.21.15.114:0/99745741 >> 172.21.15.114:0/99745741 conn(0x7f3de40cf530 msgr2=0x7f3de40cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:03.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.934+0000 7f3de359e700 1 -- 172.21.15.114:0/99745741 shutdown_connections 2023-10-18T12:20:03.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.934+0000 7f3de359e700 1 -- 172.21.15.114:0/99745741 wait complete. 2023-10-18T12:20:03.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.934+0000 7f3de359e700 1 Processor -- start 2023-10-18T12:20:03.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.934+0000 7f3de359e700 1 -- start start 2023-10-18T12:20:03.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.938+0000 7f3de359e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3de40b1df0 0x7f3de40b4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:03.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.938+0000 7f3de359e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3de40d30e0 0x7f3de4150970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:03.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.938+0000 7f3de359e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3de415cc80 0x7f3de40b3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:03.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.938+0000 7f3de359e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de40b36a0 con 0x7f3de40b1df0 2023-10-18T12:20:03.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.938+0000 7f3de359e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de40b3970 con 0x7f3de415cc80 2023-10-18T12:20:03.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.938+0000 7f3de359e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de40b3c50 con 0x7f3de40d30e0 2023-10-18T12:20:03.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.938+0000 7f3de259c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3de40b1df0 0x7f3de40b4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:03.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.938+0000 7f3dd9d9b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3de40d30e0 0x7f3de4150970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:03.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.938+0000 7f3de259c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3de40b1df0 0x7f3de40b4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46882/0 (socket says 172.21.15.114:46882) 2023-10-18T12:20:03.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.938+0000 7f3de259c700 1 -- 172.21.15.114:0/22080466 learned_addr learned my addr 172.21.15.114:0/22080466 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:03.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.938+0000 7f3de2d9d700 1 --2- 172.21.15.114:0/22080466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3de415cc80 0x7f3de40b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:03.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.938+0000 7f3de259c700 1 -- 172.21.15.114:0/22080466 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3de40d30e0 msgr2=0x7f3de4150970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:03.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.938+0000 7f3de259c700 1 --2- 172.21.15.114:0/22080466 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3de40d30e0 0x7f3de4150970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:03.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.938+0000 7f3de259c700 1 -- 172.21.15.114:0/22080466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3de415cc80 msgr2=0x7f3de40b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:03.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.938+0000 7f3de259c700 1 --2- 172.21.15.114:0/22080466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3de415cc80 0x7f3de40b3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:03.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.938+0000 7f3de259c700 1 -- 172.21.15.114:0/22080466 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dcc0094b0 con 0x7f3de40b1df0 2023-10-18T12:20:03.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.938+0000 7f3de2d9d700 1 --2- 172.21.15.114:0/22080466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3de415cc80 0x7f3de40b3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:03.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.938+0000 7f3de259c700 1 --2- 172.21.15.114:0/22080466 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3de40b1df0 0x7f3de40b4c20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3dd400b4a0 tx=0x7f3dd400b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:03.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.938+0000 7f3ddb7fe700 1 -- 172.21.15.114:0/22080466 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd4006070 con 0x7f3de40b1df0 2023-10-18T12:20:03.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.938+0000 7f3ddb7fe700 1 -- 172.21.15.114:0/22080466 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd40061d0 con 0x7f3de40b1df0 2023-10-18T12:20:03.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.938+0000 7f3ddb7fe700 1 -- 172.21.15.114:0/22080466 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd4006580 con 0x7f3de40b1df0 2023-10-18T12:20:03.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.938+0000 7f3de359e700 1 -- 172.21.15.114:0/22080466 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3de40b3f30 con 0x7f3de40b1df0 2023-10-18T12:20:03.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.942+0000 7f3de359e700 1 -- 172.21.15.114:0/22080466 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3de4151680 con 0x7f3de40b1df0 2023-10-18T12:20:03.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.942+0000 7f3de359e700 1 -- 172.21.15.114:0/22080466 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3de41514e0 con 0x7f3de40b1df0 2023-10-18T12:20:03.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.942+0000 7f3ddb7fe700 1 -- 172.21.15.114:0/22080466 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f3dd40066e0 con 0x7f3de40b1df0 2023-10-18T12:20:03.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.946+0000 7f3ddb7fe700 1 --2- 172.21.15.114:0/22080466 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f3dc40656f0 0x7f3dc4067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:03.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.946+0000 7f3ddb7fe700 1 -- 172.21.15.114:0/22080466 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3dd4082a30 con 0x7f3de40b1df0 2023-10-18T12:20:03.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.946+0000 7f3dd9d9b700 1 --2- 172.21.15.114:0/22080466 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f3dc40656f0 0x7f3dc4067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:03.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.950+0000 7f3dd9d9b700 1 --2- 172.21.15.114:0/22080466 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f3dc40656f0 0x7f3dc4067bb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc0090b0 tx=0x7f3dcc008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:03.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:03.954+0000 7f3ddb7fe700 1 -- 172.21.15.114:0/22080466 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f3de41514e0 con 0x7f3de40b1df0 2023-10-18T12:20:04.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.130+0000 7f3de359e700 1 -- 172.21.15.114:0/22080466 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3de41514e0 con 0x7f3de40b1df0 2023-10-18T12:20:04.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.134+0000 7f3ddb7fe700 1 -- 172.21.15.114:0/22080466 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20144 (secure 0 0 0) 0x7f3de41514e0 con 0x7f3de40b1df0 2023-10-18T12:20:04.138 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:20:04.138 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":28,"fsid":"240ea340-5d3d-4f52-a4bc-af075aca3deb","created":"2023-10-18T12:19:12.512994+0000","modified":"2023-10-18T12:19:44.436656+0000","last_up_change":"2023-10-18T12:19:25.286009+0000","last_in_change":"2023-10-18T12:19:15.850693+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T12:19:27.040638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-18T12:19:32.358094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-18T12:19:37.333855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-18T12:19:38.055385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-18T12:19:41.679218+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c3578978-1a03-4857-b9d2-34a5da3d7731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6817","nonce":1506287862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6820","nonce":1506287862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6830","nonce":1506287862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6825","nonce":1506287862}]},"public_addr":"172.21.15.114:6817/1506287862","cluster_addr":"172.21.15.114:6820/1506287862","heartbeat_back_addr":"172.21.15.114:6830/1506287862","heartbeat_front_addr":"172.21.15.114:6825/1506287862","state":["exists","up"]},{"osd":1,"uuid":"43eb26a6-e2b3-4670-9559-bd053b5140d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6801","nonce":3302727047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6803","nonce":3302727047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6807","nonce":3302727047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6805","nonce":3302727047}]},"public_addr":"172.21.15.114:6801/3302727047","cluster_addr":"172.21.15.114:6803/3302727047","heartbeat_back_addr":"172.21.15.114:6807/3302727047","heartbeat_front_addr":"172.21.15.114:6805/3302727047","state":["exists","up"]},{"osd":2,"uuid":"f3d4dbd5-521c-4dd2-b687-5768cc7d0938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6809","nonce":2699151351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6811","nonce":2699151351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6815","nonce":2699151351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6813","nonce":2699151351}]},"public_addr":"172.21.15.114:6809/2699151351","cluster_addr":"172.21.15.114:6811/2699151351","heartbeat_back_addr":"172.21.15.114:6815/2699151351","heartbeat_front_addr":"172.21.15.114:6813/2699151351","state":["exists","up"]},{"osd":3,"uuid":"823e5802-92b7-4f0d-b32d-a5748993f1b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6821","nonce":1361608073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6824","nonce":1361608073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6829","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6831","nonce":1361608073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6827","nonce":1361608073}]},"public_addr":"172.21.15.114:6821/1361608073","cluster_addr":"172.21.15.114:6824/1361608073","heartbeat_back_addr":"172.21.15.114:6831/1361608073","heartbeat_front_addr":"172.21.15.114:6827/1361608073","state":["exists","up"]},{"osd":4,"uuid":"e47fb93e-13b4-44a4-b084-8c4384ceb41e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6801","nonce":930839681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6803","nonce":930839681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6807","nonce":930839681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6805","nonce":930839681}]},"public_addr":"172.21.15.172:6801/930839681","cluster_addr":"172.21.15.172:6803/930839681","heartbeat_back_addr":"172.21.15.172:6807/930839681","heartbeat_front_addr":"172.21.15.172:6805/930839681","state":["exists","up"]},{"osd":5,"uuid":"7561a973-f479-45a0-af40-f324728d622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6814","nonce":571761850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6818","nonce":571761850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6824","nonce":571761850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6821","nonce":571761850}]},"public_addr":"172.21.15.172:6814/571761850","cluster_addr":"172.21.15.172:6818/571761850","heartbeat_back_addr":"172.21.15.172:6824/571761850","heartbeat_front_addr":"172.21.15.172:6821/571761850","state":["exists","up"]},{"osd":6,"uuid":"51753f4b-7f06-4f1c-9ec7-6e18a66eb980","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6825","nonce":1680398853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6827","nonce":1680398853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6831","nonce":1680398853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6829","nonce":1680398853}]},"public_addr":"172.21.15.172:6825/1680398853","cluster_addr":"172.21.15.172:6827/1680398853","heartbeat_back_addr":"172.21.15.172:6831/1680398853","heartbeat_front_addr":"172.21.15.172:6829/1680398853","state":["exists","up"]},{"osd":7,"uuid":"4d8b1e15-143d-4d17-9074-59d92f0f9af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6809","nonce":349710101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6811","nonce":349710101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6819","nonce":349710101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6815","nonce":349710101}]},"public_addr":"172.21.15.172:6809/349710101","cluster_addr":"172.21.15.172:6811/349710101","heartbeat_back_addr":"172.21.15.172:6819/349710101","heartbeat_front_addr":"172.21.15.172:6815/349710101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.889460+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.475494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.911473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.648596+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.609994+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.636248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.854589+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.885826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T12:20:04.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.134+0000 7f3de359e700 1 -- 172.21.15.114:0/22080466 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f3dc40656f0 msgr2=0x7f3dc4067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:04.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.134+0000 7f3de359e700 1 --2- 172.21.15.114:0/22080466 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f3dc40656f0 0x7f3dc4067bb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc0090b0 tx=0x7f3dcc008030 comp rx=0 tx=0).stop 2023-10-18T12:20:04.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.134+0000 7f3de359e700 1 -- 172.21.15.114:0/22080466 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3de40b1df0 msgr2=0x7f3de40b4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:04.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.134+0000 7f3de359e700 1 --2- 172.21.15.114:0/22080466 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3de40b1df0 0x7f3de40b4c20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3dd400b4a0 tx=0x7f3dd400b7b0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.138+0000 7f3de359e700 1 -- 172.21.15.114:0/22080466 shutdown_connections 2023-10-18T12:20:04.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.138+0000 7f3de359e700 1 --2- 172.21.15.114:0/22080466 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f3dc40656f0 0x7f3dc4067bb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.138+0000 7f3de359e700 1 --2- 172.21.15.114:0/22080466 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3de40d30e0 0x7f3de4150970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.138+0000 7f3de359e700 1 --2- 172.21.15.114:0/22080466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3de415cc80 0x7f3de40b3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.138+0000 7f3de359e700 1 --2- 172.21.15.114:0/22080466 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3de40b1df0 0x7f3de40b4c20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.138+0000 7f3de359e700 1 -- 172.21.15.114:0/22080466 >> 172.21.15.114:0/22080466 conn(0x7f3de40cf530 msgr2=0x7f3de40b6810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:04.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.138+0000 7f3de359e700 1 -- 172.21.15.114:0/22080466 shutdown_connections 2023-10-18T12:20:04.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.138+0000 7f3de359e700 1 -- 172.21.15.114:0/22080466 wait complete. 2023-10-18T12:20:04.161 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-18T12:20:04.162 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T12:20:04.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.333+0000 7fc53eeca700 1 Processor -- start 2023-10-18T12:20:04.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.333+0000 7fc53eeca700 1 -- start start 2023-10-18T12:20:04.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.337+0000 7fc53eeca700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc53806e8a0 0x7fc5380caf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.337+0000 7fc53eeca700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc5380cb470 0x7fc53806f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.337+0000 7fc53eeca700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc53806f450 con 0x7fc53815ee50 2023-10-18T12:20:04.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.337+0000 7fc53eeca700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc53806d4e0 con 0x7fc53806e8a0 2023-10-18T12:20:04.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.337+0000 7fc53eeca700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc538162780 con 0x7fc5380cb470 2023-10-18T12:20:04.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.337+0000 7fc53cc66700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc53815ee50 0x7fc5380cc680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41618/0 (socket says 172.21.15.114:41618) 2023-10-18T12:20:04.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.337+0000 7fc53cc66700 1 -- 172.21.15.114:0/1925044413 learned_addr learned my addr 172.21.15.114:0/1925044413 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:04.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.337+0000 7fc52ffff700 1 --2- 172.21.15.114:0/1925044413 >> v2:172.21.15.172:3300/0 conn(0x7fc53806e8a0 0x7fc5380caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.337+0000 7fc53d467700 1 --2- 172.21.15.114:0/1925044413 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc5380cb470 0x7fc53806f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.337+0000 7fc52f7fe700 1 -- 172.21.15.114:0/1925044413 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1962874321 0 0) 0x7fc53806f450 con 0x7fc53815ee50 2023-10-18T12:20:04.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.337+0000 7fc52f7fe700 1 -- 172.21.15.114:0/1925044413 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5200035d0 con 0x7fc53815ee50 2023-10-18T12:20:04.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.337+0000 7fc52f7fe700 1 -- 172.21.15.114:0/1925044413 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2641757648 0 0) 0x7fc5200035d0 con 0x7fc53815ee50 2023-10-18T12:20:04.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.337+0000 7fc52f7fe700 1 -- 172.21.15.114:0/1925044413 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc5380cb470 msgr2=0x7fc53806f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:04.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.337+0000 7fc52f7fe700 1 --2- 172.21.15.114:0/1925044413 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc5380cb470 0x7fc53806f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.337+0000 7fc52f7fe700 1 -- 172.21.15.114:0/1925044413 >> v2:172.21.15.172:3300/0 conn(0x7fc53806e8a0 msgr2=0x7fc5380caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:04.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.337+0000 7fc52f7fe700 1 --2- 172.21.15.114:0/1925044413 >> v2:172.21.15.172:3300/0 conn(0x7fc53806e8a0 0x7fc5380caf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.337+0000 7fc52f7fe700 1 -- 172.21.15.114:0/1925044413 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5380cb8a0 con 0x7fc53815ee50 2023-10-18T12:20:04.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.337+0000 7fc52f7fe700 1 -- 172.21.15.114:0/1925044413 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3368469509 0 0) 0x7fc534001670 con 0x7fc53815ee50 2023-10-18T12:20:04.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.337+0000 7fc52f7fe700 1 -- 172.21.15.114:0/1925044413 >> v1:172.21.15.114:6789/0 conn(0x7fc53815ee50 legacy=0x7fc5380cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:04.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.337+0000 7fc52f7fe700 1 --2- 172.21.15.114:0/1925044413 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc5380cb470 0x7fc520003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.337+0000 7fc52f7fe700 1 --2- 172.21.15.114:0/1925044413 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc520003ff0 0x7fc520004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.337+0000 7fc52f7fe700 1 --2- 172.21.15.114:0/1925044413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc520004db0 0x7fc520005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.337+0000 7fc52f7fe700 1 -- 172.21.15.114:0/1925044413 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53806d4e0 con 0x7fc520003ff0 2023-10-18T12:20:04.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.337+0000 7fc52f7fe700 1 -- 172.21.15.114:0/1925044413 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc538162780 con 0x7fc520004db0 2023-10-18T12:20:04.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.337+0000 7fc52f7fe700 1 -- 172.21.15.114:0/1925044413 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc52000ba30 con 0x7fc5380cb470 2023-10-18T12:20:04.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.337+0000 7fc52ffff700 1 --2- 172.21.15.114:0/1925044413 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc520003ff0 0x7fc520004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.341+0000 7fc53cc66700 1 --2- 172.21.15.114:0/1925044413 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc5380cb470 0x7fc520003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.341+0000 7fc53d467700 1 --2- 172.21.15.114:0/1925044413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc520004db0 0x7fc520005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.341+0000 7fc53cc66700 1 -- 172.21.15.114:0/1925044413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc520004db0 msgr2=0x7fc520005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:04.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.341+0000 7fc53cc66700 1 --2- 172.21.15.114:0/1925044413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc520004db0 0x7fc520005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.341+0000 7fc53cc66700 1 -- 172.21.15.114:0/1925044413 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc520003ff0 msgr2=0x7fc520004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:04.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.341+0000 7fc53cc66700 1 --2- 172.21.15.114:0/1925044413 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc520003ff0 0x7fc520004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.341+0000 7fc53cc66700 1 -- 172.21.15.114:0/1925044413 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5200035d0 con 0x7fc5380cb470 2023-10-18T12:20:04.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.341+0000 7fc52ffff700 1 --2- 172.21.15.114:0/1925044413 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc520003ff0 0x7fc520004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:20:04.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.341+0000 7fc53cc66700 1 --2- 172.21.15.114:0/1925044413 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc5380cb470 0x7fc520003a20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc53400c240 tx=0x7fc5200058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb571b69ba37f7ff server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:04.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.341+0000 7fc52f7fe700 1 -- 172.21.15.114:0/1925044413 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53400cd40 con 0x7fc5380cb470 2023-10-18T12:20:04.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.341+0000 7fc52f7fe700 1 -- 172.21.15.114:0/1925044413 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc534005980 con 0x7fc5380cb470 2023-10-18T12:20:04.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.341+0000 7fc52f7fe700 1 -- 172.21.15.114:0/1925044413 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53400cea0 con 0x7fc5380cb470 2023-10-18T12:20:04.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.341+0000 7fc53eeca700 1 -- 172.21.15.114:0/1925044413 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc5380cb470 msgr2=0x7fc520003a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:04.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.341+0000 7fc53eeca700 1 --2- 172.21.15.114:0/1925044413 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc5380cb470 0x7fc520003a20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc53400c240 tx=0x7fc5200058a0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.341+0000 7fc53d467700 1 -- 172.21.15.114:0/1925044413 reap_dead start 2023-10-18T12:20:04.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.341+0000 7fc53eeca700 1 -- 172.21.15.114:0/1925044413 shutdown_connections 2023-10-18T12:20:04.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.341+0000 7fc53eeca700 1 -- 172.21.15.114:0/1925044413 >> 172.21.15.114:0/1925044413 conn(0x7fc53806a340 msgr2=0x7fc5380b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:04.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.341+0000 7fc53eeca700 1 -- 172.21.15.114:0/1925044413 shutdown_connections 2023-10-18T12:20:04.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.341+0000 7fc53eeca700 1 -- 172.21.15.114:0/1925044413 wait complete. 2023-10-18T12:20:04.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.345+0000 7fc53eeca700 1 Processor -- start 2023-10-18T12:20:04.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.345+0000 7fc53eeca700 1 -- start start 2023-10-18T12:20:04.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.349+0000 7fc53eeca700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5380cb470 0x7fc5380afdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.349+0000 7fc53eeca700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5380b1380 0x7fc5380b1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.349+0000 7fc53eeca700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc53814b6d0 0x7fc53814bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.349+0000 7fc53eeca700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc538149ee0 con 0x7fc5380b1380 2023-10-18T12:20:04.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.349+0000 7fc53eeca700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5380b1d40 con 0x7fc5380cb470 2023-10-18T12:20:04.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.349+0000 7fc53eeca700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5381495d0 con 0x7fc53814b6d0 2023-10-18T12:20:04.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.349+0000 7fc52ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5380b1380 0x7fc5380b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.349+0000 7fc52ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5380b1380 0x7fc5380b1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46900/0 (socket says 172.21.15.114:46900) 2023-10-18T12:20:04.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.349+0000 7fc52ffff700 1 -- 172.21.15.114:0/3511943989 learned_addr learned my addr 172.21.15.114:0/3511943989 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:04.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.349+0000 7fc53cc66700 1 --2- 172.21.15.114:0/3511943989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5380cb470 0x7fc5380afdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.349+0000 7fc53d467700 1 --2- 172.21.15.114:0/3511943989 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc53814b6d0 0x7fc53814bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.349+0000 7fc53cc66700 1 -- 172.21.15.114:0/3511943989 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc53814b6d0 msgr2=0x7fc53814bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:04.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.349+0000 7fc53cc66700 1 --2- 172.21.15.114:0/3511943989 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc53814b6d0 0x7fc53814bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.349+0000 7fc53cc66700 1 -- 172.21.15.114:0/3511943989 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5380b1380 msgr2=0x7fc5380b1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:04.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.349+0000 7fc53cc66700 1 --2- 172.21.15.114:0/3511943989 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5380b1380 0x7fc5380b1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.349+0000 7fc53cc66700 1 -- 172.21.15.114:0/3511943989 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc538149310 con 0x7fc5380cb470 2023-10-18T12:20:04.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.349+0000 7fc52ffff700 1 --2- 172.21.15.114:0/3511943989 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5380b1380 0x7fc5380b1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:20:04.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.349+0000 7fc53cc66700 1 --2- 172.21.15.114:0/3511943989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5380cb470 0x7fc5380afdd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc53400c210 tx=0x7fc534000fe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:04.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.349+0000 7fc52d7fa700 1 -- 172.21.15.114:0/3511943989 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc534004890 con 0x7fc5380cb470 2023-10-18T12:20:04.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.349+0000 7fc52d7fa700 1 -- 172.21.15.114:0/3511943989 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc534004a10 con 0x7fc5380cb470 2023-10-18T12:20:04.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.349+0000 7fc53eeca700 1 -- 172.21.15.114:0/3511943989 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5380ae1f0 con 0x7fc5380cb470 2023-10-18T12:20:04.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.349+0000 7fc52d7fa700 1 -- 172.21.15.114:0/3511943989 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc534004dc0 con 0x7fc5380cb470 2023-10-18T12:20:04.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.349+0000 7fc53eeca700 1 -- 172.21.15.114:0/3511943989 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc538149820 con 0x7fc5380cb470 2023-10-18T12:20:04.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.353+0000 7fc53eeca700 1 -- 172.21.15.114:0/3511943989 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc538072e60 con 0x7fc5380cb470 2023-10-18T12:20:04.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.353+0000 7fc52d7fa700 1 -- 172.21.15.114:0/3511943989 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fc5340070d0 con 0x7fc5380cb470 2023-10-18T12:20:04.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.357+0000 7fc52d7fa700 1 --2- 172.21.15.114:0/3511943989 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc5240656f0 0x7fc524067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.357+0000 7fc52d7fa700 1 -- 172.21.15.114:0/3511943989 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc534084220 con 0x7fc5380cb470 2023-10-18T12:20:04.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.357+0000 7fc52ffff700 1 --2- 172.21.15.114:0/3511943989 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc5240656f0 0x7fc524067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.357+0000 7fc52ffff700 1 --2- 172.21.15.114:0/3511943989 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc5240656f0 0x7fc524067bb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc528006bc0 tx=0x7fc528009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:04.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.365+0000 7fc52d7fa700 1 -- 172.21.15.114:0/3511943989 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fc534051b00 con 0x7fc5380cb470 2023-10-18T12:20:04.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.549+0000 7fc53eeca700 1 -- 172.21.15.114:0/3511943989 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5380b1160 con 0x7fc5380cb470 2023-10-18T12:20:04.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.553+0000 7fc52d7fa700 1 -- 172.21.15.114:0/3511943989 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20144 (secure 0 0 0) 0x7fc534055120 con 0x7fc5380cb470 2023-10-18T12:20:04.559 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:20:04.559 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":28,"fsid":"240ea340-5d3d-4f52-a4bc-af075aca3deb","created":"2023-10-18T12:19:12.512994+0000","modified":"2023-10-18T12:19:44.436656+0000","last_up_change":"2023-10-18T12:19:25.286009+0000","last_in_change":"2023-10-18T12:19:15.850693+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T12:19:27.040638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-18T12:19:32.358094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-18T12:19:37.333855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-18T12:19:38.055385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-18T12:19:41.679218+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c3578978-1a03-4857-b9d2-34a5da3d7731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6817","nonce":1506287862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6820","nonce":1506287862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6830","nonce":1506287862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6825","nonce":1506287862}]},"public_addr":"172.21.15.114:6817/1506287862","cluster_addr":"172.21.15.114:6820/1506287862","heartbeat_back_addr":"172.21.15.114:6830/1506287862","heartbeat_front_addr":"172.21.15.114:6825/1506287862","state":["exists","up"]},{"osd":1,"uuid":"43eb26a6-e2b3-4670-9559-bd053b5140d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6801","nonce":3302727047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6803","nonce":3302727047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6807","nonce":3302727047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6805","nonce":3302727047}]},"public_addr":"172.21.15.114:6801/3302727047","cluster_addr":"172.21.15.114:6803/3302727047","heartbeat_back_addr":"172.21.15.114:6807/3302727047","heartbeat_front_addr":"172.21.15.114:6805/3302727047","state":["exists","up"]},{"osd":2,"uuid":"f3d4dbd5-521c-4dd2-b687-5768cc7d0938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6809","nonce":2699151351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6811","nonce":2699151351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6815","nonce":2699151351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6813","nonce":2699151351}]},"public_addr":"172.21.15.114:6809/2699151351","cluster_addr":"172.21.15.114:6811/2699151351","heartbeat_back_addr":"172.21.15.114:6815/2699151351","heartbeat_front_addr":"172.21.15.114:6813/2699151351","state":["exists","up"]},{"osd":3,"uuid":"823e5802-92b7-4f0d-b32d-a5748993f1b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6821","nonce":1361608073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6824","nonce":1361608073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6829","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6831","nonce":1361608073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6827","nonce":1361608073}]},"public_addr":"172.21.15.114:6821/1361608073","cluster_addr":"172.21.15.114:6824/1361608073","heartbeat_back_addr":"172.21.15.114:6831/1361608073","heartbeat_front_addr":"172.21.15.114:6827/1361608073","state":["exists","up"]},{"osd":4,"uuid":"e47fb93e-13b4-44a4-b084-8c4384ceb41e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6801","nonce":930839681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6803","nonce":930839681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6807","nonce":930839681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6805","nonce":930839681}]},"public_addr":"172.21.15.172:6801/930839681","cluster_addr":"172.21.15.172:6803/930839681","heartbeat_back_addr":"172.21.15.172:6807/930839681","heartbeat_front_addr":"172.21.15.172:6805/930839681","state":["exists","up"]},{"osd":5,"uuid":"7561a973-f479-45a0-af40-f324728d622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6814","nonce":571761850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6818","nonce":571761850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6824","nonce":571761850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6821","nonce":571761850}]},"public_addr":"172.21.15.172:6814/571761850","cluster_addr":"172.21.15.172:6818/571761850","heartbeat_back_addr":"172.21.15.172:6824/571761850","heartbeat_front_addr":"172.21.15.172:6821/571761850","state":["exists","up"]},{"osd":6,"uuid":"51753f4b-7f06-4f1c-9ec7-6e18a66eb980","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6825","nonce":1680398853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6827","nonce":1680398853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6831","nonce":1680398853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6829","nonce":1680398853}]},"public_addr":"172.21.15.172:6825/1680398853","cluster_addr":"172.21.15.172:6827/1680398853","heartbeat_back_addr":"172.21.15.172:6831/1680398853","heartbeat_front_addr":"172.21.15.172:6829/1680398853","state":["exists","up"]},{"osd":7,"uuid":"4d8b1e15-143d-4d17-9074-59d92f0f9af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6809","nonce":349710101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6811","nonce":349710101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6819","nonce":349710101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6815","nonce":349710101}]},"public_addr":"172.21.15.172:6809/349710101","cluster_addr":"172.21.15.172:6811/349710101","heartbeat_back_addr":"172.21.15.172:6819/349710101","heartbeat_front_addr":"172.21.15.172:6815/349710101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.889460+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.475494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.911473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.648596+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.609994+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.636248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.854589+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.885826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T12:20:04.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.557+0000 7fc53eeca700 1 -- 172.21.15.114:0/3511943989 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc5240656f0 msgr2=0x7fc524067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:04.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.557+0000 7fc53eeca700 1 --2- 172.21.15.114:0/3511943989 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc5240656f0 0x7fc524067bb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc528006bc0 tx=0x7fc528009240 comp rx=0 tx=0).stop 2023-10-18T12:20:04.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.557+0000 7fc53eeca700 1 -- 172.21.15.114:0/3511943989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5380cb470 msgr2=0x7fc5380afdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:04.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.557+0000 7fc53eeca700 1 --2- 172.21.15.114:0/3511943989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5380cb470 0x7fc5380afdd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc53400c210 tx=0x7fc534000fe0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.557+0000 7fc53eeca700 1 -- 172.21.15.114:0/3511943989 shutdown_connections 2023-10-18T12:20:04.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.557+0000 7fc53eeca700 1 --2- 172.21.15.114:0/3511943989 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc5240656f0 0x7fc524067bb0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.557+0000 7fc53eeca700 1 --2- 172.21.15.114:0/3511943989 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc53814b6d0 0x7fc53814bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.557+0000 7fc53eeca700 1 --2- 172.21.15.114:0/3511943989 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5380b1380 0x7fc5380b1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.557+0000 7fc53eeca700 1 --2- 172.21.15.114:0/3511943989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5380cb470 0x7fc5380afdd0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.557+0000 7fc53eeca700 1 -- 172.21.15.114:0/3511943989 >> 172.21.15.114:0/3511943989 conn(0x7fc53806a340 msgr2=0x7fc538163b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:04.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.557+0000 7fc53eeca700 1 -- 172.21.15.114:0/3511943989 shutdown_connections 2023-10-18T12:20:04.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.557+0000 7fc53eeca700 1 -- 172.21.15.114:0/3511943989 wait complete. 2023-10-18T12:20:04.580 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-18T12:20:04.581 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-18T12:20:04.582 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-18T12:20:04.583 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-18T12:20:04.584 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-18T12:20:04.585 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-18T12:20:04.586 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-18T12:20:04.587 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-18T12:20:04.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.809+0000 7f034209e700 1 Processor -- start 2023-10-18T12:20:04.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.809+0000 7f034209e700 1 -- start start 2023-10-18T12:20:04.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.813+0000 7f034209e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f033c15ad90 0x7f033c06f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.813+0000 7f034209e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f033c0709d0 con 0x7f033c0cb960 2023-10-18T12:20:04.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.813+0000 7f033b7fe700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f033c15ad90 0x7f033c06f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.813+0000 7f033b7fe700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f033c15ad90 0x7f033c06f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.114:56616/0 (socket says 172.21.15.114:56616) 2023-10-18T12:20:04.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.813+0000 7f033b7fe700 1 -- 172.21.15.114:0/79346087 learned_addr learned my addr 172.21.15.114:0/79346087 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:04.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.813+0000 7f034209e700 1 -- 172.21.15.114:0/79346087 --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f033c15b170 con 0x7f033c0afe20 2023-10-18T12:20:04.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.813+0000 7f034209e700 1 -- 172.21.15.114:0/79346087 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f033c06fdc0 con 0x7f033c15ad90 2023-10-18T12:20:04.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.813+0000 7f033b7fe700 1 -- 172.21.15.114:0/79346087 >> v1:172.21.15.172:6789/0 conn(0x7f033c0afe20 legacy=0x7f033c0cb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:04.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.813+0000 7f033b7fe700 1 -- 172.21.15.114:0/79346087 >> v1:172.21.15.114:6789/0 conn(0x7f033c0cb960 legacy=0x7f033c0b3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:04.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.813+0000 7f6027fff700 1 Processor -- start 2023-10-18T12:20:04.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.817+0000 7f033b7fe700 1 -- 172.21.15.114:0/79346087 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f033c0700a0 con 0x7f033c15ad90 2023-10-18T12:20:04.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.817+0000 7f6027fff700 1 -- start start 2023-10-18T12:20:04.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.817+0000 7f033b7fe700 1 --2- 172.21.15.114:0/79346087 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f033c15ad90 0x7f033c06f450 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0324009940 tx=0x7f0324009c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=637f3e3adfa19ab6 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:04.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.817+0000 7f033a7fc700 1 -- 172.21.15.114:0/79346087 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0324004230 con 0x7f033c15ad90 2023-10-18T12:20:04.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.817+0000 7f033a7fc700 1 -- 172.21.15.114:0/79346087 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0324009e90 con 0x7f033c15ad90 2023-10-18T12:20:04.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.817+0000 7f033a7fc700 1 -- 172.21.15.114:0/79346087 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0324004230 con 0x7f033c15ad90 2023-10-18T12:20:04.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.817+0000 7f6027fff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f60200e6ea0 0x7f60200e7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.817+0000 7f6027fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f60200070d0 0x7f6020053f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.817+0000 7f6027fff700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60200079d0 con 0x7f602003a9b0 2023-10-18T12:20:04.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.817+0000 7f6027fff700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60200e77c0 con 0x7f60200070d0 2023-10-18T12:20:04.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.817+0000 7f6027fff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6020053140 con 0x7f60200e6ea0 2023-10-18T12:20:04.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.817+0000 7f034209e700 1 -- 172.21.15.114:0/79346087 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f033c15ad90 msgr2=0x7f033c06f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:04.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.817+0000 7f034209e700 1 --2- 172.21.15.114:0/79346087 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f033c15ad90 0x7f033c06f450 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0324009940 tx=0x7f0324009c50 comp rx=0 tx=0).stop 2023-10-18T12:20:04.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.817+0000 7f034209e700 1 -- 172.21.15.114:0/79346087 shutdown_connections 2023-10-18T12:20:04.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.817+0000 7f034209e700 1 --2- 172.21.15.114:0/79346087 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f033c15ad90 0x7f033c06f450 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.817+0000 7f034209e700 1 -- 172.21.15.114:0/79346087 >> 172.21.15.114:0/79346087 conn(0x7f033c0d09f0 msgr2=0x7f033c0d0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:04.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.817+0000 7f60277fe700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f60200070d0 0x7f6020053f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.817+0000 7f60277fe700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f60200070d0 0x7f6020053f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46906/0 (socket says 172.21.15.114:46906) 2023-10-18T12:20:04.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.817+0000 7f60277fe700 1 -- 172.21.15.114:0/2483826410 learned_addr learned my addr 172.21.15.114:0/2483826410 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:04.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.817+0000 7f034209e700 1 -- 172.21.15.114:0/79346087 shutdown_connections 2023-10-18T12:20:04.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.817+0000 7f034209e700 1 -- 172.21.15.114:0/79346087 wait complete. 2023-10-18T12:20:04.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.821+0000 7f6025ffb700 1 -- 172.21.15.114:0/2483826410 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3836371434 0 0) 0x7f60200079d0 con 0x7f602003a9b0 2023-10-18T12:20:04.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.821+0000 7f60277fe700 1 -- 172.21.15.114:0/2483826410 >> v2:172.21.15.172:3300/0 conn(0x7f60200e6ea0 msgr2=0x7f60200e7280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-18T12:20:04.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.821+0000 7f60277fe700 1 --2- 172.21.15.114:0/2483826410 >> v2:172.21.15.172:3300/0 conn(0x7f60200e6ea0 0x7f60200e7280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.821+0000 7f60277fe700 1 -- 172.21.15.114:0/2483826410 >> v1:172.21.15.114:6789/0 conn(0x7f602003a9b0 legacy=0x7f6020037e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:04.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.821+0000 7f60277fe700 1 -- 172.21.15.114:0/2483826410 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6020053420 con 0x7f60200070d0 2023-10-18T12:20:04.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.821+0000 7f60277fe700 1 --2- 172.21.15.114:0/2483826410 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60200070d0 0x7f6020053f00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6028073230 tx=0x7f602804f0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20d5c618e22a718f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:04.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.821+0000 7f6025ffb700 1 -- 172.21.15.114:0/2483826410 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6028073540 con 0x7f60200070d0 2023-10-18T12:20:04.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.821+0000 7f6025ffb700 1 -- 172.21.15.114:0/2483826410 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f602808d070 con 0x7f60200070d0 2023-10-18T12:20:04.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.821+0000 7f6025ffb700 1 -- 172.21.15.114:0/2483826410 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60280720d0 con 0x7f60200070d0 2023-10-18T12:20:04.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.821+0000 7f034209e700 1 Processor -- start 2023-10-18T12:20:04.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.821+0000 7f6027fff700 1 -- 172.21.15.114:0/2483826410 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60200070d0 msgr2=0x7f6020053f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:04.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.821+0000 7f6027fff700 1 --2- 172.21.15.114:0/2483826410 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60200070d0 0x7f6020053f00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6028073230 tx=0x7f602804f0b0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.825+0000 7f6027fff700 1 -- 172.21.15.114:0/2483826410 shutdown_connections 2023-10-18T12:20:04.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.821+0000 7f034209e700 1 -- start start 2023-10-18T12:20:04.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.825+0000 7f6027fff700 1 --2- 172.21.15.114:0/2483826410 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60200070d0 0x7f6020053f00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.825+0000 7f6027fff700 1 --2- 172.21.15.114:0/2483826410 >> v2:172.21.15.172:3300/0 conn(0x7f60200e6ea0 0x7f60200e7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.825+0000 7f6027fff700 1 -- 172.21.15.114:0/2483826410 >> 172.21.15.114:0/2483826410 conn(0x7f6020054cf0 msgr2=0x7f6020055100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:04.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.825+0000 7fd687392700 1 Processor -- start 2023-10-18T12:20:04.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.825+0000 7fd687392700 1 -- start start 2023-10-18T12:20:04.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.825+0000 7f034209e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f033c0afe20 0x7f033c0cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.825+0000 7f034209e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f033c0cb960 0x7f033c0c4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.825+0000 7f034209e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f033c15ad90 0x7f033c0c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.825+0000 7f034209e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f033c0cf720 con 0x7f033c0afe20 2023-10-18T12:20:04.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.825+0000 7f034209e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f033c1f68c0 con 0x7f033c15ad90 2023-10-18T12:20:04.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.825+0000 7f034209e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f033c0c55c0 con 0x7f033c0cb960 2023-10-18T12:20:04.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.825+0000 7f033b7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f033c0afe20 0x7f033c0cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.825+0000 7f033b7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f033c0afe20 0x7f033c0cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46914/0 (socket says 172.21.15.114:46914) 2023-10-18T12:20:04.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.825+0000 7f033b7fe700 1 -- 172.21.15.114:0/2311759537 learned_addr learned my addr 172.21.15.114:0/2311759537 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:04.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.825+0000 7f6027fff700 1 -- 172.21.15.114:0/2483826410 shutdown_connections 2023-10-18T12:20:04.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.825+0000 7f6027fff700 1 -- 172.21.15.114:0/2483826410 wait complete. 2023-10-18T12:20:04.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.825+0000 7f033affd700 1 --2- 172.21.15.114:0/2311759537 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f033c0cb960 0x7f033c0c4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.825+0000 7f033bfff700 1 --2- 172.21.15.114:0/2311759537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f033c15ad90 0x7f033c0c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.825+0000 7fd687392700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd6800b1740 0x7fd6800b2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7f033affd700 1 -- 172.21.15.114:0/2311759537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f033c15ad90 msgr2=0x7f033c0c9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:04.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7f033affd700 1 --2- 172.21.15.114:0/2311759537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f033c15ad90 0x7f033c0c9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7f033affd700 1 -- 172.21.15.114:0/2311759537 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f033c0afe20 msgr2=0x7f033c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:04.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7f033affd700 1 --2- 172.21.15.114:0/2311759537 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f033c0afe20 0x7f033c0cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7f033affd700 1 -- 172.21.15.114:0/2311759537 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0324009570 con 0x7f033c0cb960 2023-10-18T12:20:04.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7f6027fff700 1 Processor -- start 2023-10-18T12:20:04.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7f6027fff700 1 -- start start 2023-10-18T12:20:04.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7fd68492d700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd6800b1740 0x7fd6800b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7fd68492d700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd6800b1740 0x7fd6800b2150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:35680/0 (socket says 172.21.15.114:35680) 2023-10-18T12:20:04.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7fd68592f700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fd680069d10 0x7fd68006e270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.114:59774/0 (socket says 172.21.15.114:59774) 2023-10-18T12:20:04.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7fd68592f700 1 -- 172.21.15.114:0/3797451016 learned_addr learned my addr 172.21.15.114:0/3797451016 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:04.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7fd68512e700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd68015cd00 0x7fd6800adc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:41650/0 (socket says 172.21.15.114:41650) 2023-10-18T12:20:04.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7fd687392700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6800ac7f0 con 0x7fd68015cd00 2023-10-18T12:20:04.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7fd687392700 1 -- 172.21.15.114:0/3797451016 --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd68006dae0 con 0x7fd680069d10 2023-10-18T12:20:04.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7fd687392700 1 -- 172.21.15.114:0/3797451016 --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6800aca40 con 0x7fd6800b1740 2023-10-18T12:20:04.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7fd67ffff700 1 -- 172.21.15.114:0/3797451016 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4179701887 0 0) 0x7fd68006dae0 con 0x7fd680069d10 2023-10-18T12:20:04.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7fd67ffff700 1 -- 172.21.15.114:0/3797451016 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6680035d0 con 0x7fd680069d10 2023-10-18T12:20:04.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7f6027fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60200070d0 0x7f602002c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7f6027fff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f602003a9b0 0x7f60200e2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7f6027fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60200e6ea0 0x7f60200e0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7fd67ffff700 1 -- 172.21.15.114:0/3797451016 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3274837814 0 0) 0x7fd6800ac7f0 con 0x7fd68015cd00 2023-10-18T12:20:04.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7fd67ffff700 1 -- 172.21.15.114:0/3797451016 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd68006dae0 con 0x7fd68015cd00 2023-10-18T12:20:04.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7fd67ffff700 1 -- 172.21.15.114:0/3797451016 <== mon.1 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1057938921 0 0) 0x7fd6680035d0 con 0x7fd680069d10 2023-10-18T12:20:04.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7fd67ffff700 1 -- 172.21.15.114:0/3797451016 >> v2:172.21.15.172:3300/0 conn(0x7fd6800b1740 msgr2=0x7fd6800b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:04.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7fd67ffff700 1 --2- 172.21.15.114:0/3797451016 >> v2:172.21.15.172:3300/0 conn(0x7fd6800b1740 0x7fd6800b2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7fd67ffff700 1 -- 172.21.15.114:0/3797451016 >> v1:172.21.15.114:6789/0 conn(0x7fd68015cd00 legacy=0x7fd6800adc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:04.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7fd67ffff700 1 -- 172.21.15.114:0/3797451016 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6800acd20 con 0x7fd680069d10 2023-10-18T12:20:04.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7fd67ffff700 1 -- 172.21.15.114:0/3797451016 <== mon.1 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3368469509 0 0) 0x7fd670001670 con 0x7fd680069d10 2023-10-18T12:20:04.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7fd67ffff700 1 -- 172.21.15.114:0/3797451016 >> v1:172.21.15.172:6789/0 conn(0x7fd680069d10 legacy=0x7fd68006e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:04.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7fd67ffff700 1 --2- 172.21.15.114:0/3797451016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd668003bb0 0x7fd668003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7fd67ffff700 1 --2- 172.21.15.114:0/3797451016 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd668004870 0x7fd668004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7fd67ffff700 1 --2- 172.21.15.114:0/3797451016 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd668005230 0x7fd66800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7fd67ffff700 1 -- 172.21.15.114:0/3797451016 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6800aca40 con 0x7fd668004870 2023-10-18T12:20:04.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7fd67ffff700 1 -- 172.21.15.114:0/3797451016 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd66800c0b0 con 0x7fd668003bb0 2023-10-18T12:20:04.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7fd67ffff700 1 -- 172.21.15.114:0/3797451016 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd66800c270 con 0x7fd668005230 2023-10-18T12:20:04.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7f6026ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60200070d0 0x7f602002c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7f6027fff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602004ce10 con 0x7f60200070d0 2023-10-18T12:20:04.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7f6027fff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60200e2c80 con 0x7f60200e6ea0 2023-10-18T12:20:04.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7f6027fff700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60200e2f00 con 0x7f602003a9b0 2023-10-18T12:20:04.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7f6026ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60200070d0 0x7f602002c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:46918/0 (socket says 172.21.15.114:46918) 2023-10-18T12:20:04.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7f6026ffd700 1 -- 172.21.15.114:0/3302328918 learned_addr learned my addr 172.21.15.114:0/3302328918 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:04.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7f60267fc700 1 --2- 172.21.15.114:0/3302328918 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f602003a9b0 0x7f60200e2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7f4dc9d75700 1 Processor -- start 2023-10-18T12:20:04.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7f4dc9d75700 1 -- start start 2023-10-18T12:20:04.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7f6026ffd700 1 -- 172.21.15.114:0/3302328918 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f602003a9b0 msgr2=0x7f60200e2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:04.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7f60277fe700 1 --2- 172.21.15.114:0/3302328918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60200e6ea0 0x7f60200e0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7f6026ffd700 1 --2- 172.21.15.114:0/3302328918 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f602003a9b0 0x7f60200e2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7f6026ffd700 1 -- 172.21.15.114:0/3302328918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60200e6ea0 msgr2=0x7f60200e0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:04.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7fd68492d700 1 --2- 172.21.15.114:0/3797451016 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd668004870 0x7fd668004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7f033affd700 1 --2- 172.21.15.114:0/2311759537 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f033c0cb960 0x7f033c0c4b50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f033c0b0240 tx=0x7f0334001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:04.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7f6026ffd700 1 --2- 172.21.15.114:0/3302328918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60200e6ea0 0x7f60200e0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7fd68592f700 1 --2- 172.21.15.114:0/3797451016 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd668005230 0x7fd66800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7f0333fff700 1 -- 172.21.15.114:0/2311759537 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03340052d0 con 0x7f033c0cb960 2023-10-18T12:20:04.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7f0333fff700 1 -- 172.21.15.114:0/2311759537 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0334005430 con 0x7f033c0cb960 2023-10-18T12:20:04.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7f0333fff700 1 -- 172.21.15.114:0/2311759537 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03340055a0 con 0x7f033c0cb960 2023-10-18T12:20:04.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7f6026ffd700 1 -- 172.21.15.114:0/3302328918 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f602004d060 con 0x7f60200070d0 2023-10-18T12:20:04.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.829+0000 7f60277fe700 1 --2- 172.21.15.114:0/3302328918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f60200e6ea0 0x7f60200e0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:20:04.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.833+0000 7f6026ffd700 1 --2- 172.21.15.114:0/3302328918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60200070d0 0x7f602002c7e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f601c00b4d0 tx=0x7f601c00b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:04.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.833+0000 7fd68492d700 1 -- 172.21.15.114:0/3797451016 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd668005230 msgr2=0x7fd66800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:04.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.833+0000 7fd68492d700 1 --2- 172.21.15.114:0/3797451016 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd668005230 0x7fd66800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.833+0000 7fd68492d700 1 -- 172.21.15.114:0/3797451016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd668003bb0 msgr2=0x7fd668003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:04.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.833+0000 7fd68492d700 1 --2- 172.21.15.114:0/3797451016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd668003bb0 0x7fd668003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.833+0000 7fd68492d700 1 -- 172.21.15.114:0/3797451016 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6800acd20 con 0x7fd668004870 2023-10-18T12:20:04.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.833+0000 7fd68592f700 1 -- 172.21.15.114:0/3797451016 reap_dead start 2023-10-18T12:20:04.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.833+0000 7fd68492d700 1 --2- 172.21.15.114:0/3797451016 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd668004870 0x7fd668004cf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd674009b20 tx=0x7fd6680058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e569dbadfc0747c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:04.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.833+0000 7f034209e700 1 -- 172.21.15.114:0/2311759537 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f033c0c58a0 con 0x7f033c0cb960 2023-10-18T12:20:04.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.833+0000 7f034209e700 1 -- 172.21.15.114:0/2311759537 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f033c0c5e60 con 0x7f033c0cb960 2023-10-18T12:20:04.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.833+0000 7f600f7fe700 1 -- 172.21.15.114:0/3302328918 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c011830 con 0x7f60200070d0 2023-10-18T12:20:04.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.833+0000 7f4dc9d75700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4dc4146650 0x7f4dc40b76c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.833+0000 7f600f7fe700 1 -- 172.21.15.114:0/3302328918 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601c0119b0 con 0x7f60200070d0 2023-10-18T12:20:04.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.833+0000 7f600f7fe700 1 -- 172.21.15.114:0/3302328918 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c011d60 con 0x7f60200070d0 2023-10-18T12:20:04.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.833+0000 7f6027fff700 1 -- 172.21.15.114:0/3302328918 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f602004d340 con 0x7f60200070d0 2023-10-18T12:20:04.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.833+0000 7f6027fff700 1 -- 172.21.15.114:0/3302328918 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60200e0d50 con 0x7f60200070d0 2023-10-18T12:20:04.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.833+0000 7fd67ffff700 1 -- 172.21.15.114:0/3797451016 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd674004020 con 0x7fd668004870 2023-10-18T12:20:04.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.833+0000 7fd67ffff700 1 -- 172.21.15.114:0/3797451016 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd674004180 con 0x7fd668004870 2023-10-18T12:20:04.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.833+0000 7fd67ffff700 1 -- 172.21.15.114:0/3797451016 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6740044f0 con 0x7fd668004870 2023-10-18T12:20:04.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.833+0000 7f4dc9d75700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4dc40700c0 0x7f4dc415d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.833+0000 7fe75689e700 1 Processor -- start 2023-10-18T12:20:04.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.833+0000 7f4dc9d75700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dc40b8060 con 0x7f4dc40b7c00 2023-10-18T12:20:04.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.833+0000 7f4dc9d75700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc40b6930 con 0x7f4dc4146650 2023-10-18T12:20:04.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.833+0000 7f034209e700 1 -- 172.21.15.114:0/2311759537 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f033c070660 con 0x7f033c0cb960 2023-10-18T12:20:04.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.837+0000 7f6027fff700 1 -- 172.21.15.114:0/3302328918 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f60200539e0 con 0x7f60200070d0 2023-10-18T12:20:04.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.833+0000 7f4dc2ffd700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f4dc40b7c00 0x7f4dc406f9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.114:59778/0 (socket says 172.21.15.114:59778) 2023-10-18T12:20:04.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.833+0000 7f4dc2ffd700 1 -- 172.21.15.114:0/2957987988 learned_addr learned my addr 172.21.15.114:0/2957987988 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:04.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.833+0000 7f4dc3fff700 1 --2- 172.21.15.114:0/2957987988 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4dc40700c0 0x7f4dc415d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.837+0000 7f4dc9d75700 1 -- 172.21.15.114:0/2957987988 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc40b5d20 con 0x7f4dc40700c0 2023-10-18T12:20:04.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.837+0000 7f4dc27fc700 1 -- 172.21.15.114:0/2957987988 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1162211578 0 0) 0x7f4dc40b8060 con 0x7f4dc40b7c00 2023-10-18T12:20:04.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.833+0000 7fe75689e700 1 -- start start 2023-10-18T12:20:04.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.837+0000 7fd687392700 1 -- 172.21.15.114:0/3797451016 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd668004870 msgr2=0x7fd668004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:04.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.837+0000 7fd687392700 1 --2- 172.21.15.114:0/3797451016 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd668004870 0x7fd668004cf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd674009b20 tx=0x7fd6680058a0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.837+0000 7f4dc27fc700 1 -- 172.21.15.114:0/2957987988 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dac0035d0 con 0x7f4dc40b7c00 2023-10-18T12:20:04.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.837+0000 7fd687392700 1 -- 172.21.15.114:0/3797451016 shutdown_connections 2023-10-18T12:20:04.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.837+0000 7fd687392700 1 --2- 172.21.15.114:0/3797451016 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd668004870 0x7fd668004cf0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.837+0000 7fd687392700 1 -- 172.21.15.114:0/3797451016 >> 172.21.15.114:0/3797451016 conn(0x7fd6800ce660 msgr2=0x7fd6800cea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:04.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.837+0000 7f4dc37fe700 1 --2- 172.21.15.114:0/2957987988 >> v2:172.21.15.114:3300/0 conn(0x7f4dc4146650 0x7f4dc40b76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.837+0000 7f4dc27fc700 1 -- 172.21.15.114:0/2957987988 <== mon.1 v1:172.21.15.172:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 311961662 0 0) 0x7f4dac0035d0 con 0x7f4dc40b7c00 2023-10-18T12:20:04.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.837+0000 7f4dc27fc700 1 -- 172.21.15.114:0/2957987988 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4dc40700c0 msgr2=0x7f4dc415d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:04.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.837+0000 7f4dc27fc700 1 --2- 172.21.15.114:0/2957987988 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4dc40700c0 0x7f4dc415d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.837+0000 7f4dc27fc700 1 -- 172.21.15.114:0/2957987988 >> v2:172.21.15.114:3300/0 conn(0x7f4dc4146650 msgr2=0x7f4dc40b76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:04.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.837+0000 7f4dc27fc700 1 --2- 172.21.15.114:0/2957987988 >> v2:172.21.15.114:3300/0 conn(0x7f4dc4146650 0x7f4dc40b76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.837+0000 7f4dc27fc700 1 -- 172.21.15.114:0/2957987988 --> v1:172.21.15.172:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc40b6000 con 0x7f4dc40b7c00 2023-10-18T12:20:04.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.837+0000 7f4dc27fc700 1 -- 172.21.15.114:0/2957987988 <== mon.1 v1:172.21.15.172:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3368469509 0 0) 0x7f4dbc0019f0 con 0x7f4dc40b7c00 2023-10-18T12:20:04.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.837+0000 7fd687392700 1 -- 172.21.15.114:0/3797451016 shutdown_connections 2023-10-18T12:20:04.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.837+0000 7f4dc27fc700 1 -- 172.21.15.114:0/2957987988 >> v1:172.21.15.172:6789/0 conn(0x7f4dc40b7c00 legacy=0x7f4dc406f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:04.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.837+0000 7f4dc27fc700 1 --2- 172.21.15.114:0/2957987988 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4dac003a20 0x7f4dac003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.837+0000 7f600f7fe700 1 -- 172.21.15.114:0/3302328918 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f601c01a400 con 0x7f60200070d0 2023-10-18T12:20:04.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.837+0000 7fe75689e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe7500b7dd0 0x7fe75006f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.837+0000 7fe75689e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe75006fef0 0x7fe75015d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.837+0000 7f9bc3d2b700 1 Processor -- start 2023-10-18T12:20:04.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.837+0000 7fe74f7fe700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe7500b7dd0 0x7fe75006f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.837+0000 7fe74f7fe700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe7500b7dd0 0x7fe75006f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:35708/0 (socket says 172.21.15.114:35708) 2023-10-18T12:20:04.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.837+0000 7fe74f7fe700 1 -- 172.21.15.114:0/3885191431 learned_addr learned my addr 172.21.15.114:0/3885191431 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:04.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.837+0000 7f9bc3d2b700 1 -- start start 2023-10-18T12:20:04.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.837+0000 7fe75689e700 1 -- 172.21.15.114:0/3885191431 --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7500b6930 con 0x7fe750146650 2023-10-18T12:20:04.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.837+0000 7fe75689e700 1 -- 172.21.15.114:0/3885191431 --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe750070380 con 0x7fe75006fef0 2023-10-18T12:20:04.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.837+0000 7fe75689e700 1 -- 172.21.15.114:0/3885191431 --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7500b5d20 con 0x7fe7500b7dd0 2023-10-18T12:20:04.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.837+0000 7fc68b211700 1 Processor -- start 2023-10-18T12:20:04.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.837+0000 7f600f7fe700 1 --2- 172.21.15.114:0/3302328918 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f60140657c0 0x7f6014067c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.837+0000 7f600f7fe700 1 -- 172.21.15.114:0/3302328918 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f601c082f40 con 0x7f60200070d0 2023-10-18T12:20:04.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7fc68b211700 1 -- start start 2023-10-18T12:20:04.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7f600f7fe700 1 --2- 172.21.15.114:0/3302328918 >> [v2:172.21.15.114:6800/3302727047,v1:172.21.15.114:6801/3302727047] conn(0x7f601406f420 0x7f6014071860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7f600f7fe700 1 -- 172.21.15.114:0/3302328918 --> [v2:172.21.15.114:6800/3302727047,v1:172.21.15.114:6801/3302727047] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6014071f30 con 0x7f601406f420 2023-10-18T12:20:04.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7f600f7fe700 1 -- 172.21.15.114:0/3302328918 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f601c050830 con 0x7f60200070d0 2023-10-18T12:20:04.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7f60277fe700 1 --2- 172.21.15.114:0/3302328918 >> [v2:172.21.15.114:6800/3302727047,v1:172.21.15.114:6801/3302727047] conn(0x7f601406f420 0x7f6014071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7f60267fc700 1 --2- 172.21.15.114:0/3302328918 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f60140657c0 0x7f6014067c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7fe754e3b700 1 --2- 172.21.15.114:0/3885191431 >> v2:172.21.15.114:3300/0 conn(0x7fe75006fef0 0x7fe75015d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7f9bc3d2b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9bbc0b7dd0 0x7f9bbc06f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7f9bc3d2b700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9bbc06fef0 0x7f9bbc15d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7f9bc3d2b700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bbc0b6930 con 0x7f9bbc146650 2023-10-18T12:20:04.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7f9bc3d2b700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bbc070380 con 0x7f9bbc06fef0 2023-10-18T12:20:04.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7f9bc3d2b700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bbc0b5d20 con 0x7f9bbc0b7dd0 2023-10-18T12:20:04.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7fe74effd700 1 -- 172.21.15.114:0/3885191431 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1380458413 0 0) 0x7fe7500b6930 con 0x7fe750146650 2023-10-18T12:20:04.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7fe74effd700 1 -- 172.21.15.114:0/3885191431 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7380035d0 con 0x7fe750146650 2023-10-18T12:20:04.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7f60277fe700 1 --2- 172.21.15.114:0/3302328918 >> [v2:172.21.15.114:6800/3302727047,v1:172.21.15.114:6801/3302727047] conn(0x7f601406f420 0x7f6014071860 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:04.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7fc68b211700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc684158ef0 0x7fc6840ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7fc68b211700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc6840cd0f0 0x7fc68406f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7f9bc1ac7700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f9bbc146650 0x7f9bbc0b76c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.114:59780/0 (socket says 172.21.15.114:59780) 2023-10-18T12:20:04.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7f9bc1ac7700 1 -- 172.21.15.114:0/3686007551 learned_addr learned my addr 172.21.15.114:0/3686007551 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:04.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7fc68b211700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc68406f990 0x7fc6841592d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7fc68b211700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc68406fe20 con 0x7fc68406f990 2023-10-18T12:20:04.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7fc68b211700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6840cd570 con 0x7fc6840cd0f0 2023-10-18T12:20:04.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7fc68b211700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6840cd850 con 0x7fc684158ef0 2023-10-18T12:20:04.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7fc688fad700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc684158ef0 0x7fc6840ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.837+0000 7fd687392700 1 -- 172.21.15.114:0/3797451016 wait complete. 2023-10-18T12:20:04.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7f60267fc700 1 --2- 172.21.15.114:0/3302328918 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f60140657c0 0x7f6014067c80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6020006d10 tx=0x7f6018009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:04.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.837+0000 7f4dc27fc700 1 --2- 172.21.15.114:0/2957987988 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4dac004870 0x7f4dac004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.837+0000 7f4dc27fc700 1 --2- 172.21.15.114:0/2957987988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4dac005230 0x7f4dac00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.837+0000 7f4dc27fc700 1 -- 172.21.15.114:0/2957987988 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc40b6930 con 0x7f4dac004870 2023-10-18T12:20:04.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.837+0000 7f4dc27fc700 1 -- 172.21.15.114:0/2957987988 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc40b5d20 con 0x7f4dac005230 2023-10-18T12:20:04.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.837+0000 7f4dc27fc700 1 -- 172.21.15.114:0/2957987988 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac00bff0 con 0x7f4dac003a20 2023-10-18T12:20:04.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.837+0000 7f4dc37fe700 1 --2- 172.21.15.114:0/2957987988 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4dac003a20 0x7f4dac003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7f4dc2ffd700 1 --2- 172.21.15.114:0/2957987988 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4dac004870 0x7f4dac004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7f4dc3fff700 1 --2- 172.21.15.114:0/2957987988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4dac005230 0x7f4dac00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7fc688fad700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc684158ef0 0x7fc6840ccbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.114:56654/0 (socket says 172.21.15.114:56654) 2023-10-18T12:20:04.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7fc688fad700 1 -- 172.21.15.114:0/430476082 learned_addr learned my addr 172.21.15.114:0/430476082 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:04.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7fc683fff700 1 --2- 172.21.15.114:0/430476082 >> v2:172.21.15.172:3300/0 conn(0x7fc6840cd0f0 0x7fc68406f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7f4dc37fe700 1 -- 172.21.15.114:0/2957987988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4dac005230 msgr2=0x7f4dac00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:04.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7f4dc37fe700 1 --2- 172.21.15.114:0/2957987988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4dac005230 0x7f4dac00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7f4dc37fe700 1 -- 172.21.15.114:0/2957987988 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4dac004870 msgr2=0x7f4dac004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:04.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7f4dc37fe700 1 --2- 172.21.15.114:0/2957987988 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4dac004870 0x7f4dac004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7f4dc37fe700 1 -- 172.21.15.114:0/2957987988 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dac0035d0 con 0x7f4dac003a20 2023-10-18T12:20:04.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7fe754e3b700 1 -- 172.21.15.114:0/3885191431 >> v2:172.21.15.172:3300/0 conn(0x7fe7500b7dd0 msgr2=0x7fe75006f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:04.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7fe754e3b700 1 --2- 172.21.15.114:0/3885191431 >> v2:172.21.15.172:3300/0 conn(0x7fe7500b7dd0 0x7fe75006f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7fe754e3b700 1 -- 172.21.15.114:0/3885191431 >> v1:172.21.15.114:6789/0 conn(0x7fe750146650 legacy=0x7fe7500b76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:04.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7fe754e3b700 1 -- 172.21.15.114:0/3885191431 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7500b6000 con 0x7fe75006fef0 2023-10-18T12:20:04.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7f4dc37fe700 1 --2- 172.21.15.114:0/2957987988 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4dac003a20 0x7f4dac003e40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4db4009ba0 tx=0x7f4dac0058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52dffc1d12c312fd server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:04.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7f9bc12c6700 1 --2- 172.21.15.114:0/3686007551 >> v2:172.21.15.172:3300/0 conn(0x7f9bbc0b7dd0 0x7f9bbc06f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7f9bc0ac5700 1 -- 172.21.15.114:0/3686007551 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3307620570 0 0) 0x7f9bbc0b6930 con 0x7f9bbc146650 2023-10-18T12:20:04.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7f9bc0ac5700 1 -- 172.21.15.114:0/3686007551 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ba80035d0 con 0x7f9bbc146650 2023-10-18T12:20:04.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7f9bc22c8700 1 --2- 172.21.15.114:0/3686007551 >> v2:172.21.15.114:3300/0 conn(0x7f9bbc06fef0 0x7f9bbc15d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7f600f7fe700 1 -- 172.21.15.114:0/3302328918 <== osd.1 v2:172.21.15.114:6800/3302727047 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f6014071f30 con 0x7f601406f420 2023-10-18T12:20:04.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7fc688fad700 1 -- 172.21.15.114:0/430476082 >> v2:172.21.15.172:3300/0 conn(0x7fc6840cd0f0 msgr2=0x7fc68406f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:04.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7fc688fad700 1 --2- 172.21.15.114:0/430476082 >> v2:172.21.15.172:3300/0 conn(0x7fc6840cd0f0 0x7fc68406f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7fc688fad700 1 -- 172.21.15.114:0/430476082 >> v2:172.21.15.114:3300/0 conn(0x7fc68406f990 msgr2=0x7fc6841592d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:04.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7fc688fad700 1 --2- 172.21.15.114:0/430476082 >> v2:172.21.15.114:3300/0 conn(0x7fc68406f990 0x7fc6841592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7fc688fad700 1 -- 172.21.15.114:0/430476082 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6840cdb30 con 0x7fc684158ef0 2023-10-18T12:20:04.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7fd687392700 1 Processor -- start 2023-10-18T12:20:04.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7f0333fff700 1 -- 172.21.15.114:0/2311759537 <== mon.2 v2:172.21.15.172:3301/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f03340038e0 con 0x7f033c0cb960 2023-10-18T12:20:04.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7f4dc27fc700 1 -- 172.21.15.114:0/2957987988 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db400e6c0 con 0x7f4dac003a20 2023-10-18T12:20:04.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7f4dc27fc700 1 -- 172.21.15.114:0/2957987988 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db400e820 con 0x7f4dac003a20 2023-10-18T12:20:04.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7f4dc27fc700 1 -- 172.21.15.114:0/2957987988 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db400eb90 con 0x7f4dac003a20 2023-10-18T12:20:04.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7f9bc12c6700 1 -- 172.21.15.114:0/3686007551 >> v2:172.21.15.114:3300/0 conn(0x7f9bbc06fef0 msgr2=0x7f9bbc15d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:04.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7f9bc12c6700 1 --2- 172.21.15.114:0/3686007551 >> v2:172.21.15.114:3300/0 conn(0x7f9bbc06fef0 0x7f9bbc15d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7f9bc12c6700 1 -- 172.21.15.114:0/3686007551 >> v1:172.21.15.172:6789/0 conn(0x7f9bbc146650 legacy=0x7f9bbc0b76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:04.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.841+0000 7f9bc12c6700 1 -- 172.21.15.114:0/3686007551 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bbc0b6000 con 0x7f9bbc0b7dd0 2023-10-18T12:20:04.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7fc688fad700 1 --2- 172.21.15.114:0/430476082 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc684158ef0 0x7fc6840ccbb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc68406cca0 tx=0x7fc678009bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83826bafc0d041ab server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:04.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7fd687392700 1 -- start start 2023-10-18T12:20:04.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7f9bc12c6700 1 --2- 172.21.15.114:0/3686007551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bbc0b7dd0 0x7f9bbc06f9b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc0d3c40 tx=0x7f9bb8009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30fc4fecc5d6170e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:04.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7fc6837fe700 1 -- 172.21.15.114:0/430476082 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67800b8a0 con 0x7fc684158ef0 2023-10-18T12:20:04.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7fc6837fe700 1 -- 172.21.15.114:0/430476082 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67800ba00 con 0x7fc684158ef0 2023-10-18T12:20:04.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7fc6837fe700 1 -- 172.21.15.114:0/430476082 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67800bd90 con 0x7fc684158ef0 2023-10-18T12:20:04.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7f9bc0ac5700 1 -- 172.21.15.114:0/3686007551 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb8011830 con 0x7f9bbc0b7dd0 2023-10-18T12:20:04.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7f9bc0ac5700 1 -- 172.21.15.114:0/3686007551 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb8011990 con 0x7f9bbc0b7dd0 2023-10-18T12:20:04.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7f9bc0ac5700 1 -- 172.21.15.114:0/3686007551 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb8011d20 con 0x7f9bbc0b7dd0 2023-10-18T12:20:04.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7fe754e3b700 1 --2- 172.21.15.114:0/3885191431 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe75006fef0 0x7fe75015d3b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe7500d3c40 tx=0x7fe74800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43d4cf8d81bab394 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:04.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7fe74effd700 1 -- 172.21.15.114:0/3885191431 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74800e070 con 0x7fe75006fef0 2023-10-18T12:20:04.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7fe74effd700 1 -- 172.21.15.114:0/3885191431 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe74800bb20 con 0x7fe75006fef0 2023-10-18T12:20:04.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7fe74effd700 1 -- 172.21.15.114:0/3885191431 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe748012430 con 0x7fe75006fef0 2023-10-18T12:20:04.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7f0333fff700 1 --2- 172.21.15.114:0/2311759537 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f031c0657c0 0x7f031c067c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7f0333fff700 1 -- 172.21.15.114:0/2311759537 <== mon.2 v2:172.21.15.172:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0334082a90 con 0x7f033c0cb960 2023-10-18T12:20:04.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7f0333fff700 1 --2- 172.21.15.114:0/2311759537 >> [v2:172.21.15.114:6816/1506287862,v1:172.21.15.114:6817/1506287862] conn(0x7f031c06f4a0 0x7f031c0718e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7f0333fff700 1 -- 172.21.15.114:0/2311759537 --> [v2:172.21.15.114:6816/1506287862,v1:172.21.15.114:6817/1506287862] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f031c071fb0 con 0x7f031c06f4a0 2023-10-18T12:20:04.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7f0333fff700 1 -- 172.21.15.114:0/2311759537 <== mon.2 v2:172.21.15.172:3301/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0334082e40 con 0x7f033c0cb960 2023-10-18T12:20:04.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7f4dc9d75700 1 -- 172.21.15.114:0/2957987988 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4dac003a20 msgr2=0x7f4dac003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:04.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7f4dc9d75700 1 --2- 172.21.15.114:0/2957987988 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4dac003a20 0x7f4dac003e40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4db4009ba0 tx=0x7f4dac0058a0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7f033b7fe700 1 --2- 172.21.15.114:0/2311759537 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f031c0657c0 0x7f031c067c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7f033bfff700 1 --2- 172.21.15.114:0/2311759537 >> [v2:172.21.15.114:6816/1506287862,v1:172.21.15.114:6817/1506287862] conn(0x7f031c06f4a0 0x7f031c0718e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7fd687392700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd668004870 0x7fd68015e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7fd687392700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd68015f3f0 0x7fd6801593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7fd687392700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd68006e7c0 0x7fd68014d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7fd687392700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68015f220 con 0x7fd668004870 2023-10-18T12:20:04.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7fd687392700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6800cb310 con 0x7fd68015f3f0 2023-10-18T12:20:04.906 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7fd687392700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd68015e980 con 0x7fd68006e7c0 2023-10-18T12:20:04.906 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7f4dc3fff700 1 -- 172.21.15.114:0/2957987988 reap_dead start 2023-10-18T12:20:04.906 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7f4dc9d75700 1 -- 172.21.15.114:0/2957987988 shutdown_connections 2023-10-18T12:20:04.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7f4dc9d75700 1 -- 172.21.15.114:0/2957987988 >> 172.21.15.114:0/2957987988 conn(0x7f4dc406a130 msgr2=0x7f4dc406a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:04.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7f4dc9d75700 1 -- 172.21.15.114:0/2957987988 shutdown_connections 2023-10-18T12:20:04.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7f9bc3d2b700 1 -- 172.21.15.114:0/3686007551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bbc0b7dd0 msgr2=0x7f9bbc06f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:04.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7f9bc3d2b700 1 --2- 172.21.15.114:0/3686007551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bbc0b7dd0 0x7f9bbc06f9b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc0d3c40 tx=0x7f9bb8009b30 comp rx=0 tx=0).stop 2023-10-18T12:20:04.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7fe75689e700 1 -- 172.21.15.114:0/3885191431 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe75006fef0 msgr2=0x7fe75015d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:04.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7fe75689e700 1 --2- 172.21.15.114:0/3885191431 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe75006fef0 0x7fe75015d3b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe7500d3c40 tx=0x7fe74800b330 comp rx=0 tx=0).stop 2023-10-18T12:20:04.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7fc68b211700 1 -- 172.21.15.114:0/430476082 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc684158ef0 msgr2=0x7fc6840ccbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:04.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7fc68b211700 1 --2- 172.21.15.114:0/430476082 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc684158ef0 0x7fc6840ccbb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc68406cca0 tx=0x7fc678009bf0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7fc68b211700 1 -- 172.21.15.114:0/430476082 shutdown_connections 2023-10-18T12:20:04.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7fc68b211700 1 --2- 172.21.15.114:0/430476082 >> v2:172.21.15.114:3300/0 conn(0x7fc68406f990 0x7fc6841592d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7fc68b211700 1 --2- 172.21.15.114:0/430476082 >> v2:172.21.15.172:3300/0 conn(0x7fc6840cd0f0 0x7fc68406f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7fc68b211700 1 --2- 172.21.15.114:0/430476082 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc684158ef0 0x7fc6840ccbb0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7fc68b211700 1 -- 172.21.15.114:0/430476082 >> 172.21.15.114:0/430476082 conn(0x7fc6840b0810 msgr2=0x7fc6840b0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:04.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7fd68492d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd68015f3f0 0x7fd6801593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7f9bc3d2b700 1 -- 172.21.15.114:0/3686007551 shutdown_connections 2023-10-18T12:20:04.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7f9bc3d2b700 1 --2- 172.21.15.114:0/3686007551 >> v2:172.21.15.114:3300/0 conn(0x7f9bbc06fef0 0x7f9bbc15d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7f9bc3d2b700 1 --2- 172.21.15.114:0/3686007551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bbc0b7dd0 0x7f9bbc06f9b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7f9bc3d2b700 1 -- 172.21.15.114:0/3686007551 >> 172.21.15.114:0/3686007551 conn(0x7f9bbc06a130 msgr2=0x7f9bbc06a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:04.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7fd68492d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd68015f3f0 0x7fd6801593d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:35740/0 (socket says 172.21.15.114:35740) 2023-10-18T12:20:04.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7fd68492d700 1 -- 172.21.15.114:0/2733713531 learned_addr learned my addr 172.21.15.114:0/2733713531 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:04.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7fd68592f700 1 --2- 172.21.15.114:0/2733713531 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd68006e7c0 0x7fd68014d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7fd68512e700 1 --2- 172.21.15.114:0/2733713531 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd668004870 0x7fd68015e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7f9bc3d2b700 1 -- 172.21.15.114:0/3686007551 shutdown_connections 2023-10-18T12:20:04.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7fe75689e700 1 -- 172.21.15.114:0/3885191431 shutdown_connections 2023-10-18T12:20:04.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7fe75689e700 1 --2- 172.21.15.114:0/3885191431 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe75006fef0 0x7fe75015d3b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7fe75689e700 1 --2- 172.21.15.114:0/3885191431 >> v2:172.21.15.172:3300/0 conn(0x7fe7500b7dd0 0x7fe75006f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7fe75689e700 1 -- 172.21.15.114:0/3885191431 >> 172.21.15.114:0/3885191431 conn(0x7fe75006a130 msgr2=0x7fe75006a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:04.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7f4dc9d75700 1 -- 172.21.15.114:0/2957987988 wait complete. 2023-10-18T12:20:04.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7fe75689e700 1 -- 172.21.15.114:0/3885191431 shutdown_connections 2023-10-18T12:20:04.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7f033bfff700 1 --2- 172.21.15.114:0/2311759537 >> [v2:172.21.15.114:6816/1506287862,v1:172.21.15.114:6817/1506287862] conn(0x7f031c06f4a0 0x7f031c0718e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:04.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7fe75689e700 1 -- 172.21.15.114:0/3885191431 wait complete. 2023-10-18T12:20:04.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.849+0000 7f033b7fe700 1 --2- 172.21.15.114:0/2311759537 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f031c0657c0 0x7f031c067c80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0324009150 tx=0x7f0324008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:04.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7fd68592f700 1 -- 172.21.15.114:0/2733713531 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd68015f3f0 msgr2=0x7fd6801593d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:04.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7fd68592f700 1 --2- 172.21.15.114:0/2733713531 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd68015f3f0 0x7fd6801593d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7fd68592f700 1 -- 172.21.15.114:0/2733713531 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd668004870 msgr2=0x7fd68015e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:04.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7fd68592f700 1 --2- 172.21.15.114:0/2733713531 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd668004870 0x7fd68015e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7fd68592f700 1 -- 172.21.15.114:0/2733713531 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd68015ec60 con 0x7fd68006e7c0 2023-10-18T12:20:04.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.849+0000 7fd68592f700 1 --2- 172.21.15.114:0/2733713531 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd68006e7c0 0x7fd68014d090 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd6800cb040 tx=0x7fd67000ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:04.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.845+0000 7f9bc3d2b700 1 -- 172.21.15.114:0/3686007551 wait complete. 2023-10-18T12:20:04.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.849+0000 7fc68b211700 1 -- 172.21.15.114:0/430476082 shutdown_connections 2023-10-18T12:20:04.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.849+0000 7fd67dffb700 1 -- 172.21.15.114:0/2733713531 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67000c540 con 0x7fd68006e7c0 2023-10-18T12:20:04.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.849+0000 7fd67dffb700 1 -- 172.21.15.114:0/2733713531 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd67000c6a0 con 0x7fd68006e7c0 2023-10-18T12:20:04.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.849+0000 7fd687392700 1 -- 172.21.15.114:0/2733713531 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd68015ef40 con 0x7fd68006e7c0 2023-10-18T12:20:04.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.849+0000 7fc68b211700 1 -- 172.21.15.114:0/430476082 wait complete. 2023-10-18T12:20:04.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.849+0000 7f4dc9d75700 1 Processor -- start 2023-10-18T12:20:04.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.849+0000 7f4dc9d75700 1 -- start start 2023-10-18T12:20:04.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.849+0000 7fe75689e700 1 Processor -- start 2023-10-18T12:20:04.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.849+0000 7f0333fff700 1 -- 172.21.15.114:0/2311759537 <== osd.0 v2:172.21.15.114:6816/1506287862 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f031c071fb0 con 0x7f031c06f4a0 2023-10-18T12:20:04.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.849+0000 7fd67dffb700 1 -- 172.21.15.114:0/2733713531 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67000c850 con 0x7fd68006e7c0 2023-10-18T12:20:04.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.849+0000 7fd687392700 1 -- 172.21.15.114:0/2733713531 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd680159910 con 0x7fd68006e7c0 2023-10-18T12:20:04.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.849+0000 7fe75689e700 1 -- start start 2023-10-18T12:20:04.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.849+0000 7fc68b211700 1 Processor -- start 2023-10-18T12:20:04.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7f4dc9d75700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4dc413dd90 0x7f4dc415cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7fd687392700 1 -- 172.21.15.114:0/2733713531 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd660000fc0 con 0x7fd68006e7c0 2023-10-18T12:20:04.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7f4dc9d75700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4dc413c280 0x7f4dc4140930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7f4dc9d75700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4dc413e170 0x7f4dc4146d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7f4dc9d75700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc4140510 con 0x7f4dc413e170 2023-10-18T12:20:04.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7f4dc9d75700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc413f4d0 con 0x7f4dc413dd90 2023-10-18T12:20:04.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7f4dc9d75700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc413bf10 con 0x7f4dc413c280 2023-10-18T12:20:04.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7f4dc37fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4dc413dd90 0x7f4dc415cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7f4dc2ffd700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4dc413c280 0x7f4dc4140930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7f4dc37fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4dc413dd90 0x7f4dc415cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:35750/0 (socket says 172.21.15.114:35750) 2023-10-18T12:20:04.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7f4dc37fe700 1 -- 172.21.15.114:0/832575646 learned_addr learned my addr 172.21.15.114:0/832575646 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:04.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.849+0000 7f9bc3d2b700 1 Processor -- start 2023-10-18T12:20:04.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7f9bc3d2b700 1 -- start start 2023-10-18T12:20:04.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7fe75689e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe75006fef0 0x7fe750136440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7fe75689e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe7500b7dd0 0x7fe75006e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7fe75689e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe750146650 0x7fe75013f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7fc68b211700 1 -- start start 2023-10-18T12:20:04.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7fe74f7fe700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe7500b7dd0 0x7fe75006e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7f4dc37fe700 1 -- 172.21.15.114:0/832575646 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4dc413c280 msgr2=0x7f4dc4140930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:04.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7f4dc37fe700 1 --2- 172.21.15.114:0/832575646 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4dc413c280 0x7f4dc4140930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7f4dc37fe700 1 -- 172.21.15.114:0/832575646 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4dc413e170 msgr2=0x7f4dc4146d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:04.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7f4dc3fff700 1 --2- 172.21.15.114:0/832575646 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4dc413e170 0x7f4dc4146d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7f4dc37fe700 1 --2- 172.21.15.114:0/832575646 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4dc413e170 0x7f4dc4146d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7f4dc37fe700 1 -- 172.21.15.114:0/832575646 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc413f640 con 0x7f4dc413dd90 2023-10-18T12:20:04.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7f4dc3fff700 1 --2- 172.21.15.114:0/832575646 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4dc413e170 0x7f4dc4146d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:20:04.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7f4dc37fe700 1 --2- 172.21.15.114:0/832575646 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4dc413dd90 0x7f4dc415cd80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4db400e4b0 tx=0x7f4db40047e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:04.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7f9bc3d2b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bbc06fef0 0x7f9bbc136440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7f9bc3d2b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bbc0b7dd0 0x7f9bbc141710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7f9bc3d2b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bbc146650 0x7f9bbc141c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7f9bc3d2b700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc13f9b0 con 0x7f9bbc0b7dd0 2023-10-18T12:20:04.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7fe74f7fe700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe7500b7dd0 0x7fe75006e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.114:56690/0 (socket says 172.21.15.114:56690) 2023-10-18T12:20:04.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7fe74f7fe700 1 -- 172.21.15.114:0/1679185784 learned_addr learned my addr 172.21.15.114:0/1679185784 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:04.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7fe75689e700 1 -- 172.21.15.114:0/1679185784 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75013e710 con 0x7fe75006fef0 2023-10-18T12:20:04.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7fe75689e700 1 -- 172.21.15.114:0/1679185784 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe750136980 con 0x7fe750146650 2023-10-18T12:20:04.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7fe75689e700 1 -- 172.21.15.114:0/1679185784 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe750142250 con 0x7fe7500b7dd0 2023-10-18T12:20:04.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7fe74ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe75006fef0 0x7fe750136440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7fe754e3b700 1 --2- 172.21.15.114:0/1679185784 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe750146650 0x7fe75013f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7fc68b211700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc68406f990 0x7fc6840c2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7fc68b211700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6840cd0f0 0x7fc68415cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7fc68b211700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc684158ef0 0x7fc68415c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7fc68b211700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6840c2c30 con 0x7fc68406f990 2023-10-18T12:20:04.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7fc68b211700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc684148130 con 0x7fc684158ef0 2023-10-18T12:20:04.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7fc68b211700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6840c4a60 con 0x7fc6840cd0f0 2023-10-18T12:20:04.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7fd67dffb700 1 -- 172.21.15.114:0/2733713531 <== mon.2 v2:172.21.15.172:3301/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fd67000c9b0 con 0x7fd68006e7c0 2023-10-18T12:20:04.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7f4dabfff700 1 -- 172.21.15.114:0/832575646 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4021070 con 0x7f4dc413dd90 2023-10-18T12:20:04.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7f4dc9d75700 1 -- 172.21.15.114:0/832575646 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dc415d2c0 con 0x7f4dc413dd90 2023-10-18T12:20:04.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7fe74f7fe700 1 -- 172.21.15.114:0/1679185784 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe750146650 msgr2=0x7fe75013f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:04.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7fe74f7fe700 1 --2- 172.21.15.114:0/1679185784 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe750146650 0x7fe75013f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7fe74f7fe700 1 -- 172.21.15.114:0/1679185784 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe75006fef0 msgr2=0x7fe750136440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:04.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7fe74f7fe700 1 --2- 172.21.15.114:0/1679185784 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe75006fef0 0x7fe750136440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7fe74f7fe700 1 -- 172.21.15.114:0/1679185784 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe748009a70 con 0x7fe7500b7dd0 2023-10-18T12:20:04.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7fc6897ae700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc684158ef0 0x7fc68415c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7fc6897ae700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc684158ef0 0x7fc68415c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:35780/0 (socket says 172.21.15.114:35780) 2023-10-18T12:20:04.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7fc6897ae700 1 -- 172.21.15.114:0/125393798 learned_addr learned my addr 172.21.15.114:0/125393798 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:04.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7f4dabfff700 1 -- 172.21.15.114:0/832575646 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db40036c0 con 0x7f4dc413dd90 2023-10-18T12:20:04.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7f4dabfff700 1 -- 172.21.15.114:0/832575646 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4021070 con 0x7f4dc413dd90 2023-10-18T12:20:04.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7f9bc1ac7700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bbc06fef0 0x7f9bbc136440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7f9bc1ac7700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bbc06fef0 0x7f9bbc136440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.114:56704/0 (socket says 172.21.15.114:56704) 2023-10-18T12:20:04.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7f9bc1ac7700 1 -- 172.21.15.114:0/2452077995 learned_addr learned my addr 172.21.15.114:0/2452077995 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:04.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7f9bc12c6700 1 --2- 172.21.15.114:0/2452077995 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bbc0b7dd0 0x7f9bbc141710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7f9bc3d2b700 1 -- 172.21.15.114:0/2452077995 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc156bb0 con 0x7f9bbc146650 2023-10-18T12:20:04.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.853+0000 7f9bc3d2b700 1 -- 172.21.15.114:0/2452077995 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc136980 con 0x7f9bbc06fef0 2023-10-18T12:20:04.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.857+0000 7f9bc22c8700 1 --2- 172.21.15.114:0/2452077995 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bbc146650 0x7f9bbc141c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.857+0000 7fd67dffb700 1 --2- 172.21.15.114:0/2733713531 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd66c065770 0x7fd66c067c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.857+0000 7fc688fad700 1 --2- 172.21.15.114:0/125393798 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc68406f990 0x7fc6840c2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.857+0000 7fc6897ae700 1 -- 172.21.15.114:0/125393798 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6840cd0f0 msgr2=0x7fc68415cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:04.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.857+0000 7fc6897ae700 1 --2- 172.21.15.114:0/125393798 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6840cd0f0 0x7fc68415cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.857+0000 7fc6897ae700 1 -- 172.21.15.114:0/125393798 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc68406f990 msgr2=0x7fc6840c2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:04.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.857+0000 7fc6897ae700 1 --2- 172.21.15.114:0/125393798 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc68406f990 0x7fc6840c2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.857+0000 7fc6897ae700 1 -- 172.21.15.114:0/125393798 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc678009570 con 0x7fc684158ef0 2023-10-18T12:20:04.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.857+0000 7fc688fad700 1 --2- 172.21.15.114:0/125393798 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc68406f990 0x7fc6840c2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:20:04.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.857+0000 7f4dc9d75700 1 -- 172.21.15.114:0/832575646 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc413fb70 con 0x7f4dc413dd90 2023-10-18T12:20:04.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.857+0000 7fd67dffb700 1 -- 172.21.15.114:0/2733713531 <== mon.2 v2:172.21.15.172:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd670082500 con 0x7fd68006e7c0 2023-10-18T12:20:04.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.857+0000 7fd67dffb700 1 --2- 172.21.15.114:0/2733713531 >> [v2:172.21.15.114:6808/2699151351,v1:172.21.15.114:6809/2699151351] conn(0x7fd66c06f450 0x7fd66c071890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.857+0000 7fd67dffb700 1 -- 172.21.15.114:0/2733713531 --> [v2:172.21.15.114:6808/2699151351,v1:172.21.15.114:6809/2699151351] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd66c071f60 con 0x7fd66c06f450 2023-10-18T12:20:04.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.857+0000 7fd67dffb700 1 -- 172.21.15.114:0/2733713531 <== mon.2 v2:172.21.15.172:3301/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd6700828c0 con 0x7fd68006e7c0 2023-10-18T12:20:04.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.857+0000 7f9bc1ac7700 1 -- 172.21.15.114:0/2452077995 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bbc146650 msgr2=0x7f9bbc141c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:04.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.857+0000 7fc6897ae700 1 --2- 172.21.15.114:0/125393798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc684158ef0 0x7fc68415c580 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc67c00b970 tx=0x7fc67c00bd30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:04.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.857+0000 7f9bc1ac7700 1 --2- 172.21.15.114:0/2452077995 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bbc146650 0x7f9bbc141c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.857+0000 7fe74f7fe700 1 --2- 172.21.15.114:0/1679185784 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe7500b7dd0 0x7fe75006e850 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe74000e810 tx=0x7fe74000eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:04.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.857+0000 7f9bc1ac7700 1 -- 172.21.15.114:0/2452077995 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bbc0b7dd0 msgr2=0x7f9bbc141710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:04.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.857+0000 7f9bc1ac7700 1 --2- 172.21.15.114:0/2452077995 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bbc0b7dd0 0x7f9bbc141710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.857+0000 7f9bc1ac7700 1 -- 172.21.15.114:0/2452077995 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb80094b0 con 0x7f9bbc06fef0 2023-10-18T12:20:04.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.857+0000 7fd68512e700 1 --2- 172.21.15.114:0/2733713531 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd66c065770 0x7fd66c067c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.857+0000 7f4dc9d75700 1 -- 172.21.15.114:0/832575646 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4dc40b65c0 con 0x7f4dc413dd90 2023-10-18T12:20:04.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.857+0000 7fd68492d700 1 --2- 172.21.15.114:0/2733713531 >> [v2:172.21.15.114:6808/2699151351,v1:172.21.15.114:6809/2699151351] conn(0x7fd66c06f450 0x7fd66c071890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.857+0000 7fe74cff9700 1 -- 172.21.15.114:0/1679185784 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe740013610 con 0x7fe7500b7dd0 2023-10-18T12:20:04.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.857+0000 7f4b29113700 1 Processor -- start 2023-10-18T12:20:04.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.857+0000 7f4b29113700 1 -- start start 2023-10-18T12:20:04.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.857+0000 7f9bc1ac7700 1 --2- 172.21.15.114:0/2452077995 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bbc06fef0 0x7f9bbc136440 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9bac00c730 tx=0x7f9bac00ca40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:04.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.857+0000 7fe74cff9700 1 -- 172.21.15.114:0/1679185784 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe740013770 con 0x7fe7500b7dd0 2023-10-18T12:20:04.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.857+0000 7fe74cff9700 1 -- 172.21.15.114:0/1679185784 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe740013b20 con 0x7fe7500b7dd0 2023-10-18T12:20:04.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.857+0000 7fe75689e700 1 -- 172.21.15.114:0/1679185784 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe750142530 con 0x7fe7500b7dd0 2023-10-18T12:20:04.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.857+0000 7fe75689e700 1 -- 172.21.15.114:0/1679185784 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe750142af0 con 0x7fe7500b7dd0 2023-10-18T12:20:04.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.857+0000 7fd68512e700 1 --2- 172.21.15.114:0/2733713531 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd66c065770 0x7fd66c067c30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd68006e520 tx=0x7fd678009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:04.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.857+0000 7fd68492d700 1 --2- 172.21.15.114:0/2733713531 >> [v2:172.21.15.114:6808/2699151351,v1:172.21.15.114:6809/2699151351] conn(0x7fd66c06f450 0x7fd66c071890 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:04.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.857+0000 7f9bb27fc700 1 -- 172.21.15.114:0/2452077995 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac005d90 con 0x7f9bbc06fef0 2023-10-18T12:20:04.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.857+0000 7f9bb27fc700 1 -- 172.21.15.114:0/2452077995 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bac0070d0 con 0x7f9bbc06fef0 2023-10-18T12:20:04.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.857+0000 7f9bc3d2b700 1 -- 172.21.15.114:0/2452077995 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bbc13f6d0 con 0x7f9bbc06fef0 2023-10-18T12:20:04.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.857+0000 7fc6817fa700 1 -- 172.21.15.114:0/125393798 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67c00c9b0 con 0x7fc684158ef0 2023-10-18T12:20:04.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.857+0000 7fc6817fa700 1 -- 172.21.15.114:0/125393798 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67c00cb30 con 0x7fc684158ef0 2023-10-18T12:20:04.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.857+0000 7fc6817fa700 1 -- 172.21.15.114:0/125393798 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67c014440 con 0x7fc684158ef0 2023-10-18T12:20:04.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.857+0000 7f4b29113700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4b1c0e7990 0x7f4b1c054680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.857+0000 7f4b29113700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b1c053be0 con 0x7f4b1c038530 2023-10-18T12:20:04.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.857+0000 7f4b29113700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b1c0500c0 con 0x7f4b1c04f340 2023-10-18T12:20:04.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.857+0000 7f4b29113700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b1c048650 con 0x7f4b1c0e7990 2023-10-18T12:20:04.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.857+0000 7f9bb27fc700 1 -- 172.21.15.114:0/2452077995 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac007480 con 0x7f9bbc06fef0 2023-10-18T12:20:04.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.861+0000 7f4b23fff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4b1c0e7990 0x7f4b1c054680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.857+0000 7f9bc3d2b700 1 -- 172.21.15.114:0/2452077995 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bbc157130 con 0x7f9bbc06fef0 2023-10-18T12:20:04.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.861+0000 7f4b23fff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4b1c0e7990 0x7f4b1c054680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:35790/0 (socket says 172.21.15.114:35790) 2023-10-18T12:20:04.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.861+0000 7f4b23fff700 1 -- 172.21.15.114:0/3585235259 learned_addr learned my addr 172.21.15.114:0/3585235259 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:04.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.861+0000 7fe75689e700 1 -- 172.21.15.114:0/1679185784 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe7500b65c0 con 0x7fe7500b7dd0 2023-10-18T12:20:04.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.861+0000 7f4b23fff700 1 -- 172.21.15.114:0/3585235259 >> v1:172.21.15.172:6789/0 conn(0x7f4b1c04f340 legacy=0x7f4b1c037e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:04.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.861+0000 7f4b23fff700 1 -- 172.21.15.114:0/3585235259 >> v1:172.21.15.114:6789/0 conn(0x7f4b1c038530 legacy=0x7f4b1c0070d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:04.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.861+0000 7f4b23fff700 1 -- 172.21.15.114:0/3585235259 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b1c053e80 con 0x7f4b1c0e7990 2023-10-18T12:20:04.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.861+0000 7fc68b211700 1 -- 172.21.15.114:0/125393798 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6840c2950 con 0x7fc684158ef0 2023-10-18T12:20:04.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.861+0000 7fc68b211700 1 -- 172.21.15.114:0/125393798 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6840c4fe0 con 0x7fc684158ef0 2023-10-18T12:20:04.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.861+0000 7fd67dffb700 1 -- 172.21.15.114:0/2733713531 <== osd.2 v2:172.21.15.114:6808/2699151351 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fd66c071f60 con 0x7fd66c06f450 2023-10-18T12:20:04.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.861+0000 7f9bc3d2b700 1 -- 172.21.15.114:0/2452077995 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9bbc0b65c0 con 0x7f9bbc06fef0 2023-10-18T12:20:04.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.861+0000 7fc68b211700 1 -- 172.21.15.114:0/125393798 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc68406d9d0 con 0x7fc684158ef0 2023-10-18T12:20:04.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.861+0000 7f4b23fff700 1 --2- 172.21.15.114:0/3585235259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b1c0e7990 0x7f4b1c054680 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4b24073230 tx=0x7f4b2404f0b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76308d068234d8db server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:04.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.861+0000 7fc6817fa700 1 -- 172.21.15.114:0/125393798 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fc67c01d3b0 con 0x7fc684158ef0 2023-10-18T12:20:04.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.861+0000 7f4dabfff700 1 -- 172.21.15.114:0/832575646 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f4db4003830 con 0x7f4dc413dd90 2023-10-18T12:20:04.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.861+0000 7f4b22ffd700 1 -- 172.21.15.114:0/3585235259 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b24073540 con 0x7f4b1c0e7990 2023-10-18T12:20:04.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.861+0000 7f4b22ffd700 1 -- 172.21.15.114:0/3585235259 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b2408d070 con 0x7f4b1c0e7990 2023-10-18T12:20:04.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.861+0000 7f4b22ffd700 1 -- 172.21.15.114:0/3585235259 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b240720d0 con 0x7f4b1c0e7990 2023-10-18T12:20:04.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.865+0000 7fe74cff9700 1 -- 172.21.15.114:0/1679185784 <== mon.2 v2:172.21.15.172:3301/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fe740013c80 con 0x7fe7500b7dd0 2023-10-18T12:20:04.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.861+0000 7f9bb27fc700 1 -- 172.21.15.114:0/2452077995 <== mon.2 v2:172.21.15.172:3301/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f9bac0075e0 con 0x7f9bbc06fef0 2023-10-18T12:20:04.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.865+0000 7fe74cff9700 1 --2- 172.21.15.114:0/1679185784 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe73c0657f0 0x7fe73c067cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.865+0000 7f4b29113700 1 -- 172.21.15.114:0/3585235259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b1c0e7990 msgr2=0x7f4b1c054680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:04.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.865+0000 7f4b29113700 1 --2- 172.21.15.114:0/3585235259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b1c0e7990 0x7f4b1c054680 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4b24073230 tx=0x7f4b2404f0b0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.865+0000 7fe74cff9700 1 -- 172.21.15.114:0/1679185784 <== mon.2 v2:172.21.15.172:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe740082cc0 con 0x7fe7500b7dd0 2023-10-18T12:20:04.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.865+0000 7fe74ffff700 1 --2- 172.21.15.114:0/1679185784 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe73c0657f0 0x7fe73c067cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.865+0000 7f4dabfff700 1 --2- 172.21.15.114:0/832575646 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4db0065750 0x7f4db0067c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.865+0000 7f4dabfff700 1 -- 172.21.15.114:0/832575646 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4db40849a0 con 0x7f4dc413dd90 2023-10-18T12:20:04.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.865+0000 7f4dabfff700 1 --2- 172.21.15.114:0/832575646 >> [v2:172.21.15.114:6819/1361608073,v1:172.21.15.114:6821/1361608073] conn(0x7f4db006f430 0x7f4db0071870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.865+0000 7f4dabfff700 1 -- 172.21.15.114:0/832575646 --> [v2:172.21.15.114:6819/1361608073,v1:172.21.15.114:6821/1361608073] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4db0071f40 con 0x7f4db006f430 2023-10-18T12:20:04.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.865+0000 7f4dabfff700 1 -- 172.21.15.114:0/832575646 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4db4084d50 con 0x7f4dc413dd90 2023-10-18T12:20:04.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.865+0000 7f9bb27fc700 1 --2- 172.21.15.114:0/2452077995 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9ba00657c0 0x7f9ba0067c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.865+0000 7f9bb27fc700 1 -- 172.21.15.114:0/2452077995 <== mon.2 v2:172.21.15.172:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9bac082690 con 0x7f9bbc06fef0 2023-10-18T12:20:04.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.865+0000 7f9bb27fc700 1 --2- 172.21.15.114:0/2452077995 >> [v2:172.21.15.172:6800/930839681,v1:172.21.15.172:6801/930839681] conn(0x7f9ba006f4a0 0x7f9ba00718e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.865+0000 7f9bb27fc700 1 -- 172.21.15.114:0/2452077995 --> [v2:172.21.15.172:6800/930839681,v1:172.21.15.172:6801/930839681] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9ba0071fb0 con 0x7f9ba006f4a0 2023-10-18T12:20:04.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.865+0000 7f9bb27fc700 1 -- 172.21.15.114:0/2452077995 <== mon.2 v2:172.21.15.172:3301/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9bac084cb0 con 0x7f9bbc06fef0 2023-10-18T12:20:04.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.865+0000 7f4b29113700 1 -- 172.21.15.114:0/3585235259 shutdown_connections 2023-10-18T12:20:04.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.865+0000 7f4b29113700 1 --2- 172.21.15.114:0/3585235259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b1c0e7990 0x7f4b1c054680 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.865+0000 7f4b29113700 1 -- 172.21.15.114:0/3585235259 >> 172.21.15.114:0/3585235259 conn(0x7f4b1c054cf0 msgr2=0x7f4b1c055100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:04.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.865+0000 7f4dc2ffd700 1 --2- 172.21.15.114:0/832575646 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4db0065750 0x7f4db0067c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.865+0000 7f4dc3fff700 1 --2- 172.21.15.114:0/832575646 >> [v2:172.21.15.114:6819/1361608073,v1:172.21.15.114:6821/1361608073] conn(0x7f4db006f430 0x7f4db0071870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.865+0000 7f9bc12c6700 1 --2- 172.21.15.114:0/2452077995 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9ba00657c0 0x7f9ba0067c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.865+0000 7fe74cff9700 1 --2- 172.21.15.114:0/1679185784 >> [v2:172.21.15.172:6812/571761850,v1:172.21.15.172:6814/571761850] conn(0x7fe73c06f4d0 0x7fe73c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.865+0000 7fe74cff9700 1 -- 172.21.15.114:0/1679185784 --> [v2:172.21.15.172:6812/571761850,v1:172.21.15.172:6814/571761850] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe73c071fe0 con 0x7fe73c06f4d0 2023-10-18T12:20:04.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.865+0000 7fe74cff9700 1 -- 172.21.15.114:0/1679185784 <== mon.2 v2:172.21.15.172:3301/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe740088290 con 0x7fe7500b7dd0 2023-10-18T12:20:04.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.865+0000 7f4b29113700 1 -- 172.21.15.114:0/3585235259 shutdown_connections 2023-10-18T12:20:04.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.865+0000 7f4b29113700 1 -- 172.21.15.114:0/3585235259 wait complete. 2023-10-18T12:20:04.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.865+0000 7f9bc22c8700 1 --2- 172.21.15.114:0/2452077995 >> [v2:172.21.15.172:6800/930839681,v1:172.21.15.172:6801/930839681] conn(0x7f9ba006f4a0 0x7f9ba00718e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.865+0000 7f4dc2ffd700 1 --2- 172.21.15.114:0/832575646 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4db0065750 0x7f4db0067c10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4dc413c680 tx=0x7f4dbc0021d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:04.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.865+0000 7fe74ffff700 1 --2- 172.21.15.114:0/1679185784 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe73c0657f0 0x7fe73c067cb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe7440011e0 tx=0x7fe744009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:04.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.865+0000 7f6027fff700 1 -- 172.21.15.114:0/3302328918 --> [v2:172.21.15.114:6800/3302727047,v1:172.21.15.114:6801/3302727047] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6020053700 con 0x7f601406f420 2023-10-18T12:20:04.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.865+0000 7f4dc3fff700 1 --2- 172.21.15.114:0/832575646 >> [v2:172.21.15.114:6819/1361608073,v1:172.21.15.114:6821/1361608073] conn(0x7f4db006f430 0x7f4db0071870 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:04.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.865+0000 7f9bc12c6700 1 --2- 172.21.15.114:0/2452077995 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9ba00657c0 0x7f9ba0067c80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8000c00 tx=0x7f9bb8008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:04.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.865+0000 7fe754e3b700 1 --2- 172.21.15.114:0/1679185784 >> [v2:172.21.15.172:6812/571761850,v1:172.21.15.172:6814/571761850] conn(0x7fe73c06f4d0 0x7fe73c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.869+0000 7f9bc22c8700 1 --2- 172.21.15.114:0/2452077995 >> [v2:172.21.15.172:6800/930839681,v1:172.21.15.172:6801/930839681] conn(0x7f9ba006f4a0 0x7f9ba00718e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:04.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.869+0000 7f600f7fe700 1 -- 172.21.15.114:0/3302328918 <== osd.1 v2:172.21.15.114:6800/3302727047 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6028072e60 con 0x7f601406f420 2023-10-18T12:20:04.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.869+0000 7fc6817fa700 1 --2- 172.21.15.114:0/125393798 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc668065720 0x7fc668067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.869+0000 7f6027fff700 1 -- 172.21.15.114:0/3302328918 >> [v2:172.21.15.114:6800/3302727047,v1:172.21.15.114:6801/3302727047] conn(0x7f601406f420 msgr2=0x7f6014071860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:04.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.869+0000 7f6027fff700 1 --2- 172.21.15.114:0/3302328918 >> [v2:172.21.15.114:6800/3302727047,v1:172.21.15.114:6801/3302727047] conn(0x7f601406f420 0x7f6014071860 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.869+0000 7fe754e3b700 1 --2- 172.21.15.114:0/1679185784 >> [v2:172.21.15.172:6812/571761850,v1:172.21.15.172:6814/571761850] conn(0x7fe73c06f4d0 0x7fe73c071910 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:04.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.869+0000 7fc6817fa700 1 -- 172.21.15.114:0/125393798 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc67c082f50 con 0x7fc684158ef0 2023-10-18T12:20:04.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.869+0000 7f4b29113700 1 Processor -- start 2023-10-18T12:20:04.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.869+0000 7f6027fff700 1 -- 172.21.15.114:0/3302328918 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f60140657c0 msgr2=0x7f6014067c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:04.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.869+0000 7f6027fff700 1 --2- 172.21.15.114:0/3302328918 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f60140657c0 0x7f6014067c80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6020006d10 tx=0x7f6018009040 comp rx=0 tx=0).stop 2023-10-18T12:20:04.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.869+0000 7f6027fff700 1 -- 172.21.15.114:0/3302328918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60200070d0 msgr2=0x7f602002c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:04.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.869+0000 7f6027fff700 1 --2- 172.21.15.114:0/3302328918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f60200070d0 0x7f602002c7e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f601c00b4d0 tx=0x7f601c00b7e0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.869+0000 7f60277fe700 1 -- 172.21.15.114:0/3302328918 reap_dead start 2023-10-18T12:20:04.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.869+0000 7fc6817fa700 1 --2- 172.21.15.114:0/125393798 >> [v2:172.21.15.172:6823/1680398853,v1:172.21.15.172:6825/1680398853] conn(0x7fc66806f380 0x7fc6680717c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.869+0000 7fc6817fa700 1 -- 172.21.15.114:0/125393798 --> [v2:172.21.15.172:6823/1680398853,v1:172.21.15.172:6825/1680398853] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc668071e90 con 0x7fc66806f380 2023-10-18T12:20:04.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.869+0000 7fc6817fa700 1 -- 172.21.15.114:0/125393798 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc67c085530 con 0x7fc684158ef0 2023-10-18T12:20:04.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.869+0000 7fc688fad700 1 --2- 172.21.15.114:0/125393798 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc668065720 0x7fc668067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.869+0000 7f6027fff700 1 -- 172.21.15.114:0/3302328918 shutdown_connections 2023-10-18T12:20:04.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.869+0000 7f6027fff700 1 -- 172.21.15.114:0/3302328918 >> 172.21.15.114:0/3302328918 conn(0x7f6020054cf0 msgr2=0x7f6020034520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:04.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.869+0000 7f4dabfff700 1 -- 172.21.15.114:0/832575646 <== osd.3 v2:172.21.15.114:6819/1361608073 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f4db0071f40 con 0x7f4db006f430 2023-10-18T12:20:04.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.869+0000 7f9bb27fc700 1 -- 172.21.15.114:0/2452077995 <== osd.4 v2:172.21.15.172:6800/930839681 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f9ba0071fb0 con 0x7f9ba006f4a0 2023-10-18T12:20:04.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.869+0000 7f6027fff700 1 -- 172.21.15.114:0/3302328918 shutdown_connections 2023-10-18T12:20:04.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.869+0000 7fc683fff700 1 --2- 172.21.15.114:0/125393798 >> [v2:172.21.15.172:6823/1680398853,v1:172.21.15.172:6825/1680398853] conn(0x7fc66806f380 0x7fc6680717c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.869+0000 7f6027fff700 1 -- 172.21.15.114:0/3302328918 wait complete. 2023-10-18T12:20:04.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.869+0000 7f4b29113700 1 -- start start 2023-10-18T12:20:04.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.869+0000 7fe74cff9700 1 -- 172.21.15.114:0/1679185784 <== osd.5 v2:172.21.15.172:6812/571761850 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fe73c071fe0 con 0x7fe73c06f4d0 2023-10-18T12:20:04.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.869+0000 7fc683fff700 1 --2- 172.21.15.114:0/125393798 >> [v2:172.21.15.172:6823/1680398853,v1:172.21.15.172:6825/1680398853] conn(0x7fc66806f380 0x7fc6680717c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:04.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.869+0000 7f4b29113700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b1c038530 0x7f4b1c17d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.869+0000 7f4b29113700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b1c04f340 0x7f4b1c04bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.869+0000 7f4b29113700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b1c0e7990 0x7f4b1c04c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.869+0000 7f4b29113700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c04e0f0 con 0x7f4b1c04f340 2023-10-18T12:20:04.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.869+0000 7f4b29113700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c04e3d0 con 0x7f4b1c038530 2023-10-18T12:20:04.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.869+0000 7f4b29113700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c04e6b0 con 0x7f4b1c0e7990 2023-10-18T12:20:04.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.873+0000 7f4b237fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b1c04f340 0x7f4b1c04bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.873+0000 7f4b237fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b1c04f340 0x7f4b1c04bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47056/0 (socket says 172.21.15.114:47056) 2023-10-18T12:20:04.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.873+0000 7f4b237fe700 1 -- 172.21.15.114:0/3720410511 learned_addr learned my addr 172.21.15.114:0/3720410511 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:04.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.873+0000 7f4b23fff700 1 --2- 172.21.15.114:0/3720410511 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b1c038530 0x7f4b1c17d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.873+0000 7f4b28912700 1 --2- 172.21.15.114:0/3720410511 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b1c0e7990 0x7f4b1c04c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.873+0000 7f4b237fe700 1 -- 172.21.15.114:0/3720410511 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b1c0e7990 msgr2=0x7f4b1c04c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:04.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.873+0000 7f4b237fe700 1 --2- 172.21.15.114:0/3720410511 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4b1c0e7990 0x7f4b1c04c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.873+0000 7f4b237fe700 1 -- 172.21.15.114:0/3720410511 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b1c038530 msgr2=0x7f4b1c17d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:04.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.873+0000 7f4b237fe700 1 --2- 172.21.15.114:0/3720410511 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b1c038530 0x7f4b1c17d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.873+0000 7f4b237fe700 1 -- 172.21.15.114:0/3720410511 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b1c04e990 con 0x7f4b1c04f340 2023-10-18T12:20:04.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.873+0000 7f4b237fe700 1 --2- 172.21.15.114:0/3720410511 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b1c04f340 0x7f4b1c04bdc0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4b1000c500 tx=0x7f4b1000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:04.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.873+0000 7fc6817fa700 1 -- 172.21.15.114:0/125393798 <== osd.6 v2:172.21.15.172:6823/1680398853 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fc668071e90 con 0x7fc66806f380 2023-10-18T12:20:04.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.873+0000 7f4b20ff9700 1 -- 172.21.15.114:0/3720410511 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b100052d0 con 0x7f4b1c04f340 2023-10-18T12:20:04.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.873+0000 7f4b20ff9700 1 -- 172.21.15.114:0/3720410511 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b10005430 con 0x7f4b1c04f340 2023-10-18T12:20:04.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.873+0000 7f4b20ff9700 1 -- 172.21.15.114:0/3720410511 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b100055a0 con 0x7f4b1c04f340 2023-10-18T12:20:04.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.873+0000 7f4b29113700 1 -- 172.21.15.114:0/3720410511 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b1c04dd70 con 0x7f4b1c04f340 2023-10-18T12:20:04.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.873+0000 7fc688fad700 1 --2- 172.21.15.114:0/125393798 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc668065720 0x7fc668067be0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc678000c00 tx=0x7fc678008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:04.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.873+0000 7f4b29113700 1 -- 172.21.15.114:0/3720410511 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b1c17dbe0 con 0x7f4b1c04f340 2023-10-18T12:20:04.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.873+0000 7f4b29113700 1 -- 172.21.15.114:0/3720410511 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4b1c04e260 con 0x7f4b1c04f340 2023-10-18T12:20:04.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.877+0000 7f4b20ff9700 1 -- 172.21.15.114:0/3720410511 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f4b100038e0 con 0x7f4b1c04f340 2023-10-18T12:20:04.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.877+0000 7f4b20ff9700 1 --2- 172.21.15.114:0/3720410511 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4b080657c0 0x7f4b08067c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.877+0000 7f4b20ff9700 1 -- 172.21.15.114:0/3720410511 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4b10082940 con 0x7f4b1c04f340 2023-10-18T12:20:04.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.877+0000 7f4b20ff9700 1 --2- 172.21.15.114:0/3720410511 >> [v2:172.21.15.172:6808/349710101,v1:172.21.15.172:6809/349710101] conn(0x7f4b0806f4a0 0x7f4b080718e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:04.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.881+0000 7f4b20ff9700 1 -- 172.21.15.114:0/3720410511 --> [v2:172.21.15.172:6808/349710101,v1:172.21.15.172:6809/349710101] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4b08071fb0 con 0x7f4b0806f4a0 2023-10-18T12:20:04.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.881+0000 7f4b20ff9700 1 -- 172.21.15.114:0/3720410511 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b10082cf0 con 0x7f4b1c04f340 2023-10-18T12:20:04.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.881+0000 7f4b28912700 1 --2- 172.21.15.114:0/3720410511 >> [v2:172.21.15.172:6808/349710101,v1:172.21.15.172:6809/349710101] conn(0x7f4b0806f4a0 0x7f4b080718e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.881+0000 7f4b23fff700 1 --2- 172.21.15.114:0/3720410511 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4b080657c0 0x7f4b08067c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:04.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.881+0000 7f034209e700 1 -- 172.21.15.114:0/2311759537 --> [v2:172.21.15.114:6816/1506287862,v1:172.21.15.114:6817/1506287862] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f033c072920 con 0x7f031c06f4a0 2023-10-18T12:20:04.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.881+0000 7f4b28912700 1 --2- 172.21.15.114:0/3720410511 >> [v2:172.21.15.172:6808/349710101,v1:172.21.15.172:6809/349710101] conn(0x7f4b0806f4a0 0x7f4b080718e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:04.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.881+0000 7f4b23fff700 1 --2- 172.21.15.114:0/3720410511 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4b080657c0 0x7f4b08067c80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c00db70 tx=0x7f4b2406b070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:04.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.881+0000 7f0333fff700 1 -- 172.21.15.114:0/2311759537 <== osd.0 v2:172.21.15.114:6816/1506287862 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f033c072920 con 0x7f031c06f4a0 2023-10-18T12:20:04.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.881+0000 7f034209e700 1 -- 172.21.15.114:0/2311759537 >> [v2:172.21.15.114:6816/1506287862,v1:172.21.15.114:6817/1506287862] conn(0x7f031c06f4a0 msgr2=0x7f031c0718e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:04.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.881+0000 7f034209e700 1 --2- 172.21.15.114:0/2311759537 >> [v2:172.21.15.114:6816/1506287862,v1:172.21.15.114:6817/1506287862] conn(0x7f031c06f4a0 0x7f031c0718e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:04.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.881+0000 7f4b20ff9700 1 -- 172.21.15.114:0/3720410511 <== osd.7 v2:172.21.15.172:6808/349710101 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f4b08071fb0 con 0x7f4b0806f4a0 2023-10-18T12:20:04.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.881+0000 7f034209e700 1 -- 172.21.15.114:0/2311759537 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f031c0657c0 msgr2=0x7f031c067c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:04.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.881+0000 7f034209e700 1 --2- 172.21.15.114:0/2311759537 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f031c0657c0 0x7f031c067c80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0324009150 tx=0x7f0324008030 comp rx=0 tx=0).stop 2023-10-18T12:20:04.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.881+0000 7f034209e700 1 -- 172.21.15.114:0/2311759537 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f033c0cb960 msgr2=0x7f033c0c4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:04.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.881+0000 7f034209e700 1 --2- 172.21.15.114:0/2311759537 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f033c0cb960 0x7f033c0c4b50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f033c0b0240 tx=0x7f0334001e70 comp rx=0 tx=0).stop 2023-10-18T12:20:04.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.885+0000 7f033bfff700 1 -- 172.21.15.114:0/2311759537 reap_dead start 2023-10-18T12:20:04.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.885+0000 7f034209e700 1 -- 172.21.15.114:0/2311759537 shutdown_connections 2023-10-18T12:20:04.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.885+0000 7f034209e700 1 -- 172.21.15.114:0/2311759537 >> 172.21.15.114:0/2311759537 conn(0x7f033c0d09f0 msgr2=0x7f033c0b5480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:04.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.889+0000 7f034209e700 1 -- 172.21.15.114:0/2311759537 shutdown_connections 2023-10-18T12:20:04.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.889+0000 7f034209e700 1 -- 172.21.15.114:0/2311759537 wait complete. 2023-10-18T12:20:04.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.893+0000 7f9bc3d2b700 1 -- 172.21.15.114:0/2452077995 --> [v2:172.21.15.172:6800/930839681,v1:172.21.15.172:6801/930839681] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9bbc0b62e0 con 0x7f9ba006f4a0 2023-10-18T12:20:04.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.893+0000 7fd687392700 1 -- 172.21.15.114:0/2733713531 --> [v2:172.21.15.114:6808/2699151351,v1:172.21.15.114:6809/2699151351] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd660002d60 con 0x7fd66c06f450 2023-10-18T12:20:04.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.897+0000 7fd67dffb700 1 -- 172.21.15.114:0/2733713531 <== osd.2 v2:172.21.15.114:6808/2699151351 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd660002d60 con 0x7fd66c06f450 2023-10-18T12:20:04.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.897+0000 7f9bb27fc700 1 -- 172.21.15.114:0/2452077995 <== osd.4 v2:172.21.15.172:6800/930839681 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9bb400f040 con 0x7f9ba006f4a0 2023-10-18T12:20:04.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.897+0000 7f4dc9d75700 1 -- 172.21.15.114:0/832575646 --> [v2:172.21.15.114:6819/1361608073,v1:172.21.15.114:6821/1361608073] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4dc40b62e0 con 0x7f4db006f430 2023-10-18T12:20:05.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.901+0000 7f9bc3d2b700 1 -- 172.21.15.114:0/2452077995 >> [v2:172.21.15.172:6800/930839681,v1:172.21.15.172:6801/930839681] conn(0x7f9ba006f4a0 msgr2=0x7f9ba00718e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.901+0000 7f9bc3d2b700 1 --2- 172.21.15.114:0/2452077995 >> [v2:172.21.15.172:6800/930839681,v1:172.21.15.172:6801/930839681] conn(0x7f9ba006f4a0 0x7f9ba00718e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.901+0000 7f9bc3d2b700 1 -- 172.21.15.114:0/2452077995 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9ba00657c0 msgr2=0x7f9ba0067c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.901+0000 7f9bc3d2b700 1 --2- 172.21.15.114:0/2452077995 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9ba00657c0 0x7f9ba0067c80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8000c00 tx=0x7f9bb8008030 comp rx=0 tx=0).stop 2023-10-18T12:20:05.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.901+0000 7f9bc3d2b700 1 -- 172.21.15.114:0/2452077995 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bbc06fef0 msgr2=0x7f9bbc136440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.901+0000 7f9bc3d2b700 1 --2- 172.21.15.114:0/2452077995 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bbc06fef0 0x7f9bbc136440 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9bac00c730 tx=0x7f9bac00ca40 comp rx=0 tx=0).stop 2023-10-18T12:20:05.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.901+0000 7f9bc22c8700 1 -- 172.21.15.114:0/2452077995 reap_dead start 2023-10-18T12:20:05.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.901+0000 7f9bc3d2b700 1 -- 172.21.15.114:0/2452077995 shutdown_connections 2023-10-18T12:20:05.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.901+0000 7f9bc3d2b700 1 -- 172.21.15.114:0/2452077995 >> 172.21.15.114:0/2452077995 conn(0x7f9bbc06a130 msgr2=0x7f9bbc0d0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:05.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.901+0000 7fd687392700 1 -- 172.21.15.114:0/2733713531 >> [v2:172.21.15.114:6808/2699151351,v1:172.21.15.114:6809/2699151351] conn(0x7fd66c06f450 msgr2=0x7fd66c071890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.901+0000 7fd687392700 1 --2- 172.21.15.114:0/2733713531 >> [v2:172.21.15.114:6808/2699151351,v1:172.21.15.114:6809/2699151351] conn(0x7fd66c06f450 0x7fd66c071890 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.901+0000 7fe75689e700 1 -- 172.21.15.114:0/1679185784 --> [v2:172.21.15.172:6812/571761850,v1:172.21.15.172:6814/571761850] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe7500b62e0 con 0x7fe73c06f4d0 2023-10-18T12:20:05.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.901+0000 7f9bc3d2b700 1 -- 172.21.15.114:0/2452077995 shutdown_connections 2023-10-18T12:20:05.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.901+0000 7f4dabfff700 1 -- 172.21.15.114:0/832575646 <== osd.3 v2:172.21.15.114:6819/1361608073 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4db800c040 con 0x7f4db006f430 2023-10-18T12:20:05.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.901+0000 7f9bc3d2b700 1 -- 172.21.15.114:0/2452077995 wait complete. 2023-10-18T12:20:05.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.901+0000 7fe74cff9700 1 -- 172.21.15.114:0/1679185784 <== osd.5 v2:172.21.15.172:6812/571761850 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe7480098f0 con 0x7fe73c06f4d0 2023-10-18T12:20:05.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.901+0000 7f4da9ffb700 1 -- 172.21.15.114:0/832575646 >> [v2:172.21.15.114:6819/1361608073,v1:172.21.15.114:6821/1361608073] conn(0x7f4db006f430 msgr2=0x7f4db0071870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.901+0000 7f4da9ffb700 1 --2- 172.21.15.114:0/832575646 >> [v2:172.21.15.114:6819/1361608073,v1:172.21.15.114:6821/1361608073] conn(0x7f4db006f430 0x7f4db0071870 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.901+0000 7fc68b211700 1 -- 172.21.15.114:0/125393798 --> [v2:172.21.15.172:6823/1680398853,v1:172.21.15.172:6825/1680398853] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc6840c4050 con 0x7fc66806f380 2023-10-18T12:20:05.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.901+0000 7fd687392700 1 -- 172.21.15.114:0/2733713531 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd66c065770 msgr2=0x7fd66c067c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.901+0000 7fd687392700 1 --2- 172.21.15.114:0/2733713531 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd66c065770 0x7fd66c067c30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd68006e520 tx=0x7fd678009040 comp rx=0 tx=0).stop 2023-10-18T12:20:05.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.901+0000 7fd687392700 1 -- 172.21.15.114:0/2733713531 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd68006e7c0 msgr2=0x7fd68014d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.901+0000 7fd687392700 1 --2- 172.21.15.114:0/2733713531 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd68006e7c0 0x7fd68014d090 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd6800cb040 tx=0x7fd67000ed50 comp rx=0 tx=0).stop 2023-10-18T12:20:05.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.901+0000 7fd68592f700 1 -- 172.21.15.114:0/2733713531 reap_dead start 2023-10-18T12:20:05.007 INFO:teuthology.orchestra.run.smithi114.stdout:55834574858 2023-10-18T12:20:05.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.905+0000 7fd687392700 1 -- 172.21.15.114:0/2733713531 shutdown_connections 2023-10-18T12:20:05.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.905+0000 7fd687392700 1 -- 172.21.15.114:0/2733713531 >> 172.21.15.114:0/2733713531 conn(0x7fd6800ce660 msgr2=0x7fd6800adfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:05.009 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-18T12:20:05.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.905+0000 7fd687392700 1 -- 172.21.15.114:0/2733713531 shutdown_connections 2023-10-18T12:20:05.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.905+0000 7fd687392700 1 -- 172.21.15.114:0/2733713531 wait complete. 2023-10-18T12:20:05.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.905+0000 7f4da9ffb700 1 -- 172.21.15.114:0/832575646 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4db0065750 msgr2=0x7f4db0067c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.905+0000 7f4da9ffb700 1 --2- 172.21.15.114:0/832575646 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4db0065750 0x7f4db0067c10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4dc413c680 tx=0x7f4dbc0021d0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.905+0000 7f4da9ffb700 1 -- 172.21.15.114:0/832575646 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4dc413dd90 msgr2=0x7f4dc415cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.905+0000 7f4da9ffb700 1 --2- 172.21.15.114:0/832575646 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4dc413dd90 0x7f4dc415cd80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4db400e4b0 tx=0x7f4db40047e0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.905+0000 7f4dc3fff700 1 -- 172.21.15.114:0/832575646 reap_dead start 2023-10-18T12:20:05.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.905+0000 7f4da9ffb700 1 -- 172.21.15.114:0/832575646 shutdown_connections 2023-10-18T12:20:05.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.905+0000 7f4da9ffb700 1 -- 172.21.15.114:0/832575646 >> 172.21.15.114:0/832575646 conn(0x7f4dc406a130 msgr2=0x7f4dc4160fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:05.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.905+0000 7fe75689e700 1 -- 172.21.15.114:0/1679185784 >> [v2:172.21.15.172:6812/571761850,v1:172.21.15.172:6814/571761850] conn(0x7fe73c06f4d0 msgr2=0x7fe73c071910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.905+0000 7fe75689e700 1 --2- 172.21.15.114:0/1679185784 >> [v2:172.21.15.172:6812/571761850,v1:172.21.15.172:6814/571761850] conn(0x7fe73c06f4d0 0x7fe73c071910 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.905+0000 7fe75689e700 1 -- 172.21.15.114:0/1679185784 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe73c0657f0 msgr2=0x7fe73c067cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.905+0000 7fe75689e700 1 --2- 172.21.15.114:0/1679185784 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe73c0657f0 0x7fe73c067cb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe7440011e0 tx=0x7fe744009040 comp rx=0 tx=0).stop 2023-10-18T12:20:05.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.905+0000 7fe75689e700 1 -- 172.21.15.114:0/1679185784 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe7500b7dd0 msgr2=0x7fe75006e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.905+0000 7fe75689e700 1 --2- 172.21.15.114:0/1679185784 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe7500b7dd0 0x7fe75006e850 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe74000e810 tx=0x7fe74000eb20 comp rx=0 tx=0).stop 2023-10-18T12:20:05.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.905+0000 7fe754e3b700 1 -- 172.21.15.114:0/1679185784 reap_dead start 2023-10-18T12:20:05.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.905+0000 7fe75689e700 1 -- 172.21.15.114:0/1679185784 shutdown_connections 2023-10-18T12:20:05.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.905+0000 7fe75689e700 1 -- 172.21.15.114:0/1679185784 >> 172.21.15.114:0/1679185784 conn(0x7fe75006a130 msgr2=0x7fe7500d09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:05.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.905+0000 7fc6817fa700 1 -- 172.21.15.114:0/125393798 <== osd.6 v2:172.21.15.172:6823/1680398853 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc6840c4050 con 0x7fc66806f380 2023-10-18T12:20:05.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.905+0000 7f4da9ffb700 1 -- 172.21.15.114:0/832575646 shutdown_connections 2023-10-18T12:20:05.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.905+0000 7f4da9ffb700 1 -- 172.21.15.114:0/832575646 wait complete. 2023-10-18T12:20:05.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.905+0000 7fe75689e700 1 -- 172.21.15.114:0/1679185784 shutdown_connections 2023-10-18T12:20:05.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.905+0000 7fe75689e700 1 -- 172.21.15.114:0/1679185784 wait complete. 2023-10-18T12:20:05.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.905+0000 7fc66effd700 1 -- 172.21.15.114:0/125393798 >> [v2:172.21.15.172:6823/1680398853,v1:172.21.15.172:6825/1680398853] conn(0x7fc66806f380 msgr2=0x7fc6680717c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.905+0000 7fc66effd700 1 --2- 172.21.15.114:0/125393798 >> [v2:172.21.15.172:6823/1680398853,v1:172.21.15.172:6825/1680398853] conn(0x7fc66806f380 0x7fc6680717c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.905+0000 7fc66effd700 1 -- 172.21.15.114:0/125393798 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc668065720 msgr2=0x7fc668067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.905+0000 7fc66effd700 1 --2- 172.21.15.114:0/125393798 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc668065720 0x7fc668067be0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc678000c00 tx=0x7fc678008030 comp rx=0 tx=0).stop 2023-10-18T12:20:05.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.905+0000 7fc66effd700 1 -- 172.21.15.114:0/125393798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc684158ef0 msgr2=0x7fc68415c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.905+0000 7fc66effd700 1 --2- 172.21.15.114:0/125393798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc684158ef0 0x7fc68415c580 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc67c00b970 tx=0x7fc67c00bd30 comp rx=0 tx=0).stop 2023-10-18T12:20:05.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.905+0000 7fc6897ae700 1 -- 172.21.15.114:0/125393798 reap_dead start 2023-10-18T12:20:05.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.905+0000 7fc66effd700 1 -- 172.21.15.114:0/125393798 shutdown_connections 2023-10-18T12:20:05.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.905+0000 7fc66effd700 1 -- 172.21.15.114:0/125393798 >> 172.21.15.114:0/125393798 conn(0x7fc6840b0810 msgr2=0x7fc6840afcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:05.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.905+0000 7fc66effd700 1 -- 172.21.15.114:0/125393798 shutdown_connections 2023-10-18T12:20:05.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.909+0000 7fc66effd700 1 -- 172.21.15.114:0/125393798 wait complete. 2023-10-18T12:20:05.020 INFO:teuthology.orchestra.run.smithi114.stdout:55834574858 2023-10-18T12:20:05.020 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-18T12:20:05.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.917+0000 7f4b29113700 1 -- 172.21.15.114:0/3720410511 --> [v2:172.21.15.172:6808/349710101,v1:172.21.15.172:6809/349710101] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4b1c04e540 con 0x7f4b0806f4a0 2023-10-18T12:20:05.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.917+0000 7f4b20ff9700 1 -- 172.21.15.114:0/3720410511 <== osd.7 v2:172.21.15.172:6808/349710101 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4b1c04e540 con 0x7f4b0806f4a0 2023-10-18T12:20:05.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.917+0000 7f4b29113700 1 -- 172.21.15.114:0/3720410511 >> [v2:172.21.15.172:6808/349710101,v1:172.21.15.172:6809/349710101] conn(0x7f4b0806f4a0 msgr2=0x7f4b080718e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.917+0000 7f4b29113700 1 --2- 172.21.15.114:0/3720410511 >> [v2:172.21.15.172:6808/349710101,v1:172.21.15.172:6809/349710101] conn(0x7f4b0806f4a0 0x7f4b080718e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.917+0000 7f4b29113700 1 -- 172.21.15.114:0/3720410511 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4b080657c0 msgr2=0x7f4b08067c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.917+0000 7f4b29113700 1 --2- 172.21.15.114:0/3720410511 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4b080657c0 0x7f4b08067c80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c00db70 tx=0x7f4b2406b070 comp rx=0 tx=0).stop 2023-10-18T12:20:05.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.917+0000 7f4b29113700 1 -- 172.21.15.114:0/3720410511 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b1c04f340 msgr2=0x7f4b1c04bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.917+0000 7f4b29113700 1 --2- 172.21.15.114:0/3720410511 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b1c04f340 0x7f4b1c04bdc0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4b1000c500 tx=0x7f4b1000c810 comp rx=0 tx=0).stop 2023-10-18T12:20:05.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.917+0000 7f4b28912700 1 -- 172.21.15.114:0/3720410511 reap_dead start 2023-10-18T12:20:05.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.921+0000 7f4b29113700 1 -- 172.21.15.114:0/3720410511 shutdown_connections 2023-10-18T12:20:05.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.921+0000 7f4b29113700 1 -- 172.21.15.114:0/3720410511 >> 172.21.15.114:0/3720410511 conn(0x7f4b1c054cf0 msgr2=0x7f4b1c0e68f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:05.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.925+0000 7f4b29113700 1 -- 172.21.15.114:0/3720410511 shutdown_connections 2023-10-18T12:20:05.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:04.925+0000 7f4b29113700 1 -- 172.21.15.114:0/3720410511 wait complete. 2023-10-18T12:20:05.025 INFO:teuthology.orchestra.run.smithi114.stdout:55834574857 2023-10-18T12:20:05.025 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-18T12:20:05.026 INFO:teuthology.orchestra.run.smithi114.stdout:55834574857 2023-10-18T12:20:05.027 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-18T12:20:05.027 INFO:teuthology.orchestra.run.smithi114.stdout:55834574859 2023-10-18T12:20:05.028 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-18T12:20:05.029 INFO:teuthology.orchestra.run.smithi114.stdout:55834574859 2023-10-18T12:20:05.029 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-18T12:20:05.030 INFO:teuthology.orchestra.run.smithi114.stdout:55834574860 2023-10-18T12:20:05.030 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-18T12:20:05.031 INFO:teuthology.orchestra.run.smithi114.stdout:55834574859 2023-10-18T12:20:05.032 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-18T12:20:05.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.297+0000 7fdeb086b700 1 Processor -- start 2023-10-18T12:20:05.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.297+0000 7fc30f59e700 1 Processor -- start 2023-10-18T12:20:05.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.297+0000 7fc30f59e700 1 -- start start 2023-10-18T12:20:05.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.301+0000 7f8fbdf90700 1 Processor -- start 2023-10-18T12:20:05.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.297+0000 7fdeb086b700 1 -- start start 2023-10-18T12:20:05.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.301+0000 7fdeb086b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdeac15cbd0 0x7fdeac0b6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.301+0000 7fdeb086b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fdeac0b5ae0 0x7fdeac0b6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.301+0000 7fdeb086b700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeac06e390 con 0x7fdeac0b1d10 2023-10-18T12:20:05.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.301+0000 7fdeb086b700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeac15cfb0 con 0x7fdeac0b5ae0 2023-10-18T12:20:05.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.301+0000 7fdeb086b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac0b6050 con 0x7fdeac15cbd0 2023-10-18T12:20:05.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.301+0000 7f8fbdf90700 1 -- start start 2023-10-18T12:20:05.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.301+0000 7fc30f59e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc3080070d0 0x7fc308053f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.301+0000 7fc30f59e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3080079d0 con 0x7fc30803a9b0 2023-10-18T12:20:05.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.301+0000 7fdeab7fe700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdeac15cbd0 0x7fdeac0b6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.301+0000 7fc30f59e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc308053140 con 0x7fc3080e6ea0 2023-10-18T12:20:05.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.301+0000 7fdeab7fe700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdeac15cbd0 0x7fdeac0b6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.114:57940/0 (socket says 172.21.15.114:57940) 2023-10-18T12:20:05.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.301+0000 7fc30f59e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc308053420 con 0x7fc3080070d0 2023-10-18T12:20:05.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.301+0000 7fdeabfff700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fdeac0b1d10 0x7fdeac160750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.114:36312/0 (socket says 172.21.15.114:36312) 2023-10-18T12:20:05.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.301+0000 7fdeabfff700 1 -- 172.21.15.114:0/3569552948 learned_addr learned my addr 172.21.15.114:0/3569552948 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:05.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.301+0000 7fc30e59c700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fc3080e6ea0 0x7fc3080e7280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.114:36326/0 (socket says 172.21.15.114:36326) 2023-10-18T12:20:05.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.301+0000 7fdeaaffd700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fdeac0b5ae0 0x7fdeac0b6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.301+0000 7fc30e59c700 1 -- 172.21.15.114:0/185811571 learned_addr learned my addr 172.21.15.114:0/185811571 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:05.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.301+0000 7fc30ed9d700 1 --2- 172.21.15.114:0/185811571 >> v2:172.21.15.114:3300/0 conn(0x7fc3080070d0 0x7fc308053f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.301+0000 7f8fbdf90700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fb00e1290 0x7f8fb0038840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.301+0000 7fdeaa7fc700 1 -- 172.21.15.114:0/3569552948 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 461019369 0 0) 0x7fdeac06e390 con 0x7fdeac0b1d10 2023-10-18T12:20:05.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.301+0000 7fc30d59a700 1 -- 172.21.15.114:0/185811571 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1361309760 0 0) 0x7fc308053140 con 0x7fc3080e6ea0 2023-10-18T12:20:05.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.301+0000 7fc30d59a700 1 -- 172.21.15.114:0/185811571 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2f80035d0 con 0x7fc3080e6ea0 2023-10-18T12:20:05.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.301+0000 7f8fbdf90700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8fb00e1670 0x7f8fb003b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.301+0000 7fdeaa7fc700 1 -- 172.21.15.114:0/3569552948 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde940035d0 con 0x7fdeac0b1d10 2023-10-18T12:20:05.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.305+0000 7f8fbdf90700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fb0055540 con 0x7f8fb0054360 2023-10-18T12:20:05.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.305+0000 7fc30ed9d700 1 -- 172.21.15.114:0/185811571 >> v1:172.21.15.172:6789/0 conn(0x7fc3080e6ea0 legacy=0x7fc3080e7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.305+0000 7fc30ed9d700 1 -- 172.21.15.114:0/185811571 >> v1:172.21.15.114:6789/0 conn(0x7fc30803a9b0 legacy=0x7fc308037e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:05.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.305+0000 7f8fbdf90700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb00569e0 con 0x7f8fb00e1670 2023-10-18T12:20:05.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.305+0000 7fc30ed9d700 1 -- 172.21.15.114:0/185811571 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc308053700 con 0x7fc3080070d0 2023-10-18T12:20:05.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.301+0000 7fdeaaffd700 1 -- 172.21.15.114:0/3569552948 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdeac15cbd0 msgr2=0x7fdeac0b6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:05.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.305+0000 7f8fbdf90700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb0055350 con 0x7f8fb00e1290 2023-10-18T12:20:05.326 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.301+0000 7fdeaaffd700 1 --2- 172.21.15.114:0/3569552948 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdeac15cbd0 0x7fdeac0b6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.326 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.301+0000 7fdeaaffd700 1 -- 172.21.15.114:0/3569552948 >> v1:172.21.15.172:6789/0 conn(0x7fdeac0b1d10 legacy=0x7fdeac160750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.305+0000 7f8fbcf8e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fb00e1290 0x7f8fb0038840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.301+0000 7fdeaaffd700 1 -- 172.21.15.114:0/3569552948 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeac06e5e0 con 0x7fdeac0b5ae0 2023-10-18T12:20:05.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.305+0000 7fc30ed9d700 1 --2- 172.21.15.114:0/185811571 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3080070d0 0x7fc308053f00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc310067ad0 tx=0x7fc31004f050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e1b29ee3a4f9b63 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:05.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.305+0000 7f8fbcf8e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fb00e1290 0x7f8fb0038840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.114:57948/0 (socket says 172.21.15.114:57948) 2023-10-18T12:20:05.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.305+0000 7f8fbcf8e700 1 -- 172.21.15.114:0/4089935483 learned_addr learned my addr 172.21.15.114:0/4089935483 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:05.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.305+0000 7f8fbd78f700 1 --2- 172.21.15.114:0/4089935483 >> v2:172.21.15.172:3300/0 conn(0x7f8fb00e1670 0x7f8fb003b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.305+0000 7fc30d59a700 1 -- 172.21.15.114:0/185811571 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31004e9d0 con 0x7fc3080070d0 2023-10-18T12:20:05.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.305+0000 7fc30d59a700 1 -- 172.21.15.114:0/185811571 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31008d070 con 0x7fc3080070d0 2023-10-18T12:20:05.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.305+0000 7fc30d59a700 1 -- 172.21.15.114:0/185811571 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3100737c0 con 0x7fc3080070d0 2023-10-18T12:20:05.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.305+0000 7f8fbcf8e700 1 -- 172.21.15.114:0/4089935483 >> v2:172.21.15.172:3300/0 conn(0x7f8fb00e1670 msgr2=0x7f8fb003b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:05.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.305+0000 7f8fbcf8e700 1 --2- 172.21.15.114:0/4089935483 >> v2:172.21.15.172:3300/0 conn(0x7f8fb00e1670 0x7f8fb003b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.305+0000 7f8fbcf8e700 1 -- 172.21.15.114:0/4089935483 >> v1:172.21.15.114:6789/0 conn(0x7f8fb0054360 legacy=0x7f8fb0051740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.305+0000 7f8fbcf8e700 1 -- 172.21.15.114:0/4089935483 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb0056600 con 0x7f8fb00e1290 2023-10-18T12:20:05.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.305+0000 7f8fb77fe700 1 -- 172.21.15.114:0/4089935483 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3912509089 0 0) 0x7f8fb0055540 con 0x7f8fb0054360 2023-10-18T12:20:05.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.305+0000 7f03bbe71700 1 Processor -- start 2023-10-18T12:20:05.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.305+0000 7fc30f59e700 1 -- 172.21.15.114:0/185811571 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3080070d0 msgr2=0x7fc308053f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.305+0000 7fc30f59e700 1 --2- 172.21.15.114:0/185811571 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3080070d0 0x7fc308053f00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc310067ad0 tx=0x7fc31004f050 comp rx=0 tx=0).stop 2023-10-18T12:20:05.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.305+0000 7f8fbcf8e700 1 --2- 172.21.15.114:0/4089935483 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fb00e1290 0x7f8fb0038840 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8fac009910 tx=0x7f8fac009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66951675f1989194 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:05.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.305+0000 7f03bbe71700 1 -- start start 2023-10-18T12:20:05.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.305+0000 7f8fb77fe700 1 -- 172.21.15.114:0/4089935483 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fac011830 con 0x7f8fb00e1290 2023-10-18T12:20:05.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.305+0000 7f8fb77fe700 1 -- 172.21.15.114:0/4089935483 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fac011990 con 0x7f8fb00e1290 2023-10-18T12:20:05.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.305+0000 7f8fb77fe700 1 -- 172.21.15.114:0/4089935483 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fac011d40 con 0x7f8fb00e1290 2023-10-18T12:20:05.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.305+0000 7fc30f59e700 1 -- 172.21.15.114:0/185811571 shutdown_connections 2023-10-18T12:20:05.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.305+0000 7fc30f59e700 1 --2- 172.21.15.114:0/185811571 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3080070d0 0x7fc308053f00 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.305+0000 7fc30f59e700 1 -- 172.21.15.114:0/185811571 >> 172.21.15.114:0/185811571 conn(0x7fc308054cf0 msgr2=0x7fc308055100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:05.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.305+0000 7f0f4e89f700 1 Processor -- start 2023-10-18T12:20:05.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.305+0000 7f0f4e89f700 1 -- start start 2023-10-18T12:20:05.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.305+0000 7fdeaaffd700 1 --2- 172.21.15.114:0/3569552948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdeac0b5ae0 0x7fdeac0b6aa0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdea0009850 tx=0x7fdea0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78d211c66bd37b0e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:05.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.305+0000 7fc30f59e700 1 -- 172.21.15.114:0/185811571 shutdown_connections 2023-10-18T12:20:05.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.305+0000 7fe9bdfca700 1 Processor -- start 2023-10-18T12:20:05.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7fe9bdfca700 1 -- start start 2023-10-18T12:20:05.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.305+0000 7fc30f59e700 1 -- 172.21.15.114:0/185811571 wait complete. 2023-10-18T12:20:05.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7f8fbdf90700 1 -- 172.21.15.114:0/4089935483 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fb00e1290 msgr2=0x7f8fb0038840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7f8fbdf90700 1 --2- 172.21.15.114:0/4089935483 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fb00e1290 0x7f8fb0038840 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8fac009910 tx=0x7f8fac009c20 comp rx=0 tx=0).stop 2023-10-18T12:20:05.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7f03bbe71700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f03b40adb60 0x7f03b40cb190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7fcafb59e700 1 Processor -- start 2023-10-18T12:20:05.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7f03bbe71700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03b40cbb20 con 0x7f03b4161230 2023-10-18T12:20:05.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7f03bbe71700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03b4165770 con 0x7f03b40cb6d0 2023-10-18T12:20:05.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7f03bbe71700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b406ea40 con 0x7f03b40adb60 2023-10-18T12:20:05.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7f8fbdf90700 1 -- 172.21.15.114:0/4089935483 shutdown_connections 2023-10-18T12:20:05.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7f8fbdf90700 1 --2- 172.21.15.114:0/4089935483 >> v2:172.21.15.172:3300/0 conn(0x7f8fb00e1670 0x7f8fb003b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7f8fbdf90700 1 --2- 172.21.15.114:0/4089935483 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fb00e1290 0x7f8fb0038840 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7fcafb59e700 1 -- start start 2023-10-18T12:20:05.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7f03b9c0d700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f03b4161230 0x7f03b406ced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34442/0 (socket says 172.21.15.114:34442) 2023-10-18T12:20:05.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7f03b9c0d700 1 -- 172.21.15.114:0/3164012623 learned_addr learned my addr 172.21.15.114:0/3164012623 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:05.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7f8fbdf90700 1 -- 172.21.15.114:0/4089935483 >> 172.21.15.114:0/4089935483 conn(0x7f8fb0053840 msgr2=0x7f8fb0053c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:05.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7f0f4e89f700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0f4815b590 0x7f0f480b16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7f8fbdf90700 1 -- 172.21.15.114:0/4089935483 shutdown_connections 2023-10-18T12:20:05.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7f8fbdf90700 1 -- 172.21.15.114:0/4089935483 wait complete. 2023-10-18T12:20:05.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7f03b940c700 1 --2- 172.21.15.114:0/3164012623 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f03b40adb60 0x7f03b40cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7f0f4e89f700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0f480b2130 0x7f0f480b25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7f0f4e89f700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f4806e7b0 con 0x7f0f48164b70 2023-10-18T12:20:05.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7f0f4e89f700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f480b2b20 con 0x7f0f4815b590 2023-10-18T12:20:05.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7f0f4e89f700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f48162590 con 0x7f0f480b2130 2023-10-18T12:20:05.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7fe9bdfca700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe9b80b2200 0x7fe9b815d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7fe9bdfca700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9b8070460 0x7fe9b8070910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7fe9bdfca700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9b8160a60 con 0x7fe9b80b5ae0 2023-10-18T12:20:05.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7fe9bdfca700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9b8070e50 con 0x7fe9b80b2200 2023-10-18T12:20:05.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7fe9bdfca700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b80b25e0 con 0x7fe9b8070460 2023-10-18T12:20:05.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7f0f4d89d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0f4815b590 0x7f0f480b16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7fc30f59e700 1 Processor -- start 2023-10-18T12:20:05.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7f03b8c0b700 1 -- 172.21.15.114:0/3164012623 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1635603600 0 0) 0x7f03b0001110 con 0x7f03b4161230 2023-10-18T12:20:05.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7f03b940c700 1 -- 172.21.15.114:0/3164012623 >> v1:172.21.15.172:6789/0 conn(0x7f03b40cb6d0 legacy=0x7f03b40cc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7fc30f59e700 1 -- start start 2023-10-18T12:20:05.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7f0f4d89d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0f4815b590 0x7f0f480b16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56574/0 (socket says 172.21.15.114:56574) 2023-10-18T12:20:05.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7f0f4d89d700 1 -- 172.21.15.114:0/2837870788 learned_addr learned my addr 172.21.15.114:0/2837870788 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:05.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7f0f4e09e700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f0f48164b70 0x7f0f48164fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.114:36334/0 (socket says 172.21.15.114:36334) 2023-10-18T12:20:05.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7f0f4d09c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0f480b2130 0x7f0f480b25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7fcafb59e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fcafc1441e0 0x7fcafc0b3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7fcafb59e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcafc15aea0 0x7fcafc06f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7fdeaa7fc700 1 -- 172.21.15.114:0/3569552948 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea0011830 con 0x7fdeac0b5ae0 2023-10-18T12:20:05.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7fdeaa7fc700 1 -- 172.21.15.114:0/3569552948 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea0011990 con 0x7fdeac0b5ae0 2023-10-18T12:20:05.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7fdeaa7fc700 1 -- 172.21.15.114:0/3569552948 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea0011d40 con 0x7fdeac0b5ae0 2023-10-18T12:20:05.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7fcafb59e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcafc1445c0 con 0x7fcafc0cb8a0 2023-10-18T12:20:05.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7fcafb59e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcafc15bf60 con 0x7fcafc15aea0 2023-10-18T12:20:05.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7f03b940c700 1 -- 172.21.15.114:0/3164012623 >> v1:172.21.15.114:6789/0 conn(0x7f03b4161230 legacy=0x7f03b406ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7fcafb59e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcafc15b6c0 con 0x7fcafc1441e0 2023-10-18T12:20:05.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7f03b940c700 1 -- 172.21.15.114:0/3164012623 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b4161610 con 0x7f03b40adb60 2023-10-18T12:20:05.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7fe9b7fff700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe9b80b5ae0 0x7fe9b8160ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34448/0 (socket says 172.21.15.114:34448) 2023-10-18T12:20:05.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7fe9b7fff700 1 -- 172.21.15.114:0/3808854906 learned_addr learned my addr 172.21.15.114:0/3808854906 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:05.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7fe9bd7c9700 1 --2- 172.21.15.114:0/3808854906 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9b8070460 0x7fe9b8070910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.309+0000 7fe9bcfc8700 1 --2- 172.21.15.114:0/3808854906 >> v2:172.21.15.114:3300/0 conn(0x7fe9b80b2200 0x7fe9b815d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fcafa59c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fcafc1441e0 0x7fcafc0b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7f03b940c700 1 --2- 172.21.15.114:0/3164012623 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f03b40adb60 0x7f03b40cb190 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f03a4009800 tx=0x7f03a4009b10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f693a686d4ebd94 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:05.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fcafa59c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fcafc1441e0 0x7fcafc0b3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:41972/0 (socket says 172.21.15.114:41972) 2023-10-18T12:20:05.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fcafa59c700 1 -- 172.21.15.114:0/581179885 learned_addr learned my addr 172.21.15.114:0/581179885 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:05.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7f8fbdf90700 1 Processor -- start 2023-10-18T12:20:05.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fdeb086b700 1 -- 172.21.15.114:0/3569552948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdeac0b5ae0 msgr2=0x7fdeac0b6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fdeb086b700 1 --2- 172.21.15.114:0/3569552948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdeac0b5ae0 0x7fdeac0b6aa0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdea0009850 tx=0x7fdea0009b60 comp rx=0 tx=0).stop 2023-10-18T12:20:05.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7f0f4d89d700 1 -- 172.21.15.114:0/2837870788 >> v2:172.21.15.172:3300/0 conn(0x7f0f480b2130 msgr2=0x7f0f480b25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:05.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7f0f4d89d700 1 --2- 172.21.15.114:0/2837870788 >> v2:172.21.15.172:3300/0 conn(0x7f0f480b2130 0x7f0f480b25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7f0f4d89d700 1 -- 172.21.15.114:0/2837870788 >> v1:172.21.15.172:6789/0 conn(0x7f0f48164b70 legacy=0x7f0f48164fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7f0f4d89d700 1 -- 172.21.15.114:0/2837870788 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f4806dba0 con 0x7f0f4815b590 2023-10-18T12:20:05.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7f0f4d09c700 1 --2- 172.21.15.114:0/2837870788 >> v2:172.21.15.172:3300/0 conn(0x7f0f480b2130 0x7f0f480b25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:05.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fe9bd7c9700 1 -- 172.21.15.114:0/3808854906 >> v2:172.21.15.114:3300/0 conn(0x7fe9b80b2200 msgr2=0x7fe9b815d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:05.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fe9bd7c9700 1 --2- 172.21.15.114:0/3808854906 >> v2:172.21.15.114:3300/0 conn(0x7fe9b80b2200 0x7fe9b815d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fe9bd7c9700 1 -- 172.21.15.114:0/3808854906 >> v1:172.21.15.114:6789/0 conn(0x7fe9b80b5ae0 legacy=0x7fe9b8160ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fdeb086b700 1 -- 172.21.15.114:0/3569552948 shutdown_connections 2023-10-18T12:20:05.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fdeb086b700 1 --2- 172.21.15.114:0/3569552948 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdeac0b5ae0 0x7fdeac0b6aa0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fdeb086b700 1 --2- 172.21.15.114:0/3569552948 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdeac15cbd0 0x7fdeac0b6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fdeb086b700 1 -- 172.21.15.114:0/3569552948 >> 172.21.15.114:0/3569552948 conn(0x7fdeac06f450 msgr2=0x7fdeac06f860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:05.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7f8fbdf90700 1 -- start start 2023-10-18T12:20:05.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7f03b8c0b700 1 -- 172.21.15.114:0/3164012623 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a4004230 con 0x7f03b40adb60 2023-10-18T12:20:05.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fe9bd7c9700 1 -- 172.21.15.114:0/3808854906 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b8161600 con 0x7fe9b8070460 2023-10-18T12:20:05.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fe9bcfc8700 1 --2- 172.21.15.114:0/3808854906 >> v2:172.21.15.114:3300/0 conn(0x7fe9b80b2200 0x7fe9b815d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:05.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7f03b8c0b700 1 -- 172.21.15.114:0/3164012623 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a4004390 con 0x7f03b40adb60 2023-10-18T12:20:05.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7f03b8c0b700 1 -- 172.21.15.114:0/3164012623 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a4004230 con 0x7f03b40adb60 2023-10-18T12:20:05.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fcaf9d9b700 1 --2- 172.21.15.114:0/581179885 >> v2:172.21.15.114:3300/0 conn(0x7fcafc15aea0 0x7fcafc06f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fdeb086b700 1 -- 172.21.15.114:0/3569552948 shutdown_connections 2023-10-18T12:20:05.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fdeb086b700 1 -- 172.21.15.114:0/3569552948 wait complete. 2023-10-18T12:20:05.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fcafa59c700 1 -- 172.21.15.114:0/581179885 >> v2:172.21.15.114:3300/0 conn(0x7fcafc15aea0 msgr2=0x7fcafc06f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:05.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fcafa59c700 1 --2- 172.21.15.114:0/581179885 >> v2:172.21.15.114:3300/0 conn(0x7fcafc15aea0 0x7fcafc06f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fcafa59c700 1 -- 172.21.15.114:0/581179885 >> v1:172.21.15.114:6789/0 conn(0x7fcafc0cb8a0 legacy=0x7fcafc0b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fcafa59c700 1 -- 172.21.15.114:0/581179885 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcafc15b9a0 con 0x7fcafc1441e0 2023-10-18T12:20:05.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fc30f59e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3080070d0 0x7fc3080dea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fc30f59e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc30803a9b0 0x7fc3080d1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fc30f59e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3080e6ea0 0x7fc3080dbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fc30f59e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3080dcf70 con 0x7fc3080070d0 2023-10-18T12:20:05.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fc30f59e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3080d1790 con 0x7fc3080e6ea0 2023-10-18T12:20:05.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fc30f59e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3080dc2f0 con 0x7fc30803a9b0 2023-10-18T12:20:05.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fc30e59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3080070d0 0x7fc3080dea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fe9bd7c9700 1 --2- 172.21.15.114:0/3808854906 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9b8070460 0x7fe9b8070910 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac009850 tx=0x7fe9ac009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bee1b5aead5e4cb server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:05.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fcafa59c700 1 --2- 172.21.15.114:0/581179885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcafc1441e0 0x7fcafc0b3830 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcafc06f1d0 tx=0x7fcaf4009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=669b6ea3328d159c server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:05.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7f03bbe71700 1 -- 172.21.15.114:0/3164012623 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f03b40adb60 msgr2=0x7f03b40cb190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7f03bbe71700 1 --2- 172.21.15.114:0/3164012623 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f03b40adb60 0x7f03b40cb190 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f03a4009800 tx=0x7f03a4009b10 comp rx=0 tx=0).stop 2023-10-18T12:20:05.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fc30e59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3080070d0 0x7fc3080dea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56584/0 (socket says 172.21.15.114:56584) 2023-10-18T12:20:05.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fc30e59c700 1 -- 172.21.15.114:0/943579326 learned_addr learned my addr 172.21.15.114:0/943579326 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:05.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fc30dd9b700 1 --2- 172.21.15.114:0/943579326 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc30803a9b0 0x7fc3080d1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fc30ed9d700 1 --2- 172.21.15.114:0/943579326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3080e6ea0 0x7fc3080dbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7f8fbdf90700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fb00e1290 0x7f8fb0178490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7f03bbe71700 1 -- 172.21.15.114:0/3164012623 shutdown_connections 2023-10-18T12:20:05.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7f03bbe71700 1 --2- 172.21.15.114:0/3164012623 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f03b40adb60 0x7f03b40cb190 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7f03bbe71700 1 -- 172.21.15.114:0/3164012623 >> 172.21.15.114:0/3164012623 conn(0x7f03b406a340 msgr2=0x7f03b40b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:05.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fe9b77fe700 1 -- 172.21.15.114:0/3808854906 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac011830 con 0x7fe9b8070460 2023-10-18T12:20:05.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7f8fbdf90700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fb00e1670 0x7f8fb00c9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7f8fbdf90700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fb0036b40 0x7f8fb0009500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7f8fbdf90700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb00cfa60 con 0x7f8fb00e1290 2023-10-18T12:20:05.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7f8fbdf90700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb00cb710 con 0x7f8fb0036b40 2023-10-18T12:20:05.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7f8fbdf90700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb01789d0 con 0x7f8fb00e1670 2023-10-18T12:20:05.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fc30e59c700 1 -- 172.21.15.114:0/943579326 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc30803a9b0 msgr2=0x7fc3080d1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fc30e59c700 1 --2- 172.21.15.114:0/943579326 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc30803a9b0 0x7fc3080d1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fe9b77fe700 1 -- 172.21.15.114:0/3808854906 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ac011990 con 0x7fe9b8070460 2023-10-18T12:20:05.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fe9b77fe700 1 -- 172.21.15.114:0/3808854906 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac011d20 con 0x7fe9b8070460 2023-10-18T12:20:05.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7f03bbe71700 1 -- 172.21.15.114:0/3164012623 shutdown_connections 2023-10-18T12:20:05.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7f8fb7fff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fb00e1670 0x7f8fb00c9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fc30e59c700 1 -- 172.21.15.114:0/943579326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3080e6ea0 msgr2=0x7fc3080dbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7f8fb7fff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fb00e1670 0x7f8fb00c9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.114:57984/0 (socket says 172.21.15.114:57984) 2023-10-18T12:20:05.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7f8fb7fff700 1 -- 172.21.15.114:0/1235250967 learned_addr learned my addr 172.21.15.114:0/1235250967 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:05.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7f8fbcf8e700 1 --2- 172.21.15.114:0/1235250967 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fb00e1290 0x7f8fb0178490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7f8fbd78f700 1 --2- 172.21.15.114:0/1235250967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fb0036b40 0x7f8fb0009500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fc30e59c700 1 --2- 172.21.15.114:0/943579326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3080e6ea0 0x7fc3080dbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7f03bbe71700 1 -- 172.21.15.114:0/3164012623 wait complete. 2023-10-18T12:20:05.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fcaf959a700 1 -- 172.21.15.114:0/581179885 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf400b8a0 con 0x7fcafc1441e0 2023-10-18T12:20:05.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fcaf959a700 1 -- 172.21.15.114:0/581179885 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf400ba00 con 0x7fcafc1441e0 2023-10-18T12:20:05.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fcaf959a700 1 -- 172.21.15.114:0/581179885 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf400bd70 con 0x7fcafc1441e0 2023-10-18T12:20:05.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fc30e59c700 1 -- 172.21.15.114:0/943579326 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3080dc5d0 con 0x7fc3080070d0 2023-10-18T12:20:05.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7fc30ed9d700 1 --2- 172.21.15.114:0/943579326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3080e6ea0 0x7fc3080dbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:20:05.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7f0f4d89d700 1 --2- 172.21.15.114:0/2837870788 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f4815b590 0x7f0f480b16d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0f4806d3b0 tx=0x7f0f40009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b68b604e16a8065 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:05.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7f0f4c89b700 1 -- 172.21.15.114:0/2837870788 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4000b8a0 con 0x7f0f4815b590 2023-10-18T12:20:05.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7f0f4c89b700 1 -- 172.21.15.114:0/2837870788 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4000ba00 con 0x7f0f4815b590 2023-10-18T12:20:05.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7f0f4c89b700 1 -- 172.21.15.114:0/2837870788 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4000bd90 con 0x7f0f4815b590 2023-10-18T12:20:05.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fe9bdfca700 1 -- 172.21.15.114:0/3808854906 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9b8070460 msgr2=0x7fe9b8070910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.313+0000 7fe9bdfca700 1 --2- 172.21.15.114:0/3808854906 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9b8070460 0x7fe9b8070910 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac009850 tx=0x7fe9ac009b60 comp rx=0 tx=0).stop 2023-10-18T12:20:05.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7fe9bdfca700 1 -- 172.21.15.114:0/3808854906 shutdown_connections 2023-10-18T12:20:05.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7fe9bdfca700 1 --2- 172.21.15.114:0/3808854906 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9b8070460 0x7fe9b8070910 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7fe9bdfca700 1 --2- 172.21.15.114:0/3808854906 >> v2:172.21.15.114:3300/0 conn(0x7fe9b80b2200 0x7fe9b815d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7fe9bdfca700 1 -- 172.21.15.114:0/3808854906 >> 172.21.15.114:0/3808854906 conn(0x7fe9b80d2a70 msgr2=0x7fe9b80d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:05.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7fe9bdfca700 1 -- 172.21.15.114:0/3808854906 shutdown_connections 2023-10-18T12:20:05.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7f8fb7fff700 1 -- 172.21.15.114:0/1235250967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fb0036b40 msgr2=0x7f8fb0009500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7f8fb7fff700 1 --2- 172.21.15.114:0/1235250967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fb0036b40 0x7f8fb0009500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7f8fb7fff700 1 -- 172.21.15.114:0/1235250967 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fb00e1290 msgr2=0x7f8fb0178490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7f8fb7fff700 1 --2- 172.21.15.114:0/1235250967 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fb00e1290 0x7f8fb0178490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7f8fb7fff700 1 -- 172.21.15.114:0/1235250967 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fac009570 con 0x7f8fb00e1670 2023-10-18T12:20:05.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7fdeb086b700 1 Processor -- start 2023-10-18T12:20:05.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7f8fb7fff700 1 --2- 172.21.15.114:0/1235250967 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fb00e1670 0x7f8fb00c9680 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8068820 tx=0x7f8fb8073820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:05.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7fc30e59c700 1 --2- 172.21.15.114:0/943579326 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3080070d0 0x7fc3080dea80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc30000c4d0 tx=0x7fc30000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:05.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7fe9bdfca700 1 -- 172.21.15.114:0/3808854906 wait complete. 2023-10-18T12:20:05.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7fdeb086b700 1 -- start start 2023-10-18T12:20:05.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7f8fb57fa700 1 -- 172.21.15.114:0/1235250967 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb80722e0 con 0x7f8fb00e1670 2023-10-18T12:20:05.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7f8fb57fa700 1 -- 172.21.15.114:0/1235250967 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb808d070 con 0x7f8fb00e1670 2023-10-18T12:20:05.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7f8fb57fa700 1 -- 172.21.15.114:0/1235250967 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb80729f0 con 0x7f8fb00e1670 2023-10-18T12:20:05.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7f8fbdf90700 1 -- 172.21.15.114:0/1235250967 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fb0037090 con 0x7f8fb00e1670 2023-10-18T12:20:05.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7fcafb59e700 1 -- 172.21.15.114:0/581179885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcafc1441e0 msgr2=0x7fcafc0b3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7f03bbe71700 1 Processor -- start 2023-10-18T12:20:05.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7f8fbdf90700 1 -- 172.21.15.114:0/1235250967 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb004e170 con 0x7f8fb00e1670 2023-10-18T12:20:05.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7f03bbe71700 1 -- start start 2023-10-18T12:20:05.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7fcafb59e700 1 --2- 172.21.15.114:0/581179885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcafc1441e0 0x7fcafc0b3830 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcafc06f1d0 tx=0x7fcaf4009bf0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7fcafb59e700 1 -- 172.21.15.114:0/581179885 shutdown_connections 2023-10-18T12:20:05.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7fcafb59e700 1 --2- 172.21.15.114:0/581179885 >> v2:172.21.15.114:3300/0 conn(0x7fcafc15aea0 0x7fcafc06f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7fcafb59e700 1 --2- 172.21.15.114:0/581179885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcafc1441e0 0x7fcafc0b3830 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7fcafb59e700 1 -- 172.21.15.114:0/581179885 >> 172.21.15.114:0/581179885 conn(0x7fcafc0b0bf0 msgr2=0x7fcafc0ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:05.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7fcafb59e700 1 -- 172.21.15.114:0/581179885 shutdown_connections 2023-10-18T12:20:05.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7f0f4e89f700 1 -- 172.21.15.114:0/2837870788 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f4815b590 msgr2=0x7f0f480b16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7f0f4e89f700 1 --2- 172.21.15.114:0/2837870788 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f4815b590 0x7f0f480b16d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0f4806d3b0 tx=0x7f0f40009bf0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7f6c17211700 1 Processor -- start 2023-10-18T12:20:05.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7f03bbe71700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f03b40adb60 0x7f03b41625f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7fcafb59e700 1 -- 172.21.15.114:0/581179885 wait complete. 2023-10-18T12:20:05.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7f03bbe71700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03b40cb6d0 0x7f03b4162b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7f8fbdf90700 1 -- 172.21.15.114:0/1235250967 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fb0005840 con 0x7f8fb00e1670 2023-10-18T12:20:05.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7f03bbe71700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03b4161230 0x7f03b40cda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7f03b9c0d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f03b40adb60 0x7f03b41625f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7f03bbe71700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b40b2a60 con 0x7f03b40cb6d0 2023-10-18T12:20:05.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7f03bbe71700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b40ad450 con 0x7f03b4161230 2023-10-18T12:20:05.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7f03bbe71700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b40b2130 con 0x7f03b40adb60 2023-10-18T12:20:05.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7f03b9c0d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f03b40adb60 0x7f03b41625f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.114:57990/0 (socket says 172.21.15.114:57990) 2023-10-18T12:20:05.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7f03b9c0d700 1 -- 172.21.15.114:0/2500210485 learned_addr learned my addr 172.21.15.114:0/2500210485 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:05.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7f6c17211700 1 -- start start 2023-10-18T12:20:05.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7fdeb086b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdeac0b1d10 0x7fdeac200080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7f0f4e89f700 1 -- 172.21.15.114:0/2837870788 shutdown_connections 2023-10-18T12:20:05.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7f0f4e89f700 1 --2- 172.21.15.114:0/2837870788 >> v2:172.21.15.172:3300/0 conn(0x7f0f480b2130 0x7f0f480b25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7f0f4e89f700 1 --2- 172.21.15.114:0/2837870788 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f4815b590 0x7f0f480b16d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7f0f4e89f700 1 -- 172.21.15.114:0/2837870788 >> 172.21.15.114:0/2837870788 conn(0x7f0f480ce660 msgr2=0x7f0f480cea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:05.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7fe9bdfca700 1 Processor -- start 2023-10-18T12:20:05.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7f03b940c700 1 --2- 172.21.15.114:0/2500210485 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03b40cb6d0 0x7f03b4162b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7fc2feffd700 1 -- 172.21.15.114:0/943579326 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc300005d90 con 0x7fc3080070d0 2023-10-18T12:20:05.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7fc2feffd700 1 -- 172.21.15.114:0/943579326 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30000ce80 con 0x7fc3080070d0 2023-10-18T12:20:05.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7fc2feffd700 1 -- 172.21.15.114:0/943579326 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3000072f0 con 0x7fc3080070d0 2023-10-18T12:20:05.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7fdeb086b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdeac0b5ae0 0x7fdeac14d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7fc30f59e700 1 -- 172.21.15.114:0/943579326 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3080dc8b0 con 0x7fc3080070d0 2023-10-18T12:20:05.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.317+0000 7fc30f59e700 1 -- 172.21.15.114:0/943579326 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3080dbfe0 con 0x7fc3080070d0 2023-10-18T12:20:05.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7fdeb086b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdeac15cbd0 0x7fdeac1fecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7fdeb086b700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac14eb80 con 0x7fdeac15cbd0 2023-10-18T12:20:05.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7fdeab7fe700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdeac0b1d10 0x7fdeac200080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7fdeab7fe700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdeac0b1d10 0x7fdeac200080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.114:57994/0 (socket says 172.21.15.114:57994) 2023-10-18T12:20:05.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7fdeab7fe700 1 -- 172.21.15.114:0/2215539240 learned_addr learned my addr 172.21.15.114:0/2215539240 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:05.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7fdeb086b700 1 -- 172.21.15.114:0/2215539240 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac14df00 con 0x7fdeac0b5ae0 2023-10-18T12:20:05.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7f03ba40e700 1 --2- 172.21.15.114:0/2500210485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03b4161230 0x7f03b40cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7f0f4e89f700 1 -- 172.21.15.114:0/2837870788 shutdown_connections 2023-10-18T12:20:05.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7fdeb086b700 1 -- 172.21.15.114:0/2215539240 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeac14e1e0 con 0x7fdeac0b1d10 2023-10-18T12:20:05.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7fcafb59e700 1 Processor -- start 2023-10-18T12:20:05.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7fcafb59e700 1 -- start start 2023-10-18T12:20:05.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7fdeaaffd700 1 --2- 172.21.15.114:0/2215539240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdeac0b5ae0 0x7fdeac14d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7f8fb57fa700 1 -- 172.21.15.114:0/1235250967 <== mon.2 v2:172.21.15.172:3301/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f8fb8072b50 con 0x7f8fb00e1670 2023-10-18T12:20:05.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7f03b940c700 1 -- 172.21.15.114:0/2500210485 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f03b40adb60 msgr2=0x7f03b41625f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7f03b940c700 1 --2- 172.21.15.114:0/2500210485 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f03b40adb60 0x7f03b41625f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7f0f4e89f700 1 -- 172.21.15.114:0/2837870788 wait complete. 2023-10-18T12:20:05.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7f6c17211700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6c100b7dd0 0x7f6c1006f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7f03b940c700 1 -- 172.21.15.114:0/2500210485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03b4161230 msgr2=0x7f03b40cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7f03b940c700 1 --2- 172.21.15.114:0/2500210485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03b4161230 0x7f03b40cda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7fc30f59e700 1 -- 172.21.15.114:0/943579326 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f4005310 con 0x7fc3080070d0 2023-10-18T12:20:05.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7fdeabfff700 1 --2- 172.21.15.114:0/2215539240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdeac15cbd0 0x7fdeac1fecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7fdeab7fe700 1 -- 172.21.15.114:0/2215539240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdeac0b5ae0 msgr2=0x7fdeac14d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7fdeab7fe700 1 --2- 172.21.15.114:0/2215539240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdeac0b5ae0 0x7fdeac14d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7fdeab7fe700 1 -- 172.21.15.114:0/2215539240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdeac15cbd0 msgr2=0x7fdeac1fecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7fdeab7fe700 1 --2- 172.21.15.114:0/2215539240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdeac15cbd0 0x7fdeac1fecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7fdeab7fe700 1 -- 172.21.15.114:0/2215539240 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea00094b0 con 0x7fdeac0b1d10 2023-10-18T12:20:05.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.325+0000 7fdeab7fe700 1 --2- 172.21.15.114:0/2215539240 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdeac0b1d10 0x7fdeac200080 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fde9c00e840 tx=0x7fde9c00eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:05.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7f8fb57fa700 1 --2- 172.21.15.114:0/1235250967 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8f9c0657c0 0x7f8f9c067c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7f8fb57fa700 1 -- 172.21.15.114:0/1235250967 <== mon.2 v2:172.21.15.172:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8fb80fc7a0 con 0x7f8fb00e1670 2023-10-18T12:20:05.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7f03b940c700 1 -- 172.21.15.114:0/2500210485 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a40094b0 con 0x7f03b40cb6d0 2023-10-18T12:20:05.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7f03b9c0d700 1 --2- 172.21.15.114:0/2500210485 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f03b40adb60 0x7f03b41625f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:20:05.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7f03ba40e700 1 --2- 172.21.15.114:0/2500210485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03b4161230 0x7f03b40cda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:20:05.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7f03b940c700 1 --2- 172.21.15.114:0/2500210485 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03b40cb6d0 0x7f03b4162b30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f03a4015000 tx=0x7f03a4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:05.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7f03aa7fc700 1 -- 172.21.15.114:0/2500210485 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a4011630 con 0x7f03b40cb6d0 2023-10-18T12:20:05.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7f03bbe71700 1 -- 172.21.15.114:0/2500210485 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03b40b2410 con 0x7f03b40cb6d0 2023-10-18T12:20:05.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7f03bbe71700 1 -- 172.21.15.114:0/2500210485 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03b4163160 con 0x7f03b40cb6d0 2023-10-18T12:20:05.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7f03aa7fc700 1 -- 172.21.15.114:0/2500210485 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a401f070 con 0x7f03b40cb6d0 2023-10-18T12:20:05.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7f03aa7fc700 1 -- 172.21.15.114:0/2500210485 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a4011a10 con 0x7f03b40cb6d0 2023-10-18T12:20:05.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7fcafb59e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcafc0cb8a0 0x7fcafc15db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7fcafb59e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcafc1441e0 0x7fcafc159c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7fcafb59e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcafc15aea0 0x7fcafc06de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7fcafb59e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcafc13b3e0 con 0x7fcafc15aea0 2023-10-18T12:20:05.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7fcafb59e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcafc13a340 con 0x7fcafc1441e0 2023-10-18T12:20:05.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7fcafb59e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcafc13a620 con 0x7fcafc0cb8a0 2023-10-18T12:20:05.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7fcafad9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcafc15aea0 0x7fcafc06de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7fcafad9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcafc15aea0 0x7fcafc06de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56610/0 (socket says 172.21.15.114:56610) 2023-10-18T12:20:05.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7fcafad9d700 1 -- 172.21.15.114:0/1985601031 learned_addr learned my addr 172.21.15.114:0/1985601031 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:05.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7fcaf9d9b700 1 --2- 172.21.15.114:0/1985601031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcafc1441e0 0x7fcafc159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7fcafa59c700 1 --2- 172.21.15.114:0/1985601031 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcafc0cb8a0 0x7fcafc15db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7fcafad9d700 1 -- 172.21.15.114:0/1985601031 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcafc0cb8a0 msgr2=0x7fcafc15db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7fcafad9d700 1 --2- 172.21.15.114:0/1985601031 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcafc0cb8a0 0x7fcafc15db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7fcafad9d700 1 -- 172.21.15.114:0/1985601031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcafc1441e0 msgr2=0x7fcafc159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7fcafad9d700 1 --2- 172.21.15.114:0/1985601031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcafc1441e0 0x7fcafc159c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7fcafad9d700 1 -- 172.21.15.114:0/1985601031 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf4009570 con 0x7fcafc15aea0 2023-10-18T12:20:05.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7fcafad9d700 1 --2- 172.21.15.114:0/1985601031 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcafc15aea0 0x7fcafc06de70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcae400c390 tx=0x7fcae400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:05.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7f6c17211700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6c1006fef0 0x7f6c1015d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7f6c17211700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c100b6930 con 0x7f6c10146650 2023-10-18T12:20:05.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7f6c17211700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c10070380 con 0x7f6c100b7dd0 2023-10-18T12:20:05.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7f6c17211700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c100b5d20 con 0x7f6c1006fef0 2023-10-18T12:20:05.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7f6c157ae700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6c1006fef0 0x7f6c1015d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7f6c157ae700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6c1006fef0 0x7f6c1015d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.114:58004/0 (socket says 172.21.15.114:58004) 2023-10-18T12:20:05.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7f6c157ae700 1 -- 172.21.15.114:0/3484704743 learned_addr learned my addr 172.21.15.114:0/3484704743 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:05.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7f6c0ffff700 1 --2- 172.21.15.114:0/3484704743 >> v2:172.21.15.114:3300/0 conn(0x7f6c100b7dd0 0x7f6c1006f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7f6c0ffff700 1 -- 172.21.15.114:0/3484704743 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6c1006fef0 msgr2=0x7f6c1015d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:05.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7f6c0ffff700 1 --2- 172.21.15.114:0/3484704743 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6c1006fef0 0x7f6c1015d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7f6c0ffff700 1 -- 172.21.15.114:0/3484704743 >> v1:172.21.15.114:6789/0 conn(0x7f6c10146650 legacy=0x7f6c100b76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:05.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7f6c0ffff700 1 -- 172.21.15.114:0/3484704743 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c100b6000 con 0x7f6c100b7dd0 2023-10-18T12:20:05.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.325+0000 7f6c0ffff700 1 --2- 172.21.15.114:0/3484704743 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c100b7dd0 0x7f6c1006f9b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6c00009d90 tx=0x7f6c0000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=454f28f00ad5f311 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:05.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.325+0000 7f6c0f7fe700 1 -- 172.21.15.114:0/3484704743 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0000e070 con 0x7f6c100b7dd0 2023-10-18T12:20:05.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.325+0000 7f6c0f7fe700 1 -- 172.21.15.114:0/3484704743 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0000bae0 con 0x7f6c100b7dd0 2023-10-18T12:20:05.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.325+0000 7f6c0f7fe700 1 -- 172.21.15.114:0/3484704743 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0000be90 con 0x7f6c100b7dd0 2023-10-18T12:20:05.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.325+0000 7f03bbe71700 1 -- 172.21.15.114:0/2500210485 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f039c005310 con 0x7f03b40cb6d0 2023-10-18T12:20:05.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.325+0000 7f8fbcf8e700 1 --2- 172.21.15.114:0/1235250967 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8f9c0657c0 0x7f8f9c067c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.325+0000 7fcaf2ffd700 1 -- 172.21.15.114:0/1985601031 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae40052d0 con 0x7fcafc15aea0 2023-10-18T12:20:05.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.325+0000 7fcaf2ffd700 1 -- 172.21.15.114:0/1985601031 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae4005430 con 0x7fcafc15aea0 2023-10-18T12:20:05.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.325+0000 7fcafb59e700 1 -- 172.21.15.114:0/1985601031 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcafc13a900 con 0x7fcafc15aea0 2023-10-18T12:20:05.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.325+0000 7fcafb59e700 1 -- 172.21.15.114:0/1985601031 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcafc13aec0 con 0x7fcafc15aea0 2023-10-18T12:20:05.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.325+0000 7fcaf2ffd700 1 -- 172.21.15.114:0/1985601031 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae40055a0 con 0x7fcafc15aea0 2023-10-18T12:20:05.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.325+0000 7f8fbcf8e700 1 --2- 172.21.15.114:0/1235250967 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8f9c0657c0 0x7f8f9c067c80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8fac000c00 tx=0x7f8fac01d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:05.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.321+0000 7fe9bdfca700 1 -- start start 2023-10-18T12:20:05.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.325+0000 7fe9bdfca700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9b8070460 0x7fe9b808bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.325+0000 7fe9bdfca700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9b80b2200 0x7fe9b814c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.325+0000 7fe9bdfca700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9b80b5ae0 0x7fe9b814ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.325+0000 7fe9bdfca700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b808b0c0 con 0x7fe9b80b5ae0 2023-10-18T12:20:05.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.325+0000 7fe9bdfca700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b808ade0 con 0x7fe9b80b2200 2023-10-18T12:20:05.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.325+0000 7f6c17211700 1 -- 172.21.15.114:0/3484704743 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c100b7dd0 msgr2=0x7f6c1006f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.325+0000 7f6c17211700 1 --2- 172.21.15.114:0/3484704743 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c100b7dd0 0x7f6c1006f9b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6c00009d90 tx=0x7f6c0000b330 comp rx=0 tx=0).stop 2023-10-18T12:20:05.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.325+0000 7fe9bdfca700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b81542e0 con 0x7fe9b8070460 2023-10-18T12:20:05.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.325+0000 7fe9bcfc8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9b8070460 0x7fe9b808bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.325+0000 7fe9bcfc8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9b8070460 0x7fe9b808bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.114:58026/0 (socket says 172.21.15.114:58026) 2023-10-18T12:20:05.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.325+0000 7fe9bcfc8700 1 -- 172.21.15.114:0/376769629 learned_addr learned my addr 172.21.15.114:0/376769629 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:05.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.325+0000 7fe9b7fff700 1 --2- 172.21.15.114:0/376769629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9b80b2200 0x7fe9b814c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.325+0000 7fe9bcfc8700 1 -- 172.21.15.114:0/376769629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9b80b2200 msgr2=0x7fe9b814c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.325+0000 7fe9bcfc8700 1 --2- 172.21.15.114:0/376769629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9b80b2200 0x7fe9b814c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.325+0000 7fe9bcfc8700 1 -- 172.21.15.114:0/376769629 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9b80b5ae0 msgr2=0x7fe9b814ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.325+0000 7fe9bcfc8700 1 --2- 172.21.15.114:0/376769629 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9b80b5ae0 0x7fe9b814ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.325+0000 7fe9bcfc8700 1 -- 172.21.15.114:0/376769629 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ac0094b0 con 0x7fe9b8070460 2023-10-18T12:20:05.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.325+0000 7f0f4e89f700 1 Processor -- start 2023-10-18T12:20:05.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.325+0000 7f03aa7fc700 1 -- 172.21.15.114:0/2500210485 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f03a4021030 con 0x7f03b40cb6d0 2023-10-18T12:20:05.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.325+0000 7fc2feffd700 1 -- 172.21.15.114:0/943579326 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fc300007450 con 0x7fc3080070d0 2023-10-18T12:20:05.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.325+0000 7fcafb59e700 1 -- 172.21.15.114:0/1985601031 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcae0005310 con 0x7fcafc15aea0 2023-10-18T12:20:05.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.325+0000 7f0f4e89f700 1 -- start start 2023-10-18T12:20:05.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.325+0000 7fe9bcfc8700 1 --2- 172.21.15.114:0/376769629 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9b8070460 0x7fe9b808bf30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0009fc0 tx=0x7fe9b000d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:05.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.325+0000 7f6c17211700 1 -- 172.21.15.114:0/3484704743 shutdown_connections 2023-10-18T12:20:05.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.325+0000 7f6c17211700 1 --2- 172.21.15.114:0/3484704743 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6c1006fef0 0x7f6c1015d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.325+0000 7f6c17211700 1 --2- 172.21.15.114:0/3484704743 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c100b7dd0 0x7f6c1006f9b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.325+0000 7f6c17211700 1 -- 172.21.15.114:0/3484704743 >> 172.21.15.114:0/3484704743 conn(0x7f6c1006a130 msgr2=0x7f6c1006a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:05.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.325+0000 7f6c17211700 1 -- 172.21.15.114:0/3484704743 shutdown_connections 2023-10-18T12:20:05.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.325+0000 7f6c17211700 1 -- 172.21.15.114:0/3484704743 wait complete. 2023-10-18T12:20:05.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7fc2feffd700 1 --2- 172.21.15.114:0/943579326 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc2f00657c0 0x7fc2f0067c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7f0f4e89f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f480b2130 0x7f0f48159720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7f0f4e89f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f4815b590 0x7f0f4815c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7f0f4e89f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0f48164b70 0x7f0f480a7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7f0f4e89f700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4815ef20 con 0x7f0f480b2130 2023-10-18T12:20:05.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7f0f4e89f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4815d640 con 0x7f0f4815b590 2023-10-18T12:20:05.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7f0f4e89f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f48159c60 con 0x7f0f48164b70 2023-10-18T12:20:05.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7f0f4d89d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f480b2130 0x7f0f48159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7fc30dd9b700 1 --2- 172.21.15.114:0/943579326 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc2f00657c0 0x7fc2f0067c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7f0f4d89d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f480b2130 0x7f0f48159720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56624/0 (socket says 172.21.15.114:56624) 2023-10-18T12:20:05.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7f0f4d89d700 1 -- 172.21.15.114:0/1295796350 learned_addr learned my addr 172.21.15.114:0/1295796350 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:05.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7f0f4d09c700 1 --2- 172.21.15.114:0/1295796350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f4815b590 0x7f0f4815c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7fcaf2ffd700 1 -- 172.21.15.114:0/1985601031 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fcae40036a0 con 0x7fcafc15aea0 2023-10-18T12:20:05.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7f0f4e09e700 1 --2- 172.21.15.114:0/1295796350 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0f48164b70 0x7f0f480a7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7fc2feffd700 1 -- 172.21.15.114:0/943579326 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc300082440 con 0x7fc3080070d0 2023-10-18T12:20:05.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7f03aa7fc700 1 --2- 172.21.15.114:0/2500210485 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f03980657c0 0x7f0398067c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7f03aa7fc700 1 -- 172.21.15.114:0/2500210485 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f03a4084bc0 con 0x7f03b40cb6d0 2023-10-18T12:20:05.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7f6c17211700 1 Processor -- start 2023-10-18T12:20:05.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7f0f4e09e700 1 -- 172.21.15.114:0/1295796350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f4815b590 msgr2=0x7f0f4815c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7f0f4e09e700 1 --2- 172.21.15.114:0/1295796350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f4815b590 0x7f0f4815c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7f0f4e09e700 1 -- 172.21.15.114:0/1295796350 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f480b2130 msgr2=0x7f0f48159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7f0f4e09e700 1 --2- 172.21.15.114:0/1295796350 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f480b2130 0x7f0f48159720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7f0f4e09e700 1 -- 172.21.15.114:0/1295796350 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f40009570 con 0x7f0f48164b70 2023-10-18T12:20:05.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7f0f4d89d700 1 --2- 172.21.15.114:0/1295796350 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f480b2130 0x7f0f48159720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:20:05.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7fc30dd9b700 1 --2- 172.21.15.114:0/943579326 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc2f00657c0 0x7fc2f0067c80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc3080061c0 tx=0x7fc304007ee0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:05.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7f6c17211700 1 -- start start 2023-10-18T12:20:05.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7f0f4e09e700 1 --2- 172.21.15.114:0/1295796350 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0f48164b70 0x7f0f480a7bc0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0f4400cae0 tx=0x7f0f4400cdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:05.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7f03b9c0d700 1 --2- 172.21.15.114:0/2500210485 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f03980657c0 0x7f0398067c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7fcaf2ffd700 1 --2- 172.21.15.114:0/1985601031 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fcadc065740 0x7fcadc067c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7f03b9c0d700 1 --2- 172.21.15.114:0/2500210485 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f03980657c0 0x7f0398067c80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f03b0001370 tx=0x7f03b0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:05.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7f6c17211700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c1006fef0 0x7f6c10158a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7f6c17211700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c100b7dd0 0x7f6c10155b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7f6c17211700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6c10146650 0x7f6c10154230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7fcafa59c700 1 --2- 172.21.15.114:0/1985601031 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fcadc065740 0x7fcadc067c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7f0f3e7fc700 1 -- 172.21.15.114:0/1295796350 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4400a9e0 con 0x7f0f48164b70 2023-10-18T12:20:05.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7fde93fff700 1 -- 172.21.15.114:0/2215539240 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c0095a0 con 0x7fdeac0b1d10 2023-10-18T12:20:05.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7f0f4e89f700 1 -- 172.21.15.114:0/1295796350 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f4815d080 con 0x7f0f48164b70 2023-10-18T12:20:05.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7fe9b57fa700 1 -- 172.21.15.114:0/376769629 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b000de90 con 0x7fe9b8070460 2023-10-18T12:20:05.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7fe9b57fa700 1 -- 172.21.15.114:0/376769629 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9b0003a40 con 0x7fe9b8070460 2023-10-18T12:20:05.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7fe9b57fa700 1 -- 172.21.15.114:0/376769629 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9b0003dd0 con 0x7fe9b8070460 2023-10-18T12:20:05.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7fe9bdfca700 1 -- 172.21.15.114:0/376769629 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9b81545c0 con 0x7fe9b8070460 2023-10-18T12:20:05.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7f0f3e7fc700 1 -- 172.21.15.114:0/1295796350 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4400ab40 con 0x7f0f48164b70 2023-10-18T12:20:05.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7f0f3e7fc700 1 -- 172.21.15.114:0/1295796350 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f44007070 con 0x7f0f48164b70 2023-10-18T12:20:05.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.333+0000 7f8fb57fa700 1 -- 172.21.15.114:0/1235250967 <== mon.2 v2:172.21.15.172:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f8fb80c9f50 con 0x7f8fb00e1670 2023-10-18T12:20:05.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7f0f4e89f700 1 -- 172.21.15.114:0/1295796350 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f4815ebb0 con 0x7f0f48164b70 2023-10-18T12:20:05.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.333+0000 7fe9bdfca700 1 -- 172.21.15.114:0/376769629 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9b808c470 con 0x7fe9b8070460 2023-10-18T12:20:05.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.333+0000 7fde93fff700 1 -- 172.21.15.114:0/2215539240 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde9c013680 con 0x7fdeac0b1d10 2023-10-18T12:20:05.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7f6c17211700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c10154a80 con 0x7f6c100b7dd0 2023-10-18T12:20:05.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7f6c17211700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c10154d60 con 0x7f6c1006fef0 2023-10-18T12:20:05.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7f6c17211700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c10155040 con 0x7f6c10146650 2023-10-18T12:20:05.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7f6c0ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c100b7dd0 0x7f6c10155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7f6c157ae700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6c10146650 0x7f6c10154230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7f6c0ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c100b7dd0 0x7f6c10155b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56626/0 (socket says 172.21.15.114:56626) 2023-10-18T12:20:05.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7f6c0ffff700 1 -- 172.21.15.114:0/3388438894 learned_addr learned my addr 172.21.15.114:0/3388438894 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:05.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.329+0000 7f6c14fad700 1 --2- 172.21.15.114:0/3388438894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c1006fef0 0x7f6c10158a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.333+0000 7f6c0ffff700 1 -- 172.21.15.114:0/3388438894 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6c10146650 msgr2=0x7f6c10154230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.333+0000 7f6c0ffff700 1 --2- 172.21.15.114:0/3388438894 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6c10146650 0x7f6c10154230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.333+0000 7f6c0ffff700 1 -- 172.21.15.114:0/3388438894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c1006fef0 msgr2=0x7f6c10158a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.333+0000 7f6c0ffff700 1 --2- 172.21.15.114:0/3388438894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c1006fef0 0x7f6c10158a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.333+0000 7f6c0ffff700 1 -- 172.21.15.114:0/3388438894 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c00009a70 con 0x7f6c100b7dd0 2023-10-18T12:20:05.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.333+0000 7fdeb086b700 1 -- 172.21.15.114:0/2215539240 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeac14e4c0 con 0x7fdeac0b1d10 2023-10-18T12:20:05.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.333+0000 7fde93fff700 1 -- 172.21.15.114:0/2215539240 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c0139f0 con 0x7fdeac0b1d10 2023-10-18T12:20:05.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.333+0000 7fcafa59c700 1 --2- 172.21.15.114:0/1985601031 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fcadc065740 0x7fcadc067c00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcafc06f1d0 tx=0x7fcaf4008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:05.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.333+0000 7f6c14fad700 1 --2- 172.21.15.114:0/3388438894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c1006fef0 0x7f6c10158a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:20:05.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.333+0000 7f6c0ffff700 1 --2- 172.21.15.114:0/3388438894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c100b7dd0 0x7f6c10155b20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6c0000b370 tx=0x7f6c00004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:05.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.333+0000 7fdeb086b700 1 -- 172.21.15.114:0/2215539240 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeac14dba0 con 0x7fdeac0b1d10 2023-10-18T12:20:05.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.333+0000 7fe9bdfca700 1 -- 172.21.15.114:0/376769629 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9b80d2870 con 0x7fe9b8070460 2023-10-18T12:20:05.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.333+0000 7f0f4e89f700 1 -- 172.21.15.114:0/1295796350 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f48070d30 con 0x7f0f48164b70 2023-10-18T12:20:05.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.333+0000 7f0f3e7fc700 1 -- 172.21.15.114:0/1295796350 <== mon.2 v2:172.21.15.172:3301/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f0f440071d0 con 0x7f0f48164b70 2023-10-18T12:20:05.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.333+0000 7fdeb086b700 1 -- 172.21.15.114:0/2215539240 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeac0b58d0 con 0x7fdeac0b1d10 2023-10-18T12:20:05.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.333+0000 7fcaf2ffd700 1 -- 172.21.15.114:0/1985601031 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcae4054240 con 0x7fcafc15aea0 2023-10-18T12:20:05.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.337+0000 7fde93fff700 1 -- 172.21.15.114:0/2215539240 <== mon.2 v2:172.21.15.172:3301/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fde9c013b50 con 0x7fdeac0b1d10 2023-10-18T12:20:05.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.337+0000 7f03aa7fc700 1 -- 172.21.15.114:0/2500210485 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f03a4052400 con 0x7f03b40cb6d0 2023-10-18T12:20:05.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.337+0000 7fe9b57fa700 1 -- 172.21.15.114:0/376769629 <== mon.2 v2:172.21.15.172:3301/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fe9b0004030 con 0x7fe9b8070460 2023-10-18T12:20:05.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.337+0000 7f0f3e7fc700 1 --2- 172.21.15.114:0/1295796350 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0f2c0656f0 0x7f0f2c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.337+0000 7f0f3e7fc700 1 -- 172.21.15.114:0/1295796350 <== mon.2 v2:172.21.15.172:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0f44082c80 con 0x7f0f48164b70 2023-10-18T12:20:05.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.337+0000 7f0f4d89d700 1 --2- 172.21.15.114:0/1295796350 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0f2c0656f0 0x7f0f2c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.337+0000 7fde93fff700 1 --2- 172.21.15.114:0/2215539240 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fde98065740 0x7fde98067c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.337+0000 7fe9b57fa700 1 --2- 172.21.15.114:0/376769629 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe9a40656f0 0x7fe9a4067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.337+0000 7fe9b57fa700 1 -- 172.21.15.114:0/376769629 <== mon.2 v2:172.21.15.172:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe9b00a52f0 con 0x7fe9b8070460 2023-10-18T12:20:05.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.337+0000 7fdeaaffd700 1 --2- 172.21.15.114:0/2215539240 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fde98065740 0x7fde98067c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.337+0000 7fe9b7fff700 1 --2- 172.21.15.114:0/376769629 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe9a40656f0 0x7fe9a4067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.337+0000 7fc2feffd700 1 -- 172.21.15.114:0/943579326 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fc30004fc80 con 0x7fc3080070d0 2023-10-18T12:20:05.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.337+0000 7fe9b7fff700 1 --2- 172.21.15.114:0/376769629 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe9a40656f0 0x7fe9a4067bb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe9b80cf6e0 tx=0x7fe9a8007f30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:05.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.337+0000 7fdeaaffd700 1 --2- 172.21.15.114:0/2215539240 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fde98065740 0x7fde98067c00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdea00090b0 tx=0x7fdea0008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:05.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.337+0000 7f0f4d89d700 1 --2- 172.21.15.114:0/1295796350 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0f2c0656f0 0x7f0f2c067bb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0f40009c30 tx=0x7f0f4001d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:05.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.341+0000 7f0f3e7fc700 1 -- 172.21.15.114:0/1295796350 <== mon.2 v2:172.21.15.172:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f0f44050460 con 0x7f0f48164b70 2023-10-18T12:20:05.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.345+0000 7f6c0d7fa700 1 -- 172.21.15.114:0/3388438894 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c000047f0 con 0x7f6c100b7dd0 2023-10-18T12:20:05.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.345+0000 7f6c0d7fa700 1 -- 172.21.15.114:0/3388438894 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c00004950 con 0x7f6c100b7dd0 2023-10-18T12:20:05.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.345+0000 7f6c0d7fa700 1 -- 172.21.15.114:0/3388438894 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c00012650 con 0x7f6c100b7dd0 2023-10-18T12:20:05.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.345+0000 7fcaf2ffd700 1 -- 172.21.15.114:0/1985601031 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fcae404fef0 con 0x7fcafc15aea0 2023-10-18T12:20:05.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.345+0000 7fde93fff700 1 -- 172.21.15.114:0/2215539240 <== mon.2 v2:172.21.15.172:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fde9c054250 con 0x7fdeac0b1d10 2023-10-18T12:20:05.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.345+0000 7fe9b57fa700 1 -- 172.21.15.114:0/376769629 <== mon.2 v2:172.21.15.172:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fe9b0072b60 con 0x7fe9b8070460 2023-10-18T12:20:05.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.345+0000 7f6c17211700 1 -- 172.21.15.114:0/3388438894 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c10155320 con 0x7f6c100b7dd0 2023-10-18T12:20:05.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.345+0000 7f6c17211700 1 -- 172.21.15.114:0/3388438894 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c10154770 con 0x7f6c100b7dd0 2023-10-18T12:20:05.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.345+0000 7f6c17211700 1 -- 172.21.15.114:0/3388438894 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c10156060 con 0x7f6c100b7dd0 2023-10-18T12:20:05.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.349+0000 7f6c0d7fa700 1 -- 172.21.15.114:0/3388438894 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f6c0002e420 con 0x7f6c100b7dd0 2023-10-18T12:20:05.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.349+0000 7f6c0d7fa700 1 --2- 172.21.15.114:0/3388438894 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6bf00657c0 0x7f6bf0067c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.349+0000 7f6c0d7fa700 1 -- 172.21.15.114:0/3388438894 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6c00085530 con 0x7f6c100b7dd0 2023-10-18T12:20:05.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.353+0000 7f6c14fad700 1 --2- 172.21.15.114:0/3388438894 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6bf00657c0 0x7f6bf0067c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.353+0000 7fde93fff700 1 -- 172.21.15.114:0/2215539240 <== mon.2 v2:172.21.15.172:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fde9c087060 con 0x7fdeac0b1d10 2023-10-18T12:20:05.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.353+0000 7f6c14fad700 1 --2- 172.21.15.114:0/3388438894 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6bf00657c0 0x7f6bf0067c80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6c08007fd0 tx=0x7f6c08009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:05.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.353+0000 7f6c0d7fa700 1 -- 172.21.15.114:0/3388438894 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f6c00056800 con 0x7f6c100b7dd0 2023-10-18T12:20:05.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.669+0000 7f8fbdf90700 1 -- 172.21.15.114:0/1235250967 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8fb0052d20 con 0x7f8fb00e1670 2023-10-18T12:20:05.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.673+0000 7f8fb57fa700 1 -- 172.21.15.114:0/1235250967 <== mon.2 v2:172.21.15.172:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8fb80cd570 con 0x7f8fb00e1670 2023-10-18T12:20:05.677 INFO:teuthology.orchestra.run.smithi114.stdout:55834574858 2023-10-18T12:20:05.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.677+0000 7f8fbdf90700 1 -- 172.21.15.114:0/1235250967 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8f9c0657c0 msgr2=0x7f8f9c067c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.677+0000 7f8fbdf90700 1 --2- 172.21.15.114:0/1235250967 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8f9c0657c0 0x7f8f9c067c80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8fac000c00 tx=0x7f8fac01d040 comp rx=0 tx=0).stop 2023-10-18T12:20:05.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.677+0000 7f8fbdf90700 1 -- 172.21.15.114:0/1235250967 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fb00e1670 msgr2=0x7f8fb00c9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.677+0000 7f8fbdf90700 1 --2- 172.21.15.114:0/1235250967 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fb00e1670 0x7f8fb00c9680 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8068820 tx=0x7f8fb8073820 comp rx=0 tx=0).stop 2023-10-18T12:20:05.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.677+0000 7f8fbdf90700 1 -- 172.21.15.114:0/1235250967 shutdown_connections 2023-10-18T12:20:05.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.677+0000 7f8fbdf90700 1 --2- 172.21.15.114:0/1235250967 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8f9c0657c0 0x7f8f9c067c80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.677+0000 7f8fbdf90700 1 --2- 172.21.15.114:0/1235250967 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fb00e1670 0x7f8fb00c9680 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.677+0000 7f8fbdf90700 1 --2- 172.21.15.114:0/1235250967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fb0036b40 0x7f8fb0009500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.677+0000 7f8fbdf90700 1 --2- 172.21.15.114:0/1235250967 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fb00e1290 0x7f8fb0178490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.677+0000 7f8fbdf90700 1 -- 172.21.15.114:0/1235250967 >> 172.21.15.114:0/1235250967 conn(0x7f8fb0053840 msgr2=0x7f8fb00dd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:05.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.677+0000 7f8fbdf90700 1 -- 172.21.15.114:0/1235250967 shutdown_connections 2023-10-18T12:20:05.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.677+0000 7f8fbdf90700 1 -- 172.21.15.114:0/1235250967 wait complete. 2023-10-18T12:20:05.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.685+0000 7fcafb59e700 1 -- 172.21.15.114:0/1985601031 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fcae0005890 con 0x7fcafc15aea0 2023-10-18T12:20:05.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.685+0000 7fcaf2ffd700 1 -- 172.21.15.114:0/1985601031 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcae4020090 con 0x7fcafc15aea0 2023-10-18T12:20:05.690 INFO:teuthology.orchestra.run.smithi114.stdout:55834574859 2023-10-18T12:20:05.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.689+0000 7fc30f59e700 1 -- 172.21.15.114:0/943579326 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc2f40055c0 con 0x7fc3080070d0 2023-10-18T12:20:05.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.689+0000 7fe9bdfca700 1 -- 172.21.15.114:0/376769629 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fe9b8154ae0 con 0x7fe9b8070460 2023-10-18T12:20:05.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.689+0000 7fc2feffd700 1 -- 172.21.15.114:0/943579326 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc3000532a0 con 0x7fc3080070d0 2023-10-18T12:20:05.693 INFO:teuthology.orchestra.run.smithi114.stdout:55834574857 2023-10-18T12:20:05.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.689+0000 7fe9b57fa700 1 -- 172.21.15.114:0/376769629 <== mon.2 v2:172.21.15.172:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe9b8154ae0 con 0x7fe9b8070460 2023-10-18T12:20:05.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.689+0000 7fcafb59e700 1 -- 172.21.15.114:0/1985601031 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fcadc065740 msgr2=0x7fcadc067c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.689+0000 7fcafb59e700 1 --2- 172.21.15.114:0/1985601031 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fcadc065740 0x7fcadc067c00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcafc06f1d0 tx=0x7fcaf4008030 comp rx=0 tx=0).stop 2023-10-18T12:20:05.695 INFO:teuthology.orchestra.run.smithi114.stdout:55834574860 2023-10-18T12:20:05.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.689+0000 7fcafb59e700 1 -- 172.21.15.114:0/1985601031 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcafc15aea0 msgr2=0x7fcafc06de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.689+0000 7fcafb59e700 1 --2- 172.21.15.114:0/1985601031 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcafc15aea0 0x7fcafc06de70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcae400c390 tx=0x7fcae400c6a0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.689+0000 7f03bbe71700 1 -- 172.21.15.114:0/2500210485 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f039c005890 con 0x7f03b40cb6d0 2023-10-18T12:20:05.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.689+0000 7fcafb59e700 1 -- 172.21.15.114:0/1985601031 shutdown_connections 2023-10-18T12:20:05.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.689+0000 7fcafb59e700 1 --2- 172.21.15.114:0/1985601031 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fcadc065740 0x7fcadc067c00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.689+0000 7fcafb59e700 1 --2- 172.21.15.114:0/1985601031 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcafc15aea0 0x7fcafc06de70 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.689+0000 7fcafb59e700 1 --2- 172.21.15.114:0/1985601031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcafc1441e0 0x7fcafc159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.689+0000 7f0f4e89f700 1 -- 172.21.15.114:0/1295796350 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0f4815f090 con 0x7f0f48164b70 2023-10-18T12:20:05.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.689+0000 7fcafb59e700 1 --2- 172.21.15.114:0/1985601031 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcafc0cb8a0 0x7fcafc15db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.689+0000 7fcafb59e700 1 -- 172.21.15.114:0/1985601031 >> 172.21.15.114:0/1985601031 conn(0x7fcafc0b0bf0 msgr2=0x7fcafc0ce490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:05.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.689+0000 7f03aa7fc700 1 -- 172.21.15.114:0/2500210485 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f03a4055a20 con 0x7f03b40cb6d0 2023-10-18T12:20:05.699 INFO:teuthology.orchestra.run.smithi114.stdout:55834574857 2023-10-18T12:20:05.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.689+0000 7fcafb59e700 1 -- 172.21.15.114:0/1985601031 shutdown_connections 2023-10-18T12:20:05.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.689+0000 7fcafb59e700 1 -- 172.21.15.114:0/1985601031 wait complete. 2023-10-18T12:20:05.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.693+0000 7f0f3e7fc700 1 -- 172.21.15.114:0/1295796350 <== mon.2 v2:172.21.15.172:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0f44017020 con 0x7f0f48164b70 2023-10-18T12:20:05.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.693+0000 7fc30f59e700 1 -- 172.21.15.114:0/943579326 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc2f00657c0 msgr2=0x7fc2f0067c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.693+0000 7fc30f59e700 1 --2- 172.21.15.114:0/943579326 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc2f00657c0 0x7fc2f0067c80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc3080061c0 tx=0x7fc304007ee0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.693+0000 7fc30f59e700 1 -- 172.21.15.114:0/943579326 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3080070d0 msgr2=0x7fc3080dea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.693+0000 7fc30f59e700 1 --2- 172.21.15.114:0/943579326 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3080070d0 0x7fc3080dea80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc30000c4d0 tx=0x7fc30000c7e0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.701 INFO:teuthology.orchestra.run.smithi114.stdout:55834574859 2023-10-18T12:20:05.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.693+0000 7fc30f59e700 1 -- 172.21.15.114:0/943579326 shutdown_connections 2023-10-18T12:20:05.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.693+0000 7fc30f59e700 1 --2- 172.21.15.114:0/943579326 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc2f00657c0 0x7fc2f0067c80 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.693+0000 7fc30f59e700 1 --2- 172.21.15.114:0/943579326 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc30803a9b0 0x7fc3080d1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.693+0000 7fc30f59e700 1 --2- 172.21.15.114:0/943579326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3080e6ea0 0x7fc3080dbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.693+0000 7fc30f59e700 1 --2- 172.21.15.114:0/943579326 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc3080070d0 0x7fc3080dea80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.693+0000 7fc30f59e700 1 -- 172.21.15.114:0/943579326 >> 172.21.15.114:0/943579326 conn(0x7fc308054cf0 msgr2=0x7fc308038000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:05.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.693+0000 7f03bbe71700 1 -- 172.21.15.114:0/2500210485 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f03980657c0 msgr2=0x7f0398067c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.693+0000 7f03bbe71700 1 --2- 172.21.15.114:0/2500210485 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f03980657c0 0x7f0398067c80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f03b0001370 tx=0x7f03b0009040 comp rx=0 tx=0).stop 2023-10-18T12:20:05.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.693+0000 7f03bbe71700 1 -- 172.21.15.114:0/2500210485 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03b40cb6d0 msgr2=0x7f03b4162b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.693+0000 7fe9bdfca700 1 -- 172.21.15.114:0/376769629 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe9a40656f0 msgr2=0x7fe9a4067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.693+0000 7fe9bdfca700 1 --2- 172.21.15.114:0/376769629 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe9a40656f0 0x7fe9a4067bb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe9b80cf6e0 tx=0x7fe9a8007f30 comp rx=0 tx=0).stop 2023-10-18T12:20:05.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.693+0000 7fe9bdfca700 1 -- 172.21.15.114:0/376769629 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9b8070460 msgr2=0x7fe9b808bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.693+0000 7fe9bdfca700 1 --2- 172.21.15.114:0/376769629 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9b8070460 0x7fe9b808bf30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0009fc0 tx=0x7fe9b000d3b0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.693+0000 7f03bbe71700 1 --2- 172.21.15.114:0/2500210485 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03b40cb6d0 0x7f03b4162b30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f03a4015000 tx=0x7f03a4004770 comp rx=0 tx=0).stop 2023-10-18T12:20:05.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.693+0000 7f03bbe71700 1 -- 172.21.15.114:0/2500210485 shutdown_connections 2023-10-18T12:20:05.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.693+0000 7f03bbe71700 1 --2- 172.21.15.114:0/2500210485 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f03980657c0 0x7f0398067c80 secure :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f03b0001370 tx=0x7f03b0009040 comp rx=0 tx=0).stop 2023-10-18T12:20:05.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.693+0000 7f03bbe71700 1 --2- 172.21.15.114:0/2500210485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03b4161230 0x7f03b40cda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.693+0000 7f03bbe71700 1 --2- 172.21.15.114:0/2500210485 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f03b40cb6d0 0x7f03b4162b30 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.693+0000 7f03bbe71700 1 --2- 172.21.15.114:0/2500210485 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f03b40adb60 0x7f03b41625f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.693+0000 7f03bbe71700 1 -- 172.21.15.114:0/2500210485 >> 172.21.15.114:0/2500210485 conn(0x7f03b406a340 msgr2=0x7f03b40ae1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:05.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.693+0000 7fc30f59e700 1 -- 172.21.15.114:0/943579326 shutdown_connections 2023-10-18T12:20:05.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.693+0000 7fc30f59e700 1 -- 172.21.15.114:0/943579326 wait complete. 2023-10-18T12:20:05.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.693+0000 7f6c17211700 1 -- 172.21.15.114:0/3388438894 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f6c10155840 con 0x7f6c100b7dd0 2023-10-18T12:20:05.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.693+0000 7f03bbe71700 1 -- 172.21.15.114:0/2500210485 shutdown_connections 2023-10-18T12:20:05.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.693+0000 7f03bbe71700 1 -- 172.21.15.114:0/2500210485 wait complete. 2023-10-18T12:20:05.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.693+0000 7fe9bdfca700 1 -- 172.21.15.114:0/376769629 shutdown_connections 2023-10-18T12:20:05.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.693+0000 7fe9bdfca700 1 --2- 172.21.15.114:0/376769629 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe9a40656f0 0x7fe9a4067bb0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.693+0000 7fe9bdfca700 1 --2- 172.21.15.114:0/376769629 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9b80b5ae0 0x7fe9b814ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.693+0000 7fe9bdfca700 1 --2- 172.21.15.114:0/376769629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9b80b2200 0x7fe9b814c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.693+0000 7fe9bdfca700 1 --2- 172.21.15.114:0/376769629 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9b8070460 0x7fe9b808bf30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.693+0000 7fe9bdfca700 1 -- 172.21.15.114:0/376769629 >> 172.21.15.114:0/376769629 conn(0x7fe9b80d2a70 msgr2=0x7fe9b806fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:05.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.693+0000 7f6c0d7fa700 1 -- 172.21.15.114:0/3388438894 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6c10155840 con 0x7f6c100b7dd0 2023-10-18T12:20:05.710 INFO:teuthology.orchestra.run.smithi114.stdout:55834574859 2023-10-18T12:20:05.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.697+0000 7fe9bdfca700 1 -- 172.21.15.114:0/376769629 shutdown_connections 2023-10-18T12:20:05.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.697+0000 7fe9bdfca700 1 -- 172.21.15.114:0/376769629 wait complete. 2023-10-18T12:20:05.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.697+0000 7f0f4e89f700 1 -- 172.21.15.114:0/1295796350 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0f2c0656f0 msgr2=0x7f0f2c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.697+0000 7f0f4e89f700 1 --2- 172.21.15.114:0/1295796350 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0f2c0656f0 0x7f0f2c067bb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0f40009c30 tx=0x7f0f4001d040 comp rx=0 tx=0).stop 2023-10-18T12:20:05.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.697+0000 7f0f4e89f700 1 -- 172.21.15.114:0/1295796350 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0f48164b70 msgr2=0x7f0f480a7bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.697+0000 7f0f4e89f700 1 --2- 172.21.15.114:0/1295796350 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0f48164b70 0x7f0f480a7bc0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0f4400cae0 tx=0x7f0f4400cdf0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.697+0000 7f0f4e89f700 1 -- 172.21.15.114:0/1295796350 shutdown_connections 2023-10-18T12:20:05.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.697+0000 7f0f4e89f700 1 --2- 172.21.15.114:0/1295796350 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0f2c0656f0 0x7f0f2c067bb0 secure :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0f40009c30 tx=0x7f0f4001d040 comp rx=0 tx=0).stop 2023-10-18T12:20:05.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.697+0000 7f0f4e89f700 1 --2- 172.21.15.114:0/1295796350 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0f48164b70 0x7f0f480a7bc0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.697+0000 7f0f4e89f700 1 --2- 172.21.15.114:0/1295796350 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f4815b590 0x7f0f4815c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.697+0000 7f0f4e89f700 1 --2- 172.21.15.114:0/1295796350 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f480b2130 0x7f0f48159720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.697+0000 7f0f4e89f700 1 -- 172.21.15.114:0/1295796350 >> 172.21.15.114:0/1295796350 conn(0x7f0f480ce660 msgr2=0x7f0f480ae340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:05.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.697+0000 7fdeb086b700 1 -- 172.21.15.114:0/2215539240 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdeac072e60 con 0x7fdeac0b1d10 2023-10-18T12:20:05.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.697+0000 7f0f4e89f700 1 -- 172.21.15.114:0/1295796350 shutdown_connections 2023-10-18T12:20:05.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.697+0000 7f0f4e89f700 1 -- 172.21.15.114:0/1295796350 wait complete. 2023-10-18T12:20:05.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.697+0000 7fde93fff700 1 -- 172.21.15.114:0/2215539240 <== mon.2 v2:172.21.15.172:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fde9c017020 con 0x7fdeac0b1d10 2023-10-18T12:20:05.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.697+0000 7f6c17211700 1 -- 172.21.15.114:0/3388438894 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6bf00657c0 msgr2=0x7f6bf0067c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.697+0000 7f6c17211700 1 --2- 172.21.15.114:0/3388438894 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6bf00657c0 0x7f6bf0067c80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6c08007fd0 tx=0x7f6c08009040 comp rx=0 tx=0).stop 2023-10-18T12:20:05.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.697+0000 7f6c17211700 1 -- 172.21.15.114:0/3388438894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c100b7dd0 msgr2=0x7f6c10155b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.697+0000 7f6c17211700 1 --2- 172.21.15.114:0/3388438894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c100b7dd0 0x7f6c10155b20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6c0000b370 tx=0x7f6c00004af0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.716 INFO:teuthology.orchestra.run.smithi114.stdout:55834574858 2023-10-18T12:20:05.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.697+0000 7f6c17211700 1 -- 172.21.15.114:0/3388438894 shutdown_connections 2023-10-18T12:20:05.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.697+0000 7f6c17211700 1 --2- 172.21.15.114:0/3388438894 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6bf00657c0 0x7f6bf0067c80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.697+0000 7f6c17211700 1 --2- 172.21.15.114:0/3388438894 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6c10146650 0x7f6c10154230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.697+0000 7f6c17211700 1 --2- 172.21.15.114:0/3388438894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c100b7dd0 0x7f6c10155b20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.697+0000 7f6c17211700 1 --2- 172.21.15.114:0/3388438894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c1006fef0 0x7f6c10158a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.697+0000 7f6c17211700 1 -- 172.21.15.114:0/3388438894 >> 172.21.15.114:0/3388438894 conn(0x7f6c1006a130 msgr2=0x7f6c10145020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:05.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.701+0000 7f6c17211700 1 -- 172.21.15.114:0/3388438894 shutdown_connections 2023-10-18T12:20:05.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.701+0000 7f6c17211700 1 -- 172.21.15.114:0/3388438894 wait complete. 2023-10-18T12:20:05.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.701+0000 7fdeb086b700 1 -- 172.21.15.114:0/2215539240 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fde98065740 msgr2=0x7fde98067c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.701+0000 7fdeb086b700 1 --2- 172.21.15.114:0/2215539240 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fde98065740 0x7fde98067c00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdea00090b0 tx=0x7fdea0008030 comp rx=0 tx=0).stop 2023-10-18T12:20:05.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.701+0000 7fdeb086b700 1 -- 172.21.15.114:0/2215539240 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdeac0b1d10 msgr2=0x7fdeac200080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.701+0000 7fdeb086b700 1 --2- 172.21.15.114:0/2215539240 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdeac0b1d10 0x7fdeac200080 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fde9c00e840 tx=0x7fde9c00eb50 comp rx=0 tx=0).stop 2023-10-18T12:20:05.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.705+0000 7fdeb086b700 1 -- 172.21.15.114:0/2215539240 shutdown_connections 2023-10-18T12:20:05.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.705+0000 7fdeb086b700 1 --2- 172.21.15.114:0/2215539240 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fde98065740 0x7fde98067c00 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.705+0000 7fdeb086b700 1 --2- 172.21.15.114:0/2215539240 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdeac15cbd0 0x7fdeac1fecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.705+0000 7fdeb086b700 1 --2- 172.21.15.114:0/2215539240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdeac0b5ae0 0x7fdeac14d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.705+0000 7fdeb086b700 1 --2- 172.21.15.114:0/2215539240 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdeac0b1d10 0x7fdeac200080 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.705+0000 7fdeb086b700 1 -- 172.21.15.114:0/2215539240 >> 172.21.15.114:0/2215539240 conn(0x7fdeac06f450 msgr2=0x7fdeac06d750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:05.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.705+0000 7fdeb086b700 1 -- 172.21.15.114:0/2215539240 shutdown_connections 2023-10-18T12:20:05.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.705+0000 7fdeb086b700 1 -- 172.21.15.114:0/2215539240 wait complete. 2023-10-18T12:20:05.722 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.1 2023-10-18T12:20:05.722 DEBUG:teuthology.parallel:result is None 2023-10-18T12:20:05.725 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.5 2023-10-18T12:20:05.725 DEBUG:teuthology.parallel:result is None 2023-10-18T12:20:05.726 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.6 2023-10-18T12:20:05.727 DEBUG:teuthology.parallel:result is None 2023-10-18T12:20:05.728 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.4 2023-10-18T12:20:05.728 DEBUG:teuthology.parallel:result is None 2023-10-18T12:20:05.731 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.2 2023-10-18T12:20:05.731 DEBUG:teuthology.parallel:result is None 2023-10-18T12:20:05.732 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.3 2023-10-18T12:20:05.732 DEBUG:teuthology.parallel:result is None 2023-10-18T12:20:05.733 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.7 2023-10-18T12:20:05.733 DEBUG:teuthology.parallel:result is None 2023-10-18T12:20:05.735 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.0 2023-10-18T12:20:05.736 DEBUG:teuthology.parallel:result is None 2023-10-18T12:20:05.736 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-18T12:20:05.736 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-18T12:20:05.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.933+0000 7fe63b3aa700 1 Processor -- start 2023-10-18T12:20:05.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.933+0000 7fe63b3aa700 1 -- start start 2023-10-18T12:20:05.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.937+0000 7fe63b3aa700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe63415ee50 0x7fe6340cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.937+0000 7fe63b3aa700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe63406f450 con 0x7fe63406e8a0 2023-10-18T12:20:05.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.937+0000 7fe63b3aa700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6340ccbc0 con 0x7fe6340cb640 2023-10-18T12:20:05.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.937+0000 7fe63b3aa700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe63406d4e0 con 0x7fe63415ee50 2023-10-18T12:20:05.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.937+0000 7fe638945700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe63406e8a0 0x7fe6340caf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34472/0 (socket says 172.21.15.114:34472) 2023-10-18T12:20:05.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.937+0000 7fe638945700 1 -- 172.21.15.114:0/3964363172 learned_addr learned my addr 172.21.15.114:0/3964363172 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:05.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.937+0000 7fe639146700 1 --2- 172.21.15.114:0/3964363172 >> v2:172.21.15.114:3300/0 conn(0x7fe63415ee50 0x7fe6340cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.937+0000 7fe62bfff700 1 -- 172.21.15.114:0/3964363172 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2205732034 0 0) 0x7fe63406f450 con 0x7fe63406e8a0 2023-10-18T12:20:05.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.937+0000 7fe62bfff700 1 -- 172.21.15.114:0/3964363172 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6200035d0 con 0x7fe63406e8a0 2023-10-18T12:20:05.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.937+0000 7fe639146700 1 -- 172.21.15.114:0/3964363172 >> v1:172.21.15.172:6789/0 conn(0x7fe6340cb640 legacy=0x7fe63406f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.937+0000 7fe639146700 1 -- 172.21.15.114:0/3964363172 >> v1:172.21.15.114:6789/0 conn(0x7fe63406e8a0 legacy=0x7fe6340caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.937+0000 7fe639146700 1 -- 172.21.15.114:0/3964363172 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6341624a0 con 0x7fe63415ee50 2023-10-18T12:20:05.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.937+0000 7fe639146700 1 --2- 172.21.15.114:0/3964363172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe63415ee50 0x7fe6340cc680 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe630009d90 tx=0x7fe63000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ba8d5884413a584 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:05.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.937+0000 7fe62bfff700 1 -- 172.21.15.114:0/3964363172 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63000e070 con 0x7fe63415ee50 2023-10-18T12:20:05.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.937+0000 7fe62bfff700 1 -- 172.21.15.114:0/3964363172 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63000bb20 con 0x7fe63415ee50 2023-10-18T12:20:05.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.937+0000 7fe62bfff700 1 -- 172.21.15.114:0/3964363172 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe630012430 con 0x7fe63415ee50 2023-10-18T12:20:05.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.941+0000 7fe63b3aa700 1 -- 172.21.15.114:0/3964363172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe63415ee50 msgr2=0x7fe6340cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.941+0000 7fe63b3aa700 1 --2- 172.21.15.114:0/3964363172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe63415ee50 0x7fe6340cc680 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe630009d90 tx=0x7fe63000b330 comp rx=0 tx=0).stop 2023-10-18T12:20:05.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.941+0000 7fe63b3aa700 1 -- 172.21.15.114:0/3964363172 shutdown_connections 2023-10-18T12:20:05.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.941+0000 7fe63b3aa700 1 --2- 172.21.15.114:0/3964363172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe63415ee50 0x7fe6340cc680 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.941+0000 7fe63b3aa700 1 -- 172.21.15.114:0/3964363172 >> 172.21.15.114:0/3964363172 conn(0x7fe63406a340 msgr2=0x7fe6340b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:05.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.941+0000 7fe63b3aa700 1 -- 172.21.15.114:0/3964363172 shutdown_connections 2023-10-18T12:20:05.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.941+0000 7fe63b3aa700 1 -- 172.21.15.114:0/3964363172 wait complete. 2023-10-18T12:20:05.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.941+0000 7fe63b3aa700 1 Processor -- start 2023-10-18T12:20:05.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.941+0000 7fe63b3aa700 1 -- start start 2023-10-18T12:20:05.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.945+0000 7fe63b3aa700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe63406e8a0 0x7fe6341587a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.945+0000 7fe63b3aa700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6340cb640 0x7fe6340b23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.945+0000 7fe63b3aa700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe63415ee50 0x7fe634159b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.945+0000 7fe63b3aa700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63415b690 con 0x7fe6340cb640 2023-10-18T12:20:05.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.945+0000 7fe63b3aa700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6340b32e0 con 0x7fe63415ee50 2023-10-18T12:20:05.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.945+0000 7fe63b3aa700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6340b2d20 con 0x7fe63406e8a0 2023-10-18T12:20:05.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.945+0000 7fe638945700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6340cb640 0x7fe6340b23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.945+0000 7fe638945700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6340cb640 0x7fe6340b23d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56634/0 (socket says 172.21.15.114:56634) 2023-10-18T12:20:05.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.945+0000 7fe638945700 1 -- 172.21.15.114:0/3313790820 learned_addr learned my addr 172.21.15.114:0/3313790820 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:05.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.945+0000 7fe639146700 1 --2- 172.21.15.114:0/3313790820 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe63406e8a0 0x7fe6341587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.945+0000 7fe639947700 1 --2- 172.21.15.114:0/3313790820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe63415ee50 0x7fe634159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.945+0000 7fe638945700 1 -- 172.21.15.114:0/3313790820 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe63406e8a0 msgr2=0x7fe6341587a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.945+0000 7fe638945700 1 --2- 172.21.15.114:0/3313790820 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe63406e8a0 0x7fe6341587a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.945+0000 7fe638945700 1 -- 172.21.15.114:0/3313790820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe63415ee50 msgr2=0x7fe634159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:05.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.945+0000 7fe638945700 1 --2- 172.21.15.114:0/3313790820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe63415ee50 0x7fe634159b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:05.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.945+0000 7fe638945700 1 -- 172.21.15.114:0/3313790820 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe630009a70 con 0x7fe6340cb640 2023-10-18T12:20:05.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.945+0000 7fe638945700 1 --2- 172.21.15.114:0/3313790820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6340cb640 0x7fe6340b23d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe62400c4d0 tx=0x7fe62400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:05.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.945+0000 7fe629ffb700 1 -- 172.21.15.114:0/3313790820 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe624005d90 con 0x7fe6340cb640 2023-10-18T12:20:05.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.945+0000 7fe629ffb700 1 -- 172.21.15.114:0/3313790820 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6240070d0 con 0x7fe6340cb640 2023-10-18T12:20:05.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.945+0000 7fe629ffb700 1 -- 172.21.15.114:0/3313790820 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe624007480 con 0x7fe6340cb640 2023-10-18T12:20:05.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.945+0000 7fe63b3aa700 1 -- 172.21.15.114:0/3313790820 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6340b3000 con 0x7fe6340cb640 2023-10-18T12:20:05.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.945+0000 7fe63b3aa700 1 -- 172.21.15.114:0/3313790820 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe634158ce0 con 0x7fe6340cb640 2023-10-18T12:20:05.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.949+0000 7fe63b3aa700 1 -- 172.21.15.114:0/3313790820 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe63415b840 con 0x7fe6340cb640 2023-10-18T12:20:05.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.949+0000 7fe629ffb700 1 -- 172.21.15.114:0/3313790820 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fe6240075e0 con 0x7fe6340cb640 2023-10-18T12:20:05.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.949+0000 7fe629ffb700 1 --2- 172.21.15.114:0/3313790820 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe6180656f0 0x7fe618067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:05.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.949+0000 7fe629ffb700 1 -- 172.21.15.114:0/3313790820 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe624082430 con 0x7fe6340cb640 2023-10-18T12:20:05.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.949+0000 7fe639146700 1 --2- 172.21.15.114:0/3313790820 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe6180656f0 0x7fe618067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:05.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.953+0000 7fe639146700 1 --2- 172.21.15.114:0/3313790820 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe6180656f0 0x7fe618067bb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe630014040 tx=0x7fe630011000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:05.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:05.957+0000 7fe629ffb700 1 -- 172.21.15.114:0/3313790820 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fe63415b840 con 0x7fe6340cb640 2023-10-18T12:20:06.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.113+0000 7fe63b3aa700 1 -- 172.21.15.114:0/3313790820 --> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe6340ce420 con 0x7fe6180656f0 2023-10-18T12:20:06.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.129+0000 7fe629ffb700 1 -- 172.21.15.114:0/3313790820 <== mgr.4108 v2:172.21.15.172:6832/461408666 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367113 (secure 0 0 0) 0x7fe630003d50 con 0x7fe6180656f0 2023-10-18T12:20:06.142 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:20:06.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.141+0000 7fe63b3aa700 1 -- 172.21.15.114:0/3313790820 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe6180656f0 msgr2=0x7fe618067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:06.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.141+0000 7fe63b3aa700 1 --2- 172.21.15.114:0/3313790820 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe6180656f0 0x7fe618067bb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe630014040 tx=0x7fe630011000 comp rx=0 tx=0).stop 2023-10-18T12:20:06.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.141+0000 7fe63b3aa700 1 -- 172.21.15.114:0/3313790820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6340cb640 msgr2=0x7fe6340b23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:06.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.141+0000 7fe63b3aa700 1 --2- 172.21.15.114:0/3313790820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6340cb640 0x7fe6340b23d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe62400c4d0 tx=0x7fe62400c7e0 comp rx=0 tx=0).stop 2023-10-18T12:20:06.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.141+0000 7fe63b3aa700 1 -- 172.21.15.114:0/3313790820 shutdown_connections 2023-10-18T12:20:06.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.141+0000 7fe63b3aa700 1 --2- 172.21.15.114:0/3313790820 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe6180656f0 0x7fe618067bb0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:06.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.141+0000 7fe63b3aa700 1 --2- 172.21.15.114:0/3313790820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe63415ee50 0x7fe634159b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:06.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.141+0000 7fe63b3aa700 1 --2- 172.21.15.114:0/3313790820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6340cb640 0x7fe6340b23d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:06.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.141+0000 7fe63b3aa700 1 --2- 172.21.15.114:0/3313790820 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe63406e8a0 0x7fe6341587a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:06.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.141+0000 7fe63b3aa700 1 -- 172.21.15.114:0/3313790820 >> 172.21.15.114:0/3313790820 conn(0x7fe63406a340 msgr2=0x7fe6340afbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:06.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.141+0000 7fe63b3aa700 1 -- 172.21.15.114:0/3313790820 shutdown_connections 2023-10-18T12:20:06.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.141+0000 7fe63b3aa700 1 -- 172.21.15.114:0/3313790820 wait complete. 2023-10-18T12:20:06.148 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2023-10-18T12:20:06.165 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2023-10-18T12:20:04.962745+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219744,"kb_used_data":3592,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754976,"statfs":{"total":773094113280,"available":772869095424,"internally_reserved":0,"allocated":3678208,"data_stored":2186590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005054"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.644127+0000","last_change":"2023-10-18T12:19:43.671541+0000","last_active":"2023-10-18T12:19:44.644127+0000","last_peered":"2023-10-18T12:19:44.644127+0000","last_clean":"2023-10-18T12:19:44.644127+0000","last_became_active":"2023-10-18T12:19:43.671125+0000","last_became_peered":"2023-10-18T12:19:43.671125+0000","last_unstale":"2023-10-18T12:19:44.644127+0000","last_undegraded":"2023-10-18T12:19:44.644127+0000","last_fullsized":"2023-10-18T12:19:44.644127+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:18:29.969594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696898+0000","last_change":"2023-10-18T12:19:38.598603+0000","last_active":"2023-10-18T12:19:44.696898+0000","last_peered":"2023-10-18T12:19:44.696898+0000","last_clean":"2023-10-18T12:19:44.696898+0000","last_became_active":"2023-10-18T12:19:38.598010+0000","last_became_peered":"2023-10-18T12:19:38.598010+0000","last_unstale":"2023-10-18T12:19:44.696898+0000","last_undegraded":"2023-10-18T12:19:44.696898+0000","last_fullsized":"2023-10-18T12:19:44.696898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:32:58.240366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695834+0000","last_change":"2023-10-18T12:19:39.616496+0000","last_active":"2023-10-18T12:19:44.695834+0000","last_peered":"2023-10-18T12:19:44.695834+0000","last_clean":"2023-10-18T12:19:44.695834+0000","last_became_active":"2023-10-18T12:19:39.615133+0000","last_became_peered":"2023-10-18T12:19:39.615133+0000","last_unstale":"2023-10-18T12:19:44.695834+0000","last_undegraded":"2023-10-18T12:19:44.695834+0000","last_fullsized":"2023-10-18T12:19:44.695834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:20:49.513519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695684+0000","last_change":"2023-10-18T12:19:43.666992+0000","last_active":"2023-10-18T12:19:44.695684+0000","last_peered":"2023-10-18T12:19:44.695684+0000","last_clean":"2023-10-18T12:19:44.695684+0000","last_became_active":"2023-10-18T12:19:43.666294+0000","last_became_peered":"2023-10-18T12:19:43.666294+0000","last_unstale":"2023-10-18T12:19:44.695684+0000","last_undegraded":"2023-10-18T12:19:44.695684+0000","last_fullsized":"2023-10-18T12:19:44.695684+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:22:06.215999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645491+0000","last_change":"2023-10-18T12:19:38.593588+0000","last_active":"2023-10-18T12:19:44.645491+0000","last_peered":"2023-10-18T12:19:44.645491+0000","last_clean":"2023-10-18T12:19:44.645491+0000","last_became_active":"2023-10-18T12:19:38.592964+0000","last_became_peered":"2023-10-18T12:19:38.592964+0000","last_unstale":"2023-10-18T12:19:44.645491+0000","last_undegraded":"2023-10-18T12:19:44.645491+0000","last_fullsized":"2023-10-18T12:19:44.645491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:43:42.560410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.644558+0000","last_change":"2023-10-18T12:19:39.607852+0000","last_active":"2023-10-18T12:19:44.644558+0000","last_peered":"2023-10-18T12:19:44.644558+0000","last_clean":"2023-10-18T12:19:44.644558+0000","last_became_active":"2023-10-18T12:19:39.603891+0000","last_became_peered":"2023-10-18T12:19:39.603891+0000","last_unstale":"2023-10-18T12:19:44.644558+0000","last_undegraded":"2023-10-18T12:19:44.644558+0000","last_fullsized":"2023-10-18T12:19:44.644558+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:34:44.895130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696905+0000","last_change":"2023-10-18T12:19:43.675386+0000","last_active":"2023-10-18T12:19:44.696905+0000","last_peered":"2023-10-18T12:19:44.696905+0000","last_clean":"2023-10-18T12:19:44.696905+0000","last_became_active":"2023-10-18T12:19:43.675017+0000","last_became_peered":"2023-10-18T12:19:43.675017+0000","last_unstale":"2023-10-18T12:19:44.696905+0000","last_undegraded":"2023-10-18T12:19:44.696905+0000","last_fullsized":"2023-10-18T12:19:44.696905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:32:33.537768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698148+0000","last_change":"2023-10-18T12:19:38.608909+0000","last_active":"2023-10-18T12:19:44.698148+0000","last_peered":"2023-10-18T12:19:44.698148+0000","last_clean":"2023-10-18T12:19:44.698148+0000","last_became_active":"2023-10-18T12:19:38.608524+0000","last_became_peered":"2023-10-18T12:19:38.608524+0000","last_unstale":"2023-10-18T12:19:44.698148+0000","last_undegraded":"2023-10-18T12:19:44.698148+0000","last_fullsized":"2023-10-18T12:19:44.698148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:05:31.346619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697032+0000","last_change":"2023-10-18T12:19:39.619005+0000","last_active":"2023-10-18T12:19:44.697032+0000","last_peered":"2023-10-18T12:19:44.697032+0000","last_clean":"2023-10-18T12:19:44.697032+0000","last_became_active":"2023-10-18T12:19:39.618668+0000","last_became_peered":"2023-10-18T12:19:39.618668+0000","last_unstale":"2023-10-18T12:19:44.697032+0000","last_undegraded":"2023-10-18T12:19:44.697032+0000","last_fullsized":"2023-10-18T12:19:44.697032+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:09:08.461295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.642816+0000","last_change":"2023-10-18T12:19:43.668706+0000","last_active":"2023-10-18T12:19:44.642816+0000","last_peered":"2023-10-18T12:19:44.642816+0000","last_clean":"2023-10-18T12:19:44.642816+0000","last_became_active":"2023-10-18T12:19:43.667712+0000","last_became_peered":"2023-10-18T12:19:43.667712+0000","last_unstale":"2023-10-18T12:19:44.642816+0000","last_undegraded":"2023-10-18T12:19:44.642816+0000","last_fullsized":"2023-10-18T12:19:44.642816+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:59:50.719856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698543+0000","last_change":"2023-10-18T12:19:38.612065+0000","last_active":"2023-10-18T12:19:44.698543+0000","last_peered":"2023-10-18T12:19:44.698543+0000","last_clean":"2023-10-18T12:19:44.698543+0000","last_became_active":"2023-10-18T12:19:38.611721+0000","last_became_peered":"2023-10-18T12:19:38.611721+0000","last_unstale":"2023-10-18T12:19:44.698543+0000","last_undegraded":"2023-10-18T12:19:44.698543+0000","last_fullsized":"2023-10-18T12:19:44.698543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:36:40.183265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698329+0000","last_change":"2023-10-18T12:19:39.620814+0000","last_active":"2023-10-18T12:19:44.698329+0000","last_peered":"2023-10-18T12:19:44.698329+0000","last_clean":"2023-10-18T12:19:44.698329+0000","last_became_active":"2023-10-18T12:19:39.620615+0000","last_became_peered":"2023-10-18T12:19:39.620615+0000","last_unstale":"2023-10-18T12:19:44.698329+0000","last_undegraded":"2023-10-18T12:19:44.698329+0000","last_fullsized":"2023-10-18T12:19:44.698329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:33:13.475249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645822+0000","last_change":"2023-10-18T12:19:43.674472+0000","last_active":"2023-10-18T12:19:44.645822+0000","last_peered":"2023-10-18T12:19:44.645822+0000","last_clean":"2023-10-18T12:19:44.645822+0000","last_became_active":"2023-10-18T12:19:43.673978+0000","last_became_peered":"2023-10-18T12:19:43.673978+0000","last_unstale":"2023-10-18T12:19:44.645822+0000","last_undegraded":"2023-10-18T12:19:44.645822+0000","last_fullsized":"2023-10-18T12:19:44.645822+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:09:05.460432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696271+0000","last_change":"2023-10-18T12:19:38.606249+0000","last_active":"2023-10-18T12:19:44.696271+0000","last_peered":"2023-10-18T12:19:44.696271+0000","last_clean":"2023-10-18T12:19:44.696271+0000","last_became_active":"2023-10-18T12:19:38.605978+0000","last_became_peered":"2023-10-18T12:19:38.605978+0000","last_unstale":"2023-10-18T12:19:44.696271+0000","last_undegraded":"2023-10-18T12:19:44.696271+0000","last_fullsized":"2023-10-18T12:19:44.696271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:01:12.525756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697183+0000","last_change":"2023-10-18T12:19:39.601641+0000","last_active":"2023-10-18T12:19:44.697183+0000","last_peered":"2023-10-18T12:19:44.697183+0000","last_clean":"2023-10-18T12:19:44.697183+0000","last_became_active":"2023-10-18T12:19:39.601275+0000","last_became_peered":"2023-10-18T12:19:39.601275+0000","last_unstale":"2023-10-18T12:19:44.697183+0000","last_undegraded":"2023-10-18T12:19:44.697183+0000","last_fullsized":"2023-10-18T12:19:44.697183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:43:39.713506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.699565+0000","last_change":"2023-10-18T12:19:43.665457+0000","last_active":"2023-10-18T12:19:44.699565+0000","last_peered":"2023-10-18T12:19:44.699565+0000","last_clean":"2023-10-18T12:19:44.699565+0000","last_became_active":"2023-10-18T12:19:43.665040+0000","last_became_peered":"2023-10-18T12:19:43.665040+0000","last_unstale":"2023-10-18T12:19:44.699565+0000","last_undegraded":"2023-10-18T12:19:44.699565+0000","last_fullsized":"2023-10-18T12:19:44.699565+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:45:20.383309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697555+0000","last_change":"2023-10-18T12:19:38.605141+0000","last_active":"2023-10-18T12:19:44.697555+0000","last_peered":"2023-10-18T12:19:44.697555+0000","last_clean":"2023-10-18T12:19:44.697555+0000","last_became_active":"2023-10-18T12:19:38.602562+0000","last_became_peered":"2023-10-18T12:19:38.602562+0000","last_unstale":"2023-10-18T12:19:44.697555+0000","last_undegraded":"2023-10-18T12:19:44.697555+0000","last_fullsized":"2023-10-18T12:19:44.697555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:27:56.749766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.646701+0000","last_change":"2023-10-18T12:19:39.610888+0000","last_active":"2023-10-18T12:19:44.646701+0000","last_peered":"2023-10-18T12:19:44.646701+0000","last_clean":"2023-10-18T12:19:44.646701+0000","last_became_active":"2023-10-18T12:19:39.610423+0000","last_became_peered":"2023-10-18T12:19:39.610423+0000","last_unstale":"2023-10-18T12:19:44.646701+0000","last_undegraded":"2023-10-18T12:19:44.646701+0000","last_fullsized":"2023-10-18T12:19:44.646701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:05:32.356553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698846+0000","last_change":"2023-10-18T12:19:43.660927+0000","last_active":"2023-10-18T12:19:44.698846+0000","last_peered":"2023-10-18T12:19:44.698846+0000","last_clean":"2023-10-18T12:19:44.698846+0000","last_became_active":"2023-10-18T12:19:43.660484+0000","last_became_peered":"2023-10-18T12:19:43.660484+0000","last_unstale":"2023-10-18T12:19:44.698846+0000","last_undegraded":"2023-10-18T12:19:44.698846+0000","last_fullsized":"2023-10-18T12:19:44.698846+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:23:40.463847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645234+0000","last_change":"2023-10-18T12:19:38.605794+0000","last_active":"2023-10-18T12:19:44.645234+0000","last_peered":"2023-10-18T12:19:44.645234+0000","last_clean":"2023-10-18T12:19:44.645234+0000","last_became_active":"2023-10-18T12:19:38.605484+0000","last_became_peered":"2023-10-18T12:19:38.605484+0000","last_unstale":"2023-10-18T12:19:44.645234+0000","last_undegraded":"2023-10-18T12:19:44.645234+0000","last_fullsized":"2023-10-18T12:19:44.645234+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:59:45.652080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696594+0000","last_change":"2023-10-18T12:19:39.611319+0000","last_active":"2023-10-18T12:19:44.696594+0000","last_peered":"2023-10-18T12:19:44.696594+0000","last_clean":"2023-10-18T12:19:44.696594+0000","last_became_active":"2023-10-18T12:19:39.610259+0000","last_became_peered":"2023-10-18T12:19:39.610259+0000","last_unstale":"2023-10-18T12:19:44.696594+0000","last_undegraded":"2023-10-18T12:19:44.696594+0000","last_fullsized":"2023-10-18T12:19:44.696594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:32:29.479925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696566+0000","last_change":"2023-10-18T12:19:43.660372+0000","last_active":"2023-10-18T12:19:44.696566+0000","last_peered":"2023-10-18T12:19:44.696566+0000","last_clean":"2023-10-18T12:19:44.696566+0000","last_became_active":"2023-10-18T12:19:43.659923+0000","last_became_peered":"2023-10-18T12:19:43.659923+0000","last_unstale":"2023-10-18T12:19:44.696566+0000","last_undegraded":"2023-10-18T12:19:44.696566+0000","last_fullsized":"2023-10-18T12:19:44.696566+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:18:29.969594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643863+0000","last_change":"2023-10-18T12:19:38.600796+0000","last_active":"2023-10-18T12:19:44.643863+0000","last_peered":"2023-10-18T12:19:44.643863+0000","last_clean":"2023-10-18T12:19:44.643863+0000","last_became_active":"2023-10-18T12:19:38.599899+0000","last_became_peered":"2023-10-18T12:19:38.599899+0000","last_unstale":"2023-10-18T12:19:44.643863+0000","last_undegraded":"2023-10-18T12:19:44.643863+0000","last_fullsized":"2023-10-18T12:19:44.643863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:01:12.525756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.699060+0000","last_change":"2023-10-18T12:19:39.607533+0000","last_active":"2023-10-18T12:19:44.699060+0000","last_peered":"2023-10-18T12:19:44.699060+0000","last_clean":"2023-10-18T12:19:44.699060+0000","last_became_active":"2023-10-18T12:19:39.604286+0000","last_became_peered":"2023-10-18T12:19:39.604286+0000","last_unstale":"2023-10-18T12:19:44.699060+0000","last_undegraded":"2023-10-18T12:19:44.699060+0000","last_fullsized":"2023-10-18T12:19:44.699060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:30:22.876433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643667+0000","last_change":"2023-10-18T12:19:39.621418+0000","last_active":"2023-10-18T12:19:44.643667+0000","last_peered":"2023-10-18T12:19:44.643667+0000","last_clean":"2023-10-18T12:19:44.643667+0000","last_became_active":"2023-10-18T12:19:39.621162+0000","last_became_peered":"2023-10-18T12:19:39.621162+0000","last_unstale":"2023-10-18T12:19:44.643667+0000","last_undegraded":"2023-10-18T12:19:44.643667+0000","last_fullsized":"2023-10-18T12:19:44.643667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:31:24.099669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697070+0000","last_change":"2023-10-18T12:19:38.602741+0000","last_active":"2023-10-18T12:19:44.697070+0000","last_peered":"2023-10-18T12:19:44.697070+0000","last_clean":"2023-10-18T12:19:44.697070+0000","last_became_active":"2023-10-18T12:19:38.598808+0000","last_became_peered":"2023-10-18T12:19:38.598808+0000","last_unstale":"2023-10-18T12:19:44.697070+0000","last_undegraded":"2023-10-18T12:19:44.697070+0000","last_fullsized":"2023-10-18T12:19:44.697070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:09:00.392656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697485+0000","last_change":"2023-10-18T12:19:43.662507+0000","last_active":"2023-10-18T12:19:44.697485+0000","last_peered":"2023-10-18T12:19:44.697485+0000","last_clean":"2023-10-18T12:19:44.697485+0000","last_became_active":"2023-10-18T12:19:43.662090+0000","last_became_peered":"2023-10-18T12:19:43.662090+0000","last_unstale":"2023-10-18T12:19:44.697485+0000","last_undegraded":"2023-10-18T12:19:44.697485+0000","last_fullsized":"2023-10-18T12:19:44.697485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:36:54.990254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.644101+0000","last_change":"2023-10-18T12:19:39.612100+0000","last_active":"2023-10-18T12:19:44.644101+0000","last_peered":"2023-10-18T12:19:44.644101+0000","last_clean":"2023-10-18T12:19:44.644101+0000","last_became_active":"2023-10-18T12:19:39.611788+0000","last_became_peered":"2023-10-18T12:19:39.611788+0000","last_unstale":"2023-10-18T12:19:44.644101+0000","last_undegraded":"2023-10-18T12:19:44.644101+0000","last_fullsized":"2023-10-18T12:19:44.644101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:18:25.911752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697553+0000","last_change":"2023-10-18T12:19:38.609638+0000","last_active":"2023-10-18T12:19:44.697553+0000","last_peered":"2023-10-18T12:19:44.697553+0000","last_clean":"2023-10-18T12:19:44.697553+0000","last_became_active":"2023-10-18T12:19:38.609318+0000","last_became_peered":"2023-10-18T12:19:38.609318+0000","last_unstale":"2023-10-18T12:19:44.697553+0000","last_undegraded":"2023-10-18T12:19:44.697553+0000","last_fullsized":"2023-10-18T12:19:44.697553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:58:15.868092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.641909+0000","last_change":"2023-10-18T12:19:43.668265+0000","last_active":"2023-10-18T12:19:44.641909+0000","last_peered":"2023-10-18T12:19:44.641909+0000","last_clean":"2023-10-18T12:19:44.641909+0000","last_became_active":"2023-10-18T12:19:43.667706+0000","last_became_peered":"2023-10-18T12:19:43.667706+0000","last_unstale":"2023-10-18T12:19:44.641909+0000","last_undegraded":"2023-10-18T12:19:44.641909+0000","last_fullsized":"2023-10-18T12:19:44.641909+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:49:04.109094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643379+0000","last_change":"2023-10-18T12:19:38.601819+0000","last_active":"2023-10-18T12:19:44.643379+0000","last_peered":"2023-10-18T12:19:44.643379+0000","last_clean":"2023-10-18T12:19:44.643379+0000","last_became_active":"2023-10-18T12:19:38.601414+0000","last_became_peered":"2023-10-18T12:19:38.601414+0000","last_unstale":"2023-10-18T12:19:44.643379+0000","last_undegraded":"2023-10-18T12:19:44.643379+0000","last_fullsized":"2023-10-18T12:19:44.643379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:43:42.560410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645163+0000","last_change":"2023-10-18T12:19:39.601170+0000","last_active":"2023-10-18T12:19:44.645163+0000","last_peered":"2023-10-18T12:19:44.645163+0000","last_clean":"2023-10-18T12:19:44.645163+0000","last_became_active":"2023-10-18T12:19:39.600901+0000","last_became_peered":"2023-10-18T12:19:39.600901+0000","last_unstale":"2023-10-18T12:19:44.645163+0000","last_undegraded":"2023-10-18T12:19:44.645163+0000","last_fullsized":"2023-10-18T12:19:44.645163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:23:37.730513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.644364+0000","last_change":"2023-10-18T12:19:43.668816+0000","last_active":"2023-10-18T12:19:44.644364+0000","last_peered":"2023-10-18T12:19:44.644364+0000","last_clean":"2023-10-18T12:19:44.644364+0000","last_became_active":"2023-10-18T12:19:43.668451+0000","last_became_peered":"2023-10-18T12:19:43.668451+0000","last_unstale":"2023-10-18T12:19:44.644364+0000","last_undegraded":"2023-10-18T12:19:44.644364+0000","last_fullsized":"2023-10-18T12:19:44.644364+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:32:33.537768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"28'10","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:58.003436+0000","last_change":"2023-10-18T12:19:38.605016+0000","last_active":"2023-10-18T12:19:58.003436+0000","last_peered":"2023-10-18T12:19:58.003436+0000","last_clean":"2023-10-18T12:19:58.003436+0000","last_became_active":"2023-10-18T12:19:38.604703+0000","last_became_peered":"2023-10-18T12:19:38.604703+0000","last_unstale":"2023-10-18T12:19:58.003436+0000","last_undegraded":"2023-10-18T12:19:58.003436+0000","last_fullsized":"2023-10-18T12:19:58.003436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:02:17.952362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698575+0000","last_change":"2023-10-18T12:19:39.615377+0000","last_active":"2023-10-18T12:19:44.698575+0000","last_peered":"2023-10-18T12:19:44.698575+0000","last_clean":"2023-10-18T12:19:44.698575+0000","last_became_active":"2023-10-18T12:19:39.610424+0000","last_became_peered":"2023-10-18T12:19:39.610424+0000","last_unstale":"2023-10-18T12:19:44.698575+0000","last_undegraded":"2023-10-18T12:19:44.698575+0000","last_fullsized":"2023-10-18T12:19:44.698575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:28:58.787021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645013+0000","last_change":"2023-10-18T12:19:43.680946+0000","last_active":"2023-10-18T12:19:44.645013+0000","last_peered":"2023-10-18T12:19:44.645013+0000","last_clean":"2023-10-18T12:19:44.645013+0000","last_became_active":"2023-10-18T12:19:43.680542+0000","last_became_peered":"2023-10-18T12:19:43.680542+0000","last_unstale":"2023-10-18T12:19:44.645013+0000","last_undegraded":"2023-10-18T12:19:44.645013+0000","last_fullsized":"2023-10-18T12:19:44.645013+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:32:33.537768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696164+0000","last_change":"2023-10-18T12:19:39.602742+0000","last_active":"2023-10-18T12:19:44.696164+0000","last_peered":"2023-10-18T12:19:44.696164+0000","last_clean":"2023-10-18T12:19:44.696164+0000","last_became_active":"2023-10-18T12:19:39.602504+0000","last_became_peered":"2023-10-18T12:19:39.602504+0000","last_unstale":"2023-10-18T12:19:44.696164+0000","last_undegraded":"2023-10-18T12:19:44.696164+0000","last_fullsized":"2023-10-18T12:19:44.696164+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:55:47.767344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.699228+0000","last_change":"2023-10-18T12:19:33.531672+0000","last_active":"2023-10-18T12:19:44.699228+0000","last_peered":"2023-10-18T12:19:44.699228+0000","last_clean":"2023-10-18T12:19:44.699228+0000","last_became_active":"2023-10-18T12:19:33.530907+0000","last_became_peered":"2023-10-18T12:19:33.530907+0000","last_unstale":"2023-10-18T12:19:44.699228+0000","last_undegraded":"2023-10-18T12:19:44.699228+0000","last_fullsized":"2023-10-18T12:19:44.699228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:22:58.092944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696857+0000","last_change":"2023-10-18T12:19:38.601615+0000","last_active":"2023-10-18T12:19:44.696857+0000","last_peered":"2023-10-18T12:19:44.696857+0000","last_clean":"2023-10-18T12:19:44.696857+0000","last_became_active":"2023-10-18T12:19:38.601084+0000","last_became_peered":"2023-10-18T12:19:38.601084+0000","last_unstale":"2023-10-18T12:19:44.696857+0000","last_undegraded":"2023-10-18T12:19:44.696857+0000","last_fullsized":"2023-10-18T12:19:44.696857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:34:43.885197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643565+0000","last_change":"2023-10-18T12:19:43.679066+0000","last_active":"2023-10-18T12:19:44.643565+0000","last_peered":"2023-10-18T12:19:44.643565+0000","last_clean":"2023-10-18T12:19:44.643565+0000","last_became_active":"2023-10-18T12:19:43.673105+0000","last_became_peered":"2023-10-18T12:19:43.673105+0000","last_unstale":"2023-10-18T12:19:44.643565+0000","last_undegraded":"2023-10-18T12:19:44.643565+0000","last_fullsized":"2023-10-18T12:19:44.643565+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:25:02.951956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643788+0000","last_change":"2023-10-18T12:19:39.620976+0000","last_active":"2023-10-18T12:19:44.643788+0000","last_peered":"2023-10-18T12:19:44.643788+0000","last_clean":"2023-10-18T12:19:44.643788+0000","last_became_active":"2023-10-18T12:19:39.620577+0000","last_became_peered":"2023-10-18T12:19:39.620577+0000","last_unstale":"2023-10-18T12:19:44.643788+0000","last_undegraded":"2023-10-18T12:19:44.643788+0000","last_fullsized":"2023-10-18T12:19:44.643788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:49:00.051251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.646821+0000","last_change":"2023-10-18T12:19:33.529329+0000","last_active":"2023-10-18T12:19:44.646821+0000","last_peered":"2023-10-18T12:19:44.646821+0000","last_clean":"2023-10-18T12:19:44.646821+0000","last_became_active":"2023-10-18T12:19:33.528930+0000","last_became_peered":"2023-10-18T12:19:33.528930+0000","last_unstale":"2023-10-18T12:19:44.646821+0000","last_undegraded":"2023-10-18T12:19:44.646821+0000","last_fullsized":"2023-10-18T12:19:44.646821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:59:29.698792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.646312+0000","last_change":"2023-10-18T12:19:38.602384+0000","last_active":"2023-10-18T12:19:44.646312+0000","last_peered":"2023-10-18T12:19:44.646312+0000","last_clean":"2023-10-18T12:19:44.646312+0000","last_became_active":"2023-10-18T12:19:38.602036+0000","last_became_peered":"2023-10-18T12:19:38.602036+0000","last_unstale":"2023-10-18T12:19:44.646312+0000","last_undegraded":"2023-10-18T12:19:44.646312+0000","last_fullsized":"2023-10-18T12:19:44.646312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:31:40.396673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695771+0000","last_change":"2023-10-18T12:19:43.665880+0000","last_active":"2023-10-18T12:19:44.695771+0000","last_peered":"2023-10-18T12:19:44.695771+0000","last_clean":"2023-10-18T12:19:44.695771+0000","last_became_active":"2023-10-18T12:19:43.665304+0000","last_became_peered":"2023-10-18T12:19:43.665304+0000","last_unstale":"2023-10-18T12:19:44.695771+0000","last_undegraded":"2023-10-18T12:19:44.695771+0000","last_fullsized":"2023-10-18T12:19:44.695771+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:41:00.366869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696091+0000","last_change":"2023-10-18T12:19:39.610495+0000","last_active":"2023-10-18T12:19:44.696091+0000","last_peered":"2023-10-18T12:19:44.696091+0000","last_clean":"2023-10-18T12:19:44.696091+0000","last_became_active":"2023-10-18T12:19:39.610070+0000","last_became_peered":"2023-10-18T12:19:39.610070+0000","last_unstale":"2023-10-18T12:19:44.696091+0000","last_undegraded":"2023-10-18T12:19:44.696091+0000","last_fullsized":"2023-10-18T12:19:44.696091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:49:00.051251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643554+0000","last_change":"2023-10-18T12:19:33.703565+0000","last_active":"2023-10-18T12:19:44.643554+0000","last_peered":"2023-10-18T12:19:44.643554+0000","last_clean":"2023-10-18T12:19:44.643554+0000","last_became_active":"2023-10-18T12:19:33.703276+0000","last_became_peered":"2023-10-18T12:19:33.703276+0000","last_unstale":"2023-10-18T12:19:44.643554+0000","last_undegraded":"2023-10-18T12:19:44.643554+0000","last_fullsized":"2023-10-18T12:19:44.643554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:42:02.281340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645909+0000","last_change":"2023-10-18T12:19:38.596831+0000","last_active":"2023-10-18T12:19:44.645909+0000","last_peered":"2023-10-18T12:19:44.645909+0000","last_clean":"2023-10-18T12:19:44.645909+0000","last_became_active":"2023-10-18T12:19:38.595274+0000","last_became_peered":"2023-10-18T12:19:38.595274+0000","last_unstale":"2023-10-18T12:19:44.645909+0000","last_undegraded":"2023-10-18T12:19:44.645909+0000","last_fullsized":"2023-10-18T12:19:44.645909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:43:42.560410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697865+0000","last_change":"2023-10-18T12:19:43.684545+0000","last_active":"2023-10-18T12:19:44.697865+0000","last_peered":"2023-10-18T12:19:44.697865+0000","last_clean":"2023-10-18T12:19:44.697865+0000","last_became_active":"2023-10-18T12:19:43.684147+0000","last_became_peered":"2023-10-18T12:19:43.684147+0000","last_unstale":"2023-10-18T12:19:44.697865+0000","last_undegraded":"2023-10-18T12:19:44.697865+0000","last_fullsized":"2023-10-18T12:19:44.697865+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:35:30.070714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645280+0000","last_change":"2023-10-18T12:19:39.611289+0000","last_active":"2023-10-18T12:19:44.645280+0000","last_peered":"2023-10-18T12:19:44.645280+0000","last_clean":"2023-10-18T12:19:44.645280+0000","last_became_active":"2023-10-18T12:19:39.610978+0000","last_became_peered":"2023-10-18T12:19:39.610978+0000","last_unstale":"2023-10-18T12:19:44.645280+0000","last_undegraded":"2023-10-18T12:19:44.645280+0000","last_fullsized":"2023-10-18T12:19:44.645280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:34:44.895130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.646099+0000","last_change":"2023-10-18T12:19:33.703109+0000","last_active":"2023-10-18T12:19:44.646099+0000","last_peered":"2023-10-18T12:19:44.646099+0000","last_clean":"2023-10-18T12:19:44.646099+0000","last_became_active":"2023-10-18T12:19:33.702456+0000","last_became_peered":"2023-10-18T12:19:33.702456+0000","last_unstale":"2023-10-18T12:19:44.646099+0000","last_undegraded":"2023-10-18T12:19:44.646099+0000","last_fullsized":"2023-10-18T12:19:44.646099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:31:35.345173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698372+0000","last_change":"2023-10-18T12:19:38.608530+0000","last_active":"2023-10-18T12:19:44.698372+0000","last_peered":"2023-10-18T12:19:44.698372+0000","last_clean":"2023-10-18T12:19:44.698372+0000","last_became_active":"2023-10-18T12:19:38.608220+0000","last_became_peered":"2023-10-18T12:19:38.608220+0000","last_unstale":"2023-10-18T12:19:44.698372+0000","last_undegraded":"2023-10-18T12:19:44.698372+0000","last_fullsized":"2023-10-18T12:19:44.698372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:18:53.495055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695872+0000","last_change":"2023-10-18T12:19:43.675239+0000","last_active":"2023-10-18T12:19:44.695872+0000","last_peered":"2023-10-18T12:19:44.695872+0000","last_clean":"2023-10-18T12:19:44.695872+0000","last_became_active":"2023-10-18T12:19:43.674815+0000","last_became_peered":"2023-10-18T12:19:43.674815+0000","last_unstale":"2023-10-18T12:19:44.695872+0000","last_undegraded":"2023-10-18T12:19:44.695872+0000","last_fullsized":"2023-10-18T12:19:44.695872+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:31:28.157512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645878+0000","last_change":"2023-10-18T12:19:39.603090+0000","last_active":"2023-10-18T12:19:44.645878+0000","last_peered":"2023-10-18T12:19:44.645878+0000","last_clean":"2023-10-18T12:19:44.645878+0000","last_became_active":"2023-10-18T12:19:39.602663+0000","last_became_peered":"2023-10-18T12:19:39.602663+0000","last_unstale":"2023-10-18T12:19:44.645878+0000","last_undegraded":"2023-10-18T12:19:44.645878+0000","last_fullsized":"2023-10-18T12:19:44.645878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:38:42.744745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698813+0000","last_change":"2023-10-18T12:19:38.605786+0000","last_active":"2023-10-18T12:19:44.698813+0000","last_peered":"2023-10-18T12:19:44.698813+0000","last_clean":"2023-10-18T12:19:44.698813+0000","last_became_active":"2023-10-18T12:19:38.605372+0000","last_became_peered":"2023-10-18T12:19:38.605372+0000","last_unstale":"2023-10-18T12:19:44.698813+0000","last_undegraded":"2023-10-18T12:19:44.698813+0000","last_fullsized":"2023-10-18T12:19:44.698813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:50:26.536151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696981+0000","last_change":"2023-10-18T12:19:33.533449+0000","last_active":"2023-10-18T12:19:44.696981+0000","last_peered":"2023-10-18T12:19:44.696981+0000","last_clean":"2023-10-18T12:19:44.696981+0000","last_became_active":"2023-10-18T12:19:33.533051+0000","last_became_peered":"2023-10-18T12:19:33.533051+0000","last_unstale":"2023-10-18T12:19:44.696981+0000","last_undegraded":"2023-10-18T12:19:44.696981+0000","last_fullsized":"2023-10-18T12:19:44.696981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:59:40.600580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696368+0000","last_change":"2023-10-18T12:19:43.667926+0000","last_active":"2023-10-18T12:19:44.696368+0000","last_peered":"2023-10-18T12:19:44.696368+0000","last_clean":"2023-10-18T12:19:44.696368+0000","last_became_active":"2023-10-18T12:19:43.663720+0000","last_became_peered":"2023-10-18T12:19:43.663720+0000","last_unstale":"2023-10-18T12:19:44.696368+0000","last_undegraded":"2023-10-18T12:19:44.696368+0000","last_fullsized":"2023-10-18T12:19:44.696368+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:45.224238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.646131+0000","last_change":"2023-10-18T12:19:39.611317+0000","last_active":"2023-10-18T12:19:44.646131+0000","last_peered":"2023-10-18T12:19:44.646131+0000","last_clean":"2023-10-18T12:19:44.646131+0000","last_became_active":"2023-10-18T12:19:39.610493+0000","last_became_peered":"2023-10-18T12:19:39.610493+0000","last_unstale":"2023-10-18T12:19:44.646131+0000","last_undegraded":"2023-10-18T12:19:44.646131+0000","last_fullsized":"2023-10-18T12:19:44.646131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:05:32.356553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.644024+0000","last_change":"2023-10-18T12:19:38.600081+0000","last_active":"2023-10-18T12:19:44.644024+0000","last_peered":"2023-10-18T12:19:44.644024+0000","last_clean":"2023-10-18T12:19:44.644024+0000","last_became_active":"2023-10-18T12:19:38.599770+0000","last_became_peered":"2023-10-18T12:19:38.599770+0000","last_unstale":"2023-10-18T12:19:44.644024+0000","last_undegraded":"2023-10-18T12:19:44.644024+0000","last_fullsized":"2023-10-18T12:19:44.644024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:40.156462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.694556+0000","last_change":"2023-10-18T12:19:33.530766+0000","last_active":"2023-10-18T12:19:44.694556+0000","last_peered":"2023-10-18T12:19:44.694556+0000","last_clean":"2023-10-18T12:19:44.694556+0000","last_became_active":"2023-10-18T12:19:33.530346+0000","last_became_peered":"2023-10-18T12:19:33.530346+0000","last_unstale":"2023-10-18T12:19:44.694556+0000","last_undegraded":"2023-10-18T12:19:44.694556+0000","last_fullsized":"2023-10-18T12:19:44.694556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:37:23.298891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697536+0000","last_change":"2023-10-18T12:19:43.670666+0000","last_active":"2023-10-18T12:19:44.697536+0000","last_peered":"2023-10-18T12:19:44.697536+0000","last_clean":"2023-10-18T12:19:44.697536+0000","last_became_active":"2023-10-18T12:19:43.667345+0000","last_became_peered":"2023-10-18T12:19:43.667345+0000","last_unstale":"2023-10-18T12:19:44.697536+0000","last_undegraded":"2023-10-18T12:19:44.697536+0000","last_fullsized":"2023-10-18T12:19:44.697536+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:49:32.050231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696679+0000","last_change":"2023-10-18T12:19:39.619910+0000","last_active":"2023-10-18T12:19:44.696679+0000","last_peered":"2023-10-18T12:19:44.696679+0000","last_clean":"2023-10-18T12:19:44.696679+0000","last_became_active":"2023-10-18T12:19:39.619657+0000","last_became_peered":"2023-10-18T12:19:39.619657+0000","last_unstale":"2023-10-18T12:19:44.696679+0000","last_undegraded":"2023-10-18T12:19:44.696679+0000","last_fullsized":"2023-10-18T12:19:44.696679+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:59:46.662013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695598+0000","last_change":"2023-10-18T12:19:38.605421+0000","last_active":"2023-10-18T12:19:44.695598+0000","last_peered":"2023-10-18T12:19:44.695598+0000","last_clean":"2023-10-18T12:19:44.695598+0000","last_became_active":"2023-10-18T12:19:38.605087+0000","last_became_peered":"2023-10-18T12:19:38.605087+0000","last_unstale":"2023-10-18T12:19:44.695598+0000","last_undegraded":"2023-10-18T12:19:44.695598+0000","last_fullsized":"2023-10-18T12:19:44.695598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:24:57.884181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.642271+0000","last_change":"2023-10-18T12:19:33.528538+0000","last_active":"2023-10-18T12:19:44.642271+0000","last_peered":"2023-10-18T12:19:44.642271+0000","last_clean":"2023-10-18T12:19:44.642271+0000","last_became_active":"2023-10-18T12:19:33.528214+0000","last_became_peered":"2023-10-18T12:19:33.528214+0000","last_unstale":"2023-10-18T12:19:44.642271+0000","last_undegraded":"2023-10-18T12:19:44.642271+0000","last_fullsized":"2023-10-18T12:19:44.642271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:16:35.962010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697181+0000","last_change":"2023-10-18T12:19:43.676292+0000","last_active":"2023-10-18T12:19:44.697181+0000","last_peered":"2023-10-18T12:19:44.697181+0000","last_clean":"2023-10-18T12:19:44.697181+0000","last_became_active":"2023-10-18T12:19:43.674659+0000","last_became_peered":"2023-10-18T12:19:43.674659+0000","last_unstale":"2023-10-18T12:19:44.697181+0000","last_undegraded":"2023-10-18T12:19:44.697181+0000","last_fullsized":"2023-10-18T12:19:44.697181+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:33:03.308142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.699094+0000","last_change":"2023-10-18T12:19:39.623370+0000","last_active":"2023-10-18T12:19:44.699094+0000","last_peered":"2023-10-18T12:19:44.699094+0000","last_clean":"2023-10-18T12:19:44.699094+0000","last_became_active":"2023-10-18T12:19:39.623099+0000","last_became_peered":"2023-10-18T12:19:39.623099+0000","last_unstale":"2023-10-18T12:19:44.699094+0000","last_undegraded":"2023-10-18T12:19:44.699094+0000","last_fullsized":"2023-10-18T12:19:44.699094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:08:54.031805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.644370+0000","last_change":"2023-10-18T12:19:38.601266+0000","last_active":"2023-10-18T12:19:44.644370+0000","last_peered":"2023-10-18T12:19:44.644370+0000","last_clean":"2023-10-18T12:19:44.644370+0000","last_became_active":"2023-10-18T12:19:38.600945+0000","last_became_peered":"2023-10-18T12:19:38.600945+0000","last_unstale":"2023-10-18T12:19:44.644370+0000","last_undegraded":"2023-10-18T12:19:44.644370+0000","last_fullsized":"2023-10-18T12:19:44.644370+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:23:36.720579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697162+0000","last_change":"2023-10-18T12:19:33.531214+0000","last_active":"2023-10-18T12:19:44.697162+0000","last_peered":"2023-10-18T12:19:44.697162+0000","last_clean":"2023-10-18T12:19:44.697162+0000","last_became_active":"2023-10-18T12:19:33.530795+0000","last_became_peered":"2023-10-18T12:19:33.530795+0000","last_unstale":"2023-10-18T12:19:44.697162+0000","last_undegraded":"2023-10-18T12:19:44.697162+0000","last_fullsized":"2023-10-18T12:19:44.697162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:08:55.341156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":181,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.642373+0000","last_change":"2023-10-18T12:19:28.825371+0000","last_active":"2023-10-18T12:19:44.642373+0000","last_peered":"2023-10-18T12:19:44.642373+0000","last_clean":"2023-10-18T12:19:44.642373+0000","last_became_active":"2023-10-18T12:19:28.822484+0000","last_became_peered":"2023-10-18T12:19:28.822484+0000","last_unstale":"2023-10-18T12:19:44.642373+0000","last_undegraded":"2023-10-18T12:19:44.642373+0000","last_fullsized":"2023-10-18T12:19:44.642373+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:27.318899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:27.318899+0000","last_clean_scrub_stamp":"2023-10-18T12:19:27.318899+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:18:14.674282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643196+0000","last_change":"2023-10-18T12:19:43.657137+0000","last_active":"2023-10-18T12:19:44.643196+0000","last_peered":"2023-10-18T12:19:44.643196+0000","last_clean":"2023-10-18T12:19:44.643196+0000","last_became_active":"2023-10-18T12:19:43.656656+0000","last_became_peered":"2023-10-18T12:19:43.656656+0000","last_unstale":"2023-10-18T12:19:44.643196+0000","last_undegraded":"2023-10-18T12:19:44.643196+0000","last_fullsized":"2023-10-18T12:19:44.643196+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:38:46.802588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.646062+0000","last_change":"2023-10-18T12:19:39.616876+0000","last_active":"2023-10-18T12:19:44.646062+0000","last_peered":"2023-10-18T12:19:44.646062+0000","last_clean":"2023-10-18T12:19:44.646062+0000","last_became_active":"2023-10-18T12:19:39.616565+0000","last_became_peered":"2023-10-18T12:19:39.616565+0000","last_unstale":"2023-10-18T12:19:44.646062+0000","last_undegraded":"2023-10-18T12:19:44.646062+0000","last_fullsized":"2023-10-18T12:19:44.646062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:42:08.342773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643925+0000","last_change":"2023-10-18T12:19:38.594539+0000","last_active":"2023-10-18T12:19:44.643925+0000","last_peered":"2023-10-18T12:19:44.643925+0000","last_clean":"2023-10-18T12:19:44.643925+0000","last_became_active":"2023-10-18T12:19:38.594225+0000","last_became_peered":"2023-10-18T12:19:38.594225+0000","last_unstale":"2023-10-18T12:19:44.643925+0000","last_undegraded":"2023-10-18T12:19:44.643925+0000","last_fullsized":"2023-10-18T12:19:44.643925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:16:41.013510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.700323+0000","last_change":"2023-10-18T12:19:43.671582+0000","last_active":"2023-10-18T12:19:44.700323+0000","last_peered":"2023-10-18T12:19:44.700323+0000","last_clean":"2023-10-18T12:19:44.700323+0000","last_became_active":"2023-10-18T12:19:43.671279+0000","last_became_peered":"2023-10-18T12:19:43.671279+0000","last_unstale":"2023-10-18T12:19:44.700323+0000","last_undegraded":"2023-10-18T12:19:44.700323+0000","last_fullsized":"2023-10-18T12:19:44.700323+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:54:13.369092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.700346+0000","last_change":"2023-10-18T12:19:39.624301+0000","last_active":"2023-10-18T12:19:44.700346+0000","last_peered":"2023-10-18T12:19:44.700346+0000","last_clean":"2023-10-18T12:19:44.700346+0000","last_became_active":"2023-10-18T12:19:39.624019+0000","last_became_peered":"2023-10-18T12:19:39.624019+0000","last_unstale":"2023-10-18T12:19:44.700346+0000","last_undegraded":"2023-10-18T12:19:44.700346+0000","last_fullsized":"2023-10-18T12:19:44.700346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:21:14.469134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696174+0000","last_change":"2023-10-18T12:19:38.605246+0000","last_active":"2023-10-18T12:19:44.696174+0000","last_peered":"2023-10-18T12:19:44.696174+0000","last_clean":"2023-10-18T12:19:44.696174+0000","last_became_active":"2023-10-18T12:19:38.604738+0000","last_became_peered":"2023-10-18T12:19:38.604738+0000","last_unstale":"2023-10-18T12:19:44.696174+0000","last_undegraded":"2023-10-18T12:19:44.696174+0000","last_fullsized":"2023-10-18T12:19:44.696174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:00:56.609231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696949+0000","last_change":"2023-10-18T12:19:43.682631+0000","last_active":"2023-10-18T12:19:44.696949+0000","last_peered":"2023-10-18T12:19:44.696949+0000","last_clean":"2023-10-18T12:19:44.696949+0000","last_became_active":"2023-10-18T12:19:43.681887+0000","last_became_peered":"2023-10-18T12:19:43.681887+0000","last_unstale":"2023-10-18T12:19:44.696949+0000","last_undegraded":"2023-10-18T12:19:44.696949+0000","last_fullsized":"2023-10-18T12:19:44.696949+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:23:41.788355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.700050+0000","last_change":"2023-10-18T12:19:39.611350+0000","last_active":"2023-10-18T12:19:44.700050+0000","last_peered":"2023-10-18T12:19:44.700050+0000","last_clean":"2023-10-18T12:19:44.700050+0000","last_became_active":"2023-10-18T12:19:39.610723+0000","last_became_peered":"2023-10-18T12:19:39.610723+0000","last_unstale":"2023-10-18T12:19:44.700050+0000","last_undegraded":"2023-10-18T12:19:44.700050+0000","last_fullsized":"2023-10-18T12:19:44.700050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:06:02.990692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698303+0000","last_change":"2023-10-18T12:19:38.606971+0000","last_active":"2023-10-18T12:19:44.698303+0000","last_peered":"2023-10-18T12:19:44.698303+0000","last_clean":"2023-10-18T12:19:44.698303+0000","last_became_active":"2023-10-18T12:19:38.606625+0000","last_became_peered":"2023-10-18T12:19:38.606625+0000","last_unstale":"2023-10-18T12:19:44.698303+0000","last_undegraded":"2023-10-18T12:19:44.698303+0000","last_fullsized":"2023-10-18T12:19:44.698303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:28:59.066223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645449+0000","last_change":"2023-10-18T12:19:43.674060+0000","last_active":"2023-10-18T12:19:44.645449+0000","last_peered":"2023-10-18T12:19:44.645449+0000","last_clean":"2023-10-18T12:19:44.645449+0000","last_became_active":"2023-10-18T12:19:43.672680+0000","last_became_peered":"2023-10-18T12:19:43.672680+0000","last_unstale":"2023-10-18T12:19:44.645449+0000","last_undegraded":"2023-10-18T12:19:44.645449+0000","last_fullsized":"2023-10-18T12:19:44.645449+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:33:03.308142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.699845+0000","last_change":"2023-10-18T12:19:39.620744+0000","last_active":"2023-10-18T12:19:44.699845+0000","last_peered":"2023-10-18T12:19:44.699845+0000","last_clean":"2023-10-18T12:19:44.699845+0000","last_became_active":"2023-10-18T12:19:39.619969+0000","last_became_peered":"2023-10-18T12:19:39.619969+0000","last_unstale":"2023-10-18T12:19:44.699845+0000","last_undegraded":"2023-10-18T12:19:44.699845+0000","last_fullsized":"2023-10-18T12:19:44.699845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:49:43.494684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.644662+0000","last_change":"2023-10-18T12:19:38.602475+0000","last_active":"2023-10-18T12:19:44.644662+0000","last_peered":"2023-10-18T12:19:44.644662+0000","last_clean":"2023-10-18T12:19:44.644662+0000","last_became_active":"2023-10-18T12:19:38.602195+0000","last_became_peered":"2023-10-18T12:19:38.602195+0000","last_unstale":"2023-10-18T12:19:44.644662+0000","last_undegraded":"2023-10-18T12:19:44.644662+0000","last_fullsized":"2023-10-18T12:19:44.644662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:32:58.240366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696887+0000","last_change":"2023-10-18T12:19:43.682795+0000","last_active":"2023-10-18T12:19:44.696887+0000","last_peered":"2023-10-18T12:19:44.696887+0000","last_clean":"2023-10-18T12:19:44.696887+0000","last_became_active":"2023-10-18T12:19:43.680710+0000","last_became_peered":"2023-10-18T12:19:43.680710+0000","last_unstale":"2023-10-18T12:19:44.696887+0000","last_undegraded":"2023-10-18T12:19:44.696887+0000","last_fullsized":"2023-10-18T12:19:44.696887+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:00:53.354798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695979+0000","last_change":"2023-10-18T12:19:39.620575+0000","last_active":"2023-10-18T12:19:44.695979+0000","last_peered":"2023-10-18T12:19:44.695979+0000","last_clean":"2023-10-18T12:19:44.695979+0000","last_became_active":"2023-10-18T12:19:39.620291+0000","last_became_peered":"2023-10-18T12:19:39.620291+0000","last_unstale":"2023-10-18T12:19:44.695979+0000","last_undegraded":"2023-10-18T12:19:44.695979+0000","last_fullsized":"2023-10-18T12:19:44.695979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:08:55.947222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698645+0000","last_change":"2023-10-18T12:19:38.607039+0000","last_active":"2023-10-18T12:19:44.698645+0000","last_peered":"2023-10-18T12:19:44.698645+0000","last_clean":"2023-10-18T12:19:44.698645+0000","last_became_active":"2023-10-18T12:19:38.606732+0000","last_became_peered":"2023-10-18T12:19:38.606732+0000","last_unstale":"2023-10-18T12:19:44.698645+0000","last_undegraded":"2023-10-18T12:19:44.698645+0000","last_fullsized":"2023-10-18T12:19:44.698645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:59:34.750292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695219+0000","last_change":"2023-10-18T12:19:43.670138+0000","last_active":"2023-10-18T12:19:44.695219+0000","last_peered":"2023-10-18T12:19:44.695219+0000","last_clean":"2023-10-18T12:19:44.695219+0000","last_became_active":"2023-10-18T12:19:43.665610+0000","last_became_peered":"2023-10-18T12:19:43.665610+0000","last_unstale":"2023-10-18T12:19:44.695219+0000","last_undegraded":"2023-10-18T12:19:44.695219+0000","last_fullsized":"2023-10-18T12:19:44.695219+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:28:00.580454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697978+0000","last_change":"2023-10-18T12:19:39.595036+0000","last_active":"2023-10-18T12:19:44.697978+0000","last_peered":"2023-10-18T12:19:44.697978+0000","last_clean":"2023-10-18T12:19:44.697978+0000","last_became_active":"2023-10-18T12:19:39.594790+0000","last_became_peered":"2023-10-18T12:19:39.594790+0000","last_unstale":"2023-10-18T12:19:44.697978+0000","last_undegraded":"2023-10-18T12:19:44.697978+0000","last_fullsized":"2023-10-18T12:19:44.697978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:36:35.120486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643398+0000","last_change":"2023-10-18T12:19:38.600268+0000","last_active":"2023-10-18T12:19:44.643398+0000","last_peered":"2023-10-18T12:19:44.643398+0000","last_clean":"2023-10-18T12:19:44.643398+0000","last_became_active":"2023-10-18T12:19:38.599435+0000","last_became_peered":"2023-10-18T12:19:38.599435+0000","last_unstale":"2023-10-18T12:19:44.643398+0000","last_undegraded":"2023-10-18T12:19:44.643398+0000","last_fullsized":"2023-10-18T12:19:44.643398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:58:15.868092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.694660+0000","last_change":"2023-10-18T12:19:43.670918+0000","last_active":"2023-10-18T12:19:44.694660+0000","last_peered":"2023-10-18T12:19:44.694660+0000","last_clean":"2023-10-18T12:19:44.694660+0000","last_became_active":"2023-10-18T12:19:43.670175+0000","last_became_peered":"2023-10-18T12:19:43.670175+0000","last_unstale":"2023-10-18T12:19:44.694660+0000","last_undegraded":"2023-10-18T12:19:44.694660+0000","last_fullsized":"2023-10-18T12:19:44.694660+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:44:28.672709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696009+0000","last_change":"2023-10-18T12:19:39.610440+0000","last_active":"2023-10-18T12:19:44.696009+0000","last_peered":"2023-10-18T12:19:44.696009+0000","last_clean":"2023-10-18T12:19:44.696009+0000","last_became_active":"2023-10-18T12:19:39.610144+0000","last_became_peered":"2023-10-18T12:19:39.610144+0000","last_unstale":"2023-10-18T12:19:44.696009+0000","last_undegraded":"2023-10-18T12:19:44.696009+0000","last_fullsized":"2023-10-18T12:19:44.696009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:53:47.232582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.644062+0000","last_change":"2023-10-18T12:19:38.605732+0000","last_active":"2023-10-18T12:19:44.644062+0000","last_peered":"2023-10-18T12:19:44.644062+0000","last_clean":"2023-10-18T12:19:44.644062+0000","last_became_active":"2023-10-18T12:19:38.605308+0000","last_became_peered":"2023-10-18T12:19:38.605308+0000","last_unstale":"2023-10-18T12:19:44.644062+0000","last_undegraded":"2023-10-18T12:19:44.644062+0000","last_fullsized":"2023-10-18T12:19:44.644062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:31:40.396673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.694490+0000","last_change":"2023-10-18T12:19:43.670657+0000","last_active":"2023-10-18T12:19:44.694490+0000","last_peered":"2023-10-18T12:19:44.694490+0000","last_clean":"2023-10-18T12:19:44.694490+0000","last_became_active":"2023-10-18T12:19:43.670163+0000","last_became_peered":"2023-10-18T12:19:43.670163+0000","last_unstale":"2023-10-18T12:19:44.694490+0000","last_undegraded":"2023-10-18T12:19:44.694490+0000","last_fullsized":"2023-10-18T12:19:44.694490+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:34:08.780931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695903+0000","last_change":"2023-10-18T12:19:39.602738+0000","last_active":"2023-10-18T12:19:44.695903+0000","last_peered":"2023-10-18T12:19:44.695903+0000","last_clean":"2023-10-18T12:19:44.695903+0000","last_became_active":"2023-10-18T12:19:39.602448+0000","last_became_peered":"2023-10-18T12:19:39.602448+0000","last_unstale":"2023-10-18T12:19:44.695903+0000","last_undegraded":"2023-10-18T12:19:44.695903+0000","last_fullsized":"2023-10-18T12:19:44.695903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:16:42.023443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.644202+0000","last_change":"2023-10-18T12:19:38.603192+0000","last_active":"2023-10-18T12:19:44.644202+0000","last_peered":"2023-10-18T12:19:44.644202+0000","last_clean":"2023-10-18T12:19:44.644202+0000","last_became_active":"2023-10-18T12:19:38.602904+0000","last_became_peered":"2023-10-18T12:19:38.602904+0000","last_unstale":"2023-10-18T12:19:44.644202+0000","last_undegraded":"2023-10-18T12:19:44.644202+0000","last_fullsized":"2023-10-18T12:19:44.644202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:05:31.346619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.642394+0000","last_change":"2023-10-18T12:19:43.664334+0000","last_active":"2023-10-18T12:19:44.642394+0000","last_peered":"2023-10-18T12:19:44.642394+0000","last_clean":"2023-10-18T12:19:44.642394+0000","last_became_active":"2023-10-18T12:19:43.663249+0000","last_became_peered":"2023-10-18T12:19:43.663249+0000","last_unstale":"2023-10-18T12:19:44.642394+0000","last_undegraded":"2023-10-18T12:19:44.642394+0000","last_fullsized":"2023-10-18T12:19:44.642394+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:45.224238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696836+0000","last_change":"2023-10-18T12:19:43.672616+0000","last_active":"2023-10-18T12:19:44.696836+0000","last_peered":"2023-10-18T12:19:44.696836+0000","last_clean":"2023-10-18T12:19:44.696836+0000","last_became_active":"2023-10-18T12:19:43.672218+0000","last_became_peered":"2023-10-18T12:19:43.672218+0000","last_unstale":"2023-10-18T12:19:44.696836+0000","last_undegraded":"2023-10-18T12:19:44.696836+0000","last_fullsized":"2023-10-18T12:19:44.696836+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:18:29.969594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698410+0000","last_change":"2023-10-18T12:19:38.592225+0000","last_active":"2023-10-18T12:19:44.698410+0000","last_peered":"2023-10-18T12:19:44.698410+0000","last_clean":"2023-10-18T12:19:44.698410+0000","last_became_active":"2023-10-18T12:19:38.591941+0000","last_became_peered":"2023-10-18T12:19:38.591941+0000","last_unstale":"2023-10-18T12:19:44.698410+0000","last_undegraded":"2023-10-18T12:19:44.698410+0000","last_fullsized":"2023-10-18T12:19:44.698410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:28:52.287011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.646062+0000","last_change":"2023-10-18T12:19:39.611861+0000","last_active":"2023-10-18T12:19:44.646062+0000","last_peered":"2023-10-18T12:19:44.646062+0000","last_clean":"2023-10-18T12:19:44.646062+0000","last_became_active":"2023-10-18T12:19:39.611576+0000","last_became_peered":"2023-10-18T12:19:39.611576+0000","last_unstale":"2023-10-18T12:19:44.646062+0000","last_undegraded":"2023-10-18T12:19:44.646062+0000","last_fullsized":"2023-10-18T12:19:44.646062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:42:08.342773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645692+0000","last_change":"2023-10-18T12:19:43.671295+0000","last_active":"2023-10-18T12:19:44.645692+0000","last_peered":"2023-10-18T12:19:44.645692+0000","last_clean":"2023-10-18T12:19:44.645692+0000","last_became_active":"2023-10-18T12:19:43.667280+0000","last_became_peered":"2023-10-18T12:19:43.667280+0000","last_unstale":"2023-10-18T12:19:44.645692+0000","last_undegraded":"2023-10-18T12:19:44.645692+0000","last_fullsized":"2023-10-18T12:19:44.645692+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:58:20.935868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.642799+0000","last_change":"2023-10-18T12:19:38.608977+0000","last_active":"2023-10-18T12:19:44.642799+0000","last_peered":"2023-10-18T12:19:44.642799+0000","last_clean":"2023-10-18T12:19:44.642799+0000","last_became_active":"2023-10-18T12:19:38.608614+0000","last_became_peered":"2023-10-18T12:19:38.608614+0000","last_unstale":"2023-10-18T12:19:44.642799+0000","last_undegraded":"2023-10-18T12:19:44.642799+0000","last_fullsized":"2023-10-18T12:19:44.642799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:34:43.885197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696721+0000","last_change":"2023-10-18T12:19:39.626624+0000","last_active":"2023-10-18T12:19:44.696721+0000","last_peered":"2023-10-18T12:19:44.696721+0000","last_clean":"2023-10-18T12:19:44.696721+0000","last_became_active":"2023-10-18T12:19:39.626353+0000","last_became_peered":"2023-10-18T12:19:39.626353+0000","last_unstale":"2023-10-18T12:19:44.696721+0000","last_undegraded":"2023-10-18T12:19:44.696721+0000","last_fullsized":"2023-10-18T12:19:44.696721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:38:42.744745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695480+0000","last_change":"2023-10-18T12:19:38.607392+0000","last_active":"2023-10-18T12:19:44.695480+0000","last_peered":"2023-10-18T12:19:44.695480+0000","last_clean":"2023-10-18T12:19:44.695480+0000","last_became_active":"2023-10-18T12:19:38.607074+0000","last_became_peered":"2023-10-18T12:19:38.607074+0000","last_unstale":"2023-10-18T12:19:44.695480+0000","last_undegraded":"2023-10-18T12:19:44.695480+0000","last_fullsized":"2023-10-18T12:19:44.695480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:39:22.962723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697929+0000","last_change":"2023-10-18T12:19:39.612978+0000","last_active":"2023-10-18T12:19:44.697929+0000","last_peered":"2023-10-18T12:19:44.697929+0000","last_clean":"2023-10-18T12:19:44.697929+0000","last_became_active":"2023-10-18T12:19:39.612414+0000","last_became_peered":"2023-10-18T12:19:39.612414+0000","last_unstale":"2023-10-18T12:19:44.697929+0000","last_undegraded":"2023-10-18T12:19:44.697929+0000","last_fullsized":"2023-10-18T12:19:44.697929+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:31:41.406606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.644993+0000","last_change":"2023-10-18T12:19:43.663874+0000","last_active":"2023-10-18T12:19:44.644993+0000","last_peered":"2023-10-18T12:19:44.644993+0000","last_clean":"2023-10-18T12:19:44.644993+0000","last_became_active":"2023-10-18T12:19:43.663482+0000","last_became_peered":"2023-10-18T12:19:43.663482+0000","last_unstale":"2023-10-18T12:19:44.644993+0000","last_undegraded":"2023-10-18T12:19:44.644993+0000","last_fullsized":"2023-10-18T12:19:44.644993+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:09:05.460432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643120+0000","last_change":"2023-10-18T12:19:38.608908+0000","last_active":"2023-10-18T12:19:44.643120+0000","last_peered":"2023-10-18T12:19:44.643120+0000","last_clean":"2023-10-18T12:19:44.643120+0000","last_became_active":"2023-10-18T12:19:38.608598+0000","last_became_peered":"2023-10-18T12:19:38.608598+0000","last_unstale":"2023-10-18T12:19:44.643120+0000","last_undegraded":"2023-10-18T12:19:44.643120+0000","last_fullsized":"2023-10-18T12:19:44.643120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:09:00.392656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645413+0000","last_change":"2023-10-18T12:19:39.610765+0000","last_active":"2023-10-18T12:19:44.645413+0000","last_peered":"2023-10-18T12:19:44.645413+0000","last_clean":"2023-10-18T12:19:44.645413+0000","last_became_active":"2023-10-18T12:19:39.610487+0000","last_became_peered":"2023-10-18T12:19:39.610487+0000","last_unstale":"2023-10-18T12:19:44.645413+0000","last_undegraded":"2023-10-18T12:19:44.645413+0000","last_fullsized":"2023-10-18T12:19:44.645413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:38:42.744745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697522+0000","last_change":"2023-10-18T12:19:43.676251+0000","last_active":"2023-10-18T12:19:44.697522+0000","last_peered":"2023-10-18T12:19:44.697522+0000","last_clean":"2023-10-18T12:19:44.697522+0000","last_became_active":"2023-10-18T12:19:43.675875+0000","last_became_peered":"2023-10-18T12:19:43.675875+0000","last_unstale":"2023-10-18T12:19:44.697522+0000","last_undegraded":"2023-10-18T12:19:44.697522+0000","last_fullsized":"2023-10-18T12:19:44.697522+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:43:47.628186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698036+0000","last_change":"2023-10-18T12:19:39.606335+0000","last_active":"2023-10-18T12:19:44.698036+0000","last_peered":"2023-10-18T12:19:44.698036+0000","last_clean":"2023-10-18T12:19:44.698036+0000","last_became_active":"2023-10-18T12:19:39.604624+0000","last_became_peered":"2023-10-18T12:19:39.604624+0000","last_unstale":"2023-10-18T12:19:44.698036+0000","last_undegraded":"2023-10-18T12:19:44.698036+0000","last_fullsized":"2023-10-18T12:19:44.698036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:00:59.306651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643934+0000","last_change":"2023-10-18T12:19:39.622414+0000","last_active":"2023-10-18T12:19:44.643934+0000","last_peered":"2023-10-18T12:19:44.643934+0000","last_clean":"2023-10-18T12:19:44.643934+0000","last_became_active":"2023-10-18T12:19:39.622099+0000","last_became_peered":"2023-10-18T12:19:39.622099+0000","last_unstale":"2023-10-18T12:19:44.643934+0000","last_undegraded":"2023-10-18T12:19:44.643934+0000","last_fullsized":"2023-10-18T12:19:44.643934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:41.166395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697300+0000","last_change":"2023-10-18T12:19:39.614498+0000","last_active":"2023-10-18T12:19:44.697300+0000","last_peered":"2023-10-18T12:19:44.697300+0000","last_clean":"2023-10-18T12:19:44.697300+0000","last_became_active":"2023-10-18T12:19:39.614221+0000","last_became_peered":"2023-10-18T12:19:39.614221+0000","last_unstale":"2023-10-18T12:19:44.697300+0000","last_undegraded":"2023-10-18T12:19:44.697300+0000","last_fullsized":"2023-10-18T12:19:44.697300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:50:20.465384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.644520+0000","last_change":"2023-10-18T12:19:39.622751+0000","last_active":"2023-10-18T12:19:44.644520+0000","last_peered":"2023-10-18T12:19:44.644520+0000","last_clean":"2023-10-18T12:19:44.644520+0000","last_became_active":"2023-10-18T12:19:39.612445+0000","last_became_peered":"2023-10-18T12:19:39.612445+0000","last_unstale":"2023-10-18T12:19:44.644520+0000","last_undegraded":"2023-10-18T12:19:44.644520+0000","last_fullsized":"2023-10-18T12:19:44.644520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:59:46.662013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.646131+0000","last_change":"2023-10-18T12:19:39.597414+0000","last_active":"2023-10-18T12:19:44.646131+0000","last_peered":"2023-10-18T12:19:44.646131+0000","last_clean":"2023-10-18T12:19:44.646131+0000","last_became_active":"2023-10-18T12:19:39.597142+0000","last_became_peered":"2023-10-18T12:19:39.597142+0000","last_unstale":"2023-10-18T12:19:44.646131+0000","last_undegraded":"2023-10-18T12:19:44.646131+0000","last_fullsized":"2023-10-18T12:19:44.646131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:18:54.504988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697649+0000","last_change":"2023-10-18T12:19:39.613135+0000","last_active":"2023-10-18T12:19:44.697649+0000","last_peered":"2023-10-18T12:19:44.697649+0000","last_clean":"2023-10-18T12:19:44.697649+0000","last_became_active":"2023-10-18T12:19:39.612747+0000","last_became_peered":"2023-10-18T12:19:39.612747+0000","last_unstale":"2023-10-18T12:19:44.697649+0000","last_undegraded":"2023-10-18T12:19:44.697649+0000","last_fullsized":"2023-10-18T12:19:44.697649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:42:08.342773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.646717+0000","last_change":"2023-10-18T12:19:39.602816+0000","last_active":"2023-10-18T12:19:44.646717+0000","last_peered":"2023-10-18T12:19:44.646717+0000","last_clean":"2023-10-18T12:19:44.646717+0000","last_became_active":"2023-10-18T12:19:39.602561+0000","last_became_peered":"2023-10-18T12:19:39.602561+0000","last_unstale":"2023-10-18T12:19:44.646717+0000","last_undegraded":"2023-10-18T12:19:44.646717+0000","last_fullsized":"2023-10-18T12:19:44.646717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:36:41.193198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645988+0000","last_change":"2023-10-18T12:19:39.600714+0000","last_active":"2023-10-18T12:19:44.645988+0000","last_peered":"2023-10-18T12:19:44.645988+0000","last_clean":"2023-10-18T12:19:44.645988+0000","last_became_active":"2023-10-18T12:19:39.600450+0000","last_became_peered":"2023-10-18T12:19:39.600450+0000","last_unstale":"2023-10-18T12:19:44.645988+0000","last_undegraded":"2023-10-18T12:19:44.645988+0000","last_fullsized":"2023-10-18T12:19:44.645988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:58:16.878025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.642145+0000","last_change":"2023-10-18T12:19:39.627407+0000","last_active":"2023-10-18T12:19:44.642145+0000","last_peered":"2023-10-18T12:19:44.642145+0000","last_clean":"2023-10-18T12:19:44.642145+0000","last_became_active":"2023-10-18T12:19:39.626211+0000","last_became_peered":"2023-10-18T12:19:39.626211+0000","last_unstale":"2023-10-18T12:19:44.642145+0000","last_undegraded":"2023-10-18T12:19:44.642145+0000","last_fullsized":"2023-10-18T12:19:44.642145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:01:13.535689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643733+0000","last_change":"2023-10-18T12:19:39.625985+0000","last_active":"2023-10-18T12:19:44.643733+0000","last_peered":"2023-10-18T12:19:44.643733+0000","last_clean":"2023-10-18T12:19:44.643733+0000","last_became_active":"2023-10-18T12:19:39.625675+0000","last_became_peered":"2023-10-18T12:19:39.625675+0000","last_unstale":"2023-10-18T12:19:44.643733+0000","last_undegraded":"2023-10-18T12:19:44.643733+0000","last_fullsized":"2023-10-18T12:19:44.643733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:08:55.947222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695201+0000","last_change":"2023-10-18T12:19:39.612565+0000","last_active":"2023-10-18T12:19:44.695201+0000","last_peered":"2023-10-18T12:19:44.695201+0000","last_clean":"2023-10-18T12:19:44.695201+0000","last_became_active":"2023-10-18T12:19:39.612238+0000","last_became_peered":"2023-10-18T12:19:39.612238+0000","last_unstale":"2023-10-18T12:19:44.695201+0000","last_undegraded":"2023-10-18T12:19:44.695201+0000","last_fullsized":"2023-10-18T12:19:44.695201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:20:41.018432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643039+0000","last_change":"2023-10-18T12:19:39.616276+0000","last_active":"2023-10-18T12:19:44.643039+0000","last_peered":"2023-10-18T12:19:44.643039+0000","last_clean":"2023-10-18T12:19:44.643039+0000","last_became_active":"2023-10-18T12:19:39.615850+0000","last_became_peered":"2023-10-18T12:19:39.615850+0000","last_unstale":"2023-10-18T12:19:44.643039+0000","last_undegraded":"2023-10-18T12:19:44.643039+0000","last_fullsized":"2023-10-18T12:19:44.643039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:32:59.250300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.699707+0000","last_change":"2023-10-18T12:19:39.623264+0000","last_active":"2023-10-18T12:19:44.699707+0000","last_peered":"2023-10-18T12:19:44.699707+0000","last_clean":"2023-10-18T12:19:44.699707+0000","last_became_active":"2023-10-18T12:19:39.621265+0000","last_became_peered":"2023-10-18T12:19:39.621265+0000","last_unstale":"2023-10-18T12:19:44.699707+0000","last_undegraded":"2023-10-18T12:19:44.699707+0000","last_fullsized":"2023-10-18T12:19:44.699707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:14:52.587185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697048+0000","last_change":"2023-10-18T12:19:39.601465+0000","last_active":"2023-10-18T12:19:44.697048+0000","last_peered":"2023-10-18T12:19:44.697048+0000","last_clean":"2023-10-18T12:19:44.697048+0000","last_became_active":"2023-10-18T12:19:39.601166+0000","last_became_peered":"2023-10-18T12:19:39.601166+0000","last_unstale":"2023-10-18T12:19:44.697048+0000","last_undegraded":"2023-10-18T12:19:44.697048+0000","last_fullsized":"2023-10-18T12:19:44.697048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:49:10.530935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.700144+0000","last_change":"2023-10-18T12:19:39.623799+0000","last_active":"2023-10-18T12:19:44.700144+0000","last_peered":"2023-10-18T12:19:44.700144+0000","last_clean":"2023-10-18T12:19:44.700144+0000","last_became_active":"2023-10-18T12:19:39.623178+0000","last_became_peered":"2023-10-18T12:19:39.623178+0000","last_unstale":"2023-10-18T12:19:44.700144+0000","last_undegraded":"2023-10-18T12:19:44.700144+0000","last_fullsized":"2023-10-18T12:19:44.700144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:41:05.788100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697167+0000","last_change":"2023-10-18T12:19:39.626941+0000","last_active":"2023-10-18T12:19:44.697167+0000","last_peered":"2023-10-18T12:19:44.697167+0000","last_clean":"2023-10-18T12:19:44.697167+0000","last_became_active":"2023-10-18T12:19:39.626282+0000","last_became_peered":"2023-10-18T12:19:39.626282+0000","last_unstale":"2023-10-18T12:19:44.697167+0000","last_undegraded":"2023-10-18T12:19:44.697167+0000","last_fullsized":"2023-10-18T12:19:44.697167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:43:43.570343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695706+0000","last_change":"2023-10-18T12:19:39.618114+0000","last_active":"2023-10-18T12:19:44.695706+0000","last_peered":"2023-10-18T12:19:44.695706+0000","last_clean":"2023-10-18T12:19:44.695706+0000","last_became_active":"2023-10-18T12:19:39.617493+0000","last_became_peered":"2023-10-18T12:19:39.617493+0000","last_unstale":"2023-10-18T12:19:44.695706+0000","last_undegraded":"2023-10-18T12:19:44.695706+0000","last_fullsized":"2023-10-18T12:19:44.695706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:51:48.593221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.642536+0000","last_change":"2023-10-18T12:19:39.593923+0000","last_active":"2023-10-18T12:19:44.642536+0000","last_peered":"2023-10-18T12:19:44.642536+0000","last_clean":"2023-10-18T12:19:44.642536+0000","last_became_active":"2023-10-18T12:19:39.593576+0000","last_became_peered":"2023-10-18T12:19:39.593576+0000","last_unstale":"2023-10-18T12:19:44.642536+0000","last_undegraded":"2023-10-18T12:19:44.642536+0000","last_fullsized":"2023-10-18T12:19:44.642536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:23:37.730513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696693+0000","last_change":"2023-10-18T12:19:39.608751+0000","last_active":"2023-10-18T12:19:44.696693+0000","last_peered":"2023-10-18T12:19:44.696693+0000","last_clean":"2023-10-18T12:19:44.696693+0000","last_became_active":"2023-10-18T12:19:39.608577+0000","last_became_peered":"2023-10-18T12:19:39.608577+0000","last_unstale":"2023-10-18T12:19:44.696693+0000","last_undegraded":"2023-10-18T12:19:44.696693+0000","last_fullsized":"2023-10-18T12:19:44.696693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:41.166395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.694826+0000","last_change":"2023-10-18T12:19:39.619193+0000","last_active":"2023-10-18T12:19:44.694826+0000","last_peered":"2023-10-18T12:19:44.694826+0000","last_clean":"2023-10-18T12:19:44.694826+0000","last_became_active":"2023-10-18T12:19:39.618875+0000","last_became_peered":"2023-10-18T12:19:39.618875+0000","last_unstale":"2023-10-18T12:19:44.694826+0000","last_undegraded":"2023-10-18T12:19:44.694826+0000","last_fullsized":"2023-10-18T12:19:44.694826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:09:05.600850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696932+0000","last_change":"2023-10-18T12:19:39.624583+0000","last_active":"2023-10-18T12:19:44.696932+0000","last_peered":"2023-10-18T12:19:44.696932+0000","last_clean":"2023-10-18T12:19:44.696932+0000","last_became_active":"2023-10-18T12:19:39.624245+0000","last_became_peered":"2023-10-18T12:19:39.624245+0000","last_unstale":"2023-10-18T12:19:44.696932+0000","last_undegraded":"2023-10-18T12:19:44.696932+0000","last_fullsized":"2023-10-18T12:19:44.696932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:30:21.637586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.699970+0000","last_change":"2023-10-18T12:19:39.611515+0000","last_active":"2023-10-18T12:19:44.699970+0000","last_peered":"2023-10-18T12:19:44.699970+0000","last_clean":"2023-10-18T12:19:44.699970+0000","last_became_active":"2023-10-18T12:19:39.611055+0000","last_became_peered":"2023-10-18T12:19:39.611055+0000","last_unstale":"2023-10-18T12:19:44.699970+0000","last_undegraded":"2023-10-18T12:19:44.699970+0000","last_fullsized":"2023-10-18T12:19:44.699970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:46:08.694186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697397+0000","last_change":"2023-10-18T12:19:39.616291+0000","last_active":"2023-10-18T12:19:44.697397+0000","last_peered":"2023-10-18T12:19:44.697397+0000","last_clean":"2023-10-18T12:19:44.697397+0000","last_became_active":"2023-10-18T12:19:39.615941+0000","last_became_peered":"2023-10-18T12:19:39.615941+0000","last_unstale":"2023-10-18T12:19:44.697397+0000","last_undegraded":"2023-10-18T12:19:44.697397+0000","last_fullsized":"2023-10-18T12:19:44.697397+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:38:42.744745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696621+0000","last_change":"2023-10-18T12:19:39.627115+0000","last_active":"2023-10-18T12:19:44.696621+0000","last_peered":"2023-10-18T12:19:44.696621+0000","last_clean":"2023-10-18T12:19:44.696621+0000","last_became_active":"2023-10-18T12:19:39.626676+0000","last_became_peered":"2023-10-18T12:19:39.626676+0000","last_unstale":"2023-10-18T12:19:44.696621+0000","last_undegraded":"2023-10-18T12:19:44.696621+0000","last_fullsized":"2023-10-18T12:19:44.696621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:23:37.730513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695588+0000","last_change":"2023-10-18T12:19:39.622702+0000","last_active":"2023-10-18T12:19:44.695588+0000","last_peered":"2023-10-18T12:19:44.695588+0000","last_clean":"2023-10-18T12:19:44.695588+0000","last_became_active":"2023-10-18T12:19:39.622413+0000","last_became_peered":"2023-10-18T12:19:39.622413+0000","last_unstale":"2023-10-18T12:19:44.695588+0000","last_undegraded":"2023-10-18T12:19:44.695588+0000","last_fullsized":"2023-10-18T12:19:44.695588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:01:13.535689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.642468+0000","last_change":"2023-10-18T12:19:39.590506+0000","last_active":"2023-10-18T12:19:44.642468+0000","last_peered":"2023-10-18T12:19:44.642468+0000","last_clean":"2023-10-18T12:19:44.642468+0000","last_became_active":"2023-10-18T12:19:39.590193+0000","last_became_peered":"2023-10-18T12:19:39.590193+0000","last_unstale":"2023-10-18T12:19:44.642468+0000","last_undegraded":"2023-10-18T12:19:44.642468+0000","last_fullsized":"2023-10-18T12:19:44.642468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:32:29.479925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696554+0000","last_change":"2023-10-18T12:19:39.623884+0000","last_active":"2023-10-18T12:19:44.696554+0000","last_peered":"2023-10-18T12:19:44.696554+0000","last_clean":"2023-10-18T12:19:44.696554+0000","last_became_active":"2023-10-18T12:19:39.621423+0000","last_became_peered":"2023-10-18T12:19:39.621423+0000","last_unstale":"2023-10-18T12:19:44.696554+0000","last_undegraded":"2023-10-18T12:19:44.696554+0000","last_fullsized":"2023-10-18T12:19:44.696554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:08:53.571323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696270+0000","last_change":"2023-10-18T12:19:39.613490+0000","last_active":"2023-10-18T12:19:44.696270+0000","last_peered":"2023-10-18T12:19:44.696270+0000","last_clean":"2023-10-18T12:19:44.696270+0000","last_became_active":"2023-10-18T12:19:39.613238+0000","last_became_peered":"2023-10-18T12:19:39.613238+0000","last_unstale":"2023-10-18T12:19:44.696270+0000","last_undegraded":"2023-10-18T12:19:44.696270+0000","last_fullsized":"2023-10-18T12:19:44.696270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:16:42.023443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698292+0000","last_change":"2023-10-18T12:19:39.616780+0000","last_active":"2023-10-18T12:19:44.698292+0000","last_peered":"2023-10-18T12:19:44.698292+0000","last_clean":"2023-10-18T12:19:44.698292+0000","last_became_active":"2023-10-18T12:19:39.612468+0000","last_became_peered":"2023-10-18T12:19:39.612468+0000","last_unstale":"2023-10-18T12:19:44.698292+0000","last_undegraded":"2023-10-18T12:19:44.698292+0000","last_fullsized":"2023-10-18T12:19:44.698292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:21:53.971574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.699940+0000","last_change":"2023-10-18T12:19:39.614291+0000","last_active":"2023-10-18T12:19:44.699940+0000","last_peered":"2023-10-18T12:19:44.699940+0000","last_clean":"2023-10-18T12:19:44.699940+0000","last_became_active":"2023-10-18T12:19:39.613988+0000","last_became_peered":"2023-10-18T12:19:39.613988+0000","last_unstale":"2023-10-18T12:19:44.699940+0000","last_undegraded":"2023-10-18T12:19:44.699940+0000","last_fullsized":"2023-10-18T12:19:44.699940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:54:49.791061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697127+0000","last_change":"2023-10-18T12:19:39.618591+0000","last_active":"2023-10-18T12:19:44.697127+0000","last_peered":"2023-10-18T12:19:44.697127+0000","last_clean":"2023-10-18T12:19:44.697127+0000","last_became_active":"2023-10-18T12:19:39.618040+0000","last_became_peered":"2023-10-18T12:19:39.618040+0000","last_unstale":"2023-10-18T12:19:44.697127+0000","last_undegraded":"2023-10-18T12:19:44.697127+0000","last_fullsized":"2023-10-18T12:19:44.697127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:34:44.895130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697567+0000","last_change":"2023-10-18T12:19:39.619158+0000","last_active":"2023-10-18T12:19:44.697567+0000","last_peered":"2023-10-18T12:19:44.697567+0000","last_clean":"2023-10-18T12:19:44.697567+0000","last_became_active":"2023-10-18T12:19:39.618867+0000","last_became_peered":"2023-10-18T12:19:39.618867+0000","last_unstale":"2023-10-18T12:19:44.697567+0000","last_undegraded":"2023-10-18T12:19:44.697567+0000","last_fullsized":"2023-10-18T12:19:44.697567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:27:24.632610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":925696,"data_stored":718997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.147}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.478}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.349}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3979999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.196}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3080000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1919999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.258}]}]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":125224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.454}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":128469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.397}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":307200,"data_stored":124662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.671}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.248}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6279999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.373}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3169999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3759999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1919999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.153}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27900,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343940,"statfs":{"total":96636764160,"available":96608194560,"internally_reserved":0,"allocated":901120,"data_stored":715522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.335}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.429}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2729999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.377}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-18T12:20:06.172 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-18T12:20:06.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.385+0000 7ff0e1847700 1 Processor -- start 2023-10-18T12:20:06.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.385+0000 7ff0e1847700 1 -- start start 2023-10-18T12:20:06.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.389+0000 7ff0e1847700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0dc06d090 0x7ff0dc0b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:06.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.389+0000 7ff0e1847700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff0dc15a410 0x7ff0dc15a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:06.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.389+0000 7ff0e1847700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0dc071120 con 0x7ff0dc06d470 2023-10-18T12:20:06.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.389+0000 7ff0e1847700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0dc15f4f0 con 0x7ff0dc15a410 2023-10-18T12:20:06.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.389+0000 7ff0e1847700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc15e990 con 0x7ff0dc06d090 2023-10-18T12:20:06.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.389+0000 7ff0e0845700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0dc06d090 0x7ff0dc0b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:06.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.389+0000 7ff0e0845700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0dc06d090 0x7ff0dc0b2590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.114:58058/0 (socket says 172.21.15.114:58058) 2023-10-18T12:20:06.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.389+0000 7ff0e0845700 1 -- 172.21.15.114:0/3964591000 learned_addr learned my addr 172.21.15.114:0/3964591000 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:06.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.389+0000 7ff0e1046700 1 --2- 172.21.15.114:0/3964591000 >> v2:172.21.15.172:3300/0 conn(0x7ff0dc15a410 0x7ff0dc15a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:06.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.389+0000 7ff0d37fe700 1 -- 172.21.15.114:0/3964591000 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 261136565 0 0) 0x7ff0dc071120 con 0x7ff0dc06d470 2023-10-18T12:20:06.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.389+0000 7ff0d37fe700 1 -- 172.21.15.114:0/3964591000 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0c40035d0 con 0x7ff0dc06d470 2023-10-18T12:20:06.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.389+0000 7ff0e0845700 1 -- 172.21.15.114:0/3964591000 >> v2:172.21.15.172:3300/0 conn(0x7ff0dc15a410 msgr2=0x7ff0dc15a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:06.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.389+0000 7ff0e0845700 1 --2- 172.21.15.114:0/3964591000 >> v2:172.21.15.172:3300/0 conn(0x7ff0dc15a410 0x7ff0dc15a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:06.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.389+0000 7ff0e0845700 1 -- 172.21.15.114:0/3964591000 >> v1:172.21.15.172:6789/0 conn(0x7ff0dc06d470 legacy=0x7ff0dc070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:06.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.389+0000 7ff0e0845700 1 -- 172.21.15.114:0/3964591000 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0dc15ec50 con 0x7ff0dc06d090 2023-10-18T12:20:06.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.389+0000 7ff0e0845700 1 --2- 172.21.15.114:0/3964591000 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0dc06d090 0x7ff0dc0b2590 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8009910 tx=0x7ff0d8009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b74d0adf68f232d server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:06.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.393+0000 7ff0d37fe700 1 -- 172.21.15.114:0/3964591000 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d8011830 con 0x7ff0dc06d090 2023-10-18T12:20:06.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.393+0000 7ff0d37fe700 1 -- 172.21.15.114:0/3964591000 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d8011990 con 0x7ff0dc06d090 2023-10-18T12:20:06.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.393+0000 7ff0d37fe700 1 -- 172.21.15.114:0/3964591000 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d8011d00 con 0x7ff0dc06d090 2023-10-18T12:20:06.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.393+0000 7ff0e1847700 1 -- 172.21.15.114:0/3964591000 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0dc06d090 msgr2=0x7ff0dc0b2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:06.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.393+0000 7ff0e1847700 1 --2- 172.21.15.114:0/3964591000 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0dc06d090 0x7ff0dc0b2590 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8009910 tx=0x7ff0d8009c20 comp rx=0 tx=0).stop 2023-10-18T12:20:06.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.393+0000 7ff0e1847700 1 -- 172.21.15.114:0/3964591000 shutdown_connections 2023-10-18T12:20:06.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.393+0000 7ff0e1847700 1 --2- 172.21.15.114:0/3964591000 >> v2:172.21.15.172:3300/0 conn(0x7ff0dc15a410 0x7ff0dc15a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:06.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.393+0000 7ff0e1847700 1 --2- 172.21.15.114:0/3964591000 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0dc06d090 0x7ff0dc0b2590 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:06.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.393+0000 7ff0e1847700 1 -- 172.21.15.114:0/3964591000 >> 172.21.15.114:0/3964591000 conn(0x7ff0dc0ce5c0 msgr2=0x7ff0dc0ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:06.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.393+0000 7ff0e1847700 1 -- 172.21.15.114:0/3964591000 shutdown_connections 2023-10-18T12:20:06.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.393+0000 7ff0e1847700 1 -- 172.21.15.114:0/3964591000 wait complete. 2023-10-18T12:20:06.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.397+0000 7ff0e1847700 1 Processor -- start 2023-10-18T12:20:06.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.397+0000 7ff0e1847700 1 -- start start 2023-10-18T12:20:06.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.397+0000 7ff0e1847700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0dc06d090 0x7ff0dc155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:06.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.397+0000 7ff0e1847700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0dc06d470 0x7ff0dc0a74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:06.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.397+0000 7ff0e1847700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0dc15a410 0x7ff0dc0a7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:06.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.397+0000 7ff0e1847700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc0c7060 con 0x7ff0dc06d090 2023-10-18T12:20:06.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.397+0000 7ff0e1847700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc0c64e0 con 0x7ff0dc06d470 2023-10-18T12:20:06.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.397+0000 7ff0e1847700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc0c67c0 con 0x7ff0dc15a410 2023-10-18T12:20:06.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.397+0000 7ff0e0845700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0dc06d090 0x7ff0dc155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:06.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.397+0000 7ff0e0845700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0dc06d090 0x7ff0dc155610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56636/0 (socket says 172.21.15.114:56636) 2023-10-18T12:20:06.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.397+0000 7ff0e0845700 1 -- 172.21.15.114:0/1368573558 learned_addr learned my addr 172.21.15.114:0/1368573558 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:06.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.397+0000 7ff0e1046700 1 --2- 172.21.15.114:0/1368573558 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0dc15a410 0x7ff0dc0a7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:06.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.397+0000 7ff0d3fff700 1 --2- 172.21.15.114:0/1368573558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0dc06d470 0x7ff0dc0a74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:06.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.397+0000 7ff0e0845700 1 -- 172.21.15.114:0/1368573558 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0dc15a410 msgr2=0x7ff0dc0a7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:06.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.397+0000 7ff0e0845700 1 --2- 172.21.15.114:0/1368573558 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0dc15a410 0x7ff0dc0a7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:06.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.397+0000 7ff0e0845700 1 -- 172.21.15.114:0/1368573558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0dc06d470 msgr2=0x7ff0dc0a74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:06.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.397+0000 7ff0e0845700 1 --2- 172.21.15.114:0/1368573558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0dc06d470 0x7ff0dc0a74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:06.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.397+0000 7ff0e0845700 1 -- 172.21.15.114:0/1368573558 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d8009570 con 0x7ff0dc06d090 2023-10-18T12:20:06.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.401+0000 7ff0e0845700 1 --2- 172.21.15.114:0/1368573558 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0dc06d090 0x7ff0dc155610 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8009c60 tx=0x7ff0d8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:06.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.401+0000 7ff0d17fa700 1 -- 172.21.15.114:0/1368573558 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d8004340 con 0x7ff0dc06d090 2023-10-18T12:20:06.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.401+0000 7ff0d17fa700 1 -- 172.21.15.114:0/1368573558 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d801f070 con 0x7ff0dc06d090 2023-10-18T12:20:06.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.401+0000 7ff0d17fa700 1 -- 172.21.15.114:0/1368573558 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d80036c0 con 0x7ff0dc06d090 2023-10-18T12:20:06.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.401+0000 7ff0e1847700 1 -- 172.21.15.114:0/1368573558 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0dc0c6aa0 con 0x7ff0dc06d090 2023-10-18T12:20:06.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.401+0000 7ff0e1847700 1 -- 172.21.15.114:0/1368573558 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0dc155b50 con 0x7ff0dc06d090 2023-10-18T12:20:06.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.401+0000 7ff0e1847700 1 -- 172.21.15.114:0/1368573558 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0dc072e60 con 0x7ff0dc06d090 2023-10-18T12:20:06.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.401+0000 7ff0d17fa700 1 -- 172.21.15.114:0/1368573558 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff0d8021030 con 0x7ff0dc06d090 2023-10-18T12:20:06.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.405+0000 7ff0d17fa700 1 --2- 172.21.15.114:0/1368573558 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff0c80656f0 0x7ff0c8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:06.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.405+0000 7ff0d17fa700 1 -- 172.21.15.114:0/1368573558 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff0d8084420 con 0x7ff0dc06d090 2023-10-18T12:20:06.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.405+0000 7ff0d3fff700 1 --2- 172.21.15.114:0/1368573558 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff0c80656f0 0x7ff0c8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:06.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.405+0000 7ff0d3fff700 1 --2- 172.21.15.114:0/1368573558 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff0c80656f0 0x7ff0c8067bb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc0c9c30 tx=0x7ff0cc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:06.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.409+0000 7ff0d17fa700 1 -- 172.21.15.114:0/1368573558 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7ff0d8051c80 con 0x7ff0dc06d090 2023-10-18T12:20:06.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.573+0000 7ff0e1847700 1 -- 172.21.15.114:0/1368573558 --> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff0dc15f210 con 0x7ff0c80656f0 2023-10-18T12:20:06.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.589+0000 7ff0d17fa700 1 -- 172.21.15.114:0/1368573558 <== mgr.4108 v2:172.21.15.172:6832/461408666 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367113 (secure 0 0 0) 0x7ff0cc0050d0 con 0x7ff0c80656f0 2023-10-18T12:20:06.597 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:20:06.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.597+0000 7ff0e1847700 1 -- 172.21.15.114:0/1368573558 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff0c80656f0 msgr2=0x7ff0c8067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:06.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.597+0000 7ff0e1847700 1 --2- 172.21.15.114:0/1368573558 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff0c80656f0 0x7ff0c8067bb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc0c9c30 tx=0x7ff0cc009040 comp rx=0 tx=0).stop 2023-10-18T12:20:06.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.597+0000 7ff0e1847700 1 -- 172.21.15.114:0/1368573558 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0dc06d090 msgr2=0x7ff0dc155610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:06.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.597+0000 7ff0e1847700 1 --2- 172.21.15.114:0/1368573558 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0dc06d090 0x7ff0dc155610 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8009c60 tx=0x7ff0d8004770 comp rx=0 tx=0).stop 2023-10-18T12:20:06.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.597+0000 7ff0e1847700 1 -- 172.21.15.114:0/1368573558 shutdown_connections 2023-10-18T12:20:06.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.597+0000 7ff0e1847700 1 --2- 172.21.15.114:0/1368573558 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff0c80656f0 0x7ff0c8067bb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:06.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.597+0000 7ff0e1847700 1 --2- 172.21.15.114:0/1368573558 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0dc15a410 0x7ff0dc0a7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:06.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.597+0000 7ff0e1847700 1 --2- 172.21.15.114:0/1368573558 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0dc06d470 0x7ff0dc0a74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:06.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.597+0000 7ff0e1847700 1 --2- 172.21.15.114:0/1368573558 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0dc06d090 0x7ff0dc155610 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:06.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.597+0000 7ff0e1847700 1 -- 172.21.15.114:0/1368573558 >> 172.21.15.114:0/1368573558 conn(0x7ff0dc0ce5c0 msgr2=0x7ff0dc159540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:06.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.597+0000 7ff0e1847700 1 -- 172.21.15.114:0/1368573558 shutdown_connections 2023-10-18T12:20:06.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.597+0000 7ff0e1847700 1 -- 172.21.15.114:0/1368573558 wait complete. 2023-10-18T12:20:06.605 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2023-10-18T12:20:06.624 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2023-10-18T12:20:04.962745+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219744,"kb_used_data":3592,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754976,"statfs":{"total":773094113280,"available":772869095424,"internally_reserved":0,"allocated":3678208,"data_stored":2186590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005054"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.644127+0000","last_change":"2023-10-18T12:19:43.671541+0000","last_active":"2023-10-18T12:19:44.644127+0000","last_peered":"2023-10-18T12:19:44.644127+0000","last_clean":"2023-10-18T12:19:44.644127+0000","last_became_active":"2023-10-18T12:19:43.671125+0000","last_became_peered":"2023-10-18T12:19:43.671125+0000","last_unstale":"2023-10-18T12:19:44.644127+0000","last_undegraded":"2023-10-18T12:19:44.644127+0000","last_fullsized":"2023-10-18T12:19:44.644127+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:18:29.969594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696898+0000","last_change":"2023-10-18T12:19:38.598603+0000","last_active":"2023-10-18T12:19:44.696898+0000","last_peered":"2023-10-18T12:19:44.696898+0000","last_clean":"2023-10-18T12:19:44.696898+0000","last_became_active":"2023-10-18T12:19:38.598010+0000","last_became_peered":"2023-10-18T12:19:38.598010+0000","last_unstale":"2023-10-18T12:19:44.696898+0000","last_undegraded":"2023-10-18T12:19:44.696898+0000","last_fullsized":"2023-10-18T12:19:44.696898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:32:58.240366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695834+0000","last_change":"2023-10-18T12:19:39.616496+0000","last_active":"2023-10-18T12:19:44.695834+0000","last_peered":"2023-10-18T12:19:44.695834+0000","last_clean":"2023-10-18T12:19:44.695834+0000","last_became_active":"2023-10-18T12:19:39.615133+0000","last_became_peered":"2023-10-18T12:19:39.615133+0000","last_unstale":"2023-10-18T12:19:44.695834+0000","last_undegraded":"2023-10-18T12:19:44.695834+0000","last_fullsized":"2023-10-18T12:19:44.695834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:20:49.513519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695684+0000","last_change":"2023-10-18T12:19:43.666992+0000","last_active":"2023-10-18T12:19:44.695684+0000","last_peered":"2023-10-18T12:19:44.695684+0000","last_clean":"2023-10-18T12:19:44.695684+0000","last_became_active":"2023-10-18T12:19:43.666294+0000","last_became_peered":"2023-10-18T12:19:43.666294+0000","last_unstale":"2023-10-18T12:19:44.695684+0000","last_undegraded":"2023-10-18T12:19:44.695684+0000","last_fullsized":"2023-10-18T12:19:44.695684+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:22:06.215999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645491+0000","last_change":"2023-10-18T12:19:38.593588+0000","last_active":"2023-10-18T12:19:44.645491+0000","last_peered":"2023-10-18T12:19:44.645491+0000","last_clean":"2023-10-18T12:19:44.645491+0000","last_became_active":"2023-10-18T12:19:38.592964+0000","last_became_peered":"2023-10-18T12:19:38.592964+0000","last_unstale":"2023-10-18T12:19:44.645491+0000","last_undegraded":"2023-10-18T12:19:44.645491+0000","last_fullsized":"2023-10-18T12:19:44.645491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:43:42.560410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.644558+0000","last_change":"2023-10-18T12:19:39.607852+0000","last_active":"2023-10-18T12:19:44.644558+0000","last_peered":"2023-10-18T12:19:44.644558+0000","last_clean":"2023-10-18T12:19:44.644558+0000","last_became_active":"2023-10-18T12:19:39.603891+0000","last_became_peered":"2023-10-18T12:19:39.603891+0000","last_unstale":"2023-10-18T12:19:44.644558+0000","last_undegraded":"2023-10-18T12:19:44.644558+0000","last_fullsized":"2023-10-18T12:19:44.644558+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:34:44.895130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696905+0000","last_change":"2023-10-18T12:19:43.675386+0000","last_active":"2023-10-18T12:19:44.696905+0000","last_peered":"2023-10-18T12:19:44.696905+0000","last_clean":"2023-10-18T12:19:44.696905+0000","last_became_active":"2023-10-18T12:19:43.675017+0000","last_became_peered":"2023-10-18T12:19:43.675017+0000","last_unstale":"2023-10-18T12:19:44.696905+0000","last_undegraded":"2023-10-18T12:19:44.696905+0000","last_fullsized":"2023-10-18T12:19:44.696905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:32:33.537768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698148+0000","last_change":"2023-10-18T12:19:38.608909+0000","last_active":"2023-10-18T12:19:44.698148+0000","last_peered":"2023-10-18T12:19:44.698148+0000","last_clean":"2023-10-18T12:19:44.698148+0000","last_became_active":"2023-10-18T12:19:38.608524+0000","last_became_peered":"2023-10-18T12:19:38.608524+0000","last_unstale":"2023-10-18T12:19:44.698148+0000","last_undegraded":"2023-10-18T12:19:44.698148+0000","last_fullsized":"2023-10-18T12:19:44.698148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:05:31.346619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697032+0000","last_change":"2023-10-18T12:19:39.619005+0000","last_active":"2023-10-18T12:19:44.697032+0000","last_peered":"2023-10-18T12:19:44.697032+0000","last_clean":"2023-10-18T12:19:44.697032+0000","last_became_active":"2023-10-18T12:19:39.618668+0000","last_became_peered":"2023-10-18T12:19:39.618668+0000","last_unstale":"2023-10-18T12:19:44.697032+0000","last_undegraded":"2023-10-18T12:19:44.697032+0000","last_fullsized":"2023-10-18T12:19:44.697032+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:09:08.461295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.642816+0000","last_change":"2023-10-18T12:19:43.668706+0000","last_active":"2023-10-18T12:19:44.642816+0000","last_peered":"2023-10-18T12:19:44.642816+0000","last_clean":"2023-10-18T12:19:44.642816+0000","last_became_active":"2023-10-18T12:19:43.667712+0000","last_became_peered":"2023-10-18T12:19:43.667712+0000","last_unstale":"2023-10-18T12:19:44.642816+0000","last_undegraded":"2023-10-18T12:19:44.642816+0000","last_fullsized":"2023-10-18T12:19:44.642816+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:59:50.719856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698543+0000","last_change":"2023-10-18T12:19:38.612065+0000","last_active":"2023-10-18T12:19:44.698543+0000","last_peered":"2023-10-18T12:19:44.698543+0000","last_clean":"2023-10-18T12:19:44.698543+0000","last_became_active":"2023-10-18T12:19:38.611721+0000","last_became_peered":"2023-10-18T12:19:38.611721+0000","last_unstale":"2023-10-18T12:19:44.698543+0000","last_undegraded":"2023-10-18T12:19:44.698543+0000","last_fullsized":"2023-10-18T12:19:44.698543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:36:40.183265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698329+0000","last_change":"2023-10-18T12:19:39.620814+0000","last_active":"2023-10-18T12:19:44.698329+0000","last_peered":"2023-10-18T12:19:44.698329+0000","last_clean":"2023-10-18T12:19:44.698329+0000","last_became_active":"2023-10-18T12:19:39.620615+0000","last_became_peered":"2023-10-18T12:19:39.620615+0000","last_unstale":"2023-10-18T12:19:44.698329+0000","last_undegraded":"2023-10-18T12:19:44.698329+0000","last_fullsized":"2023-10-18T12:19:44.698329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:33:13.475249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645822+0000","last_change":"2023-10-18T12:19:43.674472+0000","last_active":"2023-10-18T12:19:44.645822+0000","last_peered":"2023-10-18T12:19:44.645822+0000","last_clean":"2023-10-18T12:19:44.645822+0000","last_became_active":"2023-10-18T12:19:43.673978+0000","last_became_peered":"2023-10-18T12:19:43.673978+0000","last_unstale":"2023-10-18T12:19:44.645822+0000","last_undegraded":"2023-10-18T12:19:44.645822+0000","last_fullsized":"2023-10-18T12:19:44.645822+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:09:05.460432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696271+0000","last_change":"2023-10-18T12:19:38.606249+0000","last_active":"2023-10-18T12:19:44.696271+0000","last_peered":"2023-10-18T12:19:44.696271+0000","last_clean":"2023-10-18T12:19:44.696271+0000","last_became_active":"2023-10-18T12:19:38.605978+0000","last_became_peered":"2023-10-18T12:19:38.605978+0000","last_unstale":"2023-10-18T12:19:44.696271+0000","last_undegraded":"2023-10-18T12:19:44.696271+0000","last_fullsized":"2023-10-18T12:19:44.696271+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:01:12.525756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697183+0000","last_change":"2023-10-18T12:19:39.601641+0000","last_active":"2023-10-18T12:19:44.697183+0000","last_peered":"2023-10-18T12:19:44.697183+0000","last_clean":"2023-10-18T12:19:44.697183+0000","last_became_active":"2023-10-18T12:19:39.601275+0000","last_became_peered":"2023-10-18T12:19:39.601275+0000","last_unstale":"2023-10-18T12:19:44.697183+0000","last_undegraded":"2023-10-18T12:19:44.697183+0000","last_fullsized":"2023-10-18T12:19:44.697183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:43:39.713506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.699565+0000","last_change":"2023-10-18T12:19:43.665457+0000","last_active":"2023-10-18T12:19:44.699565+0000","last_peered":"2023-10-18T12:19:44.699565+0000","last_clean":"2023-10-18T12:19:44.699565+0000","last_became_active":"2023-10-18T12:19:43.665040+0000","last_became_peered":"2023-10-18T12:19:43.665040+0000","last_unstale":"2023-10-18T12:19:44.699565+0000","last_undegraded":"2023-10-18T12:19:44.699565+0000","last_fullsized":"2023-10-18T12:19:44.699565+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:45:20.383309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697555+0000","last_change":"2023-10-18T12:19:38.605141+0000","last_active":"2023-10-18T12:19:44.697555+0000","last_peered":"2023-10-18T12:19:44.697555+0000","last_clean":"2023-10-18T12:19:44.697555+0000","last_became_active":"2023-10-18T12:19:38.602562+0000","last_became_peered":"2023-10-18T12:19:38.602562+0000","last_unstale":"2023-10-18T12:19:44.697555+0000","last_undegraded":"2023-10-18T12:19:44.697555+0000","last_fullsized":"2023-10-18T12:19:44.697555+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:27:56.749766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.646701+0000","last_change":"2023-10-18T12:19:39.610888+0000","last_active":"2023-10-18T12:19:44.646701+0000","last_peered":"2023-10-18T12:19:44.646701+0000","last_clean":"2023-10-18T12:19:44.646701+0000","last_became_active":"2023-10-18T12:19:39.610423+0000","last_became_peered":"2023-10-18T12:19:39.610423+0000","last_unstale":"2023-10-18T12:19:44.646701+0000","last_undegraded":"2023-10-18T12:19:44.646701+0000","last_fullsized":"2023-10-18T12:19:44.646701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:05:32.356553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698846+0000","last_change":"2023-10-18T12:19:43.660927+0000","last_active":"2023-10-18T12:19:44.698846+0000","last_peered":"2023-10-18T12:19:44.698846+0000","last_clean":"2023-10-18T12:19:44.698846+0000","last_became_active":"2023-10-18T12:19:43.660484+0000","last_became_peered":"2023-10-18T12:19:43.660484+0000","last_unstale":"2023-10-18T12:19:44.698846+0000","last_undegraded":"2023-10-18T12:19:44.698846+0000","last_fullsized":"2023-10-18T12:19:44.698846+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:23:40.463847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645234+0000","last_change":"2023-10-18T12:19:38.605794+0000","last_active":"2023-10-18T12:19:44.645234+0000","last_peered":"2023-10-18T12:19:44.645234+0000","last_clean":"2023-10-18T12:19:44.645234+0000","last_became_active":"2023-10-18T12:19:38.605484+0000","last_became_peered":"2023-10-18T12:19:38.605484+0000","last_unstale":"2023-10-18T12:19:44.645234+0000","last_undegraded":"2023-10-18T12:19:44.645234+0000","last_fullsized":"2023-10-18T12:19:44.645234+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:59:45.652080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696594+0000","last_change":"2023-10-18T12:19:39.611319+0000","last_active":"2023-10-18T12:19:44.696594+0000","last_peered":"2023-10-18T12:19:44.696594+0000","last_clean":"2023-10-18T12:19:44.696594+0000","last_became_active":"2023-10-18T12:19:39.610259+0000","last_became_peered":"2023-10-18T12:19:39.610259+0000","last_unstale":"2023-10-18T12:19:44.696594+0000","last_undegraded":"2023-10-18T12:19:44.696594+0000","last_fullsized":"2023-10-18T12:19:44.696594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:32:29.479925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696566+0000","last_change":"2023-10-18T12:19:43.660372+0000","last_active":"2023-10-18T12:19:44.696566+0000","last_peered":"2023-10-18T12:19:44.696566+0000","last_clean":"2023-10-18T12:19:44.696566+0000","last_became_active":"2023-10-18T12:19:43.659923+0000","last_became_peered":"2023-10-18T12:19:43.659923+0000","last_unstale":"2023-10-18T12:19:44.696566+0000","last_undegraded":"2023-10-18T12:19:44.696566+0000","last_fullsized":"2023-10-18T12:19:44.696566+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:18:29.969594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643863+0000","last_change":"2023-10-18T12:19:38.600796+0000","last_active":"2023-10-18T12:19:44.643863+0000","last_peered":"2023-10-18T12:19:44.643863+0000","last_clean":"2023-10-18T12:19:44.643863+0000","last_became_active":"2023-10-18T12:19:38.599899+0000","last_became_peered":"2023-10-18T12:19:38.599899+0000","last_unstale":"2023-10-18T12:19:44.643863+0000","last_undegraded":"2023-10-18T12:19:44.643863+0000","last_fullsized":"2023-10-18T12:19:44.643863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:01:12.525756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.699060+0000","last_change":"2023-10-18T12:19:39.607533+0000","last_active":"2023-10-18T12:19:44.699060+0000","last_peered":"2023-10-18T12:19:44.699060+0000","last_clean":"2023-10-18T12:19:44.699060+0000","last_became_active":"2023-10-18T12:19:39.604286+0000","last_became_peered":"2023-10-18T12:19:39.604286+0000","last_unstale":"2023-10-18T12:19:44.699060+0000","last_undegraded":"2023-10-18T12:19:44.699060+0000","last_fullsized":"2023-10-18T12:19:44.699060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:30:22.876433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643667+0000","last_change":"2023-10-18T12:19:39.621418+0000","last_active":"2023-10-18T12:19:44.643667+0000","last_peered":"2023-10-18T12:19:44.643667+0000","last_clean":"2023-10-18T12:19:44.643667+0000","last_became_active":"2023-10-18T12:19:39.621162+0000","last_became_peered":"2023-10-18T12:19:39.621162+0000","last_unstale":"2023-10-18T12:19:44.643667+0000","last_undegraded":"2023-10-18T12:19:44.643667+0000","last_fullsized":"2023-10-18T12:19:44.643667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:31:24.099669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697070+0000","last_change":"2023-10-18T12:19:38.602741+0000","last_active":"2023-10-18T12:19:44.697070+0000","last_peered":"2023-10-18T12:19:44.697070+0000","last_clean":"2023-10-18T12:19:44.697070+0000","last_became_active":"2023-10-18T12:19:38.598808+0000","last_became_peered":"2023-10-18T12:19:38.598808+0000","last_unstale":"2023-10-18T12:19:44.697070+0000","last_undegraded":"2023-10-18T12:19:44.697070+0000","last_fullsized":"2023-10-18T12:19:44.697070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:09:00.392656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697485+0000","last_change":"2023-10-18T12:19:43.662507+0000","last_active":"2023-10-18T12:19:44.697485+0000","last_peered":"2023-10-18T12:19:44.697485+0000","last_clean":"2023-10-18T12:19:44.697485+0000","last_became_active":"2023-10-18T12:19:43.662090+0000","last_became_peered":"2023-10-18T12:19:43.662090+0000","last_unstale":"2023-10-18T12:19:44.697485+0000","last_undegraded":"2023-10-18T12:19:44.697485+0000","last_fullsized":"2023-10-18T12:19:44.697485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:36:54.990254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.644101+0000","last_change":"2023-10-18T12:19:39.612100+0000","last_active":"2023-10-18T12:19:44.644101+0000","last_peered":"2023-10-18T12:19:44.644101+0000","last_clean":"2023-10-18T12:19:44.644101+0000","last_became_active":"2023-10-18T12:19:39.611788+0000","last_became_peered":"2023-10-18T12:19:39.611788+0000","last_unstale":"2023-10-18T12:19:44.644101+0000","last_undegraded":"2023-10-18T12:19:44.644101+0000","last_fullsized":"2023-10-18T12:19:44.644101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:18:25.911752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697553+0000","last_change":"2023-10-18T12:19:38.609638+0000","last_active":"2023-10-18T12:19:44.697553+0000","last_peered":"2023-10-18T12:19:44.697553+0000","last_clean":"2023-10-18T12:19:44.697553+0000","last_became_active":"2023-10-18T12:19:38.609318+0000","last_became_peered":"2023-10-18T12:19:38.609318+0000","last_unstale":"2023-10-18T12:19:44.697553+0000","last_undegraded":"2023-10-18T12:19:44.697553+0000","last_fullsized":"2023-10-18T12:19:44.697553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:58:15.868092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.641909+0000","last_change":"2023-10-18T12:19:43.668265+0000","last_active":"2023-10-18T12:19:44.641909+0000","last_peered":"2023-10-18T12:19:44.641909+0000","last_clean":"2023-10-18T12:19:44.641909+0000","last_became_active":"2023-10-18T12:19:43.667706+0000","last_became_peered":"2023-10-18T12:19:43.667706+0000","last_unstale":"2023-10-18T12:19:44.641909+0000","last_undegraded":"2023-10-18T12:19:44.641909+0000","last_fullsized":"2023-10-18T12:19:44.641909+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:49:04.109094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643379+0000","last_change":"2023-10-18T12:19:38.601819+0000","last_active":"2023-10-18T12:19:44.643379+0000","last_peered":"2023-10-18T12:19:44.643379+0000","last_clean":"2023-10-18T12:19:44.643379+0000","last_became_active":"2023-10-18T12:19:38.601414+0000","last_became_peered":"2023-10-18T12:19:38.601414+0000","last_unstale":"2023-10-18T12:19:44.643379+0000","last_undegraded":"2023-10-18T12:19:44.643379+0000","last_fullsized":"2023-10-18T12:19:44.643379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:43:42.560410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645163+0000","last_change":"2023-10-18T12:19:39.601170+0000","last_active":"2023-10-18T12:19:44.645163+0000","last_peered":"2023-10-18T12:19:44.645163+0000","last_clean":"2023-10-18T12:19:44.645163+0000","last_became_active":"2023-10-18T12:19:39.600901+0000","last_became_peered":"2023-10-18T12:19:39.600901+0000","last_unstale":"2023-10-18T12:19:44.645163+0000","last_undegraded":"2023-10-18T12:19:44.645163+0000","last_fullsized":"2023-10-18T12:19:44.645163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:23:37.730513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.644364+0000","last_change":"2023-10-18T12:19:43.668816+0000","last_active":"2023-10-18T12:19:44.644364+0000","last_peered":"2023-10-18T12:19:44.644364+0000","last_clean":"2023-10-18T12:19:44.644364+0000","last_became_active":"2023-10-18T12:19:43.668451+0000","last_became_peered":"2023-10-18T12:19:43.668451+0000","last_unstale":"2023-10-18T12:19:44.644364+0000","last_undegraded":"2023-10-18T12:19:44.644364+0000","last_fullsized":"2023-10-18T12:19:44.644364+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:32:33.537768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"28'10","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:58.003436+0000","last_change":"2023-10-18T12:19:38.605016+0000","last_active":"2023-10-18T12:19:58.003436+0000","last_peered":"2023-10-18T12:19:58.003436+0000","last_clean":"2023-10-18T12:19:58.003436+0000","last_became_active":"2023-10-18T12:19:38.604703+0000","last_became_peered":"2023-10-18T12:19:38.604703+0000","last_unstale":"2023-10-18T12:19:58.003436+0000","last_undegraded":"2023-10-18T12:19:58.003436+0000","last_fullsized":"2023-10-18T12:19:58.003436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:02:17.952362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698575+0000","last_change":"2023-10-18T12:19:39.615377+0000","last_active":"2023-10-18T12:19:44.698575+0000","last_peered":"2023-10-18T12:19:44.698575+0000","last_clean":"2023-10-18T12:19:44.698575+0000","last_became_active":"2023-10-18T12:19:39.610424+0000","last_became_peered":"2023-10-18T12:19:39.610424+0000","last_unstale":"2023-10-18T12:19:44.698575+0000","last_undegraded":"2023-10-18T12:19:44.698575+0000","last_fullsized":"2023-10-18T12:19:44.698575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:28:58.787021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645013+0000","last_change":"2023-10-18T12:19:43.680946+0000","last_active":"2023-10-18T12:19:44.645013+0000","last_peered":"2023-10-18T12:19:44.645013+0000","last_clean":"2023-10-18T12:19:44.645013+0000","last_became_active":"2023-10-18T12:19:43.680542+0000","last_became_peered":"2023-10-18T12:19:43.680542+0000","last_unstale":"2023-10-18T12:19:44.645013+0000","last_undegraded":"2023-10-18T12:19:44.645013+0000","last_fullsized":"2023-10-18T12:19:44.645013+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:32:33.537768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696164+0000","last_change":"2023-10-18T12:19:39.602742+0000","last_active":"2023-10-18T12:19:44.696164+0000","last_peered":"2023-10-18T12:19:44.696164+0000","last_clean":"2023-10-18T12:19:44.696164+0000","last_became_active":"2023-10-18T12:19:39.602504+0000","last_became_peered":"2023-10-18T12:19:39.602504+0000","last_unstale":"2023-10-18T12:19:44.696164+0000","last_undegraded":"2023-10-18T12:19:44.696164+0000","last_fullsized":"2023-10-18T12:19:44.696164+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:55:47.767344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.699228+0000","last_change":"2023-10-18T12:19:33.531672+0000","last_active":"2023-10-18T12:19:44.699228+0000","last_peered":"2023-10-18T12:19:44.699228+0000","last_clean":"2023-10-18T12:19:44.699228+0000","last_became_active":"2023-10-18T12:19:33.530907+0000","last_became_peered":"2023-10-18T12:19:33.530907+0000","last_unstale":"2023-10-18T12:19:44.699228+0000","last_undegraded":"2023-10-18T12:19:44.699228+0000","last_fullsized":"2023-10-18T12:19:44.699228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:22:58.092944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696857+0000","last_change":"2023-10-18T12:19:38.601615+0000","last_active":"2023-10-18T12:19:44.696857+0000","last_peered":"2023-10-18T12:19:44.696857+0000","last_clean":"2023-10-18T12:19:44.696857+0000","last_became_active":"2023-10-18T12:19:38.601084+0000","last_became_peered":"2023-10-18T12:19:38.601084+0000","last_unstale":"2023-10-18T12:19:44.696857+0000","last_undegraded":"2023-10-18T12:19:44.696857+0000","last_fullsized":"2023-10-18T12:19:44.696857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:34:43.885197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643565+0000","last_change":"2023-10-18T12:19:43.679066+0000","last_active":"2023-10-18T12:19:44.643565+0000","last_peered":"2023-10-18T12:19:44.643565+0000","last_clean":"2023-10-18T12:19:44.643565+0000","last_became_active":"2023-10-18T12:19:43.673105+0000","last_became_peered":"2023-10-18T12:19:43.673105+0000","last_unstale":"2023-10-18T12:19:44.643565+0000","last_undegraded":"2023-10-18T12:19:44.643565+0000","last_fullsized":"2023-10-18T12:19:44.643565+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:25:02.951956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643788+0000","last_change":"2023-10-18T12:19:39.620976+0000","last_active":"2023-10-18T12:19:44.643788+0000","last_peered":"2023-10-18T12:19:44.643788+0000","last_clean":"2023-10-18T12:19:44.643788+0000","last_became_active":"2023-10-18T12:19:39.620577+0000","last_became_peered":"2023-10-18T12:19:39.620577+0000","last_unstale":"2023-10-18T12:19:44.643788+0000","last_undegraded":"2023-10-18T12:19:44.643788+0000","last_fullsized":"2023-10-18T12:19:44.643788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:49:00.051251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.646821+0000","last_change":"2023-10-18T12:19:33.529329+0000","last_active":"2023-10-18T12:19:44.646821+0000","last_peered":"2023-10-18T12:19:44.646821+0000","last_clean":"2023-10-18T12:19:44.646821+0000","last_became_active":"2023-10-18T12:19:33.528930+0000","last_became_peered":"2023-10-18T12:19:33.528930+0000","last_unstale":"2023-10-18T12:19:44.646821+0000","last_undegraded":"2023-10-18T12:19:44.646821+0000","last_fullsized":"2023-10-18T12:19:44.646821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:59:29.698792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.646312+0000","last_change":"2023-10-18T12:19:38.602384+0000","last_active":"2023-10-18T12:19:44.646312+0000","last_peered":"2023-10-18T12:19:44.646312+0000","last_clean":"2023-10-18T12:19:44.646312+0000","last_became_active":"2023-10-18T12:19:38.602036+0000","last_became_peered":"2023-10-18T12:19:38.602036+0000","last_unstale":"2023-10-18T12:19:44.646312+0000","last_undegraded":"2023-10-18T12:19:44.646312+0000","last_fullsized":"2023-10-18T12:19:44.646312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:31:40.396673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695771+0000","last_change":"2023-10-18T12:19:43.665880+0000","last_active":"2023-10-18T12:19:44.695771+0000","last_peered":"2023-10-18T12:19:44.695771+0000","last_clean":"2023-10-18T12:19:44.695771+0000","last_became_active":"2023-10-18T12:19:43.665304+0000","last_became_peered":"2023-10-18T12:19:43.665304+0000","last_unstale":"2023-10-18T12:19:44.695771+0000","last_undegraded":"2023-10-18T12:19:44.695771+0000","last_fullsized":"2023-10-18T12:19:44.695771+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:41:00.366869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696091+0000","last_change":"2023-10-18T12:19:39.610495+0000","last_active":"2023-10-18T12:19:44.696091+0000","last_peered":"2023-10-18T12:19:44.696091+0000","last_clean":"2023-10-18T12:19:44.696091+0000","last_became_active":"2023-10-18T12:19:39.610070+0000","last_became_peered":"2023-10-18T12:19:39.610070+0000","last_unstale":"2023-10-18T12:19:44.696091+0000","last_undegraded":"2023-10-18T12:19:44.696091+0000","last_fullsized":"2023-10-18T12:19:44.696091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:49:00.051251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643554+0000","last_change":"2023-10-18T12:19:33.703565+0000","last_active":"2023-10-18T12:19:44.643554+0000","last_peered":"2023-10-18T12:19:44.643554+0000","last_clean":"2023-10-18T12:19:44.643554+0000","last_became_active":"2023-10-18T12:19:33.703276+0000","last_became_peered":"2023-10-18T12:19:33.703276+0000","last_unstale":"2023-10-18T12:19:44.643554+0000","last_undegraded":"2023-10-18T12:19:44.643554+0000","last_fullsized":"2023-10-18T12:19:44.643554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:42:02.281340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645909+0000","last_change":"2023-10-18T12:19:38.596831+0000","last_active":"2023-10-18T12:19:44.645909+0000","last_peered":"2023-10-18T12:19:44.645909+0000","last_clean":"2023-10-18T12:19:44.645909+0000","last_became_active":"2023-10-18T12:19:38.595274+0000","last_became_peered":"2023-10-18T12:19:38.595274+0000","last_unstale":"2023-10-18T12:19:44.645909+0000","last_undegraded":"2023-10-18T12:19:44.645909+0000","last_fullsized":"2023-10-18T12:19:44.645909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:43:42.560410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697865+0000","last_change":"2023-10-18T12:19:43.684545+0000","last_active":"2023-10-18T12:19:44.697865+0000","last_peered":"2023-10-18T12:19:44.697865+0000","last_clean":"2023-10-18T12:19:44.697865+0000","last_became_active":"2023-10-18T12:19:43.684147+0000","last_became_peered":"2023-10-18T12:19:43.684147+0000","last_unstale":"2023-10-18T12:19:44.697865+0000","last_undegraded":"2023-10-18T12:19:44.697865+0000","last_fullsized":"2023-10-18T12:19:44.697865+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:35:30.070714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645280+0000","last_change":"2023-10-18T12:19:39.611289+0000","last_active":"2023-10-18T12:19:44.645280+0000","last_peered":"2023-10-18T12:19:44.645280+0000","last_clean":"2023-10-18T12:19:44.645280+0000","last_became_active":"2023-10-18T12:19:39.610978+0000","last_became_peered":"2023-10-18T12:19:39.610978+0000","last_unstale":"2023-10-18T12:19:44.645280+0000","last_undegraded":"2023-10-18T12:19:44.645280+0000","last_fullsized":"2023-10-18T12:19:44.645280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:34:44.895130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.646099+0000","last_change":"2023-10-18T12:19:33.703109+0000","last_active":"2023-10-18T12:19:44.646099+0000","last_peered":"2023-10-18T12:19:44.646099+0000","last_clean":"2023-10-18T12:19:44.646099+0000","last_became_active":"2023-10-18T12:19:33.702456+0000","last_became_peered":"2023-10-18T12:19:33.702456+0000","last_unstale":"2023-10-18T12:19:44.646099+0000","last_undegraded":"2023-10-18T12:19:44.646099+0000","last_fullsized":"2023-10-18T12:19:44.646099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:31:35.345173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698372+0000","last_change":"2023-10-18T12:19:38.608530+0000","last_active":"2023-10-18T12:19:44.698372+0000","last_peered":"2023-10-18T12:19:44.698372+0000","last_clean":"2023-10-18T12:19:44.698372+0000","last_became_active":"2023-10-18T12:19:38.608220+0000","last_became_peered":"2023-10-18T12:19:38.608220+0000","last_unstale":"2023-10-18T12:19:44.698372+0000","last_undegraded":"2023-10-18T12:19:44.698372+0000","last_fullsized":"2023-10-18T12:19:44.698372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:18:53.495055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695872+0000","last_change":"2023-10-18T12:19:43.675239+0000","last_active":"2023-10-18T12:19:44.695872+0000","last_peered":"2023-10-18T12:19:44.695872+0000","last_clean":"2023-10-18T12:19:44.695872+0000","last_became_active":"2023-10-18T12:19:43.674815+0000","last_became_peered":"2023-10-18T12:19:43.674815+0000","last_unstale":"2023-10-18T12:19:44.695872+0000","last_undegraded":"2023-10-18T12:19:44.695872+0000","last_fullsized":"2023-10-18T12:19:44.695872+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:31:28.157512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645878+0000","last_change":"2023-10-18T12:19:39.603090+0000","last_active":"2023-10-18T12:19:44.645878+0000","last_peered":"2023-10-18T12:19:44.645878+0000","last_clean":"2023-10-18T12:19:44.645878+0000","last_became_active":"2023-10-18T12:19:39.602663+0000","last_became_peered":"2023-10-18T12:19:39.602663+0000","last_unstale":"2023-10-18T12:19:44.645878+0000","last_undegraded":"2023-10-18T12:19:44.645878+0000","last_fullsized":"2023-10-18T12:19:44.645878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:38:42.744745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698813+0000","last_change":"2023-10-18T12:19:38.605786+0000","last_active":"2023-10-18T12:19:44.698813+0000","last_peered":"2023-10-18T12:19:44.698813+0000","last_clean":"2023-10-18T12:19:44.698813+0000","last_became_active":"2023-10-18T12:19:38.605372+0000","last_became_peered":"2023-10-18T12:19:38.605372+0000","last_unstale":"2023-10-18T12:19:44.698813+0000","last_undegraded":"2023-10-18T12:19:44.698813+0000","last_fullsized":"2023-10-18T12:19:44.698813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:50:26.536151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696981+0000","last_change":"2023-10-18T12:19:33.533449+0000","last_active":"2023-10-18T12:19:44.696981+0000","last_peered":"2023-10-18T12:19:44.696981+0000","last_clean":"2023-10-18T12:19:44.696981+0000","last_became_active":"2023-10-18T12:19:33.533051+0000","last_became_peered":"2023-10-18T12:19:33.533051+0000","last_unstale":"2023-10-18T12:19:44.696981+0000","last_undegraded":"2023-10-18T12:19:44.696981+0000","last_fullsized":"2023-10-18T12:19:44.696981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:59:40.600580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696368+0000","last_change":"2023-10-18T12:19:43.667926+0000","last_active":"2023-10-18T12:19:44.696368+0000","last_peered":"2023-10-18T12:19:44.696368+0000","last_clean":"2023-10-18T12:19:44.696368+0000","last_became_active":"2023-10-18T12:19:43.663720+0000","last_became_peered":"2023-10-18T12:19:43.663720+0000","last_unstale":"2023-10-18T12:19:44.696368+0000","last_undegraded":"2023-10-18T12:19:44.696368+0000","last_fullsized":"2023-10-18T12:19:44.696368+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:45.224238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.646131+0000","last_change":"2023-10-18T12:19:39.611317+0000","last_active":"2023-10-18T12:19:44.646131+0000","last_peered":"2023-10-18T12:19:44.646131+0000","last_clean":"2023-10-18T12:19:44.646131+0000","last_became_active":"2023-10-18T12:19:39.610493+0000","last_became_peered":"2023-10-18T12:19:39.610493+0000","last_unstale":"2023-10-18T12:19:44.646131+0000","last_undegraded":"2023-10-18T12:19:44.646131+0000","last_fullsized":"2023-10-18T12:19:44.646131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:05:32.356553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.644024+0000","last_change":"2023-10-18T12:19:38.600081+0000","last_active":"2023-10-18T12:19:44.644024+0000","last_peered":"2023-10-18T12:19:44.644024+0000","last_clean":"2023-10-18T12:19:44.644024+0000","last_became_active":"2023-10-18T12:19:38.599770+0000","last_became_peered":"2023-10-18T12:19:38.599770+0000","last_unstale":"2023-10-18T12:19:44.644024+0000","last_undegraded":"2023-10-18T12:19:44.644024+0000","last_fullsized":"2023-10-18T12:19:44.644024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:40.156462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.694556+0000","last_change":"2023-10-18T12:19:33.530766+0000","last_active":"2023-10-18T12:19:44.694556+0000","last_peered":"2023-10-18T12:19:44.694556+0000","last_clean":"2023-10-18T12:19:44.694556+0000","last_became_active":"2023-10-18T12:19:33.530346+0000","last_became_peered":"2023-10-18T12:19:33.530346+0000","last_unstale":"2023-10-18T12:19:44.694556+0000","last_undegraded":"2023-10-18T12:19:44.694556+0000","last_fullsized":"2023-10-18T12:19:44.694556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:37:23.298891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697536+0000","last_change":"2023-10-18T12:19:43.670666+0000","last_active":"2023-10-18T12:19:44.697536+0000","last_peered":"2023-10-18T12:19:44.697536+0000","last_clean":"2023-10-18T12:19:44.697536+0000","last_became_active":"2023-10-18T12:19:43.667345+0000","last_became_peered":"2023-10-18T12:19:43.667345+0000","last_unstale":"2023-10-18T12:19:44.697536+0000","last_undegraded":"2023-10-18T12:19:44.697536+0000","last_fullsized":"2023-10-18T12:19:44.697536+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:49:32.050231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696679+0000","last_change":"2023-10-18T12:19:39.619910+0000","last_active":"2023-10-18T12:19:44.696679+0000","last_peered":"2023-10-18T12:19:44.696679+0000","last_clean":"2023-10-18T12:19:44.696679+0000","last_became_active":"2023-10-18T12:19:39.619657+0000","last_became_peered":"2023-10-18T12:19:39.619657+0000","last_unstale":"2023-10-18T12:19:44.696679+0000","last_undegraded":"2023-10-18T12:19:44.696679+0000","last_fullsized":"2023-10-18T12:19:44.696679+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:59:46.662013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695598+0000","last_change":"2023-10-18T12:19:38.605421+0000","last_active":"2023-10-18T12:19:44.695598+0000","last_peered":"2023-10-18T12:19:44.695598+0000","last_clean":"2023-10-18T12:19:44.695598+0000","last_became_active":"2023-10-18T12:19:38.605087+0000","last_became_peered":"2023-10-18T12:19:38.605087+0000","last_unstale":"2023-10-18T12:19:44.695598+0000","last_undegraded":"2023-10-18T12:19:44.695598+0000","last_fullsized":"2023-10-18T12:19:44.695598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:24:57.884181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.642271+0000","last_change":"2023-10-18T12:19:33.528538+0000","last_active":"2023-10-18T12:19:44.642271+0000","last_peered":"2023-10-18T12:19:44.642271+0000","last_clean":"2023-10-18T12:19:44.642271+0000","last_became_active":"2023-10-18T12:19:33.528214+0000","last_became_peered":"2023-10-18T12:19:33.528214+0000","last_unstale":"2023-10-18T12:19:44.642271+0000","last_undegraded":"2023-10-18T12:19:44.642271+0000","last_fullsized":"2023-10-18T12:19:44.642271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:16:35.962010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697181+0000","last_change":"2023-10-18T12:19:43.676292+0000","last_active":"2023-10-18T12:19:44.697181+0000","last_peered":"2023-10-18T12:19:44.697181+0000","last_clean":"2023-10-18T12:19:44.697181+0000","last_became_active":"2023-10-18T12:19:43.674659+0000","last_became_peered":"2023-10-18T12:19:43.674659+0000","last_unstale":"2023-10-18T12:19:44.697181+0000","last_undegraded":"2023-10-18T12:19:44.697181+0000","last_fullsized":"2023-10-18T12:19:44.697181+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:33:03.308142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.699094+0000","last_change":"2023-10-18T12:19:39.623370+0000","last_active":"2023-10-18T12:19:44.699094+0000","last_peered":"2023-10-18T12:19:44.699094+0000","last_clean":"2023-10-18T12:19:44.699094+0000","last_became_active":"2023-10-18T12:19:39.623099+0000","last_became_peered":"2023-10-18T12:19:39.623099+0000","last_unstale":"2023-10-18T12:19:44.699094+0000","last_undegraded":"2023-10-18T12:19:44.699094+0000","last_fullsized":"2023-10-18T12:19:44.699094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:08:54.031805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.644370+0000","last_change":"2023-10-18T12:19:38.601266+0000","last_active":"2023-10-18T12:19:44.644370+0000","last_peered":"2023-10-18T12:19:44.644370+0000","last_clean":"2023-10-18T12:19:44.644370+0000","last_became_active":"2023-10-18T12:19:38.600945+0000","last_became_peered":"2023-10-18T12:19:38.600945+0000","last_unstale":"2023-10-18T12:19:44.644370+0000","last_undegraded":"2023-10-18T12:19:44.644370+0000","last_fullsized":"2023-10-18T12:19:44.644370+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:23:36.720579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697162+0000","last_change":"2023-10-18T12:19:33.531214+0000","last_active":"2023-10-18T12:19:44.697162+0000","last_peered":"2023-10-18T12:19:44.697162+0000","last_clean":"2023-10-18T12:19:44.697162+0000","last_became_active":"2023-10-18T12:19:33.530795+0000","last_became_peered":"2023-10-18T12:19:33.530795+0000","last_unstale":"2023-10-18T12:19:44.697162+0000","last_undegraded":"2023-10-18T12:19:44.697162+0000","last_fullsized":"2023-10-18T12:19:44.697162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:08:55.341156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":181,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.642373+0000","last_change":"2023-10-18T12:19:28.825371+0000","last_active":"2023-10-18T12:19:44.642373+0000","last_peered":"2023-10-18T12:19:44.642373+0000","last_clean":"2023-10-18T12:19:44.642373+0000","last_became_active":"2023-10-18T12:19:28.822484+0000","last_became_peered":"2023-10-18T12:19:28.822484+0000","last_unstale":"2023-10-18T12:19:44.642373+0000","last_undegraded":"2023-10-18T12:19:44.642373+0000","last_fullsized":"2023-10-18T12:19:44.642373+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:27.318899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:27.318899+0000","last_clean_scrub_stamp":"2023-10-18T12:19:27.318899+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:18:14.674282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643196+0000","last_change":"2023-10-18T12:19:43.657137+0000","last_active":"2023-10-18T12:19:44.643196+0000","last_peered":"2023-10-18T12:19:44.643196+0000","last_clean":"2023-10-18T12:19:44.643196+0000","last_became_active":"2023-10-18T12:19:43.656656+0000","last_became_peered":"2023-10-18T12:19:43.656656+0000","last_unstale":"2023-10-18T12:19:44.643196+0000","last_undegraded":"2023-10-18T12:19:44.643196+0000","last_fullsized":"2023-10-18T12:19:44.643196+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:38:46.802588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.646062+0000","last_change":"2023-10-18T12:19:39.616876+0000","last_active":"2023-10-18T12:19:44.646062+0000","last_peered":"2023-10-18T12:19:44.646062+0000","last_clean":"2023-10-18T12:19:44.646062+0000","last_became_active":"2023-10-18T12:19:39.616565+0000","last_became_peered":"2023-10-18T12:19:39.616565+0000","last_unstale":"2023-10-18T12:19:44.646062+0000","last_undegraded":"2023-10-18T12:19:44.646062+0000","last_fullsized":"2023-10-18T12:19:44.646062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:42:08.342773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643925+0000","last_change":"2023-10-18T12:19:38.594539+0000","last_active":"2023-10-18T12:19:44.643925+0000","last_peered":"2023-10-18T12:19:44.643925+0000","last_clean":"2023-10-18T12:19:44.643925+0000","last_became_active":"2023-10-18T12:19:38.594225+0000","last_became_peered":"2023-10-18T12:19:38.594225+0000","last_unstale":"2023-10-18T12:19:44.643925+0000","last_undegraded":"2023-10-18T12:19:44.643925+0000","last_fullsized":"2023-10-18T12:19:44.643925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:16:41.013510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.700323+0000","last_change":"2023-10-18T12:19:43.671582+0000","last_active":"2023-10-18T12:19:44.700323+0000","last_peered":"2023-10-18T12:19:44.700323+0000","last_clean":"2023-10-18T12:19:44.700323+0000","last_became_active":"2023-10-18T12:19:43.671279+0000","last_became_peered":"2023-10-18T12:19:43.671279+0000","last_unstale":"2023-10-18T12:19:44.700323+0000","last_undegraded":"2023-10-18T12:19:44.700323+0000","last_fullsized":"2023-10-18T12:19:44.700323+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:54:13.369092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.700346+0000","last_change":"2023-10-18T12:19:39.624301+0000","last_active":"2023-10-18T12:19:44.700346+0000","last_peered":"2023-10-18T12:19:44.700346+0000","last_clean":"2023-10-18T12:19:44.700346+0000","last_became_active":"2023-10-18T12:19:39.624019+0000","last_became_peered":"2023-10-18T12:19:39.624019+0000","last_unstale":"2023-10-18T12:19:44.700346+0000","last_undegraded":"2023-10-18T12:19:44.700346+0000","last_fullsized":"2023-10-18T12:19:44.700346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:21:14.469134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696174+0000","last_change":"2023-10-18T12:19:38.605246+0000","last_active":"2023-10-18T12:19:44.696174+0000","last_peered":"2023-10-18T12:19:44.696174+0000","last_clean":"2023-10-18T12:19:44.696174+0000","last_became_active":"2023-10-18T12:19:38.604738+0000","last_became_peered":"2023-10-18T12:19:38.604738+0000","last_unstale":"2023-10-18T12:19:44.696174+0000","last_undegraded":"2023-10-18T12:19:44.696174+0000","last_fullsized":"2023-10-18T12:19:44.696174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:00:56.609231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696949+0000","last_change":"2023-10-18T12:19:43.682631+0000","last_active":"2023-10-18T12:19:44.696949+0000","last_peered":"2023-10-18T12:19:44.696949+0000","last_clean":"2023-10-18T12:19:44.696949+0000","last_became_active":"2023-10-18T12:19:43.681887+0000","last_became_peered":"2023-10-18T12:19:43.681887+0000","last_unstale":"2023-10-18T12:19:44.696949+0000","last_undegraded":"2023-10-18T12:19:44.696949+0000","last_fullsized":"2023-10-18T12:19:44.696949+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:23:41.788355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.700050+0000","last_change":"2023-10-18T12:19:39.611350+0000","last_active":"2023-10-18T12:19:44.700050+0000","last_peered":"2023-10-18T12:19:44.700050+0000","last_clean":"2023-10-18T12:19:44.700050+0000","last_became_active":"2023-10-18T12:19:39.610723+0000","last_became_peered":"2023-10-18T12:19:39.610723+0000","last_unstale":"2023-10-18T12:19:44.700050+0000","last_undegraded":"2023-10-18T12:19:44.700050+0000","last_fullsized":"2023-10-18T12:19:44.700050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:06:02.990692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698303+0000","last_change":"2023-10-18T12:19:38.606971+0000","last_active":"2023-10-18T12:19:44.698303+0000","last_peered":"2023-10-18T12:19:44.698303+0000","last_clean":"2023-10-18T12:19:44.698303+0000","last_became_active":"2023-10-18T12:19:38.606625+0000","last_became_peered":"2023-10-18T12:19:38.606625+0000","last_unstale":"2023-10-18T12:19:44.698303+0000","last_undegraded":"2023-10-18T12:19:44.698303+0000","last_fullsized":"2023-10-18T12:19:44.698303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:28:59.066223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645449+0000","last_change":"2023-10-18T12:19:43.674060+0000","last_active":"2023-10-18T12:19:44.645449+0000","last_peered":"2023-10-18T12:19:44.645449+0000","last_clean":"2023-10-18T12:19:44.645449+0000","last_became_active":"2023-10-18T12:19:43.672680+0000","last_became_peered":"2023-10-18T12:19:43.672680+0000","last_unstale":"2023-10-18T12:19:44.645449+0000","last_undegraded":"2023-10-18T12:19:44.645449+0000","last_fullsized":"2023-10-18T12:19:44.645449+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:33:03.308142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.699845+0000","last_change":"2023-10-18T12:19:39.620744+0000","last_active":"2023-10-18T12:19:44.699845+0000","last_peered":"2023-10-18T12:19:44.699845+0000","last_clean":"2023-10-18T12:19:44.699845+0000","last_became_active":"2023-10-18T12:19:39.619969+0000","last_became_peered":"2023-10-18T12:19:39.619969+0000","last_unstale":"2023-10-18T12:19:44.699845+0000","last_undegraded":"2023-10-18T12:19:44.699845+0000","last_fullsized":"2023-10-18T12:19:44.699845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:49:43.494684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.644662+0000","last_change":"2023-10-18T12:19:38.602475+0000","last_active":"2023-10-18T12:19:44.644662+0000","last_peered":"2023-10-18T12:19:44.644662+0000","last_clean":"2023-10-18T12:19:44.644662+0000","last_became_active":"2023-10-18T12:19:38.602195+0000","last_became_peered":"2023-10-18T12:19:38.602195+0000","last_unstale":"2023-10-18T12:19:44.644662+0000","last_undegraded":"2023-10-18T12:19:44.644662+0000","last_fullsized":"2023-10-18T12:19:44.644662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:32:58.240366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696887+0000","last_change":"2023-10-18T12:19:43.682795+0000","last_active":"2023-10-18T12:19:44.696887+0000","last_peered":"2023-10-18T12:19:44.696887+0000","last_clean":"2023-10-18T12:19:44.696887+0000","last_became_active":"2023-10-18T12:19:43.680710+0000","last_became_peered":"2023-10-18T12:19:43.680710+0000","last_unstale":"2023-10-18T12:19:44.696887+0000","last_undegraded":"2023-10-18T12:19:44.696887+0000","last_fullsized":"2023-10-18T12:19:44.696887+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:00:53.354798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695979+0000","last_change":"2023-10-18T12:19:39.620575+0000","last_active":"2023-10-18T12:19:44.695979+0000","last_peered":"2023-10-18T12:19:44.695979+0000","last_clean":"2023-10-18T12:19:44.695979+0000","last_became_active":"2023-10-18T12:19:39.620291+0000","last_became_peered":"2023-10-18T12:19:39.620291+0000","last_unstale":"2023-10-18T12:19:44.695979+0000","last_undegraded":"2023-10-18T12:19:44.695979+0000","last_fullsized":"2023-10-18T12:19:44.695979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:08:55.947222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698645+0000","last_change":"2023-10-18T12:19:38.607039+0000","last_active":"2023-10-18T12:19:44.698645+0000","last_peered":"2023-10-18T12:19:44.698645+0000","last_clean":"2023-10-18T12:19:44.698645+0000","last_became_active":"2023-10-18T12:19:38.606732+0000","last_became_peered":"2023-10-18T12:19:38.606732+0000","last_unstale":"2023-10-18T12:19:44.698645+0000","last_undegraded":"2023-10-18T12:19:44.698645+0000","last_fullsized":"2023-10-18T12:19:44.698645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:59:34.750292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695219+0000","last_change":"2023-10-18T12:19:43.670138+0000","last_active":"2023-10-18T12:19:44.695219+0000","last_peered":"2023-10-18T12:19:44.695219+0000","last_clean":"2023-10-18T12:19:44.695219+0000","last_became_active":"2023-10-18T12:19:43.665610+0000","last_became_peered":"2023-10-18T12:19:43.665610+0000","last_unstale":"2023-10-18T12:19:44.695219+0000","last_undegraded":"2023-10-18T12:19:44.695219+0000","last_fullsized":"2023-10-18T12:19:44.695219+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:28:00.580454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697978+0000","last_change":"2023-10-18T12:19:39.595036+0000","last_active":"2023-10-18T12:19:44.697978+0000","last_peered":"2023-10-18T12:19:44.697978+0000","last_clean":"2023-10-18T12:19:44.697978+0000","last_became_active":"2023-10-18T12:19:39.594790+0000","last_became_peered":"2023-10-18T12:19:39.594790+0000","last_unstale":"2023-10-18T12:19:44.697978+0000","last_undegraded":"2023-10-18T12:19:44.697978+0000","last_fullsized":"2023-10-18T12:19:44.697978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:36:35.120486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643398+0000","last_change":"2023-10-18T12:19:38.600268+0000","last_active":"2023-10-18T12:19:44.643398+0000","last_peered":"2023-10-18T12:19:44.643398+0000","last_clean":"2023-10-18T12:19:44.643398+0000","last_became_active":"2023-10-18T12:19:38.599435+0000","last_became_peered":"2023-10-18T12:19:38.599435+0000","last_unstale":"2023-10-18T12:19:44.643398+0000","last_undegraded":"2023-10-18T12:19:44.643398+0000","last_fullsized":"2023-10-18T12:19:44.643398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:58:15.868092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.694660+0000","last_change":"2023-10-18T12:19:43.670918+0000","last_active":"2023-10-18T12:19:44.694660+0000","last_peered":"2023-10-18T12:19:44.694660+0000","last_clean":"2023-10-18T12:19:44.694660+0000","last_became_active":"2023-10-18T12:19:43.670175+0000","last_became_peered":"2023-10-18T12:19:43.670175+0000","last_unstale":"2023-10-18T12:19:44.694660+0000","last_undegraded":"2023-10-18T12:19:44.694660+0000","last_fullsized":"2023-10-18T12:19:44.694660+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:44:28.672709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696009+0000","last_change":"2023-10-18T12:19:39.610440+0000","last_active":"2023-10-18T12:19:44.696009+0000","last_peered":"2023-10-18T12:19:44.696009+0000","last_clean":"2023-10-18T12:19:44.696009+0000","last_became_active":"2023-10-18T12:19:39.610144+0000","last_became_peered":"2023-10-18T12:19:39.610144+0000","last_unstale":"2023-10-18T12:19:44.696009+0000","last_undegraded":"2023-10-18T12:19:44.696009+0000","last_fullsized":"2023-10-18T12:19:44.696009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:53:47.232582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.644062+0000","last_change":"2023-10-18T12:19:38.605732+0000","last_active":"2023-10-18T12:19:44.644062+0000","last_peered":"2023-10-18T12:19:44.644062+0000","last_clean":"2023-10-18T12:19:44.644062+0000","last_became_active":"2023-10-18T12:19:38.605308+0000","last_became_peered":"2023-10-18T12:19:38.605308+0000","last_unstale":"2023-10-18T12:19:44.644062+0000","last_undegraded":"2023-10-18T12:19:44.644062+0000","last_fullsized":"2023-10-18T12:19:44.644062+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:31:40.396673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.694490+0000","last_change":"2023-10-18T12:19:43.670657+0000","last_active":"2023-10-18T12:19:44.694490+0000","last_peered":"2023-10-18T12:19:44.694490+0000","last_clean":"2023-10-18T12:19:44.694490+0000","last_became_active":"2023-10-18T12:19:43.670163+0000","last_became_peered":"2023-10-18T12:19:43.670163+0000","last_unstale":"2023-10-18T12:19:44.694490+0000","last_undegraded":"2023-10-18T12:19:44.694490+0000","last_fullsized":"2023-10-18T12:19:44.694490+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:34:08.780931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695903+0000","last_change":"2023-10-18T12:19:39.602738+0000","last_active":"2023-10-18T12:19:44.695903+0000","last_peered":"2023-10-18T12:19:44.695903+0000","last_clean":"2023-10-18T12:19:44.695903+0000","last_became_active":"2023-10-18T12:19:39.602448+0000","last_became_peered":"2023-10-18T12:19:39.602448+0000","last_unstale":"2023-10-18T12:19:44.695903+0000","last_undegraded":"2023-10-18T12:19:44.695903+0000","last_fullsized":"2023-10-18T12:19:44.695903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:16:42.023443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.644202+0000","last_change":"2023-10-18T12:19:38.603192+0000","last_active":"2023-10-18T12:19:44.644202+0000","last_peered":"2023-10-18T12:19:44.644202+0000","last_clean":"2023-10-18T12:19:44.644202+0000","last_became_active":"2023-10-18T12:19:38.602904+0000","last_became_peered":"2023-10-18T12:19:38.602904+0000","last_unstale":"2023-10-18T12:19:44.644202+0000","last_undegraded":"2023-10-18T12:19:44.644202+0000","last_fullsized":"2023-10-18T12:19:44.644202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:05:31.346619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.642394+0000","last_change":"2023-10-18T12:19:43.664334+0000","last_active":"2023-10-18T12:19:44.642394+0000","last_peered":"2023-10-18T12:19:44.642394+0000","last_clean":"2023-10-18T12:19:44.642394+0000","last_became_active":"2023-10-18T12:19:43.663249+0000","last_became_peered":"2023-10-18T12:19:43.663249+0000","last_unstale":"2023-10-18T12:19:44.642394+0000","last_undegraded":"2023-10-18T12:19:44.642394+0000","last_fullsized":"2023-10-18T12:19:44.642394+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:45.224238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696836+0000","last_change":"2023-10-18T12:19:43.672616+0000","last_active":"2023-10-18T12:19:44.696836+0000","last_peered":"2023-10-18T12:19:44.696836+0000","last_clean":"2023-10-18T12:19:44.696836+0000","last_became_active":"2023-10-18T12:19:43.672218+0000","last_became_peered":"2023-10-18T12:19:43.672218+0000","last_unstale":"2023-10-18T12:19:44.696836+0000","last_undegraded":"2023-10-18T12:19:44.696836+0000","last_fullsized":"2023-10-18T12:19:44.696836+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:18:29.969594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698410+0000","last_change":"2023-10-18T12:19:38.592225+0000","last_active":"2023-10-18T12:19:44.698410+0000","last_peered":"2023-10-18T12:19:44.698410+0000","last_clean":"2023-10-18T12:19:44.698410+0000","last_became_active":"2023-10-18T12:19:38.591941+0000","last_became_peered":"2023-10-18T12:19:38.591941+0000","last_unstale":"2023-10-18T12:19:44.698410+0000","last_undegraded":"2023-10-18T12:19:44.698410+0000","last_fullsized":"2023-10-18T12:19:44.698410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:28:52.287011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.646062+0000","last_change":"2023-10-18T12:19:39.611861+0000","last_active":"2023-10-18T12:19:44.646062+0000","last_peered":"2023-10-18T12:19:44.646062+0000","last_clean":"2023-10-18T12:19:44.646062+0000","last_became_active":"2023-10-18T12:19:39.611576+0000","last_became_peered":"2023-10-18T12:19:39.611576+0000","last_unstale":"2023-10-18T12:19:44.646062+0000","last_undegraded":"2023-10-18T12:19:44.646062+0000","last_fullsized":"2023-10-18T12:19:44.646062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:42:08.342773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645692+0000","last_change":"2023-10-18T12:19:43.671295+0000","last_active":"2023-10-18T12:19:44.645692+0000","last_peered":"2023-10-18T12:19:44.645692+0000","last_clean":"2023-10-18T12:19:44.645692+0000","last_became_active":"2023-10-18T12:19:43.667280+0000","last_became_peered":"2023-10-18T12:19:43.667280+0000","last_unstale":"2023-10-18T12:19:44.645692+0000","last_undegraded":"2023-10-18T12:19:44.645692+0000","last_fullsized":"2023-10-18T12:19:44.645692+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:58:20.935868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.642799+0000","last_change":"2023-10-18T12:19:38.608977+0000","last_active":"2023-10-18T12:19:44.642799+0000","last_peered":"2023-10-18T12:19:44.642799+0000","last_clean":"2023-10-18T12:19:44.642799+0000","last_became_active":"2023-10-18T12:19:38.608614+0000","last_became_peered":"2023-10-18T12:19:38.608614+0000","last_unstale":"2023-10-18T12:19:44.642799+0000","last_undegraded":"2023-10-18T12:19:44.642799+0000","last_fullsized":"2023-10-18T12:19:44.642799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:34:43.885197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696721+0000","last_change":"2023-10-18T12:19:39.626624+0000","last_active":"2023-10-18T12:19:44.696721+0000","last_peered":"2023-10-18T12:19:44.696721+0000","last_clean":"2023-10-18T12:19:44.696721+0000","last_became_active":"2023-10-18T12:19:39.626353+0000","last_became_peered":"2023-10-18T12:19:39.626353+0000","last_unstale":"2023-10-18T12:19:44.696721+0000","last_undegraded":"2023-10-18T12:19:44.696721+0000","last_fullsized":"2023-10-18T12:19:44.696721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:38:42.744745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695480+0000","last_change":"2023-10-18T12:19:38.607392+0000","last_active":"2023-10-18T12:19:44.695480+0000","last_peered":"2023-10-18T12:19:44.695480+0000","last_clean":"2023-10-18T12:19:44.695480+0000","last_became_active":"2023-10-18T12:19:38.607074+0000","last_became_peered":"2023-10-18T12:19:38.607074+0000","last_unstale":"2023-10-18T12:19:44.695480+0000","last_undegraded":"2023-10-18T12:19:44.695480+0000","last_fullsized":"2023-10-18T12:19:44.695480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:39:22.962723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697929+0000","last_change":"2023-10-18T12:19:39.612978+0000","last_active":"2023-10-18T12:19:44.697929+0000","last_peered":"2023-10-18T12:19:44.697929+0000","last_clean":"2023-10-18T12:19:44.697929+0000","last_became_active":"2023-10-18T12:19:39.612414+0000","last_became_peered":"2023-10-18T12:19:39.612414+0000","last_unstale":"2023-10-18T12:19:44.697929+0000","last_undegraded":"2023-10-18T12:19:44.697929+0000","last_fullsized":"2023-10-18T12:19:44.697929+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:31:41.406606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.644993+0000","last_change":"2023-10-18T12:19:43.663874+0000","last_active":"2023-10-18T12:19:44.644993+0000","last_peered":"2023-10-18T12:19:44.644993+0000","last_clean":"2023-10-18T12:19:44.644993+0000","last_became_active":"2023-10-18T12:19:43.663482+0000","last_became_peered":"2023-10-18T12:19:43.663482+0000","last_unstale":"2023-10-18T12:19:44.644993+0000","last_undegraded":"2023-10-18T12:19:44.644993+0000","last_fullsized":"2023-10-18T12:19:44.644993+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:09:05.460432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643120+0000","last_change":"2023-10-18T12:19:38.608908+0000","last_active":"2023-10-18T12:19:44.643120+0000","last_peered":"2023-10-18T12:19:44.643120+0000","last_clean":"2023-10-18T12:19:44.643120+0000","last_became_active":"2023-10-18T12:19:38.608598+0000","last_became_peered":"2023-10-18T12:19:38.608598+0000","last_unstale":"2023-10-18T12:19:44.643120+0000","last_undegraded":"2023-10-18T12:19:44.643120+0000","last_fullsized":"2023-10-18T12:19:44.643120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:37.546436+0000","last_clean_scrub_stamp":"2023-10-18T12:19:37.546436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:09:00.392656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645413+0000","last_change":"2023-10-18T12:19:39.610765+0000","last_active":"2023-10-18T12:19:44.645413+0000","last_peered":"2023-10-18T12:19:44.645413+0000","last_clean":"2023-10-18T12:19:44.645413+0000","last_became_active":"2023-10-18T12:19:39.610487+0000","last_became_peered":"2023-10-18T12:19:39.610487+0000","last_unstale":"2023-10-18T12:19:44.645413+0000","last_undegraded":"2023-10-18T12:19:44.645413+0000","last_fullsized":"2023-10-18T12:19:44.645413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:38:42.744745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697522+0000","last_change":"2023-10-18T12:19:43.676251+0000","last_active":"2023-10-18T12:19:44.697522+0000","last_peered":"2023-10-18T12:19:44.697522+0000","last_clean":"2023-10-18T12:19:44.697522+0000","last_became_active":"2023-10-18T12:19:43.675875+0000","last_became_peered":"2023-10-18T12:19:43.675875+0000","last_unstale":"2023-10-18T12:19:44.697522+0000","last_undegraded":"2023-10-18T12:19:44.697522+0000","last_fullsized":"2023-10-18T12:19:44.697522+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:42.614211+0000","last_clean_scrub_stamp":"2023-10-18T12:19:42.614211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:43:47.628186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698036+0000","last_change":"2023-10-18T12:19:39.606335+0000","last_active":"2023-10-18T12:19:44.698036+0000","last_peered":"2023-10-18T12:19:44.698036+0000","last_clean":"2023-10-18T12:19:44.698036+0000","last_became_active":"2023-10-18T12:19:39.604624+0000","last_became_peered":"2023-10-18T12:19:39.604624+0000","last_unstale":"2023-10-18T12:19:44.698036+0000","last_undegraded":"2023-10-18T12:19:44.698036+0000","last_fullsized":"2023-10-18T12:19:44.698036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:00:59.306651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643934+0000","last_change":"2023-10-18T12:19:39.622414+0000","last_active":"2023-10-18T12:19:44.643934+0000","last_peered":"2023-10-18T12:19:44.643934+0000","last_clean":"2023-10-18T12:19:44.643934+0000","last_became_active":"2023-10-18T12:19:39.622099+0000","last_became_peered":"2023-10-18T12:19:39.622099+0000","last_unstale":"2023-10-18T12:19:44.643934+0000","last_undegraded":"2023-10-18T12:19:44.643934+0000","last_fullsized":"2023-10-18T12:19:44.643934+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:41.166395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697300+0000","last_change":"2023-10-18T12:19:39.614498+0000","last_active":"2023-10-18T12:19:44.697300+0000","last_peered":"2023-10-18T12:19:44.697300+0000","last_clean":"2023-10-18T12:19:44.697300+0000","last_became_active":"2023-10-18T12:19:39.614221+0000","last_became_peered":"2023-10-18T12:19:39.614221+0000","last_unstale":"2023-10-18T12:19:44.697300+0000","last_undegraded":"2023-10-18T12:19:44.697300+0000","last_fullsized":"2023-10-18T12:19:44.697300+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:50:20.465384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.644520+0000","last_change":"2023-10-18T12:19:39.622751+0000","last_active":"2023-10-18T12:19:44.644520+0000","last_peered":"2023-10-18T12:19:44.644520+0000","last_clean":"2023-10-18T12:19:44.644520+0000","last_became_active":"2023-10-18T12:19:39.612445+0000","last_became_peered":"2023-10-18T12:19:39.612445+0000","last_unstale":"2023-10-18T12:19:44.644520+0000","last_undegraded":"2023-10-18T12:19:44.644520+0000","last_fullsized":"2023-10-18T12:19:44.644520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:59:46.662013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.646131+0000","last_change":"2023-10-18T12:19:39.597414+0000","last_active":"2023-10-18T12:19:44.646131+0000","last_peered":"2023-10-18T12:19:44.646131+0000","last_clean":"2023-10-18T12:19:44.646131+0000","last_became_active":"2023-10-18T12:19:39.597142+0000","last_became_peered":"2023-10-18T12:19:39.597142+0000","last_unstale":"2023-10-18T12:19:44.646131+0000","last_undegraded":"2023-10-18T12:19:44.646131+0000","last_fullsized":"2023-10-18T12:19:44.646131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:18:54.504988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697649+0000","last_change":"2023-10-18T12:19:39.613135+0000","last_active":"2023-10-18T12:19:44.697649+0000","last_peered":"2023-10-18T12:19:44.697649+0000","last_clean":"2023-10-18T12:19:44.697649+0000","last_became_active":"2023-10-18T12:19:39.612747+0000","last_became_peered":"2023-10-18T12:19:39.612747+0000","last_unstale":"2023-10-18T12:19:44.697649+0000","last_undegraded":"2023-10-18T12:19:44.697649+0000","last_fullsized":"2023-10-18T12:19:44.697649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:42:08.342773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.646717+0000","last_change":"2023-10-18T12:19:39.602816+0000","last_active":"2023-10-18T12:19:44.646717+0000","last_peered":"2023-10-18T12:19:44.646717+0000","last_clean":"2023-10-18T12:19:44.646717+0000","last_became_active":"2023-10-18T12:19:39.602561+0000","last_became_peered":"2023-10-18T12:19:39.602561+0000","last_unstale":"2023-10-18T12:19:44.646717+0000","last_undegraded":"2023-10-18T12:19:44.646717+0000","last_fullsized":"2023-10-18T12:19:44.646717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:36:41.193198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.645988+0000","last_change":"2023-10-18T12:19:39.600714+0000","last_active":"2023-10-18T12:19:44.645988+0000","last_peered":"2023-10-18T12:19:44.645988+0000","last_clean":"2023-10-18T12:19:44.645988+0000","last_became_active":"2023-10-18T12:19:39.600450+0000","last_became_peered":"2023-10-18T12:19:39.600450+0000","last_unstale":"2023-10-18T12:19:44.645988+0000","last_undegraded":"2023-10-18T12:19:44.645988+0000","last_fullsized":"2023-10-18T12:19:44.645988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:58:16.878025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.642145+0000","last_change":"2023-10-18T12:19:39.627407+0000","last_active":"2023-10-18T12:19:44.642145+0000","last_peered":"2023-10-18T12:19:44.642145+0000","last_clean":"2023-10-18T12:19:44.642145+0000","last_became_active":"2023-10-18T12:19:39.626211+0000","last_became_peered":"2023-10-18T12:19:39.626211+0000","last_unstale":"2023-10-18T12:19:44.642145+0000","last_undegraded":"2023-10-18T12:19:44.642145+0000","last_fullsized":"2023-10-18T12:19:44.642145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:01:13.535689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643733+0000","last_change":"2023-10-18T12:19:39.625985+0000","last_active":"2023-10-18T12:19:44.643733+0000","last_peered":"2023-10-18T12:19:44.643733+0000","last_clean":"2023-10-18T12:19:44.643733+0000","last_became_active":"2023-10-18T12:19:39.625675+0000","last_became_peered":"2023-10-18T12:19:39.625675+0000","last_unstale":"2023-10-18T12:19:44.643733+0000","last_undegraded":"2023-10-18T12:19:44.643733+0000","last_fullsized":"2023-10-18T12:19:44.643733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:08:55.947222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695201+0000","last_change":"2023-10-18T12:19:39.612565+0000","last_active":"2023-10-18T12:19:44.695201+0000","last_peered":"2023-10-18T12:19:44.695201+0000","last_clean":"2023-10-18T12:19:44.695201+0000","last_became_active":"2023-10-18T12:19:39.612238+0000","last_became_peered":"2023-10-18T12:19:39.612238+0000","last_unstale":"2023-10-18T12:19:44.695201+0000","last_undegraded":"2023-10-18T12:19:44.695201+0000","last_fullsized":"2023-10-18T12:19:44.695201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:20:41.018432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.643039+0000","last_change":"2023-10-18T12:19:39.616276+0000","last_active":"2023-10-18T12:19:44.643039+0000","last_peered":"2023-10-18T12:19:44.643039+0000","last_clean":"2023-10-18T12:19:44.643039+0000","last_became_active":"2023-10-18T12:19:39.615850+0000","last_became_peered":"2023-10-18T12:19:39.615850+0000","last_unstale":"2023-10-18T12:19:44.643039+0000","last_undegraded":"2023-10-18T12:19:44.643039+0000","last_fullsized":"2023-10-18T12:19:44.643039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:32:59.250300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.699707+0000","last_change":"2023-10-18T12:19:39.623264+0000","last_active":"2023-10-18T12:19:44.699707+0000","last_peered":"2023-10-18T12:19:44.699707+0000","last_clean":"2023-10-18T12:19:44.699707+0000","last_became_active":"2023-10-18T12:19:39.621265+0000","last_became_peered":"2023-10-18T12:19:39.621265+0000","last_unstale":"2023-10-18T12:19:44.699707+0000","last_undegraded":"2023-10-18T12:19:44.699707+0000","last_fullsized":"2023-10-18T12:19:44.699707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:14:52.587185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697048+0000","last_change":"2023-10-18T12:19:39.601465+0000","last_active":"2023-10-18T12:19:44.697048+0000","last_peered":"2023-10-18T12:19:44.697048+0000","last_clean":"2023-10-18T12:19:44.697048+0000","last_became_active":"2023-10-18T12:19:39.601166+0000","last_became_peered":"2023-10-18T12:19:39.601166+0000","last_unstale":"2023-10-18T12:19:44.697048+0000","last_undegraded":"2023-10-18T12:19:44.697048+0000","last_fullsized":"2023-10-18T12:19:44.697048+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:49:10.530935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.700144+0000","last_change":"2023-10-18T12:19:39.623799+0000","last_active":"2023-10-18T12:19:44.700144+0000","last_peered":"2023-10-18T12:19:44.700144+0000","last_clean":"2023-10-18T12:19:44.700144+0000","last_became_active":"2023-10-18T12:19:39.623178+0000","last_became_peered":"2023-10-18T12:19:39.623178+0000","last_unstale":"2023-10-18T12:19:44.700144+0000","last_undegraded":"2023-10-18T12:19:44.700144+0000","last_fullsized":"2023-10-18T12:19:44.700144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:41:05.788100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697167+0000","last_change":"2023-10-18T12:19:39.626941+0000","last_active":"2023-10-18T12:19:44.697167+0000","last_peered":"2023-10-18T12:19:44.697167+0000","last_clean":"2023-10-18T12:19:44.697167+0000","last_became_active":"2023-10-18T12:19:39.626282+0000","last_became_peered":"2023-10-18T12:19:39.626282+0000","last_unstale":"2023-10-18T12:19:44.697167+0000","last_undegraded":"2023-10-18T12:19:44.697167+0000","last_fullsized":"2023-10-18T12:19:44.697167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:43:43.570343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695706+0000","last_change":"2023-10-18T12:19:39.618114+0000","last_active":"2023-10-18T12:19:44.695706+0000","last_peered":"2023-10-18T12:19:44.695706+0000","last_clean":"2023-10-18T12:19:44.695706+0000","last_became_active":"2023-10-18T12:19:39.617493+0000","last_became_peered":"2023-10-18T12:19:39.617493+0000","last_unstale":"2023-10-18T12:19:44.695706+0000","last_undegraded":"2023-10-18T12:19:44.695706+0000","last_fullsized":"2023-10-18T12:19:44.695706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:51:48.593221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.642536+0000","last_change":"2023-10-18T12:19:39.593923+0000","last_active":"2023-10-18T12:19:44.642536+0000","last_peered":"2023-10-18T12:19:44.642536+0000","last_clean":"2023-10-18T12:19:44.642536+0000","last_became_active":"2023-10-18T12:19:39.593576+0000","last_became_peered":"2023-10-18T12:19:39.593576+0000","last_unstale":"2023-10-18T12:19:44.642536+0000","last_undegraded":"2023-10-18T12:19:44.642536+0000","last_fullsized":"2023-10-18T12:19:44.642536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:23:37.730513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696693+0000","last_change":"2023-10-18T12:19:39.608751+0000","last_active":"2023-10-18T12:19:44.696693+0000","last_peered":"2023-10-18T12:19:44.696693+0000","last_clean":"2023-10-18T12:19:44.696693+0000","last_became_active":"2023-10-18T12:19:39.608577+0000","last_became_peered":"2023-10-18T12:19:39.608577+0000","last_unstale":"2023-10-18T12:19:44.696693+0000","last_undegraded":"2023-10-18T12:19:44.696693+0000","last_fullsized":"2023-10-18T12:19:44.696693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:41.166395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.694826+0000","last_change":"2023-10-18T12:19:39.619193+0000","last_active":"2023-10-18T12:19:44.694826+0000","last_peered":"2023-10-18T12:19:44.694826+0000","last_clean":"2023-10-18T12:19:44.694826+0000","last_became_active":"2023-10-18T12:19:39.618875+0000","last_became_peered":"2023-10-18T12:19:39.618875+0000","last_unstale":"2023-10-18T12:19:44.694826+0000","last_undegraded":"2023-10-18T12:19:44.694826+0000","last_fullsized":"2023-10-18T12:19:44.694826+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:09:05.600850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696932+0000","last_change":"2023-10-18T12:19:39.624583+0000","last_active":"2023-10-18T12:19:44.696932+0000","last_peered":"2023-10-18T12:19:44.696932+0000","last_clean":"2023-10-18T12:19:44.696932+0000","last_became_active":"2023-10-18T12:19:39.624245+0000","last_became_peered":"2023-10-18T12:19:39.624245+0000","last_unstale":"2023-10-18T12:19:44.696932+0000","last_undegraded":"2023-10-18T12:19:44.696932+0000","last_fullsized":"2023-10-18T12:19:44.696932+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:30:21.637586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.699970+0000","last_change":"2023-10-18T12:19:39.611515+0000","last_active":"2023-10-18T12:19:44.699970+0000","last_peered":"2023-10-18T12:19:44.699970+0000","last_clean":"2023-10-18T12:19:44.699970+0000","last_became_active":"2023-10-18T12:19:39.611055+0000","last_became_peered":"2023-10-18T12:19:39.611055+0000","last_unstale":"2023-10-18T12:19:44.699970+0000","last_undegraded":"2023-10-18T12:19:44.699970+0000","last_fullsized":"2023-10-18T12:19:44.699970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:46:08.694186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697397+0000","last_change":"2023-10-18T12:19:39.616291+0000","last_active":"2023-10-18T12:19:44.697397+0000","last_peered":"2023-10-18T12:19:44.697397+0000","last_clean":"2023-10-18T12:19:44.697397+0000","last_became_active":"2023-10-18T12:19:39.615941+0000","last_became_peered":"2023-10-18T12:19:39.615941+0000","last_unstale":"2023-10-18T12:19:44.697397+0000","last_undegraded":"2023-10-18T12:19:44.697397+0000","last_fullsized":"2023-10-18T12:19:44.697397+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:38:42.744745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696621+0000","last_change":"2023-10-18T12:19:39.627115+0000","last_active":"2023-10-18T12:19:44.696621+0000","last_peered":"2023-10-18T12:19:44.696621+0000","last_clean":"2023-10-18T12:19:44.696621+0000","last_became_active":"2023-10-18T12:19:39.626676+0000","last_became_peered":"2023-10-18T12:19:39.626676+0000","last_unstale":"2023-10-18T12:19:44.696621+0000","last_undegraded":"2023-10-18T12:19:44.696621+0000","last_fullsized":"2023-10-18T12:19:44.696621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:23:37.730513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.695588+0000","last_change":"2023-10-18T12:19:39.622702+0000","last_active":"2023-10-18T12:19:44.695588+0000","last_peered":"2023-10-18T12:19:44.695588+0000","last_clean":"2023-10-18T12:19:44.695588+0000","last_became_active":"2023-10-18T12:19:39.622413+0000","last_became_peered":"2023-10-18T12:19:39.622413+0000","last_unstale":"2023-10-18T12:19:44.695588+0000","last_undegraded":"2023-10-18T12:19:44.695588+0000","last_fullsized":"2023-10-18T12:19:44.695588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:01:13.535689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.642468+0000","last_change":"2023-10-18T12:19:39.590506+0000","last_active":"2023-10-18T12:19:44.642468+0000","last_peered":"2023-10-18T12:19:44.642468+0000","last_clean":"2023-10-18T12:19:44.642468+0000","last_became_active":"2023-10-18T12:19:39.590193+0000","last_became_peered":"2023-10-18T12:19:39.590193+0000","last_unstale":"2023-10-18T12:19:44.642468+0000","last_undegraded":"2023-10-18T12:19:44.642468+0000","last_fullsized":"2023-10-18T12:19:44.642468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:32:29.479925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696554+0000","last_change":"2023-10-18T12:19:39.623884+0000","last_active":"2023-10-18T12:19:44.696554+0000","last_peered":"2023-10-18T12:19:44.696554+0000","last_clean":"2023-10-18T12:19:44.696554+0000","last_became_active":"2023-10-18T12:19:39.621423+0000","last_became_peered":"2023-10-18T12:19:39.621423+0000","last_unstale":"2023-10-18T12:19:44.696554+0000","last_undegraded":"2023-10-18T12:19:44.696554+0000","last_fullsized":"2023-10-18T12:19:44.696554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:08:53.571323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.696270+0000","last_change":"2023-10-18T12:19:39.613490+0000","last_active":"2023-10-18T12:19:44.696270+0000","last_peered":"2023-10-18T12:19:44.696270+0000","last_clean":"2023-10-18T12:19:44.696270+0000","last_became_active":"2023-10-18T12:19:39.613238+0000","last_became_peered":"2023-10-18T12:19:39.613238+0000","last_unstale":"2023-10-18T12:19:44.696270+0000","last_undegraded":"2023-10-18T12:19:44.696270+0000","last_fullsized":"2023-10-18T12:19:44.696270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:16:42.023443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.698292+0000","last_change":"2023-10-18T12:19:39.616780+0000","last_active":"2023-10-18T12:19:44.698292+0000","last_peered":"2023-10-18T12:19:44.698292+0000","last_clean":"2023-10-18T12:19:44.698292+0000","last_became_active":"2023-10-18T12:19:39.612468+0000","last_became_peered":"2023-10-18T12:19:39.612468+0000","last_unstale":"2023-10-18T12:19:44.698292+0000","last_undegraded":"2023-10-18T12:19:44.698292+0000","last_fullsized":"2023-10-18T12:19:44.698292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:21:53.971574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.699940+0000","last_change":"2023-10-18T12:19:39.614291+0000","last_active":"2023-10-18T12:19:44.699940+0000","last_peered":"2023-10-18T12:19:44.699940+0000","last_clean":"2023-10-18T12:19:44.699940+0000","last_became_active":"2023-10-18T12:19:39.613988+0000","last_became_peered":"2023-10-18T12:19:39.613988+0000","last_unstale":"2023-10-18T12:19:44.699940+0000","last_undegraded":"2023-10-18T12:19:44.699940+0000","last_fullsized":"2023-10-18T12:19:44.699940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:54:49.791061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697127+0000","last_change":"2023-10-18T12:19:39.618591+0000","last_active":"2023-10-18T12:19:44.697127+0000","last_peered":"2023-10-18T12:19:44.697127+0000","last_clean":"2023-10-18T12:19:44.697127+0000","last_became_active":"2023-10-18T12:19:39.618040+0000","last_became_peered":"2023-10-18T12:19:39.618040+0000","last_unstale":"2023-10-18T12:19:44.697127+0000","last_undegraded":"2023-10-18T12:19:44.697127+0000","last_fullsized":"2023-10-18T12:19:44.697127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:34:44.895130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-18T12:19:44.697567+0000","last_change":"2023-10-18T12:19:39.619158+0000","last_active":"2023-10-18T12:19:44.697567+0000","last_peered":"2023-10-18T12:19:44.697567+0000","last_clean":"2023-10-18T12:19:44.697567+0000","last_became_active":"2023-10-18T12:19:39.618867+0000","last_became_peered":"2023-10-18T12:19:39.618867+0000","last_unstale":"2023-10-18T12:19:44.697567+0000","last_undegraded":"2023-10-18T12:19:44.697567+0000","last_fullsized":"2023-10-18T12:19:44.697567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:38.556369+0000","last_clean_scrub_stamp":"2023-10-18T12:19:38.556369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:27:24.632610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":925696,"data_stored":718997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.147}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.478}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.349}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3979999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.196}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3080000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1919999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.258}]}]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":311296,"data_stored":125224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.454}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":128469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.397}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":307200,"data_stored":124662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.671}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.248}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6279999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.373}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3169999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3759999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1919999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.153}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27900,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343940,"statfs":{"total":96636764160,"available":96608194560,"internally_reserved":0,"allocated":901120,"data_stored":715522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.335}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.429}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2729999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.377}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-18T12:20:06.631 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-18T12:20:06.631 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-18T12:20:06.632 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-18T12:20:06.632 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-18T12:20:06.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.833+0000 7fc8fbde6700 1 Processor -- start 2023-10-18T12:20:06.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.833+0000 7fc8fbde6700 1 -- start start 2023-10-18T12:20:06.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.833+0000 7fc8fbde6700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc8f406e8a0 0x7fc8f40caf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:06.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.833+0000 7fc8fbde6700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8f40cb8c0 con 0x7fc8f415ee50 2023-10-18T12:20:06.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.833+0000 7fc8fbde6700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8f406f450 con 0x7fc8f40cb470 2023-10-18T12:20:06.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.833+0000 7fc8fbde6700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f406d4e0 con 0x7fc8f406e8a0 2023-10-18T12:20:06.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.833+0000 7fc8f9b82700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc8f415ee50 0x7fc8f40cc680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34478/0 (socket says 172.21.15.114:34478) 2023-10-18T12:20:06.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.833+0000 7fc8f9b82700 1 -- 172.21.15.114:0/2091302430 learned_addr learned my addr 172.21.15.114:0/2091302430 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:06.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.837+0000 7fc8f9381700 1 --2- 172.21.15.114:0/2091302430 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc8f406e8a0 0x7fc8f40caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:06.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.837+0000 7fc8f8b80700 1 -- 172.21.15.114:0/2091302430 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2670619377 0 0) 0x7fc8f0001110 con 0x7fc8f415ee50 2023-10-18T12:20:06.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.837+0000 7fc8f8b80700 1 -- 172.21.15.114:0/2091302430 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8e00035d0 con 0x7fc8f415ee50 2023-10-18T12:20:06.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.837+0000 7fc8f8b80700 1 -- 172.21.15.114:0/2091302430 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3653771624 0 0) 0x7fc8f406f450 con 0x7fc8f40cb470 2023-10-18T12:20:06.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.837+0000 7fc8f8b80700 1 -- 172.21.15.114:0/2091302430 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8f0001110 con 0x7fc8f40cb470 2023-10-18T12:20:06.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.837+0000 7fc8f8b80700 1 -- 172.21.15.114:0/2091302430 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1468385987 0 0) 0x7fc8e00035d0 con 0x7fc8f415ee50 2023-10-18T12:20:06.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.837+0000 7fc8f8b80700 1 -- 172.21.15.114:0/2091302430 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc8f406e8a0 msgr2=0x7fc8f40caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:06.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.837+0000 7fc8f8b80700 1 --2- 172.21.15.114:0/2091302430 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc8f406e8a0 0x7fc8f40caf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:06.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.837+0000 7fc8f8b80700 1 -- 172.21.15.114:0/2091302430 >> v1:172.21.15.172:6789/0 conn(0x7fc8f40cb470 legacy=0x7fc8f406f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:06.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.837+0000 7fc8f8b80700 1 -- 172.21.15.114:0/2091302430 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f41624a0 con 0x7fc8f415ee50 2023-10-18T12:20:06.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.837+0000 7fc8f8b80700 1 -- 172.21.15.114:0/2091302430 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3368469509 0 0) 0x7fc8f0001800 con 0x7fc8f415ee50 2023-10-18T12:20:06.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.837+0000 7fc8f8b80700 1 -- 172.21.15.114:0/2091302430 >> v1:172.21.15.114:6789/0 conn(0x7fc8f415ee50 legacy=0x7fc8f40cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:06.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.837+0000 7fc8f8b80700 1 --2- 172.21.15.114:0/2091302430 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8e0003be0 0x7fc8e0003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:06.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.837+0000 7fc8f8b80700 1 --2- 172.21.15.114:0/2091302430 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8e0004870 0x7fc8e0004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:06.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.837+0000 7fc8f8b80700 1 --2- 172.21.15.114:0/2091302430 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc8f406e8a0 0x7fc8e0005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:06.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.837+0000 7fc8f8b80700 1 -- 172.21.15.114:0/2091302430 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f406d4e0 con 0x7fc8e0003be0 2023-10-18T12:20:06.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.837+0000 7fc8f8b80700 1 -- 172.21.15.114:0/2091302430 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e000bb10 con 0x7fc8e0004870 2023-10-18T12:20:06.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.837+0000 7fc8f8b80700 1 -- 172.21.15.114:0/2091302430 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e000bcd0 con 0x7fc8f406e8a0 2023-10-18T12:20:06.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.837+0000 7fc8f9b82700 1 --2- 172.21.15.114:0/2091302430 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8e0003be0 0x7fc8e0003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:06.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.837+0000 7fc8fa383700 1 --2- 172.21.15.114:0/2091302430 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc8f406e8a0 0x7fc8e0005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:06.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.837+0000 7fc8f9381700 1 --2- 172.21.15.114:0/2091302430 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8e0004870 0x7fc8e0004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:06.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.837+0000 7fc8f9b82700 1 -- 172.21.15.114:0/2091302430 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc8f406e8a0 msgr2=0x7fc8e0005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:06.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.837+0000 7fc8f9b82700 1 --2- 172.21.15.114:0/2091302430 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc8f406e8a0 0x7fc8e0005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:06.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.837+0000 7fc8f9b82700 1 -- 172.21.15.114:0/2091302430 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8e0004870 msgr2=0x7fc8e0004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:06.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.837+0000 7fc8f9b82700 1 --2- 172.21.15.114:0/2091302430 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8e0004870 0x7fc8e0004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:06.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.837+0000 7fc8f9b82700 1 -- 172.21.15.114:0/2091302430 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e00035d0 con 0x7fc8e0003be0 2023-10-18T12:20:06.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.837+0000 7fc8f9b82700 1 --2- 172.21.15.114:0/2091302430 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8e0003be0 0x7fc8e0003fe0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc8f000c110 tx=0x7fc8e00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7315f141fece415f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:06.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.837+0000 7fc8f8b80700 1 -- 172.21.15.114:0/2091302430 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f0007c90 con 0x7fc8e0003be0 2023-10-18T12:20:06.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.837+0000 7fc8f8b80700 1 -- 172.21.15.114:0/2091302430 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f000ccb0 con 0x7fc8e0003be0 2023-10-18T12:20:06.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.837+0000 7fc8f8b80700 1 -- 172.21.15.114:0/2091302430 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f0005bc0 con 0x7fc8e0003be0 2023-10-18T12:20:06.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.841+0000 7fc8fbde6700 1 -- 172.21.15.114:0/2091302430 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8e0003be0 msgr2=0x7fc8e0003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:06.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.841+0000 7fc8fbde6700 1 --2- 172.21.15.114:0/2091302430 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8e0003be0 0x7fc8e0003fe0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc8f000c110 tx=0x7fc8e00058a0 comp rx=0 tx=0).stop 2023-10-18T12:20:06.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.841+0000 7fc8fa383700 1 -- 172.21.15.114:0/2091302430 reap_dead start 2023-10-18T12:20:06.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.841+0000 7fc8fbde6700 1 -- 172.21.15.114:0/2091302430 shutdown_connections 2023-10-18T12:20:06.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.841+0000 7fc8fbde6700 1 -- 172.21.15.114:0/2091302430 >> 172.21.15.114:0/2091302430 conn(0x7fc8f406a340 msgr2=0x7fc8f40b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:06.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.841+0000 7fc8fbde6700 1 -- 172.21.15.114:0/2091302430 shutdown_connections 2023-10-18T12:20:06.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.841+0000 7fc8fbde6700 1 -- 172.21.15.114:0/2091302430 wait complete. 2023-10-18T12:20:06.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.845+0000 7fc8fbde6700 1 Processor -- start 2023-10-18T12:20:06.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.845+0000 7fc8fbde6700 1 -- start start 2023-10-18T12:20:06.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.845+0000 7fc8fbde6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8f41f6280 0x7fc8f414c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:06.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.845+0000 7fc8fbde6700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc8f41f6660 0x7fc8f4160710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:06.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.845+0000 7fc8fbde6700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8f4160c50 0x7fc8f41f9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:06.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.845+0000 7fc8fbde6700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f41610e0 con 0x7fc8f4160c50 2023-10-18T12:20:06.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.845+0000 7fc8fbde6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f414c7e0 con 0x7fc8f41f6280 2023-10-18T12:20:06.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.845+0000 7fc8fbde6700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f40b2750 con 0x7fc8f41f6660 2023-10-18T12:20:06.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.845+0000 7fc8fa383700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8f4160c50 0x7fc8f41f9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:06.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.845+0000 7fc8fa383700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8f4160c50 0x7fc8f41f9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56652/0 (socket says 172.21.15.114:56652) 2023-10-18T12:20:06.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.845+0000 7fc8fa383700 1 -- 172.21.15.114:0/781720108 learned_addr learned my addr 172.21.15.114:0/781720108 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:06.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.845+0000 7fc8f9381700 1 --2- 172.21.15.114:0/781720108 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc8f41f6660 0x7fc8f4160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:06.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.845+0000 7fc8f9b82700 1 --2- 172.21.15.114:0/781720108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8f41f6280 0x7fc8f414c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:06.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.845+0000 7fc8fa383700 1 -- 172.21.15.114:0/781720108 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc8f41f6660 msgr2=0x7fc8f4160710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:06.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.845+0000 7fc8fa383700 1 --2- 172.21.15.114:0/781720108 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc8f41f6660 0x7fc8f4160710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:06.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.845+0000 7fc8fa383700 1 -- 172.21.15.114:0/781720108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8f41f6280 msgr2=0x7fc8f414c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:06.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.845+0000 7fc8fa383700 1 --2- 172.21.15.114:0/781720108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8f41f6280 0x7fc8f414c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:06.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.845+0000 7fc8fa383700 1 -- 172.21.15.114:0/781720108 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f40b2a30 con 0x7fc8f4160c50 2023-10-18T12:20:06.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.845+0000 7fc8fa383700 1 --2- 172.21.15.114:0/781720108 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8f4160c50 0x7fc8f41f9fe0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc8f406b010 tx=0x7fc8ec00d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:06.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.845+0000 7fc8ea7fc700 1 -- 172.21.15.114:0/781720108 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec003c30 con 0x7fc8f4160c50 2023-10-18T12:20:06.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.845+0000 7fc8ea7fc700 1 -- 172.21.15.114:0/781720108 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8ec003d90 con 0x7fc8f4160c50 2023-10-18T12:20:06.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.845+0000 7fc8fbde6700 1 -- 172.21.15.114:0/781720108 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8f40b2d10 con 0x7fc8f4160c50 2023-10-18T12:20:06.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.845+0000 7fc8ea7fc700 1 -- 172.21.15.114:0/781720108 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec00dbd0 con 0x7fc8f4160c50 2023-10-18T12:20:06.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.845+0000 7fc8fbde6700 1 -- 172.21.15.114:0/781720108 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8f40b32d0 con 0x7fc8f4160c50 2023-10-18T12:20:06.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.849+0000 7fc8fbde6700 1 -- 172.21.15.114:0/781720108 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8f4072e60 con 0x7fc8f4160c50 2023-10-18T12:20:06.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.849+0000 7fc8ea7fc700 1 -- 172.21.15.114:0/781720108 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fc8ec00dd30 con 0x7fc8f4160c50 2023-10-18T12:20:06.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.849+0000 7fc8ea7fc700 1 --2- 172.21.15.114:0/781720108 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc8d80656f0 0x7fc8d8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:06.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.853+0000 7fc8ea7fc700 1 -- 172.21.15.114:0/781720108 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc8ec083510 con 0x7fc8f4160c50 2023-10-18T12:20:06.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.853+0000 7fc8f9b82700 1 --2- 172.21.15.114:0/781720108 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc8d80656f0 0x7fc8d8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:06.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.853+0000 7fc8f9b82700 1 --2- 172.21.15.114:0/781720108 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc8d80656f0 0x7fc8d8067bb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc8f406cc90 tx=0x7fc8f0007000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:06.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:06.857+0000 7fc8ea7fc700 1 -- 172.21.15.114:0/781720108 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fc8ec050c40 con 0x7fc8f4160c50 2023-10-18T12:20:07.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.193+0000 7fc8fbde6700 1 -- 172.21.15.114:0/781720108 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc8f40b1160 con 0x7fc8f4160c50 2023-10-18T12:20:07.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.193+0000 7fc8ea7fc700 1 -- 172.21.15.114:0/781720108 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fc8ec054260 con 0x7fc8f4160c50 2023-10-18T12:20:07.199 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:20:07.199 INFO:teuthology.orchestra.run.smithi114.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-18T12:20:07.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.197+0000 7fc8fbde6700 1 -- 172.21.15.114:0/781720108 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc8d80656f0 msgr2=0x7fc8d8067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:07.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.197+0000 7fc8fbde6700 1 --2- 172.21.15.114:0/781720108 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc8d80656f0 0x7fc8d8067bb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc8f406cc90 tx=0x7fc8f0007000 comp rx=0 tx=0).stop 2023-10-18T12:20:07.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.197+0000 7fc8fbde6700 1 -- 172.21.15.114:0/781720108 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8f4160c50 msgr2=0x7fc8f41f9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:07.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.197+0000 7fc8fbde6700 1 --2- 172.21.15.114:0/781720108 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8f4160c50 0x7fc8f41f9fe0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc8f406b010 tx=0x7fc8ec00d430 comp rx=0 tx=0).stop 2023-10-18T12:20:07.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.197+0000 7fc8fbde6700 1 -- 172.21.15.114:0/781720108 shutdown_connections 2023-10-18T12:20:07.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.197+0000 7fc8fbde6700 1 --2- 172.21.15.114:0/781720108 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc8d80656f0 0x7fc8d8067bb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:07.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.197+0000 7fc8fbde6700 1 --2- 172.21.15.114:0/781720108 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc8f41f6660 0x7fc8f4160710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:07.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.197+0000 7fc8fbde6700 1 --2- 172.21.15.114:0/781720108 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc8f4160c50 0x7fc8f41f9fe0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:07.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.197+0000 7fc8fbde6700 1 --2- 172.21.15.114:0/781720108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8f41f6280 0x7fc8f414c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:07.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.197+0000 7fc8fbde6700 1 -- 172.21.15.114:0/781720108 >> 172.21.15.114:0/781720108 conn(0x7fc8f406a340 msgr2=0x7fc8f4162780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:07.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.197+0000 7fc8fbde6700 1 -- 172.21.15.114:0/781720108 shutdown_connections 2023-10-18T12:20:07.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.197+0000 7fc8fbde6700 1 -- 172.21.15.114:0/781720108 wait complete. 2023-10-18T12:20:07.222 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-18T12:20:07.223 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T12:20:07.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.385+0000 7fa535546700 1 Processor -- start 2023-10-18T12:20:07.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.385+0000 7fa535546700 1 -- start start 2023-10-18T12:20:07.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.385+0000 7fa535546700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa53015cc80 0x7fa5300d13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:07.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.385+0000 7fa535546700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa5300d30e0 0x7fa530070a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:07.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.385+0000 7fa535546700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa53015d060 con 0x7fa5300b1df0 2023-10-18T12:20:07.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.385+0000 7fa535546700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa53006d830 con 0x7fa5300d30e0 2023-10-18T12:20:07.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.385+0000 7fa535546700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa53006dd60 con 0x7fa53015cc80 2023-10-18T12:20:07.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.389+0000 7fa52f7fe700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa5300d30e0 0x7fa530070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:07.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.389+0000 7fa527fff700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa5300b1df0 0x7fa5300d29d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34482/0 (socket says 172.21.15.114:34482) 2023-10-18T12:20:07.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.389+0000 7fa527fff700 1 -- 172.21.15.114:0/2744401339 learned_addr learned my addr 172.21.15.114:0/2744401339 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:07.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.389+0000 7fa52effd700 1 --2- 172.21.15.114:0/2744401339 >> v2:172.21.15.172:3300/0 conn(0x7fa53015cc80 0x7fa5300d13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:07.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.389+0000 7fa52f7fe700 1 -- 172.21.15.114:0/2744401339 >> v2:172.21.15.172:3300/0 conn(0x7fa53015cc80 msgr2=0x7fa5300d13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:07.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.389+0000 7fa52f7fe700 1 --2- 172.21.15.114:0/2744401339 >> v2:172.21.15.172:3300/0 conn(0x7fa53015cc80 0x7fa5300d13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:07.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.389+0000 7fa52f7fe700 1 -- 172.21.15.114:0/2744401339 >> v1:172.21.15.114:6789/0 conn(0x7fa5300b1df0 legacy=0x7fa5300d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:07.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.389+0000 7fa52f7fe700 1 -- 172.21.15.114:0/2744401339 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa53006da80 con 0x7fa5300d30e0 2023-10-18T12:20:07.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.389+0000 7fa52f7fe700 1 --2- 172.21.15.114:0/2744401339 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5300d30e0 0x7fa530070a50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa53006e8b0 tx=0x7fa52800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a454ca7ae43942b server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:07.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.389+0000 7fa52e7fc700 1 -- 172.21.15.114:0/2744401339 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52800e070 con 0x7fa5300d30e0 2023-10-18T12:20:07.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.389+0000 7fa52e7fc700 1 -- 172.21.15.114:0/2744401339 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa52800bb20 con 0x7fa5300d30e0 2023-10-18T12:20:07.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.389+0000 7fa52e7fc700 1 -- 172.21.15.114:0/2744401339 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa528012430 con 0x7fa5300d30e0 2023-10-18T12:20:07.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.389+0000 7fa535546700 1 -- 172.21.15.114:0/2744401339 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5300d30e0 msgr2=0x7fa530070a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:07.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.389+0000 7fa535546700 1 --2- 172.21.15.114:0/2744401339 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5300d30e0 0x7fa530070a50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa53006e8b0 tx=0x7fa52800b330 comp rx=0 tx=0).stop 2023-10-18T12:20:07.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.389+0000 7fa535546700 1 -- 172.21.15.114:0/2744401339 shutdown_connections 2023-10-18T12:20:07.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.389+0000 7fa535546700 1 --2- 172.21.15.114:0/2744401339 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5300d30e0 0x7fa530070a50 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:07.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.389+0000 7fa535546700 1 --2- 172.21.15.114:0/2744401339 >> v2:172.21.15.172:3300/0 conn(0x7fa53015cc80 0x7fa5300d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:07.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.389+0000 7fa535546700 1 -- 172.21.15.114:0/2744401339 >> 172.21.15.114:0/2744401339 conn(0x7fa5300cf530 msgr2=0x7fa5300cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:07.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.389+0000 7fa535546700 1 -- 172.21.15.114:0/2744401339 shutdown_connections 2023-10-18T12:20:07.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.389+0000 7fa535546700 1 -- 172.21.15.114:0/2744401339 wait complete. 2023-10-18T12:20:07.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.393+0000 7fa535546700 1 Processor -- start 2023-10-18T12:20:07.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.393+0000 7fa535546700 1 -- start start 2023-10-18T12:20:07.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.393+0000 7fa535546700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa5300b1df0 0x7fa5301533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:07.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.393+0000 7fa535546700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5300d30e0 0x7fa5301504f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:07.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.393+0000 7fa535546700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa53015cc80 0x7fa530150a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:07.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.393+0000 7fa535546700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5300b6e70 con 0x7fa53015cc80 2023-10-18T12:20:07.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.393+0000 7fa535546700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5300b7150 con 0x7fa5300d30e0 2023-10-18T12:20:07.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.393+0000 7fa535546700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5300b7430 con 0x7fa5300b1df0 2023-10-18T12:20:07.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.393+0000 7fa52f7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa53015cc80 0x7fa530150a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:07.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.393+0000 7fa52effd700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa5300b1df0 0x7fa5301533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:07.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.393+0000 7fa52effd700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa5300b1df0 0x7fa5301533e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.114:58100/0 (socket says 172.21.15.114:58100) 2023-10-18T12:20:07.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.393+0000 7fa52effd700 1 -- 172.21.15.114:0/2024503768 learned_addr learned my addr 172.21.15.114:0/2024503768 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:07.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.397+0000 7fa527fff700 1 --2- 172.21.15.114:0/2024503768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5300d30e0 0x7fa5301504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:07.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.397+0000 7fa52f7fe700 1 -- 172.21.15.114:0/2024503768 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa5300b1df0 msgr2=0x7fa5301533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:07.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.397+0000 7fa52f7fe700 1 --2- 172.21.15.114:0/2024503768 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa5300b1df0 0x7fa5301533e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:07.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.397+0000 7fa52f7fe700 1 -- 172.21.15.114:0/2024503768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5300d30e0 msgr2=0x7fa5301504f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:07.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.397+0000 7fa52f7fe700 1 --2- 172.21.15.114:0/2024503768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5300d30e0 0x7fa5301504f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:07.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.397+0000 7fa52f7fe700 1 -- 172.21.15.114:0/2024503768 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa528009a70 con 0x7fa53015cc80 2023-10-18T12:20:07.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.397+0000 7fa52effd700 1 --2- 172.21.15.114:0/2024503768 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa5300b1df0 0x7fa5301533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:20:07.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.397+0000 7fa52f7fe700 1 --2- 172.21.15.114:0/2024503768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa53015cc80 0x7fa530150a30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa528016000 tx=0x7fa528004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:07.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.397+0000 7fa5277fe700 1 -- 172.21.15.114:0/2024503768 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa528012430 con 0x7fa53015cc80 2023-10-18T12:20:07.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.397+0000 7fa5277fe700 1 -- 172.21.15.114:0/2024503768 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa528020070 con 0x7fa53015cc80 2023-10-18T12:20:07.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.397+0000 7fa535546700 1 -- 172.21.15.114:0/2024503768 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5300b7710 con 0x7fa53015cc80 2023-10-18T12:20:07.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.397+0000 7fa5277fe700 1 -- 172.21.15.114:0/2024503768 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa528004040 con 0x7fa53015cc80 2023-10-18T12:20:07.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.397+0000 7fa535546700 1 -- 172.21.15.114:0/2024503768 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5300b60f0 con 0x7fa53015cc80 2023-10-18T12:20:07.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.397+0000 7fa535546700 1 -- 172.21.15.114:0/2024503768 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa53015d850 con 0x7fa53015cc80 2023-10-18T12:20:07.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.401+0000 7fa5277fe700 1 -- 172.21.15.114:0/2024503768 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fa5280041a0 con 0x7fa53015cc80 2023-10-18T12:20:07.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.401+0000 7fa5277fe700 1 --2- 172.21.15.114:0/2024503768 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa5100656f0 0x7fa510067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:07.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.401+0000 7fa5277fe700 1 -- 172.21.15.114:0/2024503768 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa528022070 con 0x7fa53015cc80 2023-10-18T12:20:07.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.401+0000 7fa52effd700 1 --2- 172.21.15.114:0/2024503768 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa5100656f0 0x7fa510067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:07.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.405+0000 7fa52effd700 1 --2- 172.21.15.114:0/2024503768 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa5100656f0 0x7fa510067bb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa5200112c0 tx=0x7fa5200091c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:07.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.409+0000 7fa5277fe700 1 -- 172.21.15.114:0/2024503768 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fa53015d850 con 0x7fa53015cc80 2023-10-18T12:20:07.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.589+0000 7fa535546700 1 -- 172.21.15.114:0/2024503768 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa53015d850 con 0x7fa53015cc80 2023-10-18T12:20:07.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.589+0000 7fa5277fe700 1 -- 172.21.15.114:0/2024503768 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20144 (secure 0 0 0) 0x7fa53015d850 con 0x7fa53015cc80 2023-10-18T12:20:07.594 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:20:07.595 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":28,"fsid":"240ea340-5d3d-4f52-a4bc-af075aca3deb","created":"2023-10-18T12:19:12.512994+0000","modified":"2023-10-18T12:19:44.436656+0000","last_up_change":"2023-10-18T12:19:25.286009+0000","last_in_change":"2023-10-18T12:19:15.850693+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T12:19:27.040638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-18T12:19:32.358094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-18T12:19:37.333855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-18T12:19:38.055385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-18T12:19:41.679218+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c3578978-1a03-4857-b9d2-34a5da3d7731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6817","nonce":1506287862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6820","nonce":1506287862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6830","nonce":1506287862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6825","nonce":1506287862}]},"public_addr":"172.21.15.114:6817/1506287862","cluster_addr":"172.21.15.114:6820/1506287862","heartbeat_back_addr":"172.21.15.114:6830/1506287862","heartbeat_front_addr":"172.21.15.114:6825/1506287862","state":["exists","up"]},{"osd":1,"uuid":"43eb26a6-e2b3-4670-9559-bd053b5140d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6801","nonce":3302727047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6803","nonce":3302727047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6807","nonce":3302727047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6805","nonce":3302727047}]},"public_addr":"172.21.15.114:6801/3302727047","cluster_addr":"172.21.15.114:6803/3302727047","heartbeat_back_addr":"172.21.15.114:6807/3302727047","heartbeat_front_addr":"172.21.15.114:6805/3302727047","state":["exists","up"]},{"osd":2,"uuid":"f3d4dbd5-521c-4dd2-b687-5768cc7d0938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6809","nonce":2699151351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6811","nonce":2699151351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6815","nonce":2699151351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6813","nonce":2699151351}]},"public_addr":"172.21.15.114:6809/2699151351","cluster_addr":"172.21.15.114:6811/2699151351","heartbeat_back_addr":"172.21.15.114:6815/2699151351","heartbeat_front_addr":"172.21.15.114:6813/2699151351","state":["exists","up"]},{"osd":3,"uuid":"823e5802-92b7-4f0d-b32d-a5748993f1b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6821","nonce":1361608073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6824","nonce":1361608073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6829","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6831","nonce":1361608073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6827","nonce":1361608073}]},"public_addr":"172.21.15.114:6821/1361608073","cluster_addr":"172.21.15.114:6824/1361608073","heartbeat_back_addr":"172.21.15.114:6831/1361608073","heartbeat_front_addr":"172.21.15.114:6827/1361608073","state":["exists","up"]},{"osd":4,"uuid":"e47fb93e-13b4-44a4-b084-8c4384ceb41e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6801","nonce":930839681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6803","nonce":930839681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6807","nonce":930839681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6805","nonce":930839681}]},"public_addr":"172.21.15.172:6801/930839681","cluster_addr":"172.21.15.172:6803/930839681","heartbeat_back_addr":"172.21.15.172:6807/930839681","heartbeat_front_addr":"172.21.15.172:6805/930839681","state":["exists","up"]},{"osd":5,"uuid":"7561a973-f479-45a0-af40-f324728d622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6814","nonce":571761850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6818","nonce":571761850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6824","nonce":571761850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6821","nonce":571761850}]},"public_addr":"172.21.15.172:6814/571761850","cluster_addr":"172.21.15.172:6818/571761850","heartbeat_back_addr":"172.21.15.172:6824/571761850","heartbeat_front_addr":"172.21.15.172:6821/571761850","state":["exists","up"]},{"osd":6,"uuid":"51753f4b-7f06-4f1c-9ec7-6e18a66eb980","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6825","nonce":1680398853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6827","nonce":1680398853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6831","nonce":1680398853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6829","nonce":1680398853}]},"public_addr":"172.21.15.172:6825/1680398853","cluster_addr":"172.21.15.172:6827/1680398853","heartbeat_back_addr":"172.21.15.172:6831/1680398853","heartbeat_front_addr":"172.21.15.172:6829/1680398853","state":["exists","up"]},{"osd":7,"uuid":"4d8b1e15-143d-4d17-9074-59d92f0f9af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6809","nonce":349710101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6811","nonce":349710101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6819","nonce":349710101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6815","nonce":349710101}]},"public_addr":"172.21.15.172:6809/349710101","cluster_addr":"172.21.15.172:6811/349710101","heartbeat_back_addr":"172.21.15.172:6819/349710101","heartbeat_front_addr":"172.21.15.172:6815/349710101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.889460+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.475494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.911473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.648596+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.609994+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.636248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.854589+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.885826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T12:20:07.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.593+0000 7fa535546700 1 -- 172.21.15.114:0/2024503768 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa5100656f0 msgr2=0x7fa510067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:07.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.593+0000 7fa535546700 1 --2- 172.21.15.114:0/2024503768 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa5100656f0 0x7fa510067bb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa5200112c0 tx=0x7fa5200091c0 comp rx=0 tx=0).stop 2023-10-18T12:20:07.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.593+0000 7fa535546700 1 -- 172.21.15.114:0/2024503768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa53015cc80 msgr2=0x7fa530150a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:07.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.593+0000 7fa535546700 1 --2- 172.21.15.114:0/2024503768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa53015cc80 0x7fa530150a30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa528016000 tx=0x7fa528004af0 comp rx=0 tx=0).stop 2023-10-18T12:20:07.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.593+0000 7fa535546700 1 -- 172.21.15.114:0/2024503768 shutdown_connections 2023-10-18T12:20:07.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.593+0000 7fa535546700 1 --2- 172.21.15.114:0/2024503768 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa5100656f0 0x7fa510067bb0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:07.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.593+0000 7fa535546700 1 --2- 172.21.15.114:0/2024503768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa53015cc80 0x7fa530150a30 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:07.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.593+0000 7fa535546700 1 --2- 172.21.15.114:0/2024503768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5300d30e0 0x7fa5301504f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:07.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.593+0000 7fa535546700 1 --2- 172.21.15.114:0/2024503768 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa5300b1df0 0x7fa5301533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:07.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.593+0000 7fa535546700 1 -- 172.21.15.114:0/2024503768 >> 172.21.15.114:0/2024503768 conn(0x7fa5300cf530 msgr2=0x7fa5301e5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:07.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.593+0000 7fa535546700 1 -- 172.21.15.114:0/2024503768 shutdown_connections 2023-10-18T12:20:07.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.593+0000 7fa535546700 1 -- 172.21.15.114:0/2024503768 wait complete. 2023-10-18T12:20:07.619 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-18T12:19:27.040638+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-18T12:19:32.358094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-18T12:19:37.333855+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-18T12:19:38.055385+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-18T12:19:41.679218+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-18T12:20:07.619 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-18T12:20:07.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.801+0000 7fa9dd6df700 1 Processor -- start 2023-10-18T12:20:07.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.801+0000 7fa9dd6df700 1 -- start start 2023-10-18T12:20:07.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.805+0000 7fa9dd6df700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa9d80b5ae0 0x7fa9d80b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:07.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.805+0000 7fa9dd6df700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9d815d0d0 con 0x7fa9d80d2e00 2023-10-18T12:20:07.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.805+0000 7fa9dd6df700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9d806f0f0 con 0x7fa9d8160710 2023-10-18T12:20:07.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.805+0000 7fa9dd6df700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9d815df90 con 0x7fa9d80b5ae0 2023-10-18T12:20:07.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.805+0000 7fa9d6ffd700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa9d80d2e00 0x7fa9d80d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34490/0 (socket says 172.21.15.114:34490) 2023-10-18T12:20:07.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.805+0000 7fa9d6ffd700 1 -- 172.21.15.114:0/3251218536 learned_addr learned my addr 172.21.15.114:0/3251218536 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:07.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.805+0000 7fa9d77fe700 1 --2- 172.21.15.114:0/3251218536 >> v2:172.21.15.114:3300/0 conn(0x7fa9d80b5ae0 0x7fa9d80b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:07.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.805+0000 7fa9d5ffb700 1 -- 172.21.15.114:0/3251218536 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3971878710 0 0) 0x7fa9c8001110 con 0x7fa9d80d2e00 2023-10-18T12:20:07.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.805+0000 7fa9d5ffb700 1 -- 172.21.15.114:0/3251218536 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9c00035d0 con 0x7fa9d80d2e00 2023-10-18T12:20:07.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.805+0000 7fa9d5ffb700 1 -- 172.21.15.114:0/3251218536 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1427591058 0 0) 0x7fa9c00035d0 con 0x7fa9d80d2e00 2023-10-18T12:20:07.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.805+0000 7fa9d5ffb700 1 -- 172.21.15.114:0/3251218536 >> v2:172.21.15.114:3300/0 conn(0x7fa9d80b5ae0 msgr2=0x7fa9d80b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:07.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.805+0000 7fa9d5ffb700 1 --2- 172.21.15.114:0/3251218536 >> v2:172.21.15.114:3300/0 conn(0x7fa9d80b5ae0 0x7fa9d80b6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:07.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.805+0000 7fa9d5ffb700 1 -- 172.21.15.114:0/3251218536 >> v1:172.21.15.172:6789/0 conn(0x7fa9d8160710 legacy=0x7fa9d806db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:07.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.805+0000 7fa9d5ffb700 1 -- 172.21.15.114:0/3251218536 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d815d310 con 0x7fa9d80d2e00 2023-10-18T12:20:07.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.805+0000 7fa9d5ffb700 1 -- 172.21.15.114:0/3251218536 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3368469509 0 0) 0x7fa9c8001800 con 0x7fa9d80d2e00 2023-10-18T12:20:07.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.805+0000 7fa9d77fe700 1 --2- 172.21.15.114:0/3251218536 >> v2:172.21.15.114:3300/0 conn(0x7fa9d80b5ae0 0x7fa9d80b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:20:07.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.805+0000 7fa9d5ffb700 1 -- 172.21.15.114:0/3251218536 >> v1:172.21.15.114:6789/0 conn(0x7fa9d80d2e00 legacy=0x7fa9d80d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:07.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.809+0000 7fa9d5ffb700 1 --2- 172.21.15.114:0/3251218536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9c0003a90 0x7fa9c0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:07.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.809+0000 7fa9d5ffb700 1 --2- 172.21.15.114:0/3251218536 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa9c0004870 0x7fa9c0004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:07.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.809+0000 7fa9d5ffb700 1 --2- 172.21.15.114:0/3251218536 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9c0005230 0x7fa9c000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:07.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.809+0000 7fa9d5ffb700 1 -- 172.21.15.114:0/3251218536 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d815df90 con 0x7fa9c0003a90 2023-10-18T12:20:07.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.809+0000 7fa9d5ffb700 1 -- 172.21.15.114:0/3251218536 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c000c100 con 0x7fa9c0005230 2023-10-18T12:20:07.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.809+0000 7fa9d5ffb700 1 -- 172.21.15.114:0/3251218536 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c000c2c0 con 0x7fa9c0004870 2023-10-18T12:20:07.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.809+0000 7fa9d6ffd700 1 --2- 172.21.15.114:0/3251218536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9c0003a90 0x7fa9c0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:07.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.809+0000 7fa9d77fe700 1 --2- 172.21.15.114:0/3251218536 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9c0005230 0x7fa9c000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:07.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.809+0000 7fa9d67fc700 1 --2- 172.21.15.114:0/3251218536 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa9c0004870 0x7fa9c0004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:07.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.809+0000 7fa9d6ffd700 1 -- 172.21.15.114:0/3251218536 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa9c0004870 msgr2=0x7fa9c0004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:07.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.809+0000 7fa9d6ffd700 1 --2- 172.21.15.114:0/3251218536 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa9c0004870 0x7fa9c0004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:07.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.809+0000 7fa9d6ffd700 1 -- 172.21.15.114:0/3251218536 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9c0005230 msgr2=0x7fa9c000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:07.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.809+0000 7fa9d6ffd700 1 --2- 172.21.15.114:0/3251218536 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9c0005230 0x7fa9c000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:07.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.809+0000 7fa9d6ffd700 1 -- 172.21.15.114:0/3251218536 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c00035d0 con 0x7fa9c0003a90 2023-10-18T12:20:07.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.809+0000 7fa9d77fe700 1 -- 172.21.15.114:0/3251218536 reap_dead start 2023-10-18T12:20:07.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.809+0000 7fa9d6ffd700 1 --2- 172.21.15.114:0/3251218536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9c0003a90 0x7fa9c0003e70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa9c800c190 tx=0x7fa9c00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f072218de82d25d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:07.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.809+0000 7fa9d5ffb700 1 -- 172.21.15.114:0/3251218536 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c8007d00 con 0x7fa9c0003a90 2023-10-18T12:20:07.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.809+0000 7fa9d5ffb700 1 -- 172.21.15.114:0/3251218536 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c800cc30 con 0x7fa9c0003a90 2023-10-18T12:20:07.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.809+0000 7fa9d5ffb700 1 -- 172.21.15.114:0/3251218536 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c8005980 con 0x7fa9c0003a90 2023-10-18T12:20:07.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.809+0000 7fa9dd6df700 1 -- 172.21.15.114:0/3251218536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9c0003a90 msgr2=0x7fa9c0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:07.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.809+0000 7fa9dd6df700 1 --2- 172.21.15.114:0/3251218536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9c0003a90 0x7fa9c0003e70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa9c800c190 tx=0x7fa9c00058a0 comp rx=0 tx=0).stop 2023-10-18T12:20:07.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.809+0000 7fa9dd6df700 1 -- 172.21.15.114:0/3251218536 shutdown_connections 2023-10-18T12:20:07.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.809+0000 7fa9dd6df700 1 --2- 172.21.15.114:0/3251218536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9c0003a90 0x7fa9c0003e70 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:07.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.809+0000 7fa9dd6df700 1 -- 172.21.15.114:0/3251218536 >> 172.21.15.114:0/3251218536 conn(0x7fa9d8069f20 msgr2=0x7fa9d806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:07.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.809+0000 7fa9dd6df700 1 -- 172.21.15.114:0/3251218536 shutdown_connections 2023-10-18T12:20:07.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.809+0000 7fa9dd6df700 1 -- 172.21.15.114:0/3251218536 wait complete. 2023-10-18T12:20:07.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.813+0000 7fa9dd6df700 1 Processor -- start 2023-10-18T12:20:07.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.817+0000 7fa9dd6df700 1 -- start start 2023-10-18T12:20:07.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.817+0000 7fa9dd6df700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa9c0003a90 0x7fa9d814a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:07.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.817+0000 7fa9dd6df700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9d80b0a90 0x7fa9d80b0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:07.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.817+0000 7fa9dd6df700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9d814eb90 0x7fa9d814f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:07.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.817+0000 7fa9dd6df700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d80b1450 con 0x7fa9d80b0a90 2023-10-18T12:20:07.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.817+0000 7fa9dd6df700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d8150500 con 0x7fa9d814eb90 2023-10-18T12:20:07.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.817+0000 7fa9dd6df700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d814f8f0 con 0x7fa9c0003a90 2023-10-18T12:20:07.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.817+0000 7fa9d67fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9d80b0a90 0x7fa9d80b0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:07.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.817+0000 7fa9d67fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9d80b0a90 0x7fa9d80b0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56700/0 (socket says 172.21.15.114:56700) 2023-10-18T12:20:07.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.817+0000 7fa9d67fc700 1 -- 172.21.15.114:0/2478042093 learned_addr learned my addr 172.21.15.114:0/2478042093 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:07.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.817+0000 7fa9d77fe700 1 --2- 172.21.15.114:0/2478042093 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9d814eb90 0x7fa9d814f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:07.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.817+0000 7fa9d6ffd700 1 --2- 172.21.15.114:0/2478042093 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa9c0003a90 0x7fa9d814a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:07.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.817+0000 7fa9d67fc700 1 -- 172.21.15.114:0/2478042093 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa9c0003a90 msgr2=0x7fa9d814a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:07.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.817+0000 7fa9d67fc700 1 --2- 172.21.15.114:0/2478042093 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa9c0003a90 0x7fa9d814a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:07.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.817+0000 7fa9d67fc700 1 -- 172.21.15.114:0/2478042093 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9d814eb90 msgr2=0x7fa9d814f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:07.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.817+0000 7fa9d67fc700 1 --2- 172.21.15.114:0/2478042093 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9d814eb90 0x7fa9d814f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:07.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.817+0000 7fa9d67fc700 1 -- 172.21.15.114:0/2478042093 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d814fbd0 con 0x7fa9d80b0a90 2023-10-18T12:20:07.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.817+0000 7fa9d6ffd700 1 --2- 172.21.15.114:0/2478042093 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa9c0003a90 0x7fa9d814a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:07.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.817+0000 7fa9d67fc700 1 --2- 172.21.15.114:0/2478042093 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9d80b0a90 0x7fa9d80b0f10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc00e7e0 tx=0x7fa9cc00eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:07.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.817+0000 7fa9bf7fe700 1 -- 172.21.15.114:0/2478042093 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc0052e0 con 0x7fa9d80b0a90 2023-10-18T12:20:07.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.817+0000 7fa9bf7fe700 1 -- 172.21.15.114:0/2478042093 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9cc005460 con 0x7fa9d80b0a90 2023-10-18T12:20:07.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.817+0000 7fa9bf7fe700 1 -- 172.21.15.114:0/2478042093 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc0038e0 con 0x7fa9d80b0a90 2023-10-18T12:20:07.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.817+0000 7fa9dd6df700 1 -- 172.21.15.114:0/2478042093 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9d814feb0 con 0x7fa9d80b0a90 2023-10-18T12:20:07.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.817+0000 7fa9dd6df700 1 -- 172.21.15.114:0/2478042093 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9d814f550 con 0x7fa9d80b0a90 2023-10-18T12:20:07.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.821+0000 7fa9dd6df700 1 -- 172.21.15.114:0/2478042093 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9d804e910 con 0x7fa9d80b0a90 2023-10-18T12:20:07.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.821+0000 7fa9bf7fe700 1 -- 172.21.15.114:0/2478042093 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fa9cc003a40 con 0x7fa9d80b0a90 2023-10-18T12:20:07.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.821+0000 7fa9bf7fe700 1 --2- 172.21.15.114:0/2478042093 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa9c4065720 0x7fa9c4067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:07.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.821+0000 7fa9bf7fe700 1 -- 172.21.15.114:0/2478042093 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa9cc0827b0 con 0x7fa9d80b0a90 2023-10-18T12:20:07.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.825+0000 7fa9d6ffd700 1 --2- 172.21.15.114:0/2478042093 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa9c4065720 0x7fa9c4067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:07.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.825+0000 7fa9d6ffd700 1 --2- 172.21.15.114:0/2478042093 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa9c4065720 0x7fa9c4067be0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa9c8000c00 tx=0x7fa9c8007000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:07.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:07.829+0000 7fa9bf7fe700 1 -- 172.21.15.114:0/2478042093 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fa9cc050010 con 0x7fa9d80b0a90 2023-10-18T12:20:08.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.001+0000 7fa9dd6df700 1 -- 172.21.15.114:0/2478042093 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa9d80d2620 con 0x7fa9d80b0a90 2023-10-18T12:20:08.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.005+0000 7fa9bf7fe700 1 -- 172.21.15.114:0/2478042093 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa9cc053630 con 0x7fa9d80b0a90 2023-10-18T12:20:08.009 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-10-18T12:20:08.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.009+0000 7fa9dd6df700 1 -- 172.21.15.114:0/2478042093 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa9c4065720 msgr2=0x7fa9c4067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:08.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.009+0000 7fa9dd6df700 1 --2- 172.21.15.114:0/2478042093 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa9c4065720 0x7fa9c4067be0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa9c8000c00 tx=0x7fa9c8007000 comp rx=0 tx=0).stop 2023-10-18T12:20:08.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.009+0000 7fa9dd6df700 1 -- 172.21.15.114:0/2478042093 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9d80b0a90 msgr2=0x7fa9d80b0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:08.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.009+0000 7fa9dd6df700 1 --2- 172.21.15.114:0/2478042093 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9d80b0a90 0x7fa9d80b0f10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc00e7e0 tx=0x7fa9cc00eba0 comp rx=0 tx=0).stop 2023-10-18T12:20:08.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.009+0000 7fa9dd6df700 1 -- 172.21.15.114:0/2478042093 shutdown_connections 2023-10-18T12:20:08.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.009+0000 7fa9dd6df700 1 --2- 172.21.15.114:0/2478042093 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa9c4065720 0x7fa9c4067be0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:08.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.009+0000 7fa9dd6df700 1 --2- 172.21.15.114:0/2478042093 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9d814eb90 0x7fa9d814f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:08.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.009+0000 7fa9dd6df700 1 --2- 172.21.15.114:0/2478042093 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa9d80b0a90 0x7fa9d80b0f10 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:08.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.009+0000 7fa9dd6df700 1 --2- 172.21.15.114:0/2478042093 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa9c0003a90 0x7fa9d814a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:08.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.009+0000 7fa9dd6df700 1 -- 172.21.15.114:0/2478042093 >> 172.21.15.114:0/2478042093 conn(0x7fa9d8069f20 msgr2=0x7fa9d806e290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:08.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.009+0000 7fa9dd6df700 1 -- 172.21.15.114:0/2478042093 shutdown_connections 2023-10-18T12:20:08.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.009+0000 7fa9dd6df700 1 -- 172.21.15.114:0/2478042093 wait complete. 2023-10-18T12:20:08.036 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-18T12:20:08.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.225+0000 7ff98b4a9700 1 Processor -- start 2023-10-18T12:20:08.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.225+0000 7ff98b4a9700 1 -- start start 2023-10-18T12:20:08.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.229+0000 7ff98b4a9700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff98406f9a0 0x7ff98406fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:08.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.229+0000 7ff98b4a9700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff984146ba0 con 0x7ff9841467c0 2023-10-18T12:20:08.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.229+0000 7ff98b4a9700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9840d0920 con 0x7ff9840b5b80 2023-10-18T12:20:08.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.229+0000 7ff98b4a9700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff984070320 con 0x7ff98406f9a0 2023-10-18T12:20:08.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.229+0000 7ff989245700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff9841467c0 0x7ff9841612e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34506/0 (socket says 172.21.15.114:34506) 2023-10-18T12:20:08.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.229+0000 7ff989245700 1 -- 172.21.15.114:0/4072045769 learned_addr learned my addr 172.21.15.114:0/4072045769 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:08.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.229+0000 7ff989a46700 1 --2- 172.21.15.114:0/4072045769 >> v2:172.21.15.172:3300/0 conn(0x7ff98406f9a0 0x7ff98406fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:08.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.229+0000 7ff97bfff700 1 -- 172.21.15.114:0/4072045769 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 947664397 0 0) 0x7ff984146ba0 con 0x7ff9841467c0 2023-10-18T12:20:08.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.229+0000 7ff97bfff700 1 -- 172.21.15.114:0/4072045769 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9700035d0 con 0x7ff9841467c0 2023-10-18T12:20:08.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.229+0000 7ff97bfff700 1 -- 172.21.15.114:0/4072045769 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2494567528 0 0) 0x7ff9840d0920 con 0x7ff9840b5b80 2023-10-18T12:20:08.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.229+0000 7ff97bfff700 1 -- 172.21.15.114:0/4072045769 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff984146ba0 con 0x7ff9840b5b80 2023-10-18T12:20:08.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.229+0000 7ff989a46700 1 -- 172.21.15.114:0/4072045769 >> v1:172.21.15.172:6789/0 conn(0x7ff9840b5b80 legacy=0x7ff98415d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:08.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.229+0000 7ff989a46700 1 -- 172.21.15.114:0/4072045769 >> v1:172.21.15.114:6789/0 conn(0x7ff9841467c0 legacy=0x7ff9841612e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:08.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.229+0000 7ff989a46700 1 -- 172.21.15.114:0/4072045769 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9840b6160 con 0x7ff98406f9a0 2023-10-18T12:20:08.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.233+0000 7ff989a46700 1 --2- 172.21.15.114:0/4072045769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff98406f9a0 0x7ff98406fde0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff97c009d90 tx=0x7ff97c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f7ee45749878c39 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:08.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.233+0000 7ff97bfff700 1 -- 172.21.15.114:0/4072045769 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97c00e070 con 0x7ff98406f9a0 2023-10-18T12:20:08.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.233+0000 7ff97bfff700 1 -- 172.21.15.114:0/4072045769 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff97c00bb20 con 0x7ff98406f9a0 2023-10-18T12:20:08.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.233+0000 7ff97bfff700 1 -- 172.21.15.114:0/4072045769 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97c012430 con 0x7ff98406f9a0 2023-10-18T12:20:08.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.233+0000 7ff98b4a9700 1 -- 172.21.15.114:0/4072045769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff98406f9a0 msgr2=0x7ff98406fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:08.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.233+0000 7ff98b4a9700 1 --2- 172.21.15.114:0/4072045769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff98406f9a0 0x7ff98406fde0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff97c009d90 tx=0x7ff97c00b330 comp rx=0 tx=0).stop 2023-10-18T12:20:08.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.233+0000 7ff98b4a9700 1 -- 172.21.15.114:0/4072045769 shutdown_connections 2023-10-18T12:20:08.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.233+0000 7ff98b4a9700 1 --2- 172.21.15.114:0/4072045769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff98406f9a0 0x7ff98406fde0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:08.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.233+0000 7ff98b4a9700 1 -- 172.21.15.114:0/4072045769 >> 172.21.15.114:0/4072045769 conn(0x7ff98406a130 msgr2=0x7ff98406a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:08.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.233+0000 7ff98b4a9700 1 -- 172.21.15.114:0/4072045769 shutdown_connections 2023-10-18T12:20:08.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.233+0000 7ff98b4a9700 1 -- 172.21.15.114:0/4072045769 wait complete. 2023-10-18T12:20:08.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.237+0000 7ff98b4a9700 1 Processor -- start 2023-10-18T12:20:08.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.237+0000 7ff98b4a9700 1 -- start start 2023-10-18T12:20:08.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.241+0000 7ff98b4a9700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff98406f9a0 0x7ff9841f5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:08.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.241+0000 7ff98b4a9700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff9840b5b80 0x7ff98415eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:08.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.241+0000 7ff98b4a9700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9841467c0 0x7ff98415f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:08.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.241+0000 7ff98b4a9700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98413b3b0 con 0x7ff98406f9a0 2023-10-18T12:20:08.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.241+0000 7ff98b4a9700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98413b690 con 0x7ff9841467c0 2023-10-18T12:20:08.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.241+0000 7ff98b4a9700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff98413b970 con 0x7ff9840b5b80 2023-10-18T12:20:08.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.241+0000 7ff989245700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff98406f9a0 0x7ff9841f5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:08.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.241+0000 7ff989245700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff98406f9a0 0x7ff9841f5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56710/0 (socket says 172.21.15.114:56710) 2023-10-18T12:20:08.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.241+0000 7ff989245700 1 -- 172.21.15.114:0/1412428280 learned_addr learned my addr 172.21.15.114:0/1412428280 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:08.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.241+0000 7ff988a44700 1 --2- 172.21.15.114:0/1412428280 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff9840b5b80 0x7ff98415eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:08.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.241+0000 7ff989a46700 1 --2- 172.21.15.114:0/1412428280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9841467c0 0x7ff98415f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:08.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.241+0000 7ff989245700 1 -- 172.21.15.114:0/1412428280 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff9840b5b80 msgr2=0x7ff98415eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:08.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.241+0000 7ff989245700 1 --2- 172.21.15.114:0/1412428280 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff9840b5b80 0x7ff98415eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:08.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.241+0000 7ff989245700 1 -- 172.21.15.114:0/1412428280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9841467c0 msgr2=0x7ff98415f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:08.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.241+0000 7ff989245700 1 --2- 172.21.15.114:0/1412428280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9841467c0 0x7ff98415f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:08.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.241+0000 7ff989245700 1 -- 172.21.15.114:0/1412428280 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff97c009a70 con 0x7ff98406f9a0 2023-10-18T12:20:08.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.241+0000 7ff989245700 1 --2- 172.21.15.114:0/1412428280 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff98406f9a0 0x7ff9841f5810 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff98000c4d0 tx=0x7ff98000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:08.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.241+0000 7ff979ffb700 1 -- 172.21.15.114:0/1412428280 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff980005d90 con 0x7ff98406f9a0 2023-10-18T12:20:08.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.241+0000 7ff98b4a9700 1 -- 172.21.15.114:0/1412428280 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff98413bc50 con 0x7ff98406f9a0 2023-10-18T12:20:08.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.241+0000 7ff979ffb700 1 -- 172.21.15.114:0/1412428280 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9800070d0 con 0x7ff98406f9a0 2023-10-18T12:20:08.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.241+0000 7ff979ffb700 1 -- 172.21.15.114:0/1412428280 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff980007460 con 0x7ff98406f9a0 2023-10-18T12:20:08.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.241+0000 7ff98b4a9700 1 -- 172.21.15.114:0/1412428280 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff98415cc80 con 0x7ff98406f9a0 2023-10-18T12:20:08.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.245+0000 7ff98b4a9700 1 -- 172.21.15.114:0/1412428280 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff984072e60 con 0x7ff98406f9a0 2023-10-18T12:20:08.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.245+0000 7ff979ffb700 1 -- 172.21.15.114:0/1412428280 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff9800075c0 con 0x7ff98406f9a0 2023-10-18T12:20:08.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.245+0000 7ff979ffb700 1 --2- 172.21.15.114:0/1412428280 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff9680656f0 0x7ff968067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:08.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.245+0000 7ff979ffb700 1 -- 172.21.15.114:0/1412428280 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff980082640 con 0x7ff98406f9a0 2023-10-18T12:20:08.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.245+0000 7ff988a44700 1 --2- 172.21.15.114:0/1412428280 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff9680656f0 0x7ff968067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:08.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.245+0000 7ff988a44700 1 --2- 172.21.15.114:0/1412428280 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff9680656f0 0x7ff968067bb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff974007fd0 tx=0x7ff974009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:08.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.253+0000 7ff979ffb700 1 -- 172.21.15.114:0/1412428280 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7ff98004fe20 con 0x7ff98406f9a0 2023-10-18T12:20:08.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.437+0000 7ff98b4a9700 1 -- 172.21.15.114:0/1412428280 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff9840b7200 con 0x7ff98406f9a0 2023-10-18T12:20:08.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.437+0000 7ff979ffb700 1 -- 172.21.15.114:0/1412428280 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff980053440 con 0x7ff98406f9a0 2023-10-18T12:20:08.442 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 8 2023-10-18T12:20:08.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.441+0000 7ff98b4a9700 1 -- 172.21.15.114:0/1412428280 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff9680656f0 msgr2=0x7ff968067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:08.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.441+0000 7ff98b4a9700 1 --2- 172.21.15.114:0/1412428280 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff9680656f0 0x7ff968067bb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff974007fd0 tx=0x7ff974009040 comp rx=0 tx=0).stop 2023-10-18T12:20:08.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.441+0000 7ff98b4a9700 1 -- 172.21.15.114:0/1412428280 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff98406f9a0 msgr2=0x7ff9841f5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:08.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.441+0000 7ff98b4a9700 1 --2- 172.21.15.114:0/1412428280 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff98406f9a0 0x7ff9841f5810 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff98000c4d0 tx=0x7ff98000c890 comp rx=0 tx=0).stop 2023-10-18T12:20:08.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.441+0000 7ff98b4a9700 1 -- 172.21.15.114:0/1412428280 shutdown_connections 2023-10-18T12:20:08.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.441+0000 7ff98b4a9700 1 --2- 172.21.15.114:0/1412428280 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff9680656f0 0x7ff968067bb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:08.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.441+0000 7ff98b4a9700 1 --2- 172.21.15.114:0/1412428280 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff9840b5b80 0x7ff98415eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:08.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.441+0000 7ff98b4a9700 1 --2- 172.21.15.114:0/1412428280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9841467c0 0x7ff98415f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:08.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.441+0000 7ff98b4a9700 1 --2- 172.21.15.114:0/1412428280 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff98406f9a0 0x7ff9841f5810 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:08.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.441+0000 7ff98b4a9700 1 -- 172.21.15.114:0/1412428280 >> 172.21.15.114:0/1412428280 conn(0x7ff98406a130 msgr2=0x7ff984060730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:08.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.441+0000 7ff98b4a9700 1 -- 172.21.15.114:0/1412428280 shutdown_connections 2023-10-18T12:20:08.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.441+0000 7ff98b4a9700 1 -- 172.21.15.114:0/1412428280 wait complete. 2023-10-18T12:20:08.466 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-18T12:20:08.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.649+0000 7fbbca356700 1 Processor -- start 2023-10-18T12:20:08.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.649+0000 7fbbca356700 1 -- start start 2023-10-18T12:20:08.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.649+0000 7fbbca356700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbbc40caa10 0x7fbbc4167da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:08.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.649+0000 7fbbca356700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbc40ca840 con 0x7fbbc406f450 2023-10-18T12:20:08.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.649+0000 7fbbca356700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbc40ca560 con 0x7fbbc415ce30 2023-10-18T12:20:08.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.649+0000 7fbbca356700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc40ccf30 con 0x7fbbc40caa10 2023-10-18T12:20:08.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.649+0000 7fbbbbfff700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fbbc406f450 0x7fbbc4161120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34512/0 (socket says 172.21.15.114:34512) 2023-10-18T12:20:08.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.649+0000 7fbbbbfff700 1 -- 172.21.15.114:0/4289303632 learned_addr learned my addr 172.21.15.114:0/4289303632 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:08.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.653+0000 7fbbc88f3700 1 --2- 172.21.15.114:0/4289303632 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbbc40caa10 0x7fbbc4167da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:08.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.653+0000 7fbbc37fe700 1 -- 172.21.15.114:0/4289303632 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3413648589 0 0) 0x7fbbc40ca840 con 0x7fbbc406f450 2023-10-18T12:20:08.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.653+0000 7fbbc37fe700 1 -- 172.21.15.114:0/4289303632 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbb00035d0 con 0x7fbbc406f450 2023-10-18T12:20:08.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.653+0000 7fbbc37fe700 1 -- 172.21.15.114:0/4289303632 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 118935505 0 0) 0x7fbbc40ca560 con 0x7fbbc415ce30 2023-10-18T12:20:08.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.653+0000 7fbbc37fe700 1 -- 172.21.15.114:0/4289303632 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbc40ca840 con 0x7fbbc415ce30 2023-10-18T12:20:08.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.653+0000 7fbbc37fe700 1 -- 172.21.15.114:0/4289303632 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3573832371 0 0) 0x7fbbb00035d0 con 0x7fbbc406f450 2023-10-18T12:20:08.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.653+0000 7fbbc37fe700 1 -- 172.21.15.114:0/4289303632 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbbc40caa10 msgr2=0x7fbbc4167da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:08.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.653+0000 7fbbc37fe700 1 --2- 172.21.15.114:0/4289303632 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbbc40caa10 0x7fbbc4167da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:08.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.653+0000 7fbbc37fe700 1 -- 172.21.15.114:0/4289303632 >> v1:172.21.15.172:6789/0 conn(0x7fbbc415ce30 legacy=0x7fbbc4160a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:08.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.653+0000 7fbbc37fe700 1 -- 172.21.15.114:0/4289303632 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc40cd210 con 0x7fbbc406f450 2023-10-18T12:20:08.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.653+0000 7fbbc37fe700 1 -- 172.21.15.114:0/4289303632 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3368469509 0 0) 0x7fbbac001670 con 0x7fbbc406f450 2023-10-18T12:20:08.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.653+0000 7fbbc37fe700 1 -- 172.21.15.114:0/4289303632 >> v1:172.21.15.114:6789/0 conn(0x7fbbc406f450 legacy=0x7fbbc4161120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:08.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.653+0000 7fbbc37fe700 1 --2- 172.21.15.114:0/4289303632 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbbb0003c50 0x7fbbb0004050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:08.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.653+0000 7fbbc37fe700 1 --2- 172.21.15.114:0/4289303632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbb0004870 0x7fbbb0004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:08.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.653+0000 7fbbc37fe700 1 --2- 172.21.15.114:0/4289303632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbb0005230 0x7fbbb000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:08.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.653+0000 7fbbc37fe700 1 -- 172.21.15.114:0/4289303632 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc40ccf30 con 0x7fbbb0004870 2023-10-18T12:20:08.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.653+0000 7fbbc37fe700 1 -- 172.21.15.114:0/4289303632 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb000c130 con 0x7fbbb0005230 2023-10-18T12:20:08.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.653+0000 7fbbc37fe700 1 -- 172.21.15.114:0/4289303632 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb000c2f0 con 0x7fbbb0003c50 2023-10-18T12:20:08.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.653+0000 7fbbbbfff700 1 --2- 172.21.15.114:0/4289303632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbb0004870 0x7fbbb0004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:08.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.653+0000 7fbbc3fff700 1 --2- 172.21.15.114:0/4289303632 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbbb0003c50 0x7fbbb0004050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:08.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.653+0000 7fbbc88f3700 1 --2- 172.21.15.114:0/4289303632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbb0005230 0x7fbbb000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:08.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.653+0000 7fbbbbfff700 1 -- 172.21.15.114:0/4289303632 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbbb0003c50 msgr2=0x7fbbb0004050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:08.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.653+0000 7fbbbbfff700 1 --2- 172.21.15.114:0/4289303632 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbbb0003c50 0x7fbbb0004050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:08.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.653+0000 7fbbbbfff700 1 -- 172.21.15.114:0/4289303632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbb0005230 msgr2=0x7fbbb000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:08.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.653+0000 7fbbbbfff700 1 --2- 172.21.15.114:0/4289303632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbb0005230 0x7fbbb000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:08.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.653+0000 7fbbbbfff700 1 -- 172.21.15.114:0/4289303632 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb00035d0 con 0x7fbbb0004870 2023-10-18T12:20:08.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.653+0000 7fbbc88f3700 1 --2- 172.21.15.114:0/4289303632 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbb0005230 0x7fbbb000ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:20:08.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.653+0000 7fbbbbfff700 1 --2- 172.21.15.114:0/4289303632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbb0004870 0x7fbbb0004cf0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbbac00c210 tx=0x7fbbb00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=875d3bb6d683fca5 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:08.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.653+0000 7fbbc37fe700 1 -- 172.21.15.114:0/4289303632 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac00cdb0 con 0x7fbbb0004870 2023-10-18T12:20:08.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.653+0000 7fbbc37fe700 1 -- 172.21.15.114:0/4289303632 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbac005980 con 0x7fbbb0004870 2023-10-18T12:20:08.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.653+0000 7fbbc37fe700 1 -- 172.21.15.114:0/4289303632 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac005cf0 con 0x7fbbb0004870 2023-10-18T12:20:08.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.657+0000 7fbbca356700 1 -- 172.21.15.114:0/4289303632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbb0004870 msgr2=0x7fbbb0004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:08.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.657+0000 7fbbca356700 1 --2- 172.21.15.114:0/4289303632 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbb0004870 0x7fbbb0004cf0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbbac00c210 tx=0x7fbbb00058a0 comp rx=0 tx=0).stop 2023-10-18T12:20:08.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.657+0000 7fbbc88f3700 1 -- 172.21.15.114:0/4289303632 reap_dead start 2023-10-18T12:20:08.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.657+0000 7fbbca356700 1 -- 172.21.15.114:0/4289303632 shutdown_connections 2023-10-18T12:20:08.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.657+0000 7fbbca356700 1 -- 172.21.15.114:0/4289303632 >> 172.21.15.114:0/4289303632 conn(0x7fbbc40ce820 msgr2=0x7fbbc40cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:08.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.657+0000 7fbbca356700 1 -- 172.21.15.114:0/4289303632 shutdown_connections 2023-10-18T12:20:08.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.657+0000 7fbbca356700 1 -- 172.21.15.114:0/4289303632 wait complete. 2023-10-18T12:20:08.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.657+0000 7fbbca356700 1 Processor -- start 2023-10-18T12:20:08.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.657+0000 7fbbca356700 1 -- start start 2023-10-18T12:20:08.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.661+0000 7fbbca356700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbc415fdf0 0x7fbbc4158f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:08.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.661+0000 7fbbca356700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbc414a9d0 0x7fbbc40b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:08.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.661+0000 7fbbca356700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbbc40b39f0 0x7fbbc40c6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:08.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.661+0000 7fbbca356700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc4148970 con 0x7fbbc414a9d0 2023-10-18T12:20:08.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.661+0000 7fbbca356700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc40b3e50 con 0x7fbbc415fdf0 2023-10-18T12:20:08.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.661+0000 7fbbca356700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc41486c0 con 0x7fbbc40b39f0 2023-10-18T12:20:08.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.661+0000 7fbbbbfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbc414a9d0 0x7fbbc40b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:08.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.661+0000 7fbbbbfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbc414a9d0 0x7fbbc40b34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56736/0 (socket says 172.21.15.114:56736) 2023-10-18T12:20:08.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.661+0000 7fbbbbfff700 1 -- 172.21.15.114:0/4119620804 learned_addr learned my addr 172.21.15.114:0/4119620804 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:08.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.661+0000 7fbbbbfff700 1 -- 172.21.15.114:0/4119620804 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbbc40b39f0 msgr2=0x7fbbc40c6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:08.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.661+0000 7fbbc88f3700 1 --2- 172.21.15.114:0/4119620804 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbbc40b39f0 0x7fbbc40c6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:08.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.661+0000 7fbbc3fff700 1 --2- 172.21.15.114:0/4119620804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbc415fdf0 0x7fbbc4158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:08.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.661+0000 7fbbbbfff700 1 --2- 172.21.15.114:0/4119620804 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbbc40b39f0 0x7fbbc40c6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:08.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.661+0000 7fbbbbfff700 1 -- 172.21.15.114:0/4119620804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbc415fdf0 msgr2=0x7fbbc4158f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:08.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.661+0000 7fbbbbfff700 1 --2- 172.21.15.114:0/4119620804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbc415fdf0 0x7fbbc4158f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:08.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.661+0000 7fbbbbfff700 1 -- 172.21.15.114:0/4119620804 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc4148c30 con 0x7fbbc414a9d0 2023-10-18T12:20:08.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.661+0000 7fbbc3fff700 1 --2- 172.21.15.114:0/4119620804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbc415fdf0 0x7fbbc4158f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:20:08.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.661+0000 7fbbbbfff700 1 --2- 172.21.15.114:0/4119620804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbc414a9d0 0x7fbbc40b34b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbbac00c800 tx=0x7fbbac001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:08.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.661+0000 7fbbc17fa700 1 -- 172.21.15.114:0/4119620804 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac005d00 con 0x7fbbc414a9d0 2023-10-18T12:20:08.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.661+0000 7fbbc17fa700 1 -- 172.21.15.114:0/4119620804 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbac005e60 con 0x7fbbc414a9d0 2023-10-18T12:20:08.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.661+0000 7fbbca356700 1 -- 172.21.15.114:0/4119620804 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbc414b1e0 con 0x7fbbc414a9d0 2023-10-18T12:20:08.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.661+0000 7fbbc17fa700 1 -- 172.21.15.114:0/4119620804 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac007310 con 0x7fbbc414a9d0 2023-10-18T12:20:08.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.661+0000 7fbbca356700 1 -- 172.21.15.114:0/4119620804 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbc414b7a0 con 0x7fbbc414a9d0 2023-10-18T12:20:08.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.661+0000 7fbbca356700 1 -- 172.21.15.114:0/4119620804 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbc414b990 con 0x7fbbc414a9d0 2023-10-18T12:20:08.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.665+0000 7fbbc17fa700 1 -- 172.21.15.114:0/4119620804 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fbbac019070 con 0x7fbbc414a9d0 2023-10-18T12:20:08.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.665+0000 7fbbc17fa700 1 --2- 172.21.15.114:0/4119620804 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fbba40656f0 0x7fbba4067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:08.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.665+0000 7fbbc17fa700 1 -- 172.21.15.114:0/4119620804 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbbac083ae0 con 0x7fbbc414a9d0 2023-10-18T12:20:08.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.665+0000 7fbbc3fff700 1 --2- 172.21.15.114:0/4119620804 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fbba40656f0 0x7fbba4067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:08.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.669+0000 7fbbc3fff700 1 --2- 172.21.15.114:0/4119620804 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fbba40656f0 0x7fbba4067bb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4007fd0 tx=0x7fbbb4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:08.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.669+0000 7fbbc17fa700 1 -- 172.21.15.114:0/4119620804 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fbbc414b990 con 0x7fbbc414a9d0 2023-10-18T12:20:08.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.853+0000 7fbbca356700 1 -- 172.21.15.114:0/4119620804 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbbc414b990 con 0x7fbbc414a9d0 2023-10-18T12:20:08.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.853+0000 7fbbc17fa700 1 -- 172.21.15.114:0/4119620804 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbbc414b990 con 0x7fbbc414a9d0 2023-10-18T12:20:08.858 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-10-18T12:20:08.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.857+0000 7fbbca356700 1 -- 172.21.15.114:0/4119620804 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fbba40656f0 msgr2=0x7fbba4067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:08.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.857+0000 7fbbca356700 1 --2- 172.21.15.114:0/4119620804 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fbba40656f0 0x7fbba4067bb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4007fd0 tx=0x7fbbb4009040 comp rx=0 tx=0).stop 2023-10-18T12:20:08.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.857+0000 7fbbca356700 1 -- 172.21.15.114:0/4119620804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbc414a9d0 msgr2=0x7fbbc40b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:08.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.857+0000 7fbbca356700 1 --2- 172.21.15.114:0/4119620804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbc414a9d0 0x7fbbc40b34b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbbac00c800 tx=0x7fbbac001980 comp rx=0 tx=0).stop 2023-10-18T12:20:08.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.857+0000 7fbbca356700 1 -- 172.21.15.114:0/4119620804 shutdown_connections 2023-10-18T12:20:08.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.857+0000 7fbbca356700 1 --2- 172.21.15.114:0/4119620804 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fbba40656f0 0x7fbba4067bb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:08.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.857+0000 7fbbca356700 1 --2- 172.21.15.114:0/4119620804 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbbc40b39f0 0x7fbbc40c6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:08.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.857+0000 7fbbca356700 1 --2- 172.21.15.114:0/4119620804 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbbc414a9d0 0x7fbbc40b34b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:08.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.857+0000 7fbbca356700 1 --2- 172.21.15.114:0/4119620804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbc415fdf0 0x7fbbc4158f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:08.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.857+0000 7fbbca356700 1 -- 172.21.15.114:0/4119620804 >> 172.21.15.114:0/4119620804 conn(0x7fbbc40ce820 msgr2=0x7fbbc4160cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:08.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.857+0000 7fbbca356700 1 -- 172.21.15.114:0/4119620804 shutdown_connections 2023-10-18T12:20:08.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:08.857+0000 7fbbca356700 1 -- 172.21.15.114:0/4119620804 wait complete. 2023-10-18T12:20:08.885 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-18T12:20:09.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.069+0000 7fd53f01e700 1 Processor -- start 2023-10-18T12:20:09.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.069+0000 7fd53f01e700 1 -- start start 2023-10-18T12:20:09.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.069+0000 7fd53f01e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5380ccfe0 0x7fd53806f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:09.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.069+0000 7fd53f01e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd53806f990 0x7fd53806fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:09.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.069+0000 7fd53f01e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd53815b1d0 con 0x7fd53815adf0 2023-10-18T12:20:09.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.069+0000 7fd53f01e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5380ca590 con 0x7fd53806f990 2023-10-18T12:20:09.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.069+0000 7fd53f01e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5380ce600 con 0x7fd5380ccfe0 2023-10-18T12:20:09.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.069+0000 7fd53d5bb700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd53806f990 0x7fd53806fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:09.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.069+0000 7fd53d5bb700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd53806f990 0x7fd53806fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56740/0 (socket says 172.21.15.114:56740) 2023-10-18T12:20:09.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.069+0000 7fd53d5bb700 1 -- 172.21.15.114:0/3515443243 learned_addr learned my addr 172.21.15.114:0/3515443243 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:09.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.073+0000 7fd537fff700 1 --2- 172.21.15.114:0/3515443243 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5380ccfe0 0x7fd53806f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:09.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.073+0000 7fd53d5bb700 1 -- 172.21.15.114:0/3515443243 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5380ccfe0 msgr2=0x7fd53806f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:09.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.073+0000 7fd53d5bb700 1 --2- 172.21.15.114:0/3515443243 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5380ccfe0 0x7fd53806f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:09.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.073+0000 7fd53d5bb700 1 -- 172.21.15.114:0/3515443243 >> v1:172.21.15.114:6789/0 conn(0x7fd53815adf0 legacy=0x7fd5380cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:09.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.073+0000 7fd53d5bb700 1 -- 172.21.15.114:0/3515443243 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5380cd580 con 0x7fd53806f990 2023-10-18T12:20:09.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.073+0000 7fd53d5bb700 1 --2- 172.21.15.114:0/3515443243 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd53806f990 0x7fd53806fe20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd530009e50 tx=0x7fd53000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c8c8572e8e92da6 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:09.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.073+0000 7fd5377fe700 1 -- 172.21.15.114:0/3515443243 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53000e070 con 0x7fd53806f990 2023-10-18T12:20:09.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.073+0000 7fd5377fe700 1 -- 172.21.15.114:0/3515443243 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53000b9c0 con 0x7fd53806f990 2023-10-18T12:20:09.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.073+0000 7fd5377fe700 1 -- 172.21.15.114:0/3515443243 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53000bd70 con 0x7fd53806f990 2023-10-18T12:20:09.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.073+0000 7fd53f01e700 1 -- 172.21.15.114:0/3515443243 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd53806f990 msgr2=0x7fd53806fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:09.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.073+0000 7fd53f01e700 1 --2- 172.21.15.114:0/3515443243 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd53806f990 0x7fd53806fe20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd530009e50 tx=0x7fd53000b330 comp rx=0 tx=0).stop 2023-10-18T12:20:09.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.073+0000 7fd53f01e700 1 -- 172.21.15.114:0/3515443243 shutdown_connections 2023-10-18T12:20:09.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.073+0000 7fd53f01e700 1 --2- 172.21.15.114:0/3515443243 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd53806f990 0x7fd53806fe20 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:09.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.073+0000 7fd53f01e700 1 --2- 172.21.15.114:0/3515443243 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5380ccfe0 0x7fd53806f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:09.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.073+0000 7fd53f01e700 1 -- 172.21.15.114:0/3515443243 >> 172.21.15.114:0/3515443243 conn(0x7fd5380ce820 msgr2=0x7fd5380cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:09.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.073+0000 7fd53f01e700 1 -- 172.21.15.114:0/3515443243 shutdown_connections 2023-10-18T12:20:09.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.073+0000 7fd53f01e700 1 -- 172.21.15.114:0/3515443243 wait complete. 2023-10-18T12:20:09.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.077+0000 7fd53f01e700 1 Processor -- start 2023-10-18T12:20:09.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.077+0000 7fd53f01e700 1 -- start start 2023-10-18T12:20:09.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.081+0000 7fd53f01e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd53806f990 0x7fd538146c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:09.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.081+0000 7fd53f01e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5380ccfe0 0x7fd53815dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:09.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.081+0000 7fd53f01e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd53815adf0 0x7fd5380b1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:09.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.081+0000 7fd53f01e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd538147170 con 0x7fd53815adf0 2023-10-18T12:20:09.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.081+0000 7fd53f01e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53815c260 con 0x7fd5380ccfe0 2023-10-18T12:20:09.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.081+0000 7fd53f01e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd538146150 con 0x7fd53806f990 2023-10-18T12:20:09.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.081+0000 7fd53d5bb700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd53815adf0 0x7fd5380b1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:09.087 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.081+0000 7fd53d5bb700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd53815adf0 0x7fd5380b1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56748/0 (socket says 172.21.15.114:56748) 2023-10-18T12:20:09.087 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.081+0000 7fd53d5bb700 1 -- 172.21.15.114:0/4286657041 learned_addr learned my addr 172.21.15.114:0/4286657041 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:09.087 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.081+0000 7fd53cdba700 1 --2- 172.21.15.114:0/4286657041 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd53806f990 0x7fd538146c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:09.087 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.081+0000 7fd537fff700 1 --2- 172.21.15.114:0/4286657041 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5380ccfe0 0x7fd53815dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:09.087 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.081+0000 7fd53d5bb700 1 -- 172.21.15.114:0/4286657041 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd53806f990 msgr2=0x7fd538146c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:09.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.081+0000 7fd53d5bb700 1 --2- 172.21.15.114:0/4286657041 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd53806f990 0x7fd538146c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:09.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.081+0000 7fd53d5bb700 1 -- 172.21.15.114:0/4286657041 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5380ccfe0 msgr2=0x7fd53815dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:09.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.081+0000 7fd53d5bb700 1 --2- 172.21.15.114:0/4286657041 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5380ccfe0 0x7fd53815dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:09.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.081+0000 7fd53d5bb700 1 -- 172.21.15.114:0/4286657041 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd530009b30 con 0x7fd53815adf0 2023-10-18T12:20:09.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.081+0000 7fd53d5bb700 1 --2- 172.21.15.114:0/4286657041 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd53815adf0 0x7fd5380b1a90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd538066ec0 tx=0x7fd530004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:09.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.081+0000 7fd5357fa700 1 -- 172.21.15.114:0/4286657041 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd530004920 con 0x7fd53815adf0 2023-10-18T12:20:09.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.081+0000 7fd5357fa700 1 -- 172.21.15.114:0/4286657041 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5300099b0 con 0x7fd53815adf0 2023-10-18T12:20:09.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.081+0000 7fd53f01e700 1 -- 172.21.15.114:0/4286657041 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd538146430 con 0x7fd53815adf0 2023-10-18T12:20:09.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.081+0000 7fd5357fa700 1 -- 172.21.15.114:0/4286657041 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53001c680 con 0x7fd53815adf0 2023-10-18T12:20:09.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.081+0000 7fd53f01e700 1 -- 172.21.15.114:0/4286657041 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd538145df0 con 0x7fd53815adf0 2023-10-18T12:20:09.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.085+0000 7fd53f01e700 1 -- 172.21.15.114:0/4286657041 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd538072e60 con 0x7fd53815adf0 2023-10-18T12:20:09.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.085+0000 7fd5357fa700 1 -- 172.21.15.114:0/4286657041 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fd53001c7e0 con 0x7fd53815adf0 2023-10-18T12:20:09.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.085+0000 7fd5357fa700 1 --2- 172.21.15.114:0/4286657041 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd51c0656f0 0x7fd51c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:09.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.085+0000 7fd5357fa700 1 -- 172.21.15.114:0/4286657041 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd530084df0 con 0x7fd53815adf0 2023-10-18T12:20:09.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.085+0000 7fd53cdba700 1 --2- 172.21.15.114:0/4286657041 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd51c0656f0 0x7fd51c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:09.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.089+0000 7fd53cdba700 1 --2- 172.21.15.114:0/4286657041 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd51c0656f0 0x7fd51c067bb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd52c000f60 tx=0x7fd52c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:09.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.093+0000 7fd5357fa700 1 -- 172.21.15.114:0/4286657041 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fd5300525b0 con 0x7fd53815adf0 2023-10-18T12:20:09.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.269+0000 7fd53f01e700 1 -- 172.21.15.114:0/4286657041 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd53806ef30 con 0x7fd53815adf0 2023-10-18T12:20:09.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.269+0000 7fd5357fa700 1 -- 172.21.15.114:0/4286657041 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd530055bd0 con 0x7fd53815adf0 2023-10-18T12:20:09.275 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-10-18T12:20:09.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.273+0000 7fd53f01e700 1 -- 172.21.15.114:0/4286657041 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd51c0656f0 msgr2=0x7fd51c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:09.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.273+0000 7fd53f01e700 1 --2- 172.21.15.114:0/4286657041 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd51c0656f0 0x7fd51c067bb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd52c000f60 tx=0x7fd52c009040 comp rx=0 tx=0).stop 2023-10-18T12:20:09.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.273+0000 7fd53f01e700 1 -- 172.21.15.114:0/4286657041 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd53815adf0 msgr2=0x7fd5380b1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:09.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.273+0000 7fd53f01e700 1 --2- 172.21.15.114:0/4286657041 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd53815adf0 0x7fd5380b1a90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd538066ec0 tx=0x7fd530004af0 comp rx=0 tx=0).stop 2023-10-18T12:20:09.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.273+0000 7fd53f01e700 1 -- 172.21.15.114:0/4286657041 shutdown_connections 2023-10-18T12:20:09.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.273+0000 7fd53f01e700 1 --2- 172.21.15.114:0/4286657041 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd51c0656f0 0x7fd51c067bb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:09.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.273+0000 7fd53f01e700 1 --2- 172.21.15.114:0/4286657041 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd53815adf0 0x7fd5380b1a90 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:09.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.273+0000 7fd53f01e700 1 --2- 172.21.15.114:0/4286657041 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5380ccfe0 0x7fd53815dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:09.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.273+0000 7fd53f01e700 1 --2- 172.21.15.114:0/4286657041 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd53806f990 0x7fd538146c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:09.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.273+0000 7fd53f01e700 1 -- 172.21.15.114:0/4286657041 >> 172.21.15.114:0/4286657041 conn(0x7fd5380ce820 msgr2=0x7fd5380ad7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:09.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.273+0000 7fd53f01e700 1 -- 172.21.15.114:0/4286657041 shutdown_connections 2023-10-18T12:20:09.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.273+0000 7fd53f01e700 1 -- 172.21.15.114:0/4286657041 wait complete. 2023-10-18T12:20:09.298 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-18T12:20:09.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.469+0000 7f8c79508700 1 Processor -- start 2023-10-18T12:20:09.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.469+0000 7f8c79508700 1 -- start start 2023-10-18T12:20:09.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.473+0000 7f8c79508700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8c7406d090 0x7f8c740b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:09.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.473+0000 7f8c79508700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c7406d470 0x7f8c74070a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:09.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.473+0000 7f8c79508700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c7415e990 con 0x7f8c74070f50 2023-10-18T12:20:09.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.473+0000 7f8c79508700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c7415f4f0 con 0x7f8c7406d090 2023-10-18T12:20:09.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.473+0000 7f8c79508700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7415ec50 con 0x7f8c7406d470 2023-10-18T12:20:09.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.473+0000 7f8c72ffd700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8c7406d090 0x7f8c740b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:09.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.473+0000 7f8c72ffd700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8c7406d090 0x7f8c740b2590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56754/0 (socket says 172.21.15.114:56754) 2023-10-18T12:20:09.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.473+0000 7f8c72ffd700 1 -- 172.21.15.114:0/2358654074 learned_addr learned my addr 172.21.15.114:0/2358654074 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:09.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.473+0000 7f8c6bfff700 1 --2- 172.21.15.114:0/2358654074 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c7406d470 0x7f8c74070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:09.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.473+0000 7f8c72ffd700 1 -- 172.21.15.114:0/2358654074 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c7406d470 msgr2=0x7f8c74070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:09.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.473+0000 7f8c72ffd700 1 --2- 172.21.15.114:0/2358654074 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c7406d470 0x7f8c74070a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:09.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.473+0000 7f8c72ffd700 1 -- 172.21.15.114:0/2358654074 >> v1:172.21.15.172:6789/0 conn(0x7f8c74070f50 legacy=0x7f8c7415a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:09.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.473+0000 7f8c72ffd700 1 -- 172.21.15.114:0/2358654074 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c7415ef30 con 0x7f8c7406d090 2023-10-18T12:20:09.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.477+0000 7f8c72ffd700 1 --2- 172.21.15.114:0/2358654074 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c7406d090 0x7f8c740b2590 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8c64009910 tx=0x7f8c64009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=136d69439a7e4d97 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:09.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.477+0000 7f8c727fc700 1 -- 172.21.15.114:0/2358654074 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c64011830 con 0x7f8c7406d090 2023-10-18T12:20:09.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.477+0000 7f8c727fc700 1 -- 172.21.15.114:0/2358654074 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c64011990 con 0x7f8c7406d090 2023-10-18T12:20:09.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.477+0000 7f8c727fc700 1 -- 172.21.15.114:0/2358654074 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c64011d40 con 0x7f8c7406d090 2023-10-18T12:20:09.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.477+0000 7f8c79508700 1 -- 172.21.15.114:0/2358654074 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c7406d090 msgr2=0x7f8c740b2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:09.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.477+0000 7f8c79508700 1 --2- 172.21.15.114:0/2358654074 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c7406d090 0x7f8c740b2590 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8c64009910 tx=0x7f8c64009c20 comp rx=0 tx=0).stop 2023-10-18T12:20:09.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.477+0000 7f8c79508700 1 -- 172.21.15.114:0/2358654074 shutdown_connections 2023-10-18T12:20:09.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.477+0000 7f8c79508700 1 --2- 172.21.15.114:0/2358654074 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c7406d470 0x7f8c74070a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:09.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.477+0000 7f8c79508700 1 --2- 172.21.15.114:0/2358654074 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c7406d090 0x7f8c740b2590 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:09.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.477+0000 7f8c79508700 1 -- 172.21.15.114:0/2358654074 >> 172.21.15.114:0/2358654074 conn(0x7f8c740ce5c0 msgr2=0x7f8c740ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:09.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.477+0000 7f8c79508700 1 -- 172.21.15.114:0/2358654074 shutdown_connections 2023-10-18T12:20:09.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.477+0000 7f8c79508700 1 -- 172.21.15.114:0/2358654074 wait complete. 2023-10-18T12:20:09.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.481+0000 7f8c79508700 1 Processor -- start 2023-10-18T12:20:09.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.481+0000 7f8c79508700 1 -- start start 2023-10-18T12:20:09.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.481+0000 7f8c79508700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c7406d090 0x7f8c7414bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:09.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.481+0000 7f8c79508700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c7406d470 0x7f8c740cd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:09.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.481+0000 7f8c79508700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c74070f50 0x7f8c74158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:09.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.481+0000 7f8c79508700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c740cc190 con 0x7f8c74070f50 2023-10-18T12:20:09.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.481+0000 7f8c79508700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7414c4d0 con 0x7f8c7406d470 2023-10-18T12:20:09.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.481+0000 7f8c79508700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c740cdff0 con 0x7f8c7406d090 2023-10-18T12:20:09.488 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.481+0000 7f8c737fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c74070f50 0x7f8c74158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:09.488 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.481+0000 7f8c737fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c74070f50 0x7f8c74158ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56762/0 (socket says 172.21.15.114:56762) 2023-10-18T12:20:09.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.481+0000 7f8c6bfff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c7406d470 0x7f8c740cd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:09.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.481+0000 7f8c737fe700 1 -- 172.21.15.114:0/3044351077 learned_addr learned my addr 172.21.15.114:0/3044351077 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:09.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.481+0000 7f8c72ffd700 1 --2- 172.21.15.114:0/3044351077 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c7406d090 0x7f8c7414bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:09.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.481+0000 7f8c737fe700 1 -- 172.21.15.114:0/3044351077 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c7406d090 msgr2=0x7f8c7414bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:09.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.481+0000 7f8c737fe700 1 --2- 172.21.15.114:0/3044351077 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c7406d090 0x7f8c7414bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:09.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.481+0000 7f8c737fe700 1 -- 172.21.15.114:0/3044351077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c7406d470 msgr2=0x7f8c740cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:09.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.481+0000 7f8c737fe700 1 --2- 172.21.15.114:0/3044351077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c7406d470 0x7f8c740cd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:09.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.481+0000 7f8c737fe700 1 -- 172.21.15.114:0/3044351077 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c64009570 con 0x7f8c74070f50 2023-10-18T12:20:09.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.485+0000 7f8c737fe700 1 --2- 172.21.15.114:0/3044351077 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c74070f50 0x7f8c74158ff0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c00cbc0 tx=0x7f8c6c00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:09.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.485+0000 7f8c6b7fe700 1 -- 172.21.15.114:0/3044351077 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c003c20 con 0x7f8c74070f50 2023-10-18T12:20:09.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.485+0000 7f8c6b7fe700 1 -- 172.21.15.114:0/3044351077 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6c003d80 con 0x7f8c74070f50 2023-10-18T12:20:09.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.485+0000 7f8c6b7fe700 1 -- 172.21.15.114:0/3044351077 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c00aa20 con 0x7f8c74070f50 2023-10-18T12:20:09.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.485+0000 7f8c79508700 1 -- 172.21.15.114:0/3044351077 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c740cc3e0 con 0x7f8c74070f50 2023-10-18T12:20:09.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.485+0000 7f8c79508700 1 -- 172.21.15.114:0/3044351077 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c740cc9a0 con 0x7f8c74070f50 2023-10-18T12:20:09.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.485+0000 7f8c79508700 1 -- 172.21.15.114:0/3044351077 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c7404e910 con 0x7f8c74070f50 2023-10-18T12:20:09.492 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.489+0000 7f8c6b7fe700 1 -- 172.21.15.114:0/3044351077 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f8c6c00ab80 con 0x7f8c74070f50 2023-10-18T12:20:09.493 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.489+0000 7f8c6b7fe700 1 --2- 172.21.15.114:0/3044351077 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8c540656f0 0x7f8c54067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:09.494 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.489+0000 7f8c6b7fe700 1 -- 172.21.15.114:0/3044351077 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8c6c082fe0 con 0x7f8c74070f50 2023-10-18T12:20:09.494 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.489+0000 7f8c72ffd700 1 --2- 172.21.15.114:0/3044351077 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8c540656f0 0x7f8c54067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:09.495 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.489+0000 7f8c72ffd700 1 --2- 172.21.15.114:0/3044351077 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8c540656f0 0x7f8c54067bb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8c64000c00 tx=0x7f8c64008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:09.498 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.493+0000 7f8c6b7fe700 1 -- 172.21.15.114:0/3044351077 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f8c6c050730 con 0x7f8c74070f50 2023-10-18T12:20:09.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.673+0000 7f8c79508700 1 -- 172.21.15.114:0/3044351077 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8c740b1e90 con 0x7f8c74070f50 2023-10-18T12:20:09.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.673+0000 7f8c6b7fe700 1 -- 172.21.15.114:0/3044351077 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8c6c053d50 con 0x7f8c74070f50 2023-10-18T12:20:09.677 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-10-18T12:20:09.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.677+0000 7f8c79508700 1 -- 172.21.15.114:0/3044351077 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8c540656f0 msgr2=0x7f8c54067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:09.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.677+0000 7f8c79508700 1 --2- 172.21.15.114:0/3044351077 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8c540656f0 0x7f8c54067bb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8c64000c00 tx=0x7f8c64008030 comp rx=0 tx=0).stop 2023-10-18T12:20:09.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.677+0000 7f8c79508700 1 -- 172.21.15.114:0/3044351077 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c74070f50 msgr2=0x7f8c74158ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:09.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.677+0000 7f8c79508700 1 --2- 172.21.15.114:0/3044351077 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c74070f50 0x7f8c74158ff0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c00cbc0 tx=0x7f8c6c00ced0 comp rx=0 tx=0).stop 2023-10-18T12:20:09.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.677+0000 7f8c79508700 1 -- 172.21.15.114:0/3044351077 shutdown_connections 2023-10-18T12:20:09.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.677+0000 7f8c79508700 1 --2- 172.21.15.114:0/3044351077 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8c540656f0 0x7f8c54067bb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:09.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.677+0000 7f8c79508700 1 --2- 172.21.15.114:0/3044351077 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c74070f50 0x7f8c74158ff0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:09.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.677+0000 7f8c79508700 1 --2- 172.21.15.114:0/3044351077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c7406d470 0x7f8c740cd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:09.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.677+0000 7f8c79508700 1 --2- 172.21.15.114:0/3044351077 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c7406d090 0x7f8c7414bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:09.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.677+0000 7f8c79508700 1 -- 172.21.15.114:0/3044351077 >> 172.21.15.114:0/3044351077 conn(0x7f8c740ce5c0 msgr2=0x7f8c74154d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:09.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.677+0000 7f8c79508700 1 -- 172.21.15.114:0/3044351077 shutdown_connections 2023-10-18T12:20:09.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.677+0000 7f8c79508700 1 -- 172.21.15.114:0/3044351077 wait complete. 2023-10-18T12:20:09.704 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T12:20:09.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.877+0000 7fd834a3d700 1 Processor -- start 2023-10-18T12:20:09.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.877+0000 7fd834a3d700 1 -- start start 2023-10-18T12:20:09.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.881+0000 7fd834a3d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd83015a410 0x7fd83015a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:09.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.881+0000 7fd834a3d700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd830071120 con 0x7fd83006d090 2023-10-18T12:20:09.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.881+0000 7fd834a3d700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd83015e990 con 0x7fd83006d470 2023-10-18T12:20:09.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.881+0000 7fd834a3d700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd83015f4f0 con 0x7fd83015a410 2023-10-18T12:20:09.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.881+0000 7fd82ed9d700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd83006d090 0x7fd8300b2590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34540/0 (socket says 172.21.15.114:34540) 2023-10-18T12:20:09.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.881+0000 7fd82ed9d700 1 -- 172.21.15.114:0/2223622790 learned_addr learned my addr 172.21.15.114:0/2223622790 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:09.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.881+0000 7fd82f59e700 1 --2- 172.21.15.114:0/2223622790 >> v2:172.21.15.114:3300/0 conn(0x7fd83015a410 0x7fd83015a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:09.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.881+0000 7fd82dd9b700 1 -- 172.21.15.114:0/2223622790 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2907059910 0 0) 0x7fd830071120 con 0x7fd83006d090 2023-10-18T12:20:09.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.881+0000 7fd82dd9b700 1 -- 172.21.15.114:0/2223622790 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8180035d0 con 0x7fd83006d090 2023-10-18T12:20:09.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.881+0000 7fd82f59e700 1 -- 172.21.15.114:0/2223622790 >> v1:172.21.15.172:6789/0 conn(0x7fd83006d470 legacy=0x7fd830070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:09.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.881+0000 7fd82dd9b700 1 -- 172.21.15.114:0/2223622790 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2180650542 0 0) 0x7fd83015e990 con 0x7fd83006d470 2023-10-18T12:20:09.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.881+0000 7fd82f59e700 1 -- 172.21.15.114:0/2223622790 >> v1:172.21.15.114:6789/0 conn(0x7fd83006d090 legacy=0x7fd8300b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:09.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.881+0000 7fd82f59e700 1 -- 172.21.15.114:0/2223622790 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd83015ec50 con 0x7fd83015a410 2023-10-18T12:20:09.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.885+0000 7fd82f59e700 1 --2- 172.21.15.114:0/2223622790 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd83015a410 0x7fd83015a8c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd828009d90 tx=0x7fd82800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=765b77d684c52927 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:09.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.885+0000 7fd82dd9b700 1 -- 172.21.15.114:0/2223622790 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82800e070 con 0x7fd83015a410 2023-10-18T12:20:09.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.885+0000 7fd82dd9b700 1 -- 172.21.15.114:0/2223622790 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82800bb20 con 0x7fd83015a410 2023-10-18T12:20:09.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.885+0000 7fd82dd9b700 1 -- 172.21.15.114:0/2223622790 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82800bed0 con 0x7fd83015a410 2023-10-18T12:20:09.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.885+0000 7fd834a3d700 1 -- 172.21.15.114:0/2223622790 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd83015a410 msgr2=0x7fd83015a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:09.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.885+0000 7fd834a3d700 1 --2- 172.21.15.114:0/2223622790 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd83015a410 0x7fd83015a8c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd828009d90 tx=0x7fd82800b330 comp rx=0 tx=0).stop 2023-10-18T12:20:09.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.885+0000 7fd834a3d700 1 -- 172.21.15.114:0/2223622790 shutdown_connections 2023-10-18T12:20:09.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.885+0000 7fd834a3d700 1 --2- 172.21.15.114:0/2223622790 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd83015a410 0x7fd83015a8c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:09.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.885+0000 7fd834a3d700 1 -- 172.21.15.114:0/2223622790 >> 172.21.15.114:0/2223622790 conn(0x7fd8300ce5c0 msgr2=0x7fd8300ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:09.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.885+0000 7fd834a3d700 1 -- 172.21.15.114:0/2223622790 shutdown_connections 2023-10-18T12:20:09.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.885+0000 7fd834a3d700 1 -- 172.21.15.114:0/2223622790 wait complete. 2023-10-18T12:20:09.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.889+0000 7fd834a3d700 1 Processor -- start 2023-10-18T12:20:09.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.889+0000 7fd834a3d700 1 -- start start 2023-10-18T12:20:09.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.889+0000 7fd834a3d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd83006d090 0x7fd830153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:09.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.889+0000 7fd834a3d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd83006d470 0x7fd8301488e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:09.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.889+0000 7fd834a3d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd83015a410 0x7fd8300c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:09.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.889+0000 7fd834a3d700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8300c6250 con 0x7fd83006d470 2023-10-18T12:20:09.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.889+0000 7fd834a3d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd830148e20 con 0x7fd83015a410 2023-10-18T12:20:09.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.889+0000 7fd834a3d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd83015bbd0 con 0x7fd83006d090 2023-10-18T12:20:09.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.889+0000 7fd82e59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd83006d470 0x7fd8301488e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:09.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.889+0000 7fd82e59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd83006d470 0x7fd8301488e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56776/0 (socket says 172.21.15.114:56776) 2023-10-18T12:20:09.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.889+0000 7fd82e59c700 1 -- 172.21.15.114:0/787074599 learned_addr learned my addr 172.21.15.114:0/787074599 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:09.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.889+0000 7fd82ed9d700 1 --2- 172.21.15.114:0/787074599 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd83006d090 0x7fd830153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:09.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.889+0000 7fd82f59e700 1 --2- 172.21.15.114:0/787074599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd83015a410 0x7fd8300c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:09.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.889+0000 7fd82e59c700 1 -- 172.21.15.114:0/787074599 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd83006d090 msgr2=0x7fd830153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:09.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.889+0000 7fd82e59c700 1 --2- 172.21.15.114:0/787074599 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd83006d090 0x7fd830153970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:09.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.889+0000 7fd82e59c700 1 -- 172.21.15.114:0/787074599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd83015a410 msgr2=0x7fd8300c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:09.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.889+0000 7fd82e59c700 1 --2- 172.21.15.114:0/787074599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd83015a410 0x7fd8300c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:09.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.889+0000 7fd82e59c700 1 -- 172.21.15.114:0/787074599 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd828009a70 con 0x7fd83006d470 2023-10-18T12:20:09.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.889+0000 7fd82ed9d700 1 --2- 172.21.15.114:0/787074599 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd83006d090 0x7fd830153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:09.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.889+0000 7fd82f59e700 1 --2- 172.21.15.114:0/787074599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd83015a410 0x7fd8300c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:09.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.889+0000 7fd82e59c700 1 --2- 172.21.15.114:0/787074599 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd83006d470 0x7fd8301488e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd82400c750 tx=0x7fd82400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:09.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.889+0000 7fd8177fe700 1 -- 172.21.15.114:0/787074599 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8240054e0 con 0x7fd83006d470 2023-10-18T12:20:09.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.889+0000 7fd8177fe700 1 -- 172.21.15.114:0/787074599 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8240036a0 con 0x7fd83006d470 2023-10-18T12:20:09.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.889+0000 7fd834a3d700 1 -- 172.21.15.114:0/787074599 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd83015b2c0 con 0x7fd83006d470 2023-10-18T12:20:09.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.889+0000 7fd8177fe700 1 -- 172.21.15.114:0/787074599 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd824003a50 con 0x7fd83006d470 2023-10-18T12:20:09.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.889+0000 7fd834a3d700 1 -- 172.21.15.114:0/787074599 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd83015b510 con 0x7fd83006d470 2023-10-18T12:20:09.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.893+0000 7fd834a3d700 1 -- 172.21.15.114:0/787074599 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd830072e60 con 0x7fd83006d470 2023-10-18T12:20:09.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.893+0000 7fd8177fe700 1 -- 172.21.15.114:0/787074599 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fd824003bb0 con 0x7fd83006d470 2023-10-18T12:20:09.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.897+0000 7fd8177fe700 1 --2- 172.21.15.114:0/787074599 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd81c0656f0 0x7fd81c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:09.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.897+0000 7fd8177fe700 1 -- 172.21.15.114:0/787074599 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd824082710 con 0x7fd83006d470 2023-10-18T12:20:09.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.897+0000 7fd82ed9d700 1 --2- 172.21.15.114:0/787074599 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd81c0656f0 0x7fd81c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:09.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.897+0000 7fd82ed9d700 1 --2- 172.21.15.114:0/787074599 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd81c0656f0 0x7fd81c067bb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd820005930 tx=0x7fd820009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:09.906 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:09.901+0000 7fd8177fe700 1 -- 172.21.15.114:0/787074599 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fd82404fe40 con 0x7fd83006d470 2023-10-18T12:20:10.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.133+0000 7fd834a3d700 1 -- 172.21.15.114:0/787074599 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd83006e030 con 0x7fd83006d470 2023-10-18T12:20:10.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.133+0000 7fd8177fe700 1 -- 172.21.15.114:0/787074599 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4877 (secure 0 0 0) 0x7fd824003e60 con 0x7fd83006d470 2023-10-18T12:20:10.139 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:20:10.139 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1054658298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1054658298},{"type":"v1","addr":"172.21.15.172:6835","nonce":1054658298}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2715800167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2715800167},{"type":"v1","addr":"172.21.15.114:6833","nonce":2715800167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/22518579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":22518579},{"type":"v1","addr":"172.21.15.114:6835","nonce":22518579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T12:19:39.077734+0000","modified":"2023-10-18T12:20:01.448709+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4303":{"gid":4303,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3028221887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3028221887},{"type":"v1","addr":"172.21.15.172:6837","nonce":3028221887}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-18T12:20:10.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.137+0000 7fd834a3d700 1 -- 172.21.15.114:0/787074599 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd81c0656f0 msgr2=0x7fd81c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:10.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.137+0000 7fd834a3d700 1 --2- 172.21.15.114:0/787074599 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd81c0656f0 0x7fd81c067bb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd820005930 tx=0x7fd820009040 comp rx=0 tx=0).stop 2023-10-18T12:20:10.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.137+0000 7fd834a3d700 1 -- 172.21.15.114:0/787074599 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd83006d470 msgr2=0x7fd8301488e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:10.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.137+0000 7fd834a3d700 1 --2- 172.21.15.114:0/787074599 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd83006d470 0x7fd8301488e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd82400c750 tx=0x7fd82400cb10 comp rx=0 tx=0).stop 2023-10-18T12:20:10.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.137+0000 7fd834a3d700 1 -- 172.21.15.114:0/787074599 shutdown_connections 2023-10-18T12:20:10.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.137+0000 7fd834a3d700 1 --2- 172.21.15.114:0/787074599 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd81c0656f0 0x7fd81c067bb0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:10.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.137+0000 7fd834a3d700 1 --2- 172.21.15.114:0/787074599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd83015a410 0x7fd8300c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:10.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.137+0000 7fd834a3d700 1 --2- 172.21.15.114:0/787074599 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd83006d470 0x7fd8301488e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:10.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.137+0000 7fd834a3d700 1 --2- 172.21.15.114:0/787074599 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd83006d090 0x7fd830153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:10.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.137+0000 7fd834a3d700 1 -- 172.21.15.114:0/787074599 >> 172.21.15.114:0/787074599 conn(0x7fd8300ce5c0 msgr2=0x7fd8300b3670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:10.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.137+0000 7fd834a3d700 1 -- 172.21.15.114:0/787074599 shutdown_connections 2023-10-18T12:20:10.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.137+0000 7fd834a3d700 1 -- 172.21.15.114:0/787074599 wait complete. 2023-10-18T12:20:10.145 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 9 2023-10-18T12:20:10.165 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T12:20:10.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.341+0000 7f2519770700 1 Processor -- start 2023-10-18T12:20:10.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.341+0000 7f2519770700 1 -- start start 2023-10-18T12:20:10.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.341+0000 7f2519770700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f251415ee50 0x7f25140cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:10.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.341+0000 7f2519770700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f251406f450 con 0x7f251406e8a0 2023-10-18T12:20:10.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.341+0000 7f2519770700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25140ccbc0 con 0x7f25140cb640 2023-10-18T12:20:10.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.341+0000 7f2519770700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f251406d4e0 con 0x7f251415ee50 2023-10-18T12:20:10.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.341+0000 7f2512ffd700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f251415ee50 0x7f25140cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:10.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.341+0000 7f250bfff700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f251406e8a0 0x7f25140caf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34554/0 (socket says 172.21.15.114:34554) 2023-10-18T12:20:10.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.341+0000 7f2512ffd700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f251415ee50 0x7f25140cc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56778/0 (socket says 172.21.15.114:56778) 2023-10-18T12:20:10.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.341+0000 7f250bfff700 1 -- 172.21.15.114:0/979135426 learned_addr learned my addr 172.21.15.114:0/979135426 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:10.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.341+0000 7f2512ffd700 1 -- 172.21.15.114:0/979135426 >> v1:172.21.15.172:6789/0 conn(0x7f25140cb640 legacy=0x7f251406f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:10.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.341+0000 7f2512ffd700 1 -- 172.21.15.114:0/979135426 >> v1:172.21.15.114:6789/0 conn(0x7f251406e8a0 legacy=0x7f25140caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:10.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.341+0000 7f2512ffd700 1 -- 172.21.15.114:0/979135426 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25141624a0 con 0x7f251415ee50 2023-10-18T12:20:10.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.345+0000 7f2512ffd700 1 --2- 172.21.15.114:0/979135426 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f251415ee50 0x7f25140cc680 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2504009850 tx=0x7f2504009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d01ad162e0e99592 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:10.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.345+0000 7f25127fc700 1 -- 172.21.15.114:0/979135426 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2504004230 con 0x7f251415ee50 2023-10-18T12:20:10.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.345+0000 7f25127fc700 1 -- 172.21.15.114:0/979135426 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2504004390 con 0x7f251415ee50 2023-10-18T12:20:10.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.345+0000 7f25127fc700 1 -- 172.21.15.114:0/979135426 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25040036c0 con 0x7f251415ee50 2023-10-18T12:20:10.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.345+0000 7f2519770700 1 -- 172.21.15.114:0/979135426 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f251415ee50 msgr2=0x7f25140cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:10.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.345+0000 7f2519770700 1 --2- 172.21.15.114:0/979135426 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f251415ee50 0x7f25140cc680 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2504009850 tx=0x7f2504009b60 comp rx=0 tx=0).stop 2023-10-18T12:20:10.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.345+0000 7f2519770700 1 -- 172.21.15.114:0/979135426 shutdown_connections 2023-10-18T12:20:10.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.345+0000 7f2519770700 1 --2- 172.21.15.114:0/979135426 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f251415ee50 0x7f25140cc680 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:10.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.345+0000 7f2519770700 1 -- 172.21.15.114:0/979135426 >> 172.21.15.114:0/979135426 conn(0x7f251406a340 msgr2=0x7f25140b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:10.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.345+0000 7f2519770700 1 -- 172.21.15.114:0/979135426 shutdown_connections 2023-10-18T12:20:10.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.345+0000 7f2519770700 1 -- 172.21.15.114:0/979135426 wait complete. 2023-10-18T12:20:10.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.345+0000 7f2519770700 1 Processor -- start 2023-10-18T12:20:10.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.349+0000 7f2519770700 1 -- start start 2023-10-18T12:20:10.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.349+0000 7f2519770700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f251406e8a0 0x7f25140acf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:10.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.349+0000 7f2519770700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25140cb640 0x7f251415a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:10.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.349+0000 7f2519770700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f251415ee50 0x7f251415c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:10.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.349+0000 7f2519770700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251415b420 con 0x7f251415ee50 2023-10-18T12:20:10.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.349+0000 7f2519770700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25140a8c80 con 0x7f25140cb640 2023-10-18T12:20:10.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.349+0000 7f2519770700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25140acbb0 con 0x7f251406e8a0 2023-10-18T12:20:10.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.349+0000 7f25137fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f251415ee50 0x7f251415c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:10.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.349+0000 7f250bfff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25140cb640 0x7f251415a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:10.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.349+0000 7f25137fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f251415ee50 0x7f251415c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56786/0 (socket says 172.21.15.114:56786) 2023-10-18T12:20:10.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.349+0000 7f25137fe700 1 -- 172.21.15.114:0/2699976446 learned_addr learned my addr 172.21.15.114:0/2699976446 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:10.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.349+0000 7f2512ffd700 1 --2- 172.21.15.114:0/2699976446 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f251406e8a0 0x7f25140acf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:10.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.349+0000 7f25137fe700 1 -- 172.21.15.114:0/2699976446 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f251406e8a0 msgr2=0x7f25140acf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:10.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.349+0000 7f25137fe700 1 --2- 172.21.15.114:0/2699976446 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f251406e8a0 0x7f25140acf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:10.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.349+0000 7f25137fe700 1 -- 172.21.15.114:0/2699976446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25140cb640 msgr2=0x7f251415a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:10.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.349+0000 7f25137fe700 1 --2- 172.21.15.114:0/2699976446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25140cb640 0x7f251415a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:10.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.349+0000 7f25137fe700 1 -- 172.21.15.114:0/2699976446 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25040094b0 con 0x7f251415ee50 2023-10-18T12:20:10.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.349+0000 7f250bfff700 1 --2- 172.21.15.114:0/2699976446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25140cb640 0x7f251415a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:20:10.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.349+0000 7f25137fe700 1 --2- 172.21.15.114:0/2699976446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f251415ee50 0x7f251415c460 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f250c00cc40 tx=0x7f250c00cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:10.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.349+0000 7f250b7fe700 1 -- 172.21.15.114:0/2699976446 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250c00aa80 con 0x7f251415ee50 2023-10-18T12:20:10.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.349+0000 7f250b7fe700 1 -- 172.21.15.114:0/2699976446 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f250c00abe0 con 0x7f251415ee50 2023-10-18T12:20:10.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.349+0000 7f250b7fe700 1 -- 172.21.15.114:0/2699976446 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250c012420 con 0x7f251415ee50 2023-10-18T12:20:10.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.349+0000 7f2519770700 1 -- 172.21.15.114:0/2699976446 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25141fa360 con 0x7f251415ee50 2023-10-18T12:20:10.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.349+0000 7f2519770700 1 -- 172.21.15.114:0/2699976446 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25141fa920 con 0x7f251415ee50 2023-10-18T12:20:10.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.353+0000 7f2519770700 1 -- 172.21.15.114:0/2699976446 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f251415b560 con 0x7f251415ee50 2023-10-18T12:20:10.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.353+0000 7f250b7fe700 1 -- 172.21.15.114:0/2699976446 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f250c012580 con 0x7f251415ee50 2023-10-18T12:20:10.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.357+0000 7f250b7fe700 1 --2- 172.21.15.114:0/2699976446 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f24f4065740 0x7f24f4067c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:10.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.357+0000 7f250b7fe700 1 -- 172.21.15.114:0/2699976446 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f250c083640 con 0x7f251415ee50 2023-10-18T12:20:10.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.357+0000 7f2512ffd700 1 --2- 172.21.15.114:0/2699976446 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f24f4065740 0x7f24f4067c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:10.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.357+0000 7f2512ffd700 1 --2- 172.21.15.114:0/2699976446 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f24f4065740 0x7f24f4067c00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2504009850 tx=0x7f2504008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:10.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.361+0000 7f250b7fe700 1 -- 172.21.15.114:0/2699976446 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f251415b560 con 0x7f251415ee50 2023-10-18T12:20:10.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.541+0000 7f2519770700 1 -- 172.21.15.114:0/2699976446 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f251415b560 con 0x7f251415ee50 2023-10-18T12:20:10.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.545+0000 7f250b7fe700 1 -- 172.21.15.114:0/2699976446 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20144 (secure 0 0 0) 0x7f251415b560 con 0x7f251415ee50 2023-10-18T12:20:10.552 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:20:10.552 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":28,"fsid":"240ea340-5d3d-4f52-a4bc-af075aca3deb","created":"2023-10-18T12:19:12.512994+0000","modified":"2023-10-18T12:19:44.436656+0000","last_up_change":"2023-10-18T12:19:25.286009+0000","last_in_change":"2023-10-18T12:19:15.850693+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T12:19:27.040638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-18T12:19:32.358094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-18T12:19:37.333855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-18T12:19:38.055385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-18T12:19:41.679218+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c3578978-1a03-4857-b9d2-34a5da3d7731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6817","nonce":1506287862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6820","nonce":1506287862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6830","nonce":1506287862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6825","nonce":1506287862}]},"public_addr":"172.21.15.114:6817/1506287862","cluster_addr":"172.21.15.114:6820/1506287862","heartbeat_back_addr":"172.21.15.114:6830/1506287862","heartbeat_front_addr":"172.21.15.114:6825/1506287862","state":["exists","up"]},{"osd":1,"uuid":"43eb26a6-e2b3-4670-9559-bd053b5140d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6801","nonce":3302727047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6803","nonce":3302727047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6807","nonce":3302727047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6805","nonce":3302727047}]},"public_addr":"172.21.15.114:6801/3302727047","cluster_addr":"172.21.15.114:6803/3302727047","heartbeat_back_addr":"172.21.15.114:6807/3302727047","heartbeat_front_addr":"172.21.15.114:6805/3302727047","state":["exists","up"]},{"osd":2,"uuid":"f3d4dbd5-521c-4dd2-b687-5768cc7d0938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6809","nonce":2699151351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6811","nonce":2699151351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6815","nonce":2699151351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6813","nonce":2699151351}]},"public_addr":"172.21.15.114:6809/2699151351","cluster_addr":"172.21.15.114:6811/2699151351","heartbeat_back_addr":"172.21.15.114:6815/2699151351","heartbeat_front_addr":"172.21.15.114:6813/2699151351","state":["exists","up"]},{"osd":3,"uuid":"823e5802-92b7-4f0d-b32d-a5748993f1b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6821","nonce":1361608073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6824","nonce":1361608073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6829","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6831","nonce":1361608073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6827","nonce":1361608073}]},"public_addr":"172.21.15.114:6821/1361608073","cluster_addr":"172.21.15.114:6824/1361608073","heartbeat_back_addr":"172.21.15.114:6831/1361608073","heartbeat_front_addr":"172.21.15.114:6827/1361608073","state":["exists","up"]},{"osd":4,"uuid":"e47fb93e-13b4-44a4-b084-8c4384ceb41e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6801","nonce":930839681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6803","nonce":930839681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6807","nonce":930839681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6805","nonce":930839681}]},"public_addr":"172.21.15.172:6801/930839681","cluster_addr":"172.21.15.172:6803/930839681","heartbeat_back_addr":"172.21.15.172:6807/930839681","heartbeat_front_addr":"172.21.15.172:6805/930839681","state":["exists","up"]},{"osd":5,"uuid":"7561a973-f479-45a0-af40-f324728d622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6814","nonce":571761850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6818","nonce":571761850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6824","nonce":571761850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6821","nonce":571761850}]},"public_addr":"172.21.15.172:6814/571761850","cluster_addr":"172.21.15.172:6818/571761850","heartbeat_back_addr":"172.21.15.172:6824/571761850","heartbeat_front_addr":"172.21.15.172:6821/571761850","state":["exists","up"]},{"osd":6,"uuid":"51753f4b-7f06-4f1c-9ec7-6e18a66eb980","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6825","nonce":1680398853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6827","nonce":1680398853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6831","nonce":1680398853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6829","nonce":1680398853}]},"public_addr":"172.21.15.172:6825/1680398853","cluster_addr":"172.21.15.172:6827/1680398853","heartbeat_back_addr":"172.21.15.172:6831/1680398853","heartbeat_front_addr":"172.21.15.172:6829/1680398853","state":["exists","up"]},{"osd":7,"uuid":"4d8b1e15-143d-4d17-9074-59d92f0f9af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6809","nonce":349710101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6811","nonce":349710101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6819","nonce":349710101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6815","nonce":349710101}]},"public_addr":"172.21.15.172:6809/349710101","cluster_addr":"172.21.15.172:6811/349710101","heartbeat_back_addr":"172.21.15.172:6819/349710101","heartbeat_front_addr":"172.21.15.172:6815/349710101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.889460+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.475494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.911473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.648596+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.609994+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.636248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.854589+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.885826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T12:20:10.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.549+0000 7f2519770700 1 -- 172.21.15.114:0/2699976446 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f24f4065740 msgr2=0x7f24f4067c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:10.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.549+0000 7f2519770700 1 --2- 172.21.15.114:0/2699976446 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f24f4065740 0x7f24f4067c00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2504009850 tx=0x7f2504008030 comp rx=0 tx=0).stop 2023-10-18T12:20:10.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.549+0000 7f2519770700 1 -- 172.21.15.114:0/2699976446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f251415ee50 msgr2=0x7f251415c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:10.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.549+0000 7f2519770700 1 --2- 172.21.15.114:0/2699976446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f251415ee50 0x7f251415c460 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f250c00cc40 tx=0x7f250c00cf50 comp rx=0 tx=0).stop 2023-10-18T12:20:10.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.549+0000 7f2519770700 1 -- 172.21.15.114:0/2699976446 shutdown_connections 2023-10-18T12:20:10.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.549+0000 7f2519770700 1 --2- 172.21.15.114:0/2699976446 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f24f4065740 0x7f24f4067c00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:10.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.549+0000 7f2519770700 1 --2- 172.21.15.114:0/2699976446 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f251415ee50 0x7f251415c460 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:10.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.549+0000 7f2519770700 1 --2- 172.21.15.114:0/2699976446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f25140cb640 0x7f251415a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:10.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.549+0000 7f2519770700 1 --2- 172.21.15.114:0/2699976446 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f251406e8a0 0x7f25140acf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:10.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.549+0000 7f2519770700 1 -- 172.21.15.114:0/2699976446 >> 172.21.15.114:0/2699976446 conn(0x7f251406a340 msgr2=0x7f25140ae820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:10.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.553+0000 7f2519770700 1 -- 172.21.15.114:0/2699976446 shutdown_connections 2023-10-18T12:20:10.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.553+0000 7f2519770700 1 -- 172.21.15.114:0/2699976446 wait complete. 2023-10-18T12:20:10.578 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-18T12:19:27.040638+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-18T12:19:32.358094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-18T12:19:37.333855+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-18T12:19:38.055385+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-18T12:19:41.679218+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-18T12:20:10.579 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-18T12:20:10.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.757+0000 7fd42dffc700 1 Processor -- start 2023-10-18T12:20:10.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.757+0000 7fd42dffc700 1 -- start start 2023-10-18T12:20:10.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.757+0000 7fd42dffc700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4280d2e00 0x7fd4280b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:10.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.757+0000 7fd42dffc700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd428160710 0x7fd4280d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:10.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.757+0000 7fd42dffc700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd4280b5ae0 0x7fd42806db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:10.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.761+0000 7fd42dffc700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd42815df90 con 0x7fd428160710 2023-10-18T12:20:10.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.761+0000 7fd42dffc700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd42815d0d0 con 0x7fd4280b5ae0 2023-10-18T12:20:10.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.761+0000 7fd42dffc700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd42806f0f0 con 0x7fd4280d2e00 2023-10-18T12:20:10.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.761+0000 7fd427fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd428160710 0x7fd4280d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:10.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.761+0000 7fd427fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd428160710 0x7fd4280d31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56798/0 (socket says 172.21.15.114:56798) 2023-10-18T12:20:10.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.761+0000 7fd427fff700 1 -- 172.21.15.114:0/885766300 learned_addr learned my addr 172.21.15.114:0/885766300 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:10.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.761+0000 7fd42cffa700 1 --2- 172.21.15.114:0/885766300 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4280d2e00 0x7fd4280b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:10.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.761+0000 7fd42d7fb700 1 --2- 172.21.15.114:0/885766300 >> v2:172.21.15.172:3300/0 conn(0x7fd4280b5ae0 0x7fd42806db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:10.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.761+0000 7fd427fff700 1 -- 172.21.15.114:0/885766300 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4280d2e00 msgr2=0x7fd4280b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:10.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.761+0000 7fd427fff700 1 --2- 172.21.15.114:0/885766300 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4280d2e00 0x7fd4280b6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:10.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.761+0000 7fd427fff700 1 -- 172.21.15.114:0/885766300 >> v2:172.21.15.172:3300/0 conn(0x7fd4280b5ae0 msgr2=0x7fd42806db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:10.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.761+0000 7fd427fff700 1 --2- 172.21.15.114:0/885766300 >> v2:172.21.15.172:3300/0 conn(0x7fd4280b5ae0 0x7fd42806db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:10.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.761+0000 7fd427fff700 1 -- 172.21.15.114:0/885766300 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4280d3720 con 0x7fd428160710 2023-10-18T12:20:10.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.761+0000 7fd427fff700 1 --2- 172.21.15.114:0/885766300 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd428160710 0x7fd4280d31e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd414009910 tx=0x7fd414009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=144320e0353ab8d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:10.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.761+0000 7fd4277fe700 1 -- 172.21.15.114:0/885766300 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41400ba20 con 0x7fd428160710 2023-10-18T12:20:10.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.761+0000 7fd4277fe700 1 -- 172.21.15.114:0/885766300 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd41400bb80 con 0x7fd428160710 2023-10-18T12:20:10.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.761+0000 7fd4277fe700 1 -- 172.21.15.114:0/885766300 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd414009e60 con 0x7fd428160710 2023-10-18T12:20:10.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.761+0000 7fd42dffc700 1 -- 172.21.15.114:0/885766300 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd428160710 msgr2=0x7fd4280d31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:10.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.761+0000 7fd42dffc700 1 --2- 172.21.15.114:0/885766300 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd428160710 0x7fd4280d31e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd414009910 tx=0x7fd414009c20 comp rx=0 tx=0).stop 2023-10-18T12:20:10.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.761+0000 7fd42dffc700 1 -- 172.21.15.114:0/885766300 shutdown_connections 2023-10-18T12:20:10.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.761+0000 7fd42dffc700 1 --2- 172.21.15.114:0/885766300 >> v2:172.21.15.172:3300/0 conn(0x7fd4280b5ae0 0x7fd42806db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:10.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.761+0000 7fd42dffc700 1 --2- 172.21.15.114:0/885766300 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd428160710 0x7fd4280d31e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:10.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.761+0000 7fd42dffc700 1 --2- 172.21.15.114:0/885766300 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4280d2e00 0x7fd4280b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:10.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.761+0000 7fd42dffc700 1 -- 172.21.15.114:0/885766300 >> 172.21.15.114:0/885766300 conn(0x7fd428069f20 msgr2=0x7fd42806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:10.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.761+0000 7fd42dffc700 1 -- 172.21.15.114:0/885766300 shutdown_connections 2023-10-18T12:20:10.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.761+0000 7fd42dffc700 1 -- 172.21.15.114:0/885766300 wait complete. 2023-10-18T12:20:10.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.765+0000 7fd42dffc700 1 Processor -- start 2023-10-18T12:20:10.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.765+0000 7fd42dffc700 1 -- start start 2023-10-18T12:20:10.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.769+0000 7fd42dffc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4280b5ae0 0x7fd42814ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:10.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.769+0000 7fd42dffc700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4280d2e00 0x7fd428154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:10.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.769+0000 7fd42dffc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd428160710 0x7fd428154e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:10.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.769+0000 7fd42dffc700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4281561a0 con 0x7fd428160710 2023-10-18T12:20:10.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.769+0000 7fd42dffc700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4281553b0 con 0x7fd4280b5ae0 2023-10-18T12:20:10.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.769+0000 7fd42dffc700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd428155620 con 0x7fd4280d2e00 2023-10-18T12:20:10.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.769+0000 7fd42d7fb700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd428160710 0x7fd428154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:10.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.769+0000 7fd42d7fb700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd428160710 0x7fd428154e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56800/0 (socket says 172.21.15.114:56800) 2023-10-18T12:20:10.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.769+0000 7fd42d7fb700 1 -- 172.21.15.114:0/1600728175 learned_addr learned my addr 172.21.15.114:0/1600728175 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:10.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.769+0000 7fd427fff700 1 --2- 172.21.15.114:0/1600728175 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4280d2e00 0x7fd428154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:10.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.769+0000 7fd42cffa700 1 --2- 172.21.15.114:0/1600728175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4280b5ae0 0x7fd42814ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:10.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.769+0000 7fd42d7fb700 1 -- 172.21.15.114:0/1600728175 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4280d2e00 msgr2=0x7fd428154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:10.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.769+0000 7fd42d7fb700 1 --2- 172.21.15.114:0/1600728175 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4280d2e00 0x7fd428154930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:10.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.769+0000 7fd42d7fb700 1 -- 172.21.15.114:0/1600728175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4280b5ae0 msgr2=0x7fd42814ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:10.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.769+0000 7fd42d7fb700 1 --2- 172.21.15.114:0/1600728175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4280b5ae0 0x7fd42814ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:10.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.769+0000 7fd42d7fb700 1 -- 172.21.15.114:0/1600728175 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd414009570 con 0x7fd428160710 2023-10-18T12:20:10.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.769+0000 7fd42d7fb700 1 --2- 172.21.15.114:0/1600728175 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd428160710 0x7fd428154e70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd420007d20 tx=0x7fd42000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:10.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.769+0000 7fd4257fa700 1 -- 172.21.15.114:0/1600728175 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42000ed30 con 0x7fd428160710 2023-10-18T12:20:10.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.769+0000 7fd4257fa700 1 -- 172.21.15.114:0/1600728175 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd420007e70 con 0x7fd428160710 2023-10-18T12:20:10.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.769+0000 7fd4257fa700 1 -- 172.21.15.114:0/1600728175 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd420014640 con 0x7fd428160710 2023-10-18T12:20:10.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.769+0000 7fd42dffc700 1 -- 172.21.15.114:0/1600728175 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd428155900 con 0x7fd428160710 2023-10-18T12:20:10.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.769+0000 7fd42dffc700 1 -- 172.21.15.114:0/1600728175 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd428155ec0 con 0x7fd428160710 2023-10-18T12:20:10.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.773+0000 7fd42dffc700 1 -- 172.21.15.114:0/1600728175 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd42804e910 con 0x7fd428160710 2023-10-18T12:20:10.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.773+0000 7fd4257fa700 1 -- 172.21.15.114:0/1600728175 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fd4200147a0 con 0x7fd428160710 2023-10-18T12:20:10.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.777+0000 7fd4257fa700 1 --2- 172.21.15.114:0/1600728175 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd40c065720 0x7fd40c067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:10.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.777+0000 7fd4257fa700 1 -- 172.21.15.114:0/1600728175 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd420006e40 con 0x7fd428160710 2023-10-18T12:20:10.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.777+0000 7fd42cffa700 1 --2- 172.21.15.114:0/1600728175 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd40c065720 0x7fd40c067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:10.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.777+0000 7fd42cffa700 1 --2- 172.21.15.114:0/1600728175 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd40c065720 0x7fd40c067be0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd41c006b40 tx=0x7fd41c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:10.787 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.781+0000 7fd4257fa700 1 -- 172.21.15.114:0/1600728175 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fd420050e20 con 0x7fd428160710 2023-10-18T12:20:10.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.961+0000 7fd42dffc700 1 -- 172.21.15.114:0/1600728175 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd42806d3e0 con 0x7fd428160710 2023-10-18T12:20:10.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.961+0000 7fd4257fa700 1 -- 172.21.15.114:0/1600728175 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd420054440 con 0x7fd428160710 2023-10-18T12:20:10.965 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-10-18T12:20:10.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.965+0000 7fd42dffc700 1 -- 172.21.15.114:0/1600728175 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd40c065720 msgr2=0x7fd40c067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:10.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.965+0000 7fd42dffc700 1 --2- 172.21.15.114:0/1600728175 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd40c065720 0x7fd40c067be0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd41c006b40 tx=0x7fd41c008040 comp rx=0 tx=0).stop 2023-10-18T12:20:10.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.965+0000 7fd42dffc700 1 -- 172.21.15.114:0/1600728175 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd428160710 msgr2=0x7fd428154e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:10.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.965+0000 7fd42dffc700 1 --2- 172.21.15.114:0/1600728175 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd428160710 0x7fd428154e70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd420007d20 tx=0x7fd42000e3c0 comp rx=0 tx=0).stop 2023-10-18T12:20:10.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.965+0000 7fd42dffc700 1 -- 172.21.15.114:0/1600728175 shutdown_connections 2023-10-18T12:20:10.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.965+0000 7fd42dffc700 1 --2- 172.21.15.114:0/1600728175 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd40c065720 0x7fd40c067be0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:10.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.965+0000 7fd42dffc700 1 --2- 172.21.15.114:0/1600728175 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd4280d2e00 0x7fd428154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:10.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.965+0000 7fd42dffc700 1 --2- 172.21.15.114:0/1600728175 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd428160710 0x7fd428154e70 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:10.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.965+0000 7fd42dffc700 1 --2- 172.21.15.114:0/1600728175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4280b5ae0 0x7fd42814ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:10.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.965+0000 7fd42dffc700 1 -- 172.21.15.114:0/1600728175 >> 172.21.15.114:0/1600728175 conn(0x7fd428069f20 msgr2=0x7fd42806a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:10.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.965+0000 7fd42dffc700 1 -- 172.21.15.114:0/1600728175 shutdown_connections 2023-10-18T12:20:10.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:10.965+0000 7fd42dffc700 1 -- 172.21.15.114:0/1600728175 wait complete. 2023-10-18T12:20:10.995 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-18T12:20:11.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.161+0000 7f22a4d58700 1 Processor -- start 2023-10-18T12:20:11.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.161+0000 7f22a4d58700 1 -- start start 2023-10-18T12:20:11.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.161+0000 7f22a4d58700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f22a006d090 0x7f22a00b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:11.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.161+0000 7f22a4d58700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22a0071120 con 0x7f22a006d470 2023-10-18T12:20:11.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.161+0000 7f22a4d58700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22a015e990 con 0x7f22a015a410 2023-10-18T12:20:11.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.161+0000 7f22a4d58700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22a015f4f0 con 0x7f22a006d090 2023-10-18T12:20:11.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.165+0000 7f2296ffd700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f22a006d470 0x7f22a0070a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34564/0 (socket says 172.21.15.114:34564) 2023-10-18T12:20:11.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.165+0000 7f2296ffd700 1 -- 172.21.15.114:0/2587844063 learned_addr learned my addr 172.21.15.114:0/2587844063 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:11.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.165+0000 7f229f7fe700 1 --2- 172.21.15.114:0/2587844063 >> v2:172.21.15.114:3300/0 conn(0x7f22a006d090 0x7f22a00b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:11.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.165+0000 7f229f7fe700 1 -- 172.21.15.114:0/2587844063 >> v1:172.21.15.172:6789/0 conn(0x7f22a015a410 legacy=0x7f22a015a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:11.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.165+0000 7f229effd700 1 -- 172.21.15.114:0/2587844063 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 704682231 0 0) 0x7f22a0071120 con 0x7f22a006d470 2023-10-18T12:20:11.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.165+0000 7f229f7fe700 1 -- 172.21.15.114:0/2587844063 >> v1:172.21.15.114:6789/0 conn(0x7f22a006d470 legacy=0x7f22a0070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:11.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.165+0000 7f229f7fe700 1 -- 172.21.15.114:0/2587844063 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a015ec50 con 0x7f22a006d090 2023-10-18T12:20:11.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.165+0000 7f229f7fe700 1 --2- 172.21.15.114:0/2587844063 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22a006d090 0x7f22a00b2590 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2288009850 tx=0x7f2288009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aebd926184be64f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:11.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.165+0000 7f229effd700 1 -- 172.21.15.114:0/2587844063 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2288011830 con 0x7f22a006d090 2023-10-18T12:20:11.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.165+0000 7f229effd700 1 -- 172.21.15.114:0/2587844063 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2288011990 con 0x7f22a006d090 2023-10-18T12:20:11.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.165+0000 7f229effd700 1 -- 172.21.15.114:0/2587844063 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2288011d20 con 0x7f22a006d090 2023-10-18T12:20:11.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.165+0000 7f22a4d58700 1 -- 172.21.15.114:0/2587844063 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22a006d090 msgr2=0x7f22a00b2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:11.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.165+0000 7f22a4d58700 1 --2- 172.21.15.114:0/2587844063 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22a006d090 0x7f22a00b2590 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2288009850 tx=0x7f2288009b60 comp rx=0 tx=0).stop 2023-10-18T12:20:11.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.165+0000 7f22a4d58700 1 -- 172.21.15.114:0/2587844063 shutdown_connections 2023-10-18T12:20:11.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.165+0000 7f22a4d58700 1 --2- 172.21.15.114:0/2587844063 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22a006d090 0x7f22a00b2590 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:11.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.165+0000 7f22a4d58700 1 -- 172.21.15.114:0/2587844063 >> 172.21.15.114:0/2587844063 conn(0x7f22a00ce5c0 msgr2=0x7f22a00ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:11.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.165+0000 7f22a4d58700 1 -- 172.21.15.114:0/2587844063 shutdown_connections 2023-10-18T12:20:11.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.165+0000 7f22a4d58700 1 -- 172.21.15.114:0/2587844063 wait complete. 2023-10-18T12:20:11.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.169+0000 7f22a4d58700 1 Processor -- start 2023-10-18T12:20:11.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.169+0000 7f22a4d58700 1 -- start start 2023-10-18T12:20:11.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.169+0000 7f22a4d58700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f22a006d090 0x7f22a014a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:11.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.169+0000 7f22a4d58700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22a006d470 0x7f22a01f3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:11.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.169+0000 7f22a4d58700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22a015a410 0x7f22a014a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:11.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.169+0000 7f22a4d58700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a014a650 con 0x7f22a006d470 2023-10-18T12:20:11.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.169+0000 7f22a4d58700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a00c8050 con 0x7f22a015a410 2023-10-18T12:20:11.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.169+0000 7f22a4d58700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22a014bb50 con 0x7f22a006d090 2023-10-18T12:20:11.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.169+0000 7f2296ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22a006d470 0x7f22a01f3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:11.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.169+0000 7f2296ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22a006d470 0x7f22a01f3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56816/0 (socket says 172.21.15.114:56816) 2023-10-18T12:20:11.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.169+0000 7f2296ffd700 1 -- 172.21.15.114:0/1984132544 learned_addr learned my addr 172.21.15.114:0/1984132544 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:11.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.169+0000 7f229f7fe700 1 --2- 172.21.15.114:0/1984132544 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f22a006d090 0x7f22a014a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:11.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.169+0000 7f229ffff700 1 --2- 172.21.15.114:0/1984132544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22a015a410 0x7f22a014a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:11.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.173+0000 7f2296ffd700 1 -- 172.21.15.114:0/1984132544 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f22a006d090 msgr2=0x7f22a014a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:11.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.173+0000 7f2296ffd700 1 --2- 172.21.15.114:0/1984132544 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f22a006d090 0x7f22a014a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:11.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.173+0000 7f2296ffd700 1 -- 172.21.15.114:0/1984132544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22a015a410 msgr2=0x7f22a014a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:11.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.173+0000 7f2296ffd700 1 --2- 172.21.15.114:0/1984132544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22a015a410 0x7f22a014a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:11.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.173+0000 7f2296ffd700 1 -- 172.21.15.114:0/1984132544 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22880094b0 con 0x7f22a006d470 2023-10-18T12:20:11.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.173+0000 7f2296ffd700 1 --2- 172.21.15.114:0/1984132544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22a006d470 0x7f22a01f3bf0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f229000c4a0 tx=0x7f229000c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:11.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.173+0000 7f229cff9700 1 -- 172.21.15.114:0/1984132544 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2290004ca0 con 0x7f22a006d470 2023-10-18T12:20:11.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.173+0000 7f229cff9700 1 -- 172.21.15.114:0/1984132544 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2290004e00 con 0x7f22a006d470 2023-10-18T12:20:11.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.173+0000 7f22a4d58700 1 -- 172.21.15.114:0/1984132544 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22a014b590 con 0x7f22a006d470 2023-10-18T12:20:11.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.173+0000 7f229cff9700 1 -- 172.21.15.114:0/1984132544 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2290007310 con 0x7f22a006d470 2023-10-18T12:20:11.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.173+0000 7f22a4d58700 1 -- 172.21.15.114:0/1984132544 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22a0151600 con 0x7f22a006d470 2023-10-18T12:20:11.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.173+0000 7f22a4d58700 1 -- 172.21.15.114:0/1984132544 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22a00b2a50 con 0x7f22a006d470 2023-10-18T12:20:11.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.177+0000 7f229cff9700 1 -- 172.21.15.114:0/1984132544 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f2290007470 con 0x7f22a006d470 2023-10-18T12:20:11.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.177+0000 7f229cff9700 1 --2- 172.21.15.114:0/1984132544 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2284065720 0x7f2284067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:11.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.177+0000 7f229cff9700 1 -- 172.21.15.114:0/1984132544 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2290082d10 con 0x7f22a006d470 2023-10-18T12:20:11.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.177+0000 7f229f7fe700 1 --2- 172.21.15.114:0/1984132544 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2284065720 0x7f2284067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:11.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.177+0000 7f229f7fe700 1 --2- 172.21.15.114:0/1984132544 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2284065720 0x7f2284067be0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f22880090b0 tx=0x7f228801c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:11.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.181+0000 7f229cff9700 1 -- 172.21.15.114:0/1984132544 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f2290088020 con 0x7f22a006d470 2023-10-18T12:20:11.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.361+0000 7f22a4d58700 1 -- 172.21.15.114:0/1984132544 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f22a004e910 con 0x7f22a006d470 2023-10-18T12:20:11.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.365+0000 7f229cff9700 1 -- 172.21.15.114:0/1984132544 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2290082020 con 0x7f22a006d470 2023-10-18T12:20:11.368 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 8 2023-10-18T12:20:11.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.365+0000 7f22a4d58700 1 -- 172.21.15.114:0/1984132544 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2284065720 msgr2=0x7f2284067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:11.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.365+0000 7f22a4d58700 1 --2- 172.21.15.114:0/1984132544 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2284065720 0x7f2284067be0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f22880090b0 tx=0x7f228801c040 comp rx=0 tx=0).stop 2023-10-18T12:20:11.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.365+0000 7f22a4d58700 1 -- 172.21.15.114:0/1984132544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22a006d470 msgr2=0x7f22a01f3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:11.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.365+0000 7f22a4d58700 1 --2- 172.21.15.114:0/1984132544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22a006d470 0x7f22a01f3bf0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f229000c4a0 tx=0x7f229000c7b0 comp rx=0 tx=0).stop 2023-10-18T12:20:11.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.365+0000 7f22a4d58700 1 -- 172.21.15.114:0/1984132544 shutdown_connections 2023-10-18T12:20:11.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.365+0000 7f22a4d58700 1 --2- 172.21.15.114:0/1984132544 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2284065720 0x7f2284067be0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:11.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.365+0000 7f22a4d58700 1 --2- 172.21.15.114:0/1984132544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22a015a410 0x7f22a014a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:11.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.365+0000 7f22a4d58700 1 --2- 172.21.15.114:0/1984132544 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22a006d470 0x7f22a01f3bf0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:11.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.365+0000 7f22a4d58700 1 --2- 172.21.15.114:0/1984132544 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f22a006d090 0x7f22a014a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:11.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.365+0000 7f22a4d58700 1 -- 172.21.15.114:0/1984132544 >> 172.21.15.114:0/1984132544 conn(0x7f22a00ce5c0 msgr2=0x7f22a00c9920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:11.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.369+0000 7f22a4d58700 1 -- 172.21.15.114:0/1984132544 shutdown_connections 2023-10-18T12:20:11.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.369+0000 7f22a4d58700 1 -- 172.21.15.114:0/1984132544 wait complete. 2023-10-18T12:20:11.396 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-18T12:20:11.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.589+0000 7fadeb348700 1 Processor -- start 2023-10-18T12:20:11.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.589+0000 7fadeb348700 1 -- start start 2023-10-18T12:20:11.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.593+0000 7fadeb348700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fade4160710 0x7fade40b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:11.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.593+0000 7fadeb348700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fade40b5ae0 0x7fade406db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:11.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.593+0000 7fadeb348700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fade415d0d0 con 0x7fade40d2e00 2023-10-18T12:20:11.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.593+0000 7fadeb348700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fade415df90 con 0x7fade40b5ae0 2023-10-18T12:20:11.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.593+0000 7fadeb348700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fade406f0f0 con 0x7fade4160710 2023-10-18T12:20:11.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.593+0000 7fadea346700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fade40d2e00 0x7fade40d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34570/0 (socket says 172.21.15.114:34570) 2023-10-18T12:20:11.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.593+0000 7fadea346700 1 -- 172.21.15.114:0/706651473 learned_addr learned my addr 172.21.15.114:0/706651473 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:11.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.593+0000 7fade9b45700 1 --2- 172.21.15.114:0/706651473 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fade4160710 0x7fade40b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:11.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.593+0000 7fadeab47700 1 --2- 172.21.15.114:0/706651473 >> v2:172.21.15.114:3300/0 conn(0x7fade40b5ae0 0x7fade406db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:11.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.593+0000 7fade9344700 1 -- 172.21.15.114:0/706651473 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 417820725 0 0) 0x7fade0001110 con 0x7fade40d2e00 2023-10-18T12:20:11.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.593+0000 7fade9344700 1 -- 172.21.15.114:0/706651473 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadd00035d0 con 0x7fade40d2e00 2023-10-18T12:20:11.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.593+0000 7fade9b45700 1 -- 172.21.15.114:0/706651473 >> v2:172.21.15.114:3300/0 conn(0x7fade40b5ae0 msgr2=0x7fade406db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:11.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.593+0000 7fade9b45700 1 --2- 172.21.15.114:0/706651473 >> v2:172.21.15.114:3300/0 conn(0x7fade40b5ae0 0x7fade406db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:11.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.593+0000 7fade9b45700 1 -- 172.21.15.114:0/706651473 >> v1:172.21.15.114:6789/0 conn(0x7fade40d2e00 legacy=0x7fade40d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:11.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.593+0000 7fade9b45700 1 -- 172.21.15.114:0/706651473 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade415d310 con 0x7fade4160710 2023-10-18T12:20:11.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.593+0000 7fade9b45700 1 --2- 172.21.15.114:0/706651473 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fade4160710 0x7fade40b6e00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fadd4009880 tx=0x7fadd4009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3090a8c6102ed059 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:11.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.593+0000 7fade9344700 1 -- 172.21.15.114:0/706651473 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd4011830 con 0x7fade4160710 2023-10-18T12:20:11.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.593+0000 7fade9344700 1 -- 172.21.15.114:0/706651473 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd4011990 con 0x7fade4160710 2023-10-18T12:20:11.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.593+0000 7fade9344700 1 -- 172.21.15.114:0/706651473 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd4011d20 con 0x7fade4160710 2023-10-18T12:20:11.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.597+0000 7fadeb348700 1 -- 172.21.15.114:0/706651473 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fade4160710 msgr2=0x7fade40b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:11.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.597+0000 7fadeb348700 1 --2- 172.21.15.114:0/706651473 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fade4160710 0x7fade40b6e00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fadd4009880 tx=0x7fadd4009b90 comp rx=0 tx=0).stop 2023-10-18T12:20:11.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.597+0000 7fadeb348700 1 -- 172.21.15.114:0/706651473 shutdown_connections 2023-10-18T12:20:11.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.597+0000 7fadeb348700 1 --2- 172.21.15.114:0/706651473 >> v2:172.21.15.114:3300/0 conn(0x7fade40b5ae0 0x7fade406db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:11.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.597+0000 7fadeb348700 1 --2- 172.21.15.114:0/706651473 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fade4160710 0x7fade40b6e00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:11.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.597+0000 7fadeb348700 1 -- 172.21.15.114:0/706651473 >> 172.21.15.114:0/706651473 conn(0x7fade4069f20 msgr2=0x7fade406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:11.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.597+0000 7fadeb348700 1 -- 172.21.15.114:0/706651473 shutdown_connections 2023-10-18T12:20:11.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.597+0000 7fadeb348700 1 -- 172.21.15.114:0/706651473 wait complete. 2023-10-18T12:20:11.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.601+0000 7fadeb348700 1 Processor -- start 2023-10-18T12:20:11.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.601+0000 7fadeb348700 1 -- start start 2023-10-18T12:20:11.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.601+0000 7fadeb348700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fade40b5ae0 0x7fade4154970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:11.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.601+0000 7fadeb348700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fade40d2e00 0x7fade4154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:11.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.601+0000 7fadeb348700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fade4160710 0x7fade40b2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:11.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.601+0000 7fadeb348700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade4145230 con 0x7fade40b5ae0 2023-10-18T12:20:11.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.601+0000 7fadeb348700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade41554e0 con 0x7fade4160710 2023-10-18T12:20:11.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.601+0000 7fadeb348700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fade41557c0 con 0x7fade40d2e00 2023-10-18T12:20:11.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.601+0000 7fadea346700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fade40b5ae0 0x7fade4154970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:11.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.601+0000 7fade9b45700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fade40d2e00 0x7fade4154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:11.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.601+0000 7fadea346700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fade40b5ae0 0x7fade4154970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56834/0 (socket says 172.21.15.114:56834) 2023-10-18T12:20:11.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.601+0000 7fadeab47700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fade4160710 0x7fade40b2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:11.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.601+0000 7fadea346700 1 -- 172.21.15.114:0/3770503932 learned_addr learned my addr 172.21.15.114:0/3770503932 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:11.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.601+0000 7fade9b45700 1 -- 172.21.15.114:0/3770503932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fade4160710 msgr2=0x7fade40b2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:11.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.601+0000 7fade9b45700 1 --2- 172.21.15.114:0/3770503932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fade4160710 0x7fade40b2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:11.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.601+0000 7fade9b45700 1 -- 172.21.15.114:0/3770503932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fade40b5ae0 msgr2=0x7fade4154970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:11.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.601+0000 7fade9b45700 1 --2- 172.21.15.114:0/3770503932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fade40b5ae0 0x7fade4154970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:11.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.601+0000 7fade9b45700 1 -- 172.21.15.114:0/3770503932 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd40094b0 con 0x7fade40d2e00 2023-10-18T12:20:11.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.605+0000 7fade9b45700 1 --2- 172.21.15.114:0/3770503932 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fade40d2e00 0x7fade4154eb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fadd4016000 tx=0x7fadd4004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:11.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.605+0000 7faddaffd700 1 -- 172.21.15.114:0/3770503932 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd4004520 con 0x7fade40d2e00 2023-10-18T12:20:11.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.605+0000 7faddaffd700 1 -- 172.21.15.114:0/3770503932 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd401f070 con 0x7fade40d2e00 2023-10-18T12:20:11.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.605+0000 7faddaffd700 1 -- 172.21.15.114:0/3770503932 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd4003900 con 0x7fade40d2e00 2023-10-18T12:20:11.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.605+0000 7fadeb348700 1 -- 172.21.15.114:0/3770503932 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fade4155aa0 con 0x7fade40d2e00 2023-10-18T12:20:11.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.605+0000 7fadeb348700 1 -- 172.21.15.114:0/3770503932 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fade40b3a20 con 0x7fade40d2e00 2023-10-18T12:20:11.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.605+0000 7fadeb348700 1 -- 172.21.15.114:0/3770503932 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fade404e910 con 0x7fade40d2e00 2023-10-18T12:20:11.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.609+0000 7faddaffd700 1 -- 172.21.15.114:0/3770503932 <== mon.2 v2:172.21.15.172:3301/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fadd4003a60 con 0x7fade40d2e00 2023-10-18T12:20:11.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.609+0000 7faddaffd700 1 --2- 172.21.15.114:0/3770503932 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fadc80656f0 0x7fadc8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:11.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.609+0000 7faddaffd700 1 -- 172.21.15.114:0/3770503932 <== mon.2 v2:172.21.15.172:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fadd4021070 con 0x7fade40d2e00 2023-10-18T12:20:11.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.609+0000 7fadea346700 1 --2- 172.21.15.114:0/3770503932 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fadc80656f0 0x7fadc8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:11.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.613+0000 7fadea346700 1 --2- 172.21.15.114:0/3770503932 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fadc80656f0 0x7fadc8067bb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fade0001370 tx=0x7fade0007d20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:11.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.617+0000 7faddaffd700 1 -- 172.21.15.114:0/3770503932 <== mon.2 v2:172.21.15.172:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fadd4052030 con 0x7fade40d2e00 2023-10-18T12:20:11.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.861+0000 7fadeb348700 1 -- 172.21.15.114:0/3770503932 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fade406d3e0 con 0x7fade40d2e00 2023-10-18T12:20:11.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.861+0000 7faddaffd700 1 -- 172.21.15.114:0/3770503932 <== mon.2 v2:172.21.15.172:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fadd4055650 con 0x7fade40d2e00 2023-10-18T12:20:11.867 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-10-18T12:20:11.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.865+0000 7fadeb348700 1 -- 172.21.15.114:0/3770503932 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fadc80656f0 msgr2=0x7fadc8067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:11.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.865+0000 7fadeb348700 1 --2- 172.21.15.114:0/3770503932 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fadc80656f0 0x7fadc8067bb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fade0001370 tx=0x7fade0007d20 comp rx=0 tx=0).stop 2023-10-18T12:20:11.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.865+0000 7fadeb348700 1 -- 172.21.15.114:0/3770503932 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fade40d2e00 msgr2=0x7fade4154eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:11.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.865+0000 7fadeb348700 1 --2- 172.21.15.114:0/3770503932 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fade40d2e00 0x7fade4154eb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fadd4016000 tx=0x7fadd4004770 comp rx=0 tx=0).stop 2023-10-18T12:20:11.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.865+0000 7fadeb348700 1 -- 172.21.15.114:0/3770503932 shutdown_connections 2023-10-18T12:20:11.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.865+0000 7fadeb348700 1 --2- 172.21.15.114:0/3770503932 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fadc80656f0 0x7fadc8067bb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:11.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.865+0000 7fadeb348700 1 --2- 172.21.15.114:0/3770503932 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fade40d2e00 0x7fade4154eb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:11.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.865+0000 7fadeb348700 1 --2- 172.21.15.114:0/3770503932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fade4160710 0x7fade40b2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:11.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.865+0000 7fadeb348700 1 --2- 172.21.15.114:0/3770503932 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fade40b5ae0 0x7fade4154970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:11.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.865+0000 7fadeb348700 1 -- 172.21.15.114:0/3770503932 >> 172.21.15.114:0/3770503932 conn(0x7fade4069f20 msgr2=0x7fade40b5ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:11.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.865+0000 7fadeb348700 1 -- 172.21.15.114:0/3770503932 shutdown_connections 2023-10-18T12:20:11.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:11.865+0000 7fadeb348700 1 -- 172.21.15.114:0/3770503932 wait complete. 2023-10-18T12:20:11.892 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-18T12:20:12.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.073+0000 7fe935948700 1 Processor -- start 2023-10-18T12:20:12.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.073+0000 7fe935948700 1 -- start start 2023-10-18T12:20:12.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.073+0000 7fe935948700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe930160710 0x7fe9300b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:12.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.073+0000 7fe935948700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9300b5ae0 0x7fe93006db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:12.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.073+0000 7fe935948700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe93015d0d0 con 0x7fe9300d2e00 2023-10-18T12:20:12.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.073+0000 7fe935948700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe93015df90 con 0x7fe930160710 2023-10-18T12:20:12.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.073+0000 7fe935948700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe93006f0f0 con 0x7fe9300b5ae0 2023-10-18T12:20:12.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.073+0000 7fe92ffff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe930160710 0x7fe9300b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:12.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.073+0000 7fe934946700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe9300d2e00 0x7fe9300d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34576/0 (socket says 172.21.15.114:34576) 2023-10-18T12:20:12.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.073+0000 7fe934946700 1 -- 172.21.15.114:0/3838621680 learned_addr learned my addr 172.21.15.114:0/3838621680 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:12.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.073+0000 7fe935147700 1 --2- 172.21.15.114:0/3838621680 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9300b5ae0 0x7fe93006db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:12.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.077+0000 7fe92ffff700 1 -- 172.21.15.114:0/3838621680 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9300b5ae0 msgr2=0x7fe93006db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:12.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.077+0000 7fe92ffff700 1 --2- 172.21.15.114:0/3838621680 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9300b5ae0 0x7fe93006db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:12.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.077+0000 7fe92ffff700 1 -- 172.21.15.114:0/3838621680 >> v1:172.21.15.114:6789/0 conn(0x7fe9300d2e00 legacy=0x7fe9300d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:12.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.077+0000 7fe92f7fe700 1 -- 172.21.15.114:0/3838621680 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 45146714 0 0) 0x7fe924001110 con 0x7fe9300d2e00 2023-10-18T12:20:12.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.077+0000 7fe92ffff700 1 -- 172.21.15.114:0/3838621680 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe93015d310 con 0x7fe930160710 2023-10-18T12:20:12.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.077+0000 7fe935147700 1 --2- 172.21.15.114:0/3838621680 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9300b5ae0 0x7fe93006db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:12.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.077+0000 7fe92ffff700 1 --2- 172.21.15.114:0/3838621680 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe930160710 0x7fe9300b6e00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe91c009850 tx=0x7fe91c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce6fd00163c6492d server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:12.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.077+0000 7fe92f7fe700 1 -- 172.21.15.114:0/3838621680 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91c011830 con 0x7fe930160710 2023-10-18T12:20:12.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.077+0000 7fe92f7fe700 1 -- 172.21.15.114:0/3838621680 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe91c011990 con 0x7fe930160710 2023-10-18T12:20:12.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.077+0000 7fe92f7fe700 1 -- 172.21.15.114:0/3838621680 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91c011d20 con 0x7fe930160710 2023-10-18T12:20:12.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.077+0000 7fe935948700 1 -- 172.21.15.114:0/3838621680 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe930160710 msgr2=0x7fe9300b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:12.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.077+0000 7fe935948700 1 --2- 172.21.15.114:0/3838621680 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe930160710 0x7fe9300b6e00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe91c009850 tx=0x7fe91c009b60 comp rx=0 tx=0).stop 2023-10-18T12:20:12.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.077+0000 7fe935948700 1 -- 172.21.15.114:0/3838621680 shutdown_connections 2023-10-18T12:20:12.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.077+0000 7fe935948700 1 --2- 172.21.15.114:0/3838621680 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9300b5ae0 0x7fe93006db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:12.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.077+0000 7fe935948700 1 --2- 172.21.15.114:0/3838621680 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe930160710 0x7fe9300b6e00 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:12.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.077+0000 7fe935948700 1 -- 172.21.15.114:0/3838621680 >> 172.21.15.114:0/3838621680 conn(0x7fe930069f20 msgr2=0x7fe93006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:12.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.077+0000 7fe935948700 1 -- 172.21.15.114:0/3838621680 shutdown_connections 2023-10-18T12:20:12.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.077+0000 7fe935948700 1 -- 172.21.15.114:0/3838621680 wait complete. 2023-10-18T12:20:12.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.081+0000 7fe935948700 1 Processor -- start 2023-10-18T12:20:12.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.081+0000 7fe935948700 1 -- start start 2023-10-18T12:20:12.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.085+0000 7fe935948700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9300b5ae0 0x7fe9300aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:12.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.085+0000 7fe935948700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9300d2e00 0x7fe93015a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:12.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.085+0000 7fe935948700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe930160710 0x7fe9300b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:12.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.085+0000 7fe935948700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9300af310 con 0x7fe9300b5ae0 2023-10-18T12:20:12.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.085+0000 7fe935948700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe93015bc20 con 0x7fe9300d2e00 2023-10-18T12:20:12.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.085+0000 7fe935948700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe93015af00 con 0x7fe930160710 2023-10-18T12:20:12.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.085+0000 7fe934946700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9300b5ae0 0x7fe9300aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:12.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.085+0000 7fe935147700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe930160710 0x7fe9300b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:12.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.085+0000 7fe934946700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9300b5ae0 0x7fe9300aedd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56846/0 (socket says 172.21.15.114:56846) 2023-10-18T12:20:12.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.085+0000 7fe934946700 1 -- 172.21.15.114:0/2173258784 learned_addr learned my addr 172.21.15.114:0/2173258784 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:12.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.085+0000 7fe92ffff700 1 --2- 172.21.15.114:0/2173258784 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9300d2e00 0x7fe93015a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:12.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.085+0000 7fe935147700 1 -- 172.21.15.114:0/2173258784 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9300d2e00 msgr2=0x7fe93015a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:12.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.085+0000 7fe935147700 1 --2- 172.21.15.114:0/2173258784 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9300d2e00 0x7fe93015a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:12.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.085+0000 7fe935147700 1 -- 172.21.15.114:0/2173258784 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9300b5ae0 msgr2=0x7fe9300aedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:12.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.085+0000 7fe935147700 1 --2- 172.21.15.114:0/2173258784 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9300b5ae0 0x7fe9300aedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:12.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.085+0000 7fe935147700 1 -- 172.21.15.114:0/2173258784 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe91c0094b0 con 0x7fe930160710 2023-10-18T12:20:12.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.085+0000 7fe934946700 1 --2- 172.21.15.114:0/2173258784 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9300b5ae0 0x7fe9300aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:20:12.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.085+0000 7fe935147700 1 --2- 172.21.15.114:0/2173258784 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe930160710 0x7fe9300b0d40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe928007d40 tx=0x7fe92800d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:12.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.085+0000 7fe92d7fa700 1 -- 172.21.15.114:0/2173258784 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92800dd20 con 0x7fe930160710 2023-10-18T12:20:12.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.085+0000 7fe92d7fa700 1 -- 172.21.15.114:0/2173258784 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe92800f040 con 0x7fe930160710 2023-10-18T12:20:12.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.085+0000 7fe92d7fa700 1 -- 172.21.15.114:0/2173258784 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe928003cd0 con 0x7fe930160710 2023-10-18T12:20:12.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.085+0000 7fe935948700 1 -- 172.21.15.114:0/2173258784 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9300af500 con 0x7fe930160710 2023-10-18T12:20:12.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.085+0000 7fe935948700 1 -- 172.21.15.114:0/2173258784 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9300afac0 con 0x7fe930160710 2023-10-18T12:20:12.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.089+0000 7fe935948700 1 -- 172.21.15.114:0/2173258784 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9301f2520 con 0x7fe930160710 2023-10-18T12:20:12.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.089+0000 7fe92d7fa700 1 -- 172.21.15.114:0/2173258784 <== mon.2 v2:172.21.15.172:3301/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fe928004030 con 0x7fe930160710 2023-10-18T12:20:12.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.089+0000 7fe92d7fa700 1 --2- 172.21.15.114:0/2173258784 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe9140656f0 0x7fe914067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:12.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.089+0000 7fe92d7fa700 1 -- 172.21.15.114:0/2173258784 <== mon.2 v2:172.21.15.172:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe928006e40 con 0x7fe930160710 2023-10-18T12:20:12.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.089+0000 7fe934946700 1 --2- 172.21.15.114:0/2173258784 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe9140656f0 0x7fe914067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:12.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.093+0000 7fe934946700 1 --2- 172.21.15.114:0/2173258784 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe9140656f0 0x7fe914067bb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe924000f60 tx=0x7fe924007f50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:12.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.101+0000 7fe92d7fa700 1 -- 172.21.15.114:0/2173258784 <== mon.2 v2:172.21.15.172:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fe9301f2520 con 0x7fe930160710 2023-10-18T12:20:12.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.281+0000 7fe935948700 1 -- 172.21.15.114:0/2173258784 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe9301f2520 con 0x7fe930160710 2023-10-18T12:20:12.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.281+0000 7fe92d7fa700 1 -- 172.21.15.114:0/2173258784 <== mon.2 v2:172.21.15.172:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe92801a020 con 0x7fe930160710 2023-10-18T12:20:12.287 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-10-18T12:20:12.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.285+0000 7fe935948700 1 -- 172.21.15.114:0/2173258784 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe9140656f0 msgr2=0x7fe914067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:12.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.285+0000 7fe935948700 1 --2- 172.21.15.114:0/2173258784 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe9140656f0 0x7fe914067bb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe924000f60 tx=0x7fe924007f50 comp rx=0 tx=0).stop 2023-10-18T12:20:12.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.285+0000 7fe935948700 1 -- 172.21.15.114:0/2173258784 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe930160710 msgr2=0x7fe9300b0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:12.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.285+0000 7fe935948700 1 --2- 172.21.15.114:0/2173258784 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe930160710 0x7fe9300b0d40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe928007d40 tx=0x7fe92800d3b0 comp rx=0 tx=0).stop 2023-10-18T12:20:12.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.285+0000 7fe935948700 1 -- 172.21.15.114:0/2173258784 shutdown_connections 2023-10-18T12:20:12.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.285+0000 7fe935948700 1 --2- 172.21.15.114:0/2173258784 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe9140656f0 0x7fe914067bb0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:12.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.285+0000 7fe935948700 1 --2- 172.21.15.114:0/2173258784 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe930160710 0x7fe9300b0d40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:12.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.285+0000 7fe935948700 1 --2- 172.21.15.114:0/2173258784 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9300d2e00 0x7fe93015a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:12.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.285+0000 7fe935948700 1 --2- 172.21.15.114:0/2173258784 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9300b5ae0 0x7fe9300aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:12.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.285+0000 7fe935948700 1 -- 172.21.15.114:0/2173258784 >> 172.21.15.114:0/2173258784 conn(0x7fe930069f20 msgr2=0x7fe93015e2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:12.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.285+0000 7fe935948700 1 -- 172.21.15.114:0/2173258784 shutdown_connections 2023-10-18T12:20:12.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.285+0000 7fe935948700 1 -- 172.21.15.114:0/2173258784 wait complete. 2023-10-18T12:20:12.316 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-18T12:20:12.501 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.497+0000 7f1e30955700 1 Processor -- start 2023-10-18T12:20:12.502 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.497+0000 7f1e30955700 1 -- start start 2023-10-18T12:20:12.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.501+0000 7f1e30955700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1e2c0b3d40 0x7f1e2c0cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:12.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.501+0000 7f1e30955700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1e2c06ce20 0x7f1e2c06d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:12.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.501+0000 7f1e30955700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e2c06d7b0 con 0x7f1e2c164a20 2023-10-18T12:20:12.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.501+0000 7f1e30955700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e2c06e2d0 con 0x7f1e2c0b3d40 2023-10-18T12:20:12.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.501+0000 7f1e30955700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2c0ca4c0 con 0x7f1e2c06ce20 2023-10-18T12:20:12.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.501+0000 7f1e2b59e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1e2c06ce20 0x7f1e2c06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:12.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.501+0000 7f1e2b59e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1e2c06ce20 0x7f1e2c06d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.114:58270/0 (socket says 172.21.15.114:58270) 2023-10-18T12:20:12.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.501+0000 7f1e2b59e700 1 -- 172.21.15.114:0/1469469184 learned_addr learned my addr 172.21.15.114:0/1469469184 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:12.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.501+0000 7f1e2ad9d700 1 --2- 172.21.15.114:0/1469469184 >> v2:172.21.15.172:3300/0 conn(0x7f1e2c0b3d40 0x7f1e2c0cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:12.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.501+0000 7f1e2b59e700 1 -- 172.21.15.114:0/1469469184 >> v2:172.21.15.172:3300/0 conn(0x7f1e2c0b3d40 msgr2=0x7f1e2c0cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:12.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.501+0000 7f1e2b59e700 1 --2- 172.21.15.114:0/1469469184 >> v2:172.21.15.172:3300/0 conn(0x7f1e2c0b3d40 0x7f1e2c0cc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:12.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.501+0000 7f1e2b59e700 1 -- 172.21.15.114:0/1469469184 >> v1:172.21.15.172:6789/0 conn(0x7f1e2c164a20 legacy=0x7f1e2c0c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:12.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.501+0000 7f1e2b59e700 1 -- 172.21.15.114:0/1469469184 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e2c0ca7a0 con 0x7f1e2c06ce20 2023-10-18T12:20:12.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.501+0000 7f1e29d9b700 1 -- 172.21.15.114:0/1469469184 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2030866635 0 0) 0x7f1e20001110 con 0x7f1e2c164a20 2023-10-18T12:20:12.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.501+0000 7f1e2b59e700 1 --2- 172.21.15.114:0/1469469184 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1e2c06ce20 0x7f1e2c06d270 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1e24009e50 tx=0x7f1e2400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa80c90f5020e012 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:12.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.505+0000 7f1e29d9b700 1 -- 172.21.15.114:0/1469469184 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2400e070 con 0x7f1e2c06ce20 2023-10-18T12:20:12.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.505+0000 7f1e29d9b700 1 -- 172.21.15.114:0/1469469184 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2400b910 con 0x7f1e2c06ce20 2023-10-18T12:20:12.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.505+0000 7f1e29d9b700 1 -- 172.21.15.114:0/1469469184 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2400bcc0 con 0x7f1e2c06ce20 2023-10-18T12:20:12.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.505+0000 7f1e30955700 1 -- 172.21.15.114:0/1469469184 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1e2c06ce20 msgr2=0x7f1e2c06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:12.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.505+0000 7f1e30955700 1 --2- 172.21.15.114:0/1469469184 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1e2c06ce20 0x7f1e2c06d270 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1e24009e50 tx=0x7f1e2400b330 comp rx=0 tx=0).stop 2023-10-18T12:20:12.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.505+0000 7f1e30955700 1 -- 172.21.15.114:0/1469469184 shutdown_connections 2023-10-18T12:20:12.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.505+0000 7f1e30955700 1 --2- 172.21.15.114:0/1469469184 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1e2c06ce20 0x7f1e2c06d270 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:12.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.505+0000 7f1e30955700 1 --2- 172.21.15.114:0/1469469184 >> v2:172.21.15.172:3300/0 conn(0x7f1e2c0b3d40 0x7f1e2c0cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:12.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.505+0000 7f1e30955700 1 -- 172.21.15.114:0/1469469184 >> 172.21.15.114:0/1469469184 conn(0x7f1e2c0ce5c0 msgr2=0x7f1e2c0ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:12.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.505+0000 7f1e30955700 1 -- 172.21.15.114:0/1469469184 shutdown_connections 2023-10-18T12:20:12.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.505+0000 7f1e30955700 1 -- 172.21.15.114:0/1469469184 wait complete. 2023-10-18T12:20:12.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.509+0000 7f1e30955700 1 Processor -- start 2023-10-18T12:20:12.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.509+0000 7f1e30955700 1 -- start start 2023-10-18T12:20:12.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.509+0000 7f1e30955700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1e2c06ce20 0x7f1e2c1f6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:12.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.509+0000 7f1e30955700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e2c0b3d40 0x7f1e2c1558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:12.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.509+0000 7f1e30955700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e2c164a20 0x7f1e2c0b2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:12.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.509+0000 7f1e30955700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2c155e20 con 0x7f1e2c164a20 2023-10-18T12:20:12.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.509+0000 7f1e30955700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2c15d290 con 0x7f1e2c0b3d40 2023-10-18T12:20:12.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.509+0000 7f1e30955700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2c0b2bc0 con 0x7f1e2c06ce20 2023-10-18T12:20:12.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.509+0000 7f1e2b59e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e2c164a20 0x7f1e2c0b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:12.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.509+0000 7f1e2b59e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e2c164a20 0x7f1e2c0b2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56862/0 (socket says 172.21.15.114:56862) 2023-10-18T12:20:12.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.509+0000 7f1e2b59e700 1 -- 172.21.15.114:0/3664047059 learned_addr learned my addr 172.21.15.114:0/3664047059 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:12.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.509+0000 7f1e2ad9d700 1 --2- 172.21.15.114:0/3664047059 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1e2c06ce20 0x7f1e2c1f6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:12.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.509+0000 7f1e2a59c700 1 --2- 172.21.15.114:0/3664047059 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e2c0b3d40 0x7f1e2c1558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:12.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.513+0000 7f1e2b59e700 1 -- 172.21.15.114:0/3664047059 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1e2c06ce20 msgr2=0x7f1e2c1f6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:12.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.513+0000 7f1e2b59e700 1 --2- 172.21.15.114:0/3664047059 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1e2c06ce20 0x7f1e2c1f6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:12.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.513+0000 7f1e2b59e700 1 -- 172.21.15.114:0/3664047059 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e2c0b3d40 msgr2=0x7f1e2c1558e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:12.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.513+0000 7f1e2b59e700 1 --2- 172.21.15.114:0/3664047059 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e2c0b3d40 0x7f1e2c1558e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:12.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.513+0000 7f1e2b59e700 1 -- 172.21.15.114:0/3664047059 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e24009b30 con 0x7f1e2c164a20 2023-10-18T12:20:12.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.513+0000 7f1e2b59e700 1 --2- 172.21.15.114:0/3664047059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e2c164a20 0x7f1e2c0b2200 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c06e410 tx=0x7f1e24004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:12.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.513+0000 7f1e137fe700 1 -- 172.21.15.114:0/3664047059 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e240099b0 con 0x7f1e2c164a20 2023-10-18T12:20:12.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.513+0000 7f1e137fe700 1 -- 172.21.15.114:0/3664047059 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e240092e0 con 0x7f1e2c164a20 2023-10-18T12:20:12.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.513+0000 7f1e30955700 1 -- 172.21.15.114:0/3664047059 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e2c15d550 con 0x7f1e2c164a20 2023-10-18T12:20:12.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.513+0000 7f1e137fe700 1 -- 172.21.15.114:0/3664047059 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e24004450 con 0x7f1e2c164a20 2023-10-18T12:20:12.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.513+0000 7f1e30955700 1 -- 172.21.15.114:0/3664047059 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e2c15db10 con 0x7f1e2c164a20 2023-10-18T12:20:12.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.517+0000 7f1e30955700 1 -- 172.21.15.114:0/3664047059 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e2c04e910 con 0x7f1e2c164a20 2023-10-18T12:20:12.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.517+0000 7f1e137fe700 1 -- 172.21.15.114:0/3664047059 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f1e240045b0 con 0x7f1e2c164a20 2023-10-18T12:20:12.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.517+0000 7f1e137fe700 1 --2- 172.21.15.114:0/3664047059 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1e180656f0 0x7f1e18067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:12.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.521+0000 7f1e137fe700 1 -- 172.21.15.114:0/3664047059 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1e24084b30 con 0x7f1e2c164a20 2023-10-18T12:20:12.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.521+0000 7f1e2ad9d700 1 --2- 172.21.15.114:0/3664047059 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1e180656f0 0x7f1e18067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:12.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.521+0000 7f1e2ad9d700 1 --2- 172.21.15.114:0/3664047059 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1e180656f0 0x7f1e18067bb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c009bf0 tx=0x7f1e1c009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:12.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.525+0000 7f1e137fe700 1 -- 172.21.15.114:0/3664047059 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f1e24052430 con 0x7f1e2c164a20 2023-10-18T12:20:12.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.701+0000 7f1e30955700 1 -- 172.21.15.114:0/3664047059 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f1e2c0cad30 con 0x7f1e2c164a20 2023-10-18T12:20:12.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.701+0000 7f1e137fe700 1 -- 172.21.15.114:0/3664047059 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1e24020020 con 0x7f1e2c164a20 2023-10-18T12:20:12.707 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-10-18T12:20:12.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.705+0000 7f1e30955700 1 -- 172.21.15.114:0/3664047059 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1e180656f0 msgr2=0x7f1e18067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:12.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.705+0000 7f1e30955700 1 --2- 172.21.15.114:0/3664047059 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1e180656f0 0x7f1e18067bb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c009bf0 tx=0x7f1e1c009240 comp rx=0 tx=0).stop 2023-10-18T12:20:12.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.705+0000 7f1e30955700 1 -- 172.21.15.114:0/3664047059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e2c164a20 msgr2=0x7f1e2c0b2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:12.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.705+0000 7f1e30955700 1 --2- 172.21.15.114:0/3664047059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e2c164a20 0x7f1e2c0b2200 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c06e410 tx=0x7f1e24004af0 comp rx=0 tx=0).stop 2023-10-18T12:20:12.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.705+0000 7f1e30955700 1 -- 172.21.15.114:0/3664047059 shutdown_connections 2023-10-18T12:20:12.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.705+0000 7f1e30955700 1 --2- 172.21.15.114:0/3664047059 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1e180656f0 0x7f1e18067bb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:12.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.705+0000 7f1e30955700 1 --2- 172.21.15.114:0/3664047059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e2c164a20 0x7f1e2c0b2200 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:12.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.705+0000 7f1e30955700 1 --2- 172.21.15.114:0/3664047059 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e2c0b3d40 0x7f1e2c1558e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:12.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.705+0000 7f1e30955700 1 --2- 172.21.15.114:0/3664047059 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1e2c06ce20 0x7f1e2c1f6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:12.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.705+0000 7f1e30955700 1 -- 172.21.15.114:0/3664047059 >> 172.21.15.114:0/3664047059 conn(0x7f1e2c0ce5c0 msgr2=0x7f1e2c15f070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:12.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.705+0000 7f1e30955700 1 -- 172.21.15.114:0/3664047059 shutdown_connections 2023-10-18T12:20:12.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.705+0000 7f1e30955700 1 -- 172.21.15.114:0/3664047059 wait complete. 2023-10-18T12:20:12.734 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T12:20:12.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.889+0000 7f873ba58700 1 Processor -- start 2023-10-18T12:20:12.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.889+0000 7f873ba58700 1 -- start start 2023-10-18T12:20:12.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.893+0000 7f873ba58700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f87340ce320 0x7f87340cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:12.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.893+0000 7f873ba58700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87340cbc80 con 0x7f873415bf00 2023-10-18T12:20:12.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.893+0000 7f873ba58700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87340cb9a0 con 0x7f8734155420 2023-10-18T12:20:12.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.893+0000 7f873ba58700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8734155800 con 0x7f87340ce320 2023-10-18T12:20:12.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.893+0000 7f8738ff3700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f873415bf00 0x7f87340cdc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34588/0 (socket says 172.21.15.114:34588) 2023-10-18T12:20:12.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.893+0000 7f8738ff3700 1 -- 172.21.15.114:0/1015418297 learned_addr learned my addr 172.21.15.114:0/1015418297 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:12.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.893+0000 7f8739ff5700 1 --2- 172.21.15.114:0/1015418297 >> v2:172.21.15.114:3300/0 conn(0x7f87340ce320 0x7f87340cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:12.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.893+0000 7f8727fff700 1 -- 172.21.15.114:0/1015418297 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3860217294 0 0) 0x7f87340cbc80 con 0x7f873415bf00 2023-10-18T12:20:12.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.893+0000 7f8727fff700 1 -- 172.21.15.114:0/1015418297 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87200035d0 con 0x7f873415bf00 2023-10-18T12:20:12.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.893+0000 7f8739ff5700 1 -- 172.21.15.114:0/1015418297 >> v1:172.21.15.172:6789/0 conn(0x7f8734155420 legacy=0x7f87340cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:12.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.893+0000 7f8739ff5700 1 -- 172.21.15.114:0/1015418297 >> v1:172.21.15.114:6789/0 conn(0x7f873415bf00 legacy=0x7f87340cdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:12.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.893+0000 7f8739ff5700 1 -- 172.21.15.114:0/1015418297 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f873415b420 con 0x7f87340ce320 2023-10-18T12:20:12.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.893+0000 7f8739ff5700 1 --2- 172.21.15.114:0/1015418297 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87340ce320 0x7f87340cc680 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f872c009d90 tx=0x7f872c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ea05c9269ba1aea server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:12.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.893+0000 7f8727fff700 1 -- 172.21.15.114:0/1015418297 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872c00e070 con 0x7f87340ce320 2023-10-18T12:20:12.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.893+0000 7f8727fff700 1 -- 172.21.15.114:0/1015418297 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872c00bb20 con 0x7f87340ce320 2023-10-18T12:20:12.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.893+0000 7f8727fff700 1 -- 172.21.15.114:0/1015418297 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872c012430 con 0x7f87340ce320 2023-10-18T12:20:12.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.897+0000 7f873ba58700 1 -- 172.21.15.114:0/1015418297 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87340ce320 msgr2=0x7f87340cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:12.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.897+0000 7f873ba58700 1 --2- 172.21.15.114:0/1015418297 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87340ce320 0x7f87340cc680 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f872c009d90 tx=0x7f872c00b330 comp rx=0 tx=0).stop 2023-10-18T12:20:12.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.897+0000 7f873ba58700 1 -- 172.21.15.114:0/1015418297 shutdown_connections 2023-10-18T12:20:12.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.897+0000 7f873ba58700 1 --2- 172.21.15.114:0/1015418297 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f87340ce320 0x7f87340cc680 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:12.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.897+0000 7f873ba58700 1 -- 172.21.15.114:0/1015418297 >> 172.21.15.114:0/1015418297 conn(0x7f873406a340 msgr2=0x7f87340b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:12.906 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.897+0000 7f873ba58700 1 -- 172.21.15.114:0/1015418297 shutdown_connections 2023-10-18T12:20:12.906 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.897+0000 7f873ba58700 1 -- 172.21.15.114:0/1015418297 wait complete. 2023-10-18T12:20:12.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.897+0000 7f873ba58700 1 Processor -- start 2023-10-18T12:20:12.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.897+0000 7f873ba58700 1 -- start start 2023-10-18T12:20:12.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.901+0000 7f873ba58700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87340ce320 0x7f8734140fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:12.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.901+0000 7f873ba58700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8734155420 0x7f87340ac2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:12.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.901+0000 7f873ba58700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f873415bf00 0x7f87340add30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:12.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.901+0000 7f873ba58700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87341414e0 con 0x7f8734155420 2023-10-18T12:20:12.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.901+0000 7f873ba58700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87340b17d0 con 0x7f87340ce320 2023-10-18T12:20:12.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.901+0000 7f873ba58700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87340b2350 con 0x7f873415bf00 2023-10-18T12:20:12.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.901+0000 7f8738ff3700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8734155420 0x7f87340ac2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:12.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.901+0000 7f8738ff3700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8734155420 0x7f87340ac2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56882/0 (socket says 172.21.15.114:56882) 2023-10-18T12:20:12.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.901+0000 7f8738ff3700 1 -- 172.21.15.114:0/3399009608 learned_addr learned my addr 172.21.15.114:0/3399009608 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:12.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.901+0000 7f8738ff3700 1 -- 172.21.15.114:0/3399009608 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f873415bf00 msgr2=0x7f87340add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:12.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.901+0000 7f8738ff3700 1 --2- 172.21.15.114:0/3399009608 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f873415bf00 0x7f87340add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:12.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.901+0000 7f8738ff3700 1 -- 172.21.15.114:0/3399009608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87340ce320 msgr2=0x7f8734140fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:12.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.901+0000 7f87397f4700 1 --2- 172.21.15.114:0/3399009608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87340ce320 0x7f8734140fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:12.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.901+0000 7f8738ff3700 1 --2- 172.21.15.114:0/3399009608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87340ce320 0x7f8734140fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:12.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.901+0000 7f8738ff3700 1 -- 172.21.15.114:0/3399009608 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872c009a70 con 0x7f8734155420 2023-10-18T12:20:12.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.901+0000 7f87397f4700 1 --2- 172.21.15.114:0/3399009608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87340ce320 0x7f8734140fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:20:12.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.901+0000 7f8738ff3700 1 --2- 172.21.15.114:0/3399009608 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8734155420 0x7f87340ac2f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f873000c4d0 tx=0x7f873000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:12.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.901+0000 7f8725ffb700 1 -- 172.21.15.114:0/3399009608 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8730005d90 con 0x7f8734155420 2023-10-18T12:20:12.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.901+0000 7f8725ffb700 1 -- 172.21.15.114:0/3399009608 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87300070d0 con 0x7f8734155420 2023-10-18T12:20:12.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.901+0000 7f8725ffb700 1 -- 172.21.15.114:0/3399009608 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8730007480 con 0x7f8734155420 2023-10-18T12:20:12.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.901+0000 7f873ba58700 1 -- 172.21.15.114:0/3399009608 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87340b1a20 con 0x7f8734155420 2023-10-18T12:20:12.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.901+0000 7f873ba58700 1 -- 172.21.15.114:0/3399009608 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87340b1fe0 con 0x7f8734155420 2023-10-18T12:20:12.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.905+0000 7f873ba58700 1 -- 172.21.15.114:0/3399009608 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87340b24c0 con 0x7f8734155420 2023-10-18T12:20:12.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.905+0000 7f8725ffb700 1 -- 172.21.15.114:0/3399009608 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f87300075e0 con 0x7f8734155420 2023-10-18T12:20:12.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.905+0000 7f8725ffb700 1 --2- 172.21.15.114:0/3399009608 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f87180656f0 0x7f8718067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:12.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.905+0000 7f8725ffb700 1 -- 172.21.15.114:0/3399009608 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8730082640 con 0x7f8734155420 2023-10-18T12:20:12.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.905+0000 7f87397f4700 1 --2- 172.21.15.114:0/3399009608 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f87180656f0 0x7f8718067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:12.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.909+0000 7f87397f4700 1 --2- 172.21.15.114:0/3399009608 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f87180656f0 0x7f8718067bb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f87341589c0 tx=0x7f8728009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:12.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:12.913+0000 7f8725ffb700 1 -- 172.21.15.114:0/3399009608 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f873004fe00 con 0x7f8734155420 2023-10-18T12:20:13.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.141+0000 7f873ba58700 1 -- 172.21.15.114:0/3399009608 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8734072e60 con 0x7f8734155420 2023-10-18T12:20:13.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.141+0000 7f8725ffb700 1 -- 172.21.15.114:0/3399009608 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4877 (secure 0 0 0) 0x7f8730053420 con 0x7f8734155420 2023-10-18T12:20:13.146 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:20:13.146 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1054658298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1054658298},{"type":"v1","addr":"172.21.15.172:6835","nonce":1054658298}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2715800167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2715800167},{"type":"v1","addr":"172.21.15.114:6833","nonce":2715800167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/22518579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":22518579},{"type":"v1","addr":"172.21.15.114:6835","nonce":22518579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T12:19:39.077734+0000","modified":"2023-10-18T12:20:01.448709+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4303":{"gid":4303,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3028221887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3028221887},{"type":"v1","addr":"172.21.15.172:6837","nonce":3028221887}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-18T12:20:13.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.145+0000 7f873ba58700 1 -- 172.21.15.114:0/3399009608 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f87180656f0 msgr2=0x7f8718067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:13.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.145+0000 7f873ba58700 1 --2- 172.21.15.114:0/3399009608 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f87180656f0 0x7f8718067bb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f87341589c0 tx=0x7f8728009040 comp rx=0 tx=0).stop 2023-10-18T12:20:13.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.145+0000 7f873ba58700 1 -- 172.21.15.114:0/3399009608 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8734155420 msgr2=0x7f87340ac2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:13.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.145+0000 7f873ba58700 1 --2- 172.21.15.114:0/3399009608 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8734155420 0x7f87340ac2f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f873000c4d0 tx=0x7f873000c890 comp rx=0 tx=0).stop 2023-10-18T12:20:13.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.145+0000 7f873ba58700 1 -- 172.21.15.114:0/3399009608 shutdown_connections 2023-10-18T12:20:13.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.145+0000 7f873ba58700 1 --2- 172.21.15.114:0/3399009608 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f87180656f0 0x7f8718067bb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:13.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.145+0000 7f873ba58700 1 --2- 172.21.15.114:0/3399009608 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f873415bf00 0x7f87340add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:13.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.145+0000 7f873ba58700 1 --2- 172.21.15.114:0/3399009608 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8734155420 0x7f87340ac2f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:13.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.145+0000 7f873ba58700 1 --2- 172.21.15.114:0/3399009608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87340ce320 0x7f8734140fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:13.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.145+0000 7f873ba58700 1 -- 172.21.15.114:0/3399009608 >> 172.21.15.114:0/3399009608 conn(0x7f873406a340 msgr2=0x7f873406d050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:13.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.145+0000 7f873ba58700 1 -- 172.21.15.114:0/3399009608 shutdown_connections 2023-10-18T12:20:13.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.145+0000 7f873ba58700 1 -- 172.21.15.114:0/3399009608 wait complete. 2023-10-18T12:20:13.152 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 9 2023-10-18T12:20:13.171 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T12:20:13.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.337+0000 7f67b4e0f700 1 Processor -- start 2023-10-18T12:20:13.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.337+0000 7f67b4e0f700 1 -- start start 2023-10-18T12:20:13.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.337+0000 7f67b4e0f700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f67b006d090 0x7f67b00b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:13.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.337+0000 7f67b4e0f700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f67b006d470 0x7f67b0070a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:13.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.337+0000 7f67b4e0f700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67b015e990 con 0x7f67b0070f50 2023-10-18T12:20:13.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.337+0000 7f67b4e0f700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67b015f4f0 con 0x7f67b006d470 2023-10-18T12:20:13.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.337+0000 7f67b4e0f700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67b015ec50 con 0x7f67b006d090 2023-10-18T12:20:13.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.337+0000 7f67aeffd700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f67b006d470 0x7f67b0070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:13.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.337+0000 7f67aeffd700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f67b006d470 0x7f67b0070a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56894/0 (socket says 172.21.15.114:56894) 2023-10-18T12:20:13.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.337+0000 7f67aeffd700 1 -- 172.21.15.114:0/2163956066 learned_addr learned my addr 172.21.15.114:0/2163956066 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:13.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.337+0000 7f67af7fe700 1 --2- 172.21.15.114:0/2163956066 >> v2:172.21.15.172:3300/0 conn(0x7f67b006d090 0x7f67b00b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:13.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.337+0000 7f67aeffd700 1 -- 172.21.15.114:0/2163956066 >> v2:172.21.15.172:3300/0 conn(0x7f67b006d090 msgr2=0x7f67b00b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:13.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.337+0000 7f67aeffd700 1 --2- 172.21.15.114:0/2163956066 >> v2:172.21.15.172:3300/0 conn(0x7f67b006d090 0x7f67b00b2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:13.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.337+0000 7f67aeffd700 1 -- 172.21.15.114:0/2163956066 >> v1:172.21.15.172:6789/0 conn(0x7f67b0070f50 legacy=0x7f67b015a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:13.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.337+0000 7f67aeffd700 1 -- 172.21.15.114:0/2163956066 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b015ef30 con 0x7f67b006d470 2023-10-18T12:20:13.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.337+0000 7f67af7fe700 1 --2- 172.21.15.114:0/2163956066 >> v2:172.21.15.172:3300/0 conn(0x7f67b006d090 0x7f67b00b2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:20:13.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.337+0000 7f67aeffd700 1 --2- 172.21.15.114:0/2163956066 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67b006d470 0x7f67b0070a10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f67b00cf440 tx=0x7f6798009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4df555af13c4a826 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:13.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.341+0000 7f67ae7fc700 1 -- 172.21.15.114:0/2163956066 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6798004230 con 0x7f67b006d470 2023-10-18T12:20:13.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.341+0000 7f67ae7fc700 1 -- 172.21.15.114:0/2163956066 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6798004390 con 0x7f67b006d470 2023-10-18T12:20:13.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.341+0000 7f67ae7fc700 1 -- 172.21.15.114:0/2163956066 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67980036c0 con 0x7f67b006d470 2023-10-18T12:20:13.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.341+0000 7f67b4e0f700 1 -- 172.21.15.114:0/2163956066 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67b006d470 msgr2=0x7f67b0070a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:13.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.341+0000 7f67b4e0f700 1 --2- 172.21.15.114:0/2163956066 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67b006d470 0x7f67b0070a10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f67b00cf440 tx=0x7f6798009bf0 comp rx=0 tx=0).stop 2023-10-18T12:20:13.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.341+0000 7f67b4e0f700 1 -- 172.21.15.114:0/2163956066 shutdown_connections 2023-10-18T12:20:13.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.341+0000 7f67b4e0f700 1 --2- 172.21.15.114:0/2163956066 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67b006d470 0x7f67b0070a10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:13.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.341+0000 7f67b4e0f700 1 --2- 172.21.15.114:0/2163956066 >> v2:172.21.15.172:3300/0 conn(0x7f67b006d090 0x7f67b00b2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:13.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.341+0000 7f67b4e0f700 1 -- 172.21.15.114:0/2163956066 >> 172.21.15.114:0/2163956066 conn(0x7f67b00ce5c0 msgr2=0x7f67b00ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:13.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.341+0000 7f67b4e0f700 1 -- 172.21.15.114:0/2163956066 shutdown_connections 2023-10-18T12:20:13.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.341+0000 7f67b4e0f700 1 -- 172.21.15.114:0/2163956066 wait complete. 2023-10-18T12:20:13.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.345+0000 7f67b4e0f700 1 Processor -- start 2023-10-18T12:20:13.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.345+0000 7f67b4e0f700 1 -- start start 2023-10-18T12:20:13.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.345+0000 7f67b4e0f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67b006d090 0x7f67b0154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:13.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.345+0000 7f67b4e0f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f67b006d470 0x7f67b00c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:13.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.345+0000 7f67b4e0f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67b0070f50 0x7f67b00c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:13.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.345+0000 7f67b4e0f700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b01552f0 con 0x7f67b0070f50 2023-10-18T12:20:13.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.345+0000 7f67b4e0f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b00c6240 con 0x7f67b006d090 2023-10-18T12:20:13.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.345+0000 7f67b4e0f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67b00c6520 con 0x7f67b006d470 2023-10-18T12:20:13.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.345+0000 7f67af7fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67b006d090 0x7f67b0154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:13.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.345+0000 7f67affff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67b0070f50 0x7f67b00c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:13.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.345+0000 7f67af7fe700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67b006d090 0x7f67b0154db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:42258/0 (socket says 172.21.15.114:42258) 2023-10-18T12:20:13.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.345+0000 7f67af7fe700 1 -- 172.21.15.114:0/4053057734 learned_addr learned my addr 172.21.15.114:0/4053057734 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:13.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.345+0000 7f67aeffd700 1 --2- 172.21.15.114:0/4053057734 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f67b006d470 0x7f67b00c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:13.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.345+0000 7f67affff700 1 -- 172.21.15.114:0/4053057734 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f67b006d470 msgr2=0x7f67b00c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:13.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.345+0000 7f67affff700 1 --2- 172.21.15.114:0/4053057734 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f67b006d470 0x7f67b00c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:13.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.345+0000 7f67affff700 1 -- 172.21.15.114:0/4053057734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67b006d090 msgr2=0x7f67b0154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:13.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.345+0000 7f67affff700 1 --2- 172.21.15.114:0/4053057734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67b006d090 0x7f67b0154db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:13.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.345+0000 7f67affff700 1 -- 172.21.15.114:0/4053057734 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6798009570 con 0x7f67b0070f50 2023-10-18T12:20:13.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.349+0000 7f67affff700 1 --2- 172.21.15.114:0/4053057734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67b0070f50 0x7f67b00c85d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f67a800b410 tx=0x7f67a800b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:13.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.349+0000 7f67a7fff700 1 -- 172.21.15.114:0/4053057734 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a8011830 con 0x7f67b0070f50 2023-10-18T12:20:13.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.349+0000 7f67a7fff700 1 -- 172.21.15.114:0/4053057734 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67a8011990 con 0x7f67b0070f50 2023-10-18T12:20:13.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.349+0000 7f67a7fff700 1 -- 172.21.15.114:0/4053057734 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a8011d40 con 0x7f67b0070f50 2023-10-18T12:20:13.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.349+0000 7f67b4e0f700 1 -- 172.21.15.114:0/4053057734 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67b00c6800 con 0x7f67b0070f50 2023-10-18T12:20:13.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.349+0000 7f67b4e0f700 1 -- 172.21.15.114:0/4053057734 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67b00b0dd0 con 0x7f67b0070f50 2023-10-18T12:20:13.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.349+0000 7f67b4e0f700 1 -- 172.21.15.114:0/4053057734 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67b0072e60 con 0x7f67b0070f50 2023-10-18T12:20:13.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.353+0000 7f67a7fff700 1 -- 172.21.15.114:0/4053057734 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f67a801a400 con 0x7f67b0070f50 2023-10-18T12:20:13.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.353+0000 7f67a7fff700 1 --2- 172.21.15.114:0/4053057734 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6790065740 0x7f6790067c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:13.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.353+0000 7f67a7fff700 1 -- 172.21.15.114:0/4053057734 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f67a8082ac0 con 0x7f67b0070f50 2023-10-18T12:20:13.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.353+0000 7f67af7fe700 1 --2- 172.21.15.114:0/4053057734 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6790065740 0x7f6790067c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:13.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.353+0000 7f67af7fe700 1 --2- 172.21.15.114:0/4053057734 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6790065740 0x7f6790067c00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f67a0007fd0 tx=0x7f67a00078d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:13.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.357+0000 7f67a7fff700 1 -- 172.21.15.114:0/4053057734 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f67a8050370 con 0x7f67b0070f50 2023-10-18T12:20:13.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.533+0000 7f67b4e0f700 1 -- 172.21.15.114:0/4053057734 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f67b015f1e0 con 0x7f67b0070f50 2023-10-18T12:20:13.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.537+0000 7f67a7fff700 1 -- 172.21.15.114:0/4053057734 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20144 (secure 0 0 0) 0x7f67a8053990 con 0x7f67b0070f50 2023-10-18T12:20:13.542 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:20:13.543 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":28,"fsid":"240ea340-5d3d-4f52-a4bc-af075aca3deb","created":"2023-10-18T12:19:12.512994+0000","modified":"2023-10-18T12:19:44.436656+0000","last_up_change":"2023-10-18T12:19:25.286009+0000","last_in_change":"2023-10-18T12:19:15.850693+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T12:19:27.040638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-18T12:19:32.358094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-18T12:19:37.333855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-18T12:19:38.055385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-18T12:19:41.679218+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c3578978-1a03-4857-b9d2-34a5da3d7731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6817","nonce":1506287862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6820","nonce":1506287862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6830","nonce":1506287862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6825","nonce":1506287862}]},"public_addr":"172.21.15.114:6817/1506287862","cluster_addr":"172.21.15.114:6820/1506287862","heartbeat_back_addr":"172.21.15.114:6830/1506287862","heartbeat_front_addr":"172.21.15.114:6825/1506287862","state":["exists","up"]},{"osd":1,"uuid":"43eb26a6-e2b3-4670-9559-bd053b5140d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6801","nonce":3302727047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6803","nonce":3302727047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6807","nonce":3302727047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6805","nonce":3302727047}]},"public_addr":"172.21.15.114:6801/3302727047","cluster_addr":"172.21.15.114:6803/3302727047","heartbeat_back_addr":"172.21.15.114:6807/3302727047","heartbeat_front_addr":"172.21.15.114:6805/3302727047","state":["exists","up"]},{"osd":2,"uuid":"f3d4dbd5-521c-4dd2-b687-5768cc7d0938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6809","nonce":2699151351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6811","nonce":2699151351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6815","nonce":2699151351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6813","nonce":2699151351}]},"public_addr":"172.21.15.114:6809/2699151351","cluster_addr":"172.21.15.114:6811/2699151351","heartbeat_back_addr":"172.21.15.114:6815/2699151351","heartbeat_front_addr":"172.21.15.114:6813/2699151351","state":["exists","up"]},{"osd":3,"uuid":"823e5802-92b7-4f0d-b32d-a5748993f1b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6821","nonce":1361608073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6824","nonce":1361608073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6829","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6831","nonce":1361608073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6827","nonce":1361608073}]},"public_addr":"172.21.15.114:6821/1361608073","cluster_addr":"172.21.15.114:6824/1361608073","heartbeat_back_addr":"172.21.15.114:6831/1361608073","heartbeat_front_addr":"172.21.15.114:6827/1361608073","state":["exists","up"]},{"osd":4,"uuid":"e47fb93e-13b4-44a4-b084-8c4384ceb41e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6801","nonce":930839681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6803","nonce":930839681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6807","nonce":930839681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6805","nonce":930839681}]},"public_addr":"172.21.15.172:6801/930839681","cluster_addr":"172.21.15.172:6803/930839681","heartbeat_back_addr":"172.21.15.172:6807/930839681","heartbeat_front_addr":"172.21.15.172:6805/930839681","state":["exists","up"]},{"osd":5,"uuid":"7561a973-f479-45a0-af40-f324728d622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6814","nonce":571761850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6818","nonce":571761850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6824","nonce":571761850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6821","nonce":571761850}]},"public_addr":"172.21.15.172:6814/571761850","cluster_addr":"172.21.15.172:6818/571761850","heartbeat_back_addr":"172.21.15.172:6824/571761850","heartbeat_front_addr":"172.21.15.172:6821/571761850","state":["exists","up"]},{"osd":6,"uuid":"51753f4b-7f06-4f1c-9ec7-6e18a66eb980","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6825","nonce":1680398853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6827","nonce":1680398853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6831","nonce":1680398853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6829","nonce":1680398853}]},"public_addr":"172.21.15.172:6825/1680398853","cluster_addr":"172.21.15.172:6827/1680398853","heartbeat_back_addr":"172.21.15.172:6831/1680398853","heartbeat_front_addr":"172.21.15.172:6829/1680398853","state":["exists","up"]},{"osd":7,"uuid":"4d8b1e15-143d-4d17-9074-59d92f0f9af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6809","nonce":349710101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6811","nonce":349710101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6819","nonce":349710101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6815","nonce":349710101}]},"public_addr":"172.21.15.172:6809/349710101","cluster_addr":"172.21.15.172:6811/349710101","heartbeat_back_addr":"172.21.15.172:6819/349710101","heartbeat_front_addr":"172.21.15.172:6815/349710101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.889460+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.475494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.911473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.648596+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.609994+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.636248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.854589+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.885826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T12:20:13.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.541+0000 7f67b4e0f700 1 -- 172.21.15.114:0/4053057734 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6790065740 msgr2=0x7f6790067c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:13.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.541+0000 7f67b4e0f700 1 --2- 172.21.15.114:0/4053057734 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6790065740 0x7f6790067c00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f67a0007fd0 tx=0x7f67a00078d0 comp rx=0 tx=0).stop 2023-10-18T12:20:13.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.541+0000 7f67b4e0f700 1 -- 172.21.15.114:0/4053057734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67b0070f50 msgr2=0x7f67b00c85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:13.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.541+0000 7f67b4e0f700 1 --2- 172.21.15.114:0/4053057734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67b0070f50 0x7f67b00c85d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f67a800b410 tx=0x7f67a800b720 comp rx=0 tx=0).stop 2023-10-18T12:20:13.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.541+0000 7f67b4e0f700 1 -- 172.21.15.114:0/4053057734 shutdown_connections 2023-10-18T12:20:13.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.541+0000 7f67b4e0f700 1 --2- 172.21.15.114:0/4053057734 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6790065740 0x7f6790067c00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:13.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.541+0000 7f67b4e0f700 1 --2- 172.21.15.114:0/4053057734 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f67b006d470 0x7f67b00c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:13.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.541+0000 7f67b4e0f700 1 --2- 172.21.15.114:0/4053057734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67b0070f50 0x7f67b00c85d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:13.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.541+0000 7f67b4e0f700 1 --2- 172.21.15.114:0/4053057734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67b006d090 0x7f67b0154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:13.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.541+0000 7f67b4e0f700 1 -- 172.21.15.114:0/4053057734 >> 172.21.15.114:0/4053057734 conn(0x7f67b00ce5c0 msgr2=0x7f67b00c9590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:13.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.541+0000 7f67b4e0f700 1 -- 172.21.15.114:0/4053057734 shutdown_connections 2023-10-18T12:20:13.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.541+0000 7f67b4e0f700 1 -- 172.21.15.114:0/4053057734 wait complete. 2023-10-18T12:20:13.566 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T12:20:13.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.741+0000 7f232cd37700 1 Processor -- start 2023-10-18T12:20:13.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.741+0000 7f232cd37700 1 -- start start 2023-10-18T12:20:13.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.745+0000 7f232cd37700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f23280b3d40 0x7f23280cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:13.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.745+0000 7f232cd37700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2328164a20 0x7f23280c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:13.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.745+0000 7f232cd37700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23280ca200 con 0x7f232806ce20 2023-10-18T12:20:13.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.745+0000 7f232cd37700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f232806e2d0 con 0x7f23280b3d40 2023-10-18T12:20:13.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.745+0000 7f232cd37700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23280ca4c0 con 0x7f2328164a20 2023-10-18T12:20:13.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.745+0000 7f23277fe700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f23280b3d40 0x7f23280cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:13.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.745+0000 7f23277fe700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f23280b3d40 0x7f23280cc190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56916/0 (socket says 172.21.15.114:56916) 2023-10-18T12:20:13.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.745+0000 7f23277fe700 1 -- 172.21.15.114:0/601769840 learned_addr learned my addr 172.21.15.114:0/601769840 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:13.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.745+0000 7f231effd700 1 --2- 172.21.15.114:0/601769840 >> v2:172.21.15.172:3300/0 conn(0x7f2328164a20 0x7f23280c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:13.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.745+0000 7f23277fe700 1 -- 172.21.15.114:0/601769840 >> v2:172.21.15.172:3300/0 conn(0x7f2328164a20 msgr2=0x7f23280c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:13.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.745+0000 7f23277fe700 1 --2- 172.21.15.114:0/601769840 >> v2:172.21.15.172:3300/0 conn(0x7f2328164a20 0x7f23280c9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:13.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.745+0000 7f23277fe700 1 -- 172.21.15.114:0/601769840 >> v1:172.21.15.172:6789/0 conn(0x7f232806ce20 legacy=0x7f232806f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:13.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.749+0000 7f23277fe700 1 -- 172.21.15.114:0/601769840 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23280ca7a0 con 0x7f23280b3d40 2023-10-18T12:20:13.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.749+0000 7f23277fe700 1 --2- 172.21.15.114:0/601769840 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f23280b3d40 0x7f23280cc190 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f23280c9830 tx=0x7f2318009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12d9020f7ec8dbf7 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:13.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.749+0000 7f2326ffd700 1 -- 172.21.15.114:0/601769840 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2318004230 con 0x7f23280b3d40 2023-10-18T12:20:13.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.749+0000 7f2326ffd700 1 -- 172.21.15.114:0/601769840 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2318004390 con 0x7f23280b3d40 2023-10-18T12:20:13.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.749+0000 7f2326ffd700 1 -- 172.21.15.114:0/601769840 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23180036c0 con 0x7f23280b3d40 2023-10-18T12:20:13.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.749+0000 7f232cd37700 1 -- 172.21.15.114:0/601769840 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f23280b3d40 msgr2=0x7f23280cc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:13.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.749+0000 7f232cd37700 1 --2- 172.21.15.114:0/601769840 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f23280b3d40 0x7f23280cc190 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f23280c9830 tx=0x7f2318009bf0 comp rx=0 tx=0).stop 2023-10-18T12:20:13.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.749+0000 7f232cd37700 1 -- 172.21.15.114:0/601769840 shutdown_connections 2023-10-18T12:20:13.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.749+0000 7f232cd37700 1 --2- 172.21.15.114:0/601769840 >> v2:172.21.15.172:3300/0 conn(0x7f2328164a20 0x7f23280c9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:13.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.749+0000 7f232cd37700 1 --2- 172.21.15.114:0/601769840 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f23280b3d40 0x7f23280cc190 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:13.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.749+0000 7f232cd37700 1 -- 172.21.15.114:0/601769840 >> 172.21.15.114:0/601769840 conn(0x7f23280ce5c0 msgr2=0x7f23280ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:13.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.749+0000 7f232cd37700 1 -- 172.21.15.114:0/601769840 shutdown_connections 2023-10-18T12:20:13.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.749+0000 7f232cd37700 1 -- 172.21.15.114:0/601769840 wait complete. 2023-10-18T12:20:13.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.753+0000 7f232cd37700 1 Processor -- start 2023-10-18T12:20:13.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.753+0000 7f232cd37700 1 -- start start 2023-10-18T12:20:13.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.753+0000 7f232cd37700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f232806ce20 0x7f2328156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:13.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.753+0000 7f232cd37700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23280b3d40 0x7f2328156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:13.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.753+0000 7f232cd37700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2328164a20 0x7f23280c38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:13.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.753+0000 7f232cd37700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2328157de0 con 0x7f232806ce20 2023-10-18T12:20:13.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.753+0000 7f232cd37700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2328157260 con 0x7f2328164a20 2023-10-18T12:20:13.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.753+0000 7f232cd37700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2328157540 con 0x7f23280b3d40 2023-10-18T12:20:13.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.753+0000 7f23277fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f232806ce20 0x7f2328156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:13.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.753+0000 7f23277fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f232806ce20 0x7f2328156270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56920/0 (socket says 172.21.15.114:56920) 2023-10-18T12:20:13.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.753+0000 7f23277fe700 1 -- 172.21.15.114:0/2806378150 learned_addr learned my addr 172.21.15.114:0/2806378150 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:13.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.753+0000 7f2327fff700 1 --2- 172.21.15.114:0/2806378150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2328164a20 0x7f23280c38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:13.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.753+0000 7f231effd700 1 --2- 172.21.15.114:0/2806378150 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23280b3d40 0x7f2328156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:13.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.753+0000 7f23277fe700 1 -- 172.21.15.114:0/2806378150 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23280b3d40 msgr2=0x7f2328156a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:13.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.753+0000 7f23277fe700 1 --2- 172.21.15.114:0/2806378150 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23280b3d40 0x7f2328156a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:13.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.753+0000 7f23277fe700 1 -- 172.21.15.114:0/2806378150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2328164a20 msgr2=0x7f23280c38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:13.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.753+0000 7f23277fe700 1 --2- 172.21.15.114:0/2806378150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2328164a20 0x7f23280c38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:13.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.753+0000 7f23277fe700 1 -- 172.21.15.114:0/2806378150 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2318009570 con 0x7f232806ce20 2023-10-18T12:20:13.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.753+0000 7f2327fff700 1 --2- 172.21.15.114:0/2806378150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2328164a20 0x7f23280c38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:13.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.757+0000 7f23277fe700 1 --2- 172.21.15.114:0/2806378150 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f232806ce20 0x7f2328156270 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2318004000 tx=0x7f2318004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:13.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.757+0000 7f2324ff9700 1 -- 172.21.15.114:0/2806378150 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2318003e60 con 0x7f232806ce20 2023-10-18T12:20:13.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.757+0000 7f2324ff9700 1 -- 172.21.15.114:0/2806378150 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231801f070 con 0x7f232806ce20 2023-10-18T12:20:13.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.757+0000 7f232cd37700 1 -- 172.21.15.114:0/2806378150 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2328157820 con 0x7f232806ce20 2023-10-18T12:20:13.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.757+0000 7f2324ff9700 1 -- 172.21.15.114:0/2806378150 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231800b8a0 con 0x7f232806ce20 2023-10-18T12:20:13.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.757+0000 7f232cd37700 1 -- 172.21.15.114:0/2806378150 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23281567b0 con 0x7f232806ce20 2023-10-18T12:20:13.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.757+0000 7f232cd37700 1 -- 172.21.15.114:0/2806378150 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2328072e60 con 0x7f232806ce20 2023-10-18T12:20:13.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.761+0000 7f2324ff9700 1 -- 172.21.15.114:0/2806378150 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f2318021030 con 0x7f232806ce20 2023-10-18T12:20:13.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.761+0000 7f2324ff9700 1 --2- 172.21.15.114:0/2806378150 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f23080656f0 0x7f2308067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:13.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.761+0000 7f2324ff9700 1 -- 172.21.15.114:0/2806378150 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f23180846c0 con 0x7f232806ce20 2023-10-18T12:20:13.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.761+0000 7f231effd700 1 --2- 172.21.15.114:0/2806378150 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f23080656f0 0x7f2308067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:13.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.765+0000 7f231effd700 1 --2- 172.21.15.114:0/2806378150 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f23080656f0 0x7f2308067bb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f23280ca1d0 tx=0x7f2310008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:13.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.769+0000 7f2324ff9700 1 -- 172.21.15.114:0/2806378150 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f2318051e80 con 0x7f232806ce20 2023-10-18T12:20:14.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.993+0000 7f232cd37700 1 -- 172.21.15.114:0/2806378150 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2328072e60 con 0x7f232806ce20 2023-10-18T12:20:14.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:13.997+0000 7f2324ff9700 1 -- 172.21.15.114:0/2806378150 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4877 (secure 0 0 0) 0x7f23180554a0 con 0x7f232806ce20 2023-10-18T12:20:14.001 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:20:14.002 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1054658298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1054658298},{"type":"v1","addr":"172.21.15.172:6835","nonce":1054658298}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2715800167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2715800167},{"type":"v1","addr":"172.21.15.114:6833","nonce":2715800167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/22518579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":22518579},{"type":"v1","addr":"172.21.15.114:6835","nonce":22518579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T12:19:39.077734+0000","modified":"2023-10-18T12:20:01.448709+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4303":{"gid":4303,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3028221887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3028221887},{"type":"v1","addr":"172.21.15.172:6837","nonce":3028221887}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-18T12:20:14.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.001+0000 7f232cd37700 1 -- 172.21.15.114:0/2806378150 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f23080656f0 msgr2=0x7f2308067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:14.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.001+0000 7f232cd37700 1 --2- 172.21.15.114:0/2806378150 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f23080656f0 0x7f2308067bb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f23280ca1d0 tx=0x7f2310008040 comp rx=0 tx=0).stop 2023-10-18T12:20:14.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.001+0000 7f232cd37700 1 -- 172.21.15.114:0/2806378150 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f232806ce20 msgr2=0x7f2328156270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:14.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.001+0000 7f232cd37700 1 --2- 172.21.15.114:0/2806378150 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f232806ce20 0x7f2328156270 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2318004000 tx=0x7f2318004770 comp rx=0 tx=0).stop 2023-10-18T12:20:14.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.001+0000 7f232cd37700 1 -- 172.21.15.114:0/2806378150 shutdown_connections 2023-10-18T12:20:14.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.001+0000 7f232cd37700 1 --2- 172.21.15.114:0/2806378150 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f23080656f0 0x7f2308067bb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:14.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.001+0000 7f232cd37700 1 --2- 172.21.15.114:0/2806378150 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23280b3d40 0x7f2328156a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:14.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.001+0000 7f232cd37700 1 --2- 172.21.15.114:0/2806378150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2328164a20 0x7f23280c38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:14.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.001+0000 7f232cd37700 1 --2- 172.21.15.114:0/2806378150 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f232806ce20 0x7f2328156270 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:14.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.001+0000 7f232cd37700 1 -- 172.21.15.114:0/2806378150 >> 172.21.15.114:0/2806378150 conn(0x7f23280ce5c0 msgr2=0x7f23280cddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:14.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.001+0000 7f232cd37700 1 -- 172.21.15.114:0/2806378150 shutdown_connections 2023-10-18T12:20:14.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.001+0000 7f232cd37700 1 -- 172.21.15.114:0/2806378150 wait complete. 2023-10-18T12:20:14.009 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 9 2023-10-18T12:20:14.430 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-18T12:19:39.077734+0000', 'modified': '2023-10-18T12:20:01.448709+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4303}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4303': {'gid': 4303, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.172:6837/3028221887', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6836', 'nonce': 3028221887}, {'type': 'v1', 'addr': '172.21.15.172:6837', 'nonce': 3028221887}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-18T12:20:14.431 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-18T12:20:14.431 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-18T12:20:14.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.609+0000 7f29c9e45700 1 Processor -- start 2023-10-18T12:20:14.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.609+0000 7f29c9e45700 1 -- start start 2023-10-18T12:20:14.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.613+0000 7f29c9e45700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f29c4161230 0x7f29c406ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:14.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.613+0000 7f29c9e45700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29c4165770 con 0x7f29c40adb60 2023-10-18T12:20:14.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.613+0000 7f29c9e45700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29c406ea40 con 0x7f29c40cb8a0 2023-10-18T12:20:14.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.613+0000 7f29c9e45700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29c4161610 con 0x7f29c4161230 2023-10-18T12:20:14.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.613+0000 7f29bbfff700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f29c40adb60 0x7f29c40cb190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:34604/0 (socket says 172.21.15.114:34604) 2023-10-18T12:20:14.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.613+0000 7f29bbfff700 1 -- 172.21.15.114:0/121603861 learned_addr learned my addr 172.21.15.114:0/121603861 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:14.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.613+0000 7f29c37fe700 1 --2- 172.21.15.114:0/121603861 >> v2:172.21.15.114:3300/0 conn(0x7f29c4161230 0x7f29c406ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:14.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.613+0000 7f29c2ffd700 1 -- 172.21.15.114:0/121603861 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3344359976 0 0) 0x7f29c4165770 con 0x7f29c40adb60 2023-10-18T12:20:14.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.613+0000 7f29c2ffd700 1 -- 172.21.15.114:0/121603861 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29b00035d0 con 0x7f29c40adb60 2023-10-18T12:20:14.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.613+0000 7f29c2ffd700 1 -- 172.21.15.114:0/121603861 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2861980832 0 0) 0x7f29c406ea40 con 0x7f29c40cb8a0 2023-10-18T12:20:14.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.613+0000 7f29c2ffd700 1 -- 172.21.15.114:0/121603861 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29c4165770 con 0x7f29c40cb8a0 2023-10-18T12:20:14.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.613+0000 7f29c37fe700 1 -- 172.21.15.114:0/121603861 >> v1:172.21.15.172:6789/0 conn(0x7f29c40cb8a0 legacy=0x7f29c40cc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:14.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.613+0000 7f29c37fe700 1 -- 172.21.15.114:0/121603861 >> v1:172.21.15.114:6789/0 conn(0x7f29c40adb60 legacy=0x7f29c40cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:14.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.613+0000 7f29c37fe700 1 -- 172.21.15.114:0/121603861 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c4165ca0 con 0x7f29c4161230 2023-10-18T12:20:14.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.613+0000 7f29c37fe700 1 --2- 172.21.15.114:0/121603861 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29c4161230 0x7f29c406ced0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f29b4009850 tx=0x7f29b4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd74c64b253d15ea server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:14.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.613+0000 7f29c2ffd700 1 -- 172.21.15.114:0/121603861 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b4011830 con 0x7f29c4161230 2023-10-18T12:20:14.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.613+0000 7f29c2ffd700 1 -- 172.21.15.114:0/121603861 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b4011990 con 0x7f29c4161230 2023-10-18T12:20:14.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.613+0000 7f29c2ffd700 1 -- 172.21.15.114:0/121603861 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b4011d40 con 0x7f29c4161230 2023-10-18T12:20:14.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.617+0000 7f29c9e45700 1 -- 172.21.15.114:0/121603861 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29c4161230 msgr2=0x7f29c406ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:14.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.617+0000 7f29c9e45700 1 --2- 172.21.15.114:0/121603861 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29c4161230 0x7f29c406ced0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f29b4009850 tx=0x7f29b4009b60 comp rx=0 tx=0).stop 2023-10-18T12:20:14.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.617+0000 7f29c9e45700 1 -- 172.21.15.114:0/121603861 shutdown_connections 2023-10-18T12:20:14.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.617+0000 7f29c9e45700 1 --2- 172.21.15.114:0/121603861 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29c4161230 0x7f29c406ced0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:14.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.617+0000 7f29c9e45700 1 -- 172.21.15.114:0/121603861 >> 172.21.15.114:0/121603861 conn(0x7f29c406a340 msgr2=0x7f29c40b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:14.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.617+0000 7f29c9e45700 1 -- 172.21.15.114:0/121603861 shutdown_connections 2023-10-18T12:20:14.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.617+0000 7f29c9e45700 1 -- 172.21.15.114:0/121603861 wait complete. 2023-10-18T12:20:14.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.621+0000 7f29c9e45700 1 Processor -- start 2023-10-18T12:20:14.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.621+0000 7f29c9e45700 1 -- start start 2023-10-18T12:20:14.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.621+0000 7f29c9e45700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f29c40adb60 0x7f29c415d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:14.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.621+0000 7f29c9e45700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29c40cb8a0 0x7f29c40b2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:14.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.621+0000 7f29c9e45700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29c4161230 0x7f29c40b3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:14.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.621+0000 7f29c9e45700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c41607c0 con 0x7f29c40cb8a0 2023-10-18T12:20:14.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.621+0000 7f29c9e45700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c415fe20 con 0x7f29c4161230 2023-10-18T12:20:14.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.621+0000 7f29c9e45700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c4160100 con 0x7f29c40adb60 2023-10-18T12:20:14.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.621+0000 7f29bbfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29c40cb8a0 0x7f29c40b2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:14.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.621+0000 7f29bbfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29c40cb8a0 0x7f29c40b2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56934/0 (socket says 172.21.15.114:56934) 2023-10-18T12:20:14.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.621+0000 7f29bbfff700 1 -- 172.21.15.114:0/1703037050 learned_addr learned my addr 172.21.15.114:0/1703037050 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:14.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.621+0000 7f29c37fe700 1 --2- 172.21.15.114:0/1703037050 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f29c40adb60 0x7f29c415d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:14.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.621+0000 7f29c3fff700 1 --2- 172.21.15.114:0/1703037050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29c4161230 0x7f29c40b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:14.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.621+0000 7f29bbfff700 1 -- 172.21.15.114:0/1703037050 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f29c40adb60 msgr2=0x7f29c415d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:14.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.621+0000 7f29bbfff700 1 --2- 172.21.15.114:0/1703037050 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f29c40adb60 0x7f29c415d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:14.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.621+0000 7f29bbfff700 1 -- 172.21.15.114:0/1703037050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29c4161230 msgr2=0x7f29c40b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:14.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.621+0000 7f29bbfff700 1 --2- 172.21.15.114:0/1703037050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29c4161230 0x7f29c40b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:14.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.621+0000 7f29bbfff700 1 -- 172.21.15.114:0/1703037050 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b40094b0 con 0x7f29c40cb8a0 2023-10-18T12:20:14.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.621+0000 7f29c37fe700 1 --2- 172.21.15.114:0/1703037050 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f29c40adb60 0x7f29c415d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:14.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.621+0000 7f29bbfff700 1 --2- 172.21.15.114:0/1703037050 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29c40cb8a0 0x7f29c40b2b50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f29ac00c580 tx=0x7f29ac00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:14.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.625+0000 7f29c0ff9700 1 -- 172.21.15.114:0/1703037050 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac005d90 con 0x7f29c40cb8a0 2023-10-18T12:20:14.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.625+0000 7f29c0ff9700 1 -- 172.21.15.114:0/1703037050 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ac0070d0 con 0x7f29c40cb8a0 2023-10-18T12:20:14.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.625+0000 7f29c0ff9700 1 -- 172.21.15.114:0/1703037050 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac007460 con 0x7f29c40cb8a0 2023-10-18T12:20:14.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.625+0000 7f29c9e45700 1 -- 172.21.15.114:0/1703037050 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29c41603e0 con 0x7f29c40cb8a0 2023-10-18T12:20:14.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.625+0000 7f29c9e45700 1 -- 172.21.15.114:0/1703037050 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c415d600 con 0x7f29c40cb8a0 2023-10-18T12:20:14.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.625+0000 7f29c0ff9700 1 -- 172.21.15.114:0/1703037050 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f29ac0075c0 con 0x7f29c40cb8a0 2023-10-18T12:20:14.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.629+0000 7f29c0ff9700 1 --2- 172.21.15.114:0/1703037050 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f29a40656f0 0x7f29a4067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:14.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.629+0000 7f29c0ff9700 1 -- 172.21.15.114:0/1703037050 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f29ac082640 con 0x7f29c40cb8a0 2023-10-18T12:20:14.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.629+0000 7f29c37fe700 1 --2- 172.21.15.114:0/1703037050 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f29a40656f0 0x7f29a4067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:14.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.629+0000 7f29c37fe700 1 --2- 172.21.15.114:0/1703037050 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f29a40656f0 0x7f29a4067bb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f29b40090b0 tx=0x7f29b401c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:14.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.629+0000 7f29cd0e0740 1 Processor -- start 2023-10-18T12:20:14.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.629+0000 7f29cd0e0740 1 -- start start 2023-10-18T12:20:14.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.633+0000 7f29cd0e0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x132e4a0 0x132e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:14.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.633+0000 7f29cd0e0740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x1357ad0 0x1357eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:14.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.633+0000 7f29cd0e0740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1374d30 0x1375110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:14.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.633+0000 7f29cd0e0740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x12a0f90 con 0x1374d30 2023-10-18T12:20:14.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.633+0000 7f29cd0e0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x129e680 con 0x132e4a0 2023-10-18T12:20:14.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.633+0000 7f29cd0e0740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x1299f70 con 0x1357ad0 2023-10-18T12:20:14.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.633+0000 7f29c3fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1374d30 0x1375110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:14.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.633+0000 7f29c3fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1374d30 0x1375110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56942/0 (socket says 172.21.15.114:56942) 2023-10-18T12:20:14.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.633+0000 7f29c3fff700 1 -- 172.21.15.114:0/2729912909 learned_addr learned my addr 172.21.15.114:0/2729912909 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:14.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.633+0000 7f29c37fe700 1 --2- 172.21.15.114:0/2729912909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x132e4a0 0x132e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:14.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.633+0000 7f29bbfff700 1 --2- 172.21.15.114:0/2729912909 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x1357ad0 0x1357eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:14.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.633+0000 7f29c3fff700 1 -- 172.21.15.114:0/2729912909 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x1357ad0 msgr2=0x1357eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:14.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.633+0000 7f29c3fff700 1 --2- 172.21.15.114:0/2729912909 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x1357ad0 0x1357eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:14.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.633+0000 7f29c3fff700 1 -- 172.21.15.114:0/2729912909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x132e4a0 msgr2=0x132e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:14.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.633+0000 7f29c3fff700 1 --2- 172.21.15.114:0/2729912909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x132e4a0 0x132e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:14.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.633+0000 7f29c3fff700 1 -- 172.21.15.114:0/2729912909 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x12bf1a0 con 0x1374d30 2023-10-18T12:20:14.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.633+0000 7f29c37fe700 1 --2- 172.21.15.114:0/2729912909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x132e4a0 0x132e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:14.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.633+0000 7f29c3fff700 1 --2- 172.21.15.114:0/2729912909 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1374d30 0x1375110 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f29bc002140 tx=0x7f29bc00e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f4ad97618eb43fa server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:14.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.633+0000 7f29b97fa700 1 -- 172.21.15.114:0/2729912909 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc00ed20 con 0x1374d30 2023-10-18T12:20:14.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.633+0000 7f29b97fa700 1 -- 172.21.15.114:0/2729912909 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29bc00ee80 con 0x1374d30 2023-10-18T12:20:14.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.633+0000 7f29b97fa700 1 -- 172.21.15.114:0/2729912909 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc003c40 con 0x1374d30 2023-10-18T12:20:14.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.633+0000 7f29cd0e0740 1 -- 172.21.15.114:0/2729912909 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1374d30 msgr2=0x1375110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:14.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.633+0000 7f29cd0e0740 1 --2- 172.21.15.114:0/2729912909 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1374d30 0x1375110 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f29bc002140 tx=0x7f29bc00e440 comp rx=0 tx=0).stop 2023-10-18T12:20:14.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.633+0000 7f29cd0e0740 1 -- 172.21.15.114:0/2729912909 shutdown_connections 2023-10-18T12:20:14.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.633+0000 7f29cd0e0740 1 --2- 172.21.15.114:0/2729912909 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x1357ad0 0x1357eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:14.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.633+0000 7f29cd0e0740 1 --2- 172.21.15.114:0/2729912909 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1374d30 0x1375110 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:14.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.633+0000 7f29cd0e0740 1 --2- 172.21.15.114:0/2729912909 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x132e4a0 0x132e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:14.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.633+0000 7f29cd0e0740 1 -- 172.21.15.114:0/2729912909 >> 172.21.15.114:0/2729912909 conn(0x10c0550 msgr2=0x135ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:14.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.633+0000 7f29cd0e0740 1 -- 172.21.15.114:0/2729912909 shutdown_connections 2023-10-18T12:20:14.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.633+0000 7f29cd0e0740 1 -- 172.21.15.114:0/2729912909 wait complete. 2023-10-18T12:20:14.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.637+0000 7f29cd0e0740 1 -- start start 2023-10-18T12:20:14.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.637+0000 7f29cd0e0740 1 Processor -- start 2023-10-18T12:20:14.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.637+0000 7f29cd0e0740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x132e4a0 0x13322e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:14.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.637+0000 7f29cd0e0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x1357ad0 0x13782b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:14.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.637+0000 7f29cd0e0740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1374d30 0x13787f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:14.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.637+0000 7f29cd0e0740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x125ab00 con 0x1374d30 2023-10-18T12:20:14.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.637+0000 7f29cd0e0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x1259470 con 0x1357ad0 2023-10-18T12:20:14.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.637+0000 7f29cd0e0740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x1144b20 con 0x132e4a0 2023-10-18T12:20:14.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.637+0000 7f29cd0e0740 10 client.0 _ll_register_callbacks cb 0x1293810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T12:20:14.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.637+0000 7f29c3fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1374d30 0x13787f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:14.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.637+0000 7f29bbfff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x1357ad0 0x13782b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:14.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.637+0000 7f29c3fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1374d30 0x13787f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56958/0 (socket says 172.21.15.114:56958) 2023-10-18T12:20:14.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.637+0000 7f29c3fff700 1 -- 172.21.15.114:0/1316992035 learned_addr learned my addr 172.21.15.114:0/1316992035 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:14.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.637+0000 7f29c37fe700 1 --2- 172.21.15.114:0/1316992035 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x132e4a0 0x13322e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:14.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.637+0000 7f29c3fff700 1 -- 172.21.15.114:0/1316992035 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x132e4a0 msgr2=0x13322e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:14.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.637+0000 7f29c3fff700 1 --2- 172.21.15.114:0/1316992035 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x132e4a0 0x13322e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:14.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.637+0000 7f29c3fff700 1 -- 172.21.15.114:0/1316992035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x1357ad0 msgr2=0x13782b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:14.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.637+0000 7f29c3fff700 1 --2- 172.21.15.114:0/1316992035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x1357ad0 0x13782b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:14.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.637+0000 7f29c3fff700 1 -- 172.21.15.114:0/1316992035 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29bc00f040 con 0x1374d30 2023-10-18T12:20:14.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.637+0000 7f29bbfff700 1 --2- 172.21.15.114:0/1316992035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x1357ad0 0x13782b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:20:14.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.637+0000 7f29c3fff700 1 --2- 172.21.15.114:0/1316992035 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1374d30 0x13787f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f29bc001330 tx=0x7f29bc001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8526b99d4e560b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:14.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.637+0000 7f29a27fc700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T12:20:14.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.641+0000 7f29a27fc700 1 -- 172.21.15.114:0/1316992035 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc001db0 con 0x1374d30 2023-10-18T12:20:14.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.641+0000 7f29cd0e0740 1 -- 172.21.15.114:0/1316992035 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1292c70 con 0x1374d30 2023-10-18T12:20:14.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.641+0000 7f29a27fc700 1 -- 172.21.15.114:0/1316992035 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f29bc003c30 con 0x1374d30 2023-10-18T12:20:14.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.641+0000 7f29a27fc700 1 -- 172.21.15.114:0/1316992035 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f29bc003df0 con 0x1374d30 2023-10-18T12:20:14.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.641+0000 7f29cd0e0740 10 client.4887 fetch_fsmap learned FSMap version 9 2023-10-18T12:20:14.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.641+0000 7f29cd0e0740 1 -- 172.21.15.114:0/1316992035 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x110b9e0 con 0x1374d30 2023-10-18T12:20:14.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.641+0000 7f29a27fc700 1 -- 172.21.15.114:0/1316992035 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1292c70 con 0x1374d30 2023-10-18T12:20:14.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.641+0000 7f29a27fc700 1 -- 172.21.15.114:0/1316992035 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f29bc0050d0 con 0x1374d30 2023-10-18T12:20:14.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.641+0000 7f29cd0e0740 10 client.4887 fetch_fsmap finished waiting for FSMap version 9 2023-10-18T12:20:14.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.641+0000 7f29cd0e0740 10 client.4887 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-18T12:20:14.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.641+0000 7f29cd0e0740 20 client.4887 populate_metadata read hostname 'smithi114' 2023-10-18T12:20:14.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.641+0000 7f29cd0e0740 1 --2- 172.21.15.114:0/1316992035 >> [v2:172.21.15.172:6836/3028221887,v1:172.21.15.172:6837/3028221887] conn(0x1357610 0x13301f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:14.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.641+0000 7f29cd0e0740 4 client.4887 mds_command: new command op to 4303 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-18T12:20:14.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.641+0000 7f29cd0e0740 1 -- 172.21.15.114:0/1316992035 --> [v2:172.21.15.172:6836/3028221887,v1:172.21.15.172:6837/3028221887] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x11174e0 con 0x1357610 2023-10-18T12:20:14.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.641+0000 7f29c37fe700 1 --2- 172.21.15.114:0/1316992035 >> [v2:172.21.15.172:6836/3028221887,v1:172.21.15.172:6837/3028221887] conn(0x1357610 0x13301f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:14.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.641+0000 7f29a27fc700 10 client.4887 ms_handle_connect on v2:172.21.15.172:6836/3028221887 2023-10-18T12:20:14.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.641+0000 7f29c37fe700 1 --2- 172.21.15.114:0/1316992035 >> [v2:172.21.15.172:6836/3028221887,v1:172.21.15.172:6837/3028221887] conn(0x1357610 0x13301f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6f79a80b7a5c739 server_cookie=bed6b9960b0c79f3 in_seq=0 out_seq=0 2023-10-18T12:20:14.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.645+0000 7f29a27fc700 1 -- 172.21.15.114:0/1316992035 <== mds.0 v2:172.21.15.172:6836/3028221887 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x11174e0 con 0x1357610 2023-10-18T12:20:14.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.645+0000 7f29a27fc700 10 client.4887 handle_command_reply: tid=0 2023-10-18T12:20:14.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.645+0000 7f29cd0e0740 1 client.4887 shutdown 2023-10-18T12:20:14.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.645+0000 7f29cd0e0740 1 -- 172.21.15.114:0/1316992035 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1374d30 msgr2=0x13787f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:14.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.645+0000 7f29cd0e0740 1 --2- 172.21.15.114:0/1316992035 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1374d30 0x13787f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f29bc001330 tx=0x7f29bc001250 comp rx=0 tx=0).stop 2023-10-18T12:20:14.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.645+0000 7f29cd0e0740 1 -- 172.21.15.114:0/1316992035 shutdown_connections 2023-10-18T12:20:14.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.645+0000 7f29cd0e0740 1 --2- 172.21.15.114:0/1316992035 >> [v2:172.21.15.172:6836/3028221887,v1:172.21.15.172:6837/3028221887] conn(0x1357610 0x13301f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:14.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.645+0000 7f29cd0e0740 1 --2- 172.21.15.114:0/1316992035 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1374d30 0x13787f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:14.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.645+0000 7f29cd0e0740 1 --2- 172.21.15.114:0/1316992035 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x1357ad0 0x13782b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:14.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.645+0000 7f29cd0e0740 1 --2- 172.21.15.114:0/1316992035 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x132e4a0 0x13322e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:14.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.645+0000 7f29a27fc700 0 client.4887 ms_handle_reset on v2:172.21.15.172:6836/3028221887 2023-10-18T12:20:14.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.645+0000 7f29cd0e0740 1 -- 172.21.15.114:0/1316992035 >> 172.21.15.114:0/1316992035 conn(0x10c0550 msgr2=0x132d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:14.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.645+0000 7f29cd0e0740 1 -- 172.21.15.114:0/1316992035 shutdown_connections 2023-10-18T12:20:14.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.645+0000 7f29cd0e0740 1 -- 172.21.15.114:0/1316992035 wait complete. 2023-10-18T12:20:14.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.645+0000 7f29cd0e0740 20 client.4887 trim_cache size 0 max 16384 2023-10-18T12:20:14.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.665+0000 7f29cd0e0740 1 Processor -- start 2023-10-18T12:20:14.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.665+0000 7f29cd0e0740 1 -- start start 2023-10-18T12:20:14.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.665+0000 7f29cd0e0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x132e4a0 0x13301f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:14.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.665+0000 7f29cd0e0740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x1357ad0 0x1330730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:14.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.665+0000 7f29cd0e0740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1374d30 0x1359ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:14.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.665+0000 7f29cd0e0740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x123e330 con 0x1374d30 2023-10-18T12:20:14.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.665+0000 7f29cd0e0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x129df70 con 0x132e4a0 2023-10-18T12:20:14.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.665+0000 7f29cd0e0740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x12a3c30 con 0x1357ad0 2023-10-18T12:20:14.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.669+0000 7f29c3fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1374d30 0x1359ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:14.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.669+0000 7f29c3fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1374d30 0x1359ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56960/0 (socket says 172.21.15.114:56960) 2023-10-18T12:20:14.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.669+0000 7f29c3fff700 1 -- 172.21.15.114:0/239655512 learned_addr learned my addr 172.21.15.114:0/239655512 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:14.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.669+0000 7f29bbfff700 1 --2- 172.21.15.114:0/239655512 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x1357ad0 0x1330730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:14.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.669+0000 7f29c37fe700 1 --2- 172.21.15.114:0/239655512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x132e4a0 0x13301f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:14.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.669+0000 7f29bbfff700 1 -- 172.21.15.114:0/239655512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x132e4a0 msgr2=0x13301f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:14.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.669+0000 7f29bbfff700 1 --2- 172.21.15.114:0/239655512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x132e4a0 0x13301f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:14.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.669+0000 7f29bbfff700 1 -- 172.21.15.114:0/239655512 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1374d30 msgr2=0x1359ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:14.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.669+0000 7f29bbfff700 1 --2- 172.21.15.114:0/239655512 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1374d30 0x1359ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:14.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.669+0000 7f29bbfff700 1 -- 172.21.15.114:0/239655512 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c40ccc50 con 0x1357ad0 2023-10-18T12:20:14.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.669+0000 7f29c37fe700 1 --2- 172.21.15.114:0/239655512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x132e4a0 0x13301f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:14.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.669+0000 7f29c3fff700 1 --2- 172.21.15.114:0/239655512 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1374d30 0x1359ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:20:14.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.669+0000 7f29bbfff700 1 --2- 172.21.15.114:0/239655512 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x1357ad0 0x1330730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f29ac080800 tx=0x7f29ac082040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23ac2824684eae4b server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:14.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.669+0000 7f29b9ffb700 1 -- 172.21.15.114:0/239655512 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac057920 con 0x1357ad0 2023-10-18T12:20:14.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.669+0000 7f29b9ffb700 1 -- 172.21.15.114:0/239655512 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ac05b870 con 0x1357ad0 2023-10-18T12:20:14.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.669+0000 7f29b9ffb700 1 -- 172.21.15.114:0/239655512 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac057b80 con 0x1357ad0 2023-10-18T12:20:14.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.669+0000 7f29cd0e0740 1 -- 172.21.15.114:0/239655512 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x1357ad0 msgr2=0x1330730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:14.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.669+0000 7f29cd0e0740 1 --2- 172.21.15.114:0/239655512 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x1357ad0 0x1330730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f29ac080800 tx=0x7f29ac082040 comp rx=0 tx=0).stop 2023-10-18T12:20:14.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.669+0000 7f29cd0e0740 1 -- 172.21.15.114:0/239655512 shutdown_connections 2023-10-18T12:20:14.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.669+0000 7f29cd0e0740 1 --2- 172.21.15.114:0/239655512 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x1357ad0 0x1330730 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:14.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.669+0000 7f29cd0e0740 1 --2- 172.21.15.114:0/239655512 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1374d30 0x1359ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:14.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.669+0000 7f29cd0e0740 1 --2- 172.21.15.114:0/239655512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x132e4a0 0x13301f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:14.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.669+0000 7f29cd0e0740 1 -- 172.21.15.114:0/239655512 >> 172.21.15.114:0/239655512 conn(0x10c0550 msgr2=0x132ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:14.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.669+0000 7f29cd0e0740 1 -- 172.21.15.114:0/239655512 shutdown_connections 2023-10-18T12:20:14.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.669+0000 7f29cd0e0740 1 -- 172.21.15.114:0/239655512 wait complete. 2023-10-18T12:20:14.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.673+0000 7f29cd0e0740 1 -- start start 2023-10-18T12:20:14.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.673+0000 7f29cd0e0740 1 Processor -- start 2023-10-18T12:20:14.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.673+0000 7f29cd0e0740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x132e4a0 0x13c0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:14.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.673+0000 7f29cd0e0740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x1357ad0 0x13d79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:14.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.673+0000 7f29cd0e0740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x1374d30 0x138fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:14.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.673+0000 7f29cd0e0740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x1268510 con 0x132e4a0 2023-10-18T12:20:14.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.673+0000 7f29cd0e0740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x1297370 con 0x1374d30 2023-10-18T12:20:14.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.673+0000 7f29cd0e0740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x1297780 con 0x1357ad0 2023-10-18T12:20:14.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.673+0000 7f29cd0e0740 10 client.0 _ll_register_callbacks cb 0x1246120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T12:20:14.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.673+0000 7f29c37fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x132e4a0 0x13c0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:14.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.673+0000 7f29c37fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x132e4a0 0x13c0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56964/0 (socket says 172.21.15.114:56964) 2023-10-18T12:20:14.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.673+0000 7f29c37fe700 1 -- 172.21.15.114:0/3302199487 learned_addr learned my addr 172.21.15.114:0/3302199487 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:14.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.673+0000 7f29c3fff700 1 --2- 172.21.15.114:0/3302199487 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x1374d30 0x138fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:14.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.673+0000 7f29bbfff700 1 --2- 172.21.15.114:0/3302199487 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x1357ad0 0x13d79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:14.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.673+0000 7f29c37fe700 1 -- 172.21.15.114:0/3302199487 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x1357ad0 msgr2=0x13d79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:14.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.673+0000 7f29c37fe700 1 --2- 172.21.15.114:0/3302199487 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x1357ad0 0x13d79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:14.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.673+0000 7f29c37fe700 1 -- 172.21.15.114:0/3302199487 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x1374d30 msgr2=0x138fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:14.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.673+0000 7f29c37fe700 1 --2- 172.21.15.114:0/3302199487 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x1374d30 0x138fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:14.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.673+0000 7f29c37fe700 1 -- 172.21.15.114:0/3302199487 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x110b9e0 con 0x132e4a0 2023-10-18T12:20:14.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.673+0000 7f29c3fff700 1 --2- 172.21.15.114:0/3302199487 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x1374d30 0x138fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:20:14.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.673+0000 7f29c37fe700 1 --2- 172.21.15.114:0/3302199487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x132e4a0 0x13c0fc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f29b4009ba0 tx=0x7f29b400e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f797e442cbba1479 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:14.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.673+0000 7f29a27fc700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T12:20:14.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.677+0000 7f29a27fc700 1 -- 172.21.15.114:0/3302199487 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b402b040 con 0x132e4a0 2023-10-18T12:20:14.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.677+0000 7f29a27fc700 1 -- 172.21.15.114:0/3302199487 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f29b4032e20 con 0x132e4a0 2023-10-18T12:20:14.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.677+0000 7f29cd0e0740 1 -- 172.21.15.114:0/3302199487 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1333250 con 0x132e4a0 2023-10-18T12:20:14.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.677+0000 7f29a27fc700 1 -- 172.21.15.114:0/3302199487 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f29b401a880 con 0x132e4a0 2023-10-18T12:20:14.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.677+0000 7f29cd0e0740 10 client.4893 fetch_fsmap learned FSMap version 9 2023-10-18T12:20:14.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.677+0000 7f29cd0e0740 1 -- 172.21.15.114:0/3302199487 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x7f29c415d600 con 0x132e4a0 2023-10-18T12:20:14.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.677+0000 7f29a27fc700 1 -- 172.21.15.114:0/3302199487 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1333250 con 0x132e4a0 2023-10-18T12:20:14.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.677+0000 7f29a27fc700 1 -- 172.21.15.114:0/3302199487 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f29b401a9e0 con 0x132e4a0 2023-10-18T12:20:14.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.677+0000 7f29cd0e0740 10 client.4893 fetch_fsmap finished waiting for FSMap version 9 2023-10-18T12:20:14.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.677+0000 7f29cd0e0740 10 client.4893 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-18T12:20:14.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.677+0000 7f29cd0e0740 20 client.4893 populate_metadata read hostname 'smithi114' 2023-10-18T12:20:14.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.677+0000 7f29cd0e0740 1 --2- 172.21.15.114:0/3302199487 >> [v2:172.21.15.172:6836/3028221887,v1:172.21.15.172:6837/3028221887] conn(0x13df4e0 0x13e18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:14.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.677+0000 7f29cd0e0740 4 client.4893 mds_command: new command op to 4303 tid=0[{"prefix": "status"}] 2023-10-18T12:20:14.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.677+0000 7f29cd0e0740 1 -- 172.21.15.114:0/3302199487 --> [v2:172.21.15.172:6836/3028221887,v1:172.21.15.172:6837/3028221887] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1292f50 con 0x13df4e0 2023-10-18T12:20:14.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.677+0000 7f29bbfff700 1 --2- 172.21.15.114:0/3302199487 >> [v2:172.21.15.172:6836/3028221887,v1:172.21.15.172:6837/3028221887] conn(0x13df4e0 0x13e18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:14.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.677+0000 7f29a27fc700 10 client.4893 ms_handle_connect on v2:172.21.15.172:6836/3028221887 2023-10-18T12:20:14.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.677+0000 7f29bbfff700 1 --2- 172.21.15.114:0/3302199487 >> [v2:172.21.15.172:6836/3028221887,v1:172.21.15.172:6837/3028221887] conn(0x13df4e0 0x13e18d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77746a369a025a07 server_cookie=ddf66454be93f3bd in_seq=0 out_seq=0 2023-10-18T12:20:14.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.677+0000 7f29a27fc700 1 -- 172.21.15.114:0/3302199487 <== mds.0 v2:172.21.15.172:6836/3028221887 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x1292f50 con 0x13df4e0 2023-10-18T12:20:14.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.677+0000 7f29a27fc700 10 client.4893 handle_command_reply: tid=0 2023-10-18T12:20:14.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.677+0000 7f29cd0e0740 1 client.4893 shutdown 2023-10-18T12:20:14.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.677+0000 7f29cd0e0740 1 -- 172.21.15.114:0/3302199487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x132e4a0 msgr2=0x13c0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:14.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.677+0000 7f29cd0e0740 1 --2- 172.21.15.114:0/3302199487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x132e4a0 0x13c0fc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f29b4009ba0 tx=0x7f29b400e000 comp rx=0 tx=0).stop 2023-10-18T12:20:14.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.677+0000 7f29cd0e0740 1 -- 172.21.15.114:0/3302199487 shutdown_connections 2023-10-18T12:20:14.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.677+0000 7f29cd0e0740 1 --2- 172.21.15.114:0/3302199487 >> [v2:172.21.15.172:6836/3028221887,v1:172.21.15.172:6837/3028221887] conn(0x13df4e0 0x13e18d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:14.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.677+0000 7f29cd0e0740 1 --2- 172.21.15.114:0/3302199487 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x1357ad0 0x13d79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:14.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.677+0000 7f29cd0e0740 1 --2- 172.21.15.114:0/3302199487 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x1374d30 0x138fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:14.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.677+0000 7f29cd0e0740 1 --2- 172.21.15.114:0/3302199487 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x132e4a0 0x13c0fc0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:14.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.677+0000 7f29cd0e0740 1 -- 172.21.15.114:0/3302199487 >> 172.21.15.114:0/3302199487 conn(0x10c0550 msgr2=0x132ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:14.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.677+0000 7f29a27fc700 0 client.4893 ms_handle_reset on v2:172.21.15.172:6836/3028221887 2023-10-18T12:20:14.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.681+0000 7f29cd0e0740 1 -- 172.21.15.114:0/3302199487 shutdown_connections 2023-10-18T12:20:14.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.681+0000 7f29cd0e0740 1 -- 172.21.15.114:0/3302199487 wait complete. 2023-10-18T12:20:14.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.681+0000 7f29cd0e0740 20 client.4893 trim_cache size 0 max 16384 2023-10-18T12:20:14.694 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T12:20:14.695 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "240ea340-5d3d-4f52-a4bc-af075aca3deb", 2023-10-18T12:20:14.695 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 0, 2023-10-18T12:20:14.695 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4303, 2023-10-18T12:20:14.695 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2023-10-18T12:20:14.695 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2023-10-18T12:20:14.696 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2023-10-18T12:20:14.696 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 35.085676526999997, 2023-10-18T12:20:14.696 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 9, 2023-10-18T12:20:14.696 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 28, 2023-10-18T12:20:14.696 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 28, 2023-10-18T12:20:14.697 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 40.973151852000001 2023-10-18T12:20:14.697 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T12:20:14.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.681+0000 7f29c9e45700 1 -- 172.21.15.114:0/1703037050 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f29a40656f0 msgr2=0x7f29a4067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:14.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.681+0000 7f29c9e45700 1 --2- 172.21.15.114:0/1703037050 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f29a40656f0 0x7f29a4067bb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f29b40090b0 tx=0x7f29b401c040 comp rx=0 tx=0).stop 2023-10-18T12:20:14.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.681+0000 7f29c9e45700 1 -- 172.21.15.114:0/1703037050 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29c40cb8a0 msgr2=0x7f29c40b2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:14.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.681+0000 7f29c9e45700 1 --2- 172.21.15.114:0/1703037050 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29c40cb8a0 0x7f29c40b2b50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f29ac00c580 tx=0x7f29ac00c940 comp rx=0 tx=0).stop 2023-10-18T12:20:14.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.681+0000 7f29c9e45700 1 -- 172.21.15.114:0/1703037050 shutdown_connections 2023-10-18T12:20:14.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.681+0000 7f29c9e45700 1 --2- 172.21.15.114:0/1703037050 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f29a40656f0 0x7f29a4067bb0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:14.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.681+0000 7f29c9e45700 1 --2- 172.21.15.114:0/1703037050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29c4161230 0x7f29c40b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:14.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.681+0000 7f29c9e45700 1 --2- 172.21.15.114:0/1703037050 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f29c40cb8a0 0x7f29c40b2b50 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:14.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.681+0000 7f29c9e45700 1 --2- 172.21.15.114:0/1703037050 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f29c40adb60 0x7f29c415d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:14.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.681+0000 7f29c9e45700 1 -- 172.21.15.114:0/1703037050 >> 172.21.15.114:0/1703037050 conn(0x7f29c406a340 msgr2=0x7f29c406f450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:14.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.681+0000 7f29c9e45700 1 -- 172.21.15.114:0/1703037050 shutdown_connections 2023-10-18T12:20:14.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:14.681+0000 7f29c9e45700 1 -- 172.21.15.114:0/1703037050 wait complete. 2023-10-18T12:20:14.709 INFO:teuthology.run_tasks:Running task kclient... 2023-10-18T12:20:14.721 INFO:tasks.kclient:Mounting kernel clients... 2023-10-18T12:20:14.722 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-18T12:20:14.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:14.722 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2023-10-18T12:20:14.744 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-10-18T12:20:14.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:14.745 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-18T12:20:14.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:14.823 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link delete ceph-brx 2023-10-18T12:20:15.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:15.041 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2023-10-18T12:20:15.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:15.057 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link delete ceph-brx 2023-10-18T12:20:15.140 INFO:teuthology.orchestra.run.smithi114.stderr:Cannot find device "ceph-brx" 2023-10-18T12:20:15.143 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T12:20:15.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:15.144 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2023-10-18T12:20:15.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:15.163 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link delete ceph-brx 2023-10-18T12:20:15.247 INFO:teuthology.orchestra.run.smithi172.stderr:Cannot find device "ceph-brx" 2023-10-18T12:20:15.251 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T12:20:15.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:15.252 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2023-10-18T12:20:15.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:15.314 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link delete ceph-brx 2023-10-18T12:20:15.403 INFO:teuthology.orchestra.run.smithi172.stderr:Cannot find device "ceph-brx" 2023-10-18T12:20:15.405 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T12:20:15.406 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-10-18T12:20:15.406 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-18T12:20:15.406 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-18T12:20:15.407 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-18T12:20:15.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.585+0000 7f721995b700 1 Processor -- start 2023-10-18T12:20:15.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.585+0000 7f721995b700 1 -- start start 2023-10-18T12:20:15.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.589+0000 7f721995b700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f72140d28b0 0x7f721406f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:15.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.589+0000 7f721995b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f72141613c0 0x7f721406f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:15.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.589+0000 7f721995b700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f721415dea0 con 0x7f721415c9e0 2023-10-18T12:20:15.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.589+0000 7f721995b700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f721415e180 con 0x7f72140d28b0 2023-10-18T12:20:15.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.589+0000 7f721995b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7214160fa0 con 0x7f72141613c0 2023-10-18T12:20:15.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.589+0000 7f7212ffd700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f721415c9e0 0x7f72140d21a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49020/0 (socket says 172.21.15.114:49020) 2023-10-18T12:20:15.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.589+0000 7f7212ffd700 1 -- 172.21.15.114:0/437342750 learned_addr learned my addr 172.21.15.114:0/437342750 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:15.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.589+0000 7f72127fc700 1 --2- 172.21.15.114:0/437342750 >> v2:172.21.15.114:3300/0 conn(0x7f72140d28b0 0x7f721406f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:15.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.589+0000 7f7213fff700 1 --2- 172.21.15.114:0/437342750 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f72141613c0 0x7f721406f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:15.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.589+0000 7f7211ffb700 1 -- 172.21.15.114:0/437342750 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3187772087 0 0) 0x7f721415dea0 con 0x7f721415c9e0 2023-10-18T12:20:15.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.589+0000 7f7211ffb700 1 -- 172.21.15.114:0/437342750 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71fc0035d0 con 0x7f721415c9e0 2023-10-18T12:20:15.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.589+0000 7f7213fff700 1 -- 172.21.15.114:0/437342750 >> v2:172.21.15.114:3300/0 conn(0x7f72140d28b0 msgr2=0x7f721406f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:15.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.589+0000 7f7213fff700 1 --2- 172.21.15.114:0/437342750 >> v2:172.21.15.114:3300/0 conn(0x7f72140d28b0 0x7f721406f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:15.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.589+0000 7f7213fff700 1 -- 172.21.15.114:0/437342750 >> v1:172.21.15.114:6789/0 conn(0x7f721415c9e0 legacy=0x7f72140d21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:15.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.589+0000 7f7213fff700 1 -- 172.21.15.114:0/437342750 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72141608e0 con 0x7f72141613c0 2023-10-18T12:20:15.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.589+0000 7f7213fff700 1 --2- 172.21.15.114:0/437342750 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f72141613c0 0x7f721406f990 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f720c009d90 tx=0x7f720c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e5557b2b08dbc93 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:15.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.589+0000 7f7211ffb700 1 -- 172.21.15.114:0/437342750 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720c00e070 con 0x7f72141613c0 2023-10-18T12:20:15.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.593+0000 7f7211ffb700 1 -- 172.21.15.114:0/437342750 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f720c00bb20 con 0x7f72141613c0 2023-10-18T12:20:15.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.593+0000 7f7211ffb700 1 -- 172.21.15.114:0/437342750 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720c012430 con 0x7f72141613c0 2023-10-18T12:20:15.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.593+0000 7f721995b700 1 -- 172.21.15.114:0/437342750 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f72141613c0 msgr2=0x7f721406f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:15.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.593+0000 7f721995b700 1 --2- 172.21.15.114:0/437342750 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f72141613c0 0x7f721406f990 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f720c009d90 tx=0x7f720c00b330 comp rx=0 tx=0).stop 2023-10-18T12:20:15.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.593+0000 7f721995b700 1 -- 172.21.15.114:0/437342750 shutdown_connections 2023-10-18T12:20:15.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.593+0000 7f721995b700 1 --2- 172.21.15.114:0/437342750 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f72141613c0 0x7f721406f990 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:15.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.593+0000 7f721995b700 1 --2- 172.21.15.114:0/437342750 >> v2:172.21.15.114:3300/0 conn(0x7f72140d28b0 0x7f721406f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:15.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.593+0000 7f721995b700 1 -- 172.21.15.114:0/437342750 >> 172.21.15.114:0/437342750 conn(0x7f72140d0e40 msgr2=0x7f72140d1250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:15.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.593+0000 7f721995b700 1 -- 172.21.15.114:0/437342750 shutdown_connections 2023-10-18T12:20:15.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.593+0000 7f721995b700 1 -- 172.21.15.114:0/437342750 wait complete. 2023-10-18T12:20:15.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.593+0000 7f721995b700 1 Processor -- start 2023-10-18T12:20:15.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.593+0000 7f721995b700 1 -- start start 2023-10-18T12:20:15.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.597+0000 7f721995b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72140d28b0 0x7f7214157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:15.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.597+0000 7f721995b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f721415c9e0 0x7f72140ca970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:15.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.597+0000 7f721995b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72141613c0 0x7f72140b82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:15.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.597+0000 7f721995b700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72140b9710 con 0x7f72141613c0 2023-10-18T12:20:15.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.597+0000 7f721995b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72140b8b00 con 0x7f72140d28b0 2023-10-18T12:20:15.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.597+0000 7f721995b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72140b8de0 con 0x7f721415c9e0 2023-10-18T12:20:15.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.597+0000 7f7213fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72141613c0 0x7f72140b82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:15.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.597+0000 7f7213fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72141613c0 0x7f72140b82b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49576/0 (socket says 172.21.15.114:49576) 2023-10-18T12:20:15.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.597+0000 7f7213fff700 1 -- 172.21.15.114:0/2125536231 learned_addr learned my addr 172.21.15.114:0/2125536231 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:15.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.597+0000 7f7212ffd700 1 --2- 172.21.15.114:0/2125536231 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72140d28b0 0x7f7214157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:15.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.597+0000 7f72127fc700 1 --2- 172.21.15.114:0/2125536231 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f721415c9e0 0x7f72140ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:15.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.597+0000 7f72127fc700 1 -- 172.21.15.114:0/2125536231 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72140d28b0 msgr2=0x7f7214157b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:15.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.597+0000 7f72127fc700 1 --2- 172.21.15.114:0/2125536231 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72140d28b0 0x7f7214157b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:15.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.597+0000 7f72127fc700 1 -- 172.21.15.114:0/2125536231 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72141613c0 msgr2=0x7f72140b82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:15.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.597+0000 7f72127fc700 1 --2- 172.21.15.114:0/2125536231 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72141613c0 0x7f72140b82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:15.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.597+0000 7f72127fc700 1 -- 172.21.15.114:0/2125536231 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f720c009a70 con 0x7f721415c9e0 2023-10-18T12:20:15.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.597+0000 7f7213fff700 1 --2- 172.21.15.114:0/2125536231 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72141613c0 0x7f72140b82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:20:15.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.597+0000 7f72127fc700 1 --2- 172.21.15.114:0/2125536231 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f721415c9e0 0x7f72140ca970 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f720800e8d0 tx=0x7f720800ebe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:15.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.597+0000 7f71fbfff700 1 -- 172.21.15.114:0/2125536231 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7208013680 con 0x7f721415c9e0 2023-10-18T12:20:15.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.597+0000 7f71fbfff700 1 -- 172.21.15.114:0/2125536231 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72080137e0 con 0x7f721415c9e0 2023-10-18T12:20:15.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.597+0000 7f71fbfff700 1 -- 172.21.15.114:0/2125536231 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7208013b50 con 0x7f721415c9e0 2023-10-18T12:20:15.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.597+0000 7f721995b700 1 -- 172.21.15.114:0/2125536231 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72140b90c0 con 0x7f721415c9e0 2023-10-18T12:20:15.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.597+0000 7f721995b700 1 -- 172.21.15.114:0/2125536231 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72140b87f0 con 0x7f721415c9e0 2023-10-18T12:20:15.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.601+0000 7f721995b700 1 -- 172.21.15.114:0/2125536231 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72140b98c0 con 0x7f721415c9e0 2023-10-18T12:20:15.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.601+0000 7f71fbfff700 1 -- 172.21.15.114:0/2125536231 <== mon.2 v2:172.21.15.172:3301/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f7208013cb0 con 0x7f721415c9e0 2023-10-18T12:20:15.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.601+0000 7f71fbfff700 1 --2- 172.21.15.114:0/2125536231 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f72000656f0 0x7f7200067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:15.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.605+0000 7f71fbfff700 1 -- 172.21.15.114:0/2125536231 <== mon.2 v2:172.21.15.172:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7208082f80 con 0x7f721415c9e0 2023-10-18T12:20:15.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.605+0000 7f7212ffd700 1 --2- 172.21.15.114:0/2125536231 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f72000656f0 0x7f7200067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:15.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.605+0000 7f7212ffd700 1 --2- 172.21.15.114:0/2125536231 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f72000656f0 0x7f7200067bb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7204007fd0 tx=0x7f7204007de0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:15.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.613+0000 7f71fbfff700 1 -- 172.21.15.114:0/2125536231 <== mon.2 v2:172.21.15.172:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f72080541d0 con 0x7f721415c9e0 2023-10-18T12:20:15.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.949+0000 7f721995b700 1 -- 172.21.15.114:0/2125536231 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f72140b8f20 con 0x7f721415c9e0 2023-10-18T12:20:15.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.953+0000 7f71fbfff700 1 -- 172.21.15.114:0/2125536231 <== mon.2 v2:172.21.15.172:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f7208021070 con 0x7f721415c9e0 2023-10-18T12:20:15.957 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-18T12:20:15.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.957+0000 7f721995b700 1 -- 172.21.15.114:0/2125536231 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f72000656f0 msgr2=0x7f7200067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:15.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.957+0000 7f721995b700 1 --2- 172.21.15.114:0/2125536231 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f72000656f0 0x7f7200067bb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7204007fd0 tx=0x7f7204007de0 comp rx=0 tx=0).stop 2023-10-18T12:20:15.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.957+0000 7f721995b700 1 -- 172.21.15.114:0/2125536231 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f721415c9e0 msgr2=0x7f72140ca970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:15.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.957+0000 7f721995b700 1 --2- 172.21.15.114:0/2125536231 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f721415c9e0 0x7f72140ca970 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f720800e8d0 tx=0x7f720800ebe0 comp rx=0 tx=0).stop 2023-10-18T12:20:15.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.957+0000 7f721995b700 1 -- 172.21.15.114:0/2125536231 shutdown_connections 2023-10-18T12:20:15.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.957+0000 7f721995b700 1 --2- 172.21.15.114:0/2125536231 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f72000656f0 0x7f7200067bb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:15.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.957+0000 7f721995b700 1 --2- 172.21.15.114:0/2125536231 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f721415c9e0 0x7f72140ca970 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:15.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.957+0000 7f721995b700 1 --2- 172.21.15.114:0/2125536231 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f72141613c0 0x7f72140b82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:15.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.957+0000 7f721995b700 1 --2- 172.21.15.114:0/2125536231 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72140d28b0 0x7f7214157b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:15.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.957+0000 7f721995b700 1 -- 172.21.15.114:0/2125536231 >> 172.21.15.114:0/2125536231 conn(0x7f72140d0e40 msgr2=0x7f721406a470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:15.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.957+0000 7f721995b700 1 -- 172.21.15.114:0/2125536231 shutdown_connections 2023-10-18T12:20:15.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:15.957+0000 7f721995b700 1 -- 172.21.15.114:0/2125536231 wait complete. 2023-10-18T12:20:15.986 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-18T12:20:15.987 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-18T12:20:15.987 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2023-10-18T12:20:15.987 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-18T12:20:15.988 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-18T12:20:15.988 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-18T12:20:15.988 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-18T12:20:15.988 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-18T12:20:15.989 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-18T12:20:15.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:15.989 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2023-10-18T12:20:16.006 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-18T12:20:16.006 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-18T12:20:16.007 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2023-10-18T12:20:16.007 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:20:16.007 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2023-10-18T12:20:16.007 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:20:16.007 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-18T12:20:16.008 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2023-10-18T12:20:16.008 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2023-10-18T12:20:16.008 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-18T12:20:16.008 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2023-10-18T12:20:16.009 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2023-10-18T12:20:16.009 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-18T12:20:16.009 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2023-10-18T12:20:16.009 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-18T12:20:16.009 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2023-10-18T12:20:16.010 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-18T12:20:16.010 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42335sec preferred_lft 42335sec 2023-10-18T12:20:16.010 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2023-10-18T12:20:16.010 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:20:16.010 INFO:teuthology.orchestra.run.smithi114.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-18T12:20:16.011 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 02:42:85:ed:49:1d brd ff:ff:ff:ff:ff:ff 2023-10-18T12:20:16.011 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-18T12:20:16.011 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:20:16.012 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-18T12:20:16.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:16.013 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-10-18T12:20:16.013 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-10-18T12:20:16.013 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link add name ceph-brx type bridge 2023-10-18T12:20:16.013 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip addr flush dev ceph-brx 2023-10-18T12:20:16.014 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set ceph-brx up 2023-10-18T12:20:16.014 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-18T12:20:16.014 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-10-18T12:20:16.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:16.178 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-18T12:20:16.211 INFO:teuthology.orchestra.run.smithi114.stdout:1 2023-10-18T12:20:16.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:16.215 DEBUG:teuthology.orchestra.run.smithi114:> route 2023-10-18T12:20:16.274 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2023-10-18T12:20:16.274 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-18T12:20:16.275 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-18T12:20:16.275 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-18T12:20:16.275 INFO:teuthology.orchestra.run.smithi114.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-18T12:20:16.275 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-10-18T12:20:16.275 INFO:teuthology.orchestra.run.smithi114.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-18T12:20:16.276 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-18T12:20:16.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:16.277 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-10-18T12:20:16.277 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-10-18T12:20:16.277 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-18T12:20:16.278 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-18T12:20:16.278 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-18T12:20:16.278 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-10-18T12:20:16.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:16.420 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2023-10-18T12:20:16.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:16.439 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list-id 2023-10-18T12:20:16.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:16.503 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-10-18T12:20:16.504 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-10-18T12:20:16.504 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-18T12:20:16.504 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-18T12:20:16.505 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-10-18T12:20:16.620 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-18T12:20:16.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:16.621 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-10-18T12:20:16.621 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-10-18T12:20:16.622 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-18T12:20:16.622 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-18T12:20:16.622 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-18T12:20:16.622 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-18T12:20:16.623 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-18T12:20:16.623 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-10-18T12:20:16.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:16.769 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-10-18T12:20:16.769 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-10-18T12:20:16.769 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2023-10-18T12:20:16.770 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set dev brx.0 master ceph-brx 2023-10-18T12:20:16.770 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-10-18T12:20:16.841 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-18T12:20:16.841 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-18T12:20:16.856 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-18T12:20:16.857 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-18T12:20:16.857 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-18T12:20:16.918 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-18T12:20:16.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:16.919 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-18T12:20:17.055 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-18T12:20:17.055 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-18T12:20:17.056 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2023-10-18T12:20:17.228 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-18T12:20:17.228 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-18T12:20:17.229 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2023-10-18T12:20:17.229 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.172:3300,172.21.15.172:3301" 2023-10-18T12:20:17.229 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-18T12:20:17.251 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-18T12:20:17.251 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-18T12:20:17.252 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2023-10-18T12:20:17.252 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.172:3300,172.21.15.172:3301" 2023-10-18T12:20:17.252 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-18T12:20:17.252 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.172:6789,172.21.15.172:6790" 2023-10-18T12:20:17.252 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.172:6789,172.21.15.172:6790:/ 2023-10-18T12:20:17.253 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=240ea340-5d3d-4f52-a4bc-af075aca3deb" will pass to kernel 2023-10-18T12:20:17.260 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-18T12:20:17.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:17.260 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-18T12:20:17.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:17.293 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-18T12:20:17.360 INFO:teuthology.orchestra.run.smithi114.stdout:client4610 2023-10-18T12:20:17.361 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:20:17.361 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-18T12:20:17.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:17.423 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-18T12:20:17.491 INFO:teuthology.orchestra.run.smithi114.stdout:client4610 2023-10-18T12:20:17.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:17.491 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-18T12:20:17.557 INFO:teuthology.orchestra.run.smithi114.stdout:client4610 2023-10-18T12:20:17.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:17.558 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/240ea340-5d3d-4f52-a4bc-af075aca3deb.client4610/status') 2023-10-18T12:20:17.639 INFO:teuthology.orchestra.run.smithi114.stdout:instance: client.4610 (3)172.21.15.114:0/3292811408 2023-10-18T12:20:17.640 INFO:teuthology.orchestra.run.smithi114.stdout:blocklisted: false 2023-10-18T12:20:17.640 INFO:teuthology.orchestra.run.smithi114.stderr:0+1 records in 2023-10-18T12:20:17.640 INFO:teuthology.orchestra.run.smithi114.stderr:0+1 records out 2023-10-18T12:20:17.641 INFO:teuthology.orchestra.run.smithi114.stderr:71 bytes copied, 0.000153438 s, 463 kB/s 2023-10-18T12:20:17.643 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-10-18T12:20:17.643 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-18T12:20:17.644 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-18T12:20:17.644 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-18T12:20:17.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.857+0000 7fbf36c47700 1 Processor -- start 2023-10-18T12:20:17.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.861+0000 7fbf36c47700 1 -- start start 2023-10-18T12:20:17.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.861+0000 7fbf36c47700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbf300b3d40 0x7fbf300cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:17.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.861+0000 7fbf36c47700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf300ca4c0 con 0x7fbf30164a20 2023-10-18T12:20:17.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.861+0000 7fbf36c47700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf300ca7a0 con 0x7fbf3006ce20 2023-10-18T12:20:17.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.861+0000 7fbf36c47700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf3006e2d0 con 0x7fbf300b3d40 2023-10-18T12:20:17.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.865+0000 7fbf35c45700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbf300b3d40 0x7fbf300cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:17.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.865+0000 7fbf35444700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fbf30164a20 0x7fbf300c9cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49022/0 (socket says 172.21.15.114:49022) 2023-10-18T12:20:17.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.865+0000 7fbf35444700 1 -- 172.21.15.114:0/1619599645 learned_addr learned my addr 172.21.15.114:0/1619599645 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:17.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.865+0000 7fbf35c45700 1 -- 172.21.15.114:0/1619599645 >> v1:172.21.15.172:6789/0 conn(0x7fbf3006ce20 legacy=0x7fbf3006f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:17.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.865+0000 7fbf35c45700 1 -- 172.21.15.114:0/1619599645 >> v1:172.21.15.114:6789/0 conn(0x7fbf30164a20 legacy=0x7fbf300c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:17.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.865+0000 7fbf35c45700 1 -- 172.21.15.114:0/1619599645 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf300caa80 con 0x7fbf300b3d40 2023-10-18T12:20:17.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.865+0000 7fbf34c43700 1 -- 172.21.15.114:0/1619599645 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2556597592 0 0) 0x7fbf300ca4c0 con 0x7fbf30164a20 2023-10-18T12:20:17.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.865+0000 7fbf35c45700 1 --2- 172.21.15.114:0/1619599645 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf300b3d40 0x7fbf300cc190 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c009850 tx=0x7fbf2c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b58728b422e8a76c server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:17.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.865+0000 7fbf34c43700 1 -- 172.21.15.114:0/1619599645 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c004230 con 0x7fbf300b3d40 2023-10-18T12:20:17.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.865+0000 7fbf34c43700 1 -- 172.21.15.114:0/1619599645 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf2c004390 con 0x7fbf300b3d40 2023-10-18T12:20:17.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.865+0000 7fbf34c43700 1 -- 172.21.15.114:0/1619599645 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c0036c0 con 0x7fbf300b3d40 2023-10-18T12:20:17.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.865+0000 7fbf36c47700 1 -- 172.21.15.114:0/1619599645 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf300b3d40 msgr2=0x7fbf300cc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:17.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.865+0000 7fbf36c47700 1 --2- 172.21.15.114:0/1619599645 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf300b3d40 0x7fbf300cc190 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c009850 tx=0x7fbf2c009b60 comp rx=0 tx=0).stop 2023-10-18T12:20:17.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.865+0000 7fbf36c47700 1 -- 172.21.15.114:0/1619599645 shutdown_connections 2023-10-18T12:20:17.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.865+0000 7fbf36c47700 1 --2- 172.21.15.114:0/1619599645 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf300b3d40 0x7fbf300cc190 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:17.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.865+0000 7fbf36c47700 1 -- 172.21.15.114:0/1619599645 >> 172.21.15.114:0/1619599645 conn(0x7fbf300ce5c0 msgr2=0x7fbf300ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:17.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.865+0000 7fbf36c47700 1 -- 172.21.15.114:0/1619599645 shutdown_connections 2023-10-18T12:20:17.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.865+0000 7fbf36c47700 1 -- 172.21.15.114:0/1619599645 wait complete. 2023-10-18T12:20:17.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.869+0000 7fbf36c47700 1 Processor -- start 2023-10-18T12:20:17.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.869+0000 7fbf36c47700 1 -- start start 2023-10-18T12:20:17.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.873+0000 7fbf36c47700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf3006ce20 0x7fbf301583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:17.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.873+0000 7fbf36c47700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf300b3d40 0x7fbf301626c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:17.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.873+0000 7fbf36c47700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf30164a20 0x7fbf30162c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:17.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.873+0000 7fbf36c47700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf300c5690 con 0x7fbf30164a20 2023-10-18T12:20:17.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.873+0000 7fbf36c47700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf30163140 con 0x7fbf3006ce20 2023-10-18T12:20:17.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.873+0000 7fbf36c47700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf301e9cb0 con 0x7fbf300b3d40 2023-10-18T12:20:17.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.873+0000 7fbf36446700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf30164a20 0x7fbf30162c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:17.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.873+0000 7fbf36446700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf30164a20 0x7fbf30162c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49600/0 (socket says 172.21.15.114:49600) 2023-10-18T12:20:17.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.873+0000 7fbf36446700 1 -- 172.21.15.114:0/687990358 learned_addr learned my addr 172.21.15.114:0/687990358 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:17.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.873+0000 7fbf35c45700 1 --2- 172.21.15.114:0/687990358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf3006ce20 0x7fbf301583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:17.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.873+0000 7fbf35444700 1 --2- 172.21.15.114:0/687990358 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf300b3d40 0x7fbf301626c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:17.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.873+0000 7fbf36446700 1 -- 172.21.15.114:0/687990358 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf300b3d40 msgr2=0x7fbf301626c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:17.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.873+0000 7fbf36446700 1 --2- 172.21.15.114:0/687990358 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf300b3d40 0x7fbf301626c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:17.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.873+0000 7fbf36446700 1 -- 172.21.15.114:0/687990358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf3006ce20 msgr2=0x7fbf301583f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:17.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.873+0000 7fbf36446700 1 --2- 172.21.15.114:0/687990358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf3006ce20 0x7fbf301583f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:17.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.873+0000 7fbf36446700 1 -- 172.21.15.114:0/687990358 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf2c0094b0 con 0x7fbf30164a20 2023-10-18T12:20:17.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.873+0000 7fbf35c45700 1 --2- 172.21.15.114:0/687990358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf3006ce20 0x7fbf301583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:17.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.873+0000 7fbf36446700 1 --2- 172.21.15.114:0/687990358 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf30164a20 0x7fbf30162c00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fbf2800cc10 tx=0x7fbf2800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:17.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.873+0000 7fbf267fc700 1 -- 172.21.15.114:0/687990358 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2800abb0 con 0x7fbf30164a20 2023-10-18T12:20:17.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.873+0000 7fbf267fc700 1 -- 172.21.15.114:0/687990358 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf2800ad10 con 0x7fbf30164a20 2023-10-18T12:20:17.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.873+0000 7fbf267fc700 1 -- 172.21.15.114:0/687990358 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf28012660 con 0x7fbf30164a20 2023-10-18T12:20:17.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.873+0000 7fbf36c47700 1 -- 172.21.15.114:0/687990358 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf301e9f90 con 0x7fbf30164a20 2023-10-18T12:20:17.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.873+0000 7fbf36c47700 1 -- 172.21.15.114:0/687990358 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf301ea550 con 0x7fbf30164a20 2023-10-18T12:20:17.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.877+0000 7fbf36c47700 1 -- 172.21.15.114:0/687990358 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf301ea770 con 0x7fbf30164a20 2023-10-18T12:20:17.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.877+0000 7fbf267fc700 1 -- 172.21.15.114:0/687990358 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fbf280127c0 con 0x7fbf30164a20 2023-10-18T12:20:17.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.881+0000 7fbf267fc700 1 --2- 172.21.15.114:0/687990358 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fbf140656f0 0x7fbf14067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:17.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.881+0000 7fbf267fc700 1 -- 172.21.15.114:0/687990358 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbf28083860 con 0x7fbf30164a20 2023-10-18T12:20:17.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.881+0000 7fbf35c45700 1 --2- 172.21.15.114:0/687990358 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fbf140656f0 0x7fbf14067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:17.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.881+0000 7fbf35c45700 1 --2- 172.21.15.114:0/687990358 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fbf140656f0 0x7fbf14067bb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c009850 tx=0x7fbf2c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:17.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:17.885+0000 7fbf267fc700 1 -- 172.21.15.114:0/687990358 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fbf28051030 con 0x7fbf30164a20 2023-10-18T12:20:18.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:18.097+0000 7fbf36c47700 1 -- 172.21.15.114:0/687990358 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbf30072e60 con 0x7fbf30164a20 2023-10-18T12:20:18.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:18.101+0000 7fbf267fc700 1 -- 172.21.15.114:0/687990358 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fbf28016070 con 0x7fbf30164a20 2023-10-18T12:20:18.105 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-18T12:20:18.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:18.101+0000 7fbf36c47700 1 -- 172.21.15.114:0/687990358 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fbf140656f0 msgr2=0x7fbf14067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:18.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:18.101+0000 7fbf36c47700 1 --2- 172.21.15.114:0/687990358 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fbf140656f0 0x7fbf14067bb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c009850 tx=0x7fbf2c008030 comp rx=0 tx=0).stop 2023-10-18T12:20:18.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:18.101+0000 7fbf36c47700 1 -- 172.21.15.114:0/687990358 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf30164a20 msgr2=0x7fbf30162c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:18.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:18.101+0000 7fbf36c47700 1 --2- 172.21.15.114:0/687990358 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf30164a20 0x7fbf30162c00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fbf2800cc10 tx=0x7fbf2800a060 comp rx=0 tx=0).stop 2023-10-18T12:20:18.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:18.101+0000 7fbf36c47700 1 -- 172.21.15.114:0/687990358 shutdown_connections 2023-10-18T12:20:18.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:18.101+0000 7fbf36c47700 1 --2- 172.21.15.114:0/687990358 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fbf140656f0 0x7fbf14067bb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:18.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:18.101+0000 7fbf36c47700 1 --2- 172.21.15.114:0/687990358 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf300b3d40 0x7fbf301626c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:18.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:18.101+0000 7fbf36c47700 1 --2- 172.21.15.114:0/687990358 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf30164a20 0x7fbf30162c00 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:18.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:18.101+0000 7fbf36c47700 1 --2- 172.21.15.114:0/687990358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf3006ce20 0x7fbf301583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:18.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:18.101+0000 7fbf36c47700 1 -- 172.21.15.114:0/687990358 >> 172.21.15.114:0/687990358 conn(0x7fbf300ce5c0 msgr2=0x7fbf30160540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:18.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:18.105+0000 7fbf36c47700 1 -- 172.21.15.114:0/687990358 shutdown_connections 2023-10-18T12:20:18.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:18.105+0000 7fbf36c47700 1 -- 172.21.15.114:0/687990358 wait complete. 2023-10-18T12:20:18.128 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-18T12:20:18.128 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-18T12:20:18.129 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2023-10-18T12:20:18.129 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-18T12:20:18.129 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-18T12:20:18.129 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-18T12:20:18.130 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-18T12:20:18.130 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-18T12:20:18.130 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-18T12:20:18.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:18.131 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2023-10-18T12:20:18.151 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-18T12:20:18.152 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-18T12:20:18.152 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2023-10-18T12:20:18.152 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:20:18.152 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2023-10-18T12:20:18.152 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:20:18.153 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-18T12:20:18.153 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2023-10-18T12:20:18.153 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2023-10-18T12:20:18.153 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-18T12:20:18.153 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2023-10-18T12:20:18.154 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2023-10-18T12:20:18.154 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-18T12:20:18.154 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2023-10-18T12:20:18.154 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-18T12:20:18.154 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2023-10-18T12:20:18.155 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-18T12:20:18.155 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42333sec preferred_lft 42333sec 2023-10-18T12:20:18.155 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2023-10-18T12:20:18.155 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:20:18.155 INFO:teuthology.orchestra.run.smithi114.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-18T12:20:18.156 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 02:42:85:ed:49:1d brd ff:ff:ff:ff:ff:ff 2023-10-18T12:20:18.156 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-18T12:20:18.156 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:20:18.156 INFO:teuthology.orchestra.run.smithi114.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-18T12:20:18.156 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 5a:38:e4:bb:88:05 brd ff:ff:ff:ff:ff:ff 2023-10-18T12:20:18.157 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-18T12:20:18.157 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:20:18.157 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::5024:e8ff:fe3e:7146/64 scope link 2023-10-18T12:20:18.157 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:20:18.157 INFO:teuthology.orchestra.run.smithi114.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-18T12:20:18.157 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 5a:38:e4:bb:88:05 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-18T12:20:18.158 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::5838:e4ff:febb:8805/64 scope link tentative 2023-10-18T12:20:18.158 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:20:18.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:18.159 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-18T12:20:18.233 INFO:teuthology.orchestra.run.smithi114.stdout:1 2023-10-18T12:20:18.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:18.236 DEBUG:teuthology.orchestra.run.smithi114:> route 2023-10-18T12:20:18.303 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2023-10-18T12:20:18.304 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-18T12:20:18.304 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-18T12:20:18.304 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-18T12:20:18.304 INFO:teuthology.orchestra.run.smithi114.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-18T12:20:18.304 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-10-18T12:20:18.305 INFO:teuthology.orchestra.run.smithi114.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-18T12:20:18.305 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-18T12:20:18.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:18.306 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-10-18T12:20:18.307 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-10-18T12:20:18.307 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-18T12:20:18.307 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-18T12:20:18.307 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-18T12:20:18.308 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-10-18T12:20:18.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:18.439 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2023-10-18T12:20:18.456 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-18T12:20:18.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:18.458 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list-id 2023-10-18T12:20:18.516 INFO:teuthology.orchestra.run.smithi114.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-18T12:20:18.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:18.517 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-10-18T12:20:18.518 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-10-18T12:20:18.518 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-18T12:20:18.518 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-18T12:20:18.519 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-10-18T12:20:18.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:18.635 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-18T12:20:18.670 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-18T12:20:18.671 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-18T12:20:18.671 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2023-10-18T12:20:18.671 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:20:18.671 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2023-10-18T12:20:18.672 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:20:18.672 INFO:teuthology.orchestra.run.smithi114.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-18T12:20:18.672 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 9e:81:22:3f:1e:a9 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-18T12:20:18.673 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-18T12:20:18.673 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:20:18.673 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::9c81:22ff:fe3f:1ea9/64 scope link tentative 2023-10-18T12:20:18.673 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:20:18.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:18.675 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-18T12:20:18.755 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-18T12:20:18.755 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-18T12:20:18.755 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2023-10-18T12:20:18.755 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:20:18.755 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2023-10-18T12:20:18.756 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:20:18.756 INFO:teuthology.orchestra.run.smithi114.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-18T12:20:18.756 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 9e:81:22:3f:1e:a9 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-18T12:20:18.757 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-18T12:20:18.757 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:20:18.757 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::9c81:22ff:fe3f:1ea9/64 scope link 2023-10-18T12:20:18.757 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:20:18.760 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-18T12:20:18.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:18.760 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-10-18T12:20:18.761 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-10-18T12:20:18.761 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-18T12:20:18.761 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-18T12:20:18.762 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-18T12:20:18.762 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-18T12:20:18.762 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-18T12:20:18.763 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-10-18T12:20:18.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:18.949 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-10-18T12:20:18.949 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-10-18T12:20:18.950 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.1 up 2023-10-18T12:20:18.950 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set dev brx.1 master ceph-brx 2023-10-18T12:20:18.950 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-10-18T12:20:19.014 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-18T12:20:19.014 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-18T12:20:19.031 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-18T12:20:19.031 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-18T12:20:19.031 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-18T12:20:19.087 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-18T12:20:19.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:19.088 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-18T12:20:19.217 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-18T12:20:19.218 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-10-18T12:20:19.218 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2023-10-18T12:20:19.245 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-18T12:20:19.245 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-10-18T12:20:19.245 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2023-10-18T12:20:19.246 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.172:3300,172.21.15.172:3301" 2023-10-18T12:20:19.246 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-18T12:20:19.263 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-18T12:20:19.263 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-10-18T12:20:19.263 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2023-10-18T12:20:19.264 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.172:3300,172.21.15.172:3301" 2023-10-18T12:20:19.264 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-18T12:20:19.264 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.172:6789,172.21.15.172:6790" 2023-10-18T12:20:19.264 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.172:6789,172.21.15.172:6790:/ 2023-10-18T12:20:19.264 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=240ea340-5d3d-4f52-a4bc-af075aca3deb" will pass to kernel 2023-10-18T12:20:19.271 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-18T12:20:19.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:19.272 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-18T12:20:19.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:19.303 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-18T12:20:19.369 INFO:teuthology.orchestra.run.smithi114.stdout:client4798 2023-10-18T12:20:19.369 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:20:19.369 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-18T12:20:19.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:19.428 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-18T12:20:19.499 INFO:teuthology.orchestra.run.smithi114.stdout:client4798 2023-10-18T12:20:19.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:19.501 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-18T12:20:19.571 INFO:teuthology.orchestra.run.smithi114.stdout:client4798 2023-10-18T12:20:19.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:19.572 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/240ea340-5d3d-4f52-a4bc-af075aca3deb.client4798/status') 2023-10-18T12:20:19.643 INFO:teuthology.orchestra.run.smithi114.stdout:instance: client.4798 (3)172.21.15.114:0/3008517577 2023-10-18T12:20:19.643 INFO:teuthology.orchestra.run.smithi114.stdout:blocklisted: false 2023-10-18T12:20:19.644 INFO:teuthology.orchestra.run.smithi114.stderr:0+1 records in 2023-10-18T12:20:19.644 INFO:teuthology.orchestra.run.smithi114.stderr:0+1 records out 2023-10-18T12:20:19.644 INFO:teuthology.orchestra.run.smithi114.stderr:71 bytes copied, 0.000113313 s, 627 kB/s 2023-10-18T12:20:19.645 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-10-18T12:20:19.646 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-18T12:20:19.646 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-18T12:20:19.646 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-18T12:20:19.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.865+0000 7f7c21640700 1 Processor -- start 2023-10-18T12:20:19.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.865+0000 7f7c21640700 1 -- start start 2023-10-18T12:20:19.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.865+0000 7f7c21640700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7c1c15a410 0x7f7c1c15a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:19.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.869+0000 7f7c21640700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c1c071120 con 0x7f7c1c06d090 2023-10-18T12:20:19.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.869+0000 7f7c21640700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c1c15e990 con 0x7f7c1c06d470 2023-10-18T12:20:19.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.869+0000 7f7c21640700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c1c15f4f0 con 0x7f7c1c15a410 2023-10-18T12:20:19.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.869+0000 7f7c1bfff700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f7c1c06d090 0x7f7c1c0b2590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49024/0 (socket says 172.21.15.114:49024) 2023-10-18T12:20:19.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.869+0000 7f7c1bfff700 1 -- 172.21.15.114:0/1030467038 learned_addr learned my addr 172.21.15.114:0/1030467038 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:19.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.869+0000 7f7c20e3f700 1 --2- 172.21.15.114:0/1030467038 >> v2:172.21.15.114:3300/0 conn(0x7f7c1c15a410 0x7f7c1c15a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:19.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.869+0000 7f7c1b7fe700 1 -- 172.21.15.114:0/1030467038 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3243574170 0 0) 0x7f7c1c071120 con 0x7f7c1c06d090 2023-10-18T12:20:19.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.869+0000 7f7c1b7fe700 1 -- 172.21.15.114:0/1030467038 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c080035d0 con 0x7f7c1c06d090 2023-10-18T12:20:19.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.869+0000 7f7c20e3f700 1 -- 172.21.15.114:0/1030467038 >> v1:172.21.15.172:6789/0 conn(0x7f7c1c06d470 legacy=0x7f7c1c070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:19.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.869+0000 7f7c20e3f700 1 -- 172.21.15.114:0/1030467038 >> v1:172.21.15.114:6789/0 conn(0x7f7c1c06d090 legacy=0x7f7c1c0b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:19.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.869+0000 7f7c20e3f700 1 -- 172.21.15.114:0/1030467038 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c1c15ec50 con 0x7f7c1c15a410 2023-10-18T12:20:19.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.869+0000 7f7c20e3f700 1 --2- 172.21.15.114:0/1030467038 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c1c15a410 0x7f7c1c15a8c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7c14009850 tx=0x7f7c14009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a31249b37f18a90 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:19.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.869+0000 7f7c1b7fe700 1 -- 172.21.15.114:0/1030467038 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c14011830 con 0x7f7c1c15a410 2023-10-18T12:20:19.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.869+0000 7f7c1b7fe700 1 -- 172.21.15.114:0/1030467038 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c14011990 con 0x7f7c1c15a410 2023-10-18T12:20:19.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.869+0000 7f7c1b7fe700 1 -- 172.21.15.114:0/1030467038 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c14011d40 con 0x7f7c1c15a410 2023-10-18T12:20:19.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.869+0000 7f7c21640700 1 -- 172.21.15.114:0/1030467038 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c1c15a410 msgr2=0x7f7c1c15a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:19.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.869+0000 7f7c21640700 1 --2- 172.21.15.114:0/1030467038 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c1c15a410 0x7f7c1c15a8c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7c14009850 tx=0x7f7c14009b60 comp rx=0 tx=0).stop 2023-10-18T12:20:19.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.869+0000 7f7c21640700 1 -- 172.21.15.114:0/1030467038 shutdown_connections 2023-10-18T12:20:19.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.869+0000 7f7c21640700 1 --2- 172.21.15.114:0/1030467038 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c1c15a410 0x7f7c1c15a8c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:19.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.869+0000 7f7c21640700 1 -- 172.21.15.114:0/1030467038 >> 172.21.15.114:0/1030467038 conn(0x7f7c1c0ce5c0 msgr2=0x7f7c1c0ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:19.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.873+0000 7f7c21640700 1 -- 172.21.15.114:0/1030467038 shutdown_connections 2023-10-18T12:20:19.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.873+0000 7f7c21640700 1 -- 172.21.15.114:0/1030467038 wait complete. 2023-10-18T12:20:19.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.873+0000 7f7c21640700 1 Processor -- start 2023-10-18T12:20:19.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.873+0000 7f7c21640700 1 -- start start 2023-10-18T12:20:19.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.877+0000 7f7c21640700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c1c06d090 0x7f7c1c0c3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:19.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.877+0000 7f7c21640700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7c1c06d470 0x7f7c1c144490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:19.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.877+0000 7f7c21640700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c1c15a410 0x7f7c1c1449d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:19.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.877+0000 7f7c21640700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1c144f10 con 0x7f7c1c06d090 2023-10-18T12:20:19.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.877+0000 7f7c21640700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1c1f12d0 con 0x7f7c1c15a410 2023-10-18T12:20:19.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.877+0000 7f7c21640700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1c158d40 con 0x7f7c1c06d470 2023-10-18T12:20:19.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.877+0000 7f7c1bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c1c06d090 0x7f7c1c0c3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:19.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.877+0000 7f7c1bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c1c06d090 0x7f7c1c0c3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49608/0 (socket says 172.21.15.114:49608) 2023-10-18T12:20:19.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.877+0000 7f7c1bfff700 1 -- 172.21.15.114:0/1987005883 learned_addr learned my addr 172.21.15.114:0/1987005883 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:19.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.877+0000 7f7c137fe700 1 --2- 172.21.15.114:0/1987005883 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7c1c06d470 0x7f7c1c144490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:19.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.877+0000 7f7c20e3f700 1 --2- 172.21.15.114:0/1987005883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c1c15a410 0x7f7c1c1449d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:19.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.877+0000 7f7c1bfff700 1 -- 172.21.15.114:0/1987005883 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7c1c06d470 msgr2=0x7f7c1c144490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:19.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.877+0000 7f7c1bfff700 1 --2- 172.21.15.114:0/1987005883 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7c1c06d470 0x7f7c1c144490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:19.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.877+0000 7f7c1bfff700 1 -- 172.21.15.114:0/1987005883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c1c15a410 msgr2=0x7f7c1c1449d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:19.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.877+0000 7f7c1bfff700 1 --2- 172.21.15.114:0/1987005883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c1c15a410 0x7f7c1c1449d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:19.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.877+0000 7f7c1bfff700 1 -- 172.21.15.114:0/1987005883 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c140094b0 con 0x7f7c1c06d090 2023-10-18T12:20:19.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.877+0000 7f7c1bfff700 1 --2- 172.21.15.114:0/1987005883 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c1c06d090 0x7f7c1c0c3b30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c00cbc0 tx=0x7f7c0c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:19.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.877+0000 7f7c197fa700 1 -- 172.21.15.114:0/1987005883 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c00a9e0 con 0x7f7c1c06d090 2023-10-18T12:20:19.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.877+0000 7f7c197fa700 1 -- 172.21.15.114:0/1987005883 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0c00ab40 con 0x7f7c1c06d090 2023-10-18T12:20:19.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.877+0000 7f7c197fa700 1 -- 172.21.15.114:0/1987005883 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c00ce80 con 0x7f7c1c06d090 2023-10-18T12:20:19.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.877+0000 7f7c21640700 1 -- 172.21.15.114:0/1987005883 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c1c145330 con 0x7f7c1c06d090 2023-10-18T12:20:19.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.877+0000 7f7c21640700 1 -- 172.21.15.114:0/1987005883 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c1c1458f0 con 0x7f7c1c06d090 2023-10-18T12:20:19.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.881+0000 7f7c21640700 1 -- 172.21.15.114:0/1987005883 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c1c145190 con 0x7f7c1c06d090 2023-10-18T12:20:19.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.881+0000 7f7c197fa700 1 -- 172.21.15.114:0/1987005883 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f7c0c01b3b0 con 0x7f7c1c06d090 2023-10-18T12:20:19.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.881+0000 7f7c197fa700 1 --2- 172.21.15.114:0/1987005883 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7bfc0656f0 0x7f7bfc067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:19.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.885+0000 7f7c197fa700 1 -- 172.21.15.114:0/1987005883 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7c0c082b80 con 0x7f7c1c06d090 2023-10-18T12:20:19.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.885+0000 7f7c137fe700 1 --2- 172.21.15.114:0/1987005883 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7bfc0656f0 0x7f7bfc067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:19.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.885+0000 7f7c137fe700 1 --2- 172.21.15.114:0/1987005883 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7bfc0656f0 0x7f7bfc067bb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c071580 tx=0x7f7c04009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:19.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:19.889+0000 7f7c197fa700 1 -- 172.21.15.114:0/1987005883 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f7c1c145190 con 0x7f7c1c06d090 2023-10-18T12:20:20.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:20.109+0000 7f7c21640700 1 -- 172.21.15.114:0/1987005883 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7c1c145190 con 0x7f7c1c06d090 2023-10-18T12:20:20.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:20.109+0000 7f7c197fa700 1 -- 172.21.15.114:0/1987005883 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f7c1c145190 con 0x7f7c1c06d090 2023-10-18T12:20:20.116 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-18T12:20:20.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:20.113+0000 7f7c21640700 1 -- 172.21.15.114:0/1987005883 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7bfc0656f0 msgr2=0x7f7bfc067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:20.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:20.113+0000 7f7c21640700 1 --2- 172.21.15.114:0/1987005883 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7bfc0656f0 0x7f7bfc067bb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c071580 tx=0x7f7c04009040 comp rx=0 tx=0).stop 2023-10-18T12:20:20.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:20.113+0000 7f7c21640700 1 -- 172.21.15.114:0/1987005883 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c1c06d090 msgr2=0x7f7c1c0c3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:20.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:20.113+0000 7f7c21640700 1 --2- 172.21.15.114:0/1987005883 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c1c06d090 0x7f7c1c0c3b30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c00cbc0 tx=0x7f7c0c00cca0 comp rx=0 tx=0).stop 2023-10-18T12:20:20.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:20.113+0000 7f7c21640700 1 -- 172.21.15.114:0/1987005883 shutdown_connections 2023-10-18T12:20:20.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:20.113+0000 7f7c21640700 1 --2- 172.21.15.114:0/1987005883 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7bfc0656f0 0x7f7bfc067bb0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:20.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:20.113+0000 7f7c21640700 1 --2- 172.21.15.114:0/1987005883 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7c1c06d470 0x7f7c1c144490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:20.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:20.113+0000 7f7c21640700 1 --2- 172.21.15.114:0/1987005883 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c1c15a410 0x7f7c1c1449d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:20.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:20.113+0000 7f7c21640700 1 --2- 172.21.15.114:0/1987005883 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7c1c06d090 0x7f7c1c0c3b30 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:20.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:20.113+0000 7f7c21640700 1 -- 172.21.15.114:0/1987005883 >> 172.21.15.114:0/1987005883 conn(0x7f7c1c0ce5c0 msgr2=0x7f7c1c0b37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:20.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:20.113+0000 7f7c21640700 1 -- 172.21.15.114:0/1987005883 shutdown_connections 2023-10-18T12:20:20.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:20.113+0000 7f7c21640700 1 -- 172.21.15.114:0/1987005883 wait complete. 2023-10-18T12:20:20.137 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-18T12:20:20.138 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-18T12:20:20.138 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi172.front.sepia.ceph.com 2023-10-18T12:20:20.138 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-18T12:20:20.138 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-18T12:20:20.139 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-18T12:20:20.139 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-18T12:20:20.139 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-18T12:20:20.139 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-18T12:20:20.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:20.140 DEBUG:teuthology.orchestra.run.smithi172:> ip addr 2023-10-18T12:20:20.160 INFO:teuthology.orchestra.run.smithi172.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-18T12:20:20.160 INFO:teuthology.orchestra.run.smithi172.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-18T12:20:20.160 INFO:teuthology.orchestra.run.smithi172.stdout: inet 127.0.0.1/8 scope host lo 2023-10-18T12:20:20.160 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:20:20.161 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 ::1/128 scope host 2023-10-18T12:20:20.161 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:20:20.161 INFO:teuthology.orchestra.run.smithi172.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-18T12:20:20.161 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2c brd ff:ff:ff:ff:ff:ff 2023-10-18T12:20:20.161 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f0 2023-10-18T12:20:20.161 INFO:teuthology.orchestra.run.smithi172.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-18T12:20:20.162 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2d brd ff:ff:ff:ff:ff:ff 2023-10-18T12:20:20.162 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f1 2023-10-18T12:20:20.162 INFO:teuthology.orchestra.run.smithi172.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-18T12:20:20.162 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:90 brd ff:ff:ff:ff:ff:ff 2023-10-18T12:20:20.162 INFO:teuthology.orchestra.run.smithi172.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-18T12:20:20.163 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:91 brd ff:ff:ff:ff:ff:ff 2023-10-18T12:20:20.163 INFO:teuthology.orchestra.run.smithi172.stdout: inet 172.21.15.172/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-18T12:20:20.163 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft 42366sec preferred_lft 42366sec 2023-10-18T12:20:20.163 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::ec4:7aff:fe88:7f91/64 scope link 2023-10-18T12:20:20.163 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:20:20.163 INFO:teuthology.orchestra.run.smithi172.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-18T12:20:20.164 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 02:42:7e:42:a3:79 brd ff:ff:ff:ff:ff:ff 2023-10-18T12:20:20.164 INFO:teuthology.orchestra.run.smithi172.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-18T12:20:20.164 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:20:20.165 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-18T12:20:20.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:20.166 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2023-10-18T12:20:20.166 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2023-10-18T12:20:20.166 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link add name ceph-brx type bridge 2023-10-18T12:20:20.166 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip addr flush dev ceph-brx 2023-10-18T12:20:20.167 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set ceph-brx up 2023-10-18T12:20:20.167 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-18T12:20:20.167 DEBUG:teuthology.orchestra.run.smithi172:> ') 2023-10-18T12:20:20.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:20.324 DEBUG:teuthology.orchestra.run.smithi172:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-18T12:20:20.362 INFO:teuthology.orchestra.run.smithi172.stdout:1 2023-10-18T12:20:20.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:20.365 DEBUG:teuthology.orchestra.run.smithi172:> route 2023-10-18T12:20:20.449 INFO:teuthology.orchestra.run.smithi172.stdout:Kernel IP routing table 2023-10-18T12:20:20.449 INFO:teuthology.orchestra.run.smithi172.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-18T12:20:20.450 INFO:teuthology.orchestra.run.smithi172.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-18T12:20:20.450 INFO:teuthology.orchestra.run.smithi172.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-18T12:20:20.450 INFO:teuthology.orchestra.run.smithi172.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-18T12:20:20.450 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-10-18T12:20:20.451 INFO:teuthology.orchestra.run.smithi172.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-18T12:20:20.451 INFO:teuthology.orchestra.run.smithi172.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-18T12:20:20.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:20.452 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2023-10-18T12:20:20.453 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2023-10-18T12:20:20.453 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-18T12:20:20.453 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-18T12:20:20.453 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-18T12:20:20.454 DEBUG:teuthology.orchestra.run.smithi172:> ') 2023-10-18T12:20:20.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:20.591 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2023-10-18T12:20:20.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:20.611 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list-id 2023-10-18T12:20:20.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:20.675 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2023-10-18T12:20:20.675 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2023-10-18T12:20:20.676 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-18T12:20:20.676 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-18T12:20:20.676 DEBUG:teuthology.orchestra.run.smithi172:> ') 2023-10-18T12:20:20.789 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-18T12:20:20.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:20.789 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2023-10-18T12:20:20.790 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2023-10-18T12:20:20.790 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-18T12:20:20.790 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-18T12:20:20.791 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-18T12:20:20.791 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-18T12:20:20.791 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-18T12:20:20.792 DEBUG:teuthology.orchestra.run.smithi172:> ') 2023-10-18T12:20:20.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:20.970 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2023-10-18T12:20:20.970 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2023-10-18T12:20:20.970 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set brx.0 up 2023-10-18T12:20:20.971 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set dev brx.0 master ceph-brx 2023-10-18T12:20:20.971 DEBUG:teuthology.orchestra.run.smithi172:> ') 2023-10-18T12:20:21.039 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-18T12:20:21.039 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-18T12:20:21.053 INFO:teuthology.orchestra.run.smithi172.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-18T12:20:21.054 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-18T12:20:21.054 DEBUG:teuthology.orchestra.run.smithi172:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-18T12:20:21.113 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-18T12:20:21.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:21.113 DEBUG:teuthology.orchestra.run.smithi172:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-18T12:20:21.249 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-18T12:20:21.250 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-18T12:20:21.250 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2023-10-18T12:20:21.386 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-18T12:20:21.386 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-18T12:20:21.386 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2023-10-18T12:20:21.386 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.172:3300,172.21.15.172:3301" 2023-10-18T12:20:21.387 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-18T12:20:21.409 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-18T12:20:21.409 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-18T12:20:21.409 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2023-10-18T12:20:21.410 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.172:3300,172.21.15.172:3301" 2023-10-18T12:20:21.410 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-18T12:20:21.410 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.172:6789,172.21.15.172:6790" 2023-10-18T12:20:21.410 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.172:6789,172.21.15.172:6790:/ 2023-10-18T12:20:21.410 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=240ea340-5d3d-4f52-a4bc-af075aca3deb" will pass to kernel 2023-10-18T12:20:21.415 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-18T12:20:21.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:21.416 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-18T12:20:21.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:21.448 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-18T12:20:21.528 INFO:teuthology.orchestra.run.smithi172.stdout:client4923 2023-10-18T12:20:21.529 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T12:20:21.529 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-18T12:20:21.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:21.593 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-18T12:20:21.663 INFO:teuthology.orchestra.run.smithi172.stdout:client4923 2023-10-18T12:20:21.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:21.663 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-18T12:20:21.735 INFO:teuthology.orchestra.run.smithi172.stdout:client4923 2023-10-18T12:20:21.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:21.735 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/240ea340-5d3d-4f52-a4bc-af075aca3deb.client4923/status') 2023-10-18T12:20:21.813 INFO:teuthology.orchestra.run.smithi172.stdout:instance: client.4923 (3)172.21.15.172:0/3661515437 2023-10-18T12:20:21.814 INFO:teuthology.orchestra.run.smithi172.stdout:blocklisted: false 2023-10-18T12:20:21.814 INFO:teuthology.orchestra.run.smithi172.stderr:0+1 records in 2023-10-18T12:20:21.814 INFO:teuthology.orchestra.run.smithi172.stderr:0+1 records out 2023-10-18T12:20:21.815 INFO:teuthology.orchestra.run.smithi172.stderr:71 bytes copied, 0.000200366 s, 354 kB/s 2023-10-18T12:20:21.816 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-10-18T12:20:21.817 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-18T12:20:21.817 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-18T12:20:21.817 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-18T12:20:22.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.001+0000 7f35d1462700 1 Processor -- start 2023-10-18T12:20:22.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.001+0000 7f35d1462700 1 -- start start 2023-10-18T12:20:22.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.005+0000 7f35d1462700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f35cc15cc10 0x7f35cc070a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:22.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.005+0000 7f35d1462700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35cc0b1e60 0x7f35cc0cfd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:22.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.005+0000 7f35d1462700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f35cc0d2f20 0x7f35cc0d3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:22.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.005+0000 7f35d1462700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35cc06eef0 con 0x7f35cc0d2f20 2023-10-18T12:20:22.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.005+0000 7f35d1462700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35cc0d38d0 con 0x7f35cc15cc10 2023-10-18T12:20:22.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.005+0000 7f35d1462700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc06d220 con 0x7f35cc0b1e60 2023-10-18T12:20:22.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.005+0000 7f35cb7fe700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f35cc0d2f20 0x7f35cc0d3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:22.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.005+0000 7f35caffd700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f35cc15cc10 0x7f35cc070a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:22.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.005+0000 7f35caffd700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f35cc15cc10 0x7f35cc070a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:43696/0 (socket says 172.21.15.114:43696) 2023-10-18T12:20:22.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.005+0000 7f35caffd700 1 -- 172.21.15.114:0/3708235130 learned_addr learned my addr 172.21.15.114:0/3708235130 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:22.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.005+0000 7f35ca7fc700 1 --2- 172.21.15.114:0/3708235130 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35cc0b1e60 0x7f35cc0cfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:22.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.005+0000 7f35caffd700 1 -- 172.21.15.114:0/3708235130 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35cc0b1e60 msgr2=0x7f35cc0cfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:22.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.005+0000 7f35caffd700 1 --2- 172.21.15.114:0/3708235130 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35cc0b1e60 0x7f35cc0cfd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:22.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.005+0000 7f35caffd700 1 -- 172.21.15.114:0/3708235130 >> v2:172.21.15.114:3300/0 conn(0x7f35cc0d2f20 msgr2=0x7f35cc0d3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:22.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.005+0000 7f35caffd700 1 --2- 172.21.15.114:0/3708235130 >> v2:172.21.15.114:3300/0 conn(0x7f35cc0d2f20 0x7f35cc0d3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:22.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.005+0000 7f35caffd700 1 -- 172.21.15.114:0/3708235130 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35cc06ec10 con 0x7f35cc15cc10 2023-10-18T12:20:22.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.009+0000 7f35caffd700 1 --2- 172.21.15.114:0/3708235130 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35cc15cc10 0x7f35cc070a00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f35cc06f700 tx=0x7f35bc009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a75dda3d67d49ca server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:22.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.009+0000 7f35c9ffb700 1 -- 172.21.15.114:0/3708235130 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35bc011830 con 0x7f35cc15cc10 2023-10-18T12:20:22.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.009+0000 7f35c9ffb700 1 -- 172.21.15.114:0/3708235130 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35bc011990 con 0x7f35cc15cc10 2023-10-18T12:20:22.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.009+0000 7f35c9ffb700 1 -- 172.21.15.114:0/3708235130 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35bc011d20 con 0x7f35cc15cc10 2023-10-18T12:20:22.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.009+0000 7f35d1462700 1 -- 172.21.15.114:0/3708235130 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35cc15cc10 msgr2=0x7f35cc070a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:22.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.009+0000 7f35d1462700 1 --2- 172.21.15.114:0/3708235130 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35cc15cc10 0x7f35cc070a00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f35cc06f700 tx=0x7f35bc009bf0 comp rx=0 tx=0).stop 2023-10-18T12:20:22.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.009+0000 7f35d1462700 1 -- 172.21.15.114:0/3708235130 shutdown_connections 2023-10-18T12:20:22.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.009+0000 7f35d1462700 1 --2- 172.21.15.114:0/3708235130 >> v2:172.21.15.114:3300/0 conn(0x7f35cc0d2f20 0x7f35cc0d3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:22.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.009+0000 7f35d1462700 1 --2- 172.21.15.114:0/3708235130 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35cc0b1e60 0x7f35cc0cfd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:22.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.009+0000 7f35d1462700 1 --2- 172.21.15.114:0/3708235130 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35cc15cc10 0x7f35cc070a00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:22.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.009+0000 7f35d1462700 1 -- 172.21.15.114:0/3708235130 >> 172.21.15.114:0/3708235130 conn(0x7f35cc069ef0 msgr2=0x7f35cc06a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:22.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.009+0000 7f35d1462700 1 -- 172.21.15.114:0/3708235130 shutdown_connections 2023-10-18T12:20:22.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.009+0000 7f35d1462700 1 -- 172.21.15.114:0/3708235130 wait complete. 2023-10-18T12:20:22.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.013+0000 7f35d1462700 1 Processor -- start 2023-10-18T12:20:22.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.013+0000 7f35d1462700 1 -- start start 2023-10-18T12:20:22.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.013+0000 7f35d1462700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35cc0b1e60 0x7f35cc15faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:22.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.013+0000 7f35d1462700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35cc0d2f20 0x7f35cc153850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:22.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.013+0000 7f35d1462700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35cc15cc10 0x7f35cc1f5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:22.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.013+0000 7f35d1462700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc160cd0 con 0x7f35cc0d2f20 2023-10-18T12:20:22.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.013+0000 7f35d1462700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc15ffe0 con 0x7f35cc0b1e60 2023-10-18T12:20:22.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.013+0000 7f35d1462700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc15e590 con 0x7f35cc15cc10 2023-10-18T12:20:22.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.013+0000 7f35ca7fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35cc0d2f20 0x7f35cc153850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:22.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.013+0000 7f35ca7fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35cc0d2f20 0x7f35cc153850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49628/0 (socket says 172.21.15.114:49628) 2023-10-18T12:20:22.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.013+0000 7f35ca7fc700 1 -- 172.21.15.114:0/2762854724 learned_addr learned my addr 172.21.15.114:0/2762854724 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:22.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.013+0000 7f35caffd700 1 --2- 172.21.15.114:0/2762854724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35cc0b1e60 0x7f35cc15faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:22.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.013+0000 7f35cb7fe700 1 --2- 172.21.15.114:0/2762854724 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35cc15cc10 0x7f35cc1f5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:22.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.013+0000 7f35ca7fc700 1 -- 172.21.15.114:0/2762854724 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35cc15cc10 msgr2=0x7f35cc1f5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:22.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.013+0000 7f35ca7fc700 1 --2- 172.21.15.114:0/2762854724 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35cc15cc10 0x7f35cc1f5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:22.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.013+0000 7f35ca7fc700 1 -- 172.21.15.114:0/2762854724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35cc0b1e60 msgr2=0x7f35cc15faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:22.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.013+0000 7f35ca7fc700 1 --2- 172.21.15.114:0/2762854724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35cc0b1e60 0x7f35cc15faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:22.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.013+0000 7f35ca7fc700 1 -- 172.21.15.114:0/2762854724 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35bc009570 con 0x7f35cc0d2f20 2023-10-18T12:20:22.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.013+0000 7f35ca7fc700 1 --2- 172.21.15.114:0/2762854724 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35cc0d2f20 0x7f35cc153850 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f35c000e9a0 tx=0x7f35c000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:22.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.017+0000 7f35b37fe700 1 -- 172.21.15.114:0/2762854724 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c0009720 con 0x7f35cc0d2f20 2023-10-18T12:20:22.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.017+0000 7f35b37fe700 1 -- 172.21.15.114:0/2762854724 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c000c850 con 0x7f35cc0d2f20 2023-10-18T12:20:22.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.017+0000 7f35b37fe700 1 -- 172.21.15.114:0/2762854724 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c000cc00 con 0x7f35cc0d2f20 2023-10-18T12:20:22.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.017+0000 7f35d1462700 1 -- 172.21.15.114:0/2762854724 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35cc1f6880 con 0x7f35cc0d2f20 2023-10-18T12:20:22.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.017+0000 7f35d1462700 1 -- 172.21.15.114:0/2762854724 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35cc15d7d0 con 0x7f35cc0d2f20 2023-10-18T12:20:22.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.017+0000 7f35d1462700 1 -- 172.21.15.114:0/2762854724 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35cc15e280 con 0x7f35cc0d2f20 2023-10-18T12:20:22.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.017+0000 7f35b37fe700 1 -- 172.21.15.114:0/2762854724 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f35c0013470 con 0x7f35cc0d2f20 2023-10-18T12:20:22.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.021+0000 7f35b37fe700 1 --2- 172.21.15.114:0/2762854724 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f35b8065720 0x7f35b8067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:22.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.021+0000 7f35b37fe700 1 -- 172.21.15.114:0/2762854724 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f35c0083160 con 0x7f35cc0d2f20 2023-10-18T12:20:22.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.021+0000 7f35caffd700 1 --2- 172.21.15.114:0/2762854724 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f35b8065720 0x7f35b8067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:22.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.021+0000 7f35caffd700 1 --2- 172.21.15.114:0/2762854724 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f35b8065720 0x7f35b8067be0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f35bc014040 tx=0x7f35bc008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:22.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.029+0000 7f35b37fe700 1 -- 172.21.15.114:0/2762854724 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f35c00508e0 con 0x7f35cc0d2f20 2023-10-18T12:20:22.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.325+0000 7f35d1462700 1 -- 172.21.15.114:0/2762854724 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f35cc072e60 con 0x7f35cc0d2f20 2023-10-18T12:20:22.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.325+0000 7f35b37fe700 1 -- 172.21.15.114:0/2762854724 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f35c0053f00 con 0x7f35cc0d2f20 2023-10-18T12:20:22.332 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-18T12:20:22.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.329+0000 7f35d1462700 1 -- 172.21.15.114:0/2762854724 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f35b8065720 msgr2=0x7f35b8067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:22.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.329+0000 7f35d1462700 1 --2- 172.21.15.114:0/2762854724 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f35b8065720 0x7f35b8067be0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f35bc014040 tx=0x7f35bc008030 comp rx=0 tx=0).stop 2023-10-18T12:20:22.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.329+0000 7f35d1462700 1 -- 172.21.15.114:0/2762854724 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35cc0d2f20 msgr2=0x7f35cc153850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:22.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.329+0000 7f35d1462700 1 --2- 172.21.15.114:0/2762854724 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35cc0d2f20 0x7f35cc153850 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f35c000e9a0 tx=0x7f35c000ecb0 comp rx=0 tx=0).stop 2023-10-18T12:20:22.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.329+0000 7f35d1462700 1 -- 172.21.15.114:0/2762854724 shutdown_connections 2023-10-18T12:20:22.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.329+0000 7f35d1462700 1 --2- 172.21.15.114:0/2762854724 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f35b8065720 0x7f35b8067be0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:22.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.329+0000 7f35d1462700 1 --2- 172.21.15.114:0/2762854724 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35cc15cc10 0x7f35cc1f5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:22.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.329+0000 7f35d1462700 1 --2- 172.21.15.114:0/2762854724 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35cc0d2f20 0x7f35cc153850 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:22.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.329+0000 7f35d1462700 1 --2- 172.21.15.114:0/2762854724 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f35cc0b1e60 0x7f35cc15faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:22.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.329+0000 7f35d1462700 1 -- 172.21.15.114:0/2762854724 >> 172.21.15.114:0/2762854724 conn(0x7f35cc069ef0 msgr2=0x7f35cc1570b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:22.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.329+0000 7f35d1462700 1 -- 172.21.15.114:0/2762854724 shutdown_connections 2023-10-18T12:20:22.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:22.329+0000 7f35d1462700 1 -- 172.21.15.114:0/2762854724 wait complete. 2023-10-18T12:20:22.358 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-18T12:20:22.358 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-18T12:20:22.358 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi172.front.sepia.ceph.com 2023-10-18T12:20:22.359 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-18T12:20:22.359 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-18T12:20:22.359 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-18T12:20:22.359 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-18T12:20:22.360 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-18T12:20:22.360 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-18T12:20:22.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:22.361 DEBUG:teuthology.orchestra.run.smithi172:> ip addr 2023-10-18T12:20:22.381 INFO:teuthology.orchestra.run.smithi172.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-18T12:20:22.381 INFO:teuthology.orchestra.run.smithi172.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-18T12:20:22.381 INFO:teuthology.orchestra.run.smithi172.stdout: inet 127.0.0.1/8 scope host lo 2023-10-18T12:20:22.381 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:20:22.381 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 ::1/128 scope host 2023-10-18T12:20:22.382 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:20:22.382 INFO:teuthology.orchestra.run.smithi172.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-18T12:20:22.382 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2c brd ff:ff:ff:ff:ff:ff 2023-10-18T12:20:22.382 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f0 2023-10-18T12:20:22.382 INFO:teuthology.orchestra.run.smithi172.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-18T12:20:22.383 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2d brd ff:ff:ff:ff:ff:ff 2023-10-18T12:20:22.383 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f1 2023-10-18T12:20:22.383 INFO:teuthology.orchestra.run.smithi172.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-18T12:20:22.383 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:90 brd ff:ff:ff:ff:ff:ff 2023-10-18T12:20:22.383 INFO:teuthology.orchestra.run.smithi172.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-18T12:20:22.384 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:91 brd ff:ff:ff:ff:ff:ff 2023-10-18T12:20:22.384 INFO:teuthology.orchestra.run.smithi172.stdout: inet 172.21.15.172/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-18T12:20:22.384 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft 42364sec preferred_lft 42364sec 2023-10-18T12:20:22.384 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::ec4:7aff:fe88:7f91/64 scope link 2023-10-18T12:20:22.384 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:20:22.385 INFO:teuthology.orchestra.run.smithi172.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-18T12:20:22.385 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 02:42:7e:42:a3:79 brd ff:ff:ff:ff:ff:ff 2023-10-18T12:20:22.385 INFO:teuthology.orchestra.run.smithi172.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-18T12:20:22.385 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:20:22.385 INFO:teuthology.orchestra.run.smithi172.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-18T12:20:22.385 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 3e:d2:94:94:36:e0 brd ff:ff:ff:ff:ff:ff 2023-10-18T12:20:22.386 INFO:teuthology.orchestra.run.smithi172.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-18T12:20:22.386 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:20:22.386 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::78dc:e9ff:fe72:37d5/64 scope link 2023-10-18T12:20:22.386 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:20:22.386 INFO:teuthology.orchestra.run.smithi172.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-18T12:20:22.387 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 3e:d2:94:94:36:e0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-18T12:20:22.387 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::3cd2:94ff:fe94:36e0/64 scope link 2023-10-18T12:20:22.387 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:20:22.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:22.388 DEBUG:teuthology.orchestra.run.smithi172:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-18T12:20:22.469 INFO:teuthology.orchestra.run.smithi172.stdout:1 2023-10-18T12:20:22.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:22.473 DEBUG:teuthology.orchestra.run.smithi172:> route 2023-10-18T12:20:22.541 INFO:teuthology.orchestra.run.smithi172.stdout:Kernel IP routing table 2023-10-18T12:20:22.541 INFO:teuthology.orchestra.run.smithi172.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-18T12:20:22.541 INFO:teuthology.orchestra.run.smithi172.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-18T12:20:22.542 INFO:teuthology.orchestra.run.smithi172.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-18T12:20:22.542 INFO:teuthology.orchestra.run.smithi172.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-18T12:20:22.542 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-10-18T12:20:22.542 INFO:teuthology.orchestra.run.smithi172.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-18T12:20:22.542 INFO:teuthology.orchestra.run.smithi172.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-18T12:20:22.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:22.544 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2023-10-18T12:20:22.544 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2023-10-18T12:20:22.544 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-18T12:20:22.545 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-18T12:20:22.545 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-18T12:20:22.545 DEBUG:teuthology.orchestra.run.smithi172:> ') 2023-10-18T12:20:22.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:22.675 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2023-10-18T12:20:22.692 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-18T12:20:22.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:22.693 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list-id 2023-10-18T12:20:22.755 INFO:teuthology.orchestra.run.smithi172.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-18T12:20:22.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:22.755 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2023-10-18T12:20:22.756 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2023-10-18T12:20:22.756 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-18T12:20:22.756 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-18T12:20:22.756 DEBUG:teuthology.orchestra.run.smithi172:> ') 2023-10-18T12:20:22.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:22.870 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-18T12:20:22.906 INFO:teuthology.orchestra.run.smithi172.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-18T12:20:22.906 INFO:teuthology.orchestra.run.smithi172.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-18T12:20:22.907 INFO:teuthology.orchestra.run.smithi172.stdout: inet 127.0.0.1/8 scope host lo 2023-10-18T12:20:22.907 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:20:22.907 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 ::1/128 scope host 2023-10-18T12:20:22.907 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:20:22.908 INFO:teuthology.orchestra.run.smithi172.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-18T12:20:22.908 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether c2:dc:c1:a5:1b:6d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-18T12:20:22.909 INFO:teuthology.orchestra.run.smithi172.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-18T12:20:22.909 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:20:22.909 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::c0dc:c1ff:fea5:1b6d/64 scope link 2023-10-18T12:20:22.909 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:20:22.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:22.911 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-18T12:20:22.994 INFO:teuthology.orchestra.run.smithi172.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-18T12:20:22.994 INFO:teuthology.orchestra.run.smithi172.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-18T12:20:22.994 INFO:teuthology.orchestra.run.smithi172.stdout: inet 127.0.0.1/8 scope host lo 2023-10-18T12:20:22.995 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:20:22.995 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 ::1/128 scope host 2023-10-18T12:20:22.995 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:20:22.995 INFO:teuthology.orchestra.run.smithi172.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-18T12:20:22.995 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether c2:dc:c1:a5:1b:6d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-18T12:20:22.995 INFO:teuthology.orchestra.run.smithi172.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-18T12:20:22.996 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:20:22.996 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::c0dc:c1ff:fea5:1b6d/64 scope link 2023-10-18T12:20:22.996 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:20:22.998 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-18T12:20:22.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:22.999 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2023-10-18T12:20:22.999 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2023-10-18T12:20:22.999 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-18T12:20:23.000 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-18T12:20:23.000 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-18T12:20:23.000 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-18T12:20:23.001 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-18T12:20:23.001 DEBUG:teuthology.orchestra.run.smithi172:> ') 2023-10-18T12:20:23.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:23.191 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2023-10-18T12:20:23.192 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2023-10-18T12:20:23.192 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set brx.1 up 2023-10-18T12:20:23.192 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set dev brx.1 master ceph-brx 2023-10-18T12:20:23.193 DEBUG:teuthology.orchestra.run.smithi172:> ') 2023-10-18T12:20:23.261 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-18T12:20:23.261 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-18T12:20:23.279 INFO:teuthology.orchestra.run.smithi172.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-18T12:20:23.280 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-18T12:20:23.280 DEBUG:teuthology.orchestra.run.smithi172:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-18T12:20:23.337 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-18T12:20:23.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:23.337 DEBUG:teuthology.orchestra.run.smithi172:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-18T12:20:23.477 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-18T12:20:23.477 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-10-18T12:20:23.478 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2023-10-18T12:20:23.503 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-18T12:20:23.504 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-10-18T12:20:23.504 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2023-10-18T12:20:23.504 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.172:3300,172.21.15.172:3301" 2023-10-18T12:20:23.504 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-18T12:20:23.524 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-18T12:20:23.524 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-10-18T12:20:23.524 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2023-10-18T12:20:23.524 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.172:3300,172.21.15.172:3301" 2023-10-18T12:20:23.524 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-18T12:20:23.525 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.172:6789,172.21.15.172:6790" 2023-10-18T12:20:23.525 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.172:6789,172.21.15.172:6790:/ 2023-10-18T12:20:23.525 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=240ea340-5d3d-4f52-a4bc-af075aca3deb" will pass to kernel 2023-10-18T12:20:23.532 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-18T12:20:23.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:23.532 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-18T12:20:23.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:23.565 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-18T12:20:23.632 INFO:teuthology.orchestra.run.smithi172.stdout:client4932 2023-10-18T12:20:23.632 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T12:20:23.633 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-18T12:20:23.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:23.691 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-18T12:20:23.758 INFO:teuthology.orchestra.run.smithi172.stdout:client4932 2023-10-18T12:20:23.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:23.759 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-18T12:20:23.826 INFO:teuthology.orchestra.run.smithi172.stdout:client4932 2023-10-18T12:20:23.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:23.827 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/240ea340-5d3d-4f52-a4bc-af075aca3deb.client4932/status') 2023-10-18T12:20:23.907 INFO:teuthology.orchestra.run.smithi172.stdout:instance: client.4932 (3)172.21.15.172:0/1049706463 2023-10-18T12:20:23.907 INFO:teuthology.orchestra.run.smithi172.stdout:blocklisted: false 2023-10-18T12:20:23.908 INFO:teuthology.orchestra.run.smithi172.stderr:0+1 records in 2023-10-18T12:20:23.908 INFO:teuthology.orchestra.run.smithi172.stderr:0+1 records out 2023-10-18T12:20:23.908 INFO:teuthology.orchestra.run.smithi172.stderr:71 bytes copied, 0.000170918 s, 415 kB/s 2023-10-18T12:20:23.910 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-18T12:20:23.926 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T12:20:24.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.105+0000 7f7c15741700 1 Processor -- start 2023-10-18T12:20:24.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.105+0000 7f7c15741700 1 -- start start 2023-10-18T12:20:24.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.105+0000 7f7c15741700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7c10146800 0x7f7c100b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:24.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.105+0000 7f7c15741700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7c100700b0 0x7f7c1015eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:24.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.105+0000 7f7c15741700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c1015e680 con 0x7f7c1015dd30 2023-10-18T12:20:24.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.105+0000 7f7c15741700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c100b6180 con 0x7f7c100700b0 2023-10-18T12:20:24.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.105+0000 7f7c15741700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c100b6460 con 0x7f7c10146800 2023-10-18T12:20:24.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.105+0000 7f7c0e7fc700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f7c1015dd30 0x7f7c1006f9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49026/0 (socket says 172.21.15.114:49026) 2023-10-18T12:20:24.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.105+0000 7f7c0e7fc700 1 -- 172.21.15.114:0/1688334168 learned_addr learned my addr 172.21.15.114:0/1688334168 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:24.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.105+0000 7f7c0effd700 1 --2- 172.21.15.114:0/1688334168 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7c10146800 0x7f7c100b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:24.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.105+0000 7f7c0f7fe700 1 --2- 172.21.15.114:0/1688334168 >> v2:172.21.15.172:3300/0 conn(0x7f7c100700b0 0x7f7c1015eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:24.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.105+0000 7f7c0dffb700 1 -- 172.21.15.114:0/1688334168 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4240419336 0 0) 0x7f7c1015e680 con 0x7f7c1015dd30 2023-10-18T12:20:24.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.109+0000 7f7c0dffb700 1 -- 172.21.15.114:0/1688334168 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bf80035d0 con 0x7f7c1015dd30 2023-10-18T12:20:24.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.109+0000 7f7c0dffb700 1 -- 172.21.15.114:0/1688334168 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 357206494 0 0) 0x7f7bf80035d0 con 0x7f7c1015dd30 2023-10-18T12:20:24.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.109+0000 7f7c0dffb700 1 -- 172.21.15.114:0/1688334168 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7c10146800 msgr2=0x7f7c100b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:24.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.109+0000 7f7c0dffb700 1 --2- 172.21.15.114:0/1688334168 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7c10146800 0x7f7c100b5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:24.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.109+0000 7f7c0dffb700 1 -- 172.21.15.114:0/1688334168 >> v2:172.21.15.172:3300/0 conn(0x7f7c100700b0 msgr2=0x7f7c1015eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:24.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.109+0000 7f7c0dffb700 1 --2- 172.21.15.114:0/1688334168 >> v2:172.21.15.172:3300/0 conn(0x7f7c100700b0 0x7f7c1015eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:24.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.109+0000 7f7c0dffb700 1 -- 172.21.15.114:0/1688334168 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c100b6740 con 0x7f7c1015dd30 2023-10-18T12:20:24.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.109+0000 7f7c0dffb700 1 -- 172.21.15.114:0/1688334168 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3368469509 0 0) 0x7f7c04001670 con 0x7f7c1015dd30 2023-10-18T12:20:24.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.109+0000 7f7c0dffb700 1 -- 172.21.15.114:0/1688334168 >> v1:172.21.15.114:6789/0 conn(0x7f7c1015dd30 legacy=0x7f7c1006f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:24.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.109+0000 7f7c0dffb700 1 --2- 172.21.15.114:0/1688334168 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7c10146800 0x7f7bf8003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:24.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.109+0000 7f7c0dffb700 1 --2- 172.21.15.114:0/1688334168 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bf8003fa0 0x7f7bf8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:24.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.109+0000 7f7c0dffb700 1 --2- 172.21.15.114:0/1688334168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bf8004db0 0x7f7bf8005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:24.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.109+0000 7f7c0dffb700 1 -- 172.21.15.114:0/1688334168 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c100b6180 con 0x7f7bf8003fa0 2023-10-18T12:20:24.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.109+0000 7f7c0dffb700 1 -- 172.21.15.114:0/1688334168 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c100b6460 con 0x7f7bf8004db0 2023-10-18T12:20:24.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.109+0000 7f7c0dffb700 1 -- 172.21.15.114:0/1688334168 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf800ba30 con 0x7f7c10146800 2023-10-18T12:20:24.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.109+0000 7f7c0e7fc700 1 --2- 172.21.15.114:0/1688334168 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bf8003fa0 0x7f7bf8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:24.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.109+0000 7f7c0effd700 1 --2- 172.21.15.114:0/1688334168 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7c10146800 0x7f7bf8003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:24.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.109+0000 7f7c0f7fe700 1 --2- 172.21.15.114:0/1688334168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bf8004db0 0x7f7bf8005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:24.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.109+0000 7f7c0e7fc700 1 -- 172.21.15.114:0/1688334168 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7c10146800 msgr2=0x7f7bf8003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:24.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.109+0000 7f7c0e7fc700 1 --2- 172.21.15.114:0/1688334168 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7c10146800 0x7f7bf8003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:24.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.109+0000 7f7c0e7fc700 1 -- 172.21.15.114:0/1688334168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bf8004db0 msgr2=0x7f7bf8005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:24.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.109+0000 7f7c0e7fc700 1 --2- 172.21.15.114:0/1688334168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bf8004db0 0x7f7bf8005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:24.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.109+0000 7f7c0e7fc700 1 -- 172.21.15.114:0/1688334168 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf80035d0 con 0x7f7bf8003fa0 2023-10-18T12:20:24.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.109+0000 7f7c0f7fe700 1 --2- 172.21.15.114:0/1688334168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bf8004db0 0x7f7bf8005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:24.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.109+0000 7f7c0e7fc700 1 --2- 172.21.15.114:0/1688334168 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bf8003fa0 0x7f7bf8004870 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7c0400c320 tx=0x7f7bf80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a770125abfcc5699 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:24.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.109+0000 7f7c0dffb700 1 -- 172.21.15.114:0/1688334168 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0400ce00 con 0x7f7bf8003fa0 2023-10-18T12:20:24.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.109+0000 7f7c0dffb700 1 -- 172.21.15.114:0/1688334168 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c04005980 con 0x7f7bf8003fa0 2023-10-18T12:20:24.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.109+0000 7f7c0dffb700 1 -- 172.21.15.114:0/1688334168 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c04005d30 con 0x7f7bf8003fa0 2023-10-18T12:20:24.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.109+0000 7f7c15741700 1 -- 172.21.15.114:0/1688334168 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bf8003fa0 msgr2=0x7f7bf8004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:24.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.109+0000 7f7c15741700 1 --2- 172.21.15.114:0/1688334168 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bf8003fa0 0x7f7bf8004870 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7c0400c320 tx=0x7f7bf80058a0 comp rx=0 tx=0).stop 2023-10-18T12:20:24.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.109+0000 7f7c0f7fe700 1 -- 172.21.15.114:0/1688334168 reap_dead start 2023-10-18T12:20:24.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.109+0000 7f7c15741700 1 -- 172.21.15.114:0/1688334168 shutdown_connections 2023-10-18T12:20:24.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.109+0000 7f7c15741700 1 -- 172.21.15.114:0/1688334168 >> 172.21.15.114:0/1688334168 conn(0x7f7c1006a130 msgr2=0x7f7c1006a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:24.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.113+0000 7f7c15741700 1 -- 172.21.15.114:0/1688334168 shutdown_connections 2023-10-18T12:20:24.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.113+0000 7f7c15741700 1 -- 172.21.15.114:0/1688334168 wait complete. 2023-10-18T12:20:24.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.113+0000 7f7c15741700 1 Processor -- start 2023-10-18T12:20:24.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.113+0000 7f7c15741700 1 -- start start 2023-10-18T12:20:24.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.113+0000 7f7c15741700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bf8003fa0 0x7f7c1013dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:24.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.113+0000 7f7c15741700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c100ac930 0x7f7c101405b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:24.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.113+0000 7f7c15741700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7c101f58b0 0x7f7c101f5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:24.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.113+0000 7f7c15741700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1013e250 con 0x7f7bf8003fa0 2023-10-18T12:20:24.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.113+0000 7f7c15741700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c101f62a0 con 0x7f7c100ac930 2023-10-18T12:20:24.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.113+0000 7f7c15741700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1013e440 con 0x7f7c101f58b0 2023-10-18T12:20:24.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.113+0000 7f7c0effd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bf8003fa0 0x7f7c1013dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:24.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.113+0000 7f7c0effd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bf8003fa0 0x7f7c1013dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49644/0 (socket says 172.21.15.114:49644) 2023-10-18T12:20:24.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.113+0000 7f7c0effd700 1 -- 172.21.15.114:0/3067616267 learned_addr learned my addr 172.21.15.114:0/3067616267 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:24.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.117+0000 7f7c0e7fc700 1 --2- 172.21.15.114:0/3067616267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c100ac930 0x7f7c101405b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:24.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.117+0000 7f7c0f7fe700 1 --2- 172.21.15.114:0/3067616267 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7c101f58b0 0x7f7c101f5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:24.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.117+0000 7f7c0effd700 1 -- 172.21.15.114:0/3067616267 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7c101f58b0 msgr2=0x7f7c101f5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:24.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.117+0000 7f7c0effd700 1 --2- 172.21.15.114:0/3067616267 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7c101f58b0 0x7f7c101f5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:24.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.117+0000 7f7c0effd700 1 -- 172.21.15.114:0/3067616267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c100ac930 msgr2=0x7f7c101405b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:24.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.117+0000 7f7c0effd700 1 --2- 172.21.15.114:0/3067616267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c100ac930 0x7f7c101405b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:24.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.117+0000 7f7c0effd700 1 -- 172.21.15.114:0/3067616267 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c1013e720 con 0x7f7bf8003fa0 2023-10-18T12:20:24.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.117+0000 7f7c0f7fe700 1 --2- 172.21.15.114:0/3067616267 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7c101f58b0 0x7f7c101f5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:20:24.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.117+0000 7f7c0e7fc700 1 --2- 172.21.15.114:0/3067616267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c100ac930 0x7f7c101405b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:20:24.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.117+0000 7f7c0effd700 1 --2- 172.21.15.114:0/3067616267 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bf8003fa0 0x7f7c1013dd10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7c00011a20 tx=0x7f7c00011de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:24.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.117+0000 7f7bf77fe700 1 -- 172.21.15.114:0/3067616267 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0000fa00 con 0x7f7bf8003fa0 2023-10-18T12:20:24.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.117+0000 7f7bf77fe700 1 -- 172.21.15.114:0/3067616267 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0000fb60 con 0x7f7bf8003fa0 2023-10-18T12:20:24.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.117+0000 7f7c15741700 1 -- 172.21.15.114:0/3067616267 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c1013ea00 con 0x7f7bf8003fa0 2023-10-18T12:20:24.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.117+0000 7f7bf77fe700 1 -- 172.21.15.114:0/3067616267 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c00014440 con 0x7f7bf8003fa0 2023-10-18T12:20:24.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.117+0000 7f7c15741700 1 -- 172.21.15.114:0/3067616267 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c1013efc0 con 0x7f7bf8003fa0 2023-10-18T12:20:24.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.117+0000 7f7c15741700 1 -- 172.21.15.114:0/3067616267 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c10072e60 con 0x7f7bf8003fa0 2023-10-18T12:20:24.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.121+0000 7f7bf77fe700 1 -- 172.21.15.114:0/3067616267 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f7c0001d400 con 0x7f7bf8003fa0 2023-10-18T12:20:24.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.121+0000 7f7bf77fe700 1 --2- 172.21.15.114:0/3067616267 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7bfc0656f0 0x7f7bfc067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:24.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.121+0000 7f7bf77fe700 1 -- 172.21.15.114:0/3067616267 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7c00083860 con 0x7f7bf8003fa0 2023-10-18T12:20:24.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.121+0000 7f7c0e7fc700 1 --2- 172.21.15.114:0/3067616267 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7bfc0656f0 0x7f7bfc067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:24.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.121+0000 7f7c0e7fc700 1 --2- 172.21.15.114:0/3067616267 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7bfc0656f0 0x7f7bfc067bb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7c1006e0c0 tx=0x7f7c0400a000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:24.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.125+0000 7f7bf77fe700 1 -- 172.21.15.114:0/3067616267 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f7c00051010 con 0x7f7bf8003fa0 2023-10-18T12:20:24.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.309+0000 7f7c15741700 1 -- 172.21.15.114:0/3067616267 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c10141db0 con 0x7f7bf8003fa0 2023-10-18T12:20:24.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.313+0000 7f7bf77fe700 1 -- 172.21.15.114:0/3067616267 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20240 (secure 0 0 0) 0x7f7c00054630 con 0x7f7bf8003fa0 2023-10-18T12:20:24.316 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:20:24.317 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":30,"fsid":"240ea340-5d3d-4f52-a4bc-af075aca3deb","created":"2023-10-18T12:19:12.512994+0000","modified":"2023-10-18T12:20:20.604528+0000","last_up_change":"2023-10-18T12:19:25.286009+0000","last_in_change":"2023-10-18T12:19:15.850693+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T12:19:27.040638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-18T12:19:32.358094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-18T12:19:37.333855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-18T12:19:38.055385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-18T12:19:41.679218+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c3578978-1a03-4857-b9d2-34a5da3d7731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6817","nonce":1506287862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6820","nonce":1506287862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6830","nonce":1506287862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6825","nonce":1506287862}]},"public_addr":"172.21.15.114:6817/1506287862","cluster_addr":"172.21.15.114:6820/1506287862","heartbeat_back_addr":"172.21.15.114:6830/1506287862","heartbeat_front_addr":"172.21.15.114:6825/1506287862","state":["exists","up"]},{"osd":1,"uuid":"43eb26a6-e2b3-4670-9559-bd053b5140d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6801","nonce":3302727047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6803","nonce":3302727047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6807","nonce":3302727047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6805","nonce":3302727047}]},"public_addr":"172.21.15.114:6801/3302727047","cluster_addr":"172.21.15.114:6803/3302727047","heartbeat_back_addr":"172.21.15.114:6807/3302727047","heartbeat_front_addr":"172.21.15.114:6805/3302727047","state":["exists","up"]},{"osd":2,"uuid":"f3d4dbd5-521c-4dd2-b687-5768cc7d0938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6809","nonce":2699151351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6811","nonce":2699151351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6815","nonce":2699151351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6813","nonce":2699151351}]},"public_addr":"172.21.15.114:6809/2699151351","cluster_addr":"172.21.15.114:6811/2699151351","heartbeat_back_addr":"172.21.15.114:6815/2699151351","heartbeat_front_addr":"172.21.15.114:6813/2699151351","state":["exists","up"]},{"osd":3,"uuid":"823e5802-92b7-4f0d-b32d-a5748993f1b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6821","nonce":1361608073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6824","nonce":1361608073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6829","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6831","nonce":1361608073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6827","nonce":1361608073}]},"public_addr":"172.21.15.114:6821/1361608073","cluster_addr":"172.21.15.114:6824/1361608073","heartbeat_back_addr":"172.21.15.114:6831/1361608073","heartbeat_front_addr":"172.21.15.114:6827/1361608073","state":["exists","up"]},{"osd":4,"uuid":"e47fb93e-13b4-44a4-b084-8c4384ceb41e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6801","nonce":930839681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6803","nonce":930839681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6807","nonce":930839681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6805","nonce":930839681}]},"public_addr":"172.21.15.172:6801/930839681","cluster_addr":"172.21.15.172:6803/930839681","heartbeat_back_addr":"172.21.15.172:6807/930839681","heartbeat_front_addr":"172.21.15.172:6805/930839681","state":["exists","up"]},{"osd":5,"uuid":"7561a973-f479-45a0-af40-f324728d622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6814","nonce":571761850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6818","nonce":571761850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6824","nonce":571761850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6821","nonce":571761850}]},"public_addr":"172.21.15.172:6814/571761850","cluster_addr":"172.21.15.172:6818/571761850","heartbeat_back_addr":"172.21.15.172:6824/571761850","heartbeat_front_addr":"172.21.15.172:6821/571761850","state":["exists","up"]},{"osd":6,"uuid":"51753f4b-7f06-4f1c-9ec7-6e18a66eb980","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6825","nonce":1680398853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6827","nonce":1680398853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6831","nonce":1680398853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6829","nonce":1680398853}]},"public_addr":"172.21.15.172:6825/1680398853","cluster_addr":"172.21.15.172:6827/1680398853","heartbeat_back_addr":"172.21.15.172:6831/1680398853","heartbeat_front_addr":"172.21.15.172:6829/1680398853","state":["exists","up"]},{"osd":7,"uuid":"4d8b1e15-143d-4d17-9074-59d92f0f9af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6809","nonce":349710101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6811","nonce":349710101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6819","nonce":349710101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6815","nonce":349710101}]},"public_addr":"172.21.15.172:6809/349710101","cluster_addr":"172.21.15.172:6811/349710101","heartbeat_back_addr":"172.21.15.172:6819/349710101","heartbeat_front_addr":"172.21.15.172:6815/349710101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.889460+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.475494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.911473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.648596+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.609994+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.636248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.854589+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.885826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T12:20:24.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.313+0000 7f7c15741700 1 -- 172.21.15.114:0/3067616267 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7bfc0656f0 msgr2=0x7f7bfc067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:24.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.313+0000 7f7c15741700 1 --2- 172.21.15.114:0/3067616267 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7bfc0656f0 0x7f7bfc067bb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7c1006e0c0 tx=0x7f7c0400a000 comp rx=0 tx=0).stop 2023-10-18T12:20:24.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.313+0000 7f7c15741700 1 -- 172.21.15.114:0/3067616267 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bf8003fa0 msgr2=0x7f7c1013dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:24.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.313+0000 7f7c15741700 1 --2- 172.21.15.114:0/3067616267 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bf8003fa0 0x7f7c1013dd10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7c00011a20 tx=0x7f7c00011de0 comp rx=0 tx=0).stop 2023-10-18T12:20:24.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.313+0000 7f7c15741700 1 -- 172.21.15.114:0/3067616267 shutdown_connections 2023-10-18T12:20:24.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.313+0000 7f7c15741700 1 --2- 172.21.15.114:0/3067616267 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7bfc0656f0 0x7f7bfc067bb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:24.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.313+0000 7f7c15741700 1 --2- 172.21.15.114:0/3067616267 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7c101f58b0 0x7f7c101f5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:24.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.313+0000 7f7c15741700 1 --2- 172.21.15.114:0/3067616267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c100ac930 0x7f7c101405b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:24.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.313+0000 7f7c15741700 1 --2- 172.21.15.114:0/3067616267 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bf8003fa0 0x7f7c1013dd10 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:24.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.313+0000 7f7c15741700 1 -- 172.21.15.114:0/3067616267 >> 172.21.15.114:0/3067616267 conn(0x7f7c1006a130 msgr2=0x7f7c1006a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:24.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.313+0000 7f7c15741700 1 -- 172.21.15.114:0/3067616267 shutdown_connections 2023-10-18T12:20:24.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.313+0000 7f7c15741700 1 -- 172.21.15.114:0/3067616267 wait complete. 2023-10-18T12:20:24.342 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-18T12:19:27.040638+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-18T12:19:32.358094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-18T12:19:37.333855+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-18T12:19:38.055385+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-18T12:19:41.679218+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-18T12:20:24.343 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-18T12:20:24.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.517+0000 7f9a480a2700 1 Processor -- start 2023-10-18T12:20:24.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.517+0000 7f9a480a2700 1 -- start start 2023-10-18T12:20:24.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.521+0000 7f9a480a2700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9a4015adf0 0x7f9a400cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:24.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.521+0000 7f9a480a2700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9a400cce10 0x7f9a400b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:24.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.521+0000 7f9a480a2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9a400b1e80 0x7f9a400b22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:24.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.521+0000 7f9a480a2700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a400ca590 con 0x7f9a400cce10 2023-10-18T12:20:24.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.521+0000 7f9a480a2700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a4015b1d0 con 0x7f9a4015adf0 2023-10-18T12:20:24.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.521+0000 7f9a480a2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a400ce600 con 0x7f9a400b1e80 2023-10-18T12:20:24.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.521+0000 7f9a4563d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9a400cce10 0x7f9a400b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:24.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.521+0000 7f9a4563d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9a400cce10 0x7f9a400b1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49658/0 (socket says 172.21.15.114:49658) 2023-10-18T12:20:24.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.521+0000 7f9a4563d700 1 -- 172.21.15.114:0/411011849 learned_addr learned my addr 172.21.15.114:0/411011849 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:24.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.521+0000 7f9a45e3e700 1 --2- 172.21.15.114:0/411011849 >> v2:172.21.15.172:3300/0 conn(0x7f9a4015adf0 0x7f9a400cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:24.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.521+0000 7f9a4663f700 1 --2- 172.21.15.114:0/411011849 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9a400b1e80 0x7f9a400b22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:24.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.521+0000 7f9a4563d700 1 -- 172.21.15.114:0/411011849 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9a400b1e80 msgr2=0x7f9a400b22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:24.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.521+0000 7f9a4563d700 1 --2- 172.21.15.114:0/411011849 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9a400b1e80 0x7f9a400b22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:24.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.521+0000 7f9a4563d700 1 -- 172.21.15.114:0/411011849 >> v2:172.21.15.172:3300/0 conn(0x7f9a4015adf0 msgr2=0x7f9a400cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:24.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.521+0000 7f9a4563d700 1 --2- 172.21.15.114:0/411011849 >> v2:172.21.15.172:3300/0 conn(0x7f9a4015adf0 0x7f9a400cc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:24.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.521+0000 7f9a4563d700 1 -- 172.21.15.114:0/411011849 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a400cd580 con 0x7f9a400cce10 2023-10-18T12:20:24.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.521+0000 7f9a4563d700 1 --2- 172.21.15.114:0/411011849 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a400cce10 0x7f9a400b1940 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9a400cc3a0 tx=0x7f9a30009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fffe3de519474f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:24.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.521+0000 7f9a44e3c700 1 -- 172.21.15.114:0/411011849 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a30011830 con 0x7f9a400cce10 2023-10-18T12:20:24.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.521+0000 7f9a44e3c700 1 -- 172.21.15.114:0/411011849 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a30011990 con 0x7f9a400cce10 2023-10-18T12:20:24.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.521+0000 7f9a44e3c700 1 -- 172.21.15.114:0/411011849 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a30011d20 con 0x7f9a400cce10 2023-10-18T12:20:24.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.525+0000 7f9a480a2700 1 -- 172.21.15.114:0/411011849 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a400cce10 msgr2=0x7f9a400b1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:24.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.525+0000 7f9a480a2700 1 --2- 172.21.15.114:0/411011849 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a400cce10 0x7f9a400b1940 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9a400cc3a0 tx=0x7f9a30009bf0 comp rx=0 tx=0).stop 2023-10-18T12:20:24.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.525+0000 7f9a480a2700 1 -- 172.21.15.114:0/411011849 shutdown_connections 2023-10-18T12:20:24.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.525+0000 7f9a480a2700 1 --2- 172.21.15.114:0/411011849 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9a400b1e80 0x7f9a400b22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:24.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.525+0000 7f9a480a2700 1 --2- 172.21.15.114:0/411011849 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a400cce10 0x7f9a400b1940 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:24.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.525+0000 7f9a480a2700 1 --2- 172.21.15.114:0/411011849 >> v2:172.21.15.172:3300/0 conn(0x7f9a4015adf0 0x7f9a400cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:24.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.525+0000 7f9a480a2700 1 -- 172.21.15.114:0/411011849 >> 172.21.15.114:0/411011849 conn(0x7f9a400ce820 msgr2=0x7f9a400cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:24.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.525+0000 7f9a480a2700 1 -- 172.21.15.114:0/411011849 shutdown_connections 2023-10-18T12:20:24.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.525+0000 7f9a480a2700 1 -- 172.21.15.114:0/411011849 wait complete. 2023-10-18T12:20:24.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.525+0000 7f9a480a2700 1 Processor -- start 2023-10-18T12:20:24.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.529+0000 7f9a480a2700 1 -- start start 2023-10-18T12:20:24.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.529+0000 7f9a480a2700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a400b1e80 0x7f9a40149ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:24.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.529+0000 7f9a480a2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a400cce10 0x7f9a4015ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:24.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.529+0000 7f9a480a2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9a4015adf0 0x7f9a4015b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:24.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.529+0000 7f9a480a2700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4015ca50 con 0x7f9a400b1e80 2023-10-18T12:20:24.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.529+0000 7f9a480a2700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4014a220 con 0x7f9a400cce10 2023-10-18T12:20:24.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.529+0000 7f9a480a2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4015bdd0 con 0x7f9a4015adf0 2023-10-18T12:20:24.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.529+0000 7f9a45e3e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a400b1e80 0x7f9a40149ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:24.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.529+0000 7f9a45e3e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a400b1e80 0x7f9a40149ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49668/0 (socket says 172.21.15.114:49668) 2023-10-18T12:20:24.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.529+0000 7f9a45e3e700 1 -- 172.21.15.114:0/2885979836 learned_addr learned my addr 172.21.15.114:0/2885979836 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:24.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.529+0000 7f9a4663f700 1 --2- 172.21.15.114:0/2885979836 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9a4015adf0 0x7f9a4015b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:24.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.529+0000 7f9a4563d700 1 --2- 172.21.15.114:0/2885979836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a400cce10 0x7f9a4015ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:24.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.529+0000 7f9a45e3e700 1 -- 172.21.15.114:0/2885979836 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9a4015adf0 msgr2=0x7f9a4015b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:24.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.529+0000 7f9a45e3e700 1 --2- 172.21.15.114:0/2885979836 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9a4015adf0 0x7f9a4015b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:24.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.529+0000 7f9a45e3e700 1 -- 172.21.15.114:0/2885979836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a400cce10 msgr2=0x7f9a4015ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:24.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.529+0000 7f9a45e3e700 1 --2- 172.21.15.114:0/2885979836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a400cce10 0x7f9a4015ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:24.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.529+0000 7f9a45e3e700 1 -- 172.21.15.114:0/2885979836 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a30009570 con 0x7f9a400b1e80 2023-10-18T12:20:24.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.529+0000 7f9a45e3e700 1 --2- 172.21.15.114:0/2885979836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a400b1e80 0x7f9a40149ce0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c00e840 tx=0x7f9a3c00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:24.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.529+0000 7f9a367fc700 1 -- 172.21.15.114:0/2885979836 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c0095a0 con 0x7f9a400b1e80 2023-10-18T12:20:24.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.529+0000 7f9a367fc700 1 -- 172.21.15.114:0/2885979836 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a3c00c690 con 0x7f9a400b1e80 2023-10-18T12:20:24.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.529+0000 7f9a367fc700 1 -- 172.21.15.114:0/2885979836 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c00ca00 con 0x7f9a400b1e80 2023-10-18T12:20:24.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.529+0000 7f9a480a2700 1 -- 172.21.15.114:0/2885979836 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a4015c0b0 con 0x7f9a400b1e80 2023-10-18T12:20:24.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.529+0000 7f9a480a2700 1 -- 172.21.15.114:0/2885979836 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a4015c670 con 0x7f9a400b1e80 2023-10-18T12:20:24.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.533+0000 7f9a480a2700 1 -- 172.21.15.114:0/2885979836 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a40072e60 con 0x7f9a400b1e80 2023-10-18T12:20:24.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.533+0000 7f9a367fc700 1 -- 172.21.15.114:0/2885979836 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f9a3c00cb60 con 0x7f9a400b1e80 2023-10-18T12:20:24.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.533+0000 7f9a367fc700 1 --2- 172.21.15.114:0/2885979836 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9a240656f0 0x7f9a24067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:24.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.533+0000 7f9a367fc700 1 -- 172.21.15.114:0/2885979836 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9a3c0831d0 con 0x7f9a400b1e80 2023-10-18T12:20:24.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.533+0000 7f9a4563d700 1 --2- 172.21.15.114:0/2885979836 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9a240656f0 0x7f9a24067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:24.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.537+0000 7f9a4563d700 1 --2- 172.21.15.114:0/2885979836 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9a240656f0 0x7f9a24067bb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9a30000c00 tx=0x7f9a30008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:24.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.541+0000 7f9a367fc700 1 -- 172.21.15.114:0/2885979836 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f9a3c0508d0 con 0x7f9a400b1e80 2023-10-18T12:20:24.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.721+0000 7f9a480a2700 1 -- 172.21.15.114:0/2885979836 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9a4015ccc0 con 0x7f9a400b1e80 2023-10-18T12:20:24.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.725+0000 7f9a367fc700 1 -- 172.21.15.114:0/2885979836 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9a3c053ef0 con 0x7f9a400b1e80 2023-10-18T12:20:24.729 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-10-18T12:20:24.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.725+0000 7f9a480a2700 1 -- 172.21.15.114:0/2885979836 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9a240656f0 msgr2=0x7f9a24067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:24.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.725+0000 7f9a480a2700 1 --2- 172.21.15.114:0/2885979836 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9a240656f0 0x7f9a24067bb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9a30000c00 tx=0x7f9a30008030 comp rx=0 tx=0).stop 2023-10-18T12:20:24.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.725+0000 7f9a480a2700 1 -- 172.21.15.114:0/2885979836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a400b1e80 msgr2=0x7f9a40149ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:24.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.725+0000 7f9a480a2700 1 --2- 172.21.15.114:0/2885979836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a400b1e80 0x7f9a40149ce0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c00e840 tx=0x7f9a3c00ec00 comp rx=0 tx=0).stop 2023-10-18T12:20:24.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.725+0000 7f9a480a2700 1 -- 172.21.15.114:0/2885979836 shutdown_connections 2023-10-18T12:20:24.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.725+0000 7f9a480a2700 1 --2- 172.21.15.114:0/2885979836 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9a240656f0 0x7f9a24067bb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:24.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.725+0000 7f9a480a2700 1 --2- 172.21.15.114:0/2885979836 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9a4015adf0 0x7f9a4015b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:24.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.725+0000 7f9a480a2700 1 --2- 172.21.15.114:0/2885979836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a400cce10 0x7f9a4015ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:24.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.725+0000 7f9a480a2700 1 --2- 172.21.15.114:0/2885979836 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a400b1e80 0x7f9a40149ce0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:24.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.725+0000 7f9a480a2700 1 -- 172.21.15.114:0/2885979836 >> 172.21.15.114:0/2885979836 conn(0x7f9a400ce820 msgr2=0x7f9a40159c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:24.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.725+0000 7f9a480a2700 1 -- 172.21.15.114:0/2885979836 shutdown_connections 2023-10-18T12:20:24.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.725+0000 7f9a480a2700 1 -- 172.21.15.114:0/2885979836 wait complete. 2023-10-18T12:20:24.750 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-18T12:20:24.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.933+0000 7f040b261700 1 Processor -- start 2023-10-18T12:20:24.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.933+0000 7f040b261700 1 -- start start 2023-10-18T12:20:24.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.937+0000 7f040b261700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f04040d2e00 0x7f04040b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:24.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.937+0000 7f040b261700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0404160710 0x7f04040d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:24.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.937+0000 7f040b261700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f040415d0d0 con 0x7f04040b5ae0 2023-10-18T12:20:24.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.937+0000 7f040b261700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f040415df90 con 0x7f04040d2e00 2023-10-18T12:20:24.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.937+0000 7f040b261700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f040406f0f0 con 0x7f0404160710 2023-10-18T12:20:24.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.937+0000 7f040a25f700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f04040d2e00 0x7f04040b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:24.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.937+0000 7f040a25f700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f04040d2e00 0x7f04040b6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49670/0 (socket says 172.21.15.114:49670) 2023-10-18T12:20:24.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.937+0000 7f040a25f700 1 -- 172.21.15.114:0/3877645281 learned_addr learned my addr 172.21.15.114:0/3877645281 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:24.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.937+0000 7f0409a5e700 1 --2- 172.21.15.114:0/3877645281 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0404160710 0x7f04040d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:24.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.937+0000 7f040a25f700 1 -- 172.21.15.114:0/3877645281 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0404160710 msgr2=0x7f04040d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:24.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.937+0000 7f040a25f700 1 --2- 172.21.15.114:0/3877645281 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0404160710 0x7f04040d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:24.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.937+0000 7f040a25f700 1 -- 172.21.15.114:0/3877645281 >> v1:172.21.15.172:6789/0 conn(0x7f04040b5ae0 legacy=0x7f040406db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:24.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.937+0000 7f040a25f700 1 -- 172.21.15.114:0/3877645281 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04040d3720 con 0x7f04040d2e00 2023-10-18T12:20:24.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.937+0000 7f040a25f700 1 --2- 172.21.15.114:0/3877645281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04040d2e00 0x7f04040b6e00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0400009940 tx=0x7f0400009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11ac603051108a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:24.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.937+0000 7f040925d700 1 -- 172.21.15.114:0/3877645281 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0400011830 con 0x7f04040d2e00 2023-10-18T12:20:24.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.937+0000 7f040925d700 1 -- 172.21.15.114:0/3877645281 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0400011990 con 0x7f04040d2e00 2023-10-18T12:20:24.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.937+0000 7f040925d700 1 -- 172.21.15.114:0/3877645281 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0400011d20 con 0x7f04040d2e00 2023-10-18T12:20:24.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.941+0000 7f040b261700 1 -- 172.21.15.114:0/3877645281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04040d2e00 msgr2=0x7f04040b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:24.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.941+0000 7f040b261700 1 --2- 172.21.15.114:0/3877645281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04040d2e00 0x7f04040b6e00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0400009940 tx=0x7f0400009c50 comp rx=0 tx=0).stop 2023-10-18T12:20:24.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.941+0000 7f040b261700 1 -- 172.21.15.114:0/3877645281 shutdown_connections 2023-10-18T12:20:24.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.941+0000 7f040b261700 1 --2- 172.21.15.114:0/3877645281 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0404160710 0x7f04040d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:24.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.941+0000 7f040b261700 1 --2- 172.21.15.114:0/3877645281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04040d2e00 0x7f04040b6e00 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:24.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.941+0000 7f040b261700 1 -- 172.21.15.114:0/3877645281 >> 172.21.15.114:0/3877645281 conn(0x7f0404069f20 msgr2=0x7f040406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:24.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.941+0000 7f040b261700 1 -- 172.21.15.114:0/3877645281 shutdown_connections 2023-10-18T12:20:24.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.941+0000 7f040b261700 1 -- 172.21.15.114:0/3877645281 wait complete. 2023-10-18T12:20:24.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.941+0000 7f040b261700 1 Processor -- start 2023-10-18T12:20:24.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.941+0000 7f040b261700 1 -- start start 2023-10-18T12:20:24.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.945+0000 7f040b261700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f04040b5ae0 0x7f04041f5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:24.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.945+0000 7f040b261700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04040d2e00 0x7f040415a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:24.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.945+0000 7f040b261700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0404160710 0x7f04040ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:24.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.945+0000 7f040b261700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04041f67b0 con 0x7f04040d2e00 2023-10-18T12:20:24.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.945+0000 7f040b261700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04041f5f10 con 0x7f0404160710 2023-10-18T12:20:24.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.945+0000 7f040b261700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04041f61f0 con 0x7f04040b5ae0 2023-10-18T12:20:24.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.945+0000 7f0409a5e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04040d2e00 0x7f040415a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:24.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.945+0000 7f0409a5e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04040d2e00 0x7f040415a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:49682/0 (socket says 172.21.15.114:49682) 2023-10-18T12:20:24.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.945+0000 7f0409a5e700 1 -- 172.21.15.114:0/3058881984 learned_addr learned my addr 172.21.15.114:0/3058881984 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:24.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.945+0000 7f040a25f700 1 --2- 172.21.15.114:0/3058881984 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f04040b5ae0 0x7f04041f5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:24.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.945+0000 7f040aa60700 1 --2- 172.21.15.114:0/3058881984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0404160710 0x7f04040ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:24.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.945+0000 7f0409a5e700 1 -- 172.21.15.114:0/3058881984 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f04040b5ae0 msgr2=0x7f04041f5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:24.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.945+0000 7f0409a5e700 1 --2- 172.21.15.114:0/3058881984 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f04040b5ae0 0x7f04041f5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:24.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.945+0000 7f0409a5e700 1 -- 172.21.15.114:0/3058881984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0404160710 msgr2=0x7f04040ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:24.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.945+0000 7f0409a5e700 1 --2- 172.21.15.114:0/3058881984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0404160710 0x7f04040ab8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:24.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.945+0000 7f0409a5e700 1 -- 172.21.15.114:0/3058881984 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0400009570 con 0x7f04040d2e00 2023-10-18T12:20:24.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.945+0000 7f0409a5e700 1 --2- 172.21.15.114:0/3058881984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04040d2e00 0x7f040415a6c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f03f400e9a0 tx=0x7f03f400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:24.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.945+0000 7f03faffd700 1 -- 172.21.15.114:0/3058881984 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f4009720 con 0x7f04040d2e00 2023-10-18T12:20:24.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.945+0000 7f03faffd700 1 -- 172.21.15.114:0/3058881984 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f400c850 con 0x7f04040d2e00 2023-10-18T12:20:24.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.945+0000 7f040b261700 1 -- 172.21.15.114:0/3058881984 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04041f64d0 con 0x7f04040d2e00 2023-10-18T12:20:24.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.945+0000 7f03faffd700 1 -- 172.21.15.114:0/3058881984 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f400cbe0 con 0x7f04040d2e00 2023-10-18T12:20:24.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.945+0000 7f040b261700 1 -- 172.21.15.114:0/3058881984 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f040415ac00 con 0x7f04040d2e00 2023-10-18T12:20:24.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.949+0000 7f040b261700 1 -- 172.21.15.114:0/3058881984 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f040404e910 con 0x7f04040d2e00 2023-10-18T12:20:24.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.949+0000 7f03faffd700 1 -- 172.21.15.114:0/3058881984 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f03f400cd40 con 0x7f04040d2e00 2023-10-18T12:20:24.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.949+0000 7f03faffd700 1 --2- 172.21.15.114:0/3058881984 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f03e80656f0 0x7f03e8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:24.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.953+0000 7f03faffd700 1 -- 172.21.15.114:0/3058881984 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f03f4083240 con 0x7f04040d2e00 2023-10-18T12:20:24.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.953+0000 7f040a25f700 1 --2- 172.21.15.114:0/3058881984 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f03e80656f0 0x7f03e8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:24.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.953+0000 7f040a25f700 1 --2- 172.21.15.114:0/3058881984 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f03e80656f0 0x7f03e8067bb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0400014040 tx=0x7f0400008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:24.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:24.957+0000 7f03faffd700 1 -- 172.21.15.114:0/3058881984 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f03f4054450 con 0x7f04040d2e00 2023-10-18T12:20:25.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.137+0000 7f040b261700 1 -- 172.21.15.114:0/3058881984 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f040406a300 con 0x7f04040d2e00 2023-10-18T12:20:25.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.137+0000 7f03faffd700 1 -- 172.21.15.114:0/3058881984 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f03f4053fe0 con 0x7f04040d2e00 2023-10-18T12:20:25.143 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 8 2023-10-18T12:20:25.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.141+0000 7f040b261700 1 -- 172.21.15.114:0/3058881984 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f03e80656f0 msgr2=0x7f03e8067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:25.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.141+0000 7f040b261700 1 --2- 172.21.15.114:0/3058881984 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f03e80656f0 0x7f03e8067bb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0400014040 tx=0x7f0400008030 comp rx=0 tx=0).stop 2023-10-18T12:20:25.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.141+0000 7f040b261700 1 -- 172.21.15.114:0/3058881984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04040d2e00 msgr2=0x7f040415a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:25.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.141+0000 7f040b261700 1 --2- 172.21.15.114:0/3058881984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04040d2e00 0x7f040415a6c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f03f400e9a0 tx=0x7f03f400ed60 comp rx=0 tx=0).stop 2023-10-18T12:20:25.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.141+0000 7f040b261700 1 -- 172.21.15.114:0/3058881984 shutdown_connections 2023-10-18T12:20:25.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.141+0000 7f040b261700 1 --2- 172.21.15.114:0/3058881984 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f03e80656f0 0x7f03e8067bb0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:25.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.141+0000 7f040b261700 1 --2- 172.21.15.114:0/3058881984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0404160710 0x7f04040ab8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:25.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.141+0000 7f040b261700 1 --2- 172.21.15.114:0/3058881984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04040d2e00 0x7f040415a6c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:25.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.141+0000 7f040b261700 1 --2- 172.21.15.114:0/3058881984 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f04040b5ae0 0x7f04041f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:25.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.141+0000 7f040b261700 1 -- 172.21.15.114:0/3058881984 >> 172.21.15.114:0/3058881984 conn(0x7f0404069f20 msgr2=0x7f04040b3900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:25.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.141+0000 7f040b261700 1 -- 172.21.15.114:0/3058881984 shutdown_connections 2023-10-18T12:20:25.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.141+0000 7f040b261700 1 -- 172.21.15.114:0/3058881984 wait complete. 2023-10-18T12:20:25.169 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-18T12:20:25.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.341+0000 7f38d1247700 1 Processor -- start 2023-10-18T12:20:25.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.341+0000 7f38d1247700 1 -- start start 2023-10-18T12:20:25.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.345+0000 7f38d1247700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f38cc159750 0x7f38cc070560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:25.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.345+0000 7f38d1247700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38cc0b14f0 con 0x7f38cc0ce040 2023-10-18T12:20:25.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.345+0000 7f38d1247700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38cc15d590 con 0x7f38cc070aa0 2023-10-18T12:20:25.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.345+0000 7f38d1247700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38cc0c9aa0 con 0x7f38cc159750 2023-10-18T12:20:25.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.345+0000 7f38cbfff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f38cc159750 0x7f38cc070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:25.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.345+0000 7f38cbfff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f38cc159750 0x7f38cc070560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:37384/0 (socket says 172.21.15.114:37384) 2023-10-18T12:20:25.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.345+0000 7f38cbfff700 1 -- 172.21.15.114:0/1912536399 learned_addr learned my addr 172.21.15.114:0/1912536399 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:25.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.345+0000 7f38d0a46700 1 --1- 172.21.15.114:0/1912536399 >> v1:172.21.15.114:6789/0 conn(0x7f38cc0ce040 0x7f38cc06cf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:43214/0 (socket says 172.21.15.114:43214) 2023-10-18T12:20:25.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.345+0000 7f38cbfff700 1 -- 172.21.15.114:0/1912536399 >> v1:172.21.15.172:6789/0 conn(0x7f38cc070aa0 legacy=0x7f38cc0cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:25.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.345+0000 7f38cbfff700 1 -- 172.21.15.114:0/1912536399 >> v1:172.21.15.114:6789/0 conn(0x7f38cc0ce040 legacy=0x7f38cc06cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:25.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.345+0000 7f38cbfff700 1 -- 172.21.15.114:0/1912536399 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38cc15d870 con 0x7f38cc159750 2023-10-18T12:20:25.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.349+0000 7f38cbfff700 1 --2- 172.21.15.114:0/1912536399 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38cc159750 0x7f38cc070560 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f38bc009e50 tx=0x7f38bc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b3dfca978371946 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:25.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.349+0000 7f38cb7fe700 1 -- 172.21.15.114:0/1912536399 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc00e070 con 0x7f38cc159750 2023-10-18T12:20:25.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.349+0000 7f38cb7fe700 1 -- 172.21.15.114:0/1912536399 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38bc00b9c0 con 0x7f38cc159750 2023-10-18T12:20:25.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.349+0000 7f38cb7fe700 1 -- 172.21.15.114:0/1912536399 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc00bd70 con 0x7f38cc159750 2023-10-18T12:20:25.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.349+0000 7f38d1247700 1 -- 172.21.15.114:0/1912536399 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38cc159750 msgr2=0x7f38cc070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:25.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.349+0000 7f38d1247700 1 --2- 172.21.15.114:0/1912536399 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38cc159750 0x7f38cc070560 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f38bc009e50 tx=0x7f38bc00b330 comp rx=0 tx=0).stop 2023-10-18T12:20:25.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.349+0000 7f38d1247700 1 -- 172.21.15.114:0/1912536399 shutdown_connections 2023-10-18T12:20:25.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.349+0000 7f38d1247700 1 --2- 172.21.15.114:0/1912536399 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38cc159750 0x7f38cc070560 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:25.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.349+0000 7f38d1247700 1 -- 172.21.15.114:0/1912536399 >> 172.21.15.114:0/1912536399 conn(0x7f38cc0ce5c0 msgr2=0x7f38cc0ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:25.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.349+0000 7f38d1247700 1 -- 172.21.15.114:0/1912536399 shutdown_connections 2023-10-18T12:20:25.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.349+0000 7f38d1247700 1 -- 172.21.15.114:0/1912536399 wait complete. 2023-10-18T12:20:25.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.353+0000 7f38d1247700 1 Processor -- start 2023-10-18T12:20:25.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.353+0000 7f38d1247700 1 -- start start 2023-10-18T12:20:25.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.353+0000 7f38d1247700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f38cc070aa0 0x7f38cc1f29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:25.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.353+0000 7f38d1247700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38cc0ce040 0x7f38cc0b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:25.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.353+0000 7f38d1247700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38cc159750 0x7f38cc1580c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:25.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.353+0000 7f38d1247700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38cc1f32a0 con 0x7f38cc070aa0 2023-10-18T12:20:25.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.353+0000 7f38d1247700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38cc1f3580 con 0x7f38cc0ce040 2023-10-18T12:20:25.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.353+0000 7f38d1247700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38cc1f3860 con 0x7f38cc159750 2023-10-18T12:20:25.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.353+0000 7f38cbfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f38cc070aa0 0x7f38cc1f29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:25.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.353+0000 7f38cbfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f38cc070aa0 0x7f38cc1f29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43850/0 (socket says 172.21.15.114:43850) 2023-10-18T12:20:25.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.353+0000 7f38cbfff700 1 -- 172.21.15.114:0/3001428625 learned_addr learned my addr 172.21.15.114:0/3001428625 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:25.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.353+0000 7f38d0a46700 1 --2- 172.21.15.114:0/3001428625 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38cc159750 0x7f38cc1580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:25.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.353+0000 7f38c37fe700 1 --2- 172.21.15.114:0/3001428625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38cc0ce040 0x7f38cc0b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:25.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.353+0000 7f38cbfff700 1 -- 172.21.15.114:0/3001428625 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38cc159750 msgr2=0x7f38cc1580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:25.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.353+0000 7f38cbfff700 1 --2- 172.21.15.114:0/3001428625 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38cc159750 0x7f38cc1580c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:25.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.353+0000 7f38cbfff700 1 -- 172.21.15.114:0/3001428625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38cc0ce040 msgr2=0x7f38cc0b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:25.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.353+0000 7f38cbfff700 1 --2- 172.21.15.114:0/3001428625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38cc0ce040 0x7f38cc0b1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:25.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.353+0000 7f38cbfff700 1 -- 172.21.15.114:0/3001428625 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38bc009b30 con 0x7f38cc070aa0 2023-10-18T12:20:25.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.353+0000 7f38d0a46700 1 --2- 172.21.15.114:0/3001428625 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38cc159750 0x7f38cc1580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:20:25.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.353+0000 7f38c37fe700 1 --2- 172.21.15.114:0/3001428625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38cc0ce040 0x7f38cc0b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:20:25.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.353+0000 7f38cbfff700 1 --2- 172.21.15.114:0/3001428625 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f38cc070aa0 0x7f38cc1f29b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f38cc06b0f0 tx=0x7f38bc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:25.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.353+0000 7f38c97fa700 1 -- 172.21.15.114:0/3001428625 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc0099b0 con 0x7f38cc070aa0 2023-10-18T12:20:25.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.353+0000 7f38c97fa700 1 -- 172.21.15.114:0/3001428625 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38bc0092e0 con 0x7f38cc070aa0 2023-10-18T12:20:25.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.353+0000 7f38d1247700 1 -- 172.21.15.114:0/3001428625 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38cc0b1720 con 0x7f38cc070aa0 2023-10-18T12:20:25.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.357+0000 7f38c97fa700 1 -- 172.21.15.114:0/3001428625 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38bc01b630 con 0x7f38cc070aa0 2023-10-18T12:20:25.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.357+0000 7f38d1247700 1 -- 172.21.15.114:0/3001428625 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38cc1f2ef0 con 0x7f38cc070aa0 2023-10-18T12:20:25.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.357+0000 7f38d1247700 1 -- 172.21.15.114:0/3001428625 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38cc0b1c40 con 0x7f38cc070aa0 2023-10-18T12:20:25.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.357+0000 7f38c97fa700 1 -- 172.21.15.114:0/3001428625 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f38bc01b790 con 0x7f38cc070aa0 2023-10-18T12:20:25.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.361+0000 7f38c97fa700 1 --2- 172.21.15.114:0/3001428625 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f38ac0656f0 0x7f38ac067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:25.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.361+0000 7f38c97fa700 1 -- 172.21.15.114:0/3001428625 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f38bc084850 con 0x7f38cc070aa0 2023-10-18T12:20:25.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.361+0000 7f38c37fe700 1 --2- 172.21.15.114:0/3001428625 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f38ac0656f0 0x7f38ac067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:25.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.361+0000 7f38c37fe700 1 --2- 172.21.15.114:0/3001428625 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f38ac0656f0 0x7f38ac067bb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f38cc158cd0 tx=0x7f38b4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:25.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.365+0000 7f38c97fa700 1 -- 172.21.15.114:0/3001428625 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f38cc0b1c40 con 0x7f38cc070aa0 2023-10-18T12:20:25.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.541+0000 7f38d1247700 1 -- 172.21.15.114:0/3001428625 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f38cc0b1c40 con 0x7f38cc070aa0 2023-10-18T12:20:25.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.545+0000 7f38c97fa700 1 -- 172.21.15.114:0/3001428625 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f38cc0b1c40 con 0x7f38cc070aa0 2023-10-18T12:20:25.549 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-10-18T12:20:25.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.545+0000 7f38d1247700 1 -- 172.21.15.114:0/3001428625 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f38ac0656f0 msgr2=0x7f38ac067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:25.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.545+0000 7f38d1247700 1 --2- 172.21.15.114:0/3001428625 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f38ac0656f0 0x7f38ac067bb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f38cc158cd0 tx=0x7f38b4009040 comp rx=0 tx=0).stop 2023-10-18T12:20:25.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.545+0000 7f38d1247700 1 -- 172.21.15.114:0/3001428625 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f38cc070aa0 msgr2=0x7f38cc1f29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:25.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.545+0000 7f38d1247700 1 --2- 172.21.15.114:0/3001428625 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f38cc070aa0 0x7f38cc1f29b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f38cc06b0f0 tx=0x7f38bc004af0 comp rx=0 tx=0).stop 2023-10-18T12:20:25.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.545+0000 7f38d1247700 1 -- 172.21.15.114:0/3001428625 shutdown_connections 2023-10-18T12:20:25.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.545+0000 7f38d1247700 1 --2- 172.21.15.114:0/3001428625 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f38ac0656f0 0x7f38ac067bb0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:25.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.545+0000 7f38d1247700 1 --2- 172.21.15.114:0/3001428625 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f38cc159750 0x7f38cc1580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:25.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.545+0000 7f38d1247700 1 --2- 172.21.15.114:0/3001428625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f38cc0ce040 0x7f38cc0b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:25.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.545+0000 7f38d1247700 1 --2- 172.21.15.114:0/3001428625 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f38cc070aa0 0x7f38cc1f29b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:25.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.545+0000 7f38d1247700 1 -- 172.21.15.114:0/3001428625 >> 172.21.15.114:0/3001428625 conn(0x7f38cc0ce5c0 msgr2=0x7f38cc070080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:25.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.545+0000 7f38d1247700 1 -- 172.21.15.114:0/3001428625 shutdown_connections 2023-10-18T12:20:25.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.545+0000 7f38d1247700 1 -- 172.21.15.114:0/3001428625 wait complete. 2023-10-18T12:20:25.576 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-18T12:20:25.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.761+0000 7f375e674700 1 Processor -- start 2023-10-18T12:20:25.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.765+0000 7f375e674700 1 -- start start 2023-10-18T12:20:25.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.765+0000 7f375e674700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f37580c52d0 0x7f37580ca9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:25.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.765+0000 7f375e674700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f37580705d0 0x7f37580caf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:25.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.765+0000 7f375e674700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37580c56b0 con 0x7f37580ce950 2023-10-18T12:20:25.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.765+0000 7f375e674700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3758159df0 con 0x7f37580705d0 2023-10-18T12:20:25.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.765+0000 7f375e674700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375806bbc0 con 0x7f37580c52d0 2023-10-18T12:20:25.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.769+0000 7f375d672700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f37580c52d0 0x7f37580ca9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:25.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.769+0000 7f375ce71700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f37580705d0 0x7f37580caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:25.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.769+0000 7f375d672700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f37580c52d0 0x7f37580ca9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.114:54590/0 (socket says 172.21.15.114:54590) 2023-10-18T12:20:25.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.769+0000 7f375d672700 1 -- 172.21.15.114:0/403572979 learned_addr learned my addr 172.21.15.114:0/403572979 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:25.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.769+0000 7f375ce71700 1 -- 172.21.15.114:0/403572979 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f37580c52d0 msgr2=0x7f37580ca9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:25.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.769+0000 7f375ce71700 1 --2- 172.21.15.114:0/403572979 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f37580c52d0 0x7f37580ca9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:25.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.769+0000 7f375ce71700 1 -- 172.21.15.114:0/403572979 >> v1:172.21.15.172:6789/0 conn(0x7f37580ce950 legacy=0x7f375815d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:25.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.769+0000 7f375ce71700 1 -- 172.21.15.114:0/403572979 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3758159fe0 con 0x7f37580705d0 2023-10-18T12:20:25.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.769+0000 7f375d672700 1 --2- 172.21.15.114:0/403572979 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f37580c52d0 0x7f37580ca9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:20:25.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.769+0000 7f374ffff700 1 -- 172.21.15.114:0/403572979 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2830651903 0 0) 0x7f37580c56b0 con 0x7f37580ce950 2023-10-18T12:20:25.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.769+0000 7f375ce71700 1 --2- 172.21.15.114:0/403572979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37580705d0 0x7f37580caf00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f374800baf0 tx=0x7f374800be00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d5c1a125df7c316 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:25.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.769+0000 7f374ffff700 1 -- 172.21.15.114:0/403572979 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374800dc70 con 0x7f37580705d0 2023-10-18T12:20:25.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.769+0000 7f374ffff700 1 -- 172.21.15.114:0/403572979 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374800ddd0 con 0x7f37580705d0 2023-10-18T12:20:25.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.769+0000 7f374ffff700 1 -- 172.21.15.114:0/403572979 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3748010690 con 0x7f37580705d0 2023-10-18T12:20:25.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.773+0000 7f375e674700 1 -- 172.21.15.114:0/403572979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37580705d0 msgr2=0x7f37580caf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:25.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.773+0000 7f375e674700 1 --2- 172.21.15.114:0/403572979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37580705d0 0x7f37580caf00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f374800baf0 tx=0x7f374800be00 comp rx=0 tx=0).stop 2023-10-18T12:20:25.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.773+0000 7f375e674700 1 -- 172.21.15.114:0/403572979 shutdown_connections 2023-10-18T12:20:25.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.773+0000 7f375e674700 1 --2- 172.21.15.114:0/403572979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37580705d0 0x7f37580caf00 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:25.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.773+0000 7f375e674700 1 --2- 172.21.15.114:0/403572979 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f37580c52d0 0x7f37580ca9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:25.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.773+0000 7f375e674700 1 -- 172.21.15.114:0/403572979 >> 172.21.15.114:0/403572979 conn(0x7f37580cb920 msgr2=0x7f37580cbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:25.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.773+0000 7f375e674700 1 -- 172.21.15.114:0/403572979 shutdown_connections 2023-10-18T12:20:25.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.773+0000 7f375e674700 1 -- 172.21.15.114:0/403572979 wait complete. 2023-10-18T12:20:25.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.773+0000 7f375e674700 1 Processor -- start 2023-10-18T12:20:25.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.773+0000 7f375e674700 1 -- start start 2023-10-18T12:20:25.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.777+0000 7f375e674700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37580705d0 0x7f3758148580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:25.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.777+0000 7f375e674700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37580c52d0 0x7f37580b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:25.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.777+0000 7f375e674700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f37580ce950 0x7f37581479c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:25.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.777+0000 7f375e674700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37580b1ba0 con 0x7f37580c52d0 2023-10-18T12:20:25.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.777+0000 7f375e674700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37580b1df0 con 0x7f37580705d0 2023-10-18T12:20:25.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.777+0000 7f375e674700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37580b20d0 con 0x7f37580ce950 2023-10-18T12:20:25.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.777+0000 7f375ce71700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37580c52d0 0x7f37580b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:25.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.777+0000 7f375ce71700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37580c52d0 0x7f37580b2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43854/0 (socket says 172.21.15.114:43854) 2023-10-18T12:20:25.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.777+0000 7f375ce71700 1 -- 172.21.15.114:0/1692983792 learned_addr learned my addr 172.21.15.114:0/1692983792 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:25.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.777+0000 7f375d672700 1 --2- 172.21.15.114:0/1692983792 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37580705d0 0x7f3758148580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:25.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.777+0000 7f375de73700 1 --2- 172.21.15.114:0/1692983792 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f37580ce950 0x7f37581479c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:25.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.777+0000 7f375ce71700 1 -- 172.21.15.114:0/1692983792 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f37580ce950 msgr2=0x7f37581479c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:25.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.777+0000 7f375ce71700 1 --2- 172.21.15.114:0/1692983792 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f37580ce950 0x7f37581479c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:25.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.777+0000 7f375ce71700 1 -- 172.21.15.114:0/1692983792 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37580705d0 msgr2=0x7f3758148580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:25.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.777+0000 7f375ce71700 1 --2- 172.21.15.114:0/1692983792 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37580705d0 0x7f3758148580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:25.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.777+0000 7f375ce71700 1 -- 172.21.15.114:0/1692983792 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3754009570 con 0x7f37580c52d0 2023-10-18T12:20:25.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.777+0000 7f375ce71700 1 --2- 172.21.15.114:0/1692983792 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37580c52d0 0x7f37580b2e90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f374800b2c0 tx=0x7f3748004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:25.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.777+0000 7f374dffb700 1 -- 172.21.15.114:0/1692983792 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3748003c90 con 0x7f37580c52d0 2023-10-18T12:20:25.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.777+0000 7f374dffb700 1 -- 172.21.15.114:0/1692983792 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3748003df0 con 0x7f37580c52d0 2023-10-18T12:20:25.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.777+0000 7f375e674700 1 -- 172.21.15.114:0/1692983792 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f374800b750 con 0x7f37580c52d0 2023-10-18T12:20:25.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.777+0000 7f374dffb700 1 -- 172.21.15.114:0/1692983792 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37480106b0 con 0x7f37580c52d0 2023-10-18T12:20:25.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.777+0000 7f375e674700 1 -- 172.21.15.114:0/1692983792 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37580b2690 con 0x7f37580c52d0 2023-10-18T12:20:25.787 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.781+0000 7f375e674700 1 -- 172.21.15.114:0/1692983792 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f375804e910 con 0x7f37580c52d0 2023-10-18T12:20:25.787 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.781+0000 7f374dffb700 1 -- 172.21.15.114:0/1692983792 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f374802a430 con 0x7f37580c52d0 2023-10-18T12:20:25.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.785+0000 7f374dffb700 1 --2- 172.21.15.114:0/1692983792 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f373c065720 0x7f373c067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:25.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.785+0000 7f374dffb700 1 -- 172.21.15.114:0/1692983792 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f37480840b0 con 0x7f37580c52d0 2023-10-18T12:20:25.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.785+0000 7f375d672700 1 --2- 172.21.15.114:0/1692983792 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f373c065720 0x7f373c067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:25.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.785+0000 7f375d672700 1 --2- 172.21.15.114:0/1692983792 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f373c065720 0x7f373c067be0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f37580c4df0 tx=0x7f37540092e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:25.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.789+0000 7f374dffb700 1 -- 172.21.15.114:0/1692983792 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f37480518d0 con 0x7f37580c52d0 2023-10-18T12:20:25.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.969+0000 7f375e674700 1 -- 172.21.15.114:0/1692983792 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f37580c4b40 con 0x7f37580c52d0 2023-10-18T12:20:25.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.973+0000 7f374dffb700 1 -- 172.21.15.114:0/1692983792 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3748054ef0 con 0x7f37580c52d0 2023-10-18T12:20:25.977 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-10-18T12:20:25.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.977+0000 7f375e674700 1 -- 172.21.15.114:0/1692983792 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f373c065720 msgr2=0x7f373c067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:25.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.977+0000 7f375e674700 1 --2- 172.21.15.114:0/1692983792 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f373c065720 0x7f373c067be0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f37580c4df0 tx=0x7f37540092e0 comp rx=0 tx=0).stop 2023-10-18T12:20:25.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.977+0000 7f375e674700 1 -- 172.21.15.114:0/1692983792 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37580c52d0 msgr2=0x7f37580b2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:25.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.977+0000 7f375e674700 1 --2- 172.21.15.114:0/1692983792 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37580c52d0 0x7f37580b2e90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f374800b2c0 tx=0x7f3748004770 comp rx=0 tx=0).stop 2023-10-18T12:20:25.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.977+0000 7f375e674700 1 -- 172.21.15.114:0/1692983792 shutdown_connections 2023-10-18T12:20:25.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.977+0000 7f375e674700 1 --2- 172.21.15.114:0/1692983792 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f373c065720 0x7f373c067be0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:25.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.977+0000 7f375e674700 1 --2- 172.21.15.114:0/1692983792 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f37580ce950 0x7f37581479c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:25.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.977+0000 7f375e674700 1 --2- 172.21.15.114:0/1692983792 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f37580c52d0 0x7f37580b2e90 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:25.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.977+0000 7f375e674700 1 --2- 172.21.15.114:0/1692983792 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37580705d0 0x7f3758148580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:25.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.977+0000 7f375e674700 1 -- 172.21.15.114:0/1692983792 >> 172.21.15.114:0/1692983792 conn(0x7f37580cb920 msgr2=0x7f37580cb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:25.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.977+0000 7f375e674700 1 -- 172.21.15.114:0/1692983792 shutdown_connections 2023-10-18T12:20:25.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:25.977+0000 7f375e674700 1 -- 172.21.15.114:0/1692983792 wait complete. 2023-10-18T12:20:26.003 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-18T12:20:26.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.181+0000 7f83e17ed700 1 Processor -- start 2023-10-18T12:20:26.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.181+0000 7f83e17ed700 1 -- start start 2023-10-18T12:20:26.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.181+0000 7f83e17ed700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f83dc159750 0x7f83dc070560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:26.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.181+0000 7f83e17ed700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f83dc070aa0 0x7f83dc0cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:26.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.181+0000 7f83e17ed700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f83dc0cde70 0x7f83dc0cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:26.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.181+0000 7f83e17ed700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83dc0c9aa0 con 0x7f83dc070aa0 2023-10-18T12:20:26.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.181+0000 7f83e17ed700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83dc070f30 con 0x7f83dc159750 2023-10-18T12:20:26.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.181+0000 7f83e17ed700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc0b14f0 con 0x7f83dc0cde70 2023-10-18T12:20:26.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.181+0000 7f83d3fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f83dc070aa0 0x7f83dc0cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:26.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.181+0000 7f83d3fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f83dc070aa0 0x7f83dc0cd930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43870/0 (socket says 172.21.15.114:43870) 2023-10-18T12:20:26.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.181+0000 7f83d3fff700 1 -- 172.21.15.114:0/133382250 learned_addr learned my addr 172.21.15.114:0/133382250 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:26.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.181+0000 7f83daffd700 1 --2- 172.21.15.114:0/133382250 >> v2:172.21.15.172:3300/0 conn(0x7f83dc159750 0x7f83dc070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:26.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.181+0000 7f83db7fe700 1 --2- 172.21.15.114:0/133382250 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f83dc0cde70 0x7f83dc0cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:26.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.185+0000 7f83d3fff700 1 -- 172.21.15.114:0/133382250 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f83dc0cde70 msgr2=0x7f83dc0cc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:26.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.185+0000 7f83d3fff700 1 --2- 172.21.15.114:0/133382250 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f83dc0cde70 0x7f83dc0cc6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:26.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.185+0000 7f83d3fff700 1 -- 172.21.15.114:0/133382250 >> v2:172.21.15.172:3300/0 conn(0x7f83dc159750 msgr2=0x7f83dc070560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:26.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.185+0000 7f83d3fff700 1 --2- 172.21.15.114:0/133382250 >> v2:172.21.15.172:3300/0 conn(0x7f83dc159750 0x7f83dc070560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:26.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.185+0000 7f83d3fff700 1 -- 172.21.15.114:0/133382250 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83dc15d590 con 0x7f83dc070aa0 2023-10-18T12:20:26.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.185+0000 7f83d3fff700 1 --2- 172.21.15.114:0/133382250 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83dc070aa0 0x7f83dc0cd930 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f83dc06b330 tx=0x7f83c4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f42a6d794a4c9e36 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:26.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.185+0000 7f83da7fc700 1 -- 172.21.15.114:0/133382250 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c4011830 con 0x7f83dc070aa0 2023-10-18T12:20:26.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.185+0000 7f83da7fc700 1 -- 172.21.15.114:0/133382250 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c4011990 con 0x7f83dc070aa0 2023-10-18T12:20:26.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.185+0000 7f83da7fc700 1 -- 172.21.15.114:0/133382250 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c4011d40 con 0x7f83dc070aa0 2023-10-18T12:20:26.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.185+0000 7f83e17ed700 1 -- 172.21.15.114:0/133382250 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83dc070aa0 msgr2=0x7f83dc0cd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:26.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.185+0000 7f83e17ed700 1 --2- 172.21.15.114:0/133382250 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83dc070aa0 0x7f83dc0cd930 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f83dc06b330 tx=0x7f83c4009c20 comp rx=0 tx=0).stop 2023-10-18T12:20:26.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.185+0000 7f83e17ed700 1 -- 172.21.15.114:0/133382250 shutdown_connections 2023-10-18T12:20:26.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.185+0000 7f83e17ed700 1 --2- 172.21.15.114:0/133382250 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f83dc0cde70 0x7f83dc0cc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:26.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.185+0000 7f83e17ed700 1 --2- 172.21.15.114:0/133382250 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83dc070aa0 0x7f83dc0cd930 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:26.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.185+0000 7f83e17ed700 1 --2- 172.21.15.114:0/133382250 >> v2:172.21.15.172:3300/0 conn(0x7f83dc159750 0x7f83dc070560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:26.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.185+0000 7f83e17ed700 1 -- 172.21.15.114:0/133382250 >> 172.21.15.114:0/133382250 conn(0x7f83dc0ce5c0 msgr2=0x7f83dc0ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:26.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.185+0000 7f83e17ed700 1 -- 172.21.15.114:0/133382250 shutdown_connections 2023-10-18T12:20:26.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.185+0000 7f83e17ed700 1 -- 172.21.15.114:0/133382250 wait complete. 2023-10-18T12:20:26.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.189+0000 7f83e17ed700 1 Processor -- start 2023-10-18T12:20:26.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.189+0000 7f83e17ed700 1 -- start start 2023-10-18T12:20:26.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.189+0000 7f83e17ed700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83dc0cde70 0x7f83dc142510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:26.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.189+0000 7f83e17ed700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83dc159750 0x7f83dc14a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:26.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.189+0000 7f83e17ed700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f83dc142090 0x7f83dc0c3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:26.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.189+0000 7f83e17ed700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc142ba0 con 0x7f83dc0cde70 2023-10-18T12:20:26.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.189+0000 7f83e17ed700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc142e80 con 0x7f83dc159750 2023-10-18T12:20:26.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.189+0000 7f83e17ed700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc143160 con 0x7f83dc142090 2023-10-18T12:20:26.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.189+0000 7f83daffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83dc0cde70 0x7f83dc142510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:26.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.189+0000 7f83daffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83dc0cde70 0x7f83dc142510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43872/0 (socket says 172.21.15.114:43872) 2023-10-18T12:20:26.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.189+0000 7f83daffd700 1 -- 172.21.15.114:0/2546702085 learned_addr learned my addr 172.21.15.114:0/2546702085 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:26.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.193+0000 7f83d3fff700 1 --2- 172.21.15.114:0/2546702085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83dc159750 0x7f83dc14a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:26.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.193+0000 7f83db7fe700 1 --2- 172.21.15.114:0/2546702085 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f83dc142090 0x7f83dc0c3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:26.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.193+0000 7f83daffd700 1 -- 172.21.15.114:0/2546702085 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f83dc142090 msgr2=0x7f83dc0c3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:26.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.193+0000 7f83daffd700 1 --2- 172.21.15.114:0/2546702085 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f83dc142090 0x7f83dc0c3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:26.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.193+0000 7f83daffd700 1 -- 172.21.15.114:0/2546702085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83dc159750 msgr2=0x7f83dc14a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:26.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.193+0000 7f83daffd700 1 --2- 172.21.15.114:0/2546702085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83dc159750 0x7f83dc14a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:26.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.193+0000 7f83daffd700 1 -- 172.21.15.114:0/2546702085 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c4009570 con 0x7f83dc0cde70 2023-10-18T12:20:26.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.193+0000 7f83daffd700 1 --2- 172.21.15.114:0/2546702085 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83dc0cde70 0x7f83dc142510 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f83cc00e840 tx=0x7f83cc00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:26.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.193+0000 7f83d37fe700 1 -- 172.21.15.114:0/2546702085 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83cc0095a0 con 0x7f83dc0cde70 2023-10-18T12:20:26.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.193+0000 7f83d37fe700 1 -- 172.21.15.114:0/2546702085 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83cc013680 con 0x7f83dc0cde70 2023-10-18T12:20:26.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.193+0000 7f83d37fe700 1 -- 172.21.15.114:0/2546702085 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83cc0139f0 con 0x7f83dc0cde70 2023-10-18T12:20:26.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.193+0000 7f83e17ed700 1 -- 172.21.15.114:0/2546702085 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83dc143440 con 0x7f83dc0cde70 2023-10-18T12:20:26.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.193+0000 7f83e17ed700 1 -- 172.21.15.114:0/2546702085 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83dc14aed0 con 0x7f83dc0cde70 2023-10-18T12:20:26.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.193+0000 7f83e17ed700 1 -- 172.21.15.114:0/2546702085 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83dc04e910 con 0x7f83dc0cde70 2023-10-18T12:20:26.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.197+0000 7f83d37fe700 1 -- 172.21.15.114:0/2546702085 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f83cc013b50 con 0x7f83dc0cde70 2023-10-18T12:20:26.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.197+0000 7f83d37fe700 1 --2- 172.21.15.114:0/2546702085 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f83bc0656f0 0x7f83bc067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:26.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.197+0000 7f83d37fe700 1 -- 172.21.15.114:0/2546702085 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f83cc082e80 con 0x7f83dc0cde70 2023-10-18T12:20:26.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.197+0000 7f83d3fff700 1 --2- 172.21.15.114:0/2546702085 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f83bc0656f0 0x7f83bc067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:26.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.201+0000 7f83d3fff700 1 --2- 172.21.15.114:0/2546702085 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f83bc0656f0 0x7f83bc067bb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f83dc070e80 tx=0x7f83c4008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:26.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.205+0000 7f83d37fe700 1 -- 172.21.15.114:0/2546702085 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f83cc054130 con 0x7f83dc0cde70 2023-10-18T12:20:26.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.385+0000 7f83e17ed700 1 -- 172.21.15.114:0/2546702085 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f83dc0c9be0 con 0x7f83dc0cde70 2023-10-18T12:20:26.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.385+0000 7f83d37fe700 1 -- 172.21.15.114:0/2546702085 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f83cc021020 con 0x7f83dc0cde70 2023-10-18T12:20:26.390 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-10-18T12:20:26.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.389+0000 7f83e17ed700 1 -- 172.21.15.114:0/2546702085 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f83bc0656f0 msgr2=0x7f83bc067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:26.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.389+0000 7f83e17ed700 1 --2- 172.21.15.114:0/2546702085 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f83bc0656f0 0x7f83bc067bb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f83dc070e80 tx=0x7f83c4008030 comp rx=0 tx=0).stop 2023-10-18T12:20:26.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.389+0000 7f83e17ed700 1 -- 172.21.15.114:0/2546702085 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83dc0cde70 msgr2=0x7f83dc142510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:26.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.389+0000 7f83e17ed700 1 --2- 172.21.15.114:0/2546702085 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83dc0cde70 0x7f83dc142510 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f83cc00e840 tx=0x7f83cc00eb50 comp rx=0 tx=0).stop 2023-10-18T12:20:26.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.389+0000 7f83e17ed700 1 -- 172.21.15.114:0/2546702085 shutdown_connections 2023-10-18T12:20:26.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.389+0000 7f83e17ed700 1 --2- 172.21.15.114:0/2546702085 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f83bc0656f0 0x7f83bc067bb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:26.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.389+0000 7f83e17ed700 1 --2- 172.21.15.114:0/2546702085 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f83dc142090 0x7f83dc0c3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:26.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.389+0000 7f83e17ed700 1 --2- 172.21.15.114:0/2546702085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83dc159750 0x7f83dc14a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:26.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.389+0000 7f83e17ed700 1 --2- 172.21.15.114:0/2546702085 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83dc0cde70 0x7f83dc142510 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:26.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.389+0000 7f83e17ed700 1 -- 172.21.15.114:0/2546702085 >> 172.21.15.114:0/2546702085 conn(0x7f83dc0ce5c0 msgr2=0x7f83dc0cd2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:26.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.389+0000 7f83e17ed700 1 -- 172.21.15.114:0/2546702085 shutdown_connections 2023-10-18T12:20:26.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.389+0000 7f83e17ed700 1 -- 172.21.15.114:0/2546702085 wait complete. 2023-10-18T12:20:26.414 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T12:20:26.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.585+0000 7f1a296df700 1 Processor -- start 2023-10-18T12:20:26.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.585+0000 7f1a296df700 1 -- start start 2023-10-18T12:20:26.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.585+0000 7f1a296df700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1a240cb8a0 0x7f1a2406f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:26.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.585+0000 7f1a296df700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a2415e130 con 0x7f1a24154040 2023-10-18T12:20:26.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.585+0000 7f1a296df700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a240ce1b0 con 0x7f1a2406e8a0 2023-10-18T12:20:26.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.589+0000 7f1a296df700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a240cdfa0 con 0x7f1a240cb8a0 2023-10-18T12:20:26.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.589+0000 7f1a22ffd700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f1a24154040 0x7f1a240cc680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:43224/0 (socket says 172.21.15.114:43224) 2023-10-18T12:20:26.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.589+0000 7f1a22ffd700 1 -- 172.21.15.114:0/1904222207 learned_addr learned my addr 172.21.15.114:0/1904222207 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:26.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.589+0000 7f1a237fe700 1 --2- 172.21.15.114:0/1904222207 >> v2:172.21.15.172:3300/0 conn(0x7f1a240cb8a0 0x7f1a2406f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:26.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.589+0000 7f1a227fc700 1 -- 172.21.15.114:0/1904222207 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1415527673 0 0) 0x7f1a2415e130 con 0x7f1a24154040 2023-10-18T12:20:26.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.589+0000 7f1a227fc700 1 -- 172.21.15.114:0/1904222207 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a100035d0 con 0x7f1a24154040 2023-10-18T12:20:26.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.589+0000 7f1a237fe700 1 -- 172.21.15.114:0/1904222207 >> v1:172.21.15.172:6789/0 conn(0x7f1a2406e8a0 legacy=0x7f1a240cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:26.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.589+0000 7f1a237fe700 1 -- 172.21.15.114:0/1904222207 >> v1:172.21.15.114:6789/0 conn(0x7f1a24154040 legacy=0x7f1a240cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:26.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.589+0000 7f1a227fc700 1 -- 172.21.15.114:0/1904222207 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2829699960 0 0) 0x7f1a100035d0 con 0x7f1a24154040 2023-10-18T12:20:26.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.589+0000 7f1a237fe700 1 -- 172.21.15.114:0/1904222207 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a240ce490 con 0x7f1a240cb8a0 2023-10-18T12:20:26.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.589+0000 7f1a237fe700 1 --2- 172.21.15.114:0/1904222207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a240cb8a0 0x7f1a2406f970 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c009d90 tx=0x7f1a1c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6e73c6f32c74f89 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:26.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.589+0000 7f1a227fc700 1 -- 172.21.15.114:0/1904222207 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c00e070 con 0x7f1a240cb8a0 2023-10-18T12:20:26.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.589+0000 7f1a227fc700 1 -- 172.21.15.114:0/1904222207 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1c003a40 con 0x7f1a240cb8a0 2023-10-18T12:20:26.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.589+0000 7f1a227fc700 1 -- 172.21.15.114:0/1904222207 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a14001670 con 0x7f1a240cb8a0 2023-10-18T12:20:26.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.589+0000 7f1a296df700 1 -- 172.21.15.114:0/1904222207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a240cb8a0 msgr2=0x7f1a2406f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:26.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.589+0000 7f1a296df700 1 --2- 172.21.15.114:0/1904222207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a240cb8a0 0x7f1a2406f970 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c009d90 tx=0x7f1a1c00b330 comp rx=0 tx=0).stop 2023-10-18T12:20:26.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.589+0000 7f1a296df700 1 -- 172.21.15.114:0/1904222207 shutdown_connections 2023-10-18T12:20:26.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.589+0000 7f1a296df700 1 --2- 172.21.15.114:0/1904222207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a240cb8a0 0x7f1a2406f970 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:26.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.589+0000 7f1a296df700 1 -- 172.21.15.114:0/1904222207 >> 172.21.15.114:0/1904222207 conn(0x7f1a2406a340 msgr2=0x7f1a240b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:26.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.589+0000 7f1a296df700 1 -- 172.21.15.114:0/1904222207 shutdown_connections 2023-10-18T12:20:26.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.589+0000 7f1a296df700 1 -- 172.21.15.114:0/1904222207 wait complete. 2023-10-18T12:20:26.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.593+0000 7f1a296df700 1 Processor -- start 2023-10-18T12:20:26.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.593+0000 7f1a296df700 1 -- start start 2023-10-18T12:20:26.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.593+0000 7f1a296df700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a2406e8a0 0x7f1a240aafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:26.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.593+0000 7f1a296df700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a240cb8a0 0x7f1a2415eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:26.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.593+0000 7f1a296df700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1a24154040 0x7f1a2415f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:26.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.593+0000 7f1a296df700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a240b3690 con 0x7f1a2406e8a0 2023-10-18T12:20:26.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.593+0000 7f1a296df700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a24154460 con 0x7f1a240cb8a0 2023-10-18T12:20:26.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.593+0000 7f1a296df700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a24146e20 con 0x7f1a24154040 2023-10-18T12:20:26.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.593+0000 7f1a22ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a2406e8a0 0x7f1a240aafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:26.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.593+0000 7f1a22ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a2406e8a0 0x7f1a240aafd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43878/0 (socket says 172.21.15.114:43878) 2023-10-18T12:20:26.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.597+0000 7f1a22ffd700 1 -- 172.21.15.114:0/3163556187 learned_addr learned my addr 172.21.15.114:0/3163556187 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:26.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.597+0000 7f1a237fe700 1 --2- 172.21.15.114:0/3163556187 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1a24154040 0x7f1a2415f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:26.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.597+0000 7f1a1a7fc700 1 --2- 172.21.15.114:0/3163556187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a240cb8a0 0x7f1a2415eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:26.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.597+0000 7f1a22ffd700 1 -- 172.21.15.114:0/3163556187 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1a24154040 msgr2=0x7f1a2415f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:26.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.597+0000 7f1a22ffd700 1 --2- 172.21.15.114:0/3163556187 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1a24154040 0x7f1a2415f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:26.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.597+0000 7f1a22ffd700 1 -- 172.21.15.114:0/3163556187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a240cb8a0 msgr2=0x7f1a2415eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:26.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.597+0000 7f1a22ffd700 1 --2- 172.21.15.114:0/3163556187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a240cb8a0 0x7f1a2415eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:26.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.597+0000 7f1a22ffd700 1 -- 172.21.15.114:0/3163556187 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a1c009a70 con 0x7f1a2406e8a0 2023-10-18T12:20:26.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.597+0000 7f1a22ffd700 1 --2- 172.21.15.114:0/3163556187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a2406e8a0 0x7f1a240aafd0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1a1400c570 tx=0x7f1a1400c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:26.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.597+0000 7f1a1bfff700 1 -- 172.21.15.114:0/3163556187 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a14004ca0 con 0x7f1a2406e8a0 2023-10-18T12:20:26.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.597+0000 7f1a296df700 1 -- 172.21.15.114:0/3163556187 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a240b33b0 con 0x7f1a2406e8a0 2023-10-18T12:20:26.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.597+0000 7f1a1bfff700 1 -- 172.21.15.114:0/3163556187 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a14004e20 con 0x7f1a2406e8a0 2023-10-18T12:20:26.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.597+0000 7f1a1bfff700 1 -- 172.21.15.114:0/3163556187 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a14007310 con 0x7f1a2406e8a0 2023-10-18T12:20:26.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.597+0000 7f1a296df700 1 -- 172.21.15.114:0/3163556187 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a24146ab0 con 0x7f1a2406e8a0 2023-10-18T12:20:26.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.597+0000 7f1a296df700 1 -- 172.21.15.114:0/3163556187 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a24146630 con 0x7f1a2406e8a0 2023-10-18T12:20:26.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.601+0000 7f1a1bfff700 1 -- 172.21.15.114:0/3163556187 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f1a14007470 con 0x7f1a2406e8a0 2023-10-18T12:20:26.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.601+0000 7f1a1bfff700 1 --2- 172.21.15.114:0/3163556187 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1a040656f0 0x7f1a04067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:26.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.601+0000 7f1a1bfff700 1 -- 172.21.15.114:0/3163556187 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1a140832f0 con 0x7f1a2406e8a0 2023-10-18T12:20:26.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.605+0000 7f1a1a7fc700 1 --2- 172.21.15.114:0/3163556187 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1a040656f0 0x7f1a04067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:26.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.605+0000 7f1a1a7fc700 1 --2- 172.21.15.114:0/3163556187 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1a040656f0 0x7f1a04067bb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1a2415fa90 tx=0x7f1a0c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:26.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.605+0000 7f1a1bfff700 1 -- 172.21.15.114:0/3163556187 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f1a14050bf0 con 0x7f1a2406e8a0 2023-10-18T12:20:26.787 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.781+0000 7f1a296df700 1 -- 172.21.15.114:0/3163556187 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a24146630 con 0x7f1a2406e8a0 2023-10-18T12:20:26.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.785+0000 7f1a1bfff700 1 -- 172.21.15.114:0/3163556187 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20240 (secure 0 0 0) 0x7f1a24146630 con 0x7f1a2406e8a0 2023-10-18T12:20:26.790 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:20:26.790 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":30,"fsid":"240ea340-5d3d-4f52-a4bc-af075aca3deb","created":"2023-10-18T12:19:12.512994+0000","modified":"2023-10-18T12:20:20.604528+0000","last_up_change":"2023-10-18T12:19:25.286009+0000","last_in_change":"2023-10-18T12:19:15.850693+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T12:19:27.040638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-18T12:19:32.358094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-18T12:19:37.333855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-18T12:19:38.055385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-18T12:19:41.679218+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c3578978-1a03-4857-b9d2-34a5da3d7731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6817","nonce":1506287862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6820","nonce":1506287862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6830","nonce":1506287862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6825","nonce":1506287862}]},"public_addr":"172.21.15.114:6817/1506287862","cluster_addr":"172.21.15.114:6820/1506287862","heartbeat_back_addr":"172.21.15.114:6830/1506287862","heartbeat_front_addr":"172.21.15.114:6825/1506287862","state":["exists","up"]},{"osd":1,"uuid":"43eb26a6-e2b3-4670-9559-bd053b5140d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6801","nonce":3302727047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6803","nonce":3302727047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6807","nonce":3302727047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6805","nonce":3302727047}]},"public_addr":"172.21.15.114:6801/3302727047","cluster_addr":"172.21.15.114:6803/3302727047","heartbeat_back_addr":"172.21.15.114:6807/3302727047","heartbeat_front_addr":"172.21.15.114:6805/3302727047","state":["exists","up"]},{"osd":2,"uuid":"f3d4dbd5-521c-4dd2-b687-5768cc7d0938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6809","nonce":2699151351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6811","nonce":2699151351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6815","nonce":2699151351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6813","nonce":2699151351}]},"public_addr":"172.21.15.114:6809/2699151351","cluster_addr":"172.21.15.114:6811/2699151351","heartbeat_back_addr":"172.21.15.114:6815/2699151351","heartbeat_front_addr":"172.21.15.114:6813/2699151351","state":["exists","up"]},{"osd":3,"uuid":"823e5802-92b7-4f0d-b32d-a5748993f1b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6821","nonce":1361608073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6824","nonce":1361608073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6829","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6831","nonce":1361608073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6827","nonce":1361608073}]},"public_addr":"172.21.15.114:6821/1361608073","cluster_addr":"172.21.15.114:6824/1361608073","heartbeat_back_addr":"172.21.15.114:6831/1361608073","heartbeat_front_addr":"172.21.15.114:6827/1361608073","state":["exists","up"]},{"osd":4,"uuid":"e47fb93e-13b4-44a4-b084-8c4384ceb41e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6801","nonce":930839681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6803","nonce":930839681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6807","nonce":930839681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6805","nonce":930839681}]},"public_addr":"172.21.15.172:6801/930839681","cluster_addr":"172.21.15.172:6803/930839681","heartbeat_back_addr":"172.21.15.172:6807/930839681","heartbeat_front_addr":"172.21.15.172:6805/930839681","state":["exists","up"]},{"osd":5,"uuid":"7561a973-f479-45a0-af40-f324728d622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6814","nonce":571761850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6818","nonce":571761850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6824","nonce":571761850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6821","nonce":571761850}]},"public_addr":"172.21.15.172:6814/571761850","cluster_addr":"172.21.15.172:6818/571761850","heartbeat_back_addr":"172.21.15.172:6824/571761850","heartbeat_front_addr":"172.21.15.172:6821/571761850","state":["exists","up"]},{"osd":6,"uuid":"51753f4b-7f06-4f1c-9ec7-6e18a66eb980","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6825","nonce":1680398853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6827","nonce":1680398853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6831","nonce":1680398853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6829","nonce":1680398853}]},"public_addr":"172.21.15.172:6825/1680398853","cluster_addr":"172.21.15.172:6827/1680398853","heartbeat_back_addr":"172.21.15.172:6831/1680398853","heartbeat_front_addr":"172.21.15.172:6829/1680398853","state":["exists","up"]},{"osd":7,"uuid":"4d8b1e15-143d-4d17-9074-59d92f0f9af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6809","nonce":349710101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6811","nonce":349710101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6819","nonce":349710101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6815","nonce":349710101}]},"public_addr":"172.21.15.172:6809/349710101","cluster_addr":"172.21.15.172:6811/349710101","heartbeat_back_addr":"172.21.15.172:6819/349710101","heartbeat_front_addr":"172.21.15.172:6815/349710101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.889460+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.475494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.911473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.648596+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.609994+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.636248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.854589+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.885826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T12:20:26.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.785+0000 7f1a296df700 1 -- 172.21.15.114:0/3163556187 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1a040656f0 msgr2=0x7f1a04067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:26.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.785+0000 7f1a296df700 1 --2- 172.21.15.114:0/3163556187 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1a040656f0 0x7f1a04067bb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1a2415fa90 tx=0x7f1a0c009040 comp rx=0 tx=0).stop 2023-10-18T12:20:26.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.785+0000 7f1a296df700 1 -- 172.21.15.114:0/3163556187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a2406e8a0 msgr2=0x7f1a240aafd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:26.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.785+0000 7f1a296df700 1 --2- 172.21.15.114:0/3163556187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a2406e8a0 0x7f1a240aafd0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1a1400c570 tx=0x7f1a1400c930 comp rx=0 tx=0).stop 2023-10-18T12:20:26.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.785+0000 7f1a296df700 1 -- 172.21.15.114:0/3163556187 shutdown_connections 2023-10-18T12:20:26.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.785+0000 7f1a296df700 1 --2- 172.21.15.114:0/3163556187 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1a040656f0 0x7f1a04067bb0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:26.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.785+0000 7f1a296df700 1 --2- 172.21.15.114:0/3163556187 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1a24154040 0x7f1a2415f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:26.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.785+0000 7f1a296df700 1 --2- 172.21.15.114:0/3163556187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a240cb8a0 0x7f1a2415eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:26.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.785+0000 7f1a296df700 1 --2- 172.21.15.114:0/3163556187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a2406e8a0 0x7f1a240aafd0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:26.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.785+0000 7f1a296df700 1 -- 172.21.15.114:0/3163556187 >> 172.21.15.114:0/3163556187 conn(0x7f1a2406a340 msgr2=0x7f1a240af8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:26.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.789+0000 7f1a296df700 1 -- 172.21.15.114:0/3163556187 shutdown_connections 2023-10-18T12:20:26.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.789+0000 7f1a296df700 1 -- 172.21.15.114:0/3163556187 wait complete. 2023-10-18T12:20:26.816 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-18T12:19:27.040638+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-18T12:19:32.358094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-18T12:19:37.333855+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-18T12:19:38.055385+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-18T12:19:41.679218+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-18T12:20:26.817 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-18T12:20:26.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.989+0000 7ff29f59e700 1 Processor -- start 2023-10-18T12:20:26.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.989+0000 7ff29f59e700 1 -- start start 2023-10-18T12:20:26.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.993+0000 7ff29f59e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff2a0159a60 0x7ff2a00ce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:26.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.993+0000 7ff29f59e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff2a00ced40 0x7ff2a006dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:26.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.993+0000 7ff29f59e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff2a006e500 0x7ff2a00cb020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:26.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.993+0000 7ff29f59e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2a00cf5a0 con 0x7ff2a00ced40 2023-10-18T12:20:26.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.993+0000 7ff29f59e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2a006e990 con 0x7ff2a006e500 2023-10-18T12:20:27.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.993+0000 7ff29f59e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a015d630 con 0x7ff2a0159a60 2023-10-18T12:20:27.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.993+0000 7ff29dd9b700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff2a00ced40 0x7ff2a006dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:27.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.993+0000 7ff29dd9b700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff2a00ced40 0x7ff2a006dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43892/0 (socket says 172.21.15.114:43892) 2023-10-18T12:20:27.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.993+0000 7ff29dd9b700 1 -- 172.21.15.114:0/1874813119 learned_addr learned my addr 172.21.15.114:0/1874813119 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:27.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.993+0000 7ff29e59c700 1 --2- 172.21.15.114:0/1874813119 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff2a0159a60 0x7ff2a00ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:27.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.993+0000 7ff29ed9d700 1 --2- 172.21.15.114:0/1874813119 >> v2:172.21.15.172:3300/0 conn(0x7ff2a006e500 0x7ff2a00cb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:27.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.997+0000 7ff29dd9b700 1 -- 172.21.15.114:0/1874813119 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff2a0159a60 msgr2=0x7ff2a00ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:27.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.997+0000 7ff29dd9b700 1 --2- 172.21.15.114:0/1874813119 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff2a0159a60 0x7ff2a00ce800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:27.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.997+0000 7ff29dd9b700 1 -- 172.21.15.114:0/1874813119 >> v2:172.21.15.172:3300/0 conn(0x7ff2a006e500 msgr2=0x7ff2a00cb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:27.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.997+0000 7ff29dd9b700 1 --2- 172.21.15.114:0/1874813119 >> v2:172.21.15.172:3300/0 conn(0x7ff2a006e500 0x7ff2a00cb020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:27.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.997+0000 7ff29dd9b700 1 -- 172.21.15.114:0/1874813119 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a015ded0 con 0x7ff2a00ced40 2023-10-18T12:20:27.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.997+0000 7ff29dd9b700 1 --2- 172.21.15.114:0/1874813119 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2a00ced40 0x7ff2a006dfc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff2a015d590 tx=0x7ff294009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9f17699af7f9061 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:27.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.997+0000 7ff29d59a700 1 -- 172.21.15.114:0/1874813119 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29400b8a0 con 0x7ff2a00ced40 2023-10-18T12:20:27.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.997+0000 7ff29d59a700 1 -- 172.21.15.114:0/1874813119 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29400ba00 con 0x7ff2a00ced40 2023-10-18T12:20:27.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.997+0000 7ff29d59a700 1 -- 172.21.15.114:0/1874813119 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29400bd90 con 0x7ff2a00ced40 2023-10-18T12:20:27.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.997+0000 7ff29f59e700 1 -- 172.21.15.114:0/1874813119 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2a00ced40 msgr2=0x7ff2a006dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:27.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.997+0000 7ff29f59e700 1 --2- 172.21.15.114:0/1874813119 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2a00ced40 0x7ff2a006dfc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff2a015d590 tx=0x7ff294009bf0 comp rx=0 tx=0).stop 2023-10-18T12:20:27.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.997+0000 7ff29f59e700 1 -- 172.21.15.114:0/1874813119 shutdown_connections 2023-10-18T12:20:27.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.997+0000 7ff29f59e700 1 --2- 172.21.15.114:0/1874813119 >> v2:172.21.15.172:3300/0 conn(0x7ff2a006e500 0x7ff2a00cb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:27.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.997+0000 7ff29f59e700 1 --2- 172.21.15.114:0/1874813119 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2a00ced40 0x7ff2a006dfc0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:27.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.997+0000 7ff29f59e700 1 --2- 172.21.15.114:0/1874813119 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff2a0159a60 0x7ff2a00ce800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:27.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.997+0000 7ff29f59e700 1 -- 172.21.15.114:0/1874813119 >> 172.21.15.114:0/1874813119 conn(0x7ff2a00cc1d0 msgr2=0x7ff2a00cc5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:27.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.997+0000 7ff29f59e700 1 -- 172.21.15.114:0/1874813119 shutdown_connections 2023-10-18T12:20:27.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:26.997+0000 7ff29f59e700 1 -- 172.21.15.114:0/1874813119 wait complete. 2023-10-18T12:20:27.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.001+0000 7ff29f59e700 1 Processor -- start 2023-10-18T12:20:27.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.001+0000 7ff29f59e700 1 -- start start 2023-10-18T12:20:27.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.001+0000 7ff29f59e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2a006e500 0x7ff2a01f69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:27.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.001+0000 7ff29f59e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff2a00ced40 0x7ff2a015cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:27.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.001+0000 7ff29f59e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2a0159a60 0x7ff2a00c56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:27.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.001+0000 7ff29f59e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a00c38b0 con 0x7ff2a0159a60 2023-10-18T12:20:27.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.001+0000 7ff29f59e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a00c3280 con 0x7ff2a006e500 2023-10-18T12:20:27.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.001+0000 7ff29f59e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a00c3d90 con 0x7ff2a00ced40 2023-10-18T12:20:27.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.001+0000 7ff29ed9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2a0159a60 0x7ff2a00c56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:27.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.001+0000 7ff29ed9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2a0159a60 0x7ff2a00c56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43908/0 (socket says 172.21.15.114:43908) 2023-10-18T12:20:27.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.001+0000 7ff29ed9d700 1 -- 172.21.15.114:0/556188951 learned_addr learned my addr 172.21.15.114:0/556188951 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:27.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.001+0000 7ff29e59c700 1 --2- 172.21.15.114:0/556188951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2a006e500 0x7ff2a01f69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:27.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.001+0000 7ff29dd9b700 1 --2- 172.21.15.114:0/556188951 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff2a00ced40 0x7ff2a015cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:27.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.001+0000 7ff29ed9d700 1 -- 172.21.15.114:0/556188951 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff2a00ced40 msgr2=0x7ff2a015cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:27.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.001+0000 7ff29ed9d700 1 --2- 172.21.15.114:0/556188951 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff2a00ced40 0x7ff2a015cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:27.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.001+0000 7ff29ed9d700 1 -- 172.21.15.114:0/556188951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2a006e500 msgr2=0x7ff2a01f69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:27.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.001+0000 7ff29ed9d700 1 --2- 172.21.15.114:0/556188951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2a006e500 0x7ff2a01f69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:27.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.001+0000 7ff29ed9d700 1 -- 172.21.15.114:0/556188951 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff294009570 con 0x7ff2a0159a60 2023-10-18T12:20:27.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.001+0000 7ff29ed9d700 1 --2- 172.21.15.114:0/556188951 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2a0159a60 0x7ff2a00c56f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff298007e60 tx=0x7ff29800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:27.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.001+0000 7ff28effd700 1 -- 172.21.15.114:0/556188951 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29800ed30 con 0x7ff2a0159a60 2023-10-18T12:20:27.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.001+0000 7ff29f59e700 1 -- 172.21.15.114:0/556188951 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2a00c4070 con 0x7ff2a0159a60 2023-10-18T12:20:27.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.001+0000 7ff28effd700 1 -- 172.21.15.114:0/556188951 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff298014420 con 0x7ff2a0159a60 2023-10-18T12:20:27.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.001+0000 7ff28effd700 1 -- 172.21.15.114:0/556188951 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2980147d0 con 0x7ff2a0159a60 2023-10-18T12:20:27.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.001+0000 7ff29f59e700 1 -- 172.21.15.114:0/556188951 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2a0159030 con 0x7ff2a0159a60 2023-10-18T12:20:27.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.005+0000 7ff29f59e700 1 -- 172.21.15.114:0/556188951 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2a0159220 con 0x7ff2a0159a60 2023-10-18T12:20:27.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.005+0000 7ff28effd700 1 -- 172.21.15.114:0/556188951 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff298014930 con 0x7ff2a0159a60 2023-10-18T12:20:27.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.009+0000 7ff28effd700 1 --2- 172.21.15.114:0/556188951 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff2800656f0 0x7ff280067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:27.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.009+0000 7ff28effd700 1 -- 172.21.15.114:0/556188951 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff2980837d0 con 0x7ff2a0159a60 2023-10-18T12:20:27.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.009+0000 7ff29e59c700 1 --2- 172.21.15.114:0/556188951 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff2800656f0 0x7ff280067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:27.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.009+0000 7ff29e59c700 1 --2- 172.21.15.114:0/556188951 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff2800656f0 0x7ff280067bb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff290007a60 tx=0x7ff290008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:27.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.013+0000 7ff28effd700 1 -- 172.21.15.114:0/556188951 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7ff298050ee0 con 0x7ff2a0159a60 2023-10-18T12:20:27.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.193+0000 7ff29f59e700 1 -- 172.21.15.114:0/556188951 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff2a00c4260 con 0x7ff2a0159a60 2023-10-18T12:20:27.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.193+0000 7ff28effd700 1 -- 172.21.15.114:0/556188951 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff298054500 con 0x7ff2a0159a60 2023-10-18T12:20:27.199 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-10-18T12:20:27.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.197+0000 7ff29f59e700 1 -- 172.21.15.114:0/556188951 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff2800656f0 msgr2=0x7ff280067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:27.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.197+0000 7ff29f59e700 1 --2- 172.21.15.114:0/556188951 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff2800656f0 0x7ff280067bb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff290007a60 tx=0x7ff290008040 comp rx=0 tx=0).stop 2023-10-18T12:20:27.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.197+0000 7ff29f59e700 1 -- 172.21.15.114:0/556188951 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2a0159a60 msgr2=0x7ff2a00c56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:27.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.197+0000 7ff29f59e700 1 --2- 172.21.15.114:0/556188951 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2a0159a60 0x7ff2a00c56f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff298007e60 tx=0x7ff29800e3c0 comp rx=0 tx=0).stop 2023-10-18T12:20:27.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.197+0000 7ff29f59e700 1 -- 172.21.15.114:0/556188951 shutdown_connections 2023-10-18T12:20:27.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.197+0000 7ff29f59e700 1 --2- 172.21.15.114:0/556188951 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff2800656f0 0x7ff280067bb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:27.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.197+0000 7ff29f59e700 1 --2- 172.21.15.114:0/556188951 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff2a00ced40 0x7ff2a015cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:27.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.197+0000 7ff29f59e700 1 --2- 172.21.15.114:0/556188951 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2a0159a60 0x7ff2a00c56f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:27.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.197+0000 7ff29f59e700 1 --2- 172.21.15.114:0/556188951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2a006e500 0x7ff2a01f69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:27.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.201+0000 7ff29f59e700 1 -- 172.21.15.114:0/556188951 >> 172.21.15.114:0/556188951 conn(0x7ff2a00cc1d0 msgr2=0x7ff2a00b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:27.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.201+0000 7ff29f59e700 1 -- 172.21.15.114:0/556188951 shutdown_connections 2023-10-18T12:20:27.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.201+0000 7ff29f59e700 1 -- 172.21.15.114:0/556188951 wait complete. 2023-10-18T12:20:27.226 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-18T12:20:27.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.393+0000 7faaaf59e700 1 Processor -- start 2023-10-18T12:20:27.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.393+0000 7faaaf59e700 1 -- start start 2023-10-18T12:20:27.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.397+0000 7faaaf59e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7faab0160710 0x7faab00b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:27.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.397+0000 7faaaf59e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faab00b5ae0 0x7faab006db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:27.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.397+0000 7faaaf59e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faab015d0d0 con 0x7faab00d2e00 2023-10-18T12:20:27.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.397+0000 7faaaf59e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faab015df90 con 0x7faab0160710 2023-10-18T12:20:27.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.397+0000 7faaaf59e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faab006f0f0 con 0x7faab00b5ae0 2023-10-18T12:20:27.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.397+0000 7faaae59c700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7faab00d2e00 0x7faab00d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:43230/0 (socket says 172.21.15.114:43230) 2023-10-18T12:20:27.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.397+0000 7faaae59c700 1 -- 172.21.15.114:0/43497062 learned_addr learned my addr 172.21.15.114:0/43497062 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:27.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.397+0000 7faaadd9b700 1 --2- 172.21.15.114:0/43497062 >> v2:172.21.15.114:3300/0 conn(0x7faab0160710 0x7faab00b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:27.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.397+0000 7faaaed9d700 1 --2- 172.21.15.114:0/43497062 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faab00b5ae0 0x7faab006db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:27.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.397+0000 7faaad59a700 1 -- 172.21.15.114:0/43497062 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3402610040 0 0) 0x7faaa0001110 con 0x7faab00d2e00 2023-10-18T12:20:27.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.397+0000 7faaad59a700 1 -- 172.21.15.114:0/43497062 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa980035d0 con 0x7faab00d2e00 2023-10-18T12:20:27.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.397+0000 7faaadd9b700 1 -- 172.21.15.114:0/43497062 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faab00b5ae0 msgr2=0x7faab006db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:27.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.397+0000 7faaadd9b700 1 --2- 172.21.15.114:0/43497062 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faab00b5ae0 0x7faab006db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:27.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.397+0000 7faaadd9b700 1 -- 172.21.15.114:0/43497062 >> v1:172.21.15.114:6789/0 conn(0x7faab00d2e00 legacy=0x7faab00d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:27.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.397+0000 7faaadd9b700 1 -- 172.21.15.114:0/43497062 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab015d310 con 0x7faab0160710 2023-10-18T12:20:27.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.401+0000 7faaadd9b700 1 --2- 172.21.15.114:0/43497062 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faab0160710 0x7faab00b6e00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7faaa4009850 tx=0x7faaa4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1716606d1fcfffd7 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:27.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.401+0000 7faaad59a700 1 -- 172.21.15.114:0/43497062 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa4011830 con 0x7faab0160710 2023-10-18T12:20:27.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.401+0000 7faaad59a700 1 -- 172.21.15.114:0/43497062 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa4011990 con 0x7faab0160710 2023-10-18T12:20:27.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.401+0000 7faaad59a700 1 -- 172.21.15.114:0/43497062 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa4011d40 con 0x7faab0160710 2023-10-18T12:20:27.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.401+0000 7faaaf59e700 1 -- 172.21.15.114:0/43497062 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faab0160710 msgr2=0x7faab00b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:27.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.401+0000 7faaaf59e700 1 --2- 172.21.15.114:0/43497062 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faab0160710 0x7faab00b6e00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7faaa4009850 tx=0x7faaa4009b60 comp rx=0 tx=0).stop 2023-10-18T12:20:27.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.401+0000 7faaaf59e700 1 -- 172.21.15.114:0/43497062 shutdown_connections 2023-10-18T12:20:27.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.401+0000 7faaaf59e700 1 --2- 172.21.15.114:0/43497062 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faab00b5ae0 0x7faab006db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:27.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.401+0000 7faaaf59e700 1 --2- 172.21.15.114:0/43497062 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faab0160710 0x7faab00b6e00 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:27.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.401+0000 7faaaf59e700 1 -- 172.21.15.114:0/43497062 >> 172.21.15.114:0/43497062 conn(0x7faab0069f20 msgr2=0x7faab006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:27.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.401+0000 7faaaf59e700 1 -- 172.21.15.114:0/43497062 shutdown_connections 2023-10-18T12:20:27.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.401+0000 7faaaf59e700 1 -- 172.21.15.114:0/43497062 wait complete. 2023-10-18T12:20:27.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.405+0000 7faaaf59e700 1 Processor -- start 2023-10-18T12:20:27.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.405+0000 7faaaf59e700 1 -- start start 2023-10-18T12:20:27.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.405+0000 7faaaf59e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faab00b5ae0 0x7faab00b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:27.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.405+0000 7faaaf59e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faab00d2e00 0x7faab00af510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:27.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.405+0000 7faaaf59e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faab0160710 0x7faab00afa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:27.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.405+0000 7faaaf59e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab01f2740 con 0x7faab0160710 2023-10-18T12:20:27.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.405+0000 7faaaf59e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab00aea50 con 0x7faab00b5ae0 2023-10-18T12:20:27.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.405+0000 7faaaf59e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faab00ae070 con 0x7faab00d2e00 2023-10-18T12:20:27.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.405+0000 7faaaed9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faab0160710 0x7faab00afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:27.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.405+0000 7faaaed9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faab0160710 0x7faab00afa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43930/0 (socket says 172.21.15.114:43930) 2023-10-18T12:20:27.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.405+0000 7faaaed9d700 1 -- 172.21.15.114:0/3847092441 learned_addr learned my addr 172.21.15.114:0/3847092441 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:27.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.405+0000 7faaae59c700 1 --2- 172.21.15.114:0/3847092441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faab00b5ae0 0x7faab00b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:27.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.405+0000 7faaadd9b700 1 --2- 172.21.15.114:0/3847092441 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faab00d2e00 0x7faab00af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:27.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.405+0000 7faaaed9d700 1 -- 172.21.15.114:0/3847092441 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faab00d2e00 msgr2=0x7faab00af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:27.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.405+0000 7faaaed9d700 1 --2- 172.21.15.114:0/3847092441 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faab00d2e00 0x7faab00af510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:27.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.405+0000 7faaaed9d700 1 -- 172.21.15.114:0/3847092441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faab00b5ae0 msgr2=0x7faab00b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:27.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.405+0000 7faaaed9d700 1 --2- 172.21.15.114:0/3847092441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faab00b5ae0 0x7faab00b12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:27.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.405+0000 7faaaed9d700 1 -- 172.21.15.114:0/3847092441 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa40094b0 con 0x7faab0160710 2023-10-18T12:20:27.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.409+0000 7faaaed9d700 1 --2- 172.21.15.114:0/3847092441 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faab0160710 0x7faab00afa50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7faaa800efc0 tx=0x7faaa800c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:27.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.409+0000 7faa9effd700 1 -- 172.21.15.114:0/3847092441 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa800cad0 con 0x7faab0160710 2023-10-18T12:20:27.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.409+0000 7faa9effd700 1 -- 172.21.15.114:0/3847092441 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa800f040 con 0x7faab0160710 2023-10-18T12:20:27.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.409+0000 7faa9effd700 1 -- 172.21.15.114:0/3847092441 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa800ce70 con 0x7faab0160710 2023-10-18T12:20:27.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.409+0000 7faaaf59e700 1 -- 172.21.15.114:0/3847092441 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faab00aed10 con 0x7faab0160710 2023-10-18T12:20:27.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.409+0000 7faaaf59e700 1 -- 172.21.15.114:0/3847092441 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faab00cf080 con 0x7faab0160710 2023-10-18T12:20:27.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.409+0000 7faaaf59e700 1 -- 172.21.15.114:0/3847092441 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faab004e910 con 0x7faab0160710 2023-10-18T12:20:27.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.413+0000 7faa9effd700 1 -- 172.21.15.114:0/3847092441 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7faaa8014480 con 0x7faab0160710 2023-10-18T12:20:27.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.413+0000 7faa9effd700 1 --2- 172.21.15.114:0/3847092441 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7faa900656f0 0x7faa90067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:27.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.413+0000 7faa9effd700 1 -- 172.21.15.114:0/3847092441 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7faaa8006e40 con 0x7faab0160710 2023-10-18T12:20:27.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.413+0000 7faaae59c700 1 --2- 172.21.15.114:0/3847092441 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7faa900656f0 0x7faa90067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:27.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.413+0000 7faaae59c700 1 --2- 172.21.15.114:0/3847092441 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7faa900656f0 0x7faa90067bb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7faaa0007fd0 tx=0x7faaa0007c60 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:27.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.421+0000 7faa9effd700 1 -- 172.21.15.114:0/3847092441 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7faaa80511c0 con 0x7faab0160710 2023-10-18T12:20:27.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.597+0000 7faaaf59e700 1 -- 172.21.15.114:0/3847092441 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7faab006d3e0 con 0x7faab0160710 2023-10-18T12:20:27.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.597+0000 7faa9effd700 1 -- 172.21.15.114:0/3847092441 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7faaa80547e0 con 0x7faab0160710 2023-10-18T12:20:27.604 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 8 2023-10-18T12:20:27.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.601+0000 7faaaf59e700 1 -- 172.21.15.114:0/3847092441 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7faa900656f0 msgr2=0x7faa90067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:27.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.601+0000 7faaaf59e700 1 --2- 172.21.15.114:0/3847092441 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7faa900656f0 0x7faa90067bb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7faaa0007fd0 tx=0x7faaa0007c60 comp rx=0 tx=0).stop 2023-10-18T12:20:27.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.601+0000 7faaaf59e700 1 -- 172.21.15.114:0/3847092441 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faab0160710 msgr2=0x7faab00afa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:27.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.601+0000 7faaaf59e700 1 --2- 172.21.15.114:0/3847092441 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faab0160710 0x7faab00afa50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7faaa800efc0 tx=0x7faaa800c0c0 comp rx=0 tx=0).stop 2023-10-18T12:20:27.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.601+0000 7faaaf59e700 1 -- 172.21.15.114:0/3847092441 shutdown_connections 2023-10-18T12:20:27.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.601+0000 7faaaf59e700 1 --2- 172.21.15.114:0/3847092441 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7faa900656f0 0x7faa90067bb0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:27.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.601+0000 7faaaf59e700 1 --2- 172.21.15.114:0/3847092441 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faab00d2e00 0x7faab00af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:27.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.601+0000 7faaaf59e700 1 --2- 172.21.15.114:0/3847092441 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faab0160710 0x7faab00afa50 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:27.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.601+0000 7faaaf59e700 1 --2- 172.21.15.114:0/3847092441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faab00b5ae0 0x7faab00b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:27.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.605+0000 7faaaf59e700 1 -- 172.21.15.114:0/3847092441 >> 172.21.15.114:0/3847092441 conn(0x7faab0069f20 msgr2=0x7faab015c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:27.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.605+0000 7faaaf59e700 1 -- 172.21.15.114:0/3847092441 shutdown_connections 2023-10-18T12:20:27.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.605+0000 7faaaf59e700 1 -- 172.21.15.114:0/3847092441 wait complete. 2023-10-18T12:20:27.630 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-18T12:20:27.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.797+0000 7f61c4955700 1 Processor -- start 2023-10-18T12:20:27.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.797+0000 7f61c4955700 1 -- start start 2023-10-18T12:20:27.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.801+0000 7f61c4955700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f61c00cc190 0x7f61c00b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:27.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.801+0000 7f61c4955700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f61c00b4140 0x7f61c00ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:27.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.801+0000 7f61c4955700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61c015e000 con 0x7f61c00cdd90 2023-10-18T12:20:27.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.801+0000 7f61c4955700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61c00b45d0 con 0x7f61c00cc190 2023-10-18T12:20:27.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.801+0000 7f61c4955700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c00ce170 con 0x7f61c00b4140 2023-10-18T12:20:27.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.801+0000 7f61be59c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f61c00cc190 0x7f61c00b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:27.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.801+0000 7f61be59c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f61c00cc190 0x7f61c00b3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:37506/0 (socket says 172.21.15.114:37506) 2023-10-18T12:20:27.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.801+0000 7f61be59c700 1 -- 172.21.15.114:0/396743082 learned_addr learned my addr 172.21.15.114:0/396743082 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:27.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.801+0000 7f61bf59e700 1 --2- 172.21.15.114:0/396743082 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f61c00b4140 0x7f61c00ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:27.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.801+0000 7f61be59c700 1 -- 172.21.15.114:0/396743082 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f61c00b4140 msgr2=0x7f61c00ca0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:27.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.801+0000 7f61be59c700 1 --2- 172.21.15.114:0/396743082 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f61c00b4140 0x7f61c00ca0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:27.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.801+0000 7f61be59c700 1 -- 172.21.15.114:0/396743082 >> v1:172.21.15.172:6789/0 conn(0x7f61c00cdd90 legacy=0x7f61c006d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:27.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.801+0000 7f61be59c700 1 -- 172.21.15.114:0/396743082 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c015d3f0 con 0x7f61c00cc190 2023-10-18T12:20:27.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.801+0000 7f61be59c700 1 --2- 172.21.15.114:0/396743082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61c00cc190 0x7f61c00b3c00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f61b4009910 tx=0x7f61b4009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4680699d172b2d4c server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:27.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.801+0000 7f61bdd9b700 1 -- 172.21.15.114:0/396743082 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b4011830 con 0x7f61c00cc190 2023-10-18T12:20:27.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.805+0000 7f61bdd9b700 1 -- 172.21.15.114:0/396743082 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b4011990 con 0x7f61c00cc190 2023-10-18T12:20:27.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.805+0000 7f61bdd9b700 1 -- 172.21.15.114:0/396743082 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b4011d40 con 0x7f61c00cc190 2023-10-18T12:20:27.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.805+0000 7f61c4955700 1 -- 172.21.15.114:0/396743082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61c00cc190 msgr2=0x7f61c00b3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:27.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.805+0000 7f61c4955700 1 --2- 172.21.15.114:0/396743082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61c00cc190 0x7f61c00b3c00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f61b4009910 tx=0x7f61b4009c20 comp rx=0 tx=0).stop 2023-10-18T12:20:27.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.805+0000 7f61c4955700 1 -- 172.21.15.114:0/396743082 shutdown_connections 2023-10-18T12:20:27.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.805+0000 7f61c4955700 1 --2- 172.21.15.114:0/396743082 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f61c00b4140 0x7f61c00ca0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:27.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.805+0000 7f61c4955700 1 --2- 172.21.15.114:0/396743082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61c00cc190 0x7f61c00b3c00 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:27.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.805+0000 7f61c4955700 1 -- 172.21.15.114:0/396743082 >> 172.21.15.114:0/396743082 conn(0x7f61c00ce5c0 msgr2=0x7f61c00ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:27.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.805+0000 7f61c4955700 1 -- 172.21.15.114:0/396743082 shutdown_connections 2023-10-18T12:20:27.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.805+0000 7f61c4955700 1 -- 172.21.15.114:0/396743082 wait complete. 2023-10-18T12:20:27.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.809+0000 7f61c4955700 1 Processor -- start 2023-10-18T12:20:27.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.809+0000 7f61c4955700 1 -- start start 2023-10-18T12:20:27.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.809+0000 7f61c4955700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f61c00b4140 0x7f61c00c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:27.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.809+0000 7f61c4955700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61c00cc190 0x7f61c01f1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:27.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.809+0000 7f61c4955700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61c00cdd90 0x7f61c01568f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:27.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.809+0000 7f61c4955700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c015f8f0 con 0x7f61c00cdd90 2023-10-18T12:20:27.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.809+0000 7f61c4955700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c015ac50 con 0x7f61c00cc190 2023-10-18T12:20:27.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.809+0000 7f61c4955700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c015af30 con 0x7f61c00b4140 2023-10-18T12:20:27.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.809+0000 7f61bf59e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61c00cdd90 0x7f61c01568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:27.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.809+0000 7f61bf59e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61c00cdd90 0x7f61c01568f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43946/0 (socket says 172.21.15.114:43946) 2023-10-18T12:20:27.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.809+0000 7f61bf59e700 1 -- 172.21.15.114:0/3323564167 learned_addr learned my addr 172.21.15.114:0/3323564167 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:27.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.809+0000 7f61bed9d700 1 --2- 172.21.15.114:0/3323564167 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f61c00b4140 0x7f61c00c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:27.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.809+0000 7f61be59c700 1 --2- 172.21.15.114:0/3323564167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61c00cc190 0x7f61c01f1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:27.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.813+0000 7f61bf59e700 1 -- 172.21.15.114:0/3323564167 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f61c00b4140 msgr2=0x7f61c00c59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:27.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.813+0000 7f61bf59e700 1 --2- 172.21.15.114:0/3323564167 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f61c00b4140 0x7f61c00c59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:27.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.813+0000 7f61bf59e700 1 -- 172.21.15.114:0/3323564167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61c00cc190 msgr2=0x7f61c01f1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:27.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.813+0000 7f61bf59e700 1 --2- 172.21.15.114:0/3323564167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61c00cc190 0x7f61c01f1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:27.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.813+0000 7f61bf59e700 1 -- 172.21.15.114:0/3323564167 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b4009570 con 0x7f61c00cdd90 2023-10-18T12:20:27.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.813+0000 7f61bf59e700 1 --2- 172.21.15.114:0/3323564167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61c00cdd90 0x7f61c01568f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f61b800efc0 tx=0x7f61b800c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:27.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.813+0000 7f61a77fe700 1 -- 172.21.15.114:0/3323564167 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b800cad0 con 0x7f61c00cdd90 2023-10-18T12:20:27.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.813+0000 7f61a77fe700 1 -- 172.21.15.114:0/3323564167 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b800f040 con 0x7f61c00cdd90 2023-10-18T12:20:27.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.813+0000 7f61c4955700 1 -- 172.21.15.114:0/3323564167 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61c015b210 con 0x7f61c00cdd90 2023-10-18T12:20:27.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.813+0000 7f61a77fe700 1 -- 172.21.15.114:0/3323564167 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b800ce70 con 0x7f61c00cdd90 2023-10-18T12:20:27.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.813+0000 7f61c4955700 1 -- 172.21.15.114:0/3323564167 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61c01f21f0 con 0x7f61c00cdd90 2023-10-18T12:20:27.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.813+0000 7f61c4955700 1 -- 172.21.15.114:0/3323564167 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61c015aa90 con 0x7f61c00cdd90 2023-10-18T12:20:27.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.817+0000 7f61a77fe700 1 -- 172.21.15.114:0/3323564167 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f61b8014480 con 0x7f61c00cdd90 2023-10-18T12:20:27.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.817+0000 7f61a77fe700 1 --2- 172.21.15.114:0/3323564167 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f61ac0656f0 0x7f61ac067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:27.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.817+0000 7f61a77fe700 1 -- 172.21.15.114:0/3323564167 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f61b8083880 con 0x7f61c00cdd90 2023-10-18T12:20:27.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.817+0000 7f61bed9d700 1 --2- 172.21.15.114:0/3323564167 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f61ac0656f0 0x7f61ac067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:27.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.817+0000 7f61bed9d700 1 --2- 172.21.15.114:0/3323564167 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f61ac0656f0 0x7f61ac067bb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f61b0000f60 tx=0x7f61b0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:27.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.821+0000 7f61a77fe700 1 -- 172.21.15.114:0/3323564167 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f61b80510b0 con 0x7f61c00cdd90 2023-10-18T12:20:28.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:27.997+0000 7f61c4955700 1 -- 172.21.15.114:0/3323564167 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f61c015b450 con 0x7f61c00cdd90 2023-10-18T12:20:28.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.001+0000 7f61a77fe700 1 -- 172.21.15.114:0/3323564167 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f61b80546d0 con 0x7f61c00cdd90 2023-10-18T12:20:28.004 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-10-18T12:20:28.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.001+0000 7f61c4955700 1 -- 172.21.15.114:0/3323564167 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f61ac0656f0 msgr2=0x7f61ac067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:28.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.001+0000 7f61c4955700 1 --2- 172.21.15.114:0/3323564167 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f61ac0656f0 0x7f61ac067bb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f61b0000f60 tx=0x7f61b0009040 comp rx=0 tx=0).stop 2023-10-18T12:20:28.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.001+0000 7f61c4955700 1 -- 172.21.15.114:0/3323564167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61c00cdd90 msgr2=0x7f61c01568f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:28.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.001+0000 7f61c4955700 1 --2- 172.21.15.114:0/3323564167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61c00cdd90 0x7f61c01568f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f61b800efc0 tx=0x7f61b800c0c0 comp rx=0 tx=0).stop 2023-10-18T12:20:28.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.001+0000 7f61c4955700 1 -- 172.21.15.114:0/3323564167 shutdown_connections 2023-10-18T12:20:28.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.001+0000 7f61c4955700 1 --2- 172.21.15.114:0/3323564167 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f61ac0656f0 0x7f61ac067bb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:28.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.001+0000 7f61c4955700 1 --2- 172.21.15.114:0/3323564167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f61c00cdd90 0x7f61c01568f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:28.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.001+0000 7f61c4955700 1 --2- 172.21.15.114:0/3323564167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61c00cc190 0x7f61c01f1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:28.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.001+0000 7f61c4955700 1 --2- 172.21.15.114:0/3323564167 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f61c00b4140 0x7f61c00c59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:28.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.001+0000 7f61c4955700 1 -- 172.21.15.114:0/3323564167 >> 172.21.15.114:0/3323564167 conn(0x7f61c00ce5c0 msgr2=0x7f61c0160620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:28.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.001+0000 7f61c4955700 1 -- 172.21.15.114:0/3323564167 shutdown_connections 2023-10-18T12:20:28.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.001+0000 7f61c4955700 1 -- 172.21.15.114:0/3323564167 wait complete. 2023-10-18T12:20:28.027 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-18T12:20:28.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.209+0000 7f905756e700 1 Processor -- start 2023-10-18T12:20:28.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.209+0000 7f905756e700 1 -- start start 2023-10-18T12:20:28.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.209+0000 7f905756e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f905015adf0 0x7f90500cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:28.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.209+0000 7f905756e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f90500cce10 0x7f90500b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:28.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.209+0000 7f905756e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f90500b1e80 0x7f90500b22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:28.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.209+0000 7f905756e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90500ca590 con 0x7f90500cce10 2023-10-18T12:20:28.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.209+0000 7f905756e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f905015b1d0 con 0x7f905015adf0 2023-10-18T12:20:28.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.209+0000 7f905756e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90500ce600 con 0x7f90500b1e80 2023-10-18T12:20:28.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.209+0000 7f9054b09700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f90500cce10 0x7f90500b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:28.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.209+0000 7f9054b09700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f90500cce10 0x7f90500b1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43948/0 (socket says 172.21.15.114:43948) 2023-10-18T12:20:28.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.209+0000 7f9054b09700 1 -- 172.21.15.114:0/37677310 learned_addr learned my addr 172.21.15.114:0/37677310 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:28.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.213+0000 7f905530a700 1 --2- 172.21.15.114:0/37677310 >> v2:172.21.15.172:3300/0 conn(0x7f905015adf0 0x7f90500cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:28.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.213+0000 7f9054b09700 1 -- 172.21.15.114:0/37677310 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f90500b1e80 msgr2=0x7f90500b22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:28.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.213+0000 7f9055b0b700 1 --2- 172.21.15.114:0/37677310 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f90500b1e80 0x7f90500b22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:28.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.213+0000 7f9054b09700 1 --2- 172.21.15.114:0/37677310 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f90500b1e80 0x7f90500b22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:28.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.213+0000 7f9054b09700 1 -- 172.21.15.114:0/37677310 >> v2:172.21.15.172:3300/0 conn(0x7f905015adf0 msgr2=0x7f90500cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:28.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.213+0000 7f9054b09700 1 --2- 172.21.15.114:0/37677310 >> v2:172.21.15.172:3300/0 conn(0x7f905015adf0 0x7f90500cc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:28.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.213+0000 7f9054b09700 1 -- 172.21.15.114:0/37677310 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90500cd580 con 0x7f90500cce10 2023-10-18T12:20:28.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.213+0000 7f905530a700 1 --2- 172.21.15.114:0/37677310 >> v2:172.21.15.172:3300/0 conn(0x7f905015adf0 0x7f90500cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:20:28.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.213+0000 7f9055b0b700 1 --2- 172.21.15.114:0/37677310 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f90500b1e80 0x7f90500b22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:20:28.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.213+0000 7f9054b09700 1 --2- 172.21.15.114:0/37677310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90500cce10 0x7f90500b1940 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f90500cc3a0 tx=0x7f9040009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d706c4051e46a57f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:28.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.213+0000 7f9047fff700 1 -- 172.21.15.114:0/37677310 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904000b8a0 con 0x7f90500cce10 2023-10-18T12:20:28.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.213+0000 7f9047fff700 1 -- 172.21.15.114:0/37677310 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f904000ba00 con 0x7f90500cce10 2023-10-18T12:20:28.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.213+0000 7f9047fff700 1 -- 172.21.15.114:0/37677310 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904000bd90 con 0x7f90500cce10 2023-10-18T12:20:28.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.213+0000 7f905756e700 1 -- 172.21.15.114:0/37677310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90500cce10 msgr2=0x7f90500b1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:28.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.213+0000 7f905756e700 1 --2- 172.21.15.114:0/37677310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90500cce10 0x7f90500b1940 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f90500cc3a0 tx=0x7f9040009bf0 comp rx=0 tx=0).stop 2023-10-18T12:20:28.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.213+0000 7f905756e700 1 -- 172.21.15.114:0/37677310 shutdown_connections 2023-10-18T12:20:28.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.213+0000 7f905756e700 1 --2- 172.21.15.114:0/37677310 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f90500b1e80 0x7f90500b22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:28.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.213+0000 7f905756e700 1 --2- 172.21.15.114:0/37677310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90500cce10 0x7f90500b1940 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:28.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.213+0000 7f905756e700 1 --2- 172.21.15.114:0/37677310 >> v2:172.21.15.172:3300/0 conn(0x7f905015adf0 0x7f90500cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:28.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.213+0000 7f905756e700 1 -- 172.21.15.114:0/37677310 >> 172.21.15.114:0/37677310 conn(0x7f90500ce820 msgr2=0x7f90500cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:28.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.213+0000 7f905756e700 1 -- 172.21.15.114:0/37677310 shutdown_connections 2023-10-18T12:20:28.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.213+0000 7f905756e700 1 -- 172.21.15.114:0/37677310 wait complete. 2023-10-18T12:20:28.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.217+0000 7f905756e700 1 Processor -- start 2023-10-18T12:20:28.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.217+0000 7f905756e700 1 -- start start 2023-10-18T12:20:28.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.217+0000 7f905756e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90500b1e80 0x7f9050149ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:28.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.217+0000 7f905756e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90500cce10 0x7f905015b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:28.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.217+0000 7f905756e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f905015adf0 0x7f905015d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:28.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.217+0000 7f905756e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f905014a220 con 0x7f90500b1e80 2023-10-18T12:20:28.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.217+0000 7f905756e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f905006d350 con 0x7f90500cce10 2023-10-18T12:20:28.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.217+0000 7f905756e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f905015bd40 con 0x7f905015adf0 2023-10-18T12:20:28.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.217+0000 7f905530a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90500b1e80 0x7f9050149ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:28.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.217+0000 7f905530a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90500b1e80 0x7f9050149ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43964/0 (socket says 172.21.15.114:43964) 2023-10-18T12:20:28.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.217+0000 7f905530a700 1 -- 172.21.15.114:0/346913643 learned_addr learned my addr 172.21.15.114:0/346913643 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:28.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.217+0000 7f9054b09700 1 --2- 172.21.15.114:0/346913643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90500cce10 0x7f905015b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:28.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.217+0000 7f9055b0b700 1 --2- 172.21.15.114:0/346913643 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f905015adf0 0x7f905015d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:28.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.221+0000 7f905530a700 1 -- 172.21.15.114:0/346913643 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f905015adf0 msgr2=0x7f905015d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:28.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.221+0000 7f905530a700 1 --2- 172.21.15.114:0/346913643 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f905015adf0 0x7f905015d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:28.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.221+0000 7f905530a700 1 -- 172.21.15.114:0/346913643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90500cce10 msgr2=0x7f905015b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:28.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.221+0000 7f905530a700 1 --2- 172.21.15.114:0/346913643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90500cce10 0x7f905015b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:28.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.221+0000 7f905530a700 1 -- 172.21.15.114:0/346913643 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9040009570 con 0x7f90500b1e80 2023-10-18T12:20:28.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.221+0000 7f9055b0b700 1 --2- 172.21.15.114:0/346913643 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f905015adf0 0x7f905015d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:28.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.221+0000 7f905530a700 1 --2- 172.21.15.114:0/346913643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90500b1e80 0x7f9050149ce0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f904c00c7c0 tx=0x7f904c00cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:28.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.221+0000 7f9045ffb700 1 -- 172.21.15.114:0/346913643 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904c011800 con 0x7f90500b1e80 2023-10-18T12:20:28.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.221+0000 7f9045ffb700 1 -- 172.21.15.114:0/346913643 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f904c011960 con 0x7f90500b1e80 2023-10-18T12:20:28.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.221+0000 7f905756e700 1 -- 172.21.15.114:0/346913643 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f905015c020 con 0x7f90500b1e80 2023-10-18T12:20:28.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.221+0000 7f9045ffb700 1 -- 172.21.15.114:0/346913643 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904c011cf0 con 0x7f90500b1e80 2023-10-18T12:20:28.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.221+0000 7f905756e700 1 -- 172.21.15.114:0/346913643 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f905015c300 con 0x7f90500b1e80 2023-10-18T12:20:28.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.221+0000 7f905756e700 1 -- 172.21.15.114:0/346913643 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9050072e60 con 0x7f90500b1e80 2023-10-18T12:20:28.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.225+0000 7f9045ffb700 1 -- 172.21.15.114:0/346913643 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f904c021350 con 0x7f90500b1e80 2023-10-18T12:20:28.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.225+0000 7f9045ffb700 1 --2- 172.21.15.114:0/346913643 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9034065720 0x7f9034067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:28.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.225+0000 7f9045ffb700 1 -- 172.21.15.114:0/346913643 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f904c082f50 con 0x7f90500b1e80 2023-10-18T12:20:28.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.225+0000 7f9054b09700 1 --2- 172.21.15.114:0/346913643 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9034065720 0x7f9034067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:28.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.229+0000 7f9054b09700 1 --2- 172.21.15.114:0/346913643 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9034065720 0x7f9034067be0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9040000c00 tx=0x7f9040008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:28.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.233+0000 7f9045ffb700 1 -- 172.21.15.114:0/346913643 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f904c054180 con 0x7f90500b1e80 2023-10-18T12:20:28.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.405+0000 7f905756e700 1 -- 172.21.15.114:0/346913643 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f90500c1c70 con 0x7f90500b1e80 2023-10-18T12:20:28.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.409+0000 7f9045ffb700 1 -- 172.21.15.114:0/346913643 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f904c053d10 con 0x7f90500b1e80 2023-10-18T12:20:28.413 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-10-18T12:20:28.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.409+0000 7f905756e700 1 -- 172.21.15.114:0/346913643 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9034065720 msgr2=0x7f9034067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:28.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.409+0000 7f905756e700 1 --2- 172.21.15.114:0/346913643 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9034065720 0x7f9034067be0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9040000c00 tx=0x7f9040008030 comp rx=0 tx=0).stop 2023-10-18T12:20:28.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.409+0000 7f905756e700 1 -- 172.21.15.114:0/346913643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90500b1e80 msgr2=0x7f9050149ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:28.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.409+0000 7f905756e700 1 --2- 172.21.15.114:0/346913643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90500b1e80 0x7f9050149ce0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f904c00c7c0 tx=0x7f904c00cad0 comp rx=0 tx=0).stop 2023-10-18T12:20:28.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.409+0000 7f905756e700 1 -- 172.21.15.114:0/346913643 shutdown_connections 2023-10-18T12:20:28.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.409+0000 7f905756e700 1 --2- 172.21.15.114:0/346913643 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9034065720 0x7f9034067be0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:28.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.409+0000 7f905756e700 1 --2- 172.21.15.114:0/346913643 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f905015adf0 0x7f905015d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:28.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.409+0000 7f905756e700 1 --2- 172.21.15.114:0/346913643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90500cce10 0x7f905015b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:28.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.409+0000 7f905756e700 1 --2- 172.21.15.114:0/346913643 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90500b1e80 0x7f9050149ce0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:28.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.409+0000 7f905756e700 1 -- 172.21.15.114:0/346913643 >> 172.21.15.114:0/346913643 conn(0x7f90500ce820 msgr2=0x7f90500ae2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:28.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.409+0000 7f905756e700 1 -- 172.21.15.114:0/346913643 shutdown_connections 2023-10-18T12:20:28.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.409+0000 7f905756e700 1 -- 172.21.15.114:0/346913643 wait complete. 2023-10-18T12:20:28.434 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-18T12:20:28.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.601+0000 7f7d90feb700 1 Processor -- start 2023-10-18T12:20:28.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.601+0000 7f7d90feb700 1 -- start start 2023-10-18T12:20:28.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.605+0000 7f7d90feb700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7d8c0d23e0 0x7f7d8c15dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:28.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.605+0000 7f7d90feb700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7d8c0d2e20 0x7f7d8c0d3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:28.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.605+0000 7f7d90feb700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d8c0d37a0 con 0x7f7d8c06fef0 2023-10-18T12:20:28.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.605+0000 7f7d90feb700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d8c070360 con 0x7f7d8c0d23e0 2023-10-18T12:20:28.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.605+0000 7f7d90feb700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c0b6e40 con 0x7f7d8c0d2e20 2023-10-18T12:20:28.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.605+0000 7f7d8b7fe700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7d8c0d23e0 0x7f7d8c15dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:28.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.605+0000 7f7d8b7fe700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7d8c0d23e0 0x7f7d8c15dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43974/0 (socket says 172.21.15.114:43974) 2023-10-18T12:20:28.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.605+0000 7f7d8b7fe700 1 -- 172.21.15.114:0/1370526261 learned_addr learned my addr 172.21.15.114:0/1370526261 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:28.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.605+0000 7f7d8bfff700 1 --2- 172.21.15.114:0/1370526261 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7d8c0d2e20 0x7f7d8c0d3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:28.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.605+0000 7f7d8b7fe700 1 -- 172.21.15.114:0/1370526261 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7d8c0d2e20 msgr2=0x7f7d8c0d3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:28.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.605+0000 7f7d8b7fe700 1 --2- 172.21.15.114:0/1370526261 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7d8c0d2e20 0x7f7d8c0d3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:28.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.605+0000 7f7d8b7fe700 1 -- 172.21.15.114:0/1370526261 >> v1:172.21.15.114:6789/0 conn(0x7f7d8c06fef0 legacy=0x7f7d8c0b65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:28.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.605+0000 7f7d8b7fe700 1 -- 172.21.15.114:0/1370526261 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d8c0b7120 con 0x7f7d8c0d23e0 2023-10-18T12:20:28.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.605+0000 7f7d8b7fe700 1 --2- 172.21.15.114:0/1370526261 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d8c0d23e0 0x7f7d8c15dcf0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c009910 tx=0x7f7d7c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=291d6885eefdf99 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:28.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.609+0000 7f7d8a7fc700 1 -- 172.21.15.114:0/1370526261 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c011830 con 0x7f7d8c0d23e0 2023-10-18T12:20:28.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.609+0000 7f7d8a7fc700 1 -- 172.21.15.114:0/1370526261 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d7c011990 con 0x7f7d8c0d23e0 2023-10-18T12:20:28.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.609+0000 7f7d8a7fc700 1 -- 172.21.15.114:0/1370526261 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c011d40 con 0x7f7d8c0d23e0 2023-10-18T12:20:28.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.609+0000 7f7d90feb700 1 -- 172.21.15.114:0/1370526261 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d8c0d23e0 msgr2=0x7f7d8c15dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:28.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.609+0000 7f7d90feb700 1 --2- 172.21.15.114:0/1370526261 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d8c0d23e0 0x7f7d8c15dcf0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c009910 tx=0x7f7d7c009c20 comp rx=0 tx=0).stop 2023-10-18T12:20:28.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.609+0000 7f7d90feb700 1 -- 172.21.15.114:0/1370526261 shutdown_connections 2023-10-18T12:20:28.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.609+0000 7f7d90feb700 1 --2- 172.21.15.114:0/1370526261 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7d8c0d2e20 0x7f7d8c0d3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:28.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.609+0000 7f7d90feb700 1 --2- 172.21.15.114:0/1370526261 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d8c0d23e0 0x7f7d8c15dcf0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:28.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.609+0000 7f7d90feb700 1 -- 172.21.15.114:0/1370526261 >> 172.21.15.114:0/1370526261 conn(0x7f7d8c069f20 msgr2=0x7f7d8c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:28.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.609+0000 7f7d90feb700 1 -- 172.21.15.114:0/1370526261 shutdown_connections 2023-10-18T12:20:28.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.609+0000 7f7d90feb700 1 -- 172.21.15.114:0/1370526261 wait complete. 2023-10-18T12:20:28.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.613+0000 7f7d90feb700 1 Processor -- start 2023-10-18T12:20:28.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.613+0000 7f7d90feb700 1 -- start start 2023-10-18T12:20:28.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.613+0000 7f7d90feb700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d8c06fef0 0x7f7d8c14d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:28.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.613+0000 7f7d90feb700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7d8c0d23e0 0x7f7d8c14a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:28.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.613+0000 7f7d90feb700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d8c0d2e20 0x7f7d8c14adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:28.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.613+0000 7f7d90feb700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c08aa10 con 0x7f7d8c0d2e20 2023-10-18T12:20:28.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.613+0000 7f7d90feb700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c08b800 con 0x7f7d8c06fef0 2023-10-18T12:20:28.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.613+0000 7f7d90feb700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c08abf0 con 0x7f7d8c0d23e0 2023-10-18T12:20:28.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.613+0000 7f7d8bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d8c0d2e20 0x7f7d8c14adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:28.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.613+0000 7f7d8bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d8c0d2e20 0x7f7d8c14adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43980/0 (socket says 172.21.15.114:43980) 2023-10-18T12:20:28.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.613+0000 7f7d8bfff700 1 -- 172.21.15.114:0/1568569187 learned_addr learned my addr 172.21.15.114:0/1568569187 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:28.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.613+0000 7f7d8b7fe700 1 --2- 172.21.15.114:0/1568569187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d8c06fef0 0x7f7d8c14d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:28.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.613+0000 7f7d8affd700 1 --2- 172.21.15.114:0/1568569187 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7d8c0d23e0 0x7f7d8c14a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:28.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.617+0000 7f7d8bfff700 1 -- 172.21.15.114:0/1568569187 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7d8c0d23e0 msgr2=0x7f7d8c14a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:28.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.617+0000 7f7d8bfff700 1 --2- 172.21.15.114:0/1568569187 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7d8c0d23e0 0x7f7d8c14a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:28.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.617+0000 7f7d8bfff700 1 -- 172.21.15.114:0/1568569187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d8c06fef0 msgr2=0x7f7d8c14d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:28.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.617+0000 7f7d8bfff700 1 --2- 172.21.15.114:0/1568569187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d8c06fef0 0x7f7d8c14d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:28.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.617+0000 7f7d8bfff700 1 -- 172.21.15.114:0/1568569187 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d7c009570 con 0x7f7d8c0d2e20 2023-10-18T12:20:28.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.617+0000 7f7d8bfff700 1 --2- 172.21.15.114:0/1568569187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d8c0d2e20 0x7f7d8c14adb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7d84009d30 tx=0x7f7d8400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:28.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.617+0000 7f7d73fff700 1 -- 172.21.15.114:0/1568569187 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8400cd40 con 0x7f7d8c0d2e20 2023-10-18T12:20:28.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.617+0000 7f7d73fff700 1 -- 172.21.15.114:0/1568569187 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d8400f040 con 0x7f7d8c0d2e20 2023-10-18T12:20:28.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.617+0000 7f7d90feb700 1 -- 172.21.15.114:0/1568569187 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d8c08aed0 con 0x7f7d8c0d2e20 2023-10-18T12:20:28.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.617+0000 7f7d73fff700 1 -- 172.21.15.114:0/1568569187 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d840146c0 con 0x7f7d8c0d2e20 2023-10-18T12:20:28.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.617+0000 7f7d90feb700 1 -- 172.21.15.114:0/1568569187 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d8c08b490 con 0x7f7d8c0d2e20 2023-10-18T12:20:28.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.617+0000 7f7d90feb700 1 -- 172.21.15.114:0/1568569187 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d8c14b4c0 con 0x7f7d8c0d2e20 2023-10-18T12:20:28.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.621+0000 7f7d73fff700 1 -- 172.21.15.114:0/1568569187 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f7d84014820 con 0x7f7d8c0d2e20 2023-10-18T12:20:28.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.621+0000 7f7d73fff700 1 --2- 172.21.15.114:0/1568569187 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7d780656f0 0x7f7d78067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:28.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.621+0000 7f7d73fff700 1 -- 172.21.15.114:0/1568569187 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7d84006e40 con 0x7f7d8c0d2e20 2023-10-18T12:20:28.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.621+0000 7f7d8b7fe700 1 --2- 172.21.15.114:0/1568569187 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7d780656f0 0x7f7d78067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:28.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.621+0000 7f7d8b7fe700 1 --2- 172.21.15.114:0/1568569187 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7d780656f0 0x7f7d78067bb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c000c00 tx=0x7f7d7c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:28.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.629+0000 7f7d73fff700 1 -- 172.21.15.114:0/1568569187 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f7d8c14b4c0 con 0x7f7d8c0d2e20 2023-10-18T12:20:28.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.805+0000 7f7d90feb700 1 -- 172.21.15.114:0/1568569187 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f7d8c14b4c0 con 0x7f7d8c0d2e20 2023-10-18T12:20:28.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.805+0000 7f7d73fff700 1 -- 172.21.15.114:0/1568569187 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7d8c14b4c0 con 0x7f7d8c0d2e20 2023-10-18T12:20:28.810 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-10-18T12:20:28.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.809+0000 7f7d90feb700 1 -- 172.21.15.114:0/1568569187 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7d780656f0 msgr2=0x7f7d78067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:28.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.809+0000 7f7d90feb700 1 --2- 172.21.15.114:0/1568569187 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7d780656f0 0x7f7d78067bb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c000c00 tx=0x7f7d7c008030 comp rx=0 tx=0).stop 2023-10-18T12:20:28.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.809+0000 7f7d90feb700 1 -- 172.21.15.114:0/1568569187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d8c0d2e20 msgr2=0x7f7d8c14adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:28.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.809+0000 7f7d90feb700 1 --2- 172.21.15.114:0/1568569187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d8c0d2e20 0x7f7d8c14adb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7d84009d30 tx=0x7f7d8400c3a0 comp rx=0 tx=0).stop 2023-10-18T12:20:28.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.809+0000 7f7d90feb700 1 -- 172.21.15.114:0/1568569187 shutdown_connections 2023-10-18T12:20:28.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.809+0000 7f7d90feb700 1 --2- 172.21.15.114:0/1568569187 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7d780656f0 0x7f7d78067bb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:28.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.809+0000 7f7d90feb700 1 --2- 172.21.15.114:0/1568569187 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7d8c0d23e0 0x7f7d8c14a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:28.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.809+0000 7f7d90feb700 1 --2- 172.21.15.114:0/1568569187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d8c0d2e20 0x7f7d8c14adb0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:28.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.809+0000 7f7d90feb700 1 --2- 172.21.15.114:0/1568569187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d8c06fef0 0x7f7d8c14d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:28.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.809+0000 7f7d90feb700 1 -- 172.21.15.114:0/1568569187 >> 172.21.15.114:0/1568569187 conn(0x7f7d8c069f20 msgr2=0x7f7d8c0cecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:28.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.809+0000 7f7d90feb700 1 -- 172.21.15.114:0/1568569187 shutdown_connections 2023-10-18T12:20:28.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:28.809+0000 7f7d90feb700 1 -- 172.21.15.114:0/1568569187 wait complete. 2023-10-18T12:20:28.838 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T12:20:29.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.009+0000 7fb9a4a74700 1 Processor -- start 2023-10-18T12:20:29.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.009+0000 7fb9a4a74700 1 -- start start 2023-10-18T12:20:29.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.013+0000 7fb9a4a74700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb9a006d090 0x7fb9a00b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:29.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.013+0000 7fb9a4a74700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9a0071120 con 0x7fb9a006d470 2023-10-18T12:20:29.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.013+0000 7fb9a4a74700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9a015e990 con 0x7fb9a015a410 2023-10-18T12:20:29.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.013+0000 7fb9a4a74700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9a015f4f0 con 0x7fb9a006d090 2023-10-18T12:20:29.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.013+0000 7fb99f7fe700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb9a006d090 0x7fb9a00b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:29.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.013+0000 7fb99f7fe700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb9a006d090 0x7fb9a00b2590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:43992/0 (socket says 172.21.15.114:43992) 2023-10-18T12:20:29.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.013+0000 7fb99f7fe700 1 -- 172.21.15.114:0/2514473539 learned_addr learned my addr 172.21.15.114:0/2514473539 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:29.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.013+0000 7fb99f7fe700 1 -- 172.21.15.114:0/2514473539 >> v1:172.21.15.172:6789/0 conn(0x7fb9a015a410 legacy=0x7fb9a015a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:29.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.013+0000 7fb99f7fe700 1 -- 172.21.15.114:0/2514473539 >> v1:172.21.15.114:6789/0 conn(0x7fb9a006d470 legacy=0x7fb9a0070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:29.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.013+0000 7fb99f7fe700 1 -- 172.21.15.114:0/2514473539 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a015ec50 con 0x7fb9a006d090 2023-10-18T12:20:29.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.013+0000 7fb99f7fe700 1 --2- 172.21.15.114:0/2514473539 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9a006d090 0x7fb9a00b2590 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb990009910 tx=0x7fb990009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e798ec7a33515bb server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:29.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.013+0000 7fb99e7fc700 1 -- 172.21.15.114:0/2514473539 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99000ba60 con 0x7fb9a006d090 2023-10-18T12:20:29.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.013+0000 7fb99e7fc700 1 -- 172.21.15.114:0/2514473539 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb99000bbc0 con 0x7fb9a006d090 2023-10-18T12:20:29.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.013+0000 7fb99e7fc700 1 -- 172.21.15.114:0/2514473539 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb990009e60 con 0x7fb9a006d090 2023-10-18T12:20:29.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.013+0000 7fb9a4a74700 1 -- 172.21.15.114:0/2514473539 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9a006d090 msgr2=0x7fb9a00b2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:29.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.013+0000 7fb9a4a74700 1 --2- 172.21.15.114:0/2514473539 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9a006d090 0x7fb9a00b2590 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb990009910 tx=0x7fb990009c20 comp rx=0 tx=0).stop 2023-10-18T12:20:29.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.013+0000 7fb9a4a74700 1 -- 172.21.15.114:0/2514473539 shutdown_connections 2023-10-18T12:20:29.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.013+0000 7fb9a4a74700 1 --2- 172.21.15.114:0/2514473539 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9a006d090 0x7fb9a00b2590 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:29.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.013+0000 7fb9a4a74700 1 -- 172.21.15.114:0/2514473539 >> 172.21.15.114:0/2514473539 conn(0x7fb9a00ce5c0 msgr2=0x7fb9a00ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:29.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.013+0000 7fb9a4a74700 1 -- 172.21.15.114:0/2514473539 shutdown_connections 2023-10-18T12:20:29.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.013+0000 7fb9a4a74700 1 -- 172.21.15.114:0/2514473539 wait complete. 2023-10-18T12:20:29.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.017+0000 7fb9a4a74700 1 Processor -- start 2023-10-18T12:20:29.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.017+0000 7fb9a4a74700 1 -- start start 2023-10-18T12:20:29.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.021+0000 7fb9a4a74700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9a006d090 0x7fb9a00c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:29.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.021+0000 7fb9a4a74700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb9a006d470 0x7fb9a014a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:29.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.021+0000 7fb9a4a74700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9a015a410 0x7fb9a00c45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:29.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.021+0000 7fb9a4a74700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a00c6020 con 0x7fb9a015a410 2023-10-18T12:20:29.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.021+0000 7fb9a4a74700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a00c5730 con 0x7fb9a006d090 2023-10-18T12:20:29.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.021+0000 7fb9a4a74700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a00c59d0 con 0x7fb9a006d470 2023-10-18T12:20:29.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.021+0000 7fb99ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9a015a410 0x7fb9a00c45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:29.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.021+0000 7fb99ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9a015a410 0x7fb9a00c45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44006/0 (socket says 172.21.15.114:44006) 2023-10-18T12:20:29.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.021+0000 7fb99ffff700 1 -- 172.21.15.114:0/162714421 learned_addr learned my addr 172.21.15.114:0/162714421 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:29.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.021+0000 7fb99effd700 1 --2- 172.21.15.114:0/162714421 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb9a006d470 0x7fb9a014a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:29.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.021+0000 7fb99f7fe700 1 --2- 172.21.15.114:0/162714421 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9a006d090 0x7fb9a00c64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:29.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.021+0000 7fb99ffff700 1 -- 172.21.15.114:0/162714421 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb9a006d470 msgr2=0x7fb9a014a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:29.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.021+0000 7fb99ffff700 1 --2- 172.21.15.114:0/162714421 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb9a006d470 0x7fb9a014a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:29.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.021+0000 7fb99ffff700 1 -- 172.21.15.114:0/162714421 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9a006d090 msgr2=0x7fb9a00c64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:29.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.021+0000 7fb99ffff700 1 --2- 172.21.15.114:0/162714421 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9a006d090 0x7fb9a00c64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:29.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.021+0000 7fb99ffff700 1 -- 172.21.15.114:0/162714421 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb990009570 con 0x7fb9a015a410 2023-10-18T12:20:29.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.021+0000 7fb99ffff700 1 --2- 172.21.15.114:0/162714421 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9a015a410 0x7fb9a00c45e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb99800cb50 tx=0x7fb99800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:29.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.021+0000 7fb987fff700 1 -- 172.21.15.114:0/162714421 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb998003c20 con 0x7fb9a015a410 2023-10-18T12:20:29.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.021+0000 7fb987fff700 1 -- 172.21.15.114:0/162714421 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb998003d80 con 0x7fb9a015a410 2023-10-18T12:20:29.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.021+0000 7fb987fff700 1 -- 172.21.15.114:0/162714421 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99800aa20 con 0x7fb9a015a410 2023-10-18T12:20:29.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.021+0000 7fb9a4a74700 1 -- 172.21.15.114:0/162714421 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9a00c5cb0 con 0x7fb9a015a410 2023-10-18T12:20:29.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.021+0000 7fb9a4a74700 1 -- 172.21.15.114:0/162714421 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9a014a570 con 0x7fb9a015a410 2023-10-18T12:20:29.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.025+0000 7fb9a4a74700 1 -- 172.21.15.114:0/162714421 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9a00b16a0 con 0x7fb9a015a410 2023-10-18T12:20:29.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.025+0000 7fb987fff700 1 -- 172.21.15.114:0/162714421 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fb99800ab80 con 0x7fb9a015a410 2023-10-18T12:20:29.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.025+0000 7fb987fff700 1 --2- 172.21.15.114:0/162714421 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb98c0656f0 0x7fb98c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:29.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.025+0000 7fb987fff700 1 -- 172.21.15.114:0/162714421 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb998083020 con 0x7fb9a015a410 2023-10-18T12:20:29.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.025+0000 7fb99f7fe700 1 --2- 172.21.15.114:0/162714421 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb98c0656f0 0x7fb98c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:29.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.029+0000 7fb99f7fe700 1 --2- 172.21.15.114:0/162714421 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb98c0656f0 0x7fb98c067bb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb990006f80 tx=0x7fb990008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:29.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.033+0000 7fb987fff700 1 -- 172.21.15.114:0/162714421 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fb998050840 con 0x7fb9a015a410 2023-10-18T12:20:29.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.209+0000 7fb9a4a74700 1 -- 172.21.15.114:0/162714421 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9a006dd20 con 0x7fb9a015a410 2023-10-18T12:20:29.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.213+0000 7fb987fff700 1 -- 172.21.15.114:0/162714421 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20240 (secure 0 0 0) 0x7fb998053e60 con 0x7fb9a015a410 2023-10-18T12:20:29.219 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:20:29.219 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":30,"fsid":"240ea340-5d3d-4f52-a4bc-af075aca3deb","created":"2023-10-18T12:19:12.512994+0000","modified":"2023-10-18T12:20:20.604528+0000","last_up_change":"2023-10-18T12:19:25.286009+0000","last_in_change":"2023-10-18T12:19:15.850693+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T12:19:27.040638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-18T12:19:32.358094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-18T12:19:37.333855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-18T12:19:38.055385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-18T12:19:41.679218+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c3578978-1a03-4857-b9d2-34a5da3d7731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6817","nonce":1506287862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6820","nonce":1506287862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6830","nonce":1506287862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6825","nonce":1506287862}]},"public_addr":"172.21.15.114:6817/1506287862","cluster_addr":"172.21.15.114:6820/1506287862","heartbeat_back_addr":"172.21.15.114:6830/1506287862","heartbeat_front_addr":"172.21.15.114:6825/1506287862","state":["exists","up"]},{"osd":1,"uuid":"43eb26a6-e2b3-4670-9559-bd053b5140d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6801","nonce":3302727047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6803","nonce":3302727047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6807","nonce":3302727047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6805","nonce":3302727047}]},"public_addr":"172.21.15.114:6801/3302727047","cluster_addr":"172.21.15.114:6803/3302727047","heartbeat_back_addr":"172.21.15.114:6807/3302727047","heartbeat_front_addr":"172.21.15.114:6805/3302727047","state":["exists","up"]},{"osd":2,"uuid":"f3d4dbd5-521c-4dd2-b687-5768cc7d0938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6809","nonce":2699151351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6811","nonce":2699151351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6815","nonce":2699151351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6813","nonce":2699151351}]},"public_addr":"172.21.15.114:6809/2699151351","cluster_addr":"172.21.15.114:6811/2699151351","heartbeat_back_addr":"172.21.15.114:6815/2699151351","heartbeat_front_addr":"172.21.15.114:6813/2699151351","state":["exists","up"]},{"osd":3,"uuid":"823e5802-92b7-4f0d-b32d-a5748993f1b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6821","nonce":1361608073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6824","nonce":1361608073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6829","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6831","nonce":1361608073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6827","nonce":1361608073}]},"public_addr":"172.21.15.114:6821/1361608073","cluster_addr":"172.21.15.114:6824/1361608073","heartbeat_back_addr":"172.21.15.114:6831/1361608073","heartbeat_front_addr":"172.21.15.114:6827/1361608073","state":["exists","up"]},{"osd":4,"uuid":"e47fb93e-13b4-44a4-b084-8c4384ceb41e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6801","nonce":930839681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6803","nonce":930839681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6807","nonce":930839681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6805","nonce":930839681}]},"public_addr":"172.21.15.172:6801/930839681","cluster_addr":"172.21.15.172:6803/930839681","heartbeat_back_addr":"172.21.15.172:6807/930839681","heartbeat_front_addr":"172.21.15.172:6805/930839681","state":["exists","up"]},{"osd":5,"uuid":"7561a973-f479-45a0-af40-f324728d622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6814","nonce":571761850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6818","nonce":571761850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6824","nonce":571761850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6821","nonce":571761850}]},"public_addr":"172.21.15.172:6814/571761850","cluster_addr":"172.21.15.172:6818/571761850","heartbeat_back_addr":"172.21.15.172:6824/571761850","heartbeat_front_addr":"172.21.15.172:6821/571761850","state":["exists","up"]},{"osd":6,"uuid":"51753f4b-7f06-4f1c-9ec7-6e18a66eb980","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6825","nonce":1680398853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6827","nonce":1680398853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6831","nonce":1680398853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6829","nonce":1680398853}]},"public_addr":"172.21.15.172:6825/1680398853","cluster_addr":"172.21.15.172:6827/1680398853","heartbeat_back_addr":"172.21.15.172:6831/1680398853","heartbeat_front_addr":"172.21.15.172:6829/1680398853","state":["exists","up"]},{"osd":7,"uuid":"4d8b1e15-143d-4d17-9074-59d92f0f9af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6809","nonce":349710101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6811","nonce":349710101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6819","nonce":349710101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6815","nonce":349710101}]},"public_addr":"172.21.15.172:6809/349710101","cluster_addr":"172.21.15.172:6811/349710101","heartbeat_back_addr":"172.21.15.172:6819/349710101","heartbeat_front_addr":"172.21.15.172:6815/349710101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.889460+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.475494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.911473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.648596+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.609994+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.636248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.854589+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.885826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T12:20:29.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.217+0000 7fb9a4a74700 1 -- 172.21.15.114:0/162714421 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb98c0656f0 msgr2=0x7fb98c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:29.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.217+0000 7fb9a4a74700 1 --2- 172.21.15.114:0/162714421 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb98c0656f0 0x7fb98c067bb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb990006f80 tx=0x7fb990008030 comp rx=0 tx=0).stop 2023-10-18T12:20:29.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.217+0000 7fb9a4a74700 1 -- 172.21.15.114:0/162714421 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9a015a410 msgr2=0x7fb9a00c45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:29.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.217+0000 7fb9a4a74700 1 --2- 172.21.15.114:0/162714421 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9a015a410 0x7fb9a00c45e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb99800cb50 tx=0x7fb99800ce60 comp rx=0 tx=0).stop 2023-10-18T12:20:29.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.217+0000 7fb9a4a74700 1 -- 172.21.15.114:0/162714421 shutdown_connections 2023-10-18T12:20:29.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.217+0000 7fb9a4a74700 1 --2- 172.21.15.114:0/162714421 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb98c0656f0 0x7fb98c067bb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:29.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.217+0000 7fb9a4a74700 1 --2- 172.21.15.114:0/162714421 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb9a006d470 0x7fb9a014a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:29.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.217+0000 7fb9a4a74700 1 --2- 172.21.15.114:0/162714421 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9a015a410 0x7fb9a00c45e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:29.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.217+0000 7fb9a4a74700 1 --2- 172.21.15.114:0/162714421 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9a006d090 0x7fb9a00c64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:29.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.217+0000 7fb9a4a74700 1 -- 172.21.15.114:0/162714421 >> 172.21.15.114:0/162714421 conn(0x7fb9a00ce5c0 msgr2=0x7fb9a00c9870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:29.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.217+0000 7fb9a4a74700 1 -- 172.21.15.114:0/162714421 shutdown_connections 2023-10-18T12:20:29.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.217+0000 7fb9a4a74700 1 -- 172.21.15.114:0/162714421 wait complete. 2023-10-18T12:20:29.243 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-18T12:19:27.040638+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-18T12:19:32.358094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-18T12:19:37.333855+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-18T12:19:38.055385+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-18T12:19:41.679218+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-18T12:20:29.244 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-18T12:20:29.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.421+0000 7f40c8658700 1 Processor -- start 2023-10-18T12:20:29.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.421+0000 7f40c8658700 1 -- start start 2023-10-18T12:20:29.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.421+0000 7f40c8658700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f40c006f9a0 0x7f40c006fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:29.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.421+0000 7f40c8658700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40c0146ba0 con 0x7f40c00b5b80 2023-10-18T12:20:29.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.421+0000 7f40c8658700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40c00d0920 con 0x7f40c01467c0 2023-10-18T12:20:29.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.421+0000 7f40c8658700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c0070320 con 0x7f40c006f9a0 2023-10-18T12:20:29.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.421+0000 7f40c5bf3700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f40c00b5b80 0x7f40c015d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:43272/0 (socket says 172.21.15.114:43272) 2023-10-18T12:20:29.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.421+0000 7f40c5bf3700 1 -- 172.21.15.114:0/2775005667 learned_addr learned my addr 172.21.15.114:0/2775005667 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:29.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.425+0000 7f40c53f2700 1 -- 172.21.15.114:0/2775005667 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1982511221 0 0) 0x7f40c0146ba0 con 0x7f40c00b5b80 2023-10-18T12:20:29.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.425+0000 7f40c6bf5700 1 --2- 172.21.15.114:0/2775005667 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f40c006f9a0 0x7f40c006fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:29.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.425+0000 7f40c53f2700 1 -- 172.21.15.114:0/2775005667 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40ac0035d0 con 0x7f40c00b5b80 2023-10-18T12:20:29.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.425+0000 7f40c53f2700 1 -- 172.21.15.114:0/2775005667 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3992425279 0 0) 0x7f40ac0035d0 con 0x7f40c00b5b80 2023-10-18T12:20:29.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.425+0000 7f40c53f2700 1 -- 172.21.15.114:0/2775005667 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f40c006f9a0 msgr2=0x7f40c006fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:29.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.425+0000 7f40c53f2700 1 --2- 172.21.15.114:0/2775005667 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f40c006f9a0 0x7f40c006fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:29.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.425+0000 7f40c53f2700 1 -- 172.21.15.114:0/2775005667 >> v1:172.21.15.172:6789/0 conn(0x7f40c01467c0 legacy=0x7f40c01612e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:29.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.425+0000 7f40c53f2700 1 -- 172.21.15.114:0/2775005667 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c00b6160 con 0x7f40c00b5b80 2023-10-18T12:20:29.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.425+0000 7f40c53f2700 1 -- 172.21.15.114:0/2775005667 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3368469509 0 0) 0x7f40b0001670 con 0x7f40c00b5b80 2023-10-18T12:20:29.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.425+0000 7f40c53f2700 1 -- 172.21.15.114:0/2775005667 >> v1:172.21.15.114:6789/0 conn(0x7f40c00b5b80 legacy=0x7f40c015d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:29.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.425+0000 7f40c53f2700 1 --2- 172.21.15.114:0/2775005667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40ac003ac0 0x7f40ac003ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:29.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.425+0000 7f40c53f2700 1 --2- 172.21.15.114:0/2775005667 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f40c006f9a0 0x7f40ac004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:29.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.425+0000 7f40c53f2700 1 --2- 172.21.15.114:0/2775005667 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40ac004db0 0x7f40ac005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:29.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.425+0000 7f40c53f2700 1 -- 172.21.15.114:0/2775005667 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c0070320 con 0x7f40ac004db0 2023-10-18T12:20:29.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.425+0000 7f40c53f2700 1 -- 172.21.15.114:0/2775005667 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ac00bbc0 con 0x7f40ac003ac0 2023-10-18T12:20:29.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.425+0000 7f40c53f2700 1 -- 172.21.15.114:0/2775005667 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40ac00bd80 con 0x7f40c006f9a0 2023-10-18T12:20:29.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.425+0000 7f40c5bf3700 1 --2- 172.21.15.114:0/2775005667 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f40c006f9a0 0x7f40ac004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:29.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.425+0000 7f40c63f4700 1 --2- 172.21.15.114:0/2775005667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40ac003ac0 0x7f40ac003ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:29.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.425+0000 7f40c6bf5700 1 --2- 172.21.15.114:0/2775005667 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40ac004db0 0x7f40ac005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:29.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.425+0000 7f40c6bf5700 1 -- 172.21.15.114:0/2775005667 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f40c006f9a0 msgr2=0x7f40ac004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:29.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.425+0000 7f40c6bf5700 1 --2- 172.21.15.114:0/2775005667 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f40c006f9a0 0x7f40ac004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:29.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.425+0000 7f40c6bf5700 1 -- 172.21.15.114:0/2775005667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40ac003ac0 msgr2=0x7f40ac003ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:29.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.425+0000 7f40c6bf5700 1 --2- 172.21.15.114:0/2775005667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40ac003ac0 0x7f40ac003ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:29.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.425+0000 7f40c6bf5700 1 -- 172.21.15.114:0/2775005667 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ac0035d0 con 0x7f40ac004db0 2023-10-18T12:20:29.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.425+0000 7f40c6bf5700 1 --2- 172.21.15.114:0/2775005667 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40ac004db0 0x7f40ac005230 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f40b8009f90 tx=0x7f40ac0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a5cbfa594e17308 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:29.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.425+0000 7f40c53f2700 1 -- 172.21.15.114:0/2775005667 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b800ec30 con 0x7f40ac004db0 2023-10-18T12:20:29.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.425+0000 7f40c53f2700 1 -- 172.21.15.114:0/2775005667 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b800f040 con 0x7f40ac004db0 2023-10-18T12:20:29.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.425+0000 7f40c53f2700 1 -- 172.21.15.114:0/2775005667 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b8014480 con 0x7f40ac004db0 2023-10-18T12:20:29.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.429+0000 7f40c8658700 1 -- 172.21.15.114:0/2775005667 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40ac004db0 msgr2=0x7f40ac005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:29.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.429+0000 7f40c8658700 1 --2- 172.21.15.114:0/2775005667 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40ac004db0 0x7f40ac005230 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f40b8009f90 tx=0x7f40ac0058a0 comp rx=0 tx=0).stop 2023-10-18T12:20:29.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.429+0000 7f40c6bf5700 1 -- 172.21.15.114:0/2775005667 reap_dead start 2023-10-18T12:20:29.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.429+0000 7f40c8658700 1 -- 172.21.15.114:0/2775005667 shutdown_connections 2023-10-18T12:20:29.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.429+0000 7f40c8658700 1 -- 172.21.15.114:0/2775005667 >> 172.21.15.114:0/2775005667 conn(0x7f40c006a130 msgr2=0x7f40c006a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:29.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.429+0000 7f40c8658700 1 -- 172.21.15.114:0/2775005667 shutdown_connections 2023-10-18T12:20:29.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.429+0000 7f40c8658700 1 -- 172.21.15.114:0/2775005667 wait complete. 2023-10-18T12:20:29.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.433+0000 7f40c8658700 1 Processor -- start 2023-10-18T12:20:29.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.433+0000 7f40c8658700 1 -- start start 2023-10-18T12:20:29.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.433+0000 7f40c8658700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40ac004db0 0x7f40c01f2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:29.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.433+0000 7f40c8658700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f40c0140260 0x7f40c01406e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:29.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.433+0000 7f40c8658700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40c013ecb0 0x7f40c013f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:29.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.433+0000 7f40c8658700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c01e55a0 con 0x7f40c013ecb0 2023-10-18T12:20:29.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.433+0000 7f40c8658700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c0140c20 con 0x7f40ac004db0 2023-10-18T12:20:29.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.433+0000 7f40c8658700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c013fa30 con 0x7f40c0140260 2023-10-18T12:20:29.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.433+0000 7f40c6bf5700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40c013ecb0 0x7f40c013f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:29.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.433+0000 7f40c6bf5700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40c013ecb0 0x7f40c013f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44016/0 (socket says 172.21.15.114:44016) 2023-10-18T12:20:29.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.433+0000 7f40c6bf5700 1 -- 172.21.15.114:0/1230392494 learned_addr learned my addr 172.21.15.114:0/1230392494 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:29.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.433+0000 7f40c5bf3700 1 --2- 172.21.15.114:0/1230392494 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f40c0140260 0x7f40c01406e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:29.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.433+0000 7f40c63f4700 1 --2- 172.21.15.114:0/1230392494 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40ac004db0 0x7f40c01f2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:29.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.433+0000 7f40c6bf5700 1 -- 172.21.15.114:0/1230392494 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f40c0140260 msgr2=0x7f40c01406e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:29.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.433+0000 7f40c6bf5700 1 --2- 172.21.15.114:0/1230392494 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f40c0140260 0x7f40c01406e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:29.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.433+0000 7f40c6bf5700 1 -- 172.21.15.114:0/1230392494 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40ac004db0 msgr2=0x7f40c01f2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:29.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.433+0000 7f40c6bf5700 1 --2- 172.21.15.114:0/1230392494 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40ac004db0 0x7f40c01f2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:29.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.433+0000 7f40c6bf5700 1 -- 172.21.15.114:0/1230392494 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c01e57b0 con 0x7f40c013ecb0 2023-10-18T12:20:29.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.433+0000 7f40c5bf3700 1 --2- 172.21.15.114:0/1230392494 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f40c0140260 0x7f40c01406e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:20:29.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.433+0000 7f40c6bf5700 1 --2- 172.21.15.114:0/1230392494 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40c013ecb0 0x7f40c013f130 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f40ac0047f0 tx=0x7f40b8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:29.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.433+0000 7f40b6ffd700 1 -- 172.21.15.114:0/1230392494 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b8009410 con 0x7f40c013ecb0 2023-10-18T12:20:29.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.437+0000 7f40b6ffd700 1 -- 172.21.15.114:0/1230392494 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b800ee40 con 0x7f40c013ecb0 2023-10-18T12:20:29.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.437+0000 7f40c8658700 1 -- 172.21.15.114:0/1230392494 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40c01e5a90 con 0x7f40c013ecb0 2023-10-18T12:20:29.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.437+0000 7f40b6ffd700 1 -- 172.21.15.114:0/1230392494 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b8026420 con 0x7f40c013ecb0 2023-10-18T12:20:29.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.437+0000 7f40c8658700 1 -- 172.21.15.114:0/1230392494 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40c01f29c0 con 0x7f40c013ecb0 2023-10-18T12:20:29.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.437+0000 7f40c8658700 1 -- 172.21.15.114:0/1230392494 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40c0072e60 con 0x7f40c013ecb0 2023-10-18T12:20:29.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.437+0000 7f40b6ffd700 1 -- 172.21.15.114:0/1230392494 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f40b8023020 con 0x7f40c013ecb0 2023-10-18T12:20:29.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.441+0000 7f40b6ffd700 1 --2- 172.21.15.114:0/1230392494 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f40a40656f0 0x7f40a4067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:29.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.441+0000 7f40b6ffd700 1 -- 172.21.15.114:0/1230392494 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f40b8084720 con 0x7f40c013ecb0 2023-10-18T12:20:29.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.441+0000 7f40c63f4700 1 --2- 172.21.15.114:0/1230392494 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f40a40656f0 0x7f40a4067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:29.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.441+0000 7f40c63f4700 1 --2- 172.21.15.114:0/1230392494 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f40a40656f0 0x7f40a4067bb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f40bc000c00 tx=0x7f40bc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:29.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.445+0000 7f40b6ffd700 1 -- 172.21.15.114:0/1230392494 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f40b8052060 con 0x7f40c013ecb0 2023-10-18T12:20:29.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.621+0000 7f40c8658700 1 -- 172.21.15.114:0/1230392494 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f40c00b7200 con 0x7f40c013ecb0 2023-10-18T12:20:29.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.625+0000 7f40b6ffd700 1 -- 172.21.15.114:0/1230392494 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f40b8055680 con 0x7f40c013ecb0 2023-10-18T12:20:29.629 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-10-18T12:20:29.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.625+0000 7f40c8658700 1 -- 172.21.15.114:0/1230392494 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f40a40656f0 msgr2=0x7f40a4067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:29.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.625+0000 7f40c8658700 1 --2- 172.21.15.114:0/1230392494 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f40a40656f0 0x7f40a4067bb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f40bc000c00 tx=0x7f40bc009040 comp rx=0 tx=0).stop 2023-10-18T12:20:29.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.625+0000 7f40c8658700 1 -- 172.21.15.114:0/1230392494 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40c013ecb0 msgr2=0x7f40c013f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:29.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.625+0000 7f40c8658700 1 --2- 172.21.15.114:0/1230392494 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40c013ecb0 0x7f40c013f130 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f40ac0047f0 tx=0x7f40b8009750 comp rx=0 tx=0).stop 2023-10-18T12:20:29.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.625+0000 7f40c8658700 1 -- 172.21.15.114:0/1230392494 shutdown_connections 2023-10-18T12:20:29.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.625+0000 7f40c8658700 1 --2- 172.21.15.114:0/1230392494 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f40a40656f0 0x7f40a4067bb0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:29.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.625+0000 7f40c8658700 1 --2- 172.21.15.114:0/1230392494 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f40c0140260 0x7f40c01406e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:29.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.625+0000 7f40c8658700 1 --2- 172.21.15.114:0/1230392494 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f40c013ecb0 0x7f40c013f130 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:29.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.625+0000 7f40c8658700 1 --2- 172.21.15.114:0/1230392494 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40ac004db0 0x7f40c01f2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:29.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.625+0000 7f40c8658700 1 -- 172.21.15.114:0/1230392494 >> 172.21.15.114:0/1230392494 conn(0x7f40c006a130 msgr2=0x7f40c015db30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:29.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.625+0000 7f40c8658700 1 -- 172.21.15.114:0/1230392494 shutdown_connections 2023-10-18T12:20:29.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.625+0000 7f40c8658700 1 -- 172.21.15.114:0/1230392494 wait complete. 2023-10-18T12:20:29.654 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-18T12:20:29.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.829+0000 7fc5e359e700 1 Processor -- start 2023-10-18T12:20:29.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.833+0000 7fc5e359e700 1 -- start start 2023-10-18T12:20:29.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.833+0000 7fc5e359e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc5e40ce950 0x7fc5e40cca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:29.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.833+0000 7fc5e359e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc5e4070a30 0x7fc5e40ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:29.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.833+0000 7fc5e359e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5e406bc30 con 0x7fc5e40c5400 2023-10-18T12:20:29.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.833+0000 7fc5e359e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5e415a090 con 0x7fc5e40ce950 2023-10-18T12:20:29.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.833+0000 7fc5e359e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e415a370 con 0x7fc5e4070a30 2023-10-18T12:20:29.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.837+0000 7fc5e1d9b700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc5e40ce950 0x7fc5e40cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:29.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.837+0000 7fc5e1d9b700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc5e40ce950 0x7fc5e40cca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44024/0 (socket says 172.21.15.114:44024) 2023-10-18T12:20:29.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.837+0000 7fc5e1d9b700 1 -- 172.21.15.114:0/2529717103 learned_addr learned my addr 172.21.15.114:0/2529717103 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:29.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.837+0000 7fc5e2d9d700 1 --2- 172.21.15.114:0/2529717103 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc5e4070a30 0x7fc5e40ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:29.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.837+0000 7fc5e1d9b700 1 -- 172.21.15.114:0/2529717103 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc5e4070a30 msgr2=0x7fc5e40ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:29.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.837+0000 7fc5e1d9b700 1 --2- 172.21.15.114:0/2529717103 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc5e4070a30 0x7fc5e40ccfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:29.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.837+0000 7fc5e1d9b700 1 -- 172.21.15.114:0/2529717103 >> v1:172.21.15.172:6789/0 conn(0x7fc5e40c5400 legacy=0x7fc5e40ca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:29.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.837+0000 7fc5e1d9b700 1 -- 172.21.15.114:0/2529717103 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e415a650 con 0x7fc5e40ce950 2023-10-18T12:20:29.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.837+0000 7fc5e1d9b700 1 --2- 172.21.15.114:0/2529717103 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5e40ce950 0x7fc5e40cca70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8009910 tx=0x7fc5d8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=675bf5dfef686504 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:29.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.837+0000 7fc5e159a700 1 -- 172.21.15.114:0/2529717103 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d8011830 con 0x7fc5e40ce950 2023-10-18T12:20:29.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.837+0000 7fc5e159a700 1 -- 172.21.15.114:0/2529717103 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d8011990 con 0x7fc5e40ce950 2023-10-18T12:20:29.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.837+0000 7fc5e159a700 1 -- 172.21.15.114:0/2529717103 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d8011d40 con 0x7fc5e40ce950 2023-10-18T12:20:29.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.837+0000 7fc5e359e700 1 -- 172.21.15.114:0/2529717103 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5e40ce950 msgr2=0x7fc5e40cca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:29.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.837+0000 7fc5e359e700 1 --2- 172.21.15.114:0/2529717103 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5e40ce950 0x7fc5e40cca70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc5d8009910 tx=0x7fc5d8009c20 comp rx=0 tx=0).stop 2023-10-18T12:20:29.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.837+0000 7fc5e359e700 1 -- 172.21.15.114:0/2529717103 shutdown_connections 2023-10-18T12:20:29.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.837+0000 7fc5e359e700 1 --2- 172.21.15.114:0/2529717103 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc5e4070a30 0x7fc5e40ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:29.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.837+0000 7fc5e359e700 1 --2- 172.21.15.114:0/2529717103 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5e40ce950 0x7fc5e40cca70 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:29.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.837+0000 7fc5e359e700 1 -- 172.21.15.114:0/2529717103 >> 172.21.15.114:0/2529717103 conn(0x7fc5e40cb920 msgr2=0x7fc5e40cbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:29.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.837+0000 7fc5e359e700 1 -- 172.21.15.114:0/2529717103 shutdown_connections 2023-10-18T12:20:29.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.841+0000 7fc5e359e700 1 -- 172.21.15.114:0/2529717103 wait complete. 2023-10-18T12:20:29.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.841+0000 7fc5e359e700 1 Processor -- start 2023-10-18T12:20:29.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.841+0000 7fc5e359e700 1 -- start start 2023-10-18T12:20:29.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.841+0000 7fc5e359e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5e4070a30 0x7fc5e4163710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:29.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.841+0000 7fc5e359e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc5e40c5400 0x7fc5e4156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:29.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.841+0000 7fc5e359e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5e40ce950 0x7fc5e41f5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:29.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.841+0000 7fc5e359e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e4163e10 con 0x7fc5e40ce950 2023-10-18T12:20:29.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.841+0000 7fc5e359e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e41640f0 con 0x7fc5e4070a30 2023-10-18T12:20:29.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.841+0000 7fc5e359e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e41643d0 con 0x7fc5e40c5400 2023-10-18T12:20:29.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.845+0000 7fc5e2d9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5e40ce950 0x7fc5e41f5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:29.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.845+0000 7fc5e2d9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5e40ce950 0x7fc5e41f5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44036/0 (socket says 172.21.15.114:44036) 2023-10-18T12:20:29.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.845+0000 7fc5e2d9d700 1 -- 172.21.15.114:0/254579542 learned_addr learned my addr 172.21.15.114:0/254579542 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:29.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.845+0000 7fc5e1d9b700 1 --2- 172.21.15.114:0/254579542 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc5e40c5400 0x7fc5e4156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:29.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.845+0000 7fc5e259c700 1 --2- 172.21.15.114:0/254579542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5e4070a30 0x7fc5e4163710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:29.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.845+0000 7fc5e2d9d700 1 -- 172.21.15.114:0/254579542 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc5e40c5400 msgr2=0x7fc5e4156c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:29.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.845+0000 7fc5e2d9d700 1 --2- 172.21.15.114:0/254579542 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc5e40c5400 0x7fc5e4156c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:29.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.845+0000 7fc5e2d9d700 1 -- 172.21.15.114:0/254579542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5e4070a30 msgr2=0x7fc5e4163710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:29.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.845+0000 7fc5e2d9d700 1 --2- 172.21.15.114:0/254579542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5e4070a30 0x7fc5e4163710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:29.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.845+0000 7fc5e2d9d700 1 -- 172.21.15.114:0/254579542 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d8009570 con 0x7fc5e40ce950 2023-10-18T12:20:29.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.845+0000 7fc5e1d9b700 1 --2- 172.21.15.114:0/254579542 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc5e40c5400 0x7fc5e4156c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:29.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.845+0000 7fc5e2d9d700 1 --2- 172.21.15.114:0/254579542 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5e40ce950 0x7fc5e41f5e70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc00efc0 tx=0x7fc5dc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:29.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.845+0000 7fc5d2ffd700 1 -- 172.21.15.114:0/254579542 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc00cd40 con 0x7fc5e40ce950 2023-10-18T12:20:29.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.845+0000 7fc5d2ffd700 1 -- 172.21.15.114:0/254579542 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5dc00f040 con 0x7fc5e40ce950 2023-10-18T12:20:29.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.845+0000 7fc5e359e700 1 -- 172.21.15.114:0/254579542 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e41646b0 con 0x7fc5e40ce950 2023-10-18T12:20:29.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.845+0000 7fc5d2ffd700 1 -- 172.21.15.114:0/254579542 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc0146c0 con 0x7fc5e40ce950 2023-10-18T12:20:29.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.845+0000 7fc5e359e700 1 -- 172.21.15.114:0/254579542 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e4164990 con 0x7fc5e40ce950 2023-10-18T12:20:29.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.845+0000 7fc5e359e700 1 -- 172.21.15.114:0/254579542 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5e404e910 con 0x7fc5e40ce950 2023-10-18T12:20:29.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.849+0000 7fc5d2ffd700 1 -- 172.21.15.114:0/254579542 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fc5dc014820 con 0x7fc5e40ce950 2023-10-18T12:20:29.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.849+0000 7fc5d2ffd700 1 --2- 172.21.15.114:0/254579542 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc5c40656f0 0x7fc5c4067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:29.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.849+0000 7fc5d2ffd700 1 -- 172.21.15.114:0/254579542 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc5dc083af0 con 0x7fc5e40ce950 2023-10-18T12:20:29.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.849+0000 7fc5e259c700 1 --2- 172.21.15.114:0/254579542 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc5c40656f0 0x7fc5c4067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:29.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.853+0000 7fc5e259c700 1 --2- 172.21.15.114:0/254579542 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc5c40656f0 0x7fc5c4067bb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc5d4000f60 tx=0x7fc5d4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:29.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:29.857+0000 7fc5d2ffd700 1 -- 172.21.15.114:0/254579542 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fc5dc054c70 con 0x7fc5e40ce950 2023-10-18T12:20:30.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.029+0000 7fc5e359e700 1 -- 172.21.15.114:0/254579542 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc5e406ae80 con 0x7fc5e40ce950 2023-10-18T12:20:30.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.033+0000 7fc5d2ffd700 1 -- 172.21.15.114:0/254579542 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc5dc00cea0 con 0x7fc5e40ce950 2023-10-18T12:20:30.037 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 8 2023-10-18T12:20:30.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.033+0000 7fc5e359e700 1 -- 172.21.15.114:0/254579542 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc5c40656f0 msgr2=0x7fc5c4067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:30.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.033+0000 7fc5e359e700 1 --2- 172.21.15.114:0/254579542 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc5c40656f0 0x7fc5c4067bb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc5d4000f60 tx=0x7fc5d4009040 comp rx=0 tx=0).stop 2023-10-18T12:20:30.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.033+0000 7fc5e359e700 1 -- 172.21.15.114:0/254579542 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5e40ce950 msgr2=0x7fc5e41f5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:30.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.033+0000 7fc5e359e700 1 --2- 172.21.15.114:0/254579542 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5e40ce950 0x7fc5e41f5e70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc00efc0 tx=0x7fc5dc00c3a0 comp rx=0 tx=0).stop 2023-10-18T12:20:30.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.033+0000 7fc5e359e700 1 -- 172.21.15.114:0/254579542 shutdown_connections 2023-10-18T12:20:30.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.033+0000 7fc5e359e700 1 --2- 172.21.15.114:0/254579542 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc5c40656f0 0x7fc5c4067bb0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:30.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.033+0000 7fc5e359e700 1 --2- 172.21.15.114:0/254579542 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc5e40c5400 0x7fc5e4156c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:30.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.033+0000 7fc5e359e700 1 --2- 172.21.15.114:0/254579542 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc5e40ce950 0x7fc5e41f5e70 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:30.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.033+0000 7fc5e359e700 1 --2- 172.21.15.114:0/254579542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5e4070a30 0x7fc5e4163710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:30.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.033+0000 7fc5e359e700 1 -- 172.21.15.114:0/254579542 >> 172.21.15.114:0/254579542 conn(0x7fc5e40cb920 msgr2=0x7fc5e40cb0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:30.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.033+0000 7fc5e359e700 1 -- 172.21.15.114:0/254579542 shutdown_connections 2023-10-18T12:20:30.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.033+0000 7fc5e359e700 1 -- 172.21.15.114:0/254579542 wait complete. 2023-10-18T12:20:30.062 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-18T12:20:30.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.233+0000 7f292359e700 1 Processor -- start 2023-10-18T12:20:30.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.233+0000 7f292359e700 1 -- start start 2023-10-18T12:20:30.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.237+0000 7f292359e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2924070c70 0x7f29240cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:30.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.237+0000 7f292359e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29240b14f0 con 0x7f2924159750 2023-10-18T12:20:30.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.237+0000 7f292359e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29240ce2e0 con 0x7f29240cde70 2023-10-18T12:20:30.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.237+0000 7f292359e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29240c9aa0 con 0x7f2924070c70 2023-10-18T12:20:30.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.237+0000 7f2921d9b700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2924070c70 0x7f29240cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:30.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.237+0000 7f292259c700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f2924159750 0x7f2924070560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:43284/0 (socket says 172.21.15.114:43284) 2023-10-18T12:20:30.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.237+0000 7f292259c700 1 -- 172.21.15.114:0/3718468936 learned_addr learned my addr 172.21.15.114:0/3718468936 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:30.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.237+0000 7f292159a700 1 -- 172.21.15.114:0/3718468936 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4000177811 0 0) 0x7f29240b14f0 con 0x7f2924159750 2023-10-18T12:20:30.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.237+0000 7f292159a700 1 -- 172.21.15.114:0/3718468936 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f290c0035d0 con 0x7f2924159750 2023-10-18T12:20:30.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.237+0000 7f2921d9b700 1 -- 172.21.15.114:0/3718468936 >> v1:172.21.15.172:6789/0 conn(0x7f29240cde70 legacy=0x7f292406cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:30.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.237+0000 7f2921d9b700 1 -- 172.21.15.114:0/3718468936 >> v1:172.21.15.114:6789/0 conn(0x7f2924159750 legacy=0x7f2924070560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:30.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.237+0000 7f2921d9b700 1 -- 172.21.15.114:0/3718468936 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f292415d590 con 0x7f2924070c70 2023-10-18T12:20:30.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.237+0000 7f2921d9b700 1 --2- 172.21.15.114:0/3718468936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2924070c70 0x7f29240cd930 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2918009850 tx=0x7f2918009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60aa2405819ee57d server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:30.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.241+0000 7f292159a700 1 -- 172.21.15.114:0/3718468936 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2918011830 con 0x7f2924070c70 2023-10-18T12:20:30.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.241+0000 7f292159a700 1 -- 172.21.15.114:0/3718468936 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2918011990 con 0x7f2924070c70 2023-10-18T12:20:30.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.241+0000 7f292159a700 1 -- 172.21.15.114:0/3718468936 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2918011d40 con 0x7f2924070c70 2023-10-18T12:20:30.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.241+0000 7f292359e700 1 -- 172.21.15.114:0/3718468936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2924070c70 msgr2=0x7f29240cd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:30.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.241+0000 7f292359e700 1 --2- 172.21.15.114:0/3718468936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2924070c70 0x7f29240cd930 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2918009850 tx=0x7f2918009b60 comp rx=0 tx=0).stop 2023-10-18T12:20:30.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.241+0000 7f292359e700 1 -- 172.21.15.114:0/3718468936 shutdown_connections 2023-10-18T12:20:30.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.241+0000 7f292359e700 1 --2- 172.21.15.114:0/3718468936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2924070c70 0x7f29240cd930 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:30.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.241+0000 7f292359e700 1 -- 172.21.15.114:0/3718468936 >> 172.21.15.114:0/3718468936 conn(0x7f29240ce5c0 msgr2=0x7f29240ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:30.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.241+0000 7f292359e700 1 -- 172.21.15.114:0/3718468936 shutdown_connections 2023-10-18T12:20:30.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.241+0000 7f292359e700 1 -- 172.21.15.114:0/3718468936 wait complete. 2023-10-18T12:20:30.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.245+0000 7f292359e700 1 Processor -- start 2023-10-18T12:20:30.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.245+0000 7f292359e700 1 -- start start 2023-10-18T12:20:30.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.245+0000 7f292359e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2924070c70 0x7f2924153920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:30.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.245+0000 7f292359e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29240cde70 0x7f2924143f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:30.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.245+0000 7f292359e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2924159750 0x7f29240c3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:30.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.245+0000 7f292359e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2924153500 con 0x7f2924159750 2023-10-18T12:20:30.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.245+0000 7f292359e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f292414d430 con 0x7f29240cde70 2023-10-18T12:20:30.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.245+0000 7f292359e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f292415bff0 con 0x7f2924070c70 2023-10-18T12:20:30.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.245+0000 7f2922d9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2924159750 0x7f29240c3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:30.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.245+0000 7f2922d9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2924159750 0x7f29240c3460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44058/0 (socket says 172.21.15.114:44058) 2023-10-18T12:20:30.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.245+0000 7f2922d9d700 1 -- 172.21.15.114:0/315344757 learned_addr learned my addr 172.21.15.114:0/315344757 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:30.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.245+0000 7f2921d9b700 1 --2- 172.21.15.114:0/315344757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29240cde70 0x7f2924143f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:30.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.245+0000 7f292259c700 1 --2- 172.21.15.114:0/315344757 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2924070c70 0x7f2924153920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:30.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.245+0000 7f2922d9d700 1 -- 172.21.15.114:0/315344757 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2924070c70 msgr2=0x7f2924153920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:30.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.245+0000 7f2922d9d700 1 --2- 172.21.15.114:0/315344757 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2924070c70 0x7f2924153920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:30.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.245+0000 7f2922d9d700 1 -- 172.21.15.114:0/315344757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29240cde70 msgr2=0x7f2924143f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:30.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.245+0000 7f2922d9d700 1 --2- 172.21.15.114:0/315344757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29240cde70 0x7f2924143f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:30.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.245+0000 7f2922d9d700 1 -- 172.21.15.114:0/315344757 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29180094b0 con 0x7f2924159750 2023-10-18T12:20:30.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.245+0000 7f292259c700 1 --2- 172.21.15.114:0/315344757 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2924070c70 0x7f2924153920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:30.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.245+0000 7f2922d9d700 1 --2- 172.21.15.114:0/315344757 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2924159750 0x7f29240c3460 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f291c00cc50 tx=0x7f291c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:30.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.249+0000 7f2912ffd700 1 -- 172.21.15.114:0/315344757 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291c003c20 con 0x7f2924159750 2023-10-18T12:20:30.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.249+0000 7f2912ffd700 1 -- 172.21.15.114:0/315344757 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f291c003d80 con 0x7f2924159750 2023-10-18T12:20:30.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.249+0000 7f2912ffd700 1 -- 172.21.15.114:0/315344757 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291c00ab60 con 0x7f2924159750 2023-10-18T12:20:30.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.249+0000 7f292359e700 1 -- 172.21.15.114:0/315344757 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2924152b60 con 0x7f2924159750 2023-10-18T12:20:30.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.249+0000 7f292359e700 1 -- 172.21.15.114:0/315344757 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2924153120 con 0x7f2924159750 2023-10-18T12:20:30.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.249+0000 7f292359e700 1 -- 172.21.15.114:0/315344757 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2924153640 con 0x7f2924159750 2023-10-18T12:20:30.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.249+0000 7f2912ffd700 1 -- 172.21.15.114:0/315344757 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f291c00acc0 con 0x7f2924159750 2023-10-18T12:20:30.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.253+0000 7f2912ffd700 1 --2- 172.21.15.114:0/315344757 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f29040656f0 0x7f2904067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:30.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.253+0000 7f2912ffd700 1 -- 172.21.15.114:0/315344757 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f291c083290 con 0x7f2924159750 2023-10-18T12:20:30.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.253+0000 7f292259c700 1 --2- 172.21.15.114:0/315344757 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f29040656f0 0x7f2904067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:30.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.253+0000 7f292259c700 1 --2- 172.21.15.114:0/315344757 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f29040656f0 0x7f2904067bb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f29140011e0 tx=0x7f2914009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:30.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.257+0000 7f2912ffd700 1 -- 172.21.15.114:0/315344757 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f2924153640 con 0x7f2924159750 2023-10-18T12:20:30.495 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.489+0000 7f292359e700 1 -- 172.21.15.114:0/315344757 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2924153640 con 0x7f2924159750 2023-10-18T12:20:30.496 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.493+0000 7f2912ffd700 1 -- 172.21.15.114:0/315344757 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2924153640 con 0x7f2924159750 2023-10-18T12:20:30.497 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-10-18T12:20:30.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.493+0000 7f292359e700 1 -- 172.21.15.114:0/315344757 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f29040656f0 msgr2=0x7f2904067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:30.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.493+0000 7f292359e700 1 --2- 172.21.15.114:0/315344757 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f29040656f0 0x7f2904067bb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f29140011e0 tx=0x7f2914009040 comp rx=0 tx=0).stop 2023-10-18T12:20:30.500 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.493+0000 7f292359e700 1 -- 172.21.15.114:0/315344757 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2924159750 msgr2=0x7f29240c3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:30.500 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.493+0000 7f292359e700 1 --2- 172.21.15.114:0/315344757 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2924159750 0x7f29240c3460 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f291c00cc50 tx=0x7f291c00cf60 comp rx=0 tx=0).stop 2023-10-18T12:20:30.500 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.493+0000 7f292359e700 1 -- 172.21.15.114:0/315344757 shutdown_connections 2023-10-18T12:20:30.500 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.493+0000 7f292359e700 1 --2- 172.21.15.114:0/315344757 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f29040656f0 0x7f2904067bb0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:30.500 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.493+0000 7f292359e700 1 --2- 172.21.15.114:0/315344757 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2924159750 0x7f29240c3460 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:30.501 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.493+0000 7f292359e700 1 --2- 172.21.15.114:0/315344757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29240cde70 0x7f2924143f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:30.501 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.493+0000 7f292359e700 1 --2- 172.21.15.114:0/315344757 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2924070c70 0x7f2924153920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:30.501 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.493+0000 7f292359e700 1 -- 172.21.15.114:0/315344757 >> 172.21.15.114:0/315344757 conn(0x7f29240ce5c0 msgr2=0x7f292406fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:30.501 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.493+0000 7f292359e700 1 -- 172.21.15.114:0/315344757 shutdown_connections 2023-10-18T12:20:30.501 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.493+0000 7f292359e700 1 -- 172.21.15.114:0/315344757 wait complete. 2023-10-18T12:20:30.520 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-18T12:20:30.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.693+0000 7f01094fb700 1 Processor -- start 2023-10-18T12:20:30.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.697+0000 7f01094fb700 1 -- start start 2023-10-18T12:20:30.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.697+0000 7f01094fb700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f01040d2e00 0x7f01040b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:30.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.697+0000 7f01094fb700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f01040b5ae0 0x7f010406db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:30.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.697+0000 7f01094fb700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f010415d0d0 con 0x7f0104160710 2023-10-18T12:20:30.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.697+0000 7f01094fb700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f010415df90 con 0x7f01040b5ae0 2023-10-18T12:20:30.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.697+0000 7f01094fb700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f010406f0f0 con 0x7f01040d2e00 2023-10-18T12:20:30.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.697+0000 7f01037fe700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f0104160710 0x7f01040d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:43286/0 (socket says 172.21.15.114:43286) 2023-10-18T12:20:30.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.697+0000 7f01037fe700 1 -- 172.21.15.114:0/4284517763 learned_addr learned my addr 172.21.15.114:0/4284517763 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:30.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.697+0000 7f0108cfa700 1 --2- 172.21.15.114:0/4284517763 >> v2:172.21.15.114:3300/0 conn(0x7f01040b5ae0 0x7f010406db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:30.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.697+0000 7f0103fff700 1 --2- 172.21.15.114:0/4284517763 >> v2:172.21.15.172:3300/0 conn(0x7f01040d2e00 0x7f01040b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:30.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.697+0000 7f0102ffd700 1 -- 172.21.15.114:0/4284517763 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2944760732 0 0) 0x7f00f8001110 con 0x7f0104160710 2023-10-18T12:20:30.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.697+0000 7f0102ffd700 1 -- 172.21.15.114:0/4284517763 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00ec0035d0 con 0x7f0104160710 2023-10-18T12:20:30.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.697+0000 7f0103fff700 1 -- 172.21.15.114:0/4284517763 >> v2:172.21.15.114:3300/0 conn(0x7f01040b5ae0 msgr2=0x7f010406db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:30.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.697+0000 7f0103fff700 1 --2- 172.21.15.114:0/4284517763 >> v2:172.21.15.114:3300/0 conn(0x7f01040b5ae0 0x7f010406db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:30.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.697+0000 7f0103fff700 1 -- 172.21.15.114:0/4284517763 >> v1:172.21.15.114:6789/0 conn(0x7f0104160710 legacy=0x7f01040d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:30.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.697+0000 7f0103fff700 1 -- 172.21.15.114:0/4284517763 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f010415d310 con 0x7f01040d2e00 2023-10-18T12:20:30.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.701+0000 7f0103fff700 1 --2- 172.21.15.114:0/4284517763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01040d2e00 0x7f01040b6e00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0104070660 tx=0x7f00f4009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25810cb160cce7ee server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:30.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.701+0000 7f0102ffd700 1 -- 172.21.15.114:0/4284517763 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f4011830 con 0x7f01040d2e00 2023-10-18T12:20:30.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.701+0000 7f0102ffd700 1 -- 172.21.15.114:0/4284517763 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f4011990 con 0x7f01040d2e00 2023-10-18T12:20:30.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.701+0000 7f0102ffd700 1 -- 172.21.15.114:0/4284517763 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f4011d20 con 0x7f01040d2e00 2023-10-18T12:20:30.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.701+0000 7f01094fb700 1 -- 172.21.15.114:0/4284517763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01040d2e00 msgr2=0x7f01040b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:30.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.701+0000 7f01094fb700 1 --2- 172.21.15.114:0/4284517763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01040d2e00 0x7f01040b6e00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0104070660 tx=0x7f00f4009b30 comp rx=0 tx=0).stop 2023-10-18T12:20:30.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.701+0000 7f01094fb700 1 -- 172.21.15.114:0/4284517763 shutdown_connections 2023-10-18T12:20:30.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.701+0000 7f01094fb700 1 --2- 172.21.15.114:0/4284517763 >> v2:172.21.15.114:3300/0 conn(0x7f01040b5ae0 0x7f010406db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:30.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.701+0000 7f01094fb700 1 --2- 172.21.15.114:0/4284517763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01040d2e00 0x7f01040b6e00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:30.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.701+0000 7f01094fb700 1 -- 172.21.15.114:0/4284517763 >> 172.21.15.114:0/4284517763 conn(0x7f0104069f20 msgr2=0x7f010406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:30.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.701+0000 7f01094fb700 1 -- 172.21.15.114:0/4284517763 shutdown_connections 2023-10-18T12:20:30.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.701+0000 7f01094fb700 1 -- 172.21.15.114:0/4284517763 wait complete. 2023-10-18T12:20:30.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.701+0000 7f01094fb700 1 Processor -- start 2023-10-18T12:20:30.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.705+0000 7f01094fb700 1 -- start start 2023-10-18T12:20:30.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.705+0000 7f01094fb700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01040b5ae0 0x7f010414c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:30.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.705+0000 7f01094fb700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f01040d2e00 0x7f01040ad680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:30.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.705+0000 7f01094fb700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0104160710 0x7f010415f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:30.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.705+0000 7f01094fb700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01040ae140 con 0x7f01040b5ae0 2023-10-18T12:20:30.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.705+0000 7f01094fb700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01040ae420 con 0x7f0104160710 2023-10-18T12:20:30.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.705+0000 7f01094fb700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01040ae700 con 0x7f01040d2e00 2023-10-18T12:20:30.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.705+0000 7f0103fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01040b5ae0 0x7f010414c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:30.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.705+0000 7f0103fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01040b5ae0 0x7f010414c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44066/0 (socket says 172.21.15.114:44066) 2023-10-18T12:20:30.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.705+0000 7f0103fff700 1 -- 172.21.15.114:0/1015160109 learned_addr learned my addr 172.21.15.114:0/1015160109 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:30.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.705+0000 7f01037fe700 1 --2- 172.21.15.114:0/1015160109 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f01040d2e00 0x7f01040ad680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:30.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.705+0000 7f0108cfa700 1 --2- 172.21.15.114:0/1015160109 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0104160710 0x7f010415f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:30.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.705+0000 7f0103fff700 1 -- 172.21.15.114:0/1015160109 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f01040d2e00 msgr2=0x7f01040ad680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:30.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.705+0000 7f0103fff700 1 --2- 172.21.15.114:0/1015160109 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f01040d2e00 0x7f01040ad680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:30.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.705+0000 7f0103fff700 1 -- 172.21.15.114:0/1015160109 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0104160710 msgr2=0x7f010415f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:30.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.705+0000 7f0103fff700 1 --2- 172.21.15.114:0/1015160109 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0104160710 0x7f010415f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:30.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.705+0000 7f0103fff700 1 -- 172.21.15.114:0/1015160109 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f40094b0 con 0x7f01040b5ae0 2023-10-18T12:20:30.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.705+0000 7f01037fe700 1 --2- 172.21.15.114:0/1015160109 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f01040d2e00 0x7f01040ad680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:20:30.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.705+0000 7f0108cfa700 1 --2- 172.21.15.114:0/1015160109 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0104160710 0x7f010415f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:20:30.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.705+0000 7f0103fff700 1 --2- 172.21.15.114:0/1015160109 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01040b5ae0 0x7f010414c7e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f00f4014040 tx=0x7f00f4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:30.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.705+0000 7f0100ff9700 1 -- 172.21.15.114:0/1015160109 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f4004450 con 0x7f01040b5ae0 2023-10-18T12:20:30.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.705+0000 7f0100ff9700 1 -- 172.21.15.114:0/1015160109 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f401e070 con 0x7f01040b5ae0 2023-10-18T12:20:30.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.705+0000 7f0100ff9700 1 -- 172.21.15.114:0/1015160109 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f4003900 con 0x7f01040b5ae0 2023-10-18T12:20:30.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.705+0000 7f01094fb700 1 -- 172.21.15.114:0/1015160109 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01040ae9e0 con 0x7f01040b5ae0 2023-10-18T12:20:30.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.705+0000 7f01094fb700 1 -- 172.21.15.114:0/1015160109 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01040af1e0 con 0x7f01040b5ae0 2023-10-18T12:20:30.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.709+0000 7f01094fb700 1 -- 172.21.15.114:0/1015160109 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f010404e910 con 0x7f01040b5ae0 2023-10-18T12:20:30.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.709+0000 7f0100ff9700 1 -- 172.21.15.114:0/1015160109 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f00f4003a60 con 0x7f01040b5ae0 2023-10-18T12:20:30.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.709+0000 7f0100ff9700 1 --2- 172.21.15.114:0/1015160109 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f00f0065740 0x7f00f0067c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:30.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.709+0000 7f0100ff9700 1 -- 172.21.15.114:0/1015160109 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f00f4083d30 con 0x7f01040b5ae0 2023-10-18T12:20:30.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.713+0000 7f01037fe700 1 --2- 172.21.15.114:0/1015160109 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f00f0065740 0x7f00f0067c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:30.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.713+0000 7f01037fe700 1 --2- 172.21.15.114:0/1015160109 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f00f0065740 0x7f00f0067c00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0104160020 tx=0x7f00f8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:30.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.717+0000 7f0100ff9700 1 -- 172.21.15.114:0/1015160109 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f00f4051530 con 0x7f01040b5ae0 2023-10-18T12:20:30.906 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.901+0000 7f01094fb700 1 -- 172.21.15.114:0/1015160109 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f010406d3e0 con 0x7f01040b5ae0 2023-10-18T12:20:30.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.901+0000 7f0100ff9700 1 -- 172.21.15.114:0/1015160109 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f00f40200a0 con 0x7f01040b5ae0 2023-10-18T12:20:30.907 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-10-18T12:20:30.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.905+0000 7f01094fb700 1 -- 172.21.15.114:0/1015160109 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f00f0065740 msgr2=0x7f00f0067c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:30.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.905+0000 7f01094fb700 1 --2- 172.21.15.114:0/1015160109 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f00f0065740 0x7f00f0067c00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0104160020 tx=0x7f00f8009040 comp rx=0 tx=0).stop 2023-10-18T12:20:30.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.905+0000 7f01094fb700 1 -- 172.21.15.114:0/1015160109 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01040b5ae0 msgr2=0x7f010414c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:30.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.905+0000 7f01094fb700 1 --2- 172.21.15.114:0/1015160109 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01040b5ae0 0x7f010414c7e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f00f4014040 tx=0x7f00f4004770 comp rx=0 tx=0).stop 2023-10-18T12:20:30.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.905+0000 7f01094fb700 1 -- 172.21.15.114:0/1015160109 shutdown_connections 2023-10-18T12:20:30.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.905+0000 7f01094fb700 1 --2- 172.21.15.114:0/1015160109 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f00f0065740 0x7f00f0067c00 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:30.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.905+0000 7f01094fb700 1 --2- 172.21.15.114:0/1015160109 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f01040d2e00 0x7f01040ad680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:30.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.905+0000 7f01094fb700 1 --2- 172.21.15.114:0/1015160109 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0104160710 0x7f010415f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:30.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.905+0000 7f01094fb700 1 --2- 172.21.15.114:0/1015160109 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f01040b5ae0 0x7f010414c7e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:30.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.905+0000 7f01094fb700 1 -- 172.21.15.114:0/1015160109 >> 172.21.15.114:0/1015160109 conn(0x7f0104069f20 msgr2=0x7f01040b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:30.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.905+0000 7f01094fb700 1 -- 172.21.15.114:0/1015160109 shutdown_connections 2023-10-18T12:20:30.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:30.905+0000 7f01094fb700 1 -- 172.21.15.114:0/1015160109 wait complete. 2023-10-18T12:20:30.932 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-18T12:20:31.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.125+0000 7fee1d1ba700 1 Processor -- start 2023-10-18T12:20:31.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.125+0000 7fee1d1ba700 1 -- start start 2023-10-18T12:20:31.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.129+0000 7fee1d1ba700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fee180cad50 0x7fee1806e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:31.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.129+0000 7fee1d1ba700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fee1806ea50 0x7fee180c9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:31.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.129+0000 7fee1d1ba700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee180cc3f0 con 0x7fee180c1e30 2023-10-18T12:20:31.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.129+0000 7fee1d1ba700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee180c2210 con 0x7fee1806ea50 2023-10-18T12:20:31.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.129+0000 7fee1d1ba700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee1806d820 con 0x7fee180cad50 2023-10-18T12:20:31.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.129+0000 7fee16d9d700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fee180c1e30 0x7fee1806f450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:43298/0 (socket says 172.21.15.114:43298) 2023-10-18T12:20:31.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.129+0000 7fee16d9d700 1 -- 172.21.15.114:0/2352070551 learned_addr learned my addr 172.21.15.114:0/2352070551 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:31.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.129+0000 7fee1759e700 1 --2- 172.21.15.114:0/2352070551 >> v2:172.21.15.114:3300/0 conn(0x7fee1806ea50 0x7fee180c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:31.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.129+0000 7fee1659c700 1 --2- 172.21.15.114:0/2352070551 >> v2:172.21.15.172:3300/0 conn(0x7fee180cad50 0x7fee1806e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:31.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.129+0000 7fee15d9b700 1 -- 172.21.15.114:0/2352070551 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1892091763 0 0) 0x7fee180cc3f0 con 0x7fee180c1e30 2023-10-18T12:20:31.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.129+0000 7fee15d9b700 1 -- 172.21.15.114:0/2352070551 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee000035d0 con 0x7fee180c1e30 2023-10-18T12:20:31.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.129+0000 7fee1759e700 1 -- 172.21.15.114:0/2352070551 >> v2:172.21.15.172:3300/0 conn(0x7fee180cad50 msgr2=0x7fee1806e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:31.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.129+0000 7fee1759e700 1 --2- 172.21.15.114:0/2352070551 >> v2:172.21.15.172:3300/0 conn(0x7fee180cad50 0x7fee1806e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:31.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.129+0000 7fee1759e700 1 -- 172.21.15.114:0/2352070551 >> v1:172.21.15.114:6789/0 conn(0x7fee180c1e30 legacy=0x7fee1806f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:31.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.129+0000 7fee1759e700 1 -- 172.21.15.114:0/2352070551 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee1806e080 con 0x7fee1806ea50 2023-10-18T12:20:31.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.129+0000 7fee1759e700 1 --2- 172.21.15.114:0/2352070551 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee1806ea50 0x7fee180c9190 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fee18164e30 tx=0x7fee1000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1164153bbdcc2ad6 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:31.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.129+0000 7fee15d9b700 1 -- 172.21.15.114:0/2352070551 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1000e070 con 0x7fee1806ea50 2023-10-18T12:20:31.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.129+0000 7fee15d9b700 1 -- 172.21.15.114:0/2352070551 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee1000bb20 con 0x7fee1806ea50 2023-10-18T12:20:31.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.129+0000 7fee15d9b700 1 -- 172.21.15.114:0/2352070551 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee10012430 con 0x7fee1806ea50 2023-10-18T12:20:31.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.129+0000 7fee1d1ba700 1 -- 172.21.15.114:0/2352070551 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee1806ea50 msgr2=0x7fee180c9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:31.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.129+0000 7fee1d1ba700 1 --2- 172.21.15.114:0/2352070551 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee1806ea50 0x7fee180c9190 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fee18164e30 tx=0x7fee1000b330 comp rx=0 tx=0).stop 2023-10-18T12:20:31.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.133+0000 7fee1d1ba700 1 -- 172.21.15.114:0/2352070551 shutdown_connections 2023-10-18T12:20:31.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.133+0000 7fee1d1ba700 1 --2- 172.21.15.114:0/2352070551 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee1806ea50 0x7fee180c9190 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:31.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.133+0000 7fee1d1ba700 1 --2- 172.21.15.114:0/2352070551 >> v2:172.21.15.172:3300/0 conn(0x7fee180cad50 0x7fee1806e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:31.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.133+0000 7fee1d1ba700 1 -- 172.21.15.114:0/2352070551 >> 172.21.15.114:0/2352070551 conn(0x7fee180ce820 msgr2=0x7fee180cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:31.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.133+0000 7fee1d1ba700 1 -- 172.21.15.114:0/2352070551 shutdown_connections 2023-10-18T12:20:31.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.133+0000 7fee1d1ba700 1 -- 172.21.15.114:0/2352070551 wait complete. 2023-10-18T12:20:31.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.133+0000 7fee1d1ba700 1 Processor -- start 2023-10-18T12:20:31.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.133+0000 7fee1d1ba700 1 -- start start 2023-10-18T12:20:31.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.137+0000 7fee1d1ba700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee1806ea50 0x7fee180c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:31.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.137+0000 7fee1d1ba700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fee180c1e30 0x7fee180b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:31.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.137+0000 7fee1d1ba700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee180cad50 0x7fee181518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:31.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.137+0000 7fee1d1ba700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee180b32d0 con 0x7fee1806ea50 2023-10-18T12:20:31.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.137+0000 7fee1d1ba700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee180b2230 con 0x7fee180cad50 2023-10-18T12:20:31.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.137+0000 7fee1d1ba700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee180b2510 con 0x7fee180c1e30 2023-10-18T12:20:31.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.137+0000 7fee16d9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee1806ea50 0x7fee180c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:31.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.137+0000 7fee16d9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee1806ea50 0x7fee180c6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44088/0 (socket says 172.21.15.114:44088) 2023-10-18T12:20:31.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.137+0000 7fee16d9d700 1 -- 172.21.15.114:0/2056754850 learned_addr learned my addr 172.21.15.114:0/2056754850 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:31.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.137+0000 7fee1659c700 1 --2- 172.21.15.114:0/2056754850 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fee180c1e30 0x7fee180b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:31.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.137+0000 7fee1759e700 1 --2- 172.21.15.114:0/2056754850 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee180cad50 0x7fee181518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:31.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.137+0000 7fee16d9d700 1 -- 172.21.15.114:0/2056754850 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fee180c1e30 msgr2=0x7fee180b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:31.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.137+0000 7fee16d9d700 1 --2- 172.21.15.114:0/2056754850 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fee180c1e30 0x7fee180b3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:31.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.137+0000 7fee16d9d700 1 -- 172.21.15.114:0/2056754850 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee180cad50 msgr2=0x7fee181518c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:31.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.137+0000 7fee16d9d700 1 --2- 172.21.15.114:0/2056754850 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee180cad50 0x7fee181518c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:31.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.137+0000 7fee16d9d700 1 -- 172.21.15.114:0/2056754850 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee10009a70 con 0x7fee1806ea50 2023-10-18T12:20:31.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.137+0000 7fee16d9d700 1 --2- 172.21.15.114:0/2056754850 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee1806ea50 0x7fee180c6cc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fee0800c700 tx=0x7fee0800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:31.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.137+0000 7fedff7fe700 1 -- 172.21.15.114:0/2056754850 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee08005d90 con 0x7fee1806ea50 2023-10-18T12:20:31.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.137+0000 7fedff7fe700 1 -- 172.21.15.114:0/2056754850 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee080070d0 con 0x7fee1806ea50 2023-10-18T12:20:31.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.137+0000 7fee1d1ba700 1 -- 172.21.15.114:0/2056754850 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee180b27f0 con 0x7fee1806ea50 2023-10-18T12:20:31.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.137+0000 7fedff7fe700 1 -- 172.21.15.114:0/2056754850 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee08007480 con 0x7fee1806ea50 2023-10-18T12:20:31.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.137+0000 7fee1d1ba700 1 -- 172.21.15.114:0/2056754850 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee180b2db0 con 0x7fee1806ea50 2023-10-18T12:20:31.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.141+0000 7fee1d1ba700 1 -- 172.21.15.114:0/2056754850 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee18072e60 con 0x7fee1806ea50 2023-10-18T12:20:31.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.141+0000 7fedff7fe700 1 -- 172.21.15.114:0/2056754850 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fee080075e0 con 0x7fee1806ea50 2023-10-18T12:20:31.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.145+0000 7fedff7fe700 1 --2- 172.21.15.114:0/2056754850 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fee040656f0 0x7fee04067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:31.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.145+0000 7fedff7fe700 1 -- 172.21.15.114:0/2056754850 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fee08082660 con 0x7fee1806ea50 2023-10-18T12:20:31.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.145+0000 7fee1659c700 1 --2- 172.21.15.114:0/2056754850 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fee040656f0 0x7fee04067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:31.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.145+0000 7fee1659c700 1 --2- 172.21.15.114:0/2056754850 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fee040656f0 0x7fee04067bb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fee180c82c0 tx=0x7fee0c009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:31.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.149+0000 7fedff7fe700 1 -- 172.21.15.114:0/2056754850 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fee0804fdf0 con 0x7fee1806ea50 2023-10-18T12:20:31.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.341+0000 7fee1d1ba700 1 -- 172.21.15.114:0/2056754850 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fee180c1970 con 0x7fee1806ea50 2023-10-18T12:20:31.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.345+0000 7fedff7fe700 1 -- 172.21.15.114:0/2056754850 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7fee08053410 con 0x7fee1806ea50 2023-10-18T12:20:31.349 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-10-18T12:20:31.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.349+0000 7fee1d1ba700 1 -- 172.21.15.114:0/2056754850 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fee040656f0 msgr2=0x7fee04067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:31.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.349+0000 7fee1d1ba700 1 --2- 172.21.15.114:0/2056754850 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fee040656f0 0x7fee04067bb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fee180c82c0 tx=0x7fee0c009240 comp rx=0 tx=0).stop 2023-10-18T12:20:31.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.349+0000 7fee1d1ba700 1 -- 172.21.15.114:0/2056754850 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee1806ea50 msgr2=0x7fee180c6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:31.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.349+0000 7fee1d1ba700 1 --2- 172.21.15.114:0/2056754850 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee1806ea50 0x7fee180c6cc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fee0800c700 tx=0x7fee0800ca10 comp rx=0 tx=0).stop 2023-10-18T12:20:31.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.349+0000 7fee1d1ba700 1 -- 172.21.15.114:0/2056754850 shutdown_connections 2023-10-18T12:20:31.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.349+0000 7fee1d1ba700 1 --2- 172.21.15.114:0/2056754850 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fee040656f0 0x7fee04067bb0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:31.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.349+0000 7fee1d1ba700 1 --2- 172.21.15.114:0/2056754850 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fee180c1e30 0x7fee180b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:31.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.349+0000 7fee1d1ba700 1 --2- 172.21.15.114:0/2056754850 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee180cad50 0x7fee181518c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:31.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.349+0000 7fee1d1ba700 1 --2- 172.21.15.114:0/2056754850 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee1806ea50 0x7fee180c6cc0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:31.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.349+0000 7fee1d1ba700 1 -- 172.21.15.114:0/2056754850 >> 172.21.15.114:0/2056754850 conn(0x7fee180ce820 msgr2=0x7fee180af090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:31.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.349+0000 7fee1d1ba700 1 -- 172.21.15.114:0/2056754850 shutdown_connections 2023-10-18T12:20:31.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.349+0000 7fee1d1ba700 1 -- 172.21.15.114:0/2056754850 wait complete. 2023-10-18T12:20:31.375 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T12:20:31.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.545+0000 7f46990b2700 1 Processor -- start 2023-10-18T12:20:31.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.545+0000 7f46990b2700 1 -- start start 2023-10-18T12:20:31.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.549+0000 7f46990b2700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4694160710 0x7f46940b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:31.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.549+0000 7f46990b2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f46940b5ae0 0x7f469406db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:31.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.549+0000 7f46990b2700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f469415d0d0 con 0x7f46940d2e00 2023-10-18T12:20:31.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.549+0000 7f46990b2700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f469415df90 con 0x7f4694160710 2023-10-18T12:20:31.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.549+0000 7f46990b2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469406f0f0 con 0x7f46940b5ae0 2023-10-18T12:20:31.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.549+0000 7f46937fe700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4694160710 0x7f46940b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:31.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.549+0000 7f46937fe700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4694160710 0x7f46940b6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44104/0 (socket says 172.21.15.114:44104) 2023-10-18T12:20:31.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.549+0000 7f46937fe700 1 -- 172.21.15.114:0/2788215844 learned_addr learned my addr 172.21.15.114:0/2788215844 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:31.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.549+0000 7f46988b1700 1 --2- 172.21.15.114:0/2788215844 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f46940b5ae0 0x7f469406db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:31.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.549+0000 7f46937fe700 1 -- 172.21.15.114:0/2788215844 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f46940b5ae0 msgr2=0x7f469406db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:31.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.549+0000 7f46937fe700 1 --2- 172.21.15.114:0/2788215844 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f46940b5ae0 0x7f469406db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:31.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.549+0000 7f46937fe700 1 -- 172.21.15.114:0/2788215844 >> v1:172.21.15.172:6789/0 conn(0x7f46940d2e00 legacy=0x7f46940d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:31.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.549+0000 7f46937fe700 1 -- 172.21.15.114:0/2788215844 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f469415d310 con 0x7f4694160710 2023-10-18T12:20:31.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.549+0000 7f46988b1700 1 --2- 172.21.15.114:0/2788215844 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f46940b5ae0 0x7f469406db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:31.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.553+0000 7f46937fe700 1 --2- 172.21.15.114:0/2788215844 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4694160710 0x7f46940b6e00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4688009910 tx=0x7f4688009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39332fa53a2e3450 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:31.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.553+0000 7f4692ffd700 1 -- 172.21.15.114:0/2788215844 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468800ba60 con 0x7f4694160710 2023-10-18T12:20:31.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.553+0000 7f4692ffd700 1 -- 172.21.15.114:0/2788215844 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468800bbc0 con 0x7f4694160710 2023-10-18T12:20:31.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.553+0000 7f4692ffd700 1 -- 172.21.15.114:0/2788215844 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4688009e60 con 0x7f4694160710 2023-10-18T12:20:31.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.553+0000 7f46990b2700 1 -- 172.21.15.114:0/2788215844 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4694160710 msgr2=0x7f46940b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:31.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.553+0000 7f46990b2700 1 --2- 172.21.15.114:0/2788215844 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4694160710 0x7f46940b6e00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4688009910 tx=0x7f4688009c20 comp rx=0 tx=0).stop 2023-10-18T12:20:31.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.553+0000 7f46990b2700 1 -- 172.21.15.114:0/2788215844 shutdown_connections 2023-10-18T12:20:31.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.553+0000 7f46990b2700 1 --2- 172.21.15.114:0/2788215844 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f46940b5ae0 0x7f469406db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:31.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.553+0000 7f46990b2700 1 --2- 172.21.15.114:0/2788215844 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4694160710 0x7f46940b6e00 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:31.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.553+0000 7f46990b2700 1 -- 172.21.15.114:0/2788215844 >> 172.21.15.114:0/2788215844 conn(0x7f4694069f20 msgr2=0x7f469406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:31.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.553+0000 7f46990b2700 1 -- 172.21.15.114:0/2788215844 shutdown_connections 2023-10-18T12:20:31.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.553+0000 7f46990b2700 1 -- 172.21.15.114:0/2788215844 wait complete. 2023-10-18T12:20:31.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.557+0000 7f46990b2700 1 Processor -- start 2023-10-18T12:20:31.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.557+0000 7f46990b2700 1 -- start start 2023-10-18T12:20:31.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.557+0000 7f46990b2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f46940b5ae0 0x7f46940aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:31.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.557+0000 7f46990b2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46940d2e00 0x7f4694156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:31.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.557+0000 7f46990b2700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4694160710 0x7f4694158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:31.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.557+0000 7f46990b2700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46940aba80 con 0x7f4694160710 2023-10-18T12:20:31.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.557+0000 7f46990b2700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46940abd60 con 0x7f46940d2e00 2023-10-18T12:20:31.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.557+0000 7f46990b2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46940ac040 con 0x7f46940b5ae0 2023-10-18T12:20:31.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.557+0000 7f46988b1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4694160710 0x7f4694158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:31.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.557+0000 7f46988b1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4694160710 0x7f4694158f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44110/0 (socket says 172.21.15.114:44110) 2023-10-18T12:20:31.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.557+0000 7f46988b1700 1 -- 172.21.15.114:0/1907181380 learned_addr learned my addr 172.21.15.114:0/1907181380 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:31.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.557+0000 7f46937fe700 1 --2- 172.21.15.114:0/1907181380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46940d2e00 0x7f4694156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:31.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.557+0000 7f4693fff700 1 --2- 172.21.15.114:0/1907181380 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f46940b5ae0 0x7f46940aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:31.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.561+0000 7f46988b1700 1 -- 172.21.15.114:0/1907181380 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f46940b5ae0 msgr2=0x7f46940aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:31.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.561+0000 7f46988b1700 1 --2- 172.21.15.114:0/1907181380 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f46940b5ae0 0x7f46940aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:31.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.561+0000 7f46988b1700 1 -- 172.21.15.114:0/1907181380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46940d2e00 msgr2=0x7f4694156640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:31.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.561+0000 7f46988b1700 1 --2- 172.21.15.114:0/1907181380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46940d2e00 0x7f4694156640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:31.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.561+0000 7f46988b1700 1 -- 172.21.15.114:0/1907181380 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4688009570 con 0x7f4694160710 2023-10-18T12:20:31.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.561+0000 7f46988b1700 1 --2- 172.21.15.114:0/1907181380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4694160710 0x7f4694158f60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f468c007df0 tx=0x7f468c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:31.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.561+0000 7f4690ff9700 1 -- 172.21.15.114:0/1907181380 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c00dd20 con 0x7f4694160710 2023-10-18T12:20:31.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.561+0000 7f4690ff9700 1 -- 172.21.15.114:0/1907181380 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468c00f040 con 0x7f4694160710 2023-10-18T12:20:31.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.561+0000 7f46990b2700 1 -- 172.21.15.114:0/1907181380 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46940ac320 con 0x7f4694160710 2023-10-18T12:20:31.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.561+0000 7f4690ff9700 1 -- 172.21.15.114:0/1907181380 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c003cd0 con 0x7f4694160710 2023-10-18T12:20:31.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.561+0000 7f46990b2700 1 -- 172.21.15.114:0/1907181380 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f469415a1a0 con 0x7f4694160710 2023-10-18T12:20:31.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.561+0000 7f46990b2700 1 -- 172.21.15.114:0/1907181380 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46940ac840 con 0x7f4694160710 2023-10-18T12:20:31.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.565+0000 7f4690ff9700 1 -- 172.21.15.114:0/1907181380 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f468c004030 con 0x7f4694160710 2023-10-18T12:20:31.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.565+0000 7f4690ff9700 1 --2- 172.21.15.114:0/1907181380 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f46800656f0 0x7f4680067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:31.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.565+0000 7f4690ff9700 1 -- 172.21.15.114:0/1907181380 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f468c006e40 con 0x7f4694160710 2023-10-18T12:20:31.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.569+0000 7f4693fff700 1 --2- 172.21.15.114:0/1907181380 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f46800656f0 0x7f4680067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:31.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.569+0000 7f4693fff700 1 --2- 172.21.15.114:0/1907181380 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f46800656f0 0x7f4680067bb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4684000f60 tx=0x7f4684009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:31.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.573+0000 7f4690ff9700 1 -- 172.21.15.114:0/1907181380 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f468c0b3d40 con 0x7f4694160710 2023-10-18T12:20:31.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.757+0000 7f46990b2700 1 -- 172.21.15.114:0/1907181380 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4694072e60 con 0x7f4694160710 2023-10-18T12:20:31.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.757+0000 7f4690ff9700 1 -- 172.21.15.114:0/1907181380 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20240 (secure 0 0 0) 0x7f46940ac840 con 0x7f4694160710 2023-10-18T12:20:31.764 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:20:31.764 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":30,"fsid":"240ea340-5d3d-4f52-a4bc-af075aca3deb","created":"2023-10-18T12:19:12.512994+0000","modified":"2023-10-18T12:20:20.604528+0000","last_up_change":"2023-10-18T12:19:25.286009+0000","last_in_change":"2023-10-18T12:19:15.850693+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T12:19:27.040638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-18T12:19:32.358094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-18T12:19:37.333855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-18T12:19:38.055385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-18T12:19:41.679218+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c3578978-1a03-4857-b9d2-34a5da3d7731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6817","nonce":1506287862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6820","nonce":1506287862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6830","nonce":1506287862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6825","nonce":1506287862}]},"public_addr":"172.21.15.114:6817/1506287862","cluster_addr":"172.21.15.114:6820/1506287862","heartbeat_back_addr":"172.21.15.114:6830/1506287862","heartbeat_front_addr":"172.21.15.114:6825/1506287862","state":["exists","up"]},{"osd":1,"uuid":"43eb26a6-e2b3-4670-9559-bd053b5140d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6801","nonce":3302727047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6803","nonce":3302727047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6807","nonce":3302727047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6805","nonce":3302727047}]},"public_addr":"172.21.15.114:6801/3302727047","cluster_addr":"172.21.15.114:6803/3302727047","heartbeat_back_addr":"172.21.15.114:6807/3302727047","heartbeat_front_addr":"172.21.15.114:6805/3302727047","state":["exists","up"]},{"osd":2,"uuid":"f3d4dbd5-521c-4dd2-b687-5768cc7d0938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6809","nonce":2699151351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6811","nonce":2699151351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6815","nonce":2699151351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6813","nonce":2699151351}]},"public_addr":"172.21.15.114:6809/2699151351","cluster_addr":"172.21.15.114:6811/2699151351","heartbeat_back_addr":"172.21.15.114:6815/2699151351","heartbeat_front_addr":"172.21.15.114:6813/2699151351","state":["exists","up"]},{"osd":3,"uuid":"823e5802-92b7-4f0d-b32d-a5748993f1b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6821","nonce":1361608073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6824","nonce":1361608073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6829","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6831","nonce":1361608073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6827","nonce":1361608073}]},"public_addr":"172.21.15.114:6821/1361608073","cluster_addr":"172.21.15.114:6824/1361608073","heartbeat_back_addr":"172.21.15.114:6831/1361608073","heartbeat_front_addr":"172.21.15.114:6827/1361608073","state":["exists","up"]},{"osd":4,"uuid":"e47fb93e-13b4-44a4-b084-8c4384ceb41e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6801","nonce":930839681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6803","nonce":930839681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6807","nonce":930839681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6805","nonce":930839681}]},"public_addr":"172.21.15.172:6801/930839681","cluster_addr":"172.21.15.172:6803/930839681","heartbeat_back_addr":"172.21.15.172:6807/930839681","heartbeat_front_addr":"172.21.15.172:6805/930839681","state":["exists","up"]},{"osd":5,"uuid":"7561a973-f479-45a0-af40-f324728d622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6814","nonce":571761850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6818","nonce":571761850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6824","nonce":571761850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6821","nonce":571761850}]},"public_addr":"172.21.15.172:6814/571761850","cluster_addr":"172.21.15.172:6818/571761850","heartbeat_back_addr":"172.21.15.172:6824/571761850","heartbeat_front_addr":"172.21.15.172:6821/571761850","state":["exists","up"]},{"osd":6,"uuid":"51753f4b-7f06-4f1c-9ec7-6e18a66eb980","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6825","nonce":1680398853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6827","nonce":1680398853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6831","nonce":1680398853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6829","nonce":1680398853}]},"public_addr":"172.21.15.172:6825/1680398853","cluster_addr":"172.21.15.172:6827/1680398853","heartbeat_back_addr":"172.21.15.172:6831/1680398853","heartbeat_front_addr":"172.21.15.172:6829/1680398853","state":["exists","up"]},{"osd":7,"uuid":"4d8b1e15-143d-4d17-9074-59d92f0f9af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6809","nonce":349710101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6811","nonce":349710101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6819","nonce":349710101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6815","nonce":349710101}]},"public_addr":"172.21.15.172:6809/349710101","cluster_addr":"172.21.15.172:6811/349710101","heartbeat_back_addr":"172.21.15.172:6819/349710101","heartbeat_front_addr":"172.21.15.172:6815/349710101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.889460+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.475494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.911473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.648596+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.609994+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.636248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.854589+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.885826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T12:20:31.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.765+0000 7f46990b2700 1 -- 172.21.15.114:0/1907181380 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f46800656f0 msgr2=0x7f4680067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:31.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.765+0000 7f46990b2700 1 --2- 172.21.15.114:0/1907181380 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f46800656f0 0x7f4680067bb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4684000f60 tx=0x7f4684009040 comp rx=0 tx=0).stop 2023-10-18T12:20:31.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.765+0000 7f46990b2700 1 -- 172.21.15.114:0/1907181380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4694160710 msgr2=0x7f4694158f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:31.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.765+0000 7f46990b2700 1 --2- 172.21.15.114:0/1907181380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4694160710 0x7f4694158f60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f468c007df0 tx=0x7f468c00d3b0 comp rx=0 tx=0).stop 2023-10-18T12:20:31.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.765+0000 7f46990b2700 1 -- 172.21.15.114:0/1907181380 shutdown_connections 2023-10-18T12:20:31.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.765+0000 7f46990b2700 1 --2- 172.21.15.114:0/1907181380 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f46800656f0 0x7f4680067bb0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:31.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.765+0000 7f46990b2700 1 --2- 172.21.15.114:0/1907181380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4694160710 0x7f4694158f60 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:31.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.765+0000 7f46990b2700 1 --2- 172.21.15.114:0/1907181380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f46940d2e00 0x7f4694156640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:31.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.765+0000 7f46990b2700 1 --2- 172.21.15.114:0/1907181380 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f46940b5ae0 0x7f46940aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:31.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.765+0000 7f46990b2700 1 -- 172.21.15.114:0/1907181380 >> 172.21.15.114:0/1907181380 conn(0x7f4694069f20 msgr2=0x7f469406f450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:31.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.765+0000 7f46990b2700 1 -- 172.21.15.114:0/1907181380 shutdown_connections 2023-10-18T12:20:31.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.765+0000 7f46990b2700 1 -- 172.21.15.114:0/1907181380 wait complete. 2023-10-18T12:20:31.789 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-18T12:19:27.040638+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-18T12:19:32.358094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-18T12:19:37.333855+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-18T12:19:38.055385+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-18T12:19:41.679218+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-18T12:20:31.790 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-18T12:20:31.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.969+0000 7fe78f59e700 1 Processor -- start 2023-10-18T12:20:31.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.969+0000 7fe78f59e700 1 -- start start 2023-10-18T12:20:31.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.973+0000 7fe78f59e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe7900d3530 0x7fe79006fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:31.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.973+0000 7fe78f59e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7900b6e40 con 0x7fe79015dcf0 2023-10-18T12:20:31.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.973+0000 7fe78f59e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7900b7120 con 0x7fe7900d23e0 2023-10-18T12:20:31.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.973+0000 7fe78f59e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe79015e160 con 0x7fe7900d3530 2023-10-18T12:20:31.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.973+0000 7fe785d9b700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe79015dcf0 0x7fe7900d2e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:43312/0 (socket says 172.21.15.114:43312) 2023-10-18T12:20:31.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.973+0000 7fe785d9b700 1 -- 172.21.15.114:0/1420048540 learned_addr learned my addr 172.21.15.114:0/1420048540 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:31.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.973+0000 7fe78ed9d700 1 --2- 172.21.15.114:0/1420048540 >> v2:172.21.15.172:3300/0 conn(0x7fe7900d3530 0x7fe79006fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:31.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.973+0000 7fe78dd9b700 1 -- 172.21.15.114:0/1420048540 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1497022858 0 0) 0x7fe7900b6e40 con 0x7fe79015dcf0 2023-10-18T12:20:31.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.973+0000 7fe78dd9b700 1 -- 172.21.15.114:0/1420048540 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe77c0035d0 con 0x7fe79015dcf0 2023-10-18T12:20:31.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.973+0000 7fe78dd9b700 1 -- 172.21.15.114:0/1420048540 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2097125659 0 0) 0x7fe7900b7120 con 0x7fe7900d23e0 2023-10-18T12:20:31.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.973+0000 7fe78dd9b700 1 -- 172.21.15.114:0/1420048540 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7900b6e40 con 0x7fe7900d23e0 2023-10-18T12:20:31.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.973+0000 7fe78ed9d700 1 -- 172.21.15.114:0/1420048540 >> v1:172.21.15.172:6789/0 conn(0x7fe7900d23e0 legacy=0x7fe7900b65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:31.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.973+0000 7fe78ed9d700 1 -- 172.21.15.114:0/1420048540 >> v1:172.21.15.114:6789/0 conn(0x7fe79015dcf0 legacy=0x7fe7900d2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:31.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.973+0000 7fe78ed9d700 1 -- 172.21.15.114:0/1420048540 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe79015d4f0 con 0x7fe7900d3530 2023-10-18T12:20:31.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.973+0000 7fe78ed9d700 1 --2- 172.21.15.114:0/1420048540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7900d3530 0x7fe79006fef0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe788009840 tx=0x7fe788009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=985a5e45c85f7a0e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:31.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.977+0000 7fe78dd9b700 1 -- 172.21.15.114:0/1420048540 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe788005ea0 con 0x7fe7900d3530 2023-10-18T12:20:31.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.977+0000 7fe78dd9b700 1 -- 172.21.15.114:0/1420048540 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe788006030 con 0x7fe7900d3530 2023-10-18T12:20:31.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.977+0000 7fe78dd9b700 1 -- 172.21.15.114:0/1420048540 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7880063a0 con 0x7fe7900d3530 2023-10-18T12:20:31.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.977+0000 7fe78f59e700 1 -- 172.21.15.114:0/1420048540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7900d3530 msgr2=0x7fe79006fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:31.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.977+0000 7fe78f59e700 1 --2- 172.21.15.114:0/1420048540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7900d3530 0x7fe79006fef0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe788009840 tx=0x7fe788009b50 comp rx=0 tx=0).stop 2023-10-18T12:20:31.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.977+0000 7fe78f59e700 1 -- 172.21.15.114:0/1420048540 shutdown_connections 2023-10-18T12:20:31.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.977+0000 7fe78f59e700 1 --2- 172.21.15.114:0/1420048540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe7900d3530 0x7fe79006fef0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:31.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.977+0000 7fe78f59e700 1 -- 172.21.15.114:0/1420048540 >> 172.21.15.114:0/1420048540 conn(0x7fe790069f20 msgr2=0x7fe79006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:31.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.977+0000 7fe78f59e700 1 -- 172.21.15.114:0/1420048540 shutdown_connections 2023-10-18T12:20:31.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.977+0000 7fe78f59e700 1 -- 172.21.15.114:0/1420048540 wait complete. 2023-10-18T12:20:31.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.981+0000 7fe78f59e700 1 Processor -- start 2023-10-18T12:20:31.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.981+0000 7fe78f59e700 1 -- start start 2023-10-18T12:20:31.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.981+0000 7fe78f59e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7900d23e0 0x7fe7900b14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:31.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.981+0000 7fe78f59e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe7900d3530 0x7fe7900af6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:31.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.981+0000 7fe78f59e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe79015dcf0 0x7fe79014b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:31.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.981+0000 7fe78f59e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7900afc10 con 0x7fe7900d23e0 2023-10-18T12:20:31.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.981+0000 7fe78f59e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe790148fd0 con 0x7fe79015dcf0 2023-10-18T12:20:31.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.981+0000 7fe78f59e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe790149270 con 0x7fe7900d3530 2023-10-18T12:20:31.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.981+0000 7fe78e59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7900d23e0 0x7fe7900b14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:31.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.981+0000 7fe78e59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7900d23e0 0x7fe7900b14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44122/0 (socket says 172.21.15.114:44122) 2023-10-18T12:20:31.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.981+0000 7fe78e59c700 1 -- 172.21.15.114:0/2861458755 learned_addr learned my addr 172.21.15.114:0/2861458755 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:31.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.981+0000 7fe78ed9d700 1 --2- 172.21.15.114:0/2861458755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe79015dcf0 0x7fe79014b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:31.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.981+0000 7fe785d9b700 1 --2- 172.21.15.114:0/2861458755 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe7900d3530 0x7fe7900af6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:31.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.981+0000 7fe78e59c700 1 -- 172.21.15.114:0/2861458755 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe7900d3530 msgr2=0x7fe7900af6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:31.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.981+0000 7fe78e59c700 1 --2- 172.21.15.114:0/2861458755 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe7900d3530 0x7fe7900af6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:31.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.981+0000 7fe78e59c700 1 -- 172.21.15.114:0/2861458755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe79015dcf0 msgr2=0x7fe79014b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:31.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.981+0000 7fe78e59c700 1 --2- 172.21.15.114:0/2861458755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe79015dcf0 0x7fe79014b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:31.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.981+0000 7fe78e59c700 1 -- 172.21.15.114:0/2861458755 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7880094a0 con 0x7fe7900d23e0 2023-10-18T12:20:31.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.981+0000 7fe78ed9d700 1 --2- 172.21.15.114:0/2861458755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe79015dcf0 0x7fe79014b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:31.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.981+0000 7fe785d9b700 1 --2- 172.21.15.114:0/2861458755 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe7900d3530 0x7fe7900af6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:31.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.981+0000 7fe78e59c700 1 --2- 172.21.15.114:0/2861458755 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7900d23e0 0x7fe7900b14a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe78000c730 tx=0x7fe78000caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:31.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.981+0000 7fe7877fe700 1 -- 172.21.15.114:0/2861458755 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7800052d0 con 0x7fe7900d23e0 2023-10-18T12:20:31.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.981+0000 7fe7877fe700 1 -- 172.21.15.114:0/2861458755 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe780005430 con 0x7fe7900d23e0 2023-10-18T12:20:31.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.981+0000 7fe78f59e700 1 -- 172.21.15.114:0/2861458755 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe79014b840 con 0x7fe7900d23e0 2023-10-18T12:20:31.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.981+0000 7fe7877fe700 1 -- 172.21.15.114:0/2861458755 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7800055a0 con 0x7fe7900d23e0 2023-10-18T12:20:31.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.985+0000 7fe78f59e700 1 -- 172.21.15.114:0/2861458755 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe79014be00 con 0x7fe7900d23e0 2023-10-18T12:20:31.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.985+0000 7fe78f59e700 1 -- 172.21.15.114:0/2861458755 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe79004e910 con 0x7fe7900d23e0 2023-10-18T12:20:31.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.985+0000 7fe7877fe700 1 -- 172.21.15.114:0/2861458755 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fe7800038e0 con 0x7fe7900d23e0 2023-10-18T12:20:31.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.989+0000 7fe7877fe700 1 --2- 172.21.15.114:0/2861458755 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe7700656f0 0x7fe770067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:31.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.989+0000 7fe7877fe700 1 -- 172.21.15.114:0/2861458755 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe7800826a0 con 0x7fe7900d23e0 2023-10-18T12:20:31.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.989+0000 7fe785d9b700 1 --2- 172.21.15.114:0/2861458755 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe7700656f0 0x7fe770067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:31.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.989+0000 7fe785d9b700 1 --2- 172.21.15.114:0/2861458755 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe7700656f0 0x7fe770067bb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe7901615a0 tx=0x7fe778009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:31.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:31.993+0000 7fe7877fe700 1 -- 172.21.15.114:0/2861458755 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fe78004fe20 con 0x7fe7900d23e0 2023-10-18T12:20:32.081 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:20:32.089 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:20:32.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.169+0000 7fe78f59e700 1 -- 172.21.15.114:0/2861458755 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe79006d450 con 0x7fe7900d23e0 2023-10-18T12:20:32.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.169+0000 7fe7877fe700 1 -- 172.21.15.114:0/2861458755 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe780053440 con 0x7fe7900d23e0 2023-10-18T12:20:32.175 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-10-18T12:20:32.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.173+0000 7fe78f59e700 1 -- 172.21.15.114:0/2861458755 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe7700656f0 msgr2=0x7fe770067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:32.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.173+0000 7fe78f59e700 1 --2- 172.21.15.114:0/2861458755 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe7700656f0 0x7fe770067bb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe7901615a0 tx=0x7fe778009040 comp rx=0 tx=0).stop 2023-10-18T12:20:32.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.173+0000 7fe78f59e700 1 -- 172.21.15.114:0/2861458755 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7900d23e0 msgr2=0x7fe7900b14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:32.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.173+0000 7fe78f59e700 1 --2- 172.21.15.114:0/2861458755 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7900d23e0 0x7fe7900b14a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe78000c730 tx=0x7fe78000caf0 comp rx=0 tx=0).stop 2023-10-18T12:20:32.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.173+0000 7fe78f59e700 1 -- 172.21.15.114:0/2861458755 shutdown_connections 2023-10-18T12:20:32.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.173+0000 7fe78f59e700 1 --2- 172.21.15.114:0/2861458755 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe7700656f0 0x7fe770067bb0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:32.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.173+0000 7fe78f59e700 1 --2- 172.21.15.114:0/2861458755 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe7900d3530 0x7fe7900af6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:32.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.173+0000 7fe78f59e700 1 --2- 172.21.15.114:0/2861458755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe79015dcf0 0x7fe79014b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:32.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.173+0000 7fe78f59e700 1 --2- 172.21.15.114:0/2861458755 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe7900d23e0 0x7fe7900b14a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:32.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.173+0000 7fe78f59e700 1 -- 172.21.15.114:0/2861458755 >> 172.21.15.114:0/2861458755 conn(0x7fe790069f20 msgr2=0x7fe79006a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:32.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.173+0000 7fe78f59e700 1 -- 172.21.15.114:0/2861458755 shutdown_connections 2023-10-18T12:20:32.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.173+0000 7fe78f59e700 1 -- 172.21.15.114:0/2861458755 wait complete. 2023-10-18T12:20:32.202 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-18T12:20:32.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.417+0000 7fe99e1d2700 1 Processor -- start 2023-10-18T12:20:32.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.417+0000 7fe99e1d2700 1 -- start start 2023-10-18T12:20:32.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.421+0000 7fe99e1d2700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe99815dcf0 0x7fe99806fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:32.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.421+0000 7fe99e1d2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9980d2e20 0x7fe9980d3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:32.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.421+0000 7fe99e1d2700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9980d37a0 con 0x7fe9980d23e0 2023-10-18T12:20:32.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.421+0000 7fe99e1d2700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe99815e160 con 0x7fe99815dcf0 2023-10-18T12:20:32.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.421+0000 7fe99e1d2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9980b6e40 con 0x7fe9980d2e20 2023-10-18T12:20:32.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.421+0000 7fe99c9cf700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe99815dcf0 0x7fe99806fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:32.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.421+0000 7fe99c9cf700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe99815dcf0 0x7fe99806fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44134/0 (socket says 172.21.15.114:44134) 2023-10-18T12:20:32.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.421+0000 7fe99c9cf700 1 -- 172.21.15.114:0/1169153071 learned_addr learned my addr 172.21.15.114:0/1169153071 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:32.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.421+0000 7fe99d9d1700 1 --2- 172.21.15.114:0/1169153071 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9980d2e20 0x7fe9980d3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:32.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.421+0000 7fe99c9cf700 1 -- 172.21.15.114:0/1169153071 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9980d2e20 msgr2=0x7fe9980d3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:32.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.421+0000 7fe99c9cf700 1 --2- 172.21.15.114:0/1169153071 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9980d2e20 0x7fe9980d3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:32.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.421+0000 7fe99c9cf700 1 -- 172.21.15.114:0/1169153071 >> v1:172.21.15.114:6789/0 conn(0x7fe9980d23e0 legacy=0x7fe9980b65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:32.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.421+0000 7fe99c9cf700 1 -- 172.21.15.114:0/1169153071 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9980b7120 con 0x7fe99815dcf0 2023-10-18T12:20:32.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.421+0000 7fe98ffff700 1 -- 172.21.15.114:0/1169153071 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1288358911 0 0) 0x7fe9980d37a0 con 0x7fe9980d23e0 2023-10-18T12:20:32.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.421+0000 7fe99c9cf700 1 --2- 172.21.15.114:0/1169153071 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe99815dcf0 0x7fe99806fef0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe988009910 tx=0x7fe988009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b33bb97b5f30d6f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:32.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.421+0000 7fe98ffff700 1 -- 172.21.15.114:0/1169153071 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe988011830 con 0x7fe99815dcf0 2023-10-18T12:20:32.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.421+0000 7fe98ffff700 1 -- 172.21.15.114:0/1169153071 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe988011990 con 0x7fe99815dcf0 2023-10-18T12:20:32.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.421+0000 7fe98ffff700 1 -- 172.21.15.114:0/1169153071 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe988011d40 con 0x7fe99815dcf0 2023-10-18T12:20:32.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.425+0000 7fe99e1d2700 1 -- 172.21.15.114:0/1169153071 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe99815dcf0 msgr2=0x7fe99806fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:32.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.425+0000 7fe99e1d2700 1 --2- 172.21.15.114:0/1169153071 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe99815dcf0 0x7fe99806fef0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe988009910 tx=0x7fe988009c20 comp rx=0 tx=0).stop 2023-10-18T12:20:32.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.425+0000 7fe99e1d2700 1 -- 172.21.15.114:0/1169153071 shutdown_connections 2023-10-18T12:20:32.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.425+0000 7fe99e1d2700 1 --2- 172.21.15.114:0/1169153071 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9980d2e20 0x7fe9980d3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:32.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.425+0000 7fe99e1d2700 1 --2- 172.21.15.114:0/1169153071 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe99815dcf0 0x7fe99806fef0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:32.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.425+0000 7fe99e1d2700 1 -- 172.21.15.114:0/1169153071 >> 172.21.15.114:0/1169153071 conn(0x7fe998069f20 msgr2=0x7fe99806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:32.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.425+0000 7fe99e1d2700 1 -- 172.21.15.114:0/1169153071 shutdown_connections 2023-10-18T12:20:32.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.425+0000 7fe99e1d2700 1 -- 172.21.15.114:0/1169153071 wait complete. 2023-10-18T12:20:32.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.425+0000 7fe99e1d2700 1 Processor -- start 2023-10-18T12:20:32.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.425+0000 7fe99e1d2700 1 -- start start 2023-10-18T12:20:32.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.429+0000 7fe99e1d2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9980d23e0 0x7fe99806f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:32.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.429+0000 7fe99e1d2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9980d2e20 0x7fe99815eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:32.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.429+0000 7fe99e1d2700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe99815dcf0 0x7fe998157800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:32.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.429+0000 7fe99e1d2700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9980b18a0 con 0x7fe99815dcf0 2023-10-18T12:20:32.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.429+0000 7fe99e1d2700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9980d0bc0 con 0x7fe9980d2e20 2023-10-18T12:20:32.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.429+0000 7fe99e1d2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe998157d40 con 0x7fe9980d23e0 2023-10-18T12:20:32.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.429+0000 7fe99d9d1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe99815dcf0 0x7fe998157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:32.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.429+0000 7fe99d1d0700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9980d23e0 0x7fe99806f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:32.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.429+0000 7fe99d9d1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe99815dcf0 0x7fe998157800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44136/0 (socket says 172.21.15.114:44136) 2023-10-18T12:20:32.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.429+0000 7fe99d9d1700 1 -- 172.21.15.114:0/756374539 learned_addr learned my addr 172.21.15.114:0/756374539 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:32.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.429+0000 7fe99c9cf700 1 --2- 172.21.15.114:0/756374539 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9980d2e20 0x7fe99815eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:32.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.429+0000 7fe99d9d1700 1 -- 172.21.15.114:0/756374539 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9980d23e0 msgr2=0x7fe99806f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:32.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.429+0000 7fe99d9d1700 1 --2- 172.21.15.114:0/756374539 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9980d23e0 0x7fe99806f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:32.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.429+0000 7fe99d9d1700 1 -- 172.21.15.114:0/756374539 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9980d2e20 msgr2=0x7fe99815eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:32.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.429+0000 7fe99d9d1700 1 --2- 172.21.15.114:0/756374539 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9980d2e20 0x7fe99815eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:32.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.429+0000 7fe99d9d1700 1 -- 172.21.15.114:0/756374539 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe988009570 con 0x7fe99815dcf0 2023-10-18T12:20:32.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.429+0000 7fe99d9d1700 1 --2- 172.21.15.114:0/756374539 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe99815dcf0 0x7fe998157800 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe990009dd0 tx=0x7fe99000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:32.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.429+0000 7fe98dffb700 1 -- 172.21.15.114:0/756374539 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe990009c40 con 0x7fe99815dcf0 2023-10-18T12:20:32.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.429+0000 7fe98dffb700 1 -- 172.21.15.114:0/756374539 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe99000f040 con 0x7fe99815dcf0 2023-10-18T12:20:32.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.429+0000 7fe98dffb700 1 -- 172.21.15.114:0/756374539 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99000ceb0 con 0x7fe99815dcf0 2023-10-18T12:20:32.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.429+0000 7fe99e1d2700 1 -- 172.21.15.114:0/756374539 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9980b37a0 con 0x7fe99815dcf0 2023-10-18T12:20:32.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.429+0000 7fe99e1d2700 1 -- 172.21.15.114:0/756374539 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9980d10b0 con 0x7fe99815dcf0 2023-10-18T12:20:32.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.433+0000 7fe99e1d2700 1 -- 172.21.15.114:0/756374539 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe99804e910 con 0x7fe99815dcf0 2023-10-18T12:20:32.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.433+0000 7fe98dffb700 1 -- 172.21.15.114:0/756374539 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fe990014480 con 0x7fe99815dcf0 2023-10-18T12:20:32.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.433+0000 7fe98dffb700 1 --2- 172.21.15.114:0/756374539 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe97c0656f0 0x7fe97c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:32.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.437+0000 7fe98dffb700 1 -- 172.21.15.114:0/756374539 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe990006e40 con 0x7fe99815dcf0 2023-10-18T12:20:32.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.437+0000 7fe99d1d0700 1 --2- 172.21.15.114:0/756374539 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe97c0656f0 0x7fe97c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:32.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.437+0000 7fe99d1d0700 1 --2- 172.21.15.114:0/756374539 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe97c0656f0 0x7fe97c067bb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe994007fd0 tx=0x7fe994009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:32.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.441+0000 7fe98dffb700 1 -- 172.21.15.114:0/756374539 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fe9900512d0 con 0x7fe99815dcf0 2023-10-18T12:20:32.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.613+0000 7fe99e1d2700 1 -- 172.21.15.114:0/756374539 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe9980b66f0 con 0x7fe99815dcf0 2023-10-18T12:20:32.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.613+0000 7fe98dffb700 1 -- 172.21.15.114:0/756374539 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe9900180a0 con 0x7fe99815dcf0 2023-10-18T12:20:32.619 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 8 2023-10-18T12:20:32.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.617+0000 7fe99e1d2700 1 -- 172.21.15.114:0/756374539 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe97c0656f0 msgr2=0x7fe97c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:32.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.617+0000 7fe99e1d2700 1 --2- 172.21.15.114:0/756374539 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe97c0656f0 0x7fe97c067bb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe994007fd0 tx=0x7fe994009040 comp rx=0 tx=0).stop 2023-10-18T12:20:32.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.617+0000 7fe99e1d2700 1 -- 172.21.15.114:0/756374539 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe99815dcf0 msgr2=0x7fe998157800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:32.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.617+0000 7fe99e1d2700 1 --2- 172.21.15.114:0/756374539 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe99815dcf0 0x7fe998157800 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe990009dd0 tx=0x7fe99000c3a0 comp rx=0 tx=0).stop 2023-10-18T12:20:32.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.617+0000 7fe99e1d2700 1 -- 172.21.15.114:0/756374539 shutdown_connections 2023-10-18T12:20:32.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.617+0000 7fe99e1d2700 1 --2- 172.21.15.114:0/756374539 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe97c0656f0 0x7fe97c067bb0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:32.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.617+0000 7fe99e1d2700 1 --2- 172.21.15.114:0/756374539 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe99815dcf0 0x7fe998157800 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:32.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.617+0000 7fe99e1d2700 1 --2- 172.21.15.114:0/756374539 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9980d2e20 0x7fe99815eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:32.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.617+0000 7fe99e1d2700 1 --2- 172.21.15.114:0/756374539 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9980d23e0 0x7fe99806f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:32.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.617+0000 7fe99e1d2700 1 -- 172.21.15.114:0/756374539 >> 172.21.15.114:0/756374539 conn(0x7fe998069f20 msgr2=0x7fe99815e310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:32.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.621+0000 7fe99e1d2700 1 -- 172.21.15.114:0/756374539 shutdown_connections 2023-10-18T12:20:32.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.621+0000 7fe99e1d2700 1 -- 172.21.15.114:0/756374539 wait complete. 2023-10-18T12:20:32.647 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-18T12:20:32.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.817+0000 7fddf359e700 1 Processor -- start 2023-10-18T12:20:32.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.817+0000 7fddf359e700 1 -- start start 2023-10-18T12:20:32.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.817+0000 7fddf359e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fddf406d090 0x7fddf40b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:32.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.817+0000 7fddf359e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fddf415a410 0x7fddf415a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:32.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.817+0000 7fddf359e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddf4071120 con 0x7fddf406d470 2023-10-18T12:20:32.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.817+0000 7fddf359e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddf415f4f0 con 0x7fddf415a410 2023-10-18T12:20:32.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.817+0000 7fddf359e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf415e990 con 0x7fddf406d090 2023-10-18T12:20:32.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.817+0000 7fddf1d9b700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fddf406d470 0x7fddf4070a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:43326/0 (socket says 172.21.15.114:43326) 2023-10-18T12:20:32.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.817+0000 7fddf1d9b700 1 -- 172.21.15.114:0/3492379456 learned_addr learned my addr 172.21.15.114:0/3492379456 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:32.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.817+0000 7fddf2d9d700 1 --2- 172.21.15.114:0/3492379456 >> v2:172.21.15.114:3300/0 conn(0x7fddf415a410 0x7fddf415a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:32.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.817+0000 7fddf259c700 1 --2- 172.21.15.114:0/3492379456 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fddf406d090 0x7fddf40b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:32.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.817+0000 7fddf159a700 1 -- 172.21.15.114:0/3492379456 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2806508202 0 0) 0x7fddf4071120 con 0x7fddf406d470 2023-10-18T12:20:32.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.821+0000 7fddf159a700 1 -- 172.21.15.114:0/3492379456 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdddc0035d0 con 0x7fddf406d470 2023-10-18T12:20:32.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.821+0000 7fddf159a700 1 -- 172.21.15.114:0/3492379456 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3447839976 0 0) 0x7fdddc0035d0 con 0x7fddf406d470 2023-10-18T12:20:32.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.821+0000 7fddf159a700 1 -- 172.21.15.114:0/3492379456 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fddf406d090 msgr2=0x7fddf40b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:32.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.821+0000 7fddf159a700 1 --2- 172.21.15.114:0/3492379456 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fddf406d090 0x7fddf40b2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:32.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.821+0000 7fddf159a700 1 -- 172.21.15.114:0/3492379456 >> v2:172.21.15.114:3300/0 conn(0x7fddf415a410 msgr2=0x7fddf415a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:32.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.821+0000 7fddf159a700 1 --2- 172.21.15.114:0/3492379456 >> v2:172.21.15.114:3300/0 conn(0x7fddf415a410 0x7fddf415a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:32.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.821+0000 7fddf159a700 1 -- 172.21.15.114:0/3492379456 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf415ec50 con 0x7fddf406d470 2023-10-18T12:20:32.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.821+0000 7fddf159a700 1 -- 172.21.15.114:0/3492379456 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3368469509 0 0) 0x7fdde8001670 con 0x7fddf406d470 2023-10-18T12:20:32.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.821+0000 7fddf159a700 1 -- 172.21.15.114:0/3492379456 >> v1:172.21.15.114:6789/0 conn(0x7fddf406d470 legacy=0x7fddf4070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:32.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.821+0000 7fddf159a700 1 --2- 172.21.15.114:0/3492379456 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdddc003a90 0x7fdddc003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:32.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.821+0000 7fddf159a700 1 --2- 172.21.15.114:0/3492379456 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fddf406d090 0x7fdddc004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:32.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.821+0000 7fddf159a700 1 --2- 172.21.15.114:0/3492379456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdddc004db0 0x7fdddc005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:32.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.821+0000 7fddf159a700 1 -- 172.21.15.114:0/3492379456 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf415f4f0 con 0x7fdddc003a90 2023-10-18T12:20:32.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.821+0000 7fddf159a700 1 -- 172.21.15.114:0/3492379456 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf415e990 con 0x7fdddc004db0 2023-10-18T12:20:32.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.821+0000 7fddf159a700 1 -- 172.21.15.114:0/3492379456 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdddc00ba80 con 0x7fddf406d090 2023-10-18T12:20:32.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.821+0000 7fddf259c700 1 --2- 172.21.15.114:0/3492379456 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdddc003a90 0x7fdddc003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:32.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.821+0000 7fddf1d9b700 1 --2- 172.21.15.114:0/3492379456 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fddf406d090 0x7fdddc004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:32.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.821+0000 7fddf2d9d700 1 --2- 172.21.15.114:0/3492379456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdddc004db0 0x7fdddc005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:32.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.821+0000 7fddf259c700 1 -- 172.21.15.114:0/3492379456 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fddf406d090 msgr2=0x7fdddc004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:32.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.821+0000 7fddf259c700 1 --2- 172.21.15.114:0/3492379456 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fddf406d090 0x7fdddc004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:32.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.821+0000 7fddf259c700 1 -- 172.21.15.114:0/3492379456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdddc004db0 msgr2=0x7fdddc005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:32.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.821+0000 7fddf259c700 1 --2- 172.21.15.114:0/3492379456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdddc004db0 0x7fdddc005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:32.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.821+0000 7fddf259c700 1 -- 172.21.15.114:0/3492379456 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdddc0035d0 con 0x7fdddc003a90 2023-10-18T12:20:32.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.821+0000 7fddf2d9d700 1 --2- 172.21.15.114:0/3492379456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdddc004db0 0x7fdddc005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:20:32.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.821+0000 7fddf259c700 1 --2- 172.21.15.114:0/3492379456 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdddc003a90 0x7fdddc003eb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fdde4009b70 tx=0x7fdddc0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9db0bc5f057d7dc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:32.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.821+0000 7fddf159a700 1 -- 172.21.15.114:0/3492379456 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde400e6c0 con 0x7fdddc003a90 2023-10-18T12:20:32.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.821+0000 7fddf159a700 1 -- 172.21.15.114:0/3492379456 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde400e820 con 0x7fdddc003a90 2023-10-18T12:20:32.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.821+0000 7fddf159a700 1 -- 172.21.15.114:0/3492379456 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde400eb90 con 0x7fdddc003a90 2023-10-18T12:20:32.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.825+0000 7fddf359e700 1 -- 172.21.15.114:0/3492379456 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdddc003a90 msgr2=0x7fdddc003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:32.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.825+0000 7fddf359e700 1 --2- 172.21.15.114:0/3492379456 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdddc003a90 0x7fdddc003eb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fdde4009b70 tx=0x7fdddc0058a0 comp rx=0 tx=0).stop 2023-10-18T12:20:32.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.825+0000 7fddf2d9d700 1 -- 172.21.15.114:0/3492379456 reap_dead start 2023-10-18T12:20:32.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.825+0000 7fddf359e700 1 -- 172.21.15.114:0/3492379456 shutdown_connections 2023-10-18T12:20:32.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.825+0000 7fddf359e700 1 -- 172.21.15.114:0/3492379456 >> 172.21.15.114:0/3492379456 conn(0x7fddf40ce5c0 msgr2=0x7fddf40ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:32.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.825+0000 7fddf359e700 1 -- 172.21.15.114:0/3492379456 shutdown_connections 2023-10-18T12:20:32.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.825+0000 7fddf359e700 1 -- 172.21.15.114:0/3492379456 wait complete. 2023-10-18T12:20:32.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.825+0000 7fddf359e700 1 Processor -- start 2023-10-18T12:20:32.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.829+0000 7fddf359e700 1 -- start start 2023-10-18T12:20:32.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.829+0000 7fddf359e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdddc003a90 0x7fddf40c5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:32.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.829+0000 7fddf359e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddf40c6e10 0x7fddf414c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:32.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.829+0000 7fddf359e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddf4153f20 0x7fddf40c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:32.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.829+0000 7fddf359e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf40c69f0 con 0x7fddf40c6e10 2023-10-18T12:20:32.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.829+0000 7fddf359e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf40b3150 con 0x7fddf4153f20 2023-10-18T12:20:32.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.829+0000 7fddf359e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf40c5d70 con 0x7fdddc003a90 2023-10-18T12:20:32.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.829+0000 7fddf1d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddf40c6e10 0x7fddf414c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:32.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.829+0000 7fddf1d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddf40c6e10 0x7fddf414c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44164/0 (socket says 172.21.15.114:44164) 2023-10-18T12:20:32.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.829+0000 7fddf1d9b700 1 -- 172.21.15.114:0/1368087631 learned_addr learned my addr 172.21.15.114:0/1368087631 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:32.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.829+0000 7fddf2d9d700 1 --2- 172.21.15.114:0/1368087631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddf4153f20 0x7fddf40c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:32.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.829+0000 7fddf259c700 1 --2- 172.21.15.114:0/1368087631 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdddc003a90 0x7fddf40c5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:32.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.829+0000 7fddf1d9b700 1 -- 172.21.15.114:0/1368087631 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdddc003a90 msgr2=0x7fddf40c5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:32.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.829+0000 7fddf1d9b700 1 --2- 172.21.15.114:0/1368087631 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdddc003a90 0x7fddf40c5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:32.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.829+0000 7fddf1d9b700 1 -- 172.21.15.114:0/1368087631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddf4153f20 msgr2=0x7fddf40c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:32.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.829+0000 7fddf1d9b700 1 --2- 172.21.15.114:0/1368087631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddf4153f20 0x7fddf40c8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:32.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.829+0000 7fddf1d9b700 1 -- 172.21.15.114:0/1368087631 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf40c6050 con 0x7fddf40c6e10 2023-10-18T12:20:32.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.829+0000 7fddf2d9d700 1 --2- 172.21.15.114:0/1368087631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddf4153f20 0x7fddf40c8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:32.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.829+0000 7fddf259c700 1 --2- 172.21.15.114:0/1368087631 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdddc003a90 0x7fddf40c5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:32.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.829+0000 7fddf1d9b700 1 --2- 172.21.15.114:0/1368087631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddf40c6e10 0x7fddf414c0c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdde800e800 tx=0x7fdde800ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:32.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.829+0000 7fdde2ffd700 1 -- 172.21.15.114:0/1368087631 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde8012590 con 0x7fddf40c6e10 2023-10-18T12:20:32.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.829+0000 7fdde2ffd700 1 -- 172.21.15.114:0/1368087631 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde80126f0 con 0x7fddf40c6e10 2023-10-18T12:20:32.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.829+0000 7fddf359e700 1 -- 172.21.15.114:0/1368087631 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf40c6330 con 0x7fddf40c6e10 2023-10-18T12:20:32.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.829+0000 7fdde2ffd700 1 -- 172.21.15.114:0/1368087631 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde8012aa0 con 0x7fddf40c6e10 2023-10-18T12:20:32.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.829+0000 7fddf359e700 1 -- 172.21.15.114:0/1368087631 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf40c9130 con 0x7fddf40c6e10 2023-10-18T12:20:32.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.833+0000 7fddf359e700 1 -- 172.21.15.114:0/1368087631 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddf40c6b30 con 0x7fddf40c6e10 2023-10-18T12:20:32.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.833+0000 7fdde2ffd700 1 -- 172.21.15.114:0/1368087631 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fdde8012c00 con 0x7fddf40c6e10 2023-10-18T12:20:32.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.837+0000 7fdde2ffd700 1 --2- 172.21.15.114:0/1368087631 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fddd40656f0 0x7fddd4067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:32.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.837+0000 7fdde2ffd700 1 -- 172.21.15.114:0/1368087631 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdde8082ef0 con 0x7fddf40c6e10 2023-10-18T12:20:32.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.837+0000 7fddf259c700 1 --2- 172.21.15.114:0/1368087631 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fddd40656f0 0x7fddd4067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:32.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.837+0000 7fddf259c700 1 --2- 172.21.15.114:0/1368087631 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fddd40656f0 0x7fddd4067bb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdde40090b0 tx=0x7fdde4008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:32.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:32.841+0000 7fdde2ffd700 1 -- 172.21.15.114:0/1368087631 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fddf40c6b30 con 0x7fddf40c6e10 2023-10-18T12:20:33.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.077+0000 7fddf359e700 1 -- 172.21.15.114:0/1368087631 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fddf40c6b30 con 0x7fddf40c6e10 2023-10-18T12:20:33.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.081+0000 7fdde2ffd700 1 -- 172.21.15.114:0/1368087631 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7fddf40c6b30 con 0x7fddf40c6e10 2023-10-18T12:20:33.084 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-10-18T12:20:33.087 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.081+0000 7fddf359e700 1 -- 172.21.15.114:0/1368087631 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fddd40656f0 msgr2=0x7fddd4067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:33.087 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.081+0000 7fddf359e700 1 --2- 172.21.15.114:0/1368087631 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fddd40656f0 0x7fddd4067bb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdde40090b0 tx=0x7fdde4008030 comp rx=0 tx=0).stop 2023-10-18T12:20:33.087 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.081+0000 7fddf359e700 1 -- 172.21.15.114:0/1368087631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddf40c6e10 msgr2=0x7fddf414c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:33.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.081+0000 7fddf359e700 1 --2- 172.21.15.114:0/1368087631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddf40c6e10 0x7fddf414c0c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdde800e800 tx=0x7fdde800ebc0 comp rx=0 tx=0).stop 2023-10-18T12:20:33.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.081+0000 7fddf359e700 1 -- 172.21.15.114:0/1368087631 shutdown_connections 2023-10-18T12:20:33.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.081+0000 7fddf359e700 1 --2- 172.21.15.114:0/1368087631 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fddd40656f0 0x7fddd4067bb0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:33.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.081+0000 7fddf359e700 1 --2- 172.21.15.114:0/1368087631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddf4153f20 0x7fddf40c8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:33.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.081+0000 7fddf359e700 1 --2- 172.21.15.114:0/1368087631 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddf40c6e10 0x7fddf414c0c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:33.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.081+0000 7fddf359e700 1 --2- 172.21.15.114:0/1368087631 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdddc003a90 0x7fddf40c5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:33.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.081+0000 7fddf359e700 1 -- 172.21.15.114:0/1368087631 >> 172.21.15.114:0/1368087631 conn(0x7fddf40ce5c0 msgr2=0x7fddf41564c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:33.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.081+0000 7fddf359e700 1 -- 172.21.15.114:0/1368087631 shutdown_connections 2023-10-18T12:20:33.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.081+0000 7fddf359e700 1 -- 172.21.15.114:0/1368087631 wait complete. 2023-10-18T12:20:33.110 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-18T12:20:33.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.309+0000 7fac4f341700 1 Processor -- start 2023-10-18T12:20:33.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.309+0000 7fac4f341700 1 -- start start 2023-10-18T12:20:33.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.309+0000 7fac4f341700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac480c1e30 0x7fac4806f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:33.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.309+0000 7fac4f341700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fac480cad50 0x7fac4806e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:33.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.309+0000 7fac4f341700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac480cc3f0 con 0x7fac4806ea50 2023-10-18T12:20:33.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.309+0000 7fac4f341700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac480c2210 con 0x7fac480cad50 2023-10-18T12:20:33.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.309+0000 7fac4f341700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac4806d820 con 0x7fac480c1e30 2023-10-18T12:20:33.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.313+0000 7fac4d8de700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fac4806ea50 0x7fac48164ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:43328/0 (socket says 172.21.15.114:43328) 2023-10-18T12:20:33.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.313+0000 7fac4d8de700 1 -- 172.21.15.114:0/417701907 learned_addr learned my addr 172.21.15.114:0/417701907 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:33.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.313+0000 7fac4c8dc700 1 --2- 172.21.15.114:0/417701907 >> v2:172.21.15.114:3300/0 conn(0x7fac480cad50 0x7fac4806e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:33.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.313+0000 7fac4d0dd700 1 --2- 172.21.15.114:0/417701907 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac480c1e30 0x7fac4806f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:33.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.313+0000 7fac3ffff700 1 -- 172.21.15.114:0/417701907 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2252614584 0 0) 0x7fac480cc3f0 con 0x7fac4806ea50 2023-10-18T12:20:33.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.313+0000 7fac3ffff700 1 -- 172.21.15.114:0/417701907 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac340035d0 con 0x7fac4806ea50 2023-10-18T12:20:33.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.313+0000 7fac4c8dc700 1 -- 172.21.15.114:0/417701907 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac480c1e30 msgr2=0x7fac4806f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:33.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.313+0000 7fac4c8dc700 1 --2- 172.21.15.114:0/417701907 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac480c1e30 0x7fac4806f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:33.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.313+0000 7fac4c8dc700 1 -- 172.21.15.114:0/417701907 >> v1:172.21.15.114:6789/0 conn(0x7fac4806ea50 legacy=0x7fac48164ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:33.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.313+0000 7fac4c8dc700 1 -- 172.21.15.114:0/417701907 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac4806e080 con 0x7fac480cad50 2023-10-18T12:20:33.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.313+0000 7fac4c8dc700 1 --2- 172.21.15.114:0/417701907 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac480cad50 0x7fac4806e510 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fac38009850 tx=0x7fac38009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f6463e1324c166 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:33.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.313+0000 7fac3ffff700 1 -- 172.21.15.114:0/417701907 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac38011830 con 0x7fac480cad50 2023-10-18T12:20:33.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.313+0000 7fac3ffff700 1 -- 172.21.15.114:0/417701907 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac38011990 con 0x7fac480cad50 2023-10-18T12:20:33.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.313+0000 7fac3ffff700 1 -- 172.21.15.114:0/417701907 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac38011d40 con 0x7fac480cad50 2023-10-18T12:20:33.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.313+0000 7fac4f341700 1 -- 172.21.15.114:0/417701907 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac480cad50 msgr2=0x7fac4806e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:33.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.313+0000 7fac4f341700 1 --2- 172.21.15.114:0/417701907 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac480cad50 0x7fac4806e510 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fac38009850 tx=0x7fac38009b60 comp rx=0 tx=0).stop 2023-10-18T12:20:33.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.313+0000 7fac4f341700 1 -- 172.21.15.114:0/417701907 shutdown_connections 2023-10-18T12:20:33.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.313+0000 7fac4f341700 1 --2- 172.21.15.114:0/417701907 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac480cad50 0x7fac4806e510 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:33.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.313+0000 7fac4f341700 1 --2- 172.21.15.114:0/417701907 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac480c1e30 0x7fac4806f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:33.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.313+0000 7fac4f341700 1 -- 172.21.15.114:0/417701907 >> 172.21.15.114:0/417701907 conn(0x7fac480ce820 msgr2=0x7fac480cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:33.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.317+0000 7fac4f341700 1 -- 172.21.15.114:0/417701907 shutdown_connections 2023-10-18T12:20:33.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.317+0000 7fac4f341700 1 -- 172.21.15.114:0/417701907 wait complete. 2023-10-18T12:20:33.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.321+0000 7fac4f341700 1 Processor -- start 2023-10-18T12:20:33.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.321+0000 7fac4f341700 1 -- start start 2023-10-18T12:20:33.326 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.321+0000 7fac4f341700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac4806ea50 0x7fac48160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:33.326 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.321+0000 7fac4f341700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac480c1e30 0x7fac48161690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:33.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.321+0000 7fac4f341700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac480cad50 0x7fac481630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:33.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.321+0000 7fac4f341700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac48161420 con 0x7fac480c1e30 2023-10-18T12:20:33.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.321+0000 7fac4f341700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac481620e0 con 0x7fac480cad50 2023-10-18T12:20:33.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.321+0000 7fac4f341700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac481623c0 con 0x7fac4806ea50 2023-10-18T12:20:33.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.321+0000 7fac4c8dc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac480c1e30 0x7fac48161690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:33.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.321+0000 7fac4c8dc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac480c1e30 0x7fac48161690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44176/0 (socket says 172.21.15.114:44176) 2023-10-18T12:20:33.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.321+0000 7fac4c8dc700 1 -- 172.21.15.114:0/3192412414 learned_addr learned my addr 172.21.15.114:0/3192412414 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:33.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.321+0000 7fac4d0dd700 1 --2- 172.21.15.114:0/3192412414 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac4806ea50 0x7fac48160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:33.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.321+0000 7fac4d8de700 1 --2- 172.21.15.114:0/3192412414 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac480cad50 0x7fac481630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:33.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.321+0000 7fac4c8dc700 1 -- 172.21.15.114:0/3192412414 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac4806ea50 msgr2=0x7fac48160ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:33.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.321+0000 7fac4c8dc700 1 --2- 172.21.15.114:0/3192412414 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac4806ea50 0x7fac48160ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:33.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.321+0000 7fac4c8dc700 1 -- 172.21.15.114:0/3192412414 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac480cad50 msgr2=0x7fac481630a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:33.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.321+0000 7fac4c8dc700 1 --2- 172.21.15.114:0/3192412414 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac480cad50 0x7fac481630a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:33.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.321+0000 7fac4c8dc700 1 -- 172.21.15.114:0/3192412414 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac380094b0 con 0x7fac480c1e30 2023-10-18T12:20:33.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.321+0000 7fac4c8dc700 1 --2- 172.21.15.114:0/3192412414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac480c1e30 0x7fac48161690 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fac38014040 tx=0x7fac38004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:33.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.321+0000 7fac3dffb700 1 -- 172.21.15.114:0/3192412414 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac380038c0 con 0x7fac480c1e30 2023-10-18T12:20:33.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.321+0000 7fac3dffb700 1 -- 172.21.15.114:0/3192412414 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac3801e070 con 0x7fac480c1e30 2023-10-18T12:20:33.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.321+0000 7fac4f341700 1 -- 172.21.15.114:0/3192412414 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac481626a0 con 0x7fac480c1e30 2023-10-18T12:20:33.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.321+0000 7fac3dffb700 1 -- 172.21.15.114:0/3192412414 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac38003c80 con 0x7fac480c1e30 2023-10-18T12:20:33.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.325+0000 7fac4f341700 1 -- 172.21.15.114:0/3192412414 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac48162c60 con 0x7fac480c1e30 2023-10-18T12:20:33.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.325+0000 7fac4f341700 1 -- 172.21.15.114:0/3192412414 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac48072e60 con 0x7fac480c1e30 2023-10-18T12:20:33.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.325+0000 7fac3dffb700 1 -- 172.21.15.114:0/3192412414 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fac3801a420 con 0x7fac480c1e30 2023-10-18T12:20:33.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.329+0000 7fac3dffb700 1 --2- 172.21.15.114:0/3192412414 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fac2c0656f0 0x7fac2c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:33.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.329+0000 7fac3dffb700 1 -- 172.21.15.114:0/3192412414 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fac38020070 con 0x7fac480c1e30 2023-10-18T12:20:33.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.329+0000 7fac4d0dd700 1 --2- 172.21.15.114:0/3192412414 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fac2c0656f0 0x7fac2c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:33.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.329+0000 7fac4d0dd700 1 --2- 172.21.15.114:0/3192412414 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fac2c0656f0 0x7fac2c067bb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fac44009950 tx=0x7fac44008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:33.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.333+0000 7fac3dffb700 1 -- 172.21.15.114:0/3192412414 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fac38051e30 con 0x7fac480c1e30 2023-10-18T12:20:33.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.513+0000 7fac4f341700 1 -- 172.21.15.114:0/3192412414 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fac4806d0f0 con 0x7fac480c1e30 2023-10-18T12:20:33.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.513+0000 7fac3dffb700 1 -- 172.21.15.114:0/3192412414 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7fac38006ce0 con 0x7fac480c1e30 2023-10-18T12:20:33.517 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-10-18T12:20:33.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.517+0000 7fac4f341700 1 -- 172.21.15.114:0/3192412414 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fac2c0656f0 msgr2=0x7fac2c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:33.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.517+0000 7fac4f341700 1 --2- 172.21.15.114:0/3192412414 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fac2c0656f0 0x7fac2c067bb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fac44009950 tx=0x7fac44008040 comp rx=0 tx=0).stop 2023-10-18T12:20:33.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.517+0000 7fac4f341700 1 -- 172.21.15.114:0/3192412414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac480c1e30 msgr2=0x7fac48161690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:33.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.517+0000 7fac4f341700 1 --2- 172.21.15.114:0/3192412414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac480c1e30 0x7fac48161690 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fac38014040 tx=0x7fac38004770 comp rx=0 tx=0).stop 2023-10-18T12:20:33.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.517+0000 7fac4f341700 1 -- 172.21.15.114:0/3192412414 shutdown_connections 2023-10-18T12:20:33.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.517+0000 7fac4f341700 1 --2- 172.21.15.114:0/3192412414 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fac2c0656f0 0x7fac2c067bb0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:33.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.517+0000 7fac4f341700 1 --2- 172.21.15.114:0/3192412414 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac480cad50 0x7fac481630a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:33.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.517+0000 7fac4f341700 1 --2- 172.21.15.114:0/3192412414 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac480c1e30 0x7fac48161690 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:33.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.517+0000 7fac4f341700 1 --2- 172.21.15.114:0/3192412414 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac4806ea50 0x7fac48160ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:33.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.517+0000 7fac4f341700 1 -- 172.21.15.114:0/3192412414 >> 172.21.15.114:0/3192412414 conn(0x7fac480ce820 msgr2=0x7fac480cb210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:33.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.517+0000 7fac4f341700 1 -- 172.21.15.114:0/3192412414 shutdown_connections 2023-10-18T12:20:33.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.517+0000 7fac4f341700 1 -- 172.21.15.114:0/3192412414 wait complete. 2023-10-18T12:20:33.544 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-18T12:20:33.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.721+0000 7f14e495f700 1 Processor -- start 2023-10-18T12:20:33.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.721+0000 7f14e495f700 1 -- start start 2023-10-18T12:20:33.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.725+0000 7f14e495f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14e00d2e00 0x7f14e00b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:33.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.725+0000 7f14e495f700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f14e00b5ae0 0x7f14e006db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:33.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.725+0000 7f14e495f700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14e015d0d0 con 0x7f14e0160710 2023-10-18T12:20:33.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.725+0000 7f14e495f700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14e015df90 con 0x7f14e00b5ae0 2023-10-18T12:20:33.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.725+0000 7f14e495f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e006f0f0 con 0x7f14e00d2e00 2023-10-18T12:20:33.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.725+0000 7f14df7fe700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14e00d2e00 0x7f14e00b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:33.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.725+0000 7f14deffd700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f14e0160710 0x7f14e00d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:43340/0 (socket says 172.21.15.114:43340) 2023-10-18T12:20:33.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.725+0000 7f14deffd700 1 -- 172.21.15.114:0/3308343088 learned_addr learned my addr 172.21.15.114:0/3308343088 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:33.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.725+0000 7f14dffff700 1 --2- 172.21.15.114:0/3308343088 >> v2:172.21.15.172:3300/0 conn(0x7f14e00b5ae0 0x7f14e006db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:33.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.725+0000 7f14df7fe700 1 -- 172.21.15.114:0/3308343088 >> v2:172.21.15.172:3300/0 conn(0x7f14e00b5ae0 msgr2=0x7f14e006db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:33.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.725+0000 7f14df7fe700 1 --2- 172.21.15.114:0/3308343088 >> v2:172.21.15.172:3300/0 conn(0x7f14e00b5ae0 0x7f14e006db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:33.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.725+0000 7f14df7fe700 1 -- 172.21.15.114:0/3308343088 >> v1:172.21.15.114:6789/0 conn(0x7f14e0160710 legacy=0x7f14e00d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:33.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.725+0000 7f14de7fc700 1 -- 172.21.15.114:0/3308343088 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 899191507 0 0) 0x7f14d4001110 con 0x7f14e0160710 2023-10-18T12:20:33.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.725+0000 7f14df7fe700 1 -- 172.21.15.114:0/3308343088 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e015d310 con 0x7f14e00d2e00 2023-10-18T12:20:33.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.725+0000 7f14dffff700 1 --2- 172.21.15.114:0/3308343088 >> v2:172.21.15.172:3300/0 conn(0x7f14e00b5ae0 0x7f14e006db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:33.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.725+0000 7f14df7fe700 1 --2- 172.21.15.114:0/3308343088 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14e00d2e00 0x7f14e00b6e00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f14d0009880 tx=0x7f14d0009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b49fe2ae87399868 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:33.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.725+0000 7f14de7fc700 1 -- 172.21.15.114:0/3308343088 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d0011830 con 0x7f14e00d2e00 2023-10-18T12:20:33.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.725+0000 7f14de7fc700 1 -- 172.21.15.114:0/3308343088 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d0011990 con 0x7f14e00d2e00 2023-10-18T12:20:33.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.725+0000 7f14de7fc700 1 -- 172.21.15.114:0/3308343088 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d0011d20 con 0x7f14e00d2e00 2023-10-18T12:20:33.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.729+0000 7f14e495f700 1 -- 172.21.15.114:0/3308343088 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14e00d2e00 msgr2=0x7f14e00b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:33.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.729+0000 7f14e495f700 1 --2- 172.21.15.114:0/3308343088 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14e00d2e00 0x7f14e00b6e00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f14d0009880 tx=0x7f14d0009b90 comp rx=0 tx=0).stop 2023-10-18T12:20:33.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.729+0000 7f14e495f700 1 -- 172.21.15.114:0/3308343088 shutdown_connections 2023-10-18T12:20:33.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.729+0000 7f14e495f700 1 --2- 172.21.15.114:0/3308343088 >> v2:172.21.15.172:3300/0 conn(0x7f14e00b5ae0 0x7f14e006db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:33.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.729+0000 7f14e495f700 1 --2- 172.21.15.114:0/3308343088 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14e00d2e00 0x7f14e00b6e00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:33.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.729+0000 7f14e495f700 1 -- 172.21.15.114:0/3308343088 >> 172.21.15.114:0/3308343088 conn(0x7f14e0069f20 msgr2=0x7f14e006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:33.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.729+0000 7f14e495f700 1 -- 172.21.15.114:0/3308343088 shutdown_connections 2023-10-18T12:20:33.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.729+0000 7f14e495f700 1 -- 172.21.15.114:0/3308343088 wait complete. 2023-10-18T12:20:33.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.733+0000 7f14e495f700 1 Processor -- start 2023-10-18T12:20:33.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.733+0000 7f14e495f700 1 -- start start 2023-10-18T12:20:33.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.733+0000 7f14e495f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14e00b5ae0 0x7f14e01f1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:33.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.733+0000 7f14e495f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14e00d2e00 0x7f14e0143cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:33.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.733+0000 7f14e495f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14e0160710 0x7f14e0144230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:33.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.733+0000 7f14e495f700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e0157e20 con 0x7f14e0160710 2023-10-18T12:20:33.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.733+0000 7f14e495f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e01571a0 con 0x7f14e00b5ae0 2023-10-18T12:20:33.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.733+0000 7f14e495f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e0157480 con 0x7f14e00d2e00 2023-10-18T12:20:33.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.733+0000 7f14dffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14e0160710 0x7f14e0144230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:33.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.733+0000 7f14dffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14e0160710 0x7f14e0144230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44180/0 (socket says 172.21.15.114:44180) 2023-10-18T12:20:33.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.733+0000 7f14dffff700 1 -- 172.21.15.114:0/2923748859 learned_addr learned my addr 172.21.15.114:0/2923748859 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:33.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.733+0000 7f14deffd700 1 --2- 172.21.15.114:0/2923748859 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14e00d2e00 0x7f14e0143cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:33.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.733+0000 7f14df7fe700 1 --2- 172.21.15.114:0/2923748859 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14e00b5ae0 0x7f14e01f1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:33.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.733+0000 7f14dffff700 1 -- 172.21.15.114:0/2923748859 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14e00d2e00 msgr2=0x7f14e0143cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:33.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.733+0000 7f14dffff700 1 --2- 172.21.15.114:0/2923748859 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14e00d2e00 0x7f14e0143cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:33.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.733+0000 7f14dffff700 1 -- 172.21.15.114:0/2923748859 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14e00b5ae0 msgr2=0x7f14e01f1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:33.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.733+0000 7f14dffff700 1 --2- 172.21.15.114:0/2923748859 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14e00b5ae0 0x7f14e01f1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:33.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.733+0000 7f14dffff700 1 -- 172.21.15.114:0/2923748859 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d00094b0 con 0x7f14e0160710 2023-10-18T12:20:33.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.733+0000 7f14df7fe700 1 --2- 172.21.15.114:0/2923748859 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14e00b5ae0 0x7f14e01f1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:33.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.737+0000 7f14dffff700 1 --2- 172.21.15.114:0/2923748859 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14e0160710 0x7f14e0144230 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f14d8007df0 tx=0x7f14d800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:33.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.737+0000 7f14c7fff700 1 -- 172.21.15.114:0/2923748859 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d800ddd0 con 0x7f14e0160710 2023-10-18T12:20:33.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.737+0000 7f14c7fff700 1 -- 172.21.15.114:0/2923748859 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d800f040 con 0x7f14e0160710 2023-10-18T12:20:33.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.737+0000 7f14e495f700 1 -- 172.21.15.114:0/2923748859 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14e0157760 con 0x7f14e0160710 2023-10-18T12:20:33.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.737+0000 7f14c7fff700 1 -- 172.21.15.114:0/2923748859 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d8003cd0 con 0x7f14e0160710 2023-10-18T12:20:33.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.737+0000 7f14e495f700 1 -- 172.21.15.114:0/2923748859 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14e01f2090 con 0x7f14e0160710 2023-10-18T12:20:33.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.737+0000 7f14e495f700 1 -- 172.21.15.114:0/2923748859 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14e004e910 con 0x7f14e0160710 2023-10-18T12:20:33.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.737+0000 7f14c7fff700 1 -- 172.21.15.114:0/2923748859 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f14d8004030 con 0x7f14e0160710 2023-10-18T12:20:33.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.741+0000 7f14c7fff700 1 --2- 172.21.15.114:0/2923748859 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f14cc0656f0 0x7f14cc067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:33.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.741+0000 7f14c7fff700 1 -- 172.21.15.114:0/2923748859 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f14d8006e40 con 0x7f14e0160710 2023-10-18T12:20:33.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.741+0000 7f14df7fe700 1 --2- 172.21.15.114:0/2923748859 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f14cc0656f0 0x7f14cc067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:33.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.741+0000 7f14df7fe700 1 --2- 172.21.15.114:0/2923748859 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f14cc0656f0 0x7f14cc067bb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f14d00090b0 tx=0x7f14d0008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:33.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.745+0000 7f14c7fff700 1 -- 172.21.15.114:0/2923748859 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f14d8050a00 con 0x7f14e0160710 2023-10-18T12:20:33.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.929+0000 7f14e495f700 1 -- 172.21.15.114:0/2923748859 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f14e0161450 con 0x7f14e0160710 2023-10-18T12:20:33.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.933+0000 7f14c7fff700 1 -- 172.21.15.114:0/2923748859 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f14d801a020 con 0x7f14e0160710 2023-10-18T12:20:33.937 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-10-18T12:20:33.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.933+0000 7f14e495f700 1 -- 172.21.15.114:0/2923748859 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f14cc0656f0 msgr2=0x7f14cc067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:33.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.933+0000 7f14e495f700 1 --2- 172.21.15.114:0/2923748859 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f14cc0656f0 0x7f14cc067bb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f14d00090b0 tx=0x7f14d0008030 comp rx=0 tx=0).stop 2023-10-18T12:20:33.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.933+0000 7f14e495f700 1 -- 172.21.15.114:0/2923748859 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14e0160710 msgr2=0x7f14e0144230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:33.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.933+0000 7f14e495f700 1 --2- 172.21.15.114:0/2923748859 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14e0160710 0x7f14e0144230 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f14d8007df0 tx=0x7f14d800d3b0 comp rx=0 tx=0).stop 2023-10-18T12:20:33.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.933+0000 7f14e495f700 1 -- 172.21.15.114:0/2923748859 shutdown_connections 2023-10-18T12:20:33.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.933+0000 7f14e495f700 1 --2- 172.21.15.114:0/2923748859 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f14cc0656f0 0x7f14cc067bb0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:33.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.933+0000 7f14e495f700 1 --2- 172.21.15.114:0/2923748859 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14e00d2e00 0x7f14e0143cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:33.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.933+0000 7f14e495f700 1 --2- 172.21.15.114:0/2923748859 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14e0160710 0x7f14e0144230 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:33.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.933+0000 7f14e495f700 1 --2- 172.21.15.114:0/2923748859 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14e00b5ae0 0x7f14e01f1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:33.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.933+0000 7f14e495f700 1 -- 172.21.15.114:0/2923748859 >> 172.21.15.114:0/2923748859 conn(0x7f14e0069f20 msgr2=0x7f14e00b6640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:33.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.937+0000 7f14e495f700 1 -- 172.21.15.114:0/2923748859 shutdown_connections 2023-10-18T12:20:33.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:33.937+0000 7f14e495f700 1 -- 172.21.15.114:0/2923748859 wait complete. 2023-10-18T12:20:33.967 INFO:tasks.cephfs_test_runner:Starting test: test_network_death (tasks.cephfs.test_client_recovery.TestClientNetworkRecovery) Simulate software freeze or temporary network failure. 2023-10-18T12:20:33.967 INFO:tasks.cephfs_test_runner:test_network_death (tasks.cephfs.test_client_recovery.TestClientNetworkRecovery) 2023-10-18T12:20:33.968 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_recovery.TestClientNetworkRecovery.test_network_death' 2023-10-18T12:20:34.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.133+0000 7fdc36fd2700 1 Processor -- start 2023-10-18T12:20:34.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.137+0000 7fdc36fd2700 1 -- start start 2023-10-18T12:20:34.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.137+0000 7fdc36fd2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdc3006ced0 0x7fdc300cda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:34.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.137+0000 7fdc36fd2700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdc3006d800 0x7fdc3006dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:34.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.137+0000 7fdc36fd2700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc300ccd30 con 0x7fdc300adc00 2023-10-18T12:20:34.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.137+0000 7fdc36fd2700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc3006e1b0 con 0x7fdc3006d800 2023-10-18T12:20:34.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.137+0000 7fdc36fd2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3006d520 con 0x7fdc3006ced0 2023-10-18T12:20:34.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.137+0000 7fdc34d6e700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fdc300adc00 0x7fdc3015aab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:43354/0 (socket says 172.21.15.114:43354) 2023-10-18T12:20:34.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.137+0000 7fdc34d6e700 1 -- 172.21.15.114:0/2870799063 learned_addr learned my addr 172.21.15.114:0/2870799063 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:34.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.137+0000 7fdc3556f700 1 --2- 172.21.15.114:0/2870799063 >> v2:172.21.15.114:3300/0 conn(0x7fdc3006d800 0x7fdc3006dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:34.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.137+0000 7fdc2ffff700 1 --2- 172.21.15.114:0/2870799063 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdc3006ced0 0x7fdc300cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:34.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.137+0000 7fdc2f7fe700 1 -- 172.21.15.114:0/2870799063 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2339374609 0 0) 0x7fdc300ccd30 con 0x7fdc300adc00 2023-10-18T12:20:34.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.141+0000 7fdc2f7fe700 1 -- 172.21.15.114:0/2870799063 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc200035d0 con 0x7fdc300adc00 2023-10-18T12:20:34.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.141+0000 7fdc3556f700 1 -- 172.21.15.114:0/2870799063 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdc3006ced0 msgr2=0x7fdc300cda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:34.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.141+0000 7fdc3556f700 1 --2- 172.21.15.114:0/2870799063 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdc3006ced0 0x7fdc300cda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:34.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.141+0000 7fdc3556f700 1 -- 172.21.15.114:0/2870799063 >> v1:172.21.15.114:6789/0 conn(0x7fdc300adc00 legacy=0x7fdc3015aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:34.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.141+0000 7fdc3556f700 1 -- 172.21.15.114:0/2870799063 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc300ccf80 con 0x7fdc3006d800 2023-10-18T12:20:34.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.141+0000 7fdc3556f700 1 --2- 172.21.15.114:0/2870799063 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc3006d800 0x7fdc3006dc70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fdc28009d90 tx=0x7fdc2800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3608e16ea9edb1d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:34.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.141+0000 7fdc2f7fe700 1 -- 172.21.15.114:0/2870799063 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2800e070 con 0x7fdc3006d800 2023-10-18T12:20:34.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.141+0000 7fdc2f7fe700 1 -- 172.21.15.114:0/2870799063 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc2800bb20 con 0x7fdc3006d800 2023-10-18T12:20:34.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.141+0000 7fdc2f7fe700 1 -- 172.21.15.114:0/2870799063 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2800be90 con 0x7fdc3006d800 2023-10-18T12:20:34.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.141+0000 7fdc36fd2700 1 -- 172.21.15.114:0/2870799063 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc3006d800 msgr2=0x7fdc3006dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:34.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.141+0000 7fdc36fd2700 1 --2- 172.21.15.114:0/2870799063 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc3006d800 0x7fdc3006dc70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fdc28009d90 tx=0x7fdc2800b330 comp rx=0 tx=0).stop 2023-10-18T12:20:34.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.141+0000 7fdc36fd2700 1 -- 172.21.15.114:0/2870799063 shutdown_connections 2023-10-18T12:20:34.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.141+0000 7fdc36fd2700 1 --2- 172.21.15.114:0/2870799063 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc3006d800 0x7fdc3006dc70 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:34.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.141+0000 7fdc36fd2700 1 --2- 172.21.15.114:0/2870799063 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdc3006ced0 0x7fdc300cda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:34.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.141+0000 7fdc36fd2700 1 -- 172.21.15.114:0/2870799063 >> 172.21.15.114:0/2870799063 conn(0x7fdc3006a340 msgr2=0x7fdc300b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:34.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.141+0000 7fdc36fd2700 1 -- 172.21.15.114:0/2870799063 shutdown_connections 2023-10-18T12:20:34.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.141+0000 7fdc36fd2700 1 -- 172.21.15.114:0/2870799063 wait complete. 2023-10-18T12:20:34.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.145+0000 7fdc36fd2700 1 Processor -- start 2023-10-18T12:20:34.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.145+0000 7fdc36fd2700 1 -- start start 2023-10-18T12:20:34.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.149+0000 7fdc36fd2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdc3006ced0 0x7fdc3013b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:34.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.149+0000 7fdc36fd2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc3006d800 0x7fdc3013a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:34.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.149+0000 7fdc36fd2700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc300adc00 0x7fdc300af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:34.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.149+0000 7fdc36fd2700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc301e8ba0 con 0x7fdc300adc00 2023-10-18T12:20:34.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.149+0000 7fdc36fd2700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc30156970 con 0x7fdc3006d800 2023-10-18T12:20:34.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.149+0000 7fdc36fd2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc300aed60 con 0x7fdc3006ced0 2023-10-18T12:20:34.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.149+0000 7fdc3556f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc300adc00 0x7fdc300af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:34.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.149+0000 7fdc3556f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc300adc00 0x7fdc300af1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44214/0 (socket says 172.21.15.114:44214) 2023-10-18T12:20:34.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.149+0000 7fdc3556f700 1 -- 172.21.15.114:0/3481574928 learned_addr learned my addr 172.21.15.114:0/3481574928 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:34.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.149+0000 7fdc34d6e700 1 --2- 172.21.15.114:0/3481574928 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdc3006ced0 0x7fdc3013b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:34.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.149+0000 7fdc2ffff700 1 --2- 172.21.15.114:0/3481574928 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc3006d800 0x7fdc3013a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:34.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.149+0000 7fdc3556f700 1 -- 172.21.15.114:0/3481574928 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdc3006ced0 msgr2=0x7fdc3013b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:34.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.149+0000 7fdc3556f700 1 --2- 172.21.15.114:0/3481574928 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdc3006ced0 0x7fdc3013b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:34.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.149+0000 7fdc3556f700 1 -- 172.21.15.114:0/3481574928 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc3006d800 msgr2=0x7fdc3013a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:34.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.149+0000 7fdc3556f700 1 --2- 172.21.15.114:0/3481574928 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc3006d800 0x7fdc3013a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:34.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.149+0000 7fdc3556f700 1 -- 172.21.15.114:0/3481574928 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc28009a70 con 0x7fdc300adc00 2023-10-18T12:20:34.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.149+0000 7fdc3556f700 1 --2- 172.21.15.114:0/3481574928 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc300adc00 0x7fdc300af1f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fdc300cc550 tx=0x7fdc28004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:34.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.149+0000 7fdc2d7fa700 1 -- 172.21.15.114:0/3481574928 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc28004960 con 0x7fdc300adc00 2023-10-18T12:20:34.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.149+0000 7fdc2d7fa700 1 -- 172.21.15.114:0/3481574928 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc28020070 con 0x7fdc300adc00 2023-10-18T12:20:34.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.149+0000 7fdc36fd2700 1 -- 172.21.15.114:0/3481574928 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc300ae430 con 0x7fdc300adc00 2023-10-18T12:20:34.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.149+0000 7fdc2d7fa700 1 -- 172.21.15.114:0/3481574928 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc280276c0 con 0x7fdc300adc00 2023-10-18T12:20:34.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.149+0000 7fdc36fd2700 1 -- 172.21.15.114:0/3481574928 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc300ae9f0 con 0x7fdc300adc00 2023-10-18T12:20:34.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.153+0000 7fdc36fd2700 1 -- 172.21.15.114:0/3481574928 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc300aeef0 con 0x7fdc300adc00 2023-10-18T12:20:34.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.153+0000 7fdc2d7fa700 1 -- 172.21.15.114:0/3481574928 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fdc28027820 con 0x7fdc300adc00 2023-10-18T12:20:34.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.153+0000 7fdc2d7fa700 1 --2- 172.21.15.114:0/3481574928 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdc140656f0 0x7fdc14067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:34.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.153+0000 7fdc2d7fa700 1 -- 172.21.15.114:0/3481574928 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdc28022070 con 0x7fdc300adc00 2023-10-18T12:20:34.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.153+0000 7fdc34d6e700 1 --2- 172.21.15.114:0/3481574928 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdc140656f0 0x7fdc14067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:34.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.157+0000 7fdc34d6e700 1 --2- 172.21.15.114:0/3481574928 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdc140656f0 0x7fdc14067bb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdc24005930 tx=0x7fdc24009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:34.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.161+0000 7fdc2d7fa700 1 -- 172.21.15.114:0/3481574928 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fdc280528c0 con 0x7fdc300adc00 2023-10-18T12:20:34.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.413+0000 7fdc36fd2700 1 -- 172.21.15.114:0/3481574928 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientNetworkRecovery.test_network_death"]} v 0) v1 -- 0x7fdc3013b730 con 0x7fdc300adc00 2023-10-18T12:20:34.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.725+0000 7fdc2d7fa700 1 -- 172.21.15.114:0/3481574928 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientNetworkRecovery.test_network_death"]}]=0 v77) v1 ==== 160+0+0 (secure 0 0 0) 0x7fdc28055ee0 con 0x7fdc300adc00 2023-10-18T12:20:34.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.729+0000 7fdc36fd2700 1 -- 172.21.15.114:0/3481574928 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdc140656f0 msgr2=0x7fdc14067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:34.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.729+0000 7fdc36fd2700 1 --2- 172.21.15.114:0/3481574928 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdc140656f0 0x7fdc14067bb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdc24005930 tx=0x7fdc24009040 comp rx=0 tx=0).stop 2023-10-18T12:20:34.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.729+0000 7fdc36fd2700 1 -- 172.21.15.114:0/3481574928 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc300adc00 msgr2=0x7fdc300af1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:34.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.729+0000 7fdc36fd2700 1 --2- 172.21.15.114:0/3481574928 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc300adc00 0x7fdc300af1f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fdc300cc550 tx=0x7fdc28004af0 comp rx=0 tx=0).stop 2023-10-18T12:20:34.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.729+0000 7fdc36fd2700 1 -- 172.21.15.114:0/3481574928 shutdown_connections 2023-10-18T12:20:34.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.729+0000 7fdc36fd2700 1 --2- 172.21.15.114:0/3481574928 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdc140656f0 0x7fdc14067bb0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:34.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.729+0000 7fdc36fd2700 1 --2- 172.21.15.114:0/3481574928 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc300adc00 0x7fdc300af1f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:34.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.729+0000 7fdc36fd2700 1 --2- 172.21.15.114:0/3481574928 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc3006d800 0x7fdc3013a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:34.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.729+0000 7fdc36fd2700 1 --2- 172.21.15.114:0/3481574928 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdc3006ced0 0x7fdc3013b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:34.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.729+0000 7fdc36fd2700 1 -- 172.21.15.114:0/3481574928 >> 172.21.15.114:0/3481574928 conn(0x7fdc3006a340 msgr2=0x7fdc3006f450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:34.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.729+0000 7fdc36fd2700 1 -- 172.21.15.114:0/3481574928 shutdown_connections 2023-10-18T12:20:34.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.729+0000 7fdc36fd2700 1 -- 172.21.15.114:0/3481574928 wait complete. 2023-10-18T12:20:34.759 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T12:20:34.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.933+0000 7f2a4b1e8700 1 Processor -- start 2023-10-18T12:20:34.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.933+0000 7f2a4b1e8700 1 -- start start 2023-10-18T12:20:34.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.937+0000 7f2a4b1e8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2a4415cd30 0x7f2a440cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:34.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.937+0000 7f2a4b1e8700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2a441614f0 0x7f2a440ca8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:34.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.937+0000 7f2a4b1e8700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a440cdd80 con 0x7f2a440cae00 2023-10-18T12:20:34.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.937+0000 7f2a4b1e8700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a440c9880 con 0x7f2a441614f0 2023-10-18T12:20:34.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.937+0000 7f2a4b1e8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4415d110 con 0x7f2a4415cd30 2023-10-18T12:20:34.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.937+0000 7f2a3bfff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2a441614f0 0x7f2a440ca8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:34.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.937+0000 7f2a3bfff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2a441614f0 0x7f2a440ca8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44222/0 (socket says 172.21.15.114:44222) 2023-10-18T12:20:34.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.937+0000 7f2a3bfff700 1 -- 172.21.15.114:0/3149636910 learned_addr learned my addr 172.21.15.114:0/3149636910 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:34.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.937+0000 7f2a48f84700 1 --2- 172.21.15.114:0/3149636910 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2a4415cd30 0x7f2a440cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:34.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.937+0000 7f2a3bfff700 1 -- 172.21.15.114:0/3149636910 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2a4415cd30 msgr2=0x7f2a440cd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:34.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.937+0000 7f2a3bfff700 1 --2- 172.21.15.114:0/3149636910 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2a4415cd30 0x7f2a440cd4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:34.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.937+0000 7f2a3bfff700 1 -- 172.21.15.114:0/3149636910 >> v1:172.21.15.172:6789/0 conn(0x7f2a440cae00 legacy=0x7f2a44069d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:34.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.937+0000 7f2a3bfff700 1 -- 172.21.15.114:0/3149636910 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a440c9b00 con 0x7f2a441614f0 2023-10-18T12:20:34.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.941+0000 7f2a3bfff700 1 --2- 172.21.15.114:0/3149636910 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a441614f0 0x7f2a440ca8c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2a34009910 tx=0x7f2a34009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a581a649af9464b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:34.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.941+0000 7f2a3b7fe700 1 -- 172.21.15.114:0/3149636910 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3400ba60 con 0x7f2a441614f0 2023-10-18T12:20:34.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.941+0000 7f2a3b7fe700 1 -- 172.21.15.114:0/3149636910 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a3400bbc0 con 0x7f2a441614f0 2023-10-18T12:20:34.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.941+0000 7f2a3b7fe700 1 -- 172.21.15.114:0/3149636910 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a34009e60 con 0x7f2a441614f0 2023-10-18T12:20:34.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.941+0000 7f2a4b1e8700 1 -- 172.21.15.114:0/3149636910 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a441614f0 msgr2=0x7f2a440ca8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:34.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.941+0000 7f2a4b1e8700 1 --2- 172.21.15.114:0/3149636910 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a441614f0 0x7f2a440ca8c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2a34009910 tx=0x7f2a34009c20 comp rx=0 tx=0).stop 2023-10-18T12:20:34.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.941+0000 7f2a4b1e8700 1 -- 172.21.15.114:0/3149636910 shutdown_connections 2023-10-18T12:20:34.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.941+0000 7f2a4b1e8700 1 --2- 172.21.15.114:0/3149636910 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a441614f0 0x7f2a440ca8c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:34.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.941+0000 7f2a4b1e8700 1 --2- 172.21.15.114:0/3149636910 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2a4415cd30 0x7f2a440cd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:34.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.941+0000 7f2a4b1e8700 1 -- 172.21.15.114:0/3149636910 >> 172.21.15.114:0/3149636910 conn(0x7f2a440b0b90 msgr2=0x7f2a440b0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:34.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.941+0000 7f2a4b1e8700 1 -- 172.21.15.114:0/3149636910 shutdown_connections 2023-10-18T12:20:34.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.941+0000 7f2a4b1e8700 1 -- 172.21.15.114:0/3149636910 wait complete. 2023-10-18T12:20:34.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.945+0000 7f2a4b1e8700 1 Processor -- start 2023-10-18T12:20:34.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.945+0000 7f2a4b1e8700 1 -- start start 2023-10-18T12:20:34.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.945+0000 7f2a4b1e8700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a4415cd30 0x7f2a440c7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:34.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.945+0000 7f2a4b1e8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a441614f0 0x7f2a440c7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:34.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.945+0000 7f2a4b1e8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2a441f2230 0x7f2a440c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:34.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.945+0000 7f2a4b1e8700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a440c2e60 con 0x7f2a4415cd30 2023-10-18T12:20:34.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.945+0000 7f2a4b1e8700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4415e540 con 0x7f2a441614f0 2023-10-18T12:20:34.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.945+0000 7f2a4b1e8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4415e820 con 0x7f2a441f2230 2023-10-18T12:20:34.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.945+0000 7f2a48f84700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a4415cd30 0x7f2a440c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:34.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.945+0000 7f2a48f84700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a4415cd30 0x7f2a440c7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44238/0 (socket says 172.21.15.114:44238) 2023-10-18T12:20:34.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.945+0000 7f2a48f84700 1 -- 172.21.15.114:0/3482929962 learned_addr learned my addr 172.21.15.114:0/3482929962 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:34.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.945+0000 7f2a3bfff700 1 --2- 172.21.15.114:0/3482929962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a441614f0 0x7f2a440c7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:34.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.945+0000 7f2a49785700 1 --2- 172.21.15.114:0/3482929962 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2a441f2230 0x7f2a440c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:34.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.945+0000 7f2a48f84700 1 -- 172.21.15.114:0/3482929962 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2a441f2230 msgr2=0x7f2a440c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:34.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.945+0000 7f2a48f84700 1 --2- 172.21.15.114:0/3482929962 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2a441f2230 0x7f2a440c7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:34.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.945+0000 7f2a48f84700 1 -- 172.21.15.114:0/3482929962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a441614f0 msgr2=0x7f2a440c7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:34.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.945+0000 7f2a48f84700 1 --2- 172.21.15.114:0/3482929962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a441614f0 0x7f2a440c7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:34.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.945+0000 7f2a48f84700 1 -- 172.21.15.114:0/3482929962 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a34009570 con 0x7f2a4415cd30 2023-10-18T12:20:34.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.945+0000 7f2a3bfff700 1 --2- 172.21.15.114:0/3482929962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a441614f0 0x7f2a440c7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:20:34.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.945+0000 7f2a49785700 1 --2- 172.21.15.114:0/3482929962 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2a441f2230 0x7f2a440c7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:20:34.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.945+0000 7f2a48f84700 1 --2- 172.21.15.114:0/3482929962 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a4415cd30 0x7f2a440c7200 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2a40007ec0 tx=0x7f2a4000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:34.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.945+0000 7f2a397fa700 1 -- 172.21.15.114:0/3482929962 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4000eea0 con 0x7f2a4415cd30 2023-10-18T12:20:34.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.945+0000 7f2a397fa700 1 -- 172.21.15.114:0/3482929962 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a40014420 con 0x7f2a4415cd30 2023-10-18T12:20:34.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.945+0000 7f2a397fa700 1 -- 172.21.15.114:0/3482929962 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a400147b0 con 0x7f2a4415cd30 2023-10-18T12:20:34.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.945+0000 7f2a4b1e8700 1 -- 172.21.15.114:0/3482929962 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a4415eb00 con 0x7f2a4415cd30 2023-10-18T12:20:34.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.945+0000 7f2a4b1e8700 1 -- 172.21.15.114:0/3482929962 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a4415f0c0 con 0x7f2a4415cd30 2023-10-18T12:20:34.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.949+0000 7f2a4b1e8700 1 -- 172.21.15.114:0/3482929962 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a44060fd0 con 0x7f2a4415cd30 2023-10-18T12:20:34.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.949+0000 7f2a397fa700 1 -- 172.21.15.114:0/3482929962 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f2a40014910 con 0x7f2a4415cd30 2023-10-18T12:20:34.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.949+0000 7f2a397fa700 1 --2- 172.21.15.114:0/3482929962 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2a300656f0 0x7f2a30067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:34.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.949+0000 7f2a397fa700 1 -- 172.21.15.114:0/3482929962 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2a40083a80 con 0x7f2a4415cd30 2023-10-18T12:20:34.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.949+0000 7f2a3bfff700 1 --2- 172.21.15.114:0/3482929962 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2a300656f0 0x7f2a30067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:34.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.953+0000 7f2a3bfff700 1 --2- 172.21.15.114:0/3482929962 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2a300656f0 0x7f2a30067bb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2a44161930 tx=0x7f2a34008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:34.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:34.957+0000 7f2a397fa700 1 -- 172.21.15.114:0/3482929962 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f2a40054c00 con 0x7f2a4415cd30 2023-10-18T12:20:35.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.133+0000 7f2a4b1e8700 1 -- 172.21.15.114:0/3482929962 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a4415f2b0 con 0x7f2a4415cd30 2023-10-18T12:20:35.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.137+0000 7f2a397fa700 1 -- 172.21.15.114:0/3482929962 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20240 (secure 0 0 0) 0x7f2a40054790 con 0x7f2a4415cd30 2023-10-18T12:20:35.143 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:20:35.143 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":30,"fsid":"240ea340-5d3d-4f52-a4bc-af075aca3deb","created":"2023-10-18T12:19:12.512994+0000","modified":"2023-10-18T12:20:20.604528+0000","last_up_change":"2023-10-18T12:19:25.286009+0000","last_in_change":"2023-10-18T12:19:15.850693+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T12:19:27.040638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-18T12:19:32.358094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-18T12:19:37.333855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-18T12:19:38.055385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-18T12:19:41.679218+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c3578978-1a03-4857-b9d2-34a5da3d7731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6817","nonce":1506287862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6820","nonce":1506287862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6830","nonce":1506287862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6825","nonce":1506287862}]},"public_addr":"172.21.15.114:6817/1506287862","cluster_addr":"172.21.15.114:6820/1506287862","heartbeat_back_addr":"172.21.15.114:6830/1506287862","heartbeat_front_addr":"172.21.15.114:6825/1506287862","state":["exists","up"]},{"osd":1,"uuid":"43eb26a6-e2b3-4670-9559-bd053b5140d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6801","nonce":3302727047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6803","nonce":3302727047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6807","nonce":3302727047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6805","nonce":3302727047}]},"public_addr":"172.21.15.114:6801/3302727047","cluster_addr":"172.21.15.114:6803/3302727047","heartbeat_back_addr":"172.21.15.114:6807/3302727047","heartbeat_front_addr":"172.21.15.114:6805/3302727047","state":["exists","up"]},{"osd":2,"uuid":"f3d4dbd5-521c-4dd2-b687-5768cc7d0938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6809","nonce":2699151351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6811","nonce":2699151351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6815","nonce":2699151351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6813","nonce":2699151351}]},"public_addr":"172.21.15.114:6809/2699151351","cluster_addr":"172.21.15.114:6811/2699151351","heartbeat_back_addr":"172.21.15.114:6815/2699151351","heartbeat_front_addr":"172.21.15.114:6813/2699151351","state":["exists","up"]},{"osd":3,"uuid":"823e5802-92b7-4f0d-b32d-a5748993f1b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6821","nonce":1361608073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6824","nonce":1361608073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6829","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6831","nonce":1361608073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6827","nonce":1361608073}]},"public_addr":"172.21.15.114:6821/1361608073","cluster_addr":"172.21.15.114:6824/1361608073","heartbeat_back_addr":"172.21.15.114:6831/1361608073","heartbeat_front_addr":"172.21.15.114:6827/1361608073","state":["exists","up"]},{"osd":4,"uuid":"e47fb93e-13b4-44a4-b084-8c4384ceb41e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6801","nonce":930839681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6803","nonce":930839681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6807","nonce":930839681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6805","nonce":930839681}]},"public_addr":"172.21.15.172:6801/930839681","cluster_addr":"172.21.15.172:6803/930839681","heartbeat_back_addr":"172.21.15.172:6807/930839681","heartbeat_front_addr":"172.21.15.172:6805/930839681","state":["exists","up"]},{"osd":5,"uuid":"7561a973-f479-45a0-af40-f324728d622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6814","nonce":571761850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6818","nonce":571761850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6824","nonce":571761850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6821","nonce":571761850}]},"public_addr":"172.21.15.172:6814/571761850","cluster_addr":"172.21.15.172:6818/571761850","heartbeat_back_addr":"172.21.15.172:6824/571761850","heartbeat_front_addr":"172.21.15.172:6821/571761850","state":["exists","up"]},{"osd":6,"uuid":"51753f4b-7f06-4f1c-9ec7-6e18a66eb980","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6825","nonce":1680398853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6827","nonce":1680398853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6831","nonce":1680398853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6829","nonce":1680398853}]},"public_addr":"172.21.15.172:6825/1680398853","cluster_addr":"172.21.15.172:6827/1680398853","heartbeat_back_addr":"172.21.15.172:6831/1680398853","heartbeat_front_addr":"172.21.15.172:6829/1680398853","state":["exists","up"]},{"osd":7,"uuid":"4d8b1e15-143d-4d17-9074-59d92f0f9af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6809","nonce":349710101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6811","nonce":349710101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6819","nonce":349710101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6815","nonce":349710101}]},"public_addr":"172.21.15.172:6809/349710101","cluster_addr":"172.21.15.172:6811/349710101","heartbeat_back_addr":"172.21.15.172:6819/349710101","heartbeat_front_addr":"172.21.15.172:6815/349710101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.889460+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.475494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.911473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.648596+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.609994+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.636248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.854589+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.885826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T12:20:35.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.141+0000 7f2a4b1e8700 1 -- 172.21.15.114:0/3482929962 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2a300656f0 msgr2=0x7f2a30067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:35.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.141+0000 7f2a4b1e8700 1 --2- 172.21.15.114:0/3482929962 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2a300656f0 0x7f2a30067bb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2a44161930 tx=0x7f2a34008030 comp rx=0 tx=0).stop 2023-10-18T12:20:35.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.141+0000 7f2a4b1e8700 1 -- 172.21.15.114:0/3482929962 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a4415cd30 msgr2=0x7f2a440c7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:35.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.141+0000 7f2a4b1e8700 1 --2- 172.21.15.114:0/3482929962 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a4415cd30 0x7f2a440c7200 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2a40007ec0 tx=0x7f2a4000e3c0 comp rx=0 tx=0).stop 2023-10-18T12:20:35.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.145+0000 7f2a4b1e8700 1 -- 172.21.15.114:0/3482929962 shutdown_connections 2023-10-18T12:20:35.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.145+0000 7f2a4b1e8700 1 --2- 172.21.15.114:0/3482929962 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2a300656f0 0x7f2a30067bb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:35.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.145+0000 7f2a4b1e8700 1 --2- 172.21.15.114:0/3482929962 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2a441f2230 0x7f2a440c7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:35.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.145+0000 7f2a4b1e8700 1 --2- 172.21.15.114:0/3482929962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2a441614f0 0x7f2a440c7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:35.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.145+0000 7f2a4b1e8700 1 --2- 172.21.15.114:0/3482929962 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a4415cd30 0x7f2a440c7200 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:35.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.145+0000 7f2a4b1e8700 1 -- 172.21.15.114:0/3482929962 >> 172.21.15.114:0/3482929962 conn(0x7f2a440b0b90 msgr2=0x7f2a440cc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:35.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.145+0000 7f2a4b1e8700 1 -- 172.21.15.114:0/3482929962 shutdown_connections 2023-10-18T12:20:35.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.145+0000 7f2a4b1e8700 1 -- 172.21.15.114:0/3482929962 wait complete. 2023-10-18T12:20:35.170 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-18T12:19:27.040638+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-18T12:19:32.358094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-18T12:19:37.333855+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-18T12:19:38.055385+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-18T12:19:41.679218+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-18T12:20:35.171 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-18T12:20:35.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.349+0000 7f442f097700 1 Processor -- start 2023-10-18T12:20:35.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.349+0000 7f442f097700 1 -- start start 2023-10-18T12:20:35.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.353+0000 7f442f097700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f442815ce30 0x7f4428160a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:35.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.353+0000 7f442f097700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f442806f450 0x7f4428160f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:35.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.353+0000 7f442f097700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44280ca840 con 0x7f44280caa10 2023-10-18T12:20:35.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.353+0000 7f442f097700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44280ca560 con 0x7f442815ce30 2023-10-18T12:20:35.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.353+0000 7f442f097700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44280ccf30 con 0x7f442806f450 2023-10-18T12:20:35.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.353+0000 7f442ce33700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f442815ce30 0x7f4428160a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:35.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.353+0000 7f4427fff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f442806f450 0x7f4428160f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:35.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.353+0000 7f4427fff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f442806f450 0x7f4428160f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.114:60490/0 (socket says 172.21.15.114:60490) 2023-10-18T12:20:35.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.353+0000 7f4427fff700 1 -- 172.21.15.114:0/3578786357 learned_addr learned my addr 172.21.15.114:0/3578786357 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:35.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.353+0000 7f4427fff700 1 -- 172.21.15.114:0/3578786357 >> v2:172.21.15.172:3300/0 conn(0x7f442815ce30 msgr2=0x7f4428160a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:35.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.353+0000 7f4427fff700 1 --2- 172.21.15.114:0/3578786357 >> v2:172.21.15.172:3300/0 conn(0x7f442815ce30 0x7f4428160a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:35.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.353+0000 7f4427fff700 1 -- 172.21.15.114:0/3578786357 >> v1:172.21.15.172:6789/0 conn(0x7f44280caa10 legacy=0x7f442806e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:35.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.353+0000 7f4427fff700 1 -- 172.21.15.114:0/3578786357 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44280cd210 con 0x7f442806f450 2023-10-18T12:20:35.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.353+0000 7f4427fff700 1 --2- 172.21.15.114:0/3578786357 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f442806f450 0x7f4428160f50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4414009910 tx=0x7f4414009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92da511baa9ee6a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:35.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.353+0000 7f44277fe700 1 -- 172.21.15.114:0/3578786357 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4414011830 con 0x7f442806f450 2023-10-18T12:20:35.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.353+0000 7f44277fe700 1 -- 172.21.15.114:0/3578786357 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4414011990 con 0x7f442806f450 2023-10-18T12:20:35.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.353+0000 7f44277fe700 1 -- 172.21.15.114:0/3578786357 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4414011d40 con 0x7f442806f450 2023-10-18T12:20:35.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.357+0000 7f442f097700 1 -- 172.21.15.114:0/3578786357 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f442806f450 msgr2=0x7f4428160f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:35.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.357+0000 7f442f097700 1 --2- 172.21.15.114:0/3578786357 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f442806f450 0x7f4428160f50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4414009910 tx=0x7f4414009c20 comp rx=0 tx=0).stop 2023-10-18T12:20:35.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.357+0000 7f442f097700 1 -- 172.21.15.114:0/3578786357 shutdown_connections 2023-10-18T12:20:35.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.357+0000 7f442f097700 1 --2- 172.21.15.114:0/3578786357 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f442806f450 0x7f4428160f50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:35.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.357+0000 7f442f097700 1 --2- 172.21.15.114:0/3578786357 >> v2:172.21.15.172:3300/0 conn(0x7f442815ce30 0x7f4428160a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:35.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.357+0000 7f442f097700 1 -- 172.21.15.114:0/3578786357 >> 172.21.15.114:0/3578786357 conn(0x7f44280ce820 msgr2=0x7f44280cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:35.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.357+0000 7f442f097700 1 -- 172.21.15.114:0/3578786357 shutdown_connections 2023-10-18T12:20:35.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.357+0000 7f442f097700 1 -- 172.21.15.114:0/3578786357 wait complete. 2023-10-18T12:20:35.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.361+0000 7f442f097700 1 Processor -- start 2023-10-18T12:20:35.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.361+0000 7f442f097700 1 -- start start 2023-10-18T12:20:35.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.361+0000 7f442f097700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f442806f450 0x7f44280c4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:35.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.361+0000 7f442f097700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44280caa10 0x7f442815fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:35.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.361+0000 7f442f097700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f442815ce30 0x7f44281492a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:35.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.361+0000 7f442f097700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44280c4ad0 con 0x7f442815ce30 2023-10-18T12:20:35.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.361+0000 7f442f097700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4428160430 con 0x7f44280caa10 2023-10-18T12:20:35.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.361+0000 7f442f097700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44281497e0 con 0x7f442806f450 2023-10-18T12:20:35.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.361+0000 7f442d634700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f442815ce30 0x7f44281492a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:35.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.361+0000 7f442ce33700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f442806f450 0x7f44280c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:35.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.361+0000 7f442ce33700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f442806f450 0x7f44280c4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.114:60492/0 (socket says 172.21.15.114:60492) 2023-10-18T12:20:35.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.361+0000 7f442ce33700 1 -- 172.21.15.114:0/603250363 learned_addr learned my addr 172.21.15.114:0/603250363 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:35.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.361+0000 7f4427fff700 1 --2- 172.21.15.114:0/603250363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44280caa10 0x7f442815fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:35.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.361+0000 7f442ce33700 1 -- 172.21.15.114:0/603250363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44280caa10 msgr2=0x7f442815fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:35.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.361+0000 7f442ce33700 1 --2- 172.21.15.114:0/603250363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44280caa10 0x7f442815fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:35.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.361+0000 7f442ce33700 1 -- 172.21.15.114:0/603250363 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f442815ce30 msgr2=0x7f44281492a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:35.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.361+0000 7f442ce33700 1 --2- 172.21.15.114:0/603250363 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f442815ce30 0x7f44281492a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:35.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.361+0000 7f442ce33700 1 -- 172.21.15.114:0/603250363 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4414009570 con 0x7f442806f450 2023-10-18T12:20:35.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.365+0000 7f442ce33700 1 --2- 172.21.15.114:0/603250363 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f442806f450 0x7f44280c4590 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f441c00e9d0 tx=0x7f441c00ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:35.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.365+0000 7f44257fa700 1 -- 172.21.15.114:0/603250363 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441c009720 con 0x7f442806f450 2023-10-18T12:20:35.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.365+0000 7f44257fa700 1 -- 172.21.15.114:0/603250363 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f441c00ee70 con 0x7f442806f450 2023-10-18T12:20:35.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.365+0000 7f442f097700 1 -- 172.21.15.114:0/603250363 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f442815ee50 con 0x7f442806f450 2023-10-18T12:20:35.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.365+0000 7f44257fa700 1 -- 172.21.15.114:0/603250363 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441c00ca50 con 0x7f442806f450 2023-10-18T12:20:35.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.365+0000 7f442f097700 1 -- 172.21.15.114:0/603250363 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f442815f410 con 0x7f442806f450 2023-10-18T12:20:35.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.365+0000 7f442f097700 1 -- 172.21.15.114:0/603250363 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44280ca180 con 0x7f442806f450 2023-10-18T12:20:35.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.369+0000 7f44257fa700 1 -- 172.21.15.114:0/603250363 <== mon.2 v2:172.21.15.172:3301/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f441c00cbb0 con 0x7f442806f450 2023-10-18T12:20:35.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.369+0000 7f44257fa700 1 --2- 172.21.15.114:0/603250363 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f440c065720 0x7f440c067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:35.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.369+0000 7f44257fa700 1 -- 172.21.15.114:0/603250363 <== mon.2 v2:172.21.15.172:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f441c083080 con 0x7f442806f450 2023-10-18T12:20:35.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.369+0000 7f4427fff700 1 --2- 172.21.15.114:0/603250363 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f440c065720 0x7f440c067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:35.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.373+0000 7f4427fff700 1 --2- 172.21.15.114:0/603250363 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f440c065720 0x7f440c067be0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f442806f870 tx=0x7f4414008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:35.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.377+0000 7f44257fa700 1 -- 172.21.15.114:0/603250363 <== mon.2 v2:172.21.15.172:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f441c0507f0 con 0x7f442806f450 2023-10-18T12:20:35.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.553+0000 7f442f097700 1 -- 172.21.15.114:0/603250363 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f44280ca180 con 0x7f442806f450 2023-10-18T12:20:35.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.553+0000 7f44257fa700 1 -- 172.21.15.114:0/603250363 <== mon.2 v2:172.21.15.172:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f44280ca180 con 0x7f442806f450 2023-10-18T12:20:35.560 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-10-18T12:20:35.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.557+0000 7f442f097700 1 -- 172.21.15.114:0/603250363 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f440c065720 msgr2=0x7f440c067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:35.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.557+0000 7f442f097700 1 --2- 172.21.15.114:0/603250363 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f440c065720 0x7f440c067be0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f442806f870 tx=0x7f4414008030 comp rx=0 tx=0).stop 2023-10-18T12:20:35.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.557+0000 7f442f097700 1 -- 172.21.15.114:0/603250363 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f442806f450 msgr2=0x7f44280c4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:35.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.557+0000 7f442f097700 1 --2- 172.21.15.114:0/603250363 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f442806f450 0x7f44280c4590 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f441c00e9d0 tx=0x7f441c00ece0 comp rx=0 tx=0).stop 2023-10-18T12:20:35.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.561+0000 7f442f097700 1 -- 172.21.15.114:0/603250363 shutdown_connections 2023-10-18T12:20:35.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.561+0000 7f442f097700 1 --2- 172.21.15.114:0/603250363 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f440c065720 0x7f440c067be0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:35.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.561+0000 7f442f097700 1 --2- 172.21.15.114:0/603250363 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f442815ce30 0x7f44281492a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:35.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.561+0000 7f442f097700 1 --2- 172.21.15.114:0/603250363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44280caa10 0x7f442815fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:35.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.561+0000 7f442f097700 1 --2- 172.21.15.114:0/603250363 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f442806f450 0x7f44280c4590 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:35.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.561+0000 7f442f097700 1 -- 172.21.15.114:0/603250363 >> 172.21.15.114:0/603250363 conn(0x7f44280ce820 msgr2=0x7f4428070040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:35.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.561+0000 7f442f097700 1 -- 172.21.15.114:0/603250363 shutdown_connections 2023-10-18T12:20:35.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.561+0000 7f442f097700 1 -- 172.21.15.114:0/603250363 wait complete. 2023-10-18T12:20:35.585 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-18T12:20:35.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.765+0000 7f0c4ef5f700 1 Processor -- start 2023-10-18T12:20:35.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.765+0000 7f0c4ef5f700 1 -- start start 2023-10-18T12:20:35.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.769+0000 7f0c4ef5f700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0c480d2e00 0x7f0c480b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:35.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.769+0000 7f0c4ef5f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0c48160710 0x7f0c480d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:35.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.769+0000 7f0c4ef5f700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c4815d0d0 con 0x7f0c480b5ae0 2023-10-18T12:20:35.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.769+0000 7f0c4ef5f700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c4815df90 con 0x7f0c480d2e00 2023-10-18T12:20:35.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.769+0000 7f0c4ef5f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4806f0f0 con 0x7f0c48160710 2023-10-18T12:20:35.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.769+0000 7f0c4df5d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0c480d2e00 0x7f0c480b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:35.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.769+0000 7f0c4df5d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0c480d2e00 0x7f0c480b6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39670/0 (socket says 172.21.15.114:39670) 2023-10-18T12:20:35.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.769+0000 7f0c4df5d700 1 -- 172.21.15.114:0/1507423128 learned_addr learned my addr 172.21.15.114:0/1507423128 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:35.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.769+0000 7f0c4e75e700 1 --1- 172.21.15.114:0/1507423128 >> v1:172.21.15.114:6789/0 conn(0x7f0c480b5ae0 0x7f0c4806db60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56010/0 (socket says 172.21.15.114:56010) 2023-10-18T12:20:35.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.769+0000 7f0c4d75c700 1 --2- 172.21.15.114:0/1507423128 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0c48160710 0x7f0c480d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:35.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.769+0000 7f0c4df5d700 1 -- 172.21.15.114:0/1507423128 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0c48160710 msgr2=0x7f0c480d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:35.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.769+0000 7f0c4df5d700 1 --2- 172.21.15.114:0/1507423128 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0c48160710 0x7f0c480d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:35.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.769+0000 7f0c4df5d700 1 -- 172.21.15.114:0/1507423128 >> v1:172.21.15.114:6789/0 conn(0x7f0c480b5ae0 legacy=0x7f0c4806db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:35.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.769+0000 7f0c4df5d700 1 -- 172.21.15.114:0/1507423128 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c480d3720 con 0x7f0c480d2e00 2023-10-18T12:20:35.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.769+0000 7f0c4df5d700 1 --2- 172.21.15.114:0/1507423128 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c480d2e00 0x7f0c480b6e00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0c44009940 tx=0x7f0c44009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acbfcf469685bc44 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:35.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.769+0000 7f0c4cf5b700 1 -- 172.21.15.114:0/1507423128 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4400ba20 con 0x7f0c480d2e00 2023-10-18T12:20:35.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.769+0000 7f0c4cf5b700 1 -- 172.21.15.114:0/1507423128 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c44009e90 con 0x7f0c480d2e00 2023-10-18T12:20:35.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.769+0000 7f0c4cf5b700 1 -- 172.21.15.114:0/1507423128 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4400bda0 con 0x7f0c480d2e00 2023-10-18T12:20:35.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.773+0000 7f0c4ef5f700 1 -- 172.21.15.114:0/1507423128 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c480d2e00 msgr2=0x7f0c480b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:35.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.773+0000 7f0c4ef5f700 1 --2- 172.21.15.114:0/1507423128 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c480d2e00 0x7f0c480b6e00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0c44009940 tx=0x7f0c44009c50 comp rx=0 tx=0).stop 2023-10-18T12:20:35.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.773+0000 7f0c4ef5f700 1 -- 172.21.15.114:0/1507423128 shutdown_connections 2023-10-18T12:20:35.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.773+0000 7f0c4ef5f700 1 --2- 172.21.15.114:0/1507423128 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0c48160710 0x7f0c480d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:35.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.773+0000 7f0c4ef5f700 1 --2- 172.21.15.114:0/1507423128 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c480d2e00 0x7f0c480b6e00 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:35.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.773+0000 7f0c4ef5f700 1 -- 172.21.15.114:0/1507423128 >> 172.21.15.114:0/1507423128 conn(0x7f0c48069f20 msgr2=0x7f0c4806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:35.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.773+0000 7f0c4ef5f700 1 -- 172.21.15.114:0/1507423128 shutdown_connections 2023-10-18T12:20:35.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.773+0000 7f0c4ef5f700 1 -- 172.21.15.114:0/1507423128 wait complete. 2023-10-18T12:20:35.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.773+0000 7f0c4ef5f700 1 Processor -- start 2023-10-18T12:20:35.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.773+0000 7f0c4ef5f700 1 -- start start 2023-10-18T12:20:35.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.777+0000 7f0c4ef5f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c480b5ae0 0x7f0c481f63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:35.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.777+0000 7f0c4ef5f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0c480d2e00 0x7f0c481f1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:35.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.777+0000 7f0c4ef5f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c48160710 0x7f0c480b3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:35.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.777+0000 7f0c4ef5f700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c480ae510 con 0x7f0c48160710 2023-10-18T12:20:35.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.777+0000 7f0c4ef5f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c481f68e0 con 0x7f0c480b5ae0 2023-10-18T12:20:35.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.777+0000 7f0c4ef5f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c480ad890 con 0x7f0c480d2e00 2023-10-18T12:20:35.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.777+0000 7f0c4e75e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c48160710 0x7f0c480b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:35.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.777+0000 7f0c4e75e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c48160710 0x7f0c480b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39682/0 (socket says 172.21.15.114:39682) 2023-10-18T12:20:35.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.777+0000 7f0c4e75e700 1 -- 172.21.15.114:0/3829076918 learned_addr learned my addr 172.21.15.114:0/3829076918 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:35.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.777+0000 7f0c4df5d700 1 --2- 172.21.15.114:0/3829076918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c480b5ae0 0x7f0c481f63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:35.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.777+0000 7f0c4d75c700 1 --2- 172.21.15.114:0/3829076918 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0c480d2e00 0x7f0c481f1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:35.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.777+0000 7f0c4e75e700 1 -- 172.21.15.114:0/3829076918 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0c480d2e00 msgr2=0x7f0c481f1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:35.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.777+0000 7f0c4e75e700 1 --2- 172.21.15.114:0/3829076918 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0c480d2e00 0x7f0c481f1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:35.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.777+0000 7f0c4e75e700 1 -- 172.21.15.114:0/3829076918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c480b5ae0 msgr2=0x7f0c481f63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:35.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.777+0000 7f0c4e75e700 1 --2- 172.21.15.114:0/3829076918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c480b5ae0 0x7f0c481f63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:35.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.777+0000 7f0c4e75e700 1 -- 172.21.15.114:0/3829076918 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c44009570 con 0x7f0c48160710 2023-10-18T12:20:35.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.777+0000 7f0c4d75c700 1 --2- 172.21.15.114:0/3829076918 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0c480d2e00 0x7f0c481f1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:35.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.777+0000 7f0c4df5d700 1 --2- 172.21.15.114:0/3829076918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c480b5ae0 0x7f0c481f63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:35.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.777+0000 7f0c4e75e700 1 --2- 172.21.15.114:0/3829076918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c48160710 0x7f0c480b3990 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0c4000cb10 tx=0x7f0c4000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:35.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.777+0000 7f0c3e7fc700 1 -- 172.21.15.114:0/3829076918 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4000aac0 con 0x7f0c48160710 2023-10-18T12:20:35.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.777+0000 7f0c3e7fc700 1 -- 172.21.15.114:0/3829076918 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4000ac20 con 0x7f0c48160710 2023-10-18T12:20:35.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.777+0000 7f0c3e7fc700 1 -- 172.21.15.114:0/3829076918 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c40012400 con 0x7f0c48160710 2023-10-18T12:20:35.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.777+0000 7f0c4ef5f700 1 -- 172.21.15.114:0/3829076918 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c480adb70 con 0x7f0c48160710 2023-10-18T12:20:35.787 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.777+0000 7f0c4ef5f700 1 -- 172.21.15.114:0/3829076918 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c480ae130 con 0x7f0c48160710 2023-10-18T12:20:35.787 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.781+0000 7f0c4ef5f700 1 -- 172.21.15.114:0/3829076918 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c480ae650 con 0x7f0c48160710 2023-10-18T12:20:35.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.781+0000 7f0c3e7fc700 1 -- 172.21.15.114:0/3829076918 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f0c40007070 con 0x7f0c48160710 2023-10-18T12:20:35.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.781+0000 7f0c3e7fc700 1 --2- 172.21.15.114:0/3829076918 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0c2c0656f0 0x7f0c2c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:35.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.781+0000 7f0c3e7fc700 1 -- 172.21.15.114:0/3829076918 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0c40082d40 con 0x7f0c48160710 2023-10-18T12:20:35.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.781+0000 7f0c4df5d700 1 --2- 172.21.15.114:0/3829076918 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0c2c0656f0 0x7f0c2c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:35.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.785+0000 7f0c4df5d700 1 --2- 172.21.15.114:0/3829076918 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0c2c0656f0 0x7f0c2c067bb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0c44000c00 tx=0x7f0c44008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:35.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.789+0000 7f0c3e7fc700 1 -- 172.21.15.114:0/3829076918 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f0c40050430 con 0x7f0c48160710 2023-10-18T12:20:35.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.965+0000 7f0c4ef5f700 1 -- 172.21.15.114:0/3829076918 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0c480ae2f0 con 0x7f0c48160710 2023-10-18T12:20:35.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.965+0000 7f0c3e7fc700 1 -- 172.21.15.114:0/3829076918 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0c40017070 con 0x7f0c48160710 2023-10-18T12:20:35.971 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 8 2023-10-18T12:20:35.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.969+0000 7f0c4ef5f700 1 -- 172.21.15.114:0/3829076918 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0c2c0656f0 msgr2=0x7f0c2c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:35.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.969+0000 7f0c4ef5f700 1 --2- 172.21.15.114:0/3829076918 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0c2c0656f0 0x7f0c2c067bb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0c44000c00 tx=0x7f0c44008030 comp rx=0 tx=0).stop 2023-10-18T12:20:35.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.969+0000 7f0c4ef5f700 1 -- 172.21.15.114:0/3829076918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c48160710 msgr2=0x7f0c480b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:35.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.969+0000 7f0c4ef5f700 1 --2- 172.21.15.114:0/3829076918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c48160710 0x7f0c480b3990 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0c4000cb10 tx=0x7f0c4000ced0 comp rx=0 tx=0).stop 2023-10-18T12:20:35.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.969+0000 7f0c4ef5f700 1 -- 172.21.15.114:0/3829076918 shutdown_connections 2023-10-18T12:20:35.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.969+0000 7f0c4ef5f700 1 --2- 172.21.15.114:0/3829076918 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0c2c0656f0 0x7f0c2c067bb0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:35.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.969+0000 7f0c4ef5f700 1 --2- 172.21.15.114:0/3829076918 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0c480d2e00 0x7f0c481f1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:35.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.969+0000 7f0c4ef5f700 1 --2- 172.21.15.114:0/3829076918 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0c48160710 0x7f0c480b3990 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:35.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.969+0000 7f0c4ef5f700 1 --2- 172.21.15.114:0/3829076918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0c480b5ae0 0x7f0c481f63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:35.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.969+0000 7f0c4ef5f700 1 -- 172.21.15.114:0/3829076918 >> 172.21.15.114:0/3829076918 conn(0x7f0c48069f20 msgr2=0x7f0c480b5ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:35.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.969+0000 7f0c4ef5f700 1 -- 172.21.15.114:0/3829076918 shutdown_connections 2023-10-18T12:20:35.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:35.969+0000 7f0c4ef5f700 1 -- 172.21.15.114:0/3829076918 wait complete. 2023-10-18T12:20:35.996 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-18T12:20:36.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.165+0000 7f6d1c887700 1 Processor -- start 2023-10-18T12:20:36.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.165+0000 7f6d1c887700 1 -- start start 2023-10-18T12:20:36.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.169+0000 7f6d1c887700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d180d36b0 0x7f6d1806e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:36.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.169+0000 7f6d1c887700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6d1815e7d0 0x7f6d1815d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:36.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.169+0000 7f6d1c887700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d180d29f0 con 0x7f6d180d2610 2023-10-18T12:20:36.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.169+0000 7f6d1c887700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d180b64b0 con 0x7f6d1815e7d0 2023-10-18T12:20:36.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.169+0000 7f6d1c887700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d180b6750 con 0x7f6d180d36b0 2023-10-18T12:20:36.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.169+0000 7f6d16d9d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6d1815e7d0 0x7f6d1815d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:36.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.169+0000 7f6d1659c700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f6d180d2610 0x7f6d180d2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56022/0 (socket says 172.21.15.114:56022) 2023-10-18T12:20:36.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.169+0000 7f6d1659c700 1 -- 172.21.15.114:0/1798312823 learned_addr learned my addr 172.21.15.114:0/1798312823 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:36.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.169+0000 7f6d15d9b700 1 --2- 172.21.15.114:0/1798312823 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d180d36b0 0x7f6d1806e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:36.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.173+0000 7f6d16d9d700 1 -- 172.21.15.114:0/1798312823 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d180d36b0 msgr2=0x7f6d1806e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:36.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.173+0000 7f6d16d9d700 1 --2- 172.21.15.114:0/1798312823 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d180d36b0 0x7f6d1806e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:36.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.173+0000 7f6d16d9d700 1 -- 172.21.15.114:0/1798312823 >> v1:172.21.15.114:6789/0 conn(0x7f6d180d2610 legacy=0x7f6d180d2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:36.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.173+0000 7f6d16d9d700 1 -- 172.21.15.114:0/1798312823 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d180b6a30 con 0x7f6d1815e7d0 2023-10-18T12:20:36.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.173+0000 7f6d1559a700 1 -- 172.21.15.114:0/1798312823 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3165327146 0 0) 0x7f6d180d29f0 con 0x7f6d180d2610 2023-10-18T12:20:36.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.173+0000 7f6d16d9d700 1 --2- 172.21.15.114:0/1798312823 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d1815e7d0 0x7f6d1815d5f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6d10009d90 tx=0x7f6d1000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f622f2a68849263d server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:36.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.173+0000 7f6d1559a700 1 -- 172.21.15.114:0/1798312823 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1000e070 con 0x7f6d1815e7d0 2023-10-18T12:20:36.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.173+0000 7f6d1559a700 1 -- 172.21.15.114:0/1798312823 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d1000bb20 con 0x7f6d1815e7d0 2023-10-18T12:20:36.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.173+0000 7f6d1559a700 1 -- 172.21.15.114:0/1798312823 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d10012430 con 0x7f6d1815e7d0 2023-10-18T12:20:36.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.173+0000 7f6d1c887700 1 -- 172.21.15.114:0/1798312823 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d1815e7d0 msgr2=0x7f6d1815d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:36.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.173+0000 7f6d1c887700 1 --2- 172.21.15.114:0/1798312823 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d1815e7d0 0x7f6d1815d5f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6d10009d90 tx=0x7f6d1000b330 comp rx=0 tx=0).stop 2023-10-18T12:20:36.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.173+0000 7f6d1c887700 1 -- 172.21.15.114:0/1798312823 shutdown_connections 2023-10-18T12:20:36.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.173+0000 7f6d1c887700 1 --2- 172.21.15.114:0/1798312823 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d1815e7d0 0x7f6d1815d5f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:36.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.173+0000 7f6d1c887700 1 --2- 172.21.15.114:0/1798312823 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d180d36b0 0x7f6d1806e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:36.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.173+0000 7f6d1c887700 1 -- 172.21.15.114:0/1798312823 >> 172.21.15.114:0/1798312823 conn(0x7f6d18069f20 msgr2=0x7f6d1806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:36.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.173+0000 7f6d1c887700 1 -- 172.21.15.114:0/1798312823 shutdown_connections 2023-10-18T12:20:36.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.173+0000 7f6d1c887700 1 -- 172.21.15.114:0/1798312823 wait complete. 2023-10-18T12:20:36.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.177+0000 7f6d1c887700 1 Processor -- start 2023-10-18T12:20:36.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.177+0000 7f6d1c887700 1 -- start start 2023-10-18T12:20:36.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.177+0000 7f6d1c887700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d180d2610 0x7f6d1814d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:36.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.177+0000 7f6d1c887700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d180d36b0 0x7f6d180b0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:36.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.177+0000 7f6d1c887700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d1815e7d0 0x7f6d180b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:36.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.177+0000 7f6d1c887700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d180aea10 con 0x7f6d180d36b0 2023-10-18T12:20:36.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.177+0000 7f6d1c887700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1814dec0 con 0x7f6d1815e7d0 2023-10-18T12:20:36.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.181+0000 7f6d1c887700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d180add90 con 0x7f6d180d2610 2023-10-18T12:20:36.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.181+0000 7f6d15d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d180d36b0 0x7f6d180b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:36.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.181+0000 7f6d15d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d180d36b0 0x7f6d180b0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39696/0 (socket says 172.21.15.114:39696) 2023-10-18T12:20:36.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.181+0000 7f6d15d9b700 1 -- 172.21.15.114:0/4252112354 learned_addr learned my addr 172.21.15.114:0/4252112354 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:36.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.181+0000 7f6d1659c700 1 --2- 172.21.15.114:0/4252112354 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d180d2610 0x7f6d1814d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:36.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.181+0000 7f6d16d9d700 1 --2- 172.21.15.114:0/4252112354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d1815e7d0 0x7f6d180b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:36.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.181+0000 7f6d15d9b700 1 -- 172.21.15.114:0/4252112354 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d180d2610 msgr2=0x7f6d1814d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:36.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.181+0000 7f6d15d9b700 1 --2- 172.21.15.114:0/4252112354 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d180d2610 0x7f6d1814d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:36.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.181+0000 7f6d15d9b700 1 -- 172.21.15.114:0/4252112354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d1815e7d0 msgr2=0x7f6d180b0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:36.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.181+0000 7f6d15d9b700 1 --2- 172.21.15.114:0/4252112354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d1815e7d0 0x7f6d180b0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:36.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.181+0000 7f6d15d9b700 1 -- 172.21.15.114:0/4252112354 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d10009a70 con 0x7f6d180d36b0 2023-10-18T12:20:36.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.181+0000 7f6d1659c700 1 --2- 172.21.15.114:0/4252112354 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d180d2610 0x7f6d1814d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:36.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.181+0000 7f6d15d9b700 1 --2- 172.21.15.114:0/4252112354 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d180d36b0 0x7f6d180b0670 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c00e9d0 tx=0x7f6d0c00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:36.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.181+0000 7f6d06ffd700 1 -- 172.21.15.114:0/4252112354 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c009720 con 0x7f6d180d36b0 2023-10-18T12:20:36.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.181+0000 7f6d06ffd700 1 -- 172.21.15.114:0/4252112354 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d0c00c850 con 0x7f6d180d36b0 2023-10-18T12:20:36.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.181+0000 7f6d1c887700 1 -- 172.21.15.114:0/4252112354 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d180ae070 con 0x7f6d180d36b0 2023-10-18T12:20:36.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.181+0000 7f6d06ffd700 1 -- 172.21.15.114:0/4252112354 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c00cbc0 con 0x7f6d180d36b0 2023-10-18T12:20:36.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.181+0000 7f6d1c887700 1 -- 172.21.15.114:0/4252112354 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d180ae630 con 0x7f6d180d36b0 2023-10-18T12:20:36.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.185+0000 7f6d1c887700 1 -- 172.21.15.114:0/4252112354 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d180aeb50 con 0x7f6d180d36b0 2023-10-18T12:20:36.190 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.185+0000 7f6d06ffd700 1 -- 172.21.15.114:0/4252112354 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f6d0c00cd20 con 0x7f6d180d36b0 2023-10-18T12:20:36.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.185+0000 7f6d06ffd700 1 --2- 172.21.15.114:0/4252112354 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6cf80656f0 0x7f6cf8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:36.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.185+0000 7f6d06ffd700 1 -- 172.21.15.114:0/4252112354 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6d0c083650 con 0x7f6d180d36b0 2023-10-18T12:20:36.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.185+0000 7f6d1659c700 1 --2- 172.21.15.114:0/4252112354 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6cf80656f0 0x7f6cf8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:36.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.189+0000 7f6d1659c700 1 --2- 172.21.15.114:0/4252112354 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6cf80656f0 0x7f6cf8067bb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6d08000f60 tx=0x7f6d08007cc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:36.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.193+0000 7f6d06ffd700 1 -- 172.21.15.114:0/4252112354 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f6d180aeb50 con 0x7f6d180d36b0 2023-10-18T12:20:36.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.369+0000 7f6d1c887700 1 -- 172.21.15.114:0/4252112354 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6d180aeb50 con 0x7f6d180d36b0 2023-10-18T12:20:36.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.373+0000 7f6d06ffd700 1 -- 172.21.15.114:0/4252112354 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6d180aeb50 con 0x7f6d180d36b0 2023-10-18T12:20:36.376 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-10-18T12:20:36.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.373+0000 7f6d1c887700 1 -- 172.21.15.114:0/4252112354 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6cf80656f0 msgr2=0x7f6cf8067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:36.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.373+0000 7f6d1c887700 1 --2- 172.21.15.114:0/4252112354 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6cf80656f0 0x7f6cf8067bb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6d08000f60 tx=0x7f6d08007cc0 comp rx=0 tx=0).stop 2023-10-18T12:20:36.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.373+0000 7f6d1c887700 1 -- 172.21.15.114:0/4252112354 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d180d36b0 msgr2=0x7f6d180b0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:36.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.373+0000 7f6d1c887700 1 --2- 172.21.15.114:0/4252112354 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d180d36b0 0x7f6d180b0670 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c00e9d0 tx=0x7f6d0c00ed90 comp rx=0 tx=0).stop 2023-10-18T12:20:36.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.373+0000 7f6d1c887700 1 -- 172.21.15.114:0/4252112354 shutdown_connections 2023-10-18T12:20:36.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.373+0000 7f6d1c887700 1 --2- 172.21.15.114:0/4252112354 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6cf80656f0 0x7f6cf8067bb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:36.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.373+0000 7f6d1c887700 1 --2- 172.21.15.114:0/4252112354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d1815e7d0 0x7f6d180b0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:36.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.373+0000 7f6d1c887700 1 --2- 172.21.15.114:0/4252112354 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d180d36b0 0x7f6d180b0670 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:36.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.373+0000 7f6d1c887700 1 --2- 172.21.15.114:0/4252112354 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d180d2610 0x7f6d1814d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:36.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.373+0000 7f6d1c887700 1 -- 172.21.15.114:0/4252112354 >> 172.21.15.114:0/4252112354 conn(0x7f6d18069f20 msgr2=0x7f6d180b3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:36.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.373+0000 7f6d1c887700 1 -- 172.21.15.114:0/4252112354 shutdown_connections 2023-10-18T12:20:36.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.373+0000 7f6d1c887700 1 -- 172.21.15.114:0/4252112354 wait complete. 2023-10-18T12:20:36.401 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-18T12:20:36.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.573+0000 7f6952e87700 1 Processor -- start 2023-10-18T12:20:36.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.573+0000 7f6952e87700 1 -- start start 2023-10-18T12:20:36.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.577+0000 7f6952e87700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f694c1467c0 0x7f694c0b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:36.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.577+0000 7f6952e87700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f694c06f9a0 0x7f694c06fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:36.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.577+0000 7f6952e87700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f694c146ba0 con 0x7f694c1612e0 2023-10-18T12:20:36.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.577+0000 7f6952e87700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f694c0d0920 con 0x7f694c1467c0 2023-10-18T12:20:36.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.577+0000 7f6952e87700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f694c070320 con 0x7f694c06f9a0 2023-10-18T12:20:36.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.577+0000 7f6950c23700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f694c1467c0 0x7f694c0b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:36.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.577+0000 7f6951424700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f694c06f9a0 0x7f694c06fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:36.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.577+0000 7f6950c23700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f694c1467c0 0x7f694c0b5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39708/0 (socket says 172.21.15.114:39708) 2023-10-18T12:20:36.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.577+0000 7f6950c23700 1 -- 172.21.15.114:0/2215805317 learned_addr learned my addr 172.21.15.114:0/2215805317 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:36.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.577+0000 7f694bfff700 1 --1- 172.21.15.114:0/2215805317 >> v1:172.21.15.172:6789/0 conn(0x7f694c1612e0 0x7f694c15d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.114:59300/0 (socket says 172.21.15.114:59300) 2023-10-18T12:20:36.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.577+0000 7f6950c23700 1 -- 172.21.15.114:0/2215805317 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f694c06f9a0 msgr2=0x7f694c06fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:36.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.577+0000 7f6950c23700 1 --2- 172.21.15.114:0/2215805317 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f694c06f9a0 0x7f694c06fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:36.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.577+0000 7f6950c23700 1 -- 172.21.15.114:0/2215805317 >> v1:172.21.15.172:6789/0 conn(0x7f694c1612e0 legacy=0x7f694c15d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:36.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.577+0000 7f6950c23700 1 -- 172.21.15.114:0/2215805317 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f694c0b6160 con 0x7f694c1467c0 2023-10-18T12:20:36.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.577+0000 7f6951424700 1 --2- 172.21.15.114:0/2215805317 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f694c06f9a0 0x7f694c06fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:20:36.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.577+0000 7f6950c23700 1 --2- 172.21.15.114:0/2215805317 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f694c1467c0 0x7f694c0b5b80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6940009910 tx=0x7f6940009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27f61be2fd69e4e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:36.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.581+0000 7f694b7fe700 1 -- 172.21.15.114:0/2215805317 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6940011830 con 0x7f694c1467c0 2023-10-18T12:20:36.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.581+0000 7f694b7fe700 1 -- 172.21.15.114:0/2215805317 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6940011990 con 0x7f694c1467c0 2023-10-18T12:20:36.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.581+0000 7f694b7fe700 1 -- 172.21.15.114:0/2215805317 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6940011d40 con 0x7f694c1467c0 2023-10-18T12:20:36.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.581+0000 7f6952e87700 1 -- 172.21.15.114:0/2215805317 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f694c1467c0 msgr2=0x7f694c0b5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:36.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.581+0000 7f6952e87700 1 --2- 172.21.15.114:0/2215805317 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f694c1467c0 0x7f694c0b5b80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6940009910 tx=0x7f6940009c20 comp rx=0 tx=0).stop 2023-10-18T12:20:36.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.581+0000 7f6952e87700 1 -- 172.21.15.114:0/2215805317 shutdown_connections 2023-10-18T12:20:36.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.581+0000 7f6952e87700 1 --2- 172.21.15.114:0/2215805317 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f694c06f9a0 0x7f694c06fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:36.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.581+0000 7f6952e87700 1 --2- 172.21.15.114:0/2215805317 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f694c1467c0 0x7f694c0b5b80 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:36.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.581+0000 7f6952e87700 1 -- 172.21.15.114:0/2215805317 >> 172.21.15.114:0/2215805317 conn(0x7f694c06a130 msgr2=0x7f694c06a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:36.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.581+0000 7f6952e87700 1 -- 172.21.15.114:0/2215805317 shutdown_connections 2023-10-18T12:20:36.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.581+0000 7f6952e87700 1 -- 172.21.15.114:0/2215805317 wait complete. 2023-10-18T12:20:36.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.581+0000 7f6952e87700 1 Processor -- start 2023-10-18T12:20:36.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.581+0000 7f6952e87700 1 -- start start 2023-10-18T12:20:36.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.585+0000 7f6952e87700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f694c06f9a0 0x7f694c15c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:36.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.585+0000 7f6952e87700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f694c1467c0 0x7f694c0cd760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:36.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.585+0000 7f6952e87700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f694c1612e0 0x7f694c15e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:36.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.585+0000 7f6952e87700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694c15c880 con 0x7f694c06f9a0 2023-10-18T12:20:36.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.585+0000 7f6952e87700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694c1f2390 con 0x7f694c1467c0 2023-10-18T12:20:36.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.585+0000 7f6952e87700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f694c0ce090 con 0x7f694c1612e0 2023-10-18T12:20:36.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.585+0000 7f6950c23700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f694c06f9a0 0x7f694c15c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:36.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.585+0000 7f6950c23700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f694c06f9a0 0x7f694c15c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39718/0 (socket says 172.21.15.114:39718) 2023-10-18T12:20:36.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.585+0000 7f6950c23700 1 -- 172.21.15.114:0/3828929358 learned_addr learned my addr 172.21.15.114:0/3828929358 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:36.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.585+0000 7f694bfff700 1 --2- 172.21.15.114:0/3828929358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f694c1467c0 0x7f694c0cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:36.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.585+0000 7f6951424700 1 --2- 172.21.15.114:0/3828929358 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f694c1612e0 0x7f694c15e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:36.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.585+0000 7f6950c23700 1 -- 172.21.15.114:0/3828929358 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f694c1612e0 msgr2=0x7f694c15e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:36.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.585+0000 7f6950c23700 1 --2- 172.21.15.114:0/3828929358 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f694c1612e0 0x7f694c15e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:36.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.585+0000 7f6950c23700 1 -- 172.21.15.114:0/3828929358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f694c1467c0 msgr2=0x7f694c0cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:36.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.585+0000 7f6950c23700 1 --2- 172.21.15.114:0/3828929358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f694c1467c0 0x7f694c0cd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:36.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.585+0000 7f6950c23700 1 -- 172.21.15.114:0/3828929358 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6944009a70 con 0x7f694c06f9a0 2023-10-18T12:20:36.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.585+0000 7f6950c23700 1 --2- 172.21.15.114:0/3828929358 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f694c06f9a0 0x7f694c15c340 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6940000c00 tx=0x7f6940004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:36.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.585+0000 7f69497fa700 1 -- 172.21.15.114:0/3828929358 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69400044d0 con 0x7f694c06f9a0 2023-10-18T12:20:36.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.585+0000 7f69497fa700 1 -- 172.21.15.114:0/3828929358 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69400036c0 con 0x7f694c06f9a0 2023-10-18T12:20:36.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.585+0000 7f6952e87700 1 -- 172.21.15.114:0/3828929358 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6940009570 con 0x7f694c06f9a0 2023-10-18T12:20:36.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.585+0000 7f69497fa700 1 -- 172.21.15.114:0/3828929358 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6940003a70 con 0x7f694c06f9a0 2023-10-18T12:20:36.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.585+0000 7f6952e87700 1 -- 172.21.15.114:0/3828929358 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f694c0ce650 con 0x7f694c06f9a0 2023-10-18T12:20:36.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.589+0000 7f6952e87700 1 -- 172.21.15.114:0/3828929358 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f694c072e60 con 0x7f694c06f9a0 2023-10-18T12:20:36.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.589+0000 7f69497fa700 1 -- 172.21.15.114:0/3828929358 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f6940003bd0 con 0x7f694c06f9a0 2023-10-18T12:20:36.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.593+0000 7f69497fa700 1 --2- 172.21.15.114:0/3828929358 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f69300656f0 0x7f6930067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:36.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.593+0000 7f69497fa700 1 -- 172.21.15.114:0/3828929358 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6940021030 con 0x7f694c06f9a0 2023-10-18T12:20:36.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.593+0000 7f694bfff700 1 --2- 172.21.15.114:0/3828929358 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f69300656f0 0x7f6930067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:36.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.593+0000 7f694bfff700 1 --2- 172.21.15.114:0/3828929358 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f69300656f0 0x7f6930067bb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f694c070110 tx=0x7f6938007ef0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:36.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.597+0000 7f69497fa700 1 -- 172.21.15.114:0/3828929358 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f6940051e50 con 0x7f694c06f9a0 2023-10-18T12:20:36.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.773+0000 7f6952e87700 1 -- 172.21.15.114:0/3828929358 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f694c0b7200 con 0x7f694c06f9a0 2023-10-18T12:20:36.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.777+0000 7f69497fa700 1 -- 172.21.15.114:0/3828929358 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6940055470 con 0x7f694c06f9a0 2023-10-18T12:20:36.781 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-10-18T12:20:36.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.777+0000 7f6952e87700 1 -- 172.21.15.114:0/3828929358 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f69300656f0 msgr2=0x7f6930067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:36.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.777+0000 7f6952e87700 1 --2- 172.21.15.114:0/3828929358 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f69300656f0 0x7f6930067bb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f694c070110 tx=0x7f6938007ef0 comp rx=0 tx=0).stop 2023-10-18T12:20:36.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.777+0000 7f6952e87700 1 -- 172.21.15.114:0/3828929358 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f694c06f9a0 msgr2=0x7f694c15c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:36.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.777+0000 7f6952e87700 1 --2- 172.21.15.114:0/3828929358 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f694c06f9a0 0x7f694c15c340 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6940000c00 tx=0x7f6940004770 comp rx=0 tx=0).stop 2023-10-18T12:20:36.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.781+0000 7f6952e87700 1 -- 172.21.15.114:0/3828929358 shutdown_connections 2023-10-18T12:20:36.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.781+0000 7f6952e87700 1 --2- 172.21.15.114:0/3828929358 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f69300656f0 0x7f6930067bb0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:36.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.781+0000 7f6952e87700 1 --2- 172.21.15.114:0/3828929358 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f694c1612e0 0x7f694c15e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:36.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.781+0000 7f6952e87700 1 --2- 172.21.15.114:0/3828929358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f694c1467c0 0x7f694c0cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:36.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.781+0000 7f6952e87700 1 --2- 172.21.15.114:0/3828929358 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f694c06f9a0 0x7f694c15c340 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:36.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.781+0000 7f6952e87700 1 -- 172.21.15.114:0/3828929358 >> 172.21.15.114:0/3828929358 conn(0x7f694c06a130 msgr2=0x7f694c0d2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:36.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.781+0000 7f6952e87700 1 -- 172.21.15.114:0/3828929358 shutdown_connections 2023-10-18T12:20:36.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.781+0000 7f6952e87700 1 -- 172.21.15.114:0/3828929358 wait complete. 2023-10-18T12:20:36.804 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-18T12:20:36.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.981+0000 7fdcf72f4700 1 Processor -- start 2023-10-18T12:20:36.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.981+0000 7fdcf72f4700 1 -- start start 2023-10-18T12:20:36.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.981+0000 7fdcf72f4700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdcf006d090 0x7fdcf00b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:36.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.981+0000 7fdcf72f4700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcf0071120 con 0x7fdcf015a410 2023-10-18T12:20:36.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.981+0000 7fdcf72f4700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcf015e990 con 0x7fdcf006d470 2023-10-18T12:20:36.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.981+0000 7fdcf72f4700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf015f4f0 con 0x7fdcf006d090 2023-10-18T12:20:36.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.981+0000 7fdcf6af3700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fdcf015a410 0x7fdcf015a8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56030/0 (socket says 172.21.15.114:56030) 2023-10-18T12:20:36.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.981+0000 7fdcf6af3700 1 -- 172.21.15.114:0/512374361 learned_addr learned my addr 172.21.15.114:0/512374361 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:36.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.981+0000 7fdcf62f2700 1 --2- 172.21.15.114:0/512374361 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdcf006d090 0x7fdcf00b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:36.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.981+0000 7fdcf52f0700 1 -- 172.21.15.114:0/512374361 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2591968520 0 0) 0x7fdcf0071120 con 0x7fdcf015a410 2023-10-18T12:20:36.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.981+0000 7fdcf52f0700 1 -- 172.21.15.114:0/512374361 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcdc0035d0 con 0x7fdcf015a410 2023-10-18T12:20:36.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.981+0000 7fdcf52f0700 1 -- 172.21.15.114:0/512374361 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2319150268 0 0) 0x7fdcf015e990 con 0x7fdcf006d470 2023-10-18T12:20:36.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.981+0000 7fdcf62f2700 1 -- 172.21.15.114:0/512374361 >> v1:172.21.15.172:6789/0 conn(0x7fdcf006d470 legacy=0x7fdcf0070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:36.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.981+0000 7fdcf62f2700 1 -- 172.21.15.114:0/512374361 >> v1:172.21.15.114:6789/0 conn(0x7fdcf015a410 legacy=0x7fdcf015a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:36.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.981+0000 7fdcf62f2700 1 -- 172.21.15.114:0/512374361 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf015ec50 con 0x7fdcf006d090 2023-10-18T12:20:36.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.985+0000 7fdcf62f2700 1 --2- 172.21.15.114:0/512374361 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdcf006d090 0x7fdcf00b2590 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdcec009880 tx=0x7fdcec009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92409dc9576e1a4f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:36.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.985+0000 7fdcf52f0700 1 -- 172.21.15.114:0/512374361 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcec011830 con 0x7fdcf006d090 2023-10-18T12:20:36.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.985+0000 7fdcf52f0700 1 -- 172.21.15.114:0/512374361 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcec011990 con 0x7fdcf006d090 2023-10-18T12:20:36.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.985+0000 7fdcf52f0700 1 -- 172.21.15.114:0/512374361 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcec011d20 con 0x7fdcf006d090 2023-10-18T12:20:36.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.985+0000 7fdcf72f4700 1 -- 172.21.15.114:0/512374361 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdcf006d090 msgr2=0x7fdcf00b2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:36.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.985+0000 7fdcf72f4700 1 --2- 172.21.15.114:0/512374361 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdcf006d090 0x7fdcf00b2590 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdcec009880 tx=0x7fdcec009b90 comp rx=0 tx=0).stop 2023-10-18T12:20:36.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.985+0000 7fdcf72f4700 1 -- 172.21.15.114:0/512374361 shutdown_connections 2023-10-18T12:20:36.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.985+0000 7fdcf72f4700 1 --2- 172.21.15.114:0/512374361 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdcf006d090 0x7fdcf00b2590 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:36.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.985+0000 7fdcf72f4700 1 -- 172.21.15.114:0/512374361 >> 172.21.15.114:0/512374361 conn(0x7fdcf00ce5c0 msgr2=0x7fdcf00ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:36.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.985+0000 7fdcf72f4700 1 -- 172.21.15.114:0/512374361 shutdown_connections 2023-10-18T12:20:36.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.985+0000 7fdcf72f4700 1 -- 172.21.15.114:0/512374361 wait complete. 2023-10-18T12:20:36.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.989+0000 7fdcf72f4700 1 Processor -- start 2023-10-18T12:20:36.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.989+0000 7fdcf72f4700 1 -- start start 2023-10-18T12:20:36.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.989+0000 7fdcf72f4700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcf006d090 0x7fdcf00afdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:36.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.989+0000 7fdcf72f4700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdcf006d470 0x7fdcf0158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:36.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.989+0000 7fdcf72f4700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcf015a410 0x7fdcf0159530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:36.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.989+0000 7fdcf72f4700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf01475f0 con 0x7fdcf006d090 2023-10-18T12:20:36.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.989+0000 7fdcf72f4700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf0146e40 con 0x7fdcf015a410 2023-10-18T12:20:36.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.989+0000 7fdcf72f4700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf00a8c10 con 0x7fdcf006d470 2023-10-18T12:20:36.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.993+0000 7fdcf62f2700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcf006d090 0x7fdcf00afdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:36.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.993+0000 7fdcf62f2700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcf006d090 0x7fdcf00afdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39724/0 (socket says 172.21.15.114:39724) 2023-10-18T12:20:36.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.993+0000 7fdcf62f2700 1 -- 172.21.15.114:0/2946463914 learned_addr learned my addr 172.21.15.114:0/2946463914 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:36.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.993+0000 7fdcf5af1700 1 --2- 172.21.15.114:0/2946463914 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdcf006d470 0x7fdcf0158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:36.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.993+0000 7fdcf6af3700 1 --2- 172.21.15.114:0/2946463914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcf015a410 0x7fdcf0159530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:36.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.993+0000 7fdcf62f2700 1 -- 172.21.15.114:0/2946463914 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdcf006d470 msgr2=0x7fdcf0158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:36.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.993+0000 7fdcf62f2700 1 --2- 172.21.15.114:0/2946463914 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdcf006d470 0x7fdcf0158ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:37.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.993+0000 7fdcf62f2700 1 -- 172.21.15.114:0/2946463914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcf015a410 msgr2=0x7fdcf0159530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:37.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.993+0000 7fdcf62f2700 1 --2- 172.21.15.114:0/2946463914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcf015a410 0x7fdcf0159530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:37.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.993+0000 7fdcf62f2700 1 -- 172.21.15.114:0/2946463914 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcec0094b0 con 0x7fdcf006d090 2023-10-18T12:20:37.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.993+0000 7fdcf6af3700 1 --2- 172.21.15.114:0/2946463914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcf015a410 0x7fdcf0159530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:20:37.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.993+0000 7fdcf62f2700 1 --2- 172.21.15.114:0/2946463914 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcf006d090 0x7fdcf00afdc0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fdcec013040 tx=0x7fdcec004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:37.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.993+0000 7fdce6ffd700 1 -- 172.21.15.114:0/2946463914 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcec019a80 con 0x7fdcf006d090 2023-10-18T12:20:37.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.993+0000 7fdce6ffd700 1 -- 172.21.15.114:0/2946463914 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcec01e070 con 0x7fdcf006d090 2023-10-18T12:20:37.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.993+0000 7fdce6ffd700 1 -- 172.21.15.114:0/2946463914 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcec019e00 con 0x7fdcf006d090 2023-10-18T12:20:37.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.993+0000 7fdcf72f4700 1 -- 172.21.15.114:0/2946463914 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcf00a8ef0 con 0x7fdcf006d090 2023-10-18T12:20:37.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.993+0000 7fdcf72f4700 1 -- 172.21.15.114:0/2946463914 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcf00b0300 con 0x7fdcf006d090 2023-10-18T12:20:37.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.997+0000 7fdcf72f4700 1 -- 172.21.15.114:0/2946463914 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcf00c9f90 con 0x7fdcf006d090 2023-10-18T12:20:37.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.997+0000 7fdce6ffd700 1 -- 172.21.15.114:0/2946463914 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fdcec02d450 con 0x7fdcf006d090 2023-10-18T12:20:37.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.997+0000 7fdce6ffd700 1 --2- 172.21.15.114:0/2946463914 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdcd40656f0 0x7fdcd4067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:37.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.997+0000 7fdce6ffd700 1 -- 172.21.15.114:0/2946463914 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdcec0840c0 con 0x7fdcf006d090 2023-10-18T12:20:37.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.997+0000 7fdcf5af1700 1 --2- 172.21.15.114:0/2946463914 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdcd40656f0 0x7fdcd4067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:37.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:36.997+0000 7fdcf5af1700 1 --2- 172.21.15.114:0/2946463914 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdcd40656f0 0x7fdcd4067bb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdcf0159bb0 tx=0x7fdce0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:37.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.005+0000 7fdce6ffd700 1 -- 172.21.15.114:0/2946463914 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fdcec051990 con 0x7fdcf006d090 2023-10-18T12:20:37.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.189+0000 7fdcf72f4700 1 -- 172.21.15.114:0/2946463914 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fdcf015f1e0 con 0x7fdcf006d090 2023-10-18T12:20:37.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.193+0000 7fdce6ffd700 1 -- 172.21.15.114:0/2946463914 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7fdcec054fb0 con 0x7fdcf006d090 2023-10-18T12:20:37.197 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-10-18T12:20:37.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.193+0000 7fdcf72f4700 1 -- 172.21.15.114:0/2946463914 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdcd40656f0 msgr2=0x7fdcd4067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:37.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.193+0000 7fdcf72f4700 1 --2- 172.21.15.114:0/2946463914 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdcd40656f0 0x7fdcd4067bb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdcf0159bb0 tx=0x7fdce0009040 comp rx=0 tx=0).stop 2023-10-18T12:20:37.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.193+0000 7fdcf72f4700 1 -- 172.21.15.114:0/2946463914 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcf006d090 msgr2=0x7fdcf00afdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:37.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.193+0000 7fdcf72f4700 1 --2- 172.21.15.114:0/2946463914 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcf006d090 0x7fdcf00afdc0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fdcec013040 tx=0x7fdcec004770 comp rx=0 tx=0).stop 2023-10-18T12:20:37.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.197+0000 7fdcf72f4700 1 -- 172.21.15.114:0/2946463914 shutdown_connections 2023-10-18T12:20:37.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.197+0000 7fdcf72f4700 1 --2- 172.21.15.114:0/2946463914 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdcd40656f0 0x7fdcd4067bb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:37.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.197+0000 7fdcf72f4700 1 --2- 172.21.15.114:0/2946463914 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdcf006d470 0x7fdcf0158ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:37.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.197+0000 7fdcf72f4700 1 --2- 172.21.15.114:0/2946463914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcf015a410 0x7fdcf0159530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:37.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.197+0000 7fdcf72f4700 1 --2- 172.21.15.114:0/2946463914 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdcf006d090 0x7fdcf00afdc0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:37.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.197+0000 7fdcf72f4700 1 -- 172.21.15.114:0/2946463914 >> 172.21.15.114:0/2946463914 conn(0x7fdcf00ce5c0 msgr2=0x7fdcf0156a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:37.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.197+0000 7fdcf72f4700 1 -- 172.21.15.114:0/2946463914 shutdown_connections 2023-10-18T12:20:37.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.197+0000 7fdcf72f4700 1 -- 172.21.15.114:0/2946463914 wait complete. 2023-10-18T12:20:37.220 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-18T12:20:37.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.397+0000 7f9189dae700 1 Processor -- start 2023-10-18T12:20:37.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.397+0000 7f9189dae700 1 -- start start 2023-10-18T12:20:37.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.401+0000 7f9189dae700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f91840d2610 0x7f918406e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:37.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.401+0000 7f9189dae700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91840d36b0 0x7f918415d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:37.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.401+0000 7f9189dae700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91840d29f0 con 0x7f918415e7d0 2023-10-18T12:20:37.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.401+0000 7f9189dae700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91840b64b0 con 0x7f91840d2610 2023-10-18T12:20:37.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.401+0000 7f9189dae700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91840b6750 con 0x7f91840d36b0 2023-10-18T12:20:37.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.401+0000 7f9182ffd700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f918415e7d0 0x7f91840d2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56036/0 (socket says 172.21.15.114:56036) 2023-10-18T12:20:37.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.401+0000 7f9182ffd700 1 -- 172.21.15.114:0/3244964627 learned_addr learned my addr 172.21.15.114:0/3244964627 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:37.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.401+0000 7f91837fe700 1 --2- 172.21.15.114:0/3244964627 >> v2:172.21.15.172:3300/0 conn(0x7f91840d2610 0x7f918406e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:37.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.401+0000 7f9183fff700 1 --2- 172.21.15.114:0/3244964627 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91840d36b0 0x7f918415d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:37.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.401+0000 7f91827fc700 1 -- 172.21.15.114:0/3244964627 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3839907413 0 0) 0x7f91840d29f0 con 0x7f918415e7d0 2023-10-18T12:20:37.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.401+0000 7f91827fc700 1 -- 172.21.15.114:0/3244964627 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f916c0035d0 con 0x7f918415e7d0 2023-10-18T12:20:37.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.401+0000 7f91837fe700 1 -- 172.21.15.114:0/3244964627 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91840d36b0 msgr2=0x7f918415d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:37.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.401+0000 7f91837fe700 1 --2- 172.21.15.114:0/3244964627 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91840d36b0 0x7f918415d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:37.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.401+0000 7f91837fe700 1 -- 172.21.15.114:0/3244964627 >> v1:172.21.15.114:6789/0 conn(0x7f918415e7d0 legacy=0x7f91840d2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:37.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.401+0000 7f91837fe700 1 -- 172.21.15.114:0/3244964627 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91840b6a30 con 0x7f91840d2610 2023-10-18T12:20:37.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.401+0000 7f91837fe700 1 --2- 172.21.15.114:0/3244964627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91840d2610 0x7f918406e6f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9174009850 tx=0x7f9174009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=241bb9dd20207938 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:37.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.401+0000 7f91827fc700 1 -- 172.21.15.114:0/3244964627 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9174011830 con 0x7f91840d2610 2023-10-18T12:20:37.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.401+0000 7f91827fc700 1 -- 172.21.15.114:0/3244964627 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9174011990 con 0x7f91840d2610 2023-10-18T12:20:37.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.401+0000 7f91827fc700 1 -- 172.21.15.114:0/3244964627 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9174011d40 con 0x7f91840d2610 2023-10-18T12:20:37.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.405+0000 7f9189dae700 1 -- 172.21.15.114:0/3244964627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91840d2610 msgr2=0x7f918406e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:37.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.405+0000 7f9189dae700 1 --2- 172.21.15.114:0/3244964627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91840d2610 0x7f918406e6f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9174009850 tx=0x7f9174009b60 comp rx=0 tx=0).stop 2023-10-18T12:20:37.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.405+0000 7f9189dae700 1 -- 172.21.15.114:0/3244964627 shutdown_connections 2023-10-18T12:20:37.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.405+0000 7f9189dae700 1 --2- 172.21.15.114:0/3244964627 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91840d36b0 0x7f918415d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:37.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.405+0000 7f9189dae700 1 --2- 172.21.15.114:0/3244964627 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91840d2610 0x7f918406e6f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:37.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.405+0000 7f9189dae700 1 -- 172.21.15.114:0/3244964627 >> 172.21.15.114:0/3244964627 conn(0x7f9184069f20 msgr2=0x7f918406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:37.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.405+0000 7f9189dae700 1 -- 172.21.15.114:0/3244964627 shutdown_connections 2023-10-18T12:20:37.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.405+0000 7f9189dae700 1 -- 172.21.15.114:0/3244964627 wait complete. 2023-10-18T12:20:37.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.405+0000 7f9189dae700 1 Processor -- start 2023-10-18T12:20:37.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.405+0000 7f9189dae700 1 -- start start 2023-10-18T12:20:37.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.409+0000 7f9189dae700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91840d2610 0x7f91841f3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:37.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.409+0000 7f9189dae700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91840d36b0 0x7f91841f50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:37.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.409+0000 7f9189dae700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f918415e7d0 0x7f91840b0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:37.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.409+0000 7f9189dae700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91840cfec0 con 0x7f91840d36b0 2023-10-18T12:20:37.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.409+0000 7f9189dae700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91840b16b0 con 0x7f918415e7d0 2023-10-18T12:20:37.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.409+0000 7f9189dae700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91840d00f0 con 0x7f91840d2610 2023-10-18T12:20:37.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.409+0000 7f9182ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91840d36b0 0x7f91841f50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:37.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.409+0000 7f9182ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91840d36b0 0x7f91841f50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39734/0 (socket says 172.21.15.114:39734) 2023-10-18T12:20:37.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.409+0000 7f9182ffd700 1 -- 172.21.15.114:0/3641984509 learned_addr learned my addr 172.21.15.114:0/3641984509 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:37.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.409+0000 7f91837fe700 1 --2- 172.21.15.114:0/3641984509 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91840d2610 0x7f91841f3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:37.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.409+0000 7f9183fff700 1 --2- 172.21.15.114:0/3641984509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f918415e7d0 0x7f91840b0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:37.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.409+0000 7f9182ffd700 1 -- 172.21.15.114:0/3641984509 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91840d2610 msgr2=0x7f91841f3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:37.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.409+0000 7f9182ffd700 1 --2- 172.21.15.114:0/3641984509 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91840d2610 0x7f91841f3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:37.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.409+0000 7f9182ffd700 1 -- 172.21.15.114:0/3641984509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f918415e7d0 msgr2=0x7f91840b0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:37.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.409+0000 7f9182ffd700 1 --2- 172.21.15.114:0/3641984509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f918415e7d0 0x7f91840b0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:37.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.409+0000 7f9182ffd700 1 -- 172.21.15.114:0/3641984509 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91740094b0 con 0x7f91840d36b0 2023-10-18T12:20:37.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.409+0000 7f9183fff700 1 --2- 172.21.15.114:0/3641984509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f918415e7d0 0x7f91840b0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:37.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.409+0000 7f9182ffd700 1 --2- 172.21.15.114:0/3641984509 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91840d36b0 0x7f91841f50d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f917800c4d0 tx=0x7f917800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:37.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.409+0000 7f916bfff700 1 -- 172.21.15.114:0/3641984509 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9178005d90 con 0x7f91840d36b0 2023-10-18T12:20:37.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.409+0000 7f916bfff700 1 -- 172.21.15.114:0/3641984509 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91780070d0 con 0x7f91840d36b0 2023-10-18T12:20:37.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.409+0000 7f916bfff700 1 -- 172.21.15.114:0/3641984509 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9178007480 con 0x7f91840d36b0 2023-10-18T12:20:37.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.409+0000 7f9189dae700 1 -- 172.21.15.114:0/3641984509 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91840d03d0 con 0x7f91840d36b0 2023-10-18T12:20:37.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.409+0000 7f9189dae700 1 -- 172.21.15.114:0/3641984509 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91841f5610 con 0x7f91840d36b0 2023-10-18T12:20:37.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.413+0000 7f9189dae700 1 -- 172.21.15.114:0/3641984509 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9184072e60 con 0x7f91840d36b0 2023-10-18T12:20:37.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.413+0000 7f916bfff700 1 -- 172.21.15.114:0/3641984509 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f91780075e0 con 0x7f91840d36b0 2023-10-18T12:20:37.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.413+0000 7f916bfff700 1 --2- 172.21.15.114:0/3641984509 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f91700656f0 0x7f9170067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:37.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.413+0000 7f916bfff700 1 -- 172.21.15.114:0/3641984509 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9178082670 con 0x7f91840d36b0 2023-10-18T12:20:37.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.417+0000 7f91837fe700 1 --2- 172.21.15.114:0/3641984509 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f91700656f0 0x7f9170067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:37.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.417+0000 7f91837fe700 1 --2- 172.21.15.114:0/3641984509 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f91700656f0 0x7f9170067bb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f91740090b0 tx=0x7f9174008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:37.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.417+0000 7f916bfff700 1 -- 172.21.15.114:0/3641984509 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f917804fd60 con 0x7f91840d36b0 2023-10-18T12:20:37.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.661+0000 7f9189dae700 1 -- 172.21.15.114:0/3641984509 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f91840b7e90 con 0x7f91840d36b0 2023-10-18T12:20:37.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.673+0000 7f916bfff700 1 -- 172.21.15.114:0/3641984509 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9178053380 con 0x7f91840d36b0 2023-10-18T12:20:37.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.677+0000 7f9189dae700 1 -- 172.21.15.114:0/3641984509 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f91700656f0 msgr2=0x7f9170067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:37.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.677+0000 7f9189dae700 1 --2- 172.21.15.114:0/3641984509 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f91700656f0 0x7f9170067bb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f91740090b0 tx=0x7f9174008030 comp rx=0 tx=0).stop 2023-10-18T12:20:37.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.677+0000 7f9189dae700 1 -- 172.21.15.114:0/3641984509 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91840d36b0 msgr2=0x7f91841f50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:37.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.677+0000 7f9189dae700 1 --2- 172.21.15.114:0/3641984509 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91840d36b0 0x7f91841f50d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f917800c4d0 tx=0x7f917800c7e0 comp rx=0 tx=0).stop 2023-10-18T12:20:37.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.677+0000 7f9189dae700 1 -- 172.21.15.114:0/3641984509 shutdown_connections 2023-10-18T12:20:37.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.677+0000 7f9189dae700 1 --2- 172.21.15.114:0/3641984509 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f91700656f0 0x7f9170067bb0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:37.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.677+0000 7f9189dae700 1 --2- 172.21.15.114:0/3641984509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f918415e7d0 0x7f91840b0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:37.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.677+0000 7f9189dae700 1 --2- 172.21.15.114:0/3641984509 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91840d36b0 0x7f91841f50d0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:37.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.677+0000 7f9189dae700 1 --2- 172.21.15.114:0/3641984509 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91840d2610 0x7f91841f3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:37.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.677+0000 7f9189dae700 1 -- 172.21.15.114:0/3641984509 >> 172.21.15.114:0/3641984509 conn(0x7f9184069f20 msgr2=0x7f91841e6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:37.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.677+0000 7f9189dae700 1 -- 172.21.15.114:0/3641984509 shutdown_connections 2023-10-18T12:20:37.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.677+0000 7f9189dae700 1 -- 172.21.15.114:0/3641984509 wait complete. 2023-10-18T12:20:37.703 INFO:tasks.cephfs_test_runner:Simulate software freeze or temporary network failure. ... skipped 'Require first client to be on separate server from MDSs' 2023-10-18T12:20:37.704 INFO:tasks.cephfs_test_runner:Starting test: test_client_eviction_if_config_is_set (tasks.cephfs.test_client_recovery.TestClientOnLaggyOSD) If any client gets unresponsive/it's session get idle due to lagginess 2023-10-18T12:20:37.704 INFO:tasks.cephfs_test_runner:test_client_eviction_if_config_is_set (tasks.cephfs.test_client_recovery.TestClientOnLaggyOSD) 2023-10-18T12:20:37.704 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_recovery.TestClientOnLaggyOSD.test_client_eviction_if_config_is_set' 2023-10-18T12:20:37.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.877+0000 7f2ba5820700 1 Processor -- start 2023-10-18T12:20:37.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.877+0000 7f2ba5820700 1 -- start start 2023-10-18T12:20:37.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.877+0000 7f2ba5820700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2ba00d2e00 0x7f2ba00b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:37.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.881+0000 7f2ba5820700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ba00b5ae0 0x7f2ba006db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:37.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.881+0000 7f2ba5820700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ba015d0d0 con 0x7f2ba0160710 2023-10-18T12:20:37.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.881+0000 7f2ba5820700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ba015df90 con 0x7f2ba00d2e00 2023-10-18T12:20:37.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.881+0000 7f2ba5820700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba006f0f0 con 0x7f2ba00b5ae0 2023-10-18T12:20:37.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.881+0000 7f2b9ffff700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f2ba0160710 0x7f2ba00d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56046/0 (socket says 172.21.15.114:56046) 2023-10-18T12:20:37.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.881+0000 7f2b9ffff700 1 -- 172.21.15.114:0/739664455 learned_addr learned my addr 172.21.15.114:0/739664455 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:37.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.881+0000 7f2ba481e700 1 --2- 172.21.15.114:0/739664455 >> v2:172.21.15.172:3300/0 conn(0x7f2ba00d2e00 0x7f2ba00b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:37.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.881+0000 7f2ba501f700 1 --2- 172.21.15.114:0/739664455 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ba00b5ae0 0x7f2ba006db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:37.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.881+0000 7f2b9f7fe700 1 -- 172.21.15.114:0/739664455 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2363978583 0 0) 0x7f2b8c001110 con 0x7f2ba0160710 2023-10-18T12:20:37.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.881+0000 7f2b9f7fe700 1 -- 172.21.15.114:0/739664455 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b900035d0 con 0x7f2ba0160710 2023-10-18T12:20:37.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.881+0000 7f2ba481e700 1 -- 172.21.15.114:0/739664455 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ba00b5ae0 msgr2=0x7f2ba006db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:37.887 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.881+0000 7f2ba481e700 1 --2- 172.21.15.114:0/739664455 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ba00b5ae0 0x7f2ba006db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:37.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.881+0000 7f2ba481e700 1 -- 172.21.15.114:0/739664455 >> v1:172.21.15.114:6789/0 conn(0x7f2ba0160710 legacy=0x7f2ba00d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:37.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.881+0000 7f2ba481e700 1 -- 172.21.15.114:0/739664455 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba015d310 con 0x7f2ba00d2e00 2023-10-18T12:20:37.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.881+0000 7f2ba481e700 1 --2- 172.21.15.114:0/739664455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ba00d2e00 0x7f2ba00b6e00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2b94009850 tx=0x7f2b94009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4707c52d8258155 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:37.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.881+0000 7f2b9f7fe700 1 -- 172.21.15.114:0/739664455 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b94011830 con 0x7f2ba00d2e00 2023-10-18T12:20:37.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.881+0000 7f2b9f7fe700 1 -- 172.21.15.114:0/739664455 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b94011990 con 0x7f2ba00d2e00 2023-10-18T12:20:37.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.881+0000 7f2b9f7fe700 1 -- 172.21.15.114:0/739664455 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b94011d40 con 0x7f2ba00d2e00 2023-10-18T12:20:37.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.881+0000 7f2ba5820700 1 -- 172.21.15.114:0/739664455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ba00d2e00 msgr2=0x7f2ba00b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:37.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.881+0000 7f2ba5820700 1 --2- 172.21.15.114:0/739664455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ba00d2e00 0x7f2ba00b6e00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2b94009850 tx=0x7f2b94009b60 comp rx=0 tx=0).stop 2023-10-18T12:20:37.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.881+0000 7f2ba5820700 1 -- 172.21.15.114:0/739664455 shutdown_connections 2023-10-18T12:20:37.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.881+0000 7f2ba5820700 1 --2- 172.21.15.114:0/739664455 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ba00b5ae0 0x7f2ba006db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:37.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.881+0000 7f2ba5820700 1 --2- 172.21.15.114:0/739664455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ba00d2e00 0x7f2ba00b6e00 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:37.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.881+0000 7f2ba5820700 1 -- 172.21.15.114:0/739664455 >> 172.21.15.114:0/739664455 conn(0x7f2ba0069f20 msgr2=0x7f2ba006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:37.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.881+0000 7f2ba5820700 1 -- 172.21.15.114:0/739664455 shutdown_connections 2023-10-18T12:20:37.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.881+0000 7f2ba5820700 1 -- 172.21.15.114:0/739664455 wait complete. 2023-10-18T12:20:37.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.885+0000 7f2ba5820700 1 Processor -- start 2023-10-18T12:20:37.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.885+0000 7f2ba5820700 1 -- start start 2023-10-18T12:20:37.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.885+0000 7f2ba5820700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ba00b5ae0 0x7f2ba0159870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:37.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.885+0000 7f2ba5820700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ba00d2e00 0x7f2ba00d1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:37.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.885+0000 7f2ba5820700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ba0160710 0x7f2ba006f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:37.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.885+0000 7f2ba5820700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba00cfda0 con 0x7f2ba0160710 2023-10-18T12:20:37.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.885+0000 7f2ba5820700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba00acad0 con 0x7f2ba00b5ae0 2023-10-18T12:20:37.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.885+0000 7f2ba5820700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba00acdb0 con 0x7f2ba00d2e00 2023-10-18T12:20:37.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.889+0000 7f2ba501f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ba0160710 0x7f2ba006f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:37.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.889+0000 7f2ba501f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ba0160710 0x7f2ba006f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39738/0 (socket says 172.21.15.114:39738) 2023-10-18T12:20:37.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.889+0000 7f2ba501f700 1 -- 172.21.15.114:0/29247588 learned_addr learned my addr 172.21.15.114:0/29247588 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:37.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.889+0000 7f2b9ffff700 1 --2- 172.21.15.114:0/29247588 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ba00d2e00 0x7f2ba00d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:37.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.889+0000 7f2ba481e700 1 --2- 172.21.15.114:0/29247588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ba00b5ae0 0x7f2ba0159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:37.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.889+0000 7f2ba501f700 1 -- 172.21.15.114:0/29247588 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ba00d2e00 msgr2=0x7f2ba00d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:37.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.889+0000 7f2ba501f700 1 --2- 172.21.15.114:0/29247588 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ba00d2e00 0x7f2ba00d1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:37.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.889+0000 7f2ba501f700 1 -- 172.21.15.114:0/29247588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ba00b5ae0 msgr2=0x7f2ba0159870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:37.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.889+0000 7f2ba501f700 1 --2- 172.21.15.114:0/29247588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ba00b5ae0 0x7f2ba0159870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:37.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.889+0000 7f2ba501f700 1 -- 172.21.15.114:0/29247588 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b940094b0 con 0x7f2ba0160710 2023-10-18T12:20:37.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.889+0000 7f2ba501f700 1 --2- 172.21.15.114:0/29247588 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ba0160710 0x7f2ba006f450 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2b9800efc0 tx=0x7f2b9800c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:37.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.889+0000 7f2b9d7fa700 1 -- 172.21.15.114:0/29247588 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9800cad0 con 0x7f2ba0160710 2023-10-18T12:20:37.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.889+0000 7f2ba5820700 1 -- 172.21.15.114:0/29247588 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba00ad090 con 0x7f2ba0160710 2023-10-18T12:20:37.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.889+0000 7f2b9d7fa700 1 -- 172.21.15.114:0/29247588 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9800f040 con 0x7f2ba0160710 2023-10-18T12:20:37.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.889+0000 7f2b9d7fa700 1 -- 172.21.15.114:0/29247588 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9800ce70 con 0x7f2ba0160710 2023-10-18T12:20:37.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.889+0000 7f2ba5820700 1 -- 172.21.15.114:0/29247588 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba00ad650 con 0x7f2ba0160710 2023-10-18T12:20:37.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.889+0000 7f2ba5820700 1 -- 172.21.15.114:0/29247588 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ba015d8b0 con 0x7f2ba0160710 2023-10-18T12:20:37.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.893+0000 7f2b9d7fa700 1 -- 172.21.15.114:0/29247588 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f2b98014480 con 0x7f2ba0160710 2023-10-18T12:20:37.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.893+0000 7f2b9d7fa700 1 --2- 172.21.15.114:0/29247588 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2b840656f0 0x7f2b84067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:37.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.893+0000 7f2b9d7fa700 1 -- 172.21.15.114:0/29247588 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2b98006e40 con 0x7f2ba0160710 2023-10-18T12:20:37.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.893+0000 7f2ba481e700 1 --2- 172.21.15.114:0/29247588 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2b840656f0 0x7f2b84067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:37.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.893+0000 7f2ba481e700 1 --2- 172.21.15.114:0/29247588 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2b840656f0 0x7f2b84067bb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2b940090b0 tx=0x7f2b9401c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:37.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:37.901+0000 7f2b9d7fa700 1 -- 172.21.15.114:0/29247588 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f2ba015d8b0 con 0x7f2ba0160710 2023-10-18T12:20:38.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.133+0000 7f2ba5820700 1 -- 172.21.15.114:0/29247588 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientOnLaggyOSD.test_client_eviction_if_config_is_set"]} v 0) v1 -- 0x7f2ba015d8b0 con 0x7f2ba0160710 2023-10-18T12:20:38.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.757+0000 7f2b9d7fa700 1 -- 172.21.15.114:0/29247588 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientOnLaggyOSD.test_client_eviction_if_config_is_set"]}]=0 v81) v1 ==== 174+0+0 (secure 0 0 0) 0x7f2ba015d8b0 con 0x7f2ba0160710 2023-10-18T12:20:38.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.761+0000 7f2ba5820700 1 -- 172.21.15.114:0/29247588 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2b840656f0 msgr2=0x7f2b84067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:38.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.761+0000 7f2ba5820700 1 --2- 172.21.15.114:0/29247588 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2b840656f0 0x7f2b84067bb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2b940090b0 tx=0x7f2b9401c040 comp rx=0 tx=0).stop 2023-10-18T12:20:38.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.761+0000 7f2ba5820700 1 -- 172.21.15.114:0/29247588 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ba0160710 msgr2=0x7f2ba006f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:38.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.761+0000 7f2ba5820700 1 --2- 172.21.15.114:0/29247588 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ba0160710 0x7f2ba006f450 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2b9800efc0 tx=0x7f2b9800c0c0 comp rx=0 tx=0).stop 2023-10-18T12:20:38.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.761+0000 7f2ba5820700 1 -- 172.21.15.114:0/29247588 shutdown_connections 2023-10-18T12:20:38.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.761+0000 7f2ba5820700 1 --2- 172.21.15.114:0/29247588 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2b840656f0 0x7f2b84067bb0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:38.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.761+0000 7f2ba5820700 1 --2- 172.21.15.114:0/29247588 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ba00d2e00 0x7f2ba00d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:38.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.761+0000 7f2ba5820700 1 --2- 172.21.15.114:0/29247588 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ba0160710 0x7f2ba006f450 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:38.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.761+0000 7f2ba5820700 1 --2- 172.21.15.114:0/29247588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ba00b5ae0 0x7f2ba0159870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:38.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.761+0000 7f2ba5820700 1 -- 172.21.15.114:0/29247588 >> 172.21.15.114:0/29247588 conn(0x7f2ba0069f20 msgr2=0x7f2ba015e310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:38.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.761+0000 7f2ba5820700 1 -- 172.21.15.114:0/29247588 shutdown_connections 2023-10-18T12:20:38.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.761+0000 7f2ba5820700 1 -- 172.21.15.114:0/29247588 wait complete. 2023-10-18T12:20:38.792 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T12:20:38.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.965+0000 7f412ee9a700 1 Processor -- start 2023-10-18T12:20:38.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.965+0000 7f412ee9a700 1 -- start start 2023-10-18T12:20:38.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.969+0000 7f412ee9a700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f41280b3d40 0x7f41280cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:38.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.969+0000 7f412ee9a700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4128164a20 0x7f41280c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:38.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.969+0000 7f412ee9a700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f412806ce20 0x7f412806d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:38.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.969+0000 7f412ee9a700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f412806e2d0 con 0x7f41280b3d40 2023-10-18T12:20:38.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.969+0000 7f412ee9a700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f412806d7d0 con 0x7f4128164a20 2023-10-18T12:20:38.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.969+0000 7f412ee9a700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41280ca200 con 0x7f412806ce20 2023-10-18T12:20:38.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.969+0000 7f412de98700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f41280b3d40 0x7f41280cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:38.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.969+0000 7f412de98700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f41280b3d40 0x7f41280cc190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39748/0 (socket says 172.21.15.114:39748) 2023-10-18T12:20:38.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.969+0000 7f412de98700 1 -- 172.21.15.114:0/4081679089 learned_addr learned my addr 172.21.15.114:0/4081679089 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:38.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.969+0000 7f412e699700 1 --2- 172.21.15.114:0/4081679089 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f412806ce20 0x7f412806d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:38.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.969+0000 7f412d697700 1 --2- 172.21.15.114:0/4081679089 >> v2:172.21.15.172:3300/0 conn(0x7f4128164a20 0x7f41280c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:38.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.973+0000 7f412d697700 1 -- 172.21.15.114:0/4081679089 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f412806ce20 msgr2=0x7f412806d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:38.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.973+0000 7f412d697700 1 --2- 172.21.15.114:0/4081679089 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f412806ce20 0x7f412806d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:38.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.973+0000 7f412d697700 1 -- 172.21.15.114:0/4081679089 >> v2:172.21.15.114:3300/0 conn(0x7f41280b3d40 msgr2=0x7f41280cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:38.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.973+0000 7f412d697700 1 --2- 172.21.15.114:0/4081679089 >> v2:172.21.15.114:3300/0 conn(0x7f41280b3d40 0x7f41280cc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:38.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.973+0000 7f412d697700 1 -- 172.21.15.114:0/4081679089 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41280ca4c0 con 0x7f4128164a20 2023-10-18T12:20:38.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.973+0000 7f412d697700 1 --2- 172.21.15.114:0/4081679089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4128164a20 0x7f41280c9cc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f41280c9830 tx=0x7f4118009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fe0b170b1c08004 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:38.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.973+0000 7f412ce96700 1 -- 172.21.15.114:0/4081679089 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4118011830 con 0x7f4128164a20 2023-10-18T12:20:38.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.973+0000 7f412ce96700 1 -- 172.21.15.114:0/4081679089 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4118011990 con 0x7f4128164a20 2023-10-18T12:20:38.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.973+0000 7f412ce96700 1 -- 172.21.15.114:0/4081679089 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4118011d20 con 0x7f4128164a20 2023-10-18T12:20:38.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.973+0000 7f412ee9a700 1 -- 172.21.15.114:0/4081679089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4128164a20 msgr2=0x7f41280c9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:38.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.973+0000 7f412ee9a700 1 --2- 172.21.15.114:0/4081679089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4128164a20 0x7f41280c9cc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f41280c9830 tx=0x7f4118009b30 comp rx=0 tx=0).stop 2023-10-18T12:20:38.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.973+0000 7f412ee9a700 1 -- 172.21.15.114:0/4081679089 shutdown_connections 2023-10-18T12:20:38.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.973+0000 7f412ee9a700 1 --2- 172.21.15.114:0/4081679089 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f412806ce20 0x7f412806d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:38.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.973+0000 7f412ee9a700 1 --2- 172.21.15.114:0/4081679089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4128164a20 0x7f41280c9cc0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:38.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.973+0000 7f412ee9a700 1 --2- 172.21.15.114:0/4081679089 >> v2:172.21.15.114:3300/0 conn(0x7f41280b3d40 0x7f41280cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:38.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.973+0000 7f412ee9a700 1 -- 172.21.15.114:0/4081679089 >> 172.21.15.114:0/4081679089 conn(0x7f41280ce5c0 msgr2=0x7f41280ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:38.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.973+0000 7f412ee9a700 1 -- 172.21.15.114:0/4081679089 shutdown_connections 2023-10-18T12:20:38.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.973+0000 7f412ee9a700 1 -- 172.21.15.114:0/4081679089 wait complete. 2023-10-18T12:20:38.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.977+0000 7f412ee9a700 1 Processor -- start 2023-10-18T12:20:38.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.977+0000 7f412ee9a700 1 -- start start 2023-10-18T12:20:38.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.977+0000 7f412ee9a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f412806ce20 0x7f41281f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:38.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.977+0000 7f412ee9a700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f41280b3d40 0x7f41280b2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:38.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.977+0000 7f412ee9a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4128164a20 0x7f41280b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:38.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.977+0000 7f412ee9a700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41280c66e0 con 0x7f412806ce20 2023-10-18T12:20:38.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.977+0000 7f412ee9a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41280c7540 con 0x7f4128164a20 2023-10-18T12:20:38.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.977+0000 7f412ee9a700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41280c6930 con 0x7f41280b3d40 2023-10-18T12:20:38.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.977+0000 7f412de98700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f412806ce20 0x7f41281f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:38.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.977+0000 7f412de98700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f412806ce20 0x7f41281f64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39750/0 (socket says 172.21.15.114:39750) 2023-10-18T12:20:38.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.977+0000 7f412de98700 1 -- 172.21.15.114:0/3402733979 learned_addr learned my addr 172.21.15.114:0/3402733979 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:38.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.977+0000 7f412e699700 1 --2- 172.21.15.114:0/3402733979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4128164a20 0x7f41280b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:38.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.977+0000 7f412d697700 1 --2- 172.21.15.114:0/3402733979 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f41280b3d40 0x7f41280b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:38.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.977+0000 7f412de98700 1 -- 172.21.15.114:0/3402733979 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f41280b3d40 msgr2=0x7f41280b2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:38.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.977+0000 7f412de98700 1 --2- 172.21.15.114:0/3402733979 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f41280b3d40 0x7f41280b2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:38.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.977+0000 7f412de98700 1 -- 172.21.15.114:0/3402733979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4128164a20 msgr2=0x7f41280b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:38.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.977+0000 7f412de98700 1 --2- 172.21.15.114:0/3402733979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4128164a20 0x7f41280b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:38.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.977+0000 7f412de98700 1 -- 172.21.15.114:0/3402733979 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41180094b0 con 0x7f412806ce20 2023-10-18T12:20:38.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.981+0000 7f412de98700 1 --2- 172.21.15.114:0/3402733979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f412806ce20 0x7f41281f64a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f412400e930 tx=0x7f412400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:38.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.981+0000 7f411e7fc700 1 -- 172.21.15.114:0/3402733979 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41240096c0 con 0x7f412806ce20 2023-10-18T12:20:38.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.981+0000 7f412ee9a700 1 -- 172.21.15.114:0/3402733979 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41280c6c10 con 0x7f412806ce20 2023-10-18T12:20:38.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.981+0000 7f411e7fc700 1 -- 172.21.15.114:0/3402733979 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4124013680 con 0x7f412806ce20 2023-10-18T12:20:38.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.981+0000 7f411e7fc700 1 -- 172.21.15.114:0/3402733979 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4124013a30 con 0x7f412806ce20 2023-10-18T12:20:38.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.981+0000 7f412ee9a700 1 -- 172.21.15.114:0/3402733979 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41280c71d0 con 0x7f412806ce20 2023-10-18T12:20:38.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.981+0000 7f412ee9a700 1 -- 172.21.15.114:0/3402733979 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4128072e60 con 0x7f412806ce20 2023-10-18T12:20:38.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.981+0000 7f411e7fc700 1 -- 172.21.15.114:0/3402733979 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f4124013b90 con 0x7f412806ce20 2023-10-18T12:20:38.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.985+0000 7f411e7fc700 1 --2- 172.21.15.114:0/3402733979 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f410c0656f0 0x7f410c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:38.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.985+0000 7f411e7fc700 1 -- 172.21.15.114:0/3402733979 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f41240833e0 con 0x7f412806ce20 2023-10-18T12:20:38.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.985+0000 7f412d697700 1 --2- 172.21.15.114:0/3402733979 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f410c0656f0 0x7f410c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:38.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.985+0000 7f412d697700 1 --2- 172.21.15.114:0/3402733979 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f410c0656f0 0x7f410c067bb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4118000c00 tx=0x7f4118008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:38.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:38.989+0000 7f411e7fc700 1 -- 172.21.15.114:0/3402733979 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f4124050b80 con 0x7f412806ce20 2023-10-18T12:20:39.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.169+0000 7f412ee9a700 1 -- 172.21.15.114:0/3402733979 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41280cd730 con 0x7f412806ce20 2023-10-18T12:20:39.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.173+0000 7f411e7fc700 1 -- 172.21.15.114:0/3402733979 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20240 (secure 0 0 0) 0x7f41240541a0 con 0x7f412806ce20 2023-10-18T12:20:39.178 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:20:39.178 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":30,"fsid":"240ea340-5d3d-4f52-a4bc-af075aca3deb","created":"2023-10-18T12:19:12.512994+0000","modified":"2023-10-18T12:20:20.604528+0000","last_up_change":"2023-10-18T12:19:25.286009+0000","last_in_change":"2023-10-18T12:19:15.850693+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T12:19:27.040638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-18T12:19:32.358094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-18T12:19:37.333855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-18T12:19:38.055385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-18T12:19:41.679218+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c3578978-1a03-4857-b9d2-34a5da3d7731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6817","nonce":1506287862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6820","nonce":1506287862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6830","nonce":1506287862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6825","nonce":1506287862}]},"public_addr":"172.21.15.114:6817/1506287862","cluster_addr":"172.21.15.114:6820/1506287862","heartbeat_back_addr":"172.21.15.114:6830/1506287862","heartbeat_front_addr":"172.21.15.114:6825/1506287862","state":["exists","up"]},{"osd":1,"uuid":"43eb26a6-e2b3-4670-9559-bd053b5140d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6801","nonce":3302727047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6803","nonce":3302727047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6807","nonce":3302727047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6805","nonce":3302727047}]},"public_addr":"172.21.15.114:6801/3302727047","cluster_addr":"172.21.15.114:6803/3302727047","heartbeat_back_addr":"172.21.15.114:6807/3302727047","heartbeat_front_addr":"172.21.15.114:6805/3302727047","state":["exists","up"]},{"osd":2,"uuid":"f3d4dbd5-521c-4dd2-b687-5768cc7d0938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6809","nonce":2699151351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6811","nonce":2699151351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6815","nonce":2699151351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6813","nonce":2699151351}]},"public_addr":"172.21.15.114:6809/2699151351","cluster_addr":"172.21.15.114:6811/2699151351","heartbeat_back_addr":"172.21.15.114:6815/2699151351","heartbeat_front_addr":"172.21.15.114:6813/2699151351","state":["exists","up"]},{"osd":3,"uuid":"823e5802-92b7-4f0d-b32d-a5748993f1b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6821","nonce":1361608073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6824","nonce":1361608073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6829","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6831","nonce":1361608073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6827","nonce":1361608073}]},"public_addr":"172.21.15.114:6821/1361608073","cluster_addr":"172.21.15.114:6824/1361608073","heartbeat_back_addr":"172.21.15.114:6831/1361608073","heartbeat_front_addr":"172.21.15.114:6827/1361608073","state":["exists","up"]},{"osd":4,"uuid":"e47fb93e-13b4-44a4-b084-8c4384ceb41e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6801","nonce":930839681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6803","nonce":930839681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6807","nonce":930839681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6805","nonce":930839681}]},"public_addr":"172.21.15.172:6801/930839681","cluster_addr":"172.21.15.172:6803/930839681","heartbeat_back_addr":"172.21.15.172:6807/930839681","heartbeat_front_addr":"172.21.15.172:6805/930839681","state":["exists","up"]},{"osd":5,"uuid":"7561a973-f479-45a0-af40-f324728d622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6814","nonce":571761850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6818","nonce":571761850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6824","nonce":571761850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6821","nonce":571761850}]},"public_addr":"172.21.15.172:6814/571761850","cluster_addr":"172.21.15.172:6818/571761850","heartbeat_back_addr":"172.21.15.172:6824/571761850","heartbeat_front_addr":"172.21.15.172:6821/571761850","state":["exists","up"]},{"osd":6,"uuid":"51753f4b-7f06-4f1c-9ec7-6e18a66eb980","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6825","nonce":1680398853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6827","nonce":1680398853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6831","nonce":1680398853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6829","nonce":1680398853}]},"public_addr":"172.21.15.172:6825/1680398853","cluster_addr":"172.21.15.172:6827/1680398853","heartbeat_back_addr":"172.21.15.172:6831/1680398853","heartbeat_front_addr":"172.21.15.172:6829/1680398853","state":["exists","up"]},{"osd":7,"uuid":"4d8b1e15-143d-4d17-9074-59d92f0f9af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6809","nonce":349710101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6811","nonce":349710101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6819","nonce":349710101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6815","nonce":349710101}]},"public_addr":"172.21.15.172:6809/349710101","cluster_addr":"172.21.15.172:6811/349710101","heartbeat_back_addr":"172.21.15.172:6819/349710101","heartbeat_front_addr":"172.21.15.172:6815/349710101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.889460+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.475494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.911473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.648596+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.609994+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.636248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.854589+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.885826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T12:20:39.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.177+0000 7f412ee9a700 1 -- 172.21.15.114:0/3402733979 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f410c0656f0 msgr2=0x7f410c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:39.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.177+0000 7f412ee9a700 1 --2- 172.21.15.114:0/3402733979 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f410c0656f0 0x7f410c067bb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4118000c00 tx=0x7f4118008030 comp rx=0 tx=0).stop 2023-10-18T12:20:39.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.177+0000 7f412ee9a700 1 -- 172.21.15.114:0/3402733979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f412806ce20 msgr2=0x7f41281f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:39.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.177+0000 7f412ee9a700 1 --2- 172.21.15.114:0/3402733979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f412806ce20 0x7f41281f64a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f412400e930 tx=0x7f412400ec40 comp rx=0 tx=0).stop 2023-10-18T12:20:39.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.177+0000 7f412ee9a700 1 -- 172.21.15.114:0/3402733979 shutdown_connections 2023-10-18T12:20:39.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.177+0000 7f412ee9a700 1 --2- 172.21.15.114:0/3402733979 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f410c0656f0 0x7f410c067bb0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:39.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.177+0000 7f412ee9a700 1 --2- 172.21.15.114:0/3402733979 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f41280b3d40 0x7f41280b2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:39.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.177+0000 7f412ee9a700 1 --2- 172.21.15.114:0/3402733979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4128164a20 0x7f41280b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:39.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.177+0000 7f412ee9a700 1 --2- 172.21.15.114:0/3402733979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f412806ce20 0x7f41281f64a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:39.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.177+0000 7f412ee9a700 1 -- 172.21.15.114:0/3402733979 >> 172.21.15.114:0/3402733979 conn(0x7f41280ce5c0 msgr2=0x7f4128164ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:39.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.177+0000 7f412ee9a700 1 -- 172.21.15.114:0/3402733979 shutdown_connections 2023-10-18T12:20:39.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.177+0000 7f412ee9a700 1 -- 172.21.15.114:0/3402733979 wait complete. 2023-10-18T12:20:39.200 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-18T12:19:27.040638+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-18T12:19:32.358094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-18T12:19:37.333855+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-18T12:19:38.055385+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-18T12:19:41.679218+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-18T12:20:39.201 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-18T12:20:39.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.385+0000 7fe955970700 1 Processor -- start 2023-10-18T12:20:39.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.385+0000 7fe955970700 1 -- start start 2023-10-18T12:20:39.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.389+0000 7fe955970700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe9500d2e00 0x7fe9500b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:39.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.389+0000 7fe955970700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe950160710 0x7fe9500d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:39.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.389+0000 7fe955970700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9500b5ae0 0x7fe95006db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:39.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.389+0000 7fe955970700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe95015df90 con 0x7fe9500d2e00 2023-10-18T12:20:39.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.389+0000 7fe955970700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe95015d0d0 con 0x7fe950160710 2023-10-18T12:20:39.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.389+0000 7fe955970700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe95006f0f0 con 0x7fe9500b5ae0 2023-10-18T12:20:39.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.389+0000 7fe95496e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe9500d2e00 0x7fe9500b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:39.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.389+0000 7fe95496e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe9500d2e00 0x7fe9500b6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39758/0 (socket says 172.21.15.114:39758) 2023-10-18T12:20:39.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.389+0000 7fe95496e700 1 -- 172.21.15.114:0/737058187 learned_addr learned my addr 172.21.15.114:0/737058187 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:39.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.389+0000 7fe94ffff700 1 --2- 172.21.15.114:0/737058187 >> v2:172.21.15.172:3300/0 conn(0x7fe950160710 0x7fe9500d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:39.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.389+0000 7fe95516f700 1 --2- 172.21.15.114:0/737058187 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9500b5ae0 0x7fe95006db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:39.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.389+0000 7fe95496e700 1 -- 172.21.15.114:0/737058187 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9500b5ae0 msgr2=0x7fe95006db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:39.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.389+0000 7fe95496e700 1 --2- 172.21.15.114:0/737058187 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9500b5ae0 0x7fe95006db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:39.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.389+0000 7fe95496e700 1 -- 172.21.15.114:0/737058187 >> v2:172.21.15.172:3300/0 conn(0x7fe950160710 msgr2=0x7fe9500d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:39.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.389+0000 7fe95496e700 1 --2- 172.21.15.114:0/737058187 >> v2:172.21.15.172:3300/0 conn(0x7fe950160710 0x7fe9500d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:39.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.389+0000 7fe95496e700 1 -- 172.21.15.114:0/737058187 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9500d3720 con 0x7fe9500d2e00 2023-10-18T12:20:39.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.389+0000 7fe95496e700 1 --2- 172.21.15.114:0/737058187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9500d2e00 0x7fe9500b6e00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe9500d2420 tx=0x7fe944009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d02542c9bbf5d0bd server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:39.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.389+0000 7fe94f7fe700 1 -- 172.21.15.114:0/737058187 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94400b8a0 con 0x7fe9500d2e00 2023-10-18T12:20:39.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.389+0000 7fe94f7fe700 1 -- 172.21.15.114:0/737058187 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe94400ba00 con 0x7fe9500d2e00 2023-10-18T12:20:39.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.389+0000 7fe94f7fe700 1 -- 172.21.15.114:0/737058187 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94400bd90 con 0x7fe9500d2e00 2023-10-18T12:20:39.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.393+0000 7fe955970700 1 -- 172.21.15.114:0/737058187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9500d2e00 msgr2=0x7fe9500b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:39.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.393+0000 7fe955970700 1 --2- 172.21.15.114:0/737058187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9500d2e00 0x7fe9500b6e00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe9500d2420 tx=0x7fe944009bf0 comp rx=0 tx=0).stop 2023-10-18T12:20:39.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.393+0000 7fe955970700 1 -- 172.21.15.114:0/737058187 shutdown_connections 2023-10-18T12:20:39.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.393+0000 7fe955970700 1 --2- 172.21.15.114:0/737058187 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe9500b5ae0 0x7fe95006db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:39.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.393+0000 7fe955970700 1 --2- 172.21.15.114:0/737058187 >> v2:172.21.15.172:3300/0 conn(0x7fe950160710 0x7fe9500d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:39.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.393+0000 7fe955970700 1 --2- 172.21.15.114:0/737058187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9500d2e00 0x7fe9500b6e00 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:39.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.393+0000 7fe955970700 1 -- 172.21.15.114:0/737058187 >> 172.21.15.114:0/737058187 conn(0x7fe950069f20 msgr2=0x7fe95006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:39.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.393+0000 7fe955970700 1 -- 172.21.15.114:0/737058187 shutdown_connections 2023-10-18T12:20:39.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.393+0000 7fe955970700 1 -- 172.21.15.114:0/737058187 wait complete. 2023-10-18T12:20:39.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.393+0000 7fe955970700 1 Processor -- start 2023-10-18T12:20:39.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.393+0000 7fe955970700 1 -- start start 2023-10-18T12:20:39.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.397+0000 7fe955970700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9500b5ae0 0x7fe9500af840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:39.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.397+0000 7fe955970700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9500d2e00 0x7fe9500afd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:39.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.397+0000 7fe955970700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe950160710 0x7fe9500abb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:39.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.397+0000 7fe955970700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9500ad500 con 0x7fe9500d2e00 2023-10-18T12:20:39.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.397+0000 7fe955970700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9500ac880 con 0x7fe9500b5ae0 2023-10-18T12:20:39.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.397+0000 7fe955970700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9500acb60 con 0x7fe950160710 2023-10-18T12:20:39.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.397+0000 7fe94ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9500d2e00 0x7fe9500afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:39.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.397+0000 7fe94ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9500d2e00 0x7fe9500afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39768/0 (socket says 172.21.15.114:39768) 2023-10-18T12:20:39.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.397+0000 7fe94ffff700 1 -- 172.21.15.114:0/758945225 learned_addr learned my addr 172.21.15.114:0/758945225 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:39.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.397+0000 7fe95496e700 1 --2- 172.21.15.114:0/758945225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9500b5ae0 0x7fe9500af840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:39.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.397+0000 7fe95516f700 1 --2- 172.21.15.114:0/758945225 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe950160710 0x7fe9500abb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:39.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.397+0000 7fe94ffff700 1 -- 172.21.15.114:0/758945225 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe950160710 msgr2=0x7fe9500abb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:39.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.397+0000 7fe94ffff700 1 --2- 172.21.15.114:0/758945225 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe950160710 0x7fe9500abb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:39.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.397+0000 7fe94ffff700 1 -- 172.21.15.114:0/758945225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9500b5ae0 msgr2=0x7fe9500af840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:39.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.397+0000 7fe94ffff700 1 --2- 172.21.15.114:0/758945225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9500b5ae0 0x7fe9500af840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:39.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.397+0000 7fe94ffff700 1 -- 172.21.15.114:0/758945225 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe944009570 con 0x7fe9500d2e00 2023-10-18T12:20:39.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.397+0000 7fe95516f700 1 --2- 172.21.15.114:0/758945225 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe950160710 0x7fe9500abb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:39.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.397+0000 7fe94ffff700 1 --2- 172.21.15.114:0/758945225 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9500d2e00 0x7fe9500afd80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe93c00d7d0 tx=0x7fe93c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:39.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.397+0000 7fe94d7fa700 1 -- 172.21.15.114:0/758945225 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93c017070 con 0x7fe9500d2e00 2023-10-18T12:20:39.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.397+0000 7fe955970700 1 -- 172.21.15.114:0/758945225 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9500ace40 con 0x7fe9500d2e00 2023-10-18T12:20:39.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.397+0000 7fe94d7fa700 1 -- 172.21.15.114:0/758945225 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe93c004020 con 0x7fe9500d2e00 2023-10-18T12:20:39.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.397+0000 7fe94d7fa700 1 -- 172.21.15.114:0/758945225 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93c0041d0 con 0x7fe9500d2e00 2023-10-18T12:20:39.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.397+0000 7fe955970700 1 -- 172.21.15.114:0/758945225 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9501f5450 con 0x7fe9500d2e00 2023-10-18T12:20:39.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.401+0000 7fe955970700 1 -- 172.21.15.114:0/758945225 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe95014cf80 con 0x7fe9500d2e00 2023-10-18T12:20:39.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.401+0000 7fe94d7fa700 1 -- 172.21.15.114:0/758945225 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fe93c004330 con 0x7fe9500d2e00 2023-10-18T12:20:39.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.401+0000 7fe94d7fa700 1 --2- 172.21.15.114:0/758945225 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe9340656f0 0x7fe934067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:39.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.401+0000 7fe94d7fa700 1 -- 172.21.15.114:0/758945225 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe93c082c50 con 0x7fe9500d2e00 2023-10-18T12:20:39.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.405+0000 7fe95496e700 1 --2- 172.21.15.114:0/758945225 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe9340656f0 0x7fe934067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:39.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.405+0000 7fe95496e700 1 --2- 172.21.15.114:0/758945225 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe9340656f0 0x7fe934067bb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe944000c00 tx=0x7fe944008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:39.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.409+0000 7fe94d7fa700 1 -- 172.21.15.114:0/758945225 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fe95014cf80 con 0x7fe9500d2e00 2023-10-18T12:20:39.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.589+0000 7fe955970700 1 -- 172.21.15.114:0/758945225 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe95014cf80 con 0x7fe9500d2e00 2023-10-18T12:20:39.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.589+0000 7fe94d7fa700 1 -- 172.21.15.114:0/758945225 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe95014cf80 con 0x7fe9500d2e00 2023-10-18T12:20:39.594 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-10-18T12:20:39.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.593+0000 7fe955970700 1 -- 172.21.15.114:0/758945225 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe9340656f0 msgr2=0x7fe934067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:39.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.593+0000 7fe955970700 1 --2- 172.21.15.114:0/758945225 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe9340656f0 0x7fe934067bb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe944000c00 tx=0x7fe944008030 comp rx=0 tx=0).stop 2023-10-18T12:20:39.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.593+0000 7fe955970700 1 -- 172.21.15.114:0/758945225 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9500d2e00 msgr2=0x7fe9500afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:39.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.593+0000 7fe955970700 1 --2- 172.21.15.114:0/758945225 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9500d2e00 0x7fe9500afd80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe93c00d7d0 tx=0x7fe93c00dae0 comp rx=0 tx=0).stop 2023-10-18T12:20:39.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.593+0000 7fe955970700 1 -- 172.21.15.114:0/758945225 shutdown_connections 2023-10-18T12:20:39.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.593+0000 7fe955970700 1 --2- 172.21.15.114:0/758945225 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe9340656f0 0x7fe934067bb0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:39.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.593+0000 7fe955970700 1 --2- 172.21.15.114:0/758945225 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe950160710 0x7fe9500abb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:39.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.593+0000 7fe955970700 1 --2- 172.21.15.114:0/758945225 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe9500d2e00 0x7fe9500afd80 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:39.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.593+0000 7fe955970700 1 --2- 172.21.15.114:0/758945225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe9500b5ae0 0x7fe9500af840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:39.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.593+0000 7fe955970700 1 -- 172.21.15.114:0/758945225 >> 172.21.15.114:0/758945225 conn(0x7fe950069f20 msgr2=0x7fe95006e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:39.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.593+0000 7fe955970700 1 -- 172.21.15.114:0/758945225 shutdown_connections 2023-10-18T12:20:39.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.593+0000 7fe955970700 1 -- 172.21.15.114:0/758945225 wait complete. 2023-10-18T12:20:39.615 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-18T12:20:39.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.793+0000 7fec1e8fc700 1 Processor -- start 2023-10-18T12:20:39.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.793+0000 7fec1e8fc700 1 -- start start 2023-10-18T12:20:39.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.793+0000 7fec1e8fc700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fec181467c0 0x7fec180b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:39.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.793+0000 7fec1e8fc700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fec1806f9a0 0x7fec1806fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:39.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.793+0000 7fec1e8fc700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec18146ba0 con 0x7fec181612e0 2023-10-18T12:20:39.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.793+0000 7fec1e8fc700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec180d0920 con 0x7fec181467c0 2023-10-18T12:20:39.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.793+0000 7fec1e8fc700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec18070320 con 0x7fec1806f9a0 2023-10-18T12:20:39.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.793+0000 7fec17fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fec181467c0 0x7fec180b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:39.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.793+0000 7fec17fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fec181467c0 0x7fec180b5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39776/0 (socket says 172.21.15.114:39776) 2023-10-18T12:20:39.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.793+0000 7fec17fff700 1 -- 172.21.15.114:0/902759683 learned_addr learned my addr 172.21.15.114:0/902759683 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:39.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.797+0000 7fec1ce99700 1 --2- 172.21.15.114:0/902759683 >> v2:172.21.15.172:3300/0 conn(0x7fec1806f9a0 0x7fec1806fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:39.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.797+0000 7fec17fff700 1 -- 172.21.15.114:0/902759683 >> v2:172.21.15.172:3300/0 conn(0x7fec1806f9a0 msgr2=0x7fec1806fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:39.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.797+0000 7fec17fff700 1 --2- 172.21.15.114:0/902759683 >> v2:172.21.15.172:3300/0 conn(0x7fec1806f9a0 0x7fec1806fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:39.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.797+0000 7fec17fff700 1 -- 172.21.15.114:0/902759683 >> v1:172.21.15.114:6789/0 conn(0x7fec181612e0 legacy=0x7fec1815d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:39.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.797+0000 7fec17fff700 1 -- 172.21.15.114:0/902759683 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec180b6160 con 0x7fec181467c0 2023-10-18T12:20:39.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.797+0000 7fec17fff700 1 --2- 172.21.15.114:0/902759683 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec181467c0 0x7fec180b5b80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fec180b81f0 tx=0x7fec08009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9d53e36b67da13e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:39.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.797+0000 7fec16ffd700 1 -- 172.21.15.114:0/902759683 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0800b8a0 con 0x7fec181467c0 2023-10-18T12:20:39.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.797+0000 7fec16ffd700 1 -- 172.21.15.114:0/902759683 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0800ba00 con 0x7fec181467c0 2023-10-18T12:20:39.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.797+0000 7fec16ffd700 1 -- 172.21.15.114:0/902759683 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0800bd90 con 0x7fec181467c0 2023-10-18T12:20:39.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.797+0000 7fec1e8fc700 1 -- 172.21.15.114:0/902759683 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec181467c0 msgr2=0x7fec180b5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:39.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.797+0000 7fec1e8fc700 1 --2- 172.21.15.114:0/902759683 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec181467c0 0x7fec180b5b80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fec180b81f0 tx=0x7fec08009bf0 comp rx=0 tx=0).stop 2023-10-18T12:20:39.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.797+0000 7fec1e8fc700 1 -- 172.21.15.114:0/902759683 shutdown_connections 2023-10-18T12:20:39.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.797+0000 7fec1e8fc700 1 --2- 172.21.15.114:0/902759683 >> v2:172.21.15.172:3300/0 conn(0x7fec1806f9a0 0x7fec1806fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:39.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.797+0000 7fec1e8fc700 1 --2- 172.21.15.114:0/902759683 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec181467c0 0x7fec180b5b80 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:39.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.797+0000 7fec1e8fc700 1 -- 172.21.15.114:0/902759683 >> 172.21.15.114:0/902759683 conn(0x7fec1806a130 msgr2=0x7fec1806a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:39.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.797+0000 7fec1e8fc700 1 -- 172.21.15.114:0/902759683 shutdown_connections 2023-10-18T12:20:39.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.797+0000 7fec1e8fc700 1 -- 172.21.15.114:0/902759683 wait complete. 2023-10-18T12:20:39.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.801+0000 7fec1e8fc700 1 Processor -- start 2023-10-18T12:20:39.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.801+0000 7fec1e8fc700 1 -- start start 2023-10-18T12:20:39.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.805+0000 7fec1e8fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec1806f9a0 0x7fec1813ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:39.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.805+0000 7fec1e8fc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec181467c0 0x7fec1808b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:39.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.805+0000 7fec1e8fc700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fec181612e0 0x7fec1808b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:39.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.805+0000 7fec1e8fc700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec181533f0 con 0x7fec1806f9a0 2023-10-18T12:20:39.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.805+0000 7fec1e8fc700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec18152820 con 0x7fec181467c0 2023-10-18T12:20:39.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.805+0000 7fec1e8fc700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec18152ac0 con 0x7fec181612e0 2023-10-18T12:20:39.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.805+0000 7fec17fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec1806f9a0 0x7fec1813ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:39.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.805+0000 7fec17fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec1806f9a0 0x7fec1813ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39782/0 (socket says 172.21.15.114:39782) 2023-10-18T12:20:39.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.805+0000 7fec17fff700 1 -- 172.21.15.114:0/1345807435 learned_addr learned my addr 172.21.15.114:0/1345807435 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:39.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.805+0000 7fec1ce99700 1 --2- 172.21.15.114:0/1345807435 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fec181612e0 0x7fec1808b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:39.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.805+0000 7fec177fe700 1 --2- 172.21.15.114:0/1345807435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec181467c0 0x7fec1808b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:39.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.805+0000 7fec17fff700 1 -- 172.21.15.114:0/1345807435 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fec181612e0 msgr2=0x7fec1808b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:39.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.805+0000 7fec17fff700 1 --2- 172.21.15.114:0/1345807435 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fec181612e0 0x7fec1808b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:39.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.805+0000 7fec17fff700 1 -- 172.21.15.114:0/1345807435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec181467c0 msgr2=0x7fec1808b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:39.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.805+0000 7fec17fff700 1 --2- 172.21.15.114:0/1345807435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec181467c0 0x7fec1808b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:39.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.805+0000 7fec17fff700 1 -- 172.21.15.114:0/1345807435 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec08009570 con 0x7fec1806f9a0 2023-10-18T12:20:39.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.805+0000 7fec1ce99700 1 --2- 172.21.15.114:0/1345807435 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fec181612e0 0x7fec1808b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:20:39.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.805+0000 7fec177fe700 1 --2- 172.21.15.114:0/1345807435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec181467c0 0x7fec1808b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:20:39.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.805+0000 7fec17fff700 1 --2- 172.21.15.114:0/1345807435 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec1806f9a0 0x7fec1813ec90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fec18070690 tx=0x7fec08004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:39.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.805+0000 7fec14ff9700 1 -- 172.21.15.114:0/1345807435 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec080038c0 con 0x7fec1806f9a0 2023-10-18T12:20:39.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.805+0000 7fec14ff9700 1 -- 172.21.15.114:0/1345807435 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0801f070 con 0x7fec1806f9a0 2023-10-18T12:20:39.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.805+0000 7fec1e8fc700 1 -- 172.21.15.114:0/1345807435 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec18152da0 con 0x7fec1806f9a0 2023-10-18T12:20:39.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.805+0000 7fec14ff9700 1 -- 172.21.15.114:0/1345807435 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec08003c60 con 0x7fec1806f9a0 2023-10-18T12:20:39.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.805+0000 7fec1e8fc700 1 -- 172.21.15.114:0/1345807435 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec1815e690 con 0x7fec1806f9a0 2023-10-18T12:20:39.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.809+0000 7fec1e8fc700 1 -- 172.21.15.114:0/1345807435 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec1808e260 con 0x7fec1806f9a0 2023-10-18T12:20:39.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.809+0000 7fec14ff9700 1 -- 172.21.15.114:0/1345807435 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fec08026480 con 0x7fec1806f9a0 2023-10-18T12:20:39.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.813+0000 7fec14ff9700 1 --2- 172.21.15.114:0/1345807435 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fec040656f0 0x7fec04067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:39.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.813+0000 7fec14ff9700 1 -- 172.21.15.114:0/1345807435 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fec08021070 con 0x7fec1806f9a0 2023-10-18T12:20:39.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.813+0000 7fec177fe700 1 --2- 172.21.15.114:0/1345807435 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fec040656f0 0x7fec04067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:39.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.813+0000 7fec177fe700 1 --2- 172.21.15.114:0/1345807435 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fec040656f0 0x7fec04067bb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fec181505c0 tx=0x7fec0c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:39.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.817+0000 7fec14ff9700 1 -- 172.21.15.114:0/1345807435 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fec080523f0 con 0x7fec1806f9a0 2023-10-18T12:20:40.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.997+0000 7fec1e8fc700 1 -- 172.21.15.114:0/1345807435 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fec18161770 con 0x7fec1806f9a0 2023-10-18T12:20:40.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:39.997+0000 7fec14ff9700 1 -- 172.21.15.114:0/1345807435 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7fec080150a0 con 0x7fec1806f9a0 2023-10-18T12:20:40.003 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 8 2023-10-18T12:20:40.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.001+0000 7fec1e8fc700 1 -- 172.21.15.114:0/1345807435 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fec040656f0 msgr2=0x7fec04067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:40.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.001+0000 7fec1e8fc700 1 --2- 172.21.15.114:0/1345807435 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fec040656f0 0x7fec04067bb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fec181505c0 tx=0x7fec0c009040 comp rx=0 tx=0).stop 2023-10-18T12:20:40.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.001+0000 7fec1e8fc700 1 -- 172.21.15.114:0/1345807435 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec1806f9a0 msgr2=0x7fec1813ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:40.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.001+0000 7fec1e8fc700 1 --2- 172.21.15.114:0/1345807435 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec1806f9a0 0x7fec1813ec90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fec18070690 tx=0x7fec08004770 comp rx=0 tx=0).stop 2023-10-18T12:20:40.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.005+0000 7fec1e8fc700 1 -- 172.21.15.114:0/1345807435 shutdown_connections 2023-10-18T12:20:40.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.005+0000 7fec1e8fc700 1 --2- 172.21.15.114:0/1345807435 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fec040656f0 0x7fec04067bb0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:40.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.005+0000 7fec1e8fc700 1 --2- 172.21.15.114:0/1345807435 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fec181612e0 0x7fec1808b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:40.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.005+0000 7fec1e8fc700 1 --2- 172.21.15.114:0/1345807435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec181467c0 0x7fec1808b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:40.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.005+0000 7fec1e8fc700 1 --2- 172.21.15.114:0/1345807435 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fec1806f9a0 0x7fec1813ec90 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:40.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.005+0000 7fec1e8fc700 1 -- 172.21.15.114:0/1345807435 >> 172.21.15.114:0/1345807435 conn(0x7fec1806a130 msgr2=0x7fec1806d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:40.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.005+0000 7fec1e8fc700 1 -- 172.21.15.114:0/1345807435 shutdown_connections 2023-10-18T12:20:40.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.005+0000 7fec1e8fc700 1 -- 172.21.15.114:0/1345807435 wait complete. 2023-10-18T12:20:40.030 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-18T12:20:40.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.209+0000 7f17b16a9700 1 Processor -- start 2023-10-18T12:20:40.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.209+0000 7f17b16a9700 1 -- start start 2023-10-18T12:20:40.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.209+0000 7f17b16a9700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17ac15adf0 0x7f17ac0cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:40.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.209+0000 7f17b16a9700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f17ac0cce10 0x7f17ac0b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:40.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.209+0000 7f17b16a9700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17ac15b1d0 con 0x7f17ac0b1e80 2023-10-18T12:20:40.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.209+0000 7f17b16a9700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17ac0ca590 con 0x7f17ac0cce10 2023-10-18T12:20:40.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.209+0000 7f17b16a9700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17ac0ce600 con 0x7f17ac15adf0 2023-10-18T12:20:40.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.213+0000 7f17a3fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f17ac0cce10 0x7f17ac0b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:40.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.213+0000 7f17a3fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f17ac0cce10 0x7f17ac0b1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39790/0 (socket says 172.21.15.114:39790) 2023-10-18T12:20:40.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.213+0000 7f17a3fff700 1 -- 172.21.15.114:0/4105654310 learned_addr learned my addr 172.21.15.114:0/4105654310 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:40.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.213+0000 7f17aaffd700 1 --2- 172.21.15.114:0/4105654310 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17ac15adf0 0x7f17ac0cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:40.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.213+0000 7f17a3fff700 1 -- 172.21.15.114:0/4105654310 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17ac15adf0 msgr2=0x7f17ac0cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:40.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.213+0000 7f17a3fff700 1 --2- 172.21.15.114:0/4105654310 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17ac15adf0 0x7f17ac0cc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:40.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.213+0000 7f17a3fff700 1 -- 172.21.15.114:0/4105654310 >> v1:172.21.15.172:6789/0 conn(0x7f17ac0b1e80 legacy=0x7f17ac0b2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:40.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.213+0000 7f17a3fff700 1 -- 172.21.15.114:0/4105654310 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17ac0cd580 con 0x7f17ac0cce10 2023-10-18T12:20:40.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.213+0000 7f17a3fff700 1 --2- 172.21.15.114:0/4105654310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17ac0cce10 0x7f17ac0b1940 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1794009910 tx=0x7f1794009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7322e260a1ee8fbd server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:40.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.213+0000 7f17aa7fc700 1 -- 172.21.15.114:0/4105654310 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179400ba60 con 0x7f17ac0cce10 2023-10-18T12:20:40.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.213+0000 7f17aa7fc700 1 -- 172.21.15.114:0/4105654310 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f179400bbc0 con 0x7f17ac0cce10 2023-10-18T12:20:40.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.213+0000 7f17aa7fc700 1 -- 172.21.15.114:0/4105654310 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1794009e60 con 0x7f17ac0cce10 2023-10-18T12:20:40.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.213+0000 7f17b16a9700 1 -- 172.21.15.114:0/4105654310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17ac0cce10 msgr2=0x7f17ac0b1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:40.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.213+0000 7f17b16a9700 1 --2- 172.21.15.114:0/4105654310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17ac0cce10 0x7f17ac0b1940 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1794009910 tx=0x7f1794009c20 comp rx=0 tx=0).stop 2023-10-18T12:20:40.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.213+0000 7f17b16a9700 1 -- 172.21.15.114:0/4105654310 shutdown_connections 2023-10-18T12:20:40.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.213+0000 7f17b16a9700 1 --2- 172.21.15.114:0/4105654310 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17ac0cce10 0x7f17ac0b1940 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:40.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.213+0000 7f17b16a9700 1 --2- 172.21.15.114:0/4105654310 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17ac15adf0 0x7f17ac0cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:40.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.213+0000 7f17b16a9700 1 -- 172.21.15.114:0/4105654310 >> 172.21.15.114:0/4105654310 conn(0x7f17ac0ce820 msgr2=0x7f17ac0cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:40.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.213+0000 7f17b16a9700 1 -- 172.21.15.114:0/4105654310 shutdown_connections 2023-10-18T12:20:40.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.217+0000 7f17b16a9700 1 -- 172.21.15.114:0/4105654310 wait complete. 2023-10-18T12:20:40.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.217+0000 7f17b16a9700 1 Processor -- start 2023-10-18T12:20:40.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.217+0000 7f17b16a9700 1 -- start start 2023-10-18T12:20:40.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.221+0000 7f17b16a9700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17ac0b1e80 0x7f17ac15dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:40.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.221+0000 7f17b16a9700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17ac0cce10 0x7f17ac14eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:40.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.221+0000 7f17b16a9700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17ac15adf0 0x7f17ac14dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:40.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.221+0000 7f17b16a9700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ac0c70b0 con 0x7f17ac15adf0 2023-10-18T12:20:40.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.221+0000 7f17b16a9700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ac153010 con 0x7f17ac0b1e80 2023-10-18T12:20:40.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.221+0000 7f17b16a9700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17ac152d30 con 0x7f17ac0cce10 2023-10-18T12:20:40.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.221+0000 7f17ab7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17ac15adf0 0x7f17ac14dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:40.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.221+0000 7f17aaffd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17ac0b1e80 0x7f17ac15dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:40.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.221+0000 7f17aaffd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17ac0b1e80 0x7f17ac15dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:36540/0 (socket says 172.21.15.114:36540) 2023-10-18T12:20:40.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.221+0000 7f17ab7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17ac15adf0 0x7f17ac14dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39796/0 (socket says 172.21.15.114:39796) 2023-10-18T12:20:40.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.221+0000 7f17aaffd700 1 -- 172.21.15.114:0/3568501418 learned_addr learned my addr 172.21.15.114:0/3568501418 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:40.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.221+0000 7f17a3fff700 1 --2- 172.21.15.114:0/3568501418 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17ac0cce10 0x7f17ac14eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:40.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.221+0000 7f17aaffd700 1 -- 172.21.15.114:0/3568501418 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17ac0cce10 msgr2=0x7f17ac14eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:40.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.221+0000 7f17aaffd700 1 --2- 172.21.15.114:0/3568501418 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17ac0cce10 0x7f17ac14eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:40.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.221+0000 7f17aaffd700 1 -- 172.21.15.114:0/3568501418 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17ac15adf0 msgr2=0x7f17ac14dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:40.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.221+0000 7f17aaffd700 1 --2- 172.21.15.114:0/3568501418 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17ac15adf0 0x7f17ac14dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:40.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.221+0000 7f17aaffd700 1 -- 172.21.15.114:0/3568501418 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1794009570 con 0x7f17ac0b1e80 2023-10-18T12:20:40.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.221+0000 7f17a3fff700 1 --2- 172.21.15.114:0/3568501418 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17ac0cce10 0x7f17ac14eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:20:40.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.221+0000 7f17ab7fe700 1 --2- 172.21.15.114:0/3568501418 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17ac15adf0 0x7f17ac14dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:20:40.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.221+0000 7f17aaffd700 1 --2- 172.21.15.114:0/3568501418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17ac0b1e80 0x7f17ac15dbf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f179c00d800 tx=0x7f179c00db10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:40.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.221+0000 7f17a37fe700 1 -- 172.21.15.114:0/3568501418 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179c0125f0 con 0x7f17ac0b1e80 2023-10-18T12:20:40.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.221+0000 7f17a37fe700 1 -- 172.21.15.114:0/3568501418 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f179c012750 con 0x7f17ac0b1e80 2023-10-18T12:20:40.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.221+0000 7f17a37fe700 1 -- 172.21.15.114:0/3568501418 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179c012ac0 con 0x7f17ac0b1e80 2023-10-18T12:20:40.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.221+0000 7f17b16a9700 1 -- 172.21.15.114:0/3568501418 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17ac0c72e0 con 0x7f17ac0b1e80 2023-10-18T12:20:40.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.225+0000 7f17b16a9700 1 -- 172.21.15.114:0/3568501418 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17ac0c78a0 con 0x7f17ac0b1e80 2023-10-18T12:20:40.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.225+0000 7f17b16a9700 1 -- 172.21.15.114:0/3568501418 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17ac0c7a90 con 0x7f17ac0b1e80 2023-10-18T12:20:40.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.225+0000 7f17a37fe700 1 -- 172.21.15.114:0/3568501418 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f179c012c20 con 0x7f17ac0b1e80 2023-10-18T12:20:40.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.229+0000 7f17a37fe700 1 --2- 172.21.15.114:0/3568501418 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f178c0656f0 0x7f178c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:40.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.229+0000 7f17a37fe700 1 -- 172.21.15.114:0/3568501418 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f179c0831a0 con 0x7f17ac0b1e80 2023-10-18T12:20:40.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.229+0000 7f17a3fff700 1 --2- 172.21.15.114:0/3568501418 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f178c0656f0 0x7f178c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:40.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.229+0000 7f17a3fff700 1 --2- 172.21.15.114:0/3568501418 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f178c0656f0 0x7f178c067bb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1794000c00 tx=0x7f1794008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:40.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.237+0000 7f17a37fe700 1 -- 172.21.15.114:0/3568501418 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f179c050950 con 0x7f17ac0b1e80 2023-10-18T12:20:40.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.421+0000 7f17b16a9700 1 -- 172.21.15.114:0/3568501418 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f17ac072e60 con 0x7f17ac0b1e80 2023-10-18T12:20:40.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.425+0000 7f17a37fe700 1 -- 172.21.15.114:0/3568501418 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f179c053f70 con 0x7f17ac0b1e80 2023-10-18T12:20:40.428 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-10-18T12:20:40.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.429+0000 7f17b16a9700 1 -- 172.21.15.114:0/3568501418 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f178c0656f0 msgr2=0x7f178c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:40.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.429+0000 7f17b16a9700 1 --2- 172.21.15.114:0/3568501418 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f178c0656f0 0x7f178c067bb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1794000c00 tx=0x7f1794008030 comp rx=0 tx=0).stop 2023-10-18T12:20:40.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.429+0000 7f17b16a9700 1 -- 172.21.15.114:0/3568501418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17ac0b1e80 msgr2=0x7f17ac15dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:40.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.429+0000 7f17b16a9700 1 --2- 172.21.15.114:0/3568501418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17ac0b1e80 0x7f17ac15dbf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f179c00d800 tx=0x7f179c00db10 comp rx=0 tx=0).stop 2023-10-18T12:20:40.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.429+0000 7f17b16a9700 1 -- 172.21.15.114:0/3568501418 shutdown_connections 2023-10-18T12:20:40.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.429+0000 7f17b16a9700 1 --2- 172.21.15.114:0/3568501418 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f178c0656f0 0x7f178c067bb0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:40.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.429+0000 7f17b16a9700 1 --2- 172.21.15.114:0/3568501418 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f17ac0cce10 0x7f17ac14eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:40.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.429+0000 7f17b16a9700 1 --2- 172.21.15.114:0/3568501418 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17ac15adf0 0x7f17ac14dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:40.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.429+0000 7f17b16a9700 1 --2- 172.21.15.114:0/3568501418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f17ac0b1e80 0x7f17ac15dbf0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:40.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.429+0000 7f17b16a9700 1 -- 172.21.15.114:0/3568501418 >> 172.21.15.114:0/3568501418 conn(0x7f17ac0ce820 msgr2=0x7f17ac15a120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:40.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.429+0000 7f17b16a9700 1 -- 172.21.15.114:0/3568501418 shutdown_connections 2023-10-18T12:20:40.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.429+0000 7f17b16a9700 1 -- 172.21.15.114:0/3568501418 wait complete. 2023-10-18T12:20:40.459 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-18T12:20:40.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.633+0000 7f4ffb30c700 1 Processor -- start 2023-10-18T12:20:40.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.633+0000 7f4ffb30c700 1 -- start start 2023-10-18T12:20:40.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.633+0000 7f4ffb30c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4ff40b3d40 0x7f4ff40cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:40.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.637+0000 7f4ffb30c700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ff40ca4c0 con 0x7f4ff4164a20 2023-10-18T12:20:40.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.637+0000 7f4ffb30c700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ff40ca7a0 con 0x7f4ff406ce20 2023-10-18T12:20:40.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.637+0000 7f4ffb30c700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ff406e2d0 con 0x7f4ff40b3d40 2023-10-18T12:20:40.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.637+0000 7f4ff9b09700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f4ff4164a20 0x7f4ff40c9cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56070/0 (socket says 172.21.15.114:56070) 2023-10-18T12:20:40.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.637+0000 7f4ff9b09700 1 -- 172.21.15.114:0/3553448851 learned_addr learned my addr 172.21.15.114:0/3553448851 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:40.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.637+0000 7f4ffa30a700 1 --2- 172.21.15.114:0/3553448851 >> v2:172.21.15.172:3300/0 conn(0x7f4ff40b3d40 0x7f4ff40cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:40.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.637+0000 7f4ff9308700 1 -- 172.21.15.114:0/3553448851 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 66014275 0 0) 0x7f4ff40ca4c0 con 0x7f4ff4164a20 2023-10-18T12:20:40.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.637+0000 7f4ff9308700 1 -- 172.21.15.114:0/3553448851 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fe00035d0 con 0x7f4ff4164a20 2023-10-18T12:20:40.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.637+0000 7f4ffa30a700 1 -- 172.21.15.114:0/3553448851 >> v1:172.21.15.172:6789/0 conn(0x7f4ff406ce20 legacy=0x7f4ff406f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:40.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.637+0000 7f4ff9308700 1 -- 172.21.15.114:0/3553448851 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3946012789 0 0) 0x7f4fe00035d0 con 0x7f4ff4164a20 2023-10-18T12:20:40.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.637+0000 7f4ffa30a700 1 -- 172.21.15.114:0/3553448851 >> v1:172.21.15.114:6789/0 conn(0x7f4ff4164a20 legacy=0x7f4ff40c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:40.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.637+0000 7f4ffa30a700 1 -- 172.21.15.114:0/3553448851 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff40caa80 con 0x7f4ff40b3d40 2023-10-18T12:20:40.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.637+0000 7f4ffa30a700 1 --2- 172.21.15.114:0/3553448851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ff40b3d40 0x7f4ff40cc190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0009850 tx=0x7f4ff0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82e02ae78ac32f35 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:40.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.637+0000 7f4ff9308700 1 -- 172.21.15.114:0/3553448851 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe4001670 con 0x7f4ff40b3d40 2023-10-18T12:20:40.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.637+0000 7f4ff9308700 1 -- 172.21.15.114:0/3553448851 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff0004030 con 0x7f4ff40b3d40 2023-10-18T12:20:40.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.637+0000 7f4ff9308700 1 -- 172.21.15.114:0/3553448851 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff00043c0 con 0x7f4ff40b3d40 2023-10-18T12:20:40.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.641+0000 7f4ffb30c700 1 -- 172.21.15.114:0/3553448851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ff40b3d40 msgr2=0x7f4ff40cc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:40.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.641+0000 7f4ffb30c700 1 --2- 172.21.15.114:0/3553448851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ff40b3d40 0x7f4ff40cc190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0009850 tx=0x7f4ff0009b60 comp rx=0 tx=0).stop 2023-10-18T12:20:40.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.641+0000 7f4ffb30c700 1 -- 172.21.15.114:0/3553448851 shutdown_connections 2023-10-18T12:20:40.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.641+0000 7f4ffb30c700 1 --2- 172.21.15.114:0/3553448851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ff40b3d40 0x7f4ff40cc190 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:40.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.641+0000 7f4ffb30c700 1 -- 172.21.15.114:0/3553448851 >> 172.21.15.114:0/3553448851 conn(0x7f4ff40ce5c0 msgr2=0x7f4ff40ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:40.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.641+0000 7f4ffb30c700 1 -- 172.21.15.114:0/3553448851 shutdown_connections 2023-10-18T12:20:40.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.641+0000 7f4ffb30c700 1 -- 172.21.15.114:0/3553448851 wait complete. 2023-10-18T12:20:40.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.641+0000 7f4ffb30c700 1 Processor -- start 2023-10-18T12:20:40.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.641+0000 7f4ffb30c700 1 -- start start 2023-10-18T12:20:40.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.641+0000 7f4ffb30c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4ff406ce20 0x7f4ff4157970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:40.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.641+0000 7f4ffb30c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ff40b3d40 0x7f4ff40b1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:40.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.645+0000 7f4ffb30c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ff4164a20 0x7f4ff40c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:40.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.645+0000 7f4ffb30c700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff41f9a70 con 0x7f4ff4164a20 2023-10-18T12:20:40.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.645+0000 7f4ffb30c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff41f9cc0 con 0x7f4ff40b3d40 2023-10-18T12:20:40.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.645+0000 7f4ffb30c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff41f9fa0 con 0x7f4ff406ce20 2023-10-18T12:20:40.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.645+0000 7f4ffab0b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ff4164a20 0x7f4ff40c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:40.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.645+0000 7f4ffab0b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ff4164a20 0x7f4ff40c7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39806/0 (socket says 172.21.15.114:39806) 2023-10-18T12:20:40.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.645+0000 7f4ffab0b700 1 -- 172.21.15.114:0/4168275062 learned_addr learned my addr 172.21.15.114:0/4168275062 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:40.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.645+0000 7f4ff9b09700 1 --2- 172.21.15.114:0/4168275062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ff40b3d40 0x7f4ff40b1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:40.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.645+0000 7f4ffa30a700 1 --2- 172.21.15.114:0/4168275062 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4ff406ce20 0x7f4ff4157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:40.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.645+0000 7f4ffab0b700 1 -- 172.21.15.114:0/4168275062 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4ff406ce20 msgr2=0x7f4ff4157970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:40.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.645+0000 7f4ffab0b700 1 --2- 172.21.15.114:0/4168275062 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4ff406ce20 0x7f4ff4157970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:40.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.645+0000 7f4ffab0b700 1 -- 172.21.15.114:0/4168275062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ff40b3d40 msgr2=0x7f4ff40b1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:40.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.645+0000 7f4ffab0b700 1 --2- 172.21.15.114:0/4168275062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ff40b3d40 0x7f4ff40b1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:40.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.645+0000 7f4ffab0b700 1 -- 172.21.15.114:0/4168275062 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff00094b0 con 0x7f4ff4164a20 2023-10-18T12:20:40.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.645+0000 7f4ff9b09700 1 --2- 172.21.15.114:0/4168275062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ff40b3d40 0x7f4ff40b1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:40.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.645+0000 7f4ffab0b700 1 --2- 172.21.15.114:0/4168275062 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ff4164a20 0x7f4ff40c7b90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4fec00cc50 tx=0x7f4fec00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:40.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.645+0000 7f4feaffd700 1 -- 172.21.15.114:0/4168275062 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fec003c20 con 0x7f4ff4164a20 2023-10-18T12:20:40.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.645+0000 7f4ffb30c700 1 -- 172.21.15.114:0/4168275062 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ff41fa280 con 0x7f4ff4164a20 2023-10-18T12:20:40.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.645+0000 7f4feaffd700 1 -- 172.21.15.114:0/4168275062 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fec003d80 con 0x7f4ff4164a20 2023-10-18T12:20:40.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.645+0000 7f4feaffd700 1 -- 172.21.15.114:0/4168275062 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fec00ab60 con 0x7f4ff4164a20 2023-10-18T12:20:40.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.645+0000 7f4ffb30c700 1 -- 172.21.15.114:0/4168275062 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ff4157eb0 con 0x7f4ff4164a20 2023-10-18T12:20:40.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.649+0000 7f4ffb30c700 1 -- 172.21.15.114:0/4168275062 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ff41591f0 con 0x7f4ff4164a20 2023-10-18T12:20:40.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.649+0000 7f4feaffd700 1 -- 172.21.15.114:0/4168275062 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f4fec00acc0 con 0x7f4ff4164a20 2023-10-18T12:20:40.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.649+0000 7f4feaffd700 1 --2- 172.21.15.114:0/4168275062 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4fd80656f0 0x7f4fd8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:40.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.653+0000 7f4feaffd700 1 -- 172.21.15.114:0/4168275062 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4fec0831d0 con 0x7f4ff4164a20 2023-10-18T12:20:40.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.653+0000 7f4ffa30a700 1 --2- 172.21.15.114:0/4168275062 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4fd80656f0 0x7f4fd8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:40.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.653+0000 7f4ffa30a700 1 --2- 172.21.15.114:0/4168275062 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4fd80656f0 0x7f4fd8067bb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4ff00090b0 tx=0x7f4ff0008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:40.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.657+0000 7f4feaffd700 1 -- 172.21.15.114:0/4168275062 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f4fec0508d0 con 0x7f4ff4164a20 2023-10-18T12:20:40.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.829+0000 7f4ffb30c700 1 -- 172.21.15.114:0/4168275062 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4ff404e910 con 0x7f4ff4164a20 2023-10-18T12:20:40.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.833+0000 7f4feaffd700 1 -- 172.21.15.114:0/4168275062 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4fec053ef0 con 0x7f4ff4164a20 2023-10-18T12:20:40.837 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-10-18T12:20:40.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.833+0000 7f4ffb30c700 1 -- 172.21.15.114:0/4168275062 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4fd80656f0 msgr2=0x7f4fd8067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:40.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.833+0000 7f4ffb30c700 1 --2- 172.21.15.114:0/4168275062 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4fd80656f0 0x7f4fd8067bb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4ff00090b0 tx=0x7f4ff0008030 comp rx=0 tx=0).stop 2023-10-18T12:20:40.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.833+0000 7f4ffb30c700 1 -- 172.21.15.114:0/4168275062 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ff4164a20 msgr2=0x7f4ff40c7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:40.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.833+0000 7f4ffb30c700 1 --2- 172.21.15.114:0/4168275062 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ff4164a20 0x7f4ff40c7b90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4fec00cc50 tx=0x7f4fec00cf60 comp rx=0 tx=0).stop 2023-10-18T12:20:40.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.833+0000 7f4ffb30c700 1 -- 172.21.15.114:0/4168275062 shutdown_connections 2023-10-18T12:20:40.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.833+0000 7f4ffb30c700 1 --2- 172.21.15.114:0/4168275062 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4fd80656f0 0x7f4fd8067bb0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:40.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.833+0000 7f4ffb30c700 1 --2- 172.21.15.114:0/4168275062 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4ff4164a20 0x7f4ff40c7b90 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:40.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.833+0000 7f4ffb30c700 1 --2- 172.21.15.114:0/4168275062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ff40b3d40 0x7f4ff40b1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:40.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.833+0000 7f4ffb30c700 1 --2- 172.21.15.114:0/4168275062 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4ff406ce20 0x7f4ff4157970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:40.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.833+0000 7f4ffb30c700 1 -- 172.21.15.114:0/4168275062 >> 172.21.15.114:0/4168275062 conn(0x7f4ff40ce5c0 msgr2=0x7f4ff4160620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:40.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.833+0000 7f4ffb30c700 1 -- 172.21.15.114:0/4168275062 shutdown_connections 2023-10-18T12:20:40.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:40.837+0000 7f4ffb30c700 1 -- 172.21.15.114:0/4168275062 wait complete. 2023-10-18T12:20:40.861 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-18T12:20:41.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.029+0000 7f143add2700 1 Processor -- start 2023-10-18T12:20:41.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.029+0000 7f143add2700 1 -- start start 2023-10-18T12:20:41.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.033+0000 7f143add2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14340b5ae0 0x7f14340b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:41.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.033+0000 7f143add2700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f143415d0d0 con 0x7f14340d2e00 2023-10-18T12:20:41.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.033+0000 7f143add2700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f143406f0f0 con 0x7f1434160710 2023-10-18T12:20:41.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.033+0000 7f143add2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f143415df90 con 0x7f14340b5ae0 2023-10-18T12:20:41.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.033+0000 7f1439dd0700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f14340d2e00 0x7f14340d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56076/0 (socket says 172.21.15.114:56076) 2023-10-18T12:20:41.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.033+0000 7f1439dd0700 1 -- 172.21.15.114:0/214214849 learned_addr learned my addr 172.21.15.114:0/214214849 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:41.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.033+0000 7f143a5d1700 1 --2- 172.21.15.114:0/214214849 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14340b5ae0 0x7f14340b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:41.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.033+0000 7f1438dce700 1 -- 172.21.15.114:0/214214849 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3100531982 0 0) 0x7f1430001110 con 0x7f14340d2e00 2023-10-18T12:20:41.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.033+0000 7f1438dce700 1 -- 172.21.15.114:0/214214849 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14200035d0 con 0x7f14340d2e00 2023-10-18T12:20:41.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.033+0000 7f143a5d1700 1 -- 172.21.15.114:0/214214849 >> v1:172.21.15.172:6789/0 conn(0x7f1434160710 legacy=0x7f143406db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:41.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.033+0000 7f143a5d1700 1 -- 172.21.15.114:0/214214849 >> v1:172.21.15.114:6789/0 conn(0x7f14340d2e00 legacy=0x7f14340d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:41.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.033+0000 7f1438dce700 1 -- 172.21.15.114:0/214214849 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3088642208 0 0) 0x7f143406f0f0 con 0x7f1434160710 2023-10-18T12:20:41.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.033+0000 7f143a5d1700 1 -- 172.21.15.114:0/214214849 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f143415d310 con 0x7f14340b5ae0 2023-10-18T12:20:41.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.033+0000 7f143a5d1700 1 --2- 172.21.15.114:0/214214849 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14340b5ae0 0x7f14340b6e00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f142c009dc0 tx=0x7f142c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bed8f1602e4b14 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:41.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.037+0000 7f1438dce700 1 -- 172.21.15.114:0/214214849 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c00e070 con 0x7f14340b5ae0 2023-10-18T12:20:41.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.037+0000 7f1438dce700 1 -- 172.21.15.114:0/214214849 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142c00bb20 con 0x7f14340b5ae0 2023-10-18T12:20:41.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.037+0000 7f1438dce700 1 -- 172.21.15.114:0/214214849 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c00bed0 con 0x7f14340b5ae0 2023-10-18T12:20:41.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.037+0000 7f143add2700 1 -- 172.21.15.114:0/214214849 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14340b5ae0 msgr2=0x7f14340b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:41.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.037+0000 7f143add2700 1 --2- 172.21.15.114:0/214214849 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14340b5ae0 0x7f14340b6e00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f142c009dc0 tx=0x7f142c00b330 comp rx=0 tx=0).stop 2023-10-18T12:20:41.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.037+0000 7f143add2700 1 -- 172.21.15.114:0/214214849 shutdown_connections 2023-10-18T12:20:41.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.037+0000 7f143add2700 1 --2- 172.21.15.114:0/214214849 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14340b5ae0 0x7f14340b6e00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:41.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.037+0000 7f143add2700 1 -- 172.21.15.114:0/214214849 >> 172.21.15.114:0/214214849 conn(0x7f1434069f20 msgr2=0x7f143406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:41.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.037+0000 7f143add2700 1 -- 172.21.15.114:0/214214849 shutdown_connections 2023-10-18T12:20:41.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.037+0000 7f143add2700 1 -- 172.21.15.114:0/214214849 wait complete. 2023-10-18T12:20:41.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.037+0000 7f143add2700 1 Processor -- start 2023-10-18T12:20:41.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.037+0000 7f143add2700 1 -- start start 2023-10-18T12:20:41.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.041+0000 7f143add2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14340b5ae0 0x7f14340afed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:41.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.041+0000 7f143add2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14340d2e00 0x7f14341f2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:41.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.041+0000 7f143add2700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1434160710 0x7f14340b3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:41.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.041+0000 7f143add2700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14340b0410 con 0x7f1434160710 2023-10-18T12:20:41.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.041+0000 7f143add2700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14341f2bb0 con 0x7f14340b5ae0 2023-10-18T12:20:41.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.041+0000 7f143add2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14341f2e90 con 0x7f14340d2e00 2023-10-18T12:20:41.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.041+0000 7f143a5d1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1434160710 0x7f14340b3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:41.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.041+0000 7f143a5d1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1434160710 0x7f14340b3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39810/0 (socket says 172.21.15.114:39810) 2023-10-18T12:20:41.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.041+0000 7f143a5d1700 1 -- 172.21.15.114:0/3095709720 learned_addr learned my addr 172.21.15.114:0/3095709720 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:41.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.041+0000 7f14395cf700 1 --2- 172.21.15.114:0/3095709720 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14340d2e00 0x7f14341f2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:41.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.041+0000 7f1439dd0700 1 --2- 172.21.15.114:0/3095709720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14340b5ae0 0x7f14340afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:41.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.041+0000 7f143a5d1700 1 -- 172.21.15.114:0/3095709720 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14340d2e00 msgr2=0x7f14341f2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:41.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.041+0000 7f143a5d1700 1 --2- 172.21.15.114:0/3095709720 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14340d2e00 0x7f14341f2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:41.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.041+0000 7f143a5d1700 1 -- 172.21.15.114:0/3095709720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14340b5ae0 msgr2=0x7f14340afed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:41.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.041+0000 7f143a5d1700 1 --2- 172.21.15.114:0/3095709720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14340b5ae0 0x7f14340afed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:41.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.041+0000 7f143a5d1700 1 -- 172.21.15.114:0/3095709720 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f142c009a70 con 0x7f1434160710 2023-10-18T12:20:41.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.041+0000 7f143a5d1700 1 --2- 172.21.15.114:0/3095709720 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1434160710 0x7f14340b3920 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f142c009f30 tx=0x7f142c004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:41.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.041+0000 7f142a7fc700 1 -- 172.21.15.114:0/3095709720 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c01b8d0 con 0x7f1434160710 2023-10-18T12:20:41.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.041+0000 7f142a7fc700 1 -- 172.21.15.114:0/3095709720 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142c020070 con 0x7f1434160710 2023-10-18T12:20:41.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.041+0000 7f143add2700 1 -- 172.21.15.114:0/3095709720 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14341f3170 con 0x7f1434160710 2023-10-18T12:20:41.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.041+0000 7f142a7fc700 1 -- 172.21.15.114:0/3095709720 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c01bc50 con 0x7f1434160710 2023-10-18T12:20:41.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.041+0000 7f143add2700 1 -- 172.21.15.114:0/3095709720 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14341f3730 con 0x7f1434160710 2023-10-18T12:20:41.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.045+0000 7f143add2700 1 -- 172.21.15.114:0/3095709720 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14341f3920 con 0x7f1434160710 2023-10-18T12:20:41.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.045+0000 7f142a7fc700 1 -- 172.21.15.114:0/3095709720 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f142c01c400 con 0x7f1434160710 2023-10-18T12:20:41.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.045+0000 7f142a7fc700 1 --2- 172.21.15.114:0/3095709720 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1418065720 0x7f1418067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:41.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.045+0000 7f142a7fc700 1 -- 172.21.15.114:0/3095709720 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f142c022070 con 0x7f1434160710 2023-10-18T12:20:41.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.045+0000 7f1439dd0700 1 --2- 172.21.15.114:0/3095709720 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1418065720 0x7f1418067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:41.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.049+0000 7f1439dd0700 1 --2- 172.21.15.114:0/3095709720 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1418065720 0x7f1418067be0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1430005930 tx=0x7f1430009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:41.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.053+0000 7f142a7fc700 1 -- 172.21.15.114:0/3095709720 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f142c052e00 con 0x7f1434160710 2023-10-18T12:20:41.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.229+0000 7f143add2700 1 -- 172.21.15.114:0/3095709720 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f143404e910 con 0x7f1434160710 2023-10-18T12:20:41.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.229+0000 7f142a7fc700 1 -- 172.21.15.114:0/3095709720 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f142c01bdb0 con 0x7f1434160710 2023-10-18T12:20:41.235 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-10-18T12:20:41.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.237+0000 7f143add2700 1 -- 172.21.15.114:0/3095709720 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1418065720 msgr2=0x7f1418067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:41.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.237+0000 7f143add2700 1 --2- 172.21.15.114:0/3095709720 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1418065720 0x7f1418067be0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1430005930 tx=0x7f1430009040 comp rx=0 tx=0).stop 2023-10-18T12:20:41.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.237+0000 7f143add2700 1 -- 172.21.15.114:0/3095709720 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1434160710 msgr2=0x7f14340b3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:41.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.237+0000 7f143add2700 1 --2- 172.21.15.114:0/3095709720 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1434160710 0x7f14340b3920 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f142c009f30 tx=0x7f142c004b40 comp rx=0 tx=0).stop 2023-10-18T12:20:41.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.237+0000 7f143add2700 1 -- 172.21.15.114:0/3095709720 shutdown_connections 2023-10-18T12:20:41.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.237+0000 7f143add2700 1 --2- 172.21.15.114:0/3095709720 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1418065720 0x7f1418067be0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:41.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.237+0000 7f143add2700 1 --2- 172.21.15.114:0/3095709720 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14340d2e00 0x7f14341f2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:41.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.237+0000 7f143add2700 1 --2- 172.21.15.114:0/3095709720 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1434160710 0x7f14340b3920 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:41.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.237+0000 7f143add2700 1 --2- 172.21.15.114:0/3095709720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14340b5ae0 0x7f14340afed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:41.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.237+0000 7f143add2700 1 -- 172.21.15.114:0/3095709720 >> 172.21.15.114:0/3095709720 conn(0x7f1434069f20 msgr2=0x7f14340b62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:41.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.237+0000 7f143add2700 1 -- 172.21.15.114:0/3095709720 shutdown_connections 2023-10-18T12:20:41.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.237+0000 7f143add2700 1 -- 172.21.15.114:0/3095709720 wait complete. 2023-10-18T12:20:41.263 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-18T12:20:41.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.440+0000 7f7bf8861700 1 Processor -- start 2023-10-18T12:20:41.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.440+0000 7f7bf8861700 1 -- start start 2023-10-18T12:20:41.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.440+0000 7f7bf8861700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7bf4160710 0x7f7bf40b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:41.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.440+0000 7f7bf8861700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7bf40b5ae0 0x7f7bf406db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:41.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.440+0000 7f7bf8861700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bf415d0d0 con 0x7f7bf40d2e00 2023-10-18T12:20:41.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.440+0000 7f7bf8861700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bf415df90 con 0x7f7bf4160710 2023-10-18T12:20:41.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.440+0000 7f7bf8861700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf406f0f0 con 0x7f7bf40b5ae0 2023-10-18T12:20:41.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.440+0000 7f7bf259c700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7bf4160710 0x7f7bf40b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:41.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.440+0000 7f7bf259c700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7bf4160710 0x7f7bf40b6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39812/0 (socket says 172.21.15.114:39812) 2023-10-18T12:20:41.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.440+0000 7f7bf259c700 1 -- 172.21.15.114:0/2669816410 learned_addr learned my addr 172.21.15.114:0/2669816410 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:41.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.440+0000 7f7bf359e700 1 --2- 172.21.15.114:0/2669816410 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7bf40b5ae0 0x7f7bf406db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:41.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.444+0000 7f7bf259c700 1 -- 172.21.15.114:0/2669816410 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7bf40b5ae0 msgr2=0x7f7bf406db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:41.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.444+0000 7f7bf259c700 1 --2- 172.21.15.114:0/2669816410 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7bf40b5ae0 0x7f7bf406db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:41.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.444+0000 7f7bf259c700 1 -- 172.21.15.114:0/2669816410 >> v1:172.21.15.172:6789/0 conn(0x7f7bf40d2e00 legacy=0x7f7bf40d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:41.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.444+0000 7f7bf259c700 1 -- 172.21.15.114:0/2669816410 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf415d310 con 0x7f7bf4160710 2023-10-18T12:20:41.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.444+0000 7f7bf259c700 1 --2- 172.21.15.114:0/2669816410 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bf4160710 0x7f7bf40b6e00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7be8009910 tx=0x7f7be8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0f08f8b9f009319 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:41.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.444+0000 7f7bf1d9b700 1 -- 172.21.15.114:0/2669816410 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be8011830 con 0x7f7bf4160710 2023-10-18T12:20:41.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.444+0000 7f7bf1d9b700 1 -- 172.21.15.114:0/2669816410 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be8011990 con 0x7f7bf4160710 2023-10-18T12:20:41.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.444+0000 7f7bf1d9b700 1 -- 172.21.15.114:0/2669816410 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be8011d40 con 0x7f7bf4160710 2023-10-18T12:20:41.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.444+0000 7f7bf8861700 1 -- 172.21.15.114:0/2669816410 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bf4160710 msgr2=0x7f7bf40b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:41.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.444+0000 7f7bf8861700 1 --2- 172.21.15.114:0/2669816410 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bf4160710 0x7f7bf40b6e00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7be8009910 tx=0x7f7be8009c20 comp rx=0 tx=0).stop 2023-10-18T12:20:41.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.444+0000 7f7bf8861700 1 -- 172.21.15.114:0/2669816410 shutdown_connections 2023-10-18T12:20:41.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.444+0000 7f7bf8861700 1 --2- 172.21.15.114:0/2669816410 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7bf40b5ae0 0x7f7bf406db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:41.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.444+0000 7f7bf8861700 1 --2- 172.21.15.114:0/2669816410 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bf4160710 0x7f7bf40b6e00 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:41.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.444+0000 7f7bf8861700 1 -- 172.21.15.114:0/2669816410 >> 172.21.15.114:0/2669816410 conn(0x7f7bf4069f20 msgr2=0x7f7bf406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:41.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.444+0000 7f7bf8861700 1 -- 172.21.15.114:0/2669816410 shutdown_connections 2023-10-18T12:20:41.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.444+0000 7f7bf8861700 1 -- 172.21.15.114:0/2669816410 wait complete. 2023-10-18T12:20:41.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.448+0000 7f7bf8861700 1 Processor -- start 2023-10-18T12:20:41.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.448+0000 7f7bf8861700 1 -- start start 2023-10-18T12:20:41.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.452+0000 7f7bf8861700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bf40b5ae0 0x7f7bf40b0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:41.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.452+0000 7f7bf8861700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7bf40d2e00 0x7f7bf41500b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:41.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.452+0000 7f7bf8861700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bf4160710 0x7f7bf41505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:41.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.452+0000 7f7bf8861700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf414b390 con 0x7f7bf40b5ae0 2023-10-18T12:20:41.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.452+0000 7f7bf8861700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf40ad450 con 0x7f7bf4160710 2023-10-18T12:20:41.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.452+0000 7f7bf8861700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf40ad170 con 0x7f7bf40d2e00 2023-10-18T12:20:41.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.452+0000 7f7bf2d9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bf40b5ae0 0x7f7bf40b0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:41.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.452+0000 7f7bf2d9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bf40b5ae0 0x7f7bf40b0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39816/0 (socket says 172.21.15.114:39816) 2023-10-18T12:20:41.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.452+0000 7f7bf2d9d700 1 -- 172.21.15.114:0/361692709 learned_addr learned my addr 172.21.15.114:0/361692709 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:41.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.452+0000 7f7bf359e700 1 --2- 172.21.15.114:0/361692709 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bf4160710 0x7f7bf41505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:41.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.452+0000 7f7bf259c700 1 --2- 172.21.15.114:0/361692709 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7bf40d2e00 0x7f7bf41500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:41.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.452+0000 7f7bf2d9d700 1 -- 172.21.15.114:0/361692709 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7bf40d2e00 msgr2=0x7f7bf41500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:41.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.452+0000 7f7bf2d9d700 1 --2- 172.21.15.114:0/361692709 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7bf40d2e00 0x7f7bf41500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:41.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.452+0000 7f7bf2d9d700 1 -- 172.21.15.114:0/361692709 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bf4160710 msgr2=0x7f7bf41505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:41.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.452+0000 7f7bf2d9d700 1 --2- 172.21.15.114:0/361692709 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bf4160710 0x7f7bf41505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:41.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.452+0000 7f7bf2d9d700 1 -- 172.21.15.114:0/361692709 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be8009570 con 0x7f7bf40b5ae0 2023-10-18T12:20:41.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.452+0000 7f7bf2d9d700 1 --2- 172.21.15.114:0/361692709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bf40b5ae0 0x7f7bf40b0c40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f7be400c500 tx=0x7f7be400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:41.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.452+0000 7f7bdb7fe700 1 -- 172.21.15.114:0/361692709 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be40052d0 con 0x7f7bf40b5ae0 2023-10-18T12:20:41.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.452+0000 7f7bdb7fe700 1 -- 172.21.15.114:0/361692709 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be4005430 con 0x7f7bf40b5ae0 2023-10-18T12:20:41.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.452+0000 7f7bf8861700 1 -- 172.21.15.114:0/361692709 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bf414acd0 con 0x7f7bf40b5ae0 2023-10-18T12:20:41.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.452+0000 7f7bdb7fe700 1 -- 172.21.15.114:0/361692709 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be40055a0 con 0x7f7bf40b5ae0 2023-10-18T12:20:41.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.452+0000 7f7bf8861700 1 -- 172.21.15.114:0/361692709 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bf40b1180 con 0x7f7bf40b5ae0 2023-10-18T12:20:41.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.456+0000 7f7bf8861700 1 -- 172.21.15.114:0/361692709 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bf40b1370 con 0x7f7bf40b5ae0 2023-10-18T12:20:41.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.456+0000 7f7bdb7fe700 1 -- 172.21.15.114:0/361692709 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f7be40038e0 con 0x7f7bf40b5ae0 2023-10-18T12:20:41.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.460+0000 7f7bdb7fe700 1 --2- 172.21.15.114:0/361692709 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7be00656f0 0x7f7be0067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:41.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.460+0000 7f7bdb7fe700 1 -- 172.21.15.114:0/361692709 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7be4082260 con 0x7f7bf40b5ae0 2023-10-18T12:20:41.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.460+0000 7f7bf259c700 1 --2- 172.21.15.114:0/361692709 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7be00656f0 0x7f7be0067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:41.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.460+0000 7f7bf259c700 1 --2- 172.21.15.114:0/361692709 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7be00656f0 0x7f7be0067bb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7be8009910 tx=0x7f7be8008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:41.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.464+0000 7f7bdb7fe700 1 -- 172.21.15.114:0/361692709 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f7be404f9e0 con 0x7f7bf40b5ae0 2023-10-18T12:20:41.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.716+0000 7f7bf8861700 1 -- 172.21.15.114:0/361692709 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f7bf415d0d0 con 0x7f7bf40b5ae0 2023-10-18T12:20:41.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.716+0000 7f7bdb7fe700 1 -- 172.21.15.114:0/361692709 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7bf415d0d0 con 0x7f7bf40b5ae0 2023-10-18T12:20:41.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.720+0000 7f7bf8861700 1 -- 172.21.15.114:0/361692709 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7be00656f0 msgr2=0x7f7be0067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:41.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.720+0000 7f7bf8861700 1 --2- 172.21.15.114:0/361692709 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7be00656f0 0x7f7be0067bb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7be8009910 tx=0x7f7be8008030 comp rx=0 tx=0).stop 2023-10-18T12:20:41.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.720+0000 7f7bf8861700 1 -- 172.21.15.114:0/361692709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bf40b5ae0 msgr2=0x7f7bf40b0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:41.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.720+0000 7f7bf8861700 1 --2- 172.21.15.114:0/361692709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bf40b5ae0 0x7f7bf40b0c40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f7be400c500 tx=0x7f7be400c810 comp rx=0 tx=0).stop 2023-10-18T12:20:41.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.720+0000 7f7bf8861700 1 -- 172.21.15.114:0/361692709 shutdown_connections 2023-10-18T12:20:41.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.720+0000 7f7bf8861700 1 --2- 172.21.15.114:0/361692709 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7be00656f0 0x7f7be0067bb0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:41.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.720+0000 7f7bf8861700 1 --2- 172.21.15.114:0/361692709 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7bf40d2e00 0x7f7bf41500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:41.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.720+0000 7f7bf8861700 1 --2- 172.21.15.114:0/361692709 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7bf4160710 0x7f7bf41505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:41.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.720+0000 7f7bf8861700 1 --2- 172.21.15.114:0/361692709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7bf40b5ae0 0x7f7bf40b0c40 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:41.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.720+0000 7f7bf8861700 1 -- 172.21.15.114:0/361692709 >> 172.21.15.114:0/361692709 conn(0x7f7bf4069f20 msgr2=0x7f7bf415b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:41.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.720+0000 7f7bf8861700 1 -- 172.21.15.114:0/361692709 shutdown_connections 2023-10-18T12:20:41.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:41.720+0000 7f7bf8861700 1 -- 172.21.15.114:0/361692709 wait complete. 2023-10-18T12:20:41.746 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-18T12:20:41.747 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-18T12:20:41.793 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-18T12:20:41.836 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-18T12:20:41.836 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:20:41.837 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-18T12:20:41.855 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:20:41.855 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-18T12:20:41.914 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:20:41.914 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-18T12:20:41.974 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T12:20:42.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.196+0000 7f7d3a0d1700 1 Processor -- start 2023-10-18T12:20:42.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.196+0000 7f7d3a0d1700 1 -- start start 2023-10-18T12:20:42.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.196+0000 7f7d3a0d1700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7d3406d530 0x7f7d340cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:42.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.196+0000 7f7d3a0d1700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d340ca4c0 con 0x7f7d340b3d40 2023-10-18T12:20:42.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.196+0000 7f7d3a0d1700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d340ca7a0 con 0x7f7d34164a20 2023-10-18T12:20:42.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.196+0000 7f7d3a0d1700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3406e2d0 con 0x7f7d3406d530 2023-10-18T12:20:42.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.196+0000 7f7d390cf700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f7d340b3d40 0x7f7d340c9cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56086/0 (socket says 172.21.15.114:56086) 2023-10-18T12:20:42.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.196+0000 7f7d390cf700 1 -- 172.21.15.114:0/229266 learned_addr learned my addr 172.21.15.114:0/229266 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:42.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.196+0000 7f7d398d0700 1 --2- 172.21.15.114:0/229266 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7d3406d530 0x7f7d340cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:42.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.200+0000 7f7d2bfff700 1 -- 172.21.15.114:0/229266 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2817615137 0 0) 0x7f7d340ca4c0 con 0x7f7d340b3d40 2023-10-18T12:20:42.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.200+0000 7f7d2bfff700 1 -- 172.21.15.114:0/229266 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d200035d0 con 0x7f7d340b3d40 2023-10-18T12:20:42.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.200+0000 7f7d2bfff700 1 -- 172.21.15.114:0/229266 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2308246430 0 0) 0x7f7d340ca7a0 con 0x7f7d34164a20 2023-10-18T12:20:42.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.200+0000 7f7d2bfff700 1 -- 172.21.15.114:0/229266 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d340ca4c0 con 0x7f7d34164a20 2023-10-18T12:20:42.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.200+0000 7f7d398d0700 1 -- 172.21.15.114:0/229266 >> v1:172.21.15.172:6789/0 conn(0x7f7d34164a20 legacy=0x7f7d3406ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:42.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.200+0000 7f7d398d0700 1 -- 172.21.15.114:0/229266 >> v1:172.21.15.114:6789/0 conn(0x7f7d340b3d40 legacy=0x7f7d340c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:42.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.200+0000 7f7d398d0700 1 -- 172.21.15.114:0/229266 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d340caa80 con 0x7f7d3406d530 2023-10-18T12:20:42.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.200+0000 7f7d398d0700 1 --2- 172.21.15.114:0/229266 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7d3406d530 0x7f7d340cc190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c009dc0 tx=0x7f7d2c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38e72e0c3f6472c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:42.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.200+0000 7f7d2bfff700 1 -- 172.21.15.114:0/229266 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c00e070 con 0x7f7d3406d530 2023-10-18T12:20:42.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.200+0000 7f7d2bfff700 1 -- 172.21.15.114:0/229266 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d2c00bb20 con 0x7f7d3406d530 2023-10-18T12:20:42.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.200+0000 7f7d2bfff700 1 -- 172.21.15.114:0/229266 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c012430 con 0x7f7d3406d530 2023-10-18T12:20:42.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.200+0000 7f7d3a0d1700 1 -- 172.21.15.114:0/229266 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7d3406d530 msgr2=0x7f7d340cc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:42.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.200+0000 7f7d3a0d1700 1 --2- 172.21.15.114:0/229266 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7d3406d530 0x7f7d340cc190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c009dc0 tx=0x7f7d2c00b330 comp rx=0 tx=0).stop 2023-10-18T12:20:42.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.200+0000 7f7d3a0d1700 1 -- 172.21.15.114:0/229266 shutdown_connections 2023-10-18T12:20:42.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.200+0000 7f7d3a0d1700 1 --2- 172.21.15.114:0/229266 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7d3406d530 0x7f7d340cc190 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:42.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.200+0000 7f7d3a0d1700 1 -- 172.21.15.114:0/229266 >> 172.21.15.114:0/229266 conn(0x7f7d340ce5c0 msgr2=0x7f7d340ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:42.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.204+0000 7f7d3a0d1700 1 -- 172.21.15.114:0/229266 shutdown_connections 2023-10-18T12:20:42.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.204+0000 7f7d3a0d1700 1 -- 172.21.15.114:0/229266 wait complete. 2023-10-18T12:20:42.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.204+0000 7f7d3a0d1700 1 Processor -- start 2023-10-18T12:20:42.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.208+0000 7f7d3a0d1700 1 -- start start 2023-10-18T12:20:42.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.208+0000 7f7d3a0d1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d3406d530 0x7f7d340b1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:42.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.208+0000 7f7d3a0d1700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7d340b3d40 0x7f7d340c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:42.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.208+0000 7f7d3a0d1700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d34164a20 0x7f7d340c6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:42.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.208+0000 7f7d3a0d1700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d340b2c70 con 0x7f7d3406d530 2023-10-18T12:20:42.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.208+0000 7f7d3a0d1700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d340c5850 con 0x7f7d34164a20 2023-10-18T12:20:42.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.208+0000 7f7d3a0d1700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d340b23d0 con 0x7f7d340b3d40 2023-10-18T12:20:42.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.208+0000 7f7d390cf700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d3406d530 0x7f7d340b1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:42.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.208+0000 7f7d390cf700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d3406d530 0x7f7d340b1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39830/0 (socket says 172.21.15.114:39830) 2023-10-18T12:20:42.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.208+0000 7f7d390cf700 1 -- 172.21.15.114:0/211715522 learned_addr learned my addr 172.21.15.114:0/211715522 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:42.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.208+0000 7f7d388ce700 1 --2- 172.21.15.114:0/211715522 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7d340b3d40 0x7f7d340c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:42.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.208+0000 7f7d398d0700 1 --2- 172.21.15.114:0/211715522 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d34164a20 0x7f7d340c6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:42.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.208+0000 7f7d390cf700 1 -- 172.21.15.114:0/211715522 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7d340b3d40 msgr2=0x7f7d340c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:42.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.208+0000 7f7d390cf700 1 --2- 172.21.15.114:0/211715522 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7d340b3d40 0x7f7d340c5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:42.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.208+0000 7f7d390cf700 1 -- 172.21.15.114:0/211715522 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d34164a20 msgr2=0x7f7d340c6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:42.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.208+0000 7f7d390cf700 1 --2- 172.21.15.114:0/211715522 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d34164a20 0x7f7d340c6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:42.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.208+0000 7f7d390cf700 1 -- 172.21.15.114:0/211715522 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d2c009a70 con 0x7f7d3406d530 2023-10-18T12:20:42.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.208+0000 7f7d390cf700 1 --2- 172.21.15.114:0/211715522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d3406d530 0x7f7d340b1cc0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7d3000c560 tx=0x7f7d3000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:42.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.212+0000 7f7d29ffb700 1 -- 172.21.15.114:0/211715522 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d30005d90 con 0x7f7d3406d530 2023-10-18T12:20:42.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.212+0000 7f7d29ffb700 1 -- 172.21.15.114:0/211715522 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d300070d0 con 0x7f7d3406d530 2023-10-18T12:20:42.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.212+0000 7f7d3a0d1700 1 -- 172.21.15.114:0/211715522 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d340b26b0 con 0x7f7d3406d530 2023-10-18T12:20:42.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.212+0000 7f7d29ffb700 1 -- 172.21.15.114:0/211715522 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d30007460 con 0x7f7d3406d530 2023-10-18T12:20:42.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.212+0000 7f7d3a0d1700 1 -- 172.21.15.114:0/211715522 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d34152d90 con 0x7f7d3406d530 2023-10-18T12:20:42.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.212+0000 7f7d3a0d1700 1 -- 172.21.15.114:0/211715522 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d34072e60 con 0x7f7d3406d530 2023-10-18T12:20:42.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.216+0000 7f7d29ffb700 1 -- 172.21.15.114:0/211715522 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f7d300075c0 con 0x7f7d3406d530 2023-10-18T12:20:42.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.216+0000 7f7d29ffb700 1 --2- 172.21.15.114:0/211715522 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7d18065720 0x7f7d18067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:42.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.216+0000 7f7d29ffb700 1 -- 172.21.15.114:0/211715522 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7d30082630 con 0x7f7d3406d530 2023-10-18T12:20:42.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.216+0000 7f7d388ce700 1 --2- 172.21.15.114:0/211715522 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7d18065720 0x7f7d18067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:42.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.220+0000 7f7d388ce700 1 --2- 172.21.15.114:0/211715522 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7d18065720 0x7f7d18067be0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7d340b2e40 tx=0x7f7d24009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:42.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.224+0000 7f7d29ffb700 1 -- 172.21.15.114:0/211715522 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f7d3004fe50 con 0x7f7d3406d530 2023-10-18T12:20:42.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.400+0000 7f7d3a0d1700 1 -- 172.21.15.114:0/211715522 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d3415fe40 con 0x7f7d3406d530 2023-10-18T12:20:42.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.404+0000 7f7d29ffb700 1 -- 172.21.15.114:0/211715522 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20240 (secure 0 0 0) 0x7f7d30053470 con 0x7f7d3406d530 2023-10-18T12:20:42.410 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:20:42.410 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":30,"fsid":"240ea340-5d3d-4f52-a4bc-af075aca3deb","created":"2023-10-18T12:19:12.512994+0000","modified":"2023-10-18T12:20:20.604528+0000","last_up_change":"2023-10-18T12:19:25.286009+0000","last_in_change":"2023-10-18T12:19:15.850693+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T12:19:27.040638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-18T12:19:32.358094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-18T12:19:37.333855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-18T12:19:38.055385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-18T12:19:41.679218+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c3578978-1a03-4857-b9d2-34a5da3d7731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6817","nonce":1506287862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6820","nonce":1506287862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6830","nonce":1506287862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6825","nonce":1506287862}]},"public_addr":"172.21.15.114:6817/1506287862","cluster_addr":"172.21.15.114:6820/1506287862","heartbeat_back_addr":"172.21.15.114:6830/1506287862","heartbeat_front_addr":"172.21.15.114:6825/1506287862","state":["exists","up"]},{"osd":1,"uuid":"43eb26a6-e2b3-4670-9559-bd053b5140d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6801","nonce":3302727047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6803","nonce":3302727047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6807","nonce":3302727047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6805","nonce":3302727047}]},"public_addr":"172.21.15.114:6801/3302727047","cluster_addr":"172.21.15.114:6803/3302727047","heartbeat_back_addr":"172.21.15.114:6807/3302727047","heartbeat_front_addr":"172.21.15.114:6805/3302727047","state":["exists","up"]},{"osd":2,"uuid":"f3d4dbd5-521c-4dd2-b687-5768cc7d0938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6809","nonce":2699151351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6811","nonce":2699151351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6815","nonce":2699151351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6813","nonce":2699151351}]},"public_addr":"172.21.15.114:6809/2699151351","cluster_addr":"172.21.15.114:6811/2699151351","heartbeat_back_addr":"172.21.15.114:6815/2699151351","heartbeat_front_addr":"172.21.15.114:6813/2699151351","state":["exists","up"]},{"osd":3,"uuid":"823e5802-92b7-4f0d-b32d-a5748993f1b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6821","nonce":1361608073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6824","nonce":1361608073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6829","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6831","nonce":1361608073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6827","nonce":1361608073}]},"public_addr":"172.21.15.114:6821/1361608073","cluster_addr":"172.21.15.114:6824/1361608073","heartbeat_back_addr":"172.21.15.114:6831/1361608073","heartbeat_front_addr":"172.21.15.114:6827/1361608073","state":["exists","up"]},{"osd":4,"uuid":"e47fb93e-13b4-44a4-b084-8c4384ceb41e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6801","nonce":930839681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6803","nonce":930839681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6807","nonce":930839681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6805","nonce":930839681}]},"public_addr":"172.21.15.172:6801/930839681","cluster_addr":"172.21.15.172:6803/930839681","heartbeat_back_addr":"172.21.15.172:6807/930839681","heartbeat_front_addr":"172.21.15.172:6805/930839681","state":["exists","up"]},{"osd":5,"uuid":"7561a973-f479-45a0-af40-f324728d622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6814","nonce":571761850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6818","nonce":571761850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6824","nonce":571761850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6821","nonce":571761850}]},"public_addr":"172.21.15.172:6814/571761850","cluster_addr":"172.21.15.172:6818/571761850","heartbeat_back_addr":"172.21.15.172:6824/571761850","heartbeat_front_addr":"172.21.15.172:6821/571761850","state":["exists","up"]},{"osd":6,"uuid":"51753f4b-7f06-4f1c-9ec7-6e18a66eb980","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6825","nonce":1680398853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6827","nonce":1680398853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6831","nonce":1680398853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6829","nonce":1680398853}]},"public_addr":"172.21.15.172:6825/1680398853","cluster_addr":"172.21.15.172:6827/1680398853","heartbeat_back_addr":"172.21.15.172:6831/1680398853","heartbeat_front_addr":"172.21.15.172:6829/1680398853","state":["exists","up"]},{"osd":7,"uuid":"4d8b1e15-143d-4d17-9074-59d92f0f9af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6809","nonce":349710101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6811","nonce":349710101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6819","nonce":349710101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6815","nonce":349710101}]},"public_addr":"172.21.15.172:6809/349710101","cluster_addr":"172.21.15.172:6811/349710101","heartbeat_back_addr":"172.21.15.172:6819/349710101","heartbeat_front_addr":"172.21.15.172:6815/349710101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.889460+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.475494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.911473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.648596+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.609994+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.636248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.854589+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.885826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T12:20:42.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.408+0000 7f7d3a0d1700 1 -- 172.21.15.114:0/211715522 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7d18065720 msgr2=0x7f7d18067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:42.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.408+0000 7f7d3a0d1700 1 --2- 172.21.15.114:0/211715522 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7d18065720 0x7f7d18067be0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7d340b2e40 tx=0x7f7d24009040 comp rx=0 tx=0).stop 2023-10-18T12:20:42.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.408+0000 7f7d3a0d1700 1 -- 172.21.15.114:0/211715522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d3406d530 msgr2=0x7f7d340b1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:42.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.408+0000 7f7d3a0d1700 1 --2- 172.21.15.114:0/211715522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d3406d530 0x7f7d340b1cc0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7d3000c560 tx=0x7f7d3000c920 comp rx=0 tx=0).stop 2023-10-18T12:20:42.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.408+0000 7f7d3a0d1700 1 -- 172.21.15.114:0/211715522 shutdown_connections 2023-10-18T12:20:42.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.408+0000 7f7d3a0d1700 1 --2- 172.21.15.114:0/211715522 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7d18065720 0x7f7d18067be0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:42.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.408+0000 7f7d3a0d1700 1 --2- 172.21.15.114:0/211715522 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7d340b3d40 0x7f7d340c5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:42.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.408+0000 7f7d3a0d1700 1 --2- 172.21.15.114:0/211715522 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d34164a20 0x7f7d340c6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:42.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.408+0000 7f7d3a0d1700 1 --2- 172.21.15.114:0/211715522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d3406d530 0x7f7d340b1cc0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:42.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.408+0000 7f7d3a0d1700 1 -- 172.21.15.114:0/211715522 >> 172.21.15.114:0/211715522 conn(0x7f7d340ce5c0 msgr2=0x7f7d340ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:42.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.408+0000 7f7d3a0d1700 1 -- 172.21.15.114:0/211715522 shutdown_connections 2023-10-18T12:20:42.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.408+0000 7f7d3a0d1700 1 -- 172.21.15.114:0/211715522 wait complete. 2023-10-18T12:20:42.432 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-18T12:19:27.040638+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-18T12:19:32.358094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-18T12:19:37.333855+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-18T12:19:38.055385+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-18T12:19:41.679218+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-18T12:20:42.433 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-18T12:20:42.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.608+0000 7f0009400700 1 Processor -- start 2023-10-18T12:20:42.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.608+0000 7f0009400700 1 -- start start 2023-10-18T12:20:42.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.608+0000 7f0009400700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f000415caa0 0x7f00040d2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:42.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.612+0000 7f0009400700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f000415ce80 0x7f000406c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:42.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.612+0000 7f0009400700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00040d2e80 con 0x7f00040d0880 2023-10-18T12:20:42.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.612+0000 7f0009400700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0004160900 con 0x7f000415caa0 2023-10-18T12:20:42.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.612+0000 7f0009400700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0004160be0 con 0x7f000415ce80 2023-10-18T12:20:42.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.612+0000 7f0003fff700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f00040d0880 0x7f000406f450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56096/0 (socket says 172.21.15.114:56096) 2023-10-18T12:20:42.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.612+0000 7f0003fff700 1 -- 172.21.15.114:0/922840776 learned_addr learned my addr 172.21.15.114:0/922840776 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:42.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.612+0000 7f0002ffd700 1 --2- 172.21.15.114:0/922840776 >> v2:172.21.15.172:3300/0 conn(0x7f000415caa0 0x7f00040d2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:42.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.612+0000 7f00027fc700 1 --2- 172.21.15.114:0/922840776 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f000415ce80 0x7f000406c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:42.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.612+0000 7f0002ffd700 1 -- 172.21.15.114:0/922840776 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f000415ce80 msgr2=0x7f000406c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:42.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.612+0000 7f0002ffd700 1 --2- 172.21.15.114:0/922840776 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f000415ce80 0x7f000406c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:42.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.612+0000 7f0002ffd700 1 -- 172.21.15.114:0/922840776 >> v1:172.21.15.114:6789/0 conn(0x7f00040d0880 legacy=0x7f000406f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:42.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.612+0000 7f0002ffd700 1 -- 172.21.15.114:0/922840776 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0004160ec0 con 0x7f000415caa0 2023-10-18T12:20:42.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.612+0000 7f0001ffb700 1 -- 172.21.15.114:0/922840776 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3096237784 0 0) 0x7f00040d2e80 con 0x7f00040d0880 2023-10-18T12:20:42.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.612+0000 7f0002ffd700 1 --2- 172.21.15.114:0/922840776 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f000415caa0 0x7f00040d2940 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efff4009850 tx=0x7efff4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55acb8c7a67cdea5 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:42.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.612+0000 7f0001ffb700 1 -- 172.21.15.114:0/922840776 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff4011830 con 0x7f000415caa0 2023-10-18T12:20:42.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.612+0000 7f0001ffb700 1 -- 172.21.15.114:0/922840776 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff4011990 con 0x7f000415caa0 2023-10-18T12:20:42.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.612+0000 7f0001ffb700 1 -- 172.21.15.114:0/922840776 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff4011d40 con 0x7f000415caa0 2023-10-18T12:20:42.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.612+0000 7f0009400700 1 -- 172.21.15.114:0/922840776 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f000415caa0 msgr2=0x7f00040d2940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:42.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.612+0000 7f0009400700 1 --2- 172.21.15.114:0/922840776 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f000415caa0 0x7f00040d2940 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efff4009850 tx=0x7efff4009b60 comp rx=0 tx=0).stop 2023-10-18T12:20:42.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.612+0000 7f0009400700 1 -- 172.21.15.114:0/922840776 shutdown_connections 2023-10-18T12:20:42.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.612+0000 7f0009400700 1 --2- 172.21.15.114:0/922840776 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f000415ce80 0x7f000406c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:42.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.612+0000 7f0009400700 1 --2- 172.21.15.114:0/922840776 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f000415caa0 0x7f00040d2940 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:42.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.612+0000 7f0009400700 1 -- 172.21.15.114:0/922840776 >> 172.21.15.114:0/922840776 conn(0x7f00040d4360 msgr2=0x7f00040d4770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:42.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.612+0000 7f0009400700 1 -- 172.21.15.114:0/922840776 shutdown_connections 2023-10-18T12:20:42.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.612+0000 7f0009400700 1 -- 172.21.15.114:0/922840776 wait complete. 2023-10-18T12:20:42.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.616+0000 7f0009400700 1 Processor -- start 2023-10-18T12:20:42.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.616+0000 7f0009400700 1 -- start start 2023-10-18T12:20:42.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.620+0000 7f0009400700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00040d0880 0x7f00040b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:42.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.620+0000 7f0009400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f000415caa0 0x7f00040ca640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:42.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.620+0000 7f0009400700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f000415ce80 0x7f00040c7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:42.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.620+0000 7f0009400700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00041f6810 con 0x7f00040d0880 2023-10-18T12:20:42.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.620+0000 7f0009400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00040b5240 con 0x7f000415caa0 2023-10-18T12:20:42.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.620+0000 7f0009400700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00040b4f60 con 0x7f000415ce80 2023-10-18T12:20:42.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.620+0000 7f0002ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00040d0880 0x7f00040b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:42.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.620+0000 7f0002ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00040d0880 0x7f00040b46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39838/0 (socket says 172.21.15.114:39838) 2023-10-18T12:20:42.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.620+0000 7f0002ffd700 1 -- 172.21.15.114:0/704678014 learned_addr learned my addr 172.21.15.114:0/704678014 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:42.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.620+0000 7f00027fc700 1 --2- 172.21.15.114:0/704678014 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f000415caa0 0x7f00040ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:42.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.620+0000 7f0003fff700 1 --2- 172.21.15.114:0/704678014 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f000415ce80 0x7f00040c7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:42.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.620+0000 7f0002ffd700 1 -- 172.21.15.114:0/704678014 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f000415ce80 msgr2=0x7f00040c7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:42.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.620+0000 7f0002ffd700 1 --2- 172.21.15.114:0/704678014 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f000415ce80 0x7f00040c7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:42.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.620+0000 7f0002ffd700 1 -- 172.21.15.114:0/704678014 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f000415caa0 msgr2=0x7f00040ca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:42.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.620+0000 7f0002ffd700 1 --2- 172.21.15.114:0/704678014 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f000415caa0 0x7f00040ca640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:42.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.620+0000 7f0002ffd700 1 -- 172.21.15.114:0/704678014 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff40094b0 con 0x7f00040d0880 2023-10-18T12:20:42.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.620+0000 7f0002ffd700 1 --2- 172.21.15.114:0/704678014 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00040d0880 0x7f00040b46a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7efff4000c00 tx=0x7efff4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:42.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.620+0000 7effeb7fe700 1 -- 172.21.15.114:0/704678014 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff401a990 con 0x7f00040d0880 2023-10-18T12:20:42.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.620+0000 7effeb7fe700 1 -- 172.21.15.114:0/704678014 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff401f070 con 0x7f00040d0880 2023-10-18T12:20:42.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.620+0000 7effeb7fe700 1 -- 172.21.15.114:0/704678014 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff401ad30 con 0x7f00040d0880 2023-10-18T12:20:42.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.620+0000 7f0009400700 1 -- 172.21.15.114:0/704678014 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00040c9b60 con 0x7f00040d0880 2023-10-18T12:20:42.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.620+0000 7f0009400700 1 -- 172.21.15.114:0/704678014 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00040ca120 con 0x7f00040d0880 2023-10-18T12:20:42.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.624+0000 7f0009400700 1 -- 172.21.15.114:0/704678014 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00040c99c0 con 0x7f00040d0880 2023-10-18T12:20:42.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.624+0000 7effeb7fe700 1 -- 172.21.15.114:0/704678014 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7efff401b430 con 0x7f00040d0880 2023-10-18T12:20:42.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.624+0000 7effeb7fe700 1 --2- 172.21.15.114:0/704678014 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7efff00656f0 0x7efff0067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:42.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.624+0000 7effeb7fe700 1 -- 172.21.15.114:0/704678014 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7efff4084170 con 0x7f00040d0880 2023-10-18T12:20:42.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.628+0000 7f00027fc700 1 --2- 172.21.15.114:0/704678014 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7efff00656f0 0x7efff0067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:42.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.628+0000 7f00027fc700 1 --2- 172.21.15.114:0/704678014 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7efff00656f0 0x7efff0067bb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f00040b56a0 tx=0x7efff8009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:42.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.632+0000 7effeb7fe700 1 -- 172.21.15.114:0/704678014 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f00040c99c0 con 0x7f00040d0880 2023-10-18T12:20:42.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.808+0000 7f0009400700 1 -- 172.21.15.114:0/704678014 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f00040c99c0 con 0x7f00040d0880 2023-10-18T12:20:42.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.812+0000 7effeb7fe700 1 -- 172.21.15.114:0/704678014 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f00040c99c0 con 0x7f00040d0880 2023-10-18T12:20:42.816 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-10-18T12:20:42.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.812+0000 7f0009400700 1 -- 172.21.15.114:0/704678014 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7efff00656f0 msgr2=0x7efff0067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:42.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.812+0000 7f0009400700 1 --2- 172.21.15.114:0/704678014 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7efff00656f0 0x7efff0067bb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f00040b56a0 tx=0x7efff8009240 comp rx=0 tx=0).stop 2023-10-18T12:20:42.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.812+0000 7f0009400700 1 -- 172.21.15.114:0/704678014 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00040d0880 msgr2=0x7f00040b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:42.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.812+0000 7f0009400700 1 --2- 172.21.15.114:0/704678014 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00040d0880 0x7f00040b46a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7efff4000c00 tx=0x7efff4004770 comp rx=0 tx=0).stop 2023-10-18T12:20:42.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.812+0000 7f0009400700 1 -- 172.21.15.114:0/704678014 shutdown_connections 2023-10-18T12:20:42.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.812+0000 7f0009400700 1 --2- 172.21.15.114:0/704678014 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7efff00656f0 0x7efff0067bb0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:42.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.812+0000 7f0009400700 1 --2- 172.21.15.114:0/704678014 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f000415ce80 0x7f00040c7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:42.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.812+0000 7f0009400700 1 --2- 172.21.15.114:0/704678014 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f000415caa0 0x7f00040ca640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:42.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.812+0000 7f0009400700 1 --2- 172.21.15.114:0/704678014 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00040d0880 0x7f00040b46a0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:42.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.812+0000 7f0009400700 1 -- 172.21.15.114:0/704678014 >> 172.21.15.114:0/704678014 conn(0x7f00040d4360 msgr2=0x7f0004070180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:42.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.812+0000 7f0009400700 1 -- 172.21.15.114:0/704678014 shutdown_connections 2023-10-18T12:20:42.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:42.812+0000 7f0009400700 1 -- 172.21.15.114:0/704678014 wait complete. 2023-10-18T12:20:42.840 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-18T12:20:43.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.008+0000 7f8e46025700 1 Processor -- start 2023-10-18T12:20:43.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.008+0000 7f8e46025700 1 -- start start 2023-10-18T12:20:43.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.012+0000 7f8e46025700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8e4015dcf0 0x7f8e4006fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:43.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.012+0000 7f8e46025700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e400d2e20 0x7f8e400d3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:43.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.012+0000 7f8e46025700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e400d37a0 con 0x7f8e400d23e0 2023-10-18T12:20:43.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.012+0000 7f8e46025700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e4015e160 con 0x7f8e4015dcf0 2023-10-18T12:20:43.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.012+0000 7f8e46025700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e400b6e40 con 0x7f8e400d2e20 2023-10-18T12:20:43.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.012+0000 7f8e45023700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f8e400d23e0 0x7f8e400b65f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56100/0 (socket says 172.21.15.114:56100) 2023-10-18T12:20:43.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.012+0000 7f8e45023700 1 -- 172.21.15.114:0/1676289002 learned_addr learned my addr 172.21.15.114:0/1676289002 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:43.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.012+0000 7f8e44822700 1 --2- 172.21.15.114:0/1676289002 >> v2:172.21.15.172:3300/0 conn(0x7f8e4015dcf0 0x7f8e4006fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:43.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.012+0000 7f8e45824700 1 --2- 172.21.15.114:0/1676289002 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e400d2e20 0x7f8e400d3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:43.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.012+0000 7f8e37fff700 1 -- 172.21.15.114:0/1676289002 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2405941186 0 0) 0x7f8e400d37a0 con 0x7f8e400d23e0 2023-10-18T12:20:43.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.012+0000 7f8e37fff700 1 -- 172.21.15.114:0/1676289002 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e2c0035d0 con 0x7f8e400d23e0 2023-10-18T12:20:43.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.012+0000 7f8e45824700 1 -- 172.21.15.114:0/1676289002 >> v2:172.21.15.172:3300/0 conn(0x7f8e4015dcf0 msgr2=0x7f8e4006fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:43.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.016+0000 7f8e45824700 1 --2- 172.21.15.114:0/1676289002 >> v2:172.21.15.172:3300/0 conn(0x7f8e4015dcf0 0x7f8e4006fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:43.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.016+0000 7f8e45824700 1 -- 172.21.15.114:0/1676289002 >> v1:172.21.15.114:6789/0 conn(0x7f8e400d23e0 legacy=0x7f8e400b65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:43.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.016+0000 7f8e45824700 1 -- 172.21.15.114:0/1676289002 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e400b7120 con 0x7f8e400d2e20 2023-10-18T12:20:43.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.016+0000 7f8e45824700 1 --2- 172.21.15.114:0/1676289002 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e400d2e20 0x7f8e400d3260 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8e38009d90 tx=0x7f8e3800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b3e93da65bfea42 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:43.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.016+0000 7f8e37fff700 1 -- 172.21.15.114:0/1676289002 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3800e070 con 0x7f8e400d2e20 2023-10-18T12:20:43.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.016+0000 7f8e37fff700 1 -- 172.21.15.114:0/1676289002 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3800bb20 con 0x7f8e400d2e20 2023-10-18T12:20:43.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.016+0000 7f8e37fff700 1 -- 172.21.15.114:0/1676289002 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3800be90 con 0x7f8e400d2e20 2023-10-18T12:20:43.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.016+0000 7f8e46025700 1 -- 172.21.15.114:0/1676289002 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e400d2e20 msgr2=0x7f8e400d3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:43.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.016+0000 7f8e46025700 1 --2- 172.21.15.114:0/1676289002 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e400d2e20 0x7f8e400d3260 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8e38009d90 tx=0x7f8e3800b330 comp rx=0 tx=0).stop 2023-10-18T12:20:43.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.016+0000 7f8e46025700 1 -- 172.21.15.114:0/1676289002 shutdown_connections 2023-10-18T12:20:43.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.016+0000 7f8e46025700 1 --2- 172.21.15.114:0/1676289002 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e400d2e20 0x7f8e400d3260 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:43.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.016+0000 7f8e46025700 1 --2- 172.21.15.114:0/1676289002 >> v2:172.21.15.172:3300/0 conn(0x7f8e4015dcf0 0x7f8e4006fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:43.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.016+0000 7f8e46025700 1 -- 172.21.15.114:0/1676289002 >> 172.21.15.114:0/1676289002 conn(0x7f8e40069f20 msgr2=0x7f8e4006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:43.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.016+0000 7f8e46025700 1 -- 172.21.15.114:0/1676289002 shutdown_connections 2023-10-18T12:20:43.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.016+0000 7f8e46025700 1 -- 172.21.15.114:0/1676289002 wait complete. 2023-10-18T12:20:43.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.020+0000 7f8e46025700 1 Processor -- start 2023-10-18T12:20:43.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.020+0000 7f8e46025700 1 -- start start 2023-10-18T12:20:43.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.024+0000 7f8e46025700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e400d23e0 0x7f8e40157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:43.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.024+0000 7f8e46025700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e400d2e20 0x7f8e400ae580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:43.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.024+0000 7f8e46025700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e4015dcf0 0x7f8e400d0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:43.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.024+0000 7f8e46025700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e400b4790 con 0x7f8e400d2e20 2023-10-18T12:20:43.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.024+0000 7f8e46025700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e40157d70 con 0x7f8e4015dcf0 2023-10-18T12:20:43.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.024+0000 7f8e46025700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e400b3ba0 con 0x7f8e400d23e0 2023-10-18T12:20:43.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.024+0000 7f8e44822700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e400d2e20 0x7f8e400ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:43.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.024+0000 7f8e44822700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e400d2e20 0x7f8e400ae580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39852/0 (socket says 172.21.15.114:39852) 2023-10-18T12:20:43.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.024+0000 7f8e44822700 1 -- 172.21.15.114:0/4063355770 learned_addr learned my addr 172.21.15.114:0/4063355770 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:43.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.024+0000 7f8e45824700 1 --2- 172.21.15.114:0/4063355770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e4015dcf0 0x7f8e400d0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:43.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.024+0000 7f8e45023700 1 --2- 172.21.15.114:0/4063355770 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e400d23e0 0x7f8e40157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:43.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.024+0000 7f8e44822700 1 -- 172.21.15.114:0/4063355770 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e400d23e0 msgr2=0x7f8e40157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:43.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.024+0000 7f8e44822700 1 --2- 172.21.15.114:0/4063355770 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e400d23e0 0x7f8e40157290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:43.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.024+0000 7f8e44822700 1 -- 172.21.15.114:0/4063355770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e4015dcf0 msgr2=0x7f8e400d0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:43.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.024+0000 7f8e44822700 1 --2- 172.21.15.114:0/4063355770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e4015dcf0 0x7f8e400d0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:43.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.024+0000 7f8e44822700 1 -- 172.21.15.114:0/4063355770 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e38009a70 con 0x7f8e400d2e20 2023-10-18T12:20:43.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.024+0000 7f8e45824700 1 --2- 172.21.15.114:0/4063355770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e4015dcf0 0x7f8e400d0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:43.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.024+0000 7f8e44822700 1 --2- 172.21.15.114:0/4063355770 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e400d2e20 0x7f8e400ae580 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f8e3000e870 tx=0x7f8e3000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:43.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.024+0000 7f8e35ffb700 1 -- 172.21.15.114:0/4063355770 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e300095a0 con 0x7f8e400d2e20 2023-10-18T12:20:43.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.024+0000 7f8e35ffb700 1 -- 172.21.15.114:0/4063355770 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3000ee70 con 0x7f8e400d2e20 2023-10-18T12:20:43.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.024+0000 7f8e35ffb700 1 -- 172.21.15.114:0/4063355770 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3000ca50 con 0x7f8e400d2e20 2023-10-18T12:20:43.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.024+0000 7f8e46025700 1 -- 172.21.15.114:0/4063355770 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e400b3df0 con 0x7f8e400d2e20 2023-10-18T12:20:43.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.024+0000 7f8e46025700 1 -- 172.21.15.114:0/4063355770 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e400b43b0 con 0x7f8e400d2e20 2023-10-18T12:20:43.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.028+0000 7f8e46025700 1 -- 172.21.15.114:0/4063355770 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e4004e910 con 0x7f8e400d2e20 2023-10-18T12:20:43.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.028+0000 7f8e35ffb700 1 -- 172.21.15.114:0/4063355770 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f8e3000cbb0 con 0x7f8e400d2e20 2023-10-18T12:20:43.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.032+0000 7f8e35ffb700 1 --2- 172.21.15.114:0/4063355770 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8e240656f0 0x7f8e24067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:43.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.032+0000 7f8e35ffb700 1 -- 172.21.15.114:0/4063355770 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8e30083850 con 0x7f8e400d2e20 2023-10-18T12:20:43.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.032+0000 7f8e45023700 1 --2- 172.21.15.114:0/4063355770 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8e240656f0 0x7f8e24067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:43.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.032+0000 7f8e35ffb700 1 -- 172.21.15.114:0/4063355770 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f8e30054ae0 con 0x7f8e400d2e20 2023-10-18T12:20:43.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.032+0000 7f8e45023700 1 --2- 172.21.15.114:0/4063355770 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8e240656f0 0x7f8e24067bb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c005930 tx=0x7f8e3c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:43.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.208+0000 7f8e46025700 1 -- 172.21.15.114:0/4063355770 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8e4006d450 con 0x7f8e400d2e20 2023-10-18T12:20:43.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.208+0000 7f8e35ffb700 1 -- 172.21.15.114:0/4063355770 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8e30017020 con 0x7f8e400d2e20 2023-10-18T12:20:43.215 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 8 2023-10-18T12:20:43.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.212+0000 7f8e46025700 1 -- 172.21.15.114:0/4063355770 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8e240656f0 msgr2=0x7f8e24067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:43.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.212+0000 7f8e46025700 1 --2- 172.21.15.114:0/4063355770 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8e240656f0 0x7f8e24067bb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c005930 tx=0x7f8e3c009040 comp rx=0 tx=0).stop 2023-10-18T12:20:43.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.212+0000 7f8e46025700 1 -- 172.21.15.114:0/4063355770 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e400d2e20 msgr2=0x7f8e400ae580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:43.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.212+0000 7f8e46025700 1 --2- 172.21.15.114:0/4063355770 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e400d2e20 0x7f8e400ae580 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f8e3000e870 tx=0x7f8e3000ec30 comp rx=0 tx=0).stop 2023-10-18T12:20:43.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.212+0000 7f8e46025700 1 -- 172.21.15.114:0/4063355770 shutdown_connections 2023-10-18T12:20:43.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.212+0000 7f8e46025700 1 --2- 172.21.15.114:0/4063355770 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8e240656f0 0x7f8e24067bb0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:43.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.212+0000 7f8e46025700 1 --2- 172.21.15.114:0/4063355770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e4015dcf0 0x7f8e400d0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:43.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.212+0000 7f8e46025700 1 --2- 172.21.15.114:0/4063355770 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8e400d2e20 0x7f8e400ae580 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:43.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.212+0000 7f8e46025700 1 --2- 172.21.15.114:0/4063355770 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8e400d23e0 0x7f8e40157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:43.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.212+0000 7f8e46025700 1 -- 172.21.15.114:0/4063355770 >> 172.21.15.114:0/4063355770 conn(0x7f8e40069f20 msgr2=0x7f8e4015e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:43.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.212+0000 7f8e46025700 1 -- 172.21.15.114:0/4063355770 shutdown_connections 2023-10-18T12:20:43.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.212+0000 7f8e46025700 1 -- 172.21.15.114:0/4063355770 wait complete. 2023-10-18T12:20:43.240 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-18T12:20:43.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.416+0000 7f1bc759e700 1 Processor -- start 2023-10-18T12:20:43.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.416+0000 7f1bc759e700 1 -- start start 2023-10-18T12:20:43.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.416+0000 7f1bc759e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1bc815dcf0 0x7f1bc806fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:43.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.416+0000 7f1bc759e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bc80b6e40 con 0x7f1bc80d23e0 2023-10-18T12:20:43.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.416+0000 7f1bc759e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bc80b7120 con 0x7f1bc80d2e20 2023-10-18T12:20:43.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.416+0000 7f1bc759e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bc815e160 con 0x7f1bc815dcf0 2023-10-18T12:20:43.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.420+0000 7f1bc659c700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f1bc80d23e0 0x7f1bc80b65f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56114/0 (socket says 172.21.15.114:56114) 2023-10-18T12:20:43.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.420+0000 7f1bc659c700 1 -- 172.21.15.114:0/2049457512 learned_addr learned my addr 172.21.15.114:0/2049457512 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:43.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.420+0000 7f1bc5d9b700 1 --2- 172.21.15.114:0/2049457512 >> v2:172.21.15.172:3300/0 conn(0x7f1bc815dcf0 0x7f1bc806fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:43.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.420+0000 7f1bc559a700 1 -- 172.21.15.114:0/2049457512 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 535367779 0 0) 0x7f1bc80b6e40 con 0x7f1bc80d23e0 2023-10-18T12:20:43.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.420+0000 7f1bc559a700 1 -- 172.21.15.114:0/2049457512 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bb00035d0 con 0x7f1bc80d23e0 2023-10-18T12:20:43.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.420+0000 7f1bc5d9b700 1 -- 172.21.15.114:0/2049457512 >> v1:172.21.15.172:6789/0 conn(0x7f1bc80d2e20 legacy=0x7f1bc81607d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:43.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.420+0000 7f1bc5d9b700 1 -- 172.21.15.114:0/2049457512 >> v1:172.21.15.114:6789/0 conn(0x7f1bc80d23e0 legacy=0x7f1bc80b65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:43.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.420+0000 7f1bc5d9b700 1 -- 172.21.15.114:0/2049457512 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc815d4f0 con 0x7f1bc815dcf0 2023-10-18T12:20:43.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.420+0000 7f1bc5d9b700 1 --2- 172.21.15.114:0/2049457512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bc815dcf0 0x7f1bc806fef0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc009850 tx=0x7f1bbc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=307aba6450dc0394 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:43.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.420+0000 7f1bc559a700 1 -- 172.21.15.114:0/2049457512 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc011830 con 0x7f1bc815dcf0 2023-10-18T12:20:43.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.420+0000 7f1bc559a700 1 -- 172.21.15.114:0/2049457512 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bbc011990 con 0x7f1bc815dcf0 2023-10-18T12:20:43.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.420+0000 7f1bc559a700 1 -- 172.21.15.114:0/2049457512 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc011d00 con 0x7f1bc815dcf0 2023-10-18T12:20:43.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.420+0000 7f1bc759e700 1 -- 172.21.15.114:0/2049457512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bc815dcf0 msgr2=0x7f1bc806fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:43.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.420+0000 7f1bc759e700 1 --2- 172.21.15.114:0/2049457512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bc815dcf0 0x7f1bc806fef0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc009850 tx=0x7f1bbc009b60 comp rx=0 tx=0).stop 2023-10-18T12:20:43.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.420+0000 7f1bc759e700 1 -- 172.21.15.114:0/2049457512 shutdown_connections 2023-10-18T12:20:43.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.420+0000 7f1bc759e700 1 --2- 172.21.15.114:0/2049457512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bc815dcf0 0x7f1bc806fef0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:43.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.420+0000 7f1bc759e700 1 -- 172.21.15.114:0/2049457512 >> 172.21.15.114:0/2049457512 conn(0x7f1bc8069f20 msgr2=0x7f1bc806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:43.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.420+0000 7f1bc759e700 1 -- 172.21.15.114:0/2049457512 shutdown_connections 2023-10-18T12:20:43.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.424+0000 7f1bc759e700 1 -- 172.21.15.114:0/2049457512 wait complete. 2023-10-18T12:20:43.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.428+0000 7f1bc759e700 1 Processor -- start 2023-10-18T12:20:43.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.428+0000 7f1bc759e700 1 -- start start 2023-10-18T12:20:43.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.428+0000 7f1bc759e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bc80d23e0 0x7f1bc80b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:43.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.428+0000 7f1bc759e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1bc80d2e20 0x7f1bc815f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:43.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.428+0000 7f1bc759e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bc815dcf0 0x7f1bc815f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:43.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.428+0000 7f1bc759e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc80ab8e0 con 0x7f1bc815dcf0 2023-10-18T12:20:43.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.428+0000 7f1bc759e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc81f3730 con 0x7f1bc80d23e0 2023-10-18T12:20:43.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.428+0000 7f1bc759e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc81f3fd0 con 0x7f1bc80d2e20 2023-10-18T12:20:43.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.428+0000 7f1bc6d9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bc815dcf0 0x7f1bc815f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:43.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.428+0000 7f1bc6d9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bc815dcf0 0x7f1bc815f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39860/0 (socket says 172.21.15.114:39860) 2023-10-18T12:20:43.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.428+0000 7f1bc6d9d700 1 -- 172.21.15.114:0/362023946 learned_addr learned my addr 172.21.15.114:0/362023946 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:43.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.428+0000 7f1bc659c700 1 --2- 172.21.15.114:0/362023946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bc80d23e0 0x7f1bc80b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:43.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.428+0000 7f1bc5d9b700 1 --2- 172.21.15.114:0/362023946 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1bc80d2e20 0x7f1bc815f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:43.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.428+0000 7f1bc6d9d700 1 -- 172.21.15.114:0/362023946 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1bc80d2e20 msgr2=0x7f1bc815f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:43.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.428+0000 7f1bc6d9d700 1 --2- 172.21.15.114:0/362023946 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1bc80d2e20 0x7f1bc815f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:43.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.428+0000 7f1bc6d9d700 1 -- 172.21.15.114:0/362023946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bc80d23e0 msgr2=0x7f1bc80b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:43.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.428+0000 7f1bc6d9d700 1 --2- 172.21.15.114:0/362023946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bc80d23e0 0x7f1bc80b3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:43.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.428+0000 7f1bc6d9d700 1 -- 172.21.15.114:0/362023946 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bbc0094b0 con 0x7f1bc815dcf0 2023-10-18T12:20:43.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.428+0000 7f1bc6d9d700 1 --2- 172.21.15.114:0/362023946 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bc815dcf0 0x7f1bc815f7a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1bc000cb80 tx=0x7f1bc000cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:43.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.428+0000 7f1bb6ffd700 1 -- 172.21.15.114:0/362023946 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0003c70 con 0x7f1bc815dcf0 2023-10-18T12:20:43.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.432+0000 7f1bb6ffd700 1 -- 172.21.15.114:0/362023946 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc0003dd0 con 0x7f1bc815dcf0 2023-10-18T12:20:43.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.432+0000 7f1bc759e700 1 -- 172.21.15.114:0/362023946 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bc80b49b0 con 0x7f1bc815dcf0 2023-10-18T12:20:43.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.432+0000 7f1bb6ffd700 1 -- 172.21.15.114:0/362023946 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc000abb0 con 0x7f1bc815dcf0 2023-10-18T12:20:43.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.432+0000 7f1bc759e700 1 -- 172.21.15.114:0/362023946 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bc81f3c60 con 0x7f1bc815dcf0 2023-10-18T12:20:43.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.432+0000 7f1bc759e700 1 -- 172.21.15.114:0/362023946 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bc804e910 con 0x7f1bc815dcf0 2023-10-18T12:20:43.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.432+0000 7f1bb6ffd700 1 -- 172.21.15.114:0/362023946 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f1bc000ad10 con 0x7f1bc815dcf0 2023-10-18T12:20:43.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.436+0000 7f1bb6ffd700 1 --2- 172.21.15.114:0/362023946 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1ba80656f0 0x7f1ba8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:43.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.436+0000 7f1bb6ffd700 1 -- 172.21.15.114:0/362023946 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1bc00831b0 con 0x7f1bc815dcf0 2023-10-18T12:20:43.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.436+0000 7f1bc659c700 1 --2- 172.21.15.114:0/362023946 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1ba80656f0 0x7f1ba8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:43.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.436+0000 7f1bc659c700 1 --2- 172.21.15.114:0/362023946 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1ba80656f0 0x7f1ba8067bb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80011e0 tx=0x7f1bb8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:43.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.444+0000 7f1bb6ffd700 1 -- 172.21.15.114:0/362023946 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f1bc0050950 con 0x7f1bc815dcf0 2023-10-18T12:20:43.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.628+0000 7f1bc759e700 1 -- 172.21.15.114:0/362023946 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1bc81f4110 con 0x7f1bc815dcf0 2023-10-18T12:20:43.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.628+0000 7f1bb6ffd700 1 -- 172.21.15.114:0/362023946 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1bc0053f70 con 0x7f1bc815dcf0 2023-10-18T12:20:43.633 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-10-18T12:20:43.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.628+0000 7f1bc759e700 1 -- 172.21.15.114:0/362023946 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1ba80656f0 msgr2=0x7f1ba8067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:43.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.628+0000 7f1bc759e700 1 --2- 172.21.15.114:0/362023946 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1ba80656f0 0x7f1ba8067bb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80011e0 tx=0x7f1bb8009040 comp rx=0 tx=0).stop 2023-10-18T12:20:43.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.628+0000 7f1bc759e700 1 -- 172.21.15.114:0/362023946 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bc815dcf0 msgr2=0x7f1bc815f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:43.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.628+0000 7f1bc759e700 1 --2- 172.21.15.114:0/362023946 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bc815dcf0 0x7f1bc815f7a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1bc000cb80 tx=0x7f1bc000cf40 comp rx=0 tx=0).stop 2023-10-18T12:20:43.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.628+0000 7f1bc759e700 1 -- 172.21.15.114:0/362023946 shutdown_connections 2023-10-18T12:20:43.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.628+0000 7f1bc759e700 1 --2- 172.21.15.114:0/362023946 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1ba80656f0 0x7f1ba8067bb0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:43.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.628+0000 7f1bc759e700 1 --2- 172.21.15.114:0/362023946 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1bc80d2e20 0x7f1bc815f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:43.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.628+0000 7f1bc759e700 1 --2- 172.21.15.114:0/362023946 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1bc815dcf0 0x7f1bc815f7a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:43.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.628+0000 7f1bc759e700 1 --2- 172.21.15.114:0/362023946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1bc80d23e0 0x7f1bc80b3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:43.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.628+0000 7f1bc759e700 1 -- 172.21.15.114:0/362023946 >> 172.21.15.114:0/362023946 conn(0x7f1bc8069f20 msgr2=0x7f1bc815c770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:43.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.628+0000 7f1bc759e700 1 -- 172.21.15.114:0/362023946 shutdown_connections 2023-10-18T12:20:43.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.628+0000 7f1bc759e700 1 -- 172.21.15.114:0/362023946 wait complete. 2023-10-18T12:20:43.655 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-18T12:20:43.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.836+0000 7f22f74f2700 1 Processor -- start 2023-10-18T12:20:43.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.836+0000 7f22f74f2700 1 -- start start 2023-10-18T12:20:43.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.836+0000 7f22f74f2700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f22f00d2e00 0x7f22f00b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:43.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.836+0000 7f22f74f2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f22f0160710 0x7f22f00d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:43.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.836+0000 7f22f74f2700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f22f00b5ae0 0x7f22f006db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:43.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.836+0000 7f22f74f2700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22f015df90 con 0x7f22f00b5ae0 2023-10-18T12:20:43.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.836+0000 7f22f74f2700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22f015d0d0 con 0x7f22f00d2e00 2023-10-18T12:20:43.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.836+0000 7f22f74f2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f006f0f0 con 0x7f22f0160710 2023-10-18T12:20:43.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.840+0000 7f22f6cf1700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f22f00b5ae0 0x7f22f006db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:43.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.840+0000 7f22f6cf1700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f22f00b5ae0 0x7f22f006db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39866/0 (socket says 172.21.15.114:39866) 2023-10-18T12:20:43.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.840+0000 7f22f6cf1700 1 -- 172.21.15.114:0/1842409912 learned_addr learned my addr 172.21.15.114:0/1842409912 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:43.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.840+0000 7f22f64f0700 1 --2- 172.21.15.114:0/1842409912 >> v2:172.21.15.172:3300/0 conn(0x7f22f00d2e00 0x7f22f00b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:43.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.840+0000 7f22f5cef700 1 --2- 172.21.15.114:0/1842409912 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f22f0160710 0x7f22f00d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:43.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.840+0000 7f22f6cf1700 1 -- 172.21.15.114:0/1842409912 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f22f0160710 msgr2=0x7f22f00d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:43.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.840+0000 7f22f6cf1700 1 --2- 172.21.15.114:0/1842409912 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f22f0160710 0x7f22f00d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:43.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.840+0000 7f22f6cf1700 1 -- 172.21.15.114:0/1842409912 >> v2:172.21.15.172:3300/0 conn(0x7f22f00d2e00 msgr2=0x7f22f00b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:43.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.840+0000 7f22f6cf1700 1 --2- 172.21.15.114:0/1842409912 >> v2:172.21.15.172:3300/0 conn(0x7f22f00d2e00 0x7f22f00b6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:43.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.840+0000 7f22f6cf1700 1 -- 172.21.15.114:0/1842409912 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f00d3720 con 0x7f22f00b5ae0 2023-10-18T12:20:43.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.840+0000 7f22f5cef700 1 --2- 172.21.15.114:0/1842409912 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f22f0160710 0x7f22f00d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:20:43.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.840+0000 7f22f6cf1700 1 --2- 172.21.15.114:0/1842409912 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22f00b5ae0 0x7f22f006db60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f22e8009e50 tx=0x7f22e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b9d2491e525b35e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:43.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.840+0000 7f22f54ee700 1 -- 172.21.15.114:0/1842409912 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e800e070 con 0x7f22f00b5ae0 2023-10-18T12:20:43.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.840+0000 7f22f54ee700 1 -- 172.21.15.114:0/1842409912 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e800b8d0 con 0x7f22f00b5ae0 2023-10-18T12:20:43.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.840+0000 7f22f54ee700 1 -- 172.21.15.114:0/1842409912 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e800bc80 con 0x7f22f00b5ae0 2023-10-18T12:20:43.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.840+0000 7f22f74f2700 1 -- 172.21.15.114:0/1842409912 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22f00b5ae0 msgr2=0x7f22f006db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:43.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.840+0000 7f22f74f2700 1 --2- 172.21.15.114:0/1842409912 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22f00b5ae0 0x7f22f006db60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f22e8009e50 tx=0x7f22e800b330 comp rx=0 tx=0).stop 2023-10-18T12:20:43.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.844+0000 7f22f74f2700 1 -- 172.21.15.114:0/1842409912 shutdown_connections 2023-10-18T12:20:43.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.844+0000 7f22f74f2700 1 --2- 172.21.15.114:0/1842409912 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22f00b5ae0 0x7f22f006db60 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:43.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.844+0000 7f22f74f2700 1 --2- 172.21.15.114:0/1842409912 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f22f0160710 0x7f22f00d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:43.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.844+0000 7f22f74f2700 1 --2- 172.21.15.114:0/1842409912 >> v2:172.21.15.172:3300/0 conn(0x7f22f00d2e00 0x7f22f00b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:43.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.844+0000 7f22f74f2700 1 -- 172.21.15.114:0/1842409912 >> 172.21.15.114:0/1842409912 conn(0x7f22f0069f20 msgr2=0x7f22f006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:43.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.844+0000 7f22f74f2700 1 -- 172.21.15.114:0/1842409912 shutdown_connections 2023-10-18T12:20:43.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.844+0000 7f22f74f2700 1 -- 172.21.15.114:0/1842409912 wait complete. 2023-10-18T12:20:43.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.844+0000 7f22f74f2700 1 Processor -- start 2023-10-18T12:20:43.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.844+0000 7f22f74f2700 1 -- start start 2023-10-18T12:20:43.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.848+0000 7f22f74f2700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22f00b5ae0 0x7f22f015c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:43.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.848+0000 7f22f74f2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f22f00d2e00 0x7f22f0155300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:43.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.848+0000 7f22f74f2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22f0160710 0x7f22f0155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:43.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.848+0000 7f22f74f2700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f00b3840 con 0x7f22f00b5ae0 2023-10-18T12:20:43.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.848+0000 7f22f74f2700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f0158590 con 0x7f22f0160710 2023-10-18T12:20:43.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.848+0000 7f22f74f2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f0158870 con 0x7f22f00d2e00 2023-10-18T12:20:43.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.848+0000 7f22f64f0700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22f00b5ae0 0x7f22f015c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:43.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.848+0000 7f22f64f0700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22f00b5ae0 0x7f22f015c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39876/0 (socket says 172.21.15.114:39876) 2023-10-18T12:20:43.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.848+0000 7f22f64f0700 1 -- 172.21.15.114:0/4091529403 learned_addr learned my addr 172.21.15.114:0/4091529403 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:43.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.848+0000 7f22f5cef700 1 --2- 172.21.15.114:0/4091529403 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f22f00d2e00 0x7f22f0155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:43.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.848+0000 7f22f6cf1700 1 --2- 172.21.15.114:0/4091529403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22f0160710 0x7f22f0155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:43.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.848+0000 7f22f64f0700 1 -- 172.21.15.114:0/4091529403 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f22f00d2e00 msgr2=0x7f22f0155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:43.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.848+0000 7f22f64f0700 1 --2- 172.21.15.114:0/4091529403 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f22f00d2e00 0x7f22f0155300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:43.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.848+0000 7f22f64f0700 1 -- 172.21.15.114:0/4091529403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22f0160710 msgr2=0x7f22f0155f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:43.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.848+0000 7f22f64f0700 1 --2- 172.21.15.114:0/4091529403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22f0160710 0x7f22f0155f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:43.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.848+0000 7f22f64f0700 1 -- 172.21.15.114:0/4091529403 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e8009b30 con 0x7f22f00b5ae0 2023-10-18T12:20:43.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.848+0000 7f22f64f0700 1 --2- 172.21.15.114:0/4091529403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22f00b5ae0 0x7f22f015c820 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f22ec00e7c0 tx=0x7f22ec00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:43.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.848+0000 7f22e6ffd700 1 -- 172.21.15.114:0/4091529403 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ec013680 con 0x7f22f00b5ae0 2023-10-18T12:20:43.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.848+0000 7f22e6ffd700 1 -- 172.21.15.114:0/4091529403 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ec0137e0 con 0x7f22f00b5ae0 2023-10-18T12:20:43.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.848+0000 7f22f74f2700 1 -- 172.21.15.114:0/4091529403 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22f0158b50 con 0x7f22f00b5ae0 2023-10-18T12:20:43.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.848+0000 7f22e6ffd700 1 -- 172.21.15.114:0/4091529403 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ec013b90 con 0x7f22f00b5ae0 2023-10-18T12:20:43.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.848+0000 7f22f74f2700 1 -- 172.21.15.114:0/4091529403 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22f01564d0 con 0x7f22f00b5ae0 2023-10-18T12:20:43.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.852+0000 7f22f74f2700 1 -- 172.21.15.114:0/4091529403 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22f004e910 con 0x7f22f00b5ae0 2023-10-18T12:20:43.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.852+0000 7f22e6ffd700 1 -- 172.21.15.114:0/4091529403 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f22ec013cf0 con 0x7f22f00b5ae0 2023-10-18T12:20:43.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.856+0000 7f22e6ffd700 1 --2- 172.21.15.114:0/4091529403 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f22d4065720 0x7f22d4067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:43.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.856+0000 7f22e6ffd700 1 -- 172.21.15.114:0/4091529403 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f22ec0830a0 con 0x7f22f00b5ae0 2023-10-18T12:20:43.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.856+0000 7f22f5cef700 1 --2- 172.21.15.114:0/4091529403 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f22d4065720 0x7f22d4067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:43.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.856+0000 7f22f5cef700 1 --2- 172.21.15.114:0/4091529403 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f22d4065720 0x7f22d4067be0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f22f00cf360 tx=0x7f22e0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:43.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:43.860+0000 7f22e6ffd700 1 -- 172.21.15.114:0/4091529403 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f22ec050820 con 0x7f22f00b5ae0 2023-10-18T12:20:44.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.036+0000 7f22f74f2700 1 -- 172.21.15.114:0/4091529403 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f22f00b3980 con 0x7f22f00b5ae0 2023-10-18T12:20:44.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.036+0000 7f22e6ffd700 1 -- 172.21.15.114:0/4091529403 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f22f00b3980 con 0x7f22f00b5ae0 2023-10-18T12:20:44.043 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-10-18T12:20:44.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.040+0000 7f22f74f2700 1 -- 172.21.15.114:0/4091529403 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f22d4065720 msgr2=0x7f22d4067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:44.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.040+0000 7f22f74f2700 1 --2- 172.21.15.114:0/4091529403 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f22d4065720 0x7f22d4067be0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f22f00cf360 tx=0x7f22e0008040 comp rx=0 tx=0).stop 2023-10-18T12:20:44.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.040+0000 7f22f74f2700 1 -- 172.21.15.114:0/4091529403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22f00b5ae0 msgr2=0x7f22f015c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:44.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.040+0000 7f22f74f2700 1 --2- 172.21.15.114:0/4091529403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22f00b5ae0 0x7f22f015c820 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f22ec00e7c0 tx=0x7f22ec00eb80 comp rx=0 tx=0).stop 2023-10-18T12:20:44.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.040+0000 7f22f74f2700 1 -- 172.21.15.114:0/4091529403 shutdown_connections 2023-10-18T12:20:44.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.040+0000 7f22f74f2700 1 --2- 172.21.15.114:0/4091529403 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f22d4065720 0x7f22d4067be0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:44.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.040+0000 7f22f74f2700 1 --2- 172.21.15.114:0/4091529403 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f22f00d2e00 0x7f22f0155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:44.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.040+0000 7f22f74f2700 1 --2- 172.21.15.114:0/4091529403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22f0160710 0x7f22f0155f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:44.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.040+0000 7f22f74f2700 1 --2- 172.21.15.114:0/4091529403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22f00b5ae0 0x7f22f015c820 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:44.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.040+0000 7f22f74f2700 1 -- 172.21.15.114:0/4091529403 >> 172.21.15.114:0/4091529403 conn(0x7f22f0069f20 msgr2=0x7f22f006a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:44.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.040+0000 7f22f74f2700 1 -- 172.21.15.114:0/4091529403 shutdown_connections 2023-10-18T12:20:44.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.040+0000 7f22f74f2700 1 -- 172.21.15.114:0/4091529403 wait complete. 2023-10-18T12:20:44.068 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-18T12:20:44.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.240+0000 7f21a8936700 1 Processor -- start 2023-10-18T12:20:44.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.240+0000 7f21a8936700 1 -- start start 2023-10-18T12:20:44.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.244+0000 7f21a8936700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f21a40d2e00 0x7f21a40b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:44.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.244+0000 7f21a8936700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f21a4160710 0x7f21a40d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:44.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.244+0000 7f21a8936700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f21a40b5ae0 0x7f21a406db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:44.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.244+0000 7f21a8936700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21a415df90 con 0x7f21a4160710 2023-10-18T12:20:44.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.244+0000 7f21a8936700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21a415d0d0 con 0x7f21a40b5ae0 2023-10-18T12:20:44.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.244+0000 7f21a8936700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a406f0f0 con 0x7f21a40d2e00 2023-10-18T12:20:44.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.244+0000 7f21a2ffd700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f21a4160710 0x7f21a40d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:44.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.244+0000 7f21a2ffd700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f21a4160710 0x7f21a40d31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39890/0 (socket says 172.21.15.114:39890) 2023-10-18T12:20:44.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.244+0000 7f21a2ffd700 1 -- 172.21.15.114:0/3333280648 learned_addr learned my addr 172.21.15.114:0/3333280648 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:44.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.244+0000 7f21a37fe700 1 --2- 172.21.15.114:0/3333280648 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f21a40d2e00 0x7f21a40b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:44.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.244+0000 7f21a3fff700 1 --2- 172.21.15.114:0/3333280648 >> v2:172.21.15.172:3300/0 conn(0x7f21a40b5ae0 0x7f21a406db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:44.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.244+0000 7f21a2ffd700 1 -- 172.21.15.114:0/3333280648 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f21a40d2e00 msgr2=0x7f21a40b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:44.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.244+0000 7f21a2ffd700 1 --2- 172.21.15.114:0/3333280648 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f21a40d2e00 0x7f21a40b6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:44.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.244+0000 7f21a2ffd700 1 -- 172.21.15.114:0/3333280648 >> v2:172.21.15.172:3300/0 conn(0x7f21a40b5ae0 msgr2=0x7f21a406db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:44.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.244+0000 7f21a2ffd700 1 --2- 172.21.15.114:0/3333280648 >> v2:172.21.15.172:3300/0 conn(0x7f21a40b5ae0 0x7f21a406db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:44.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.244+0000 7f21a2ffd700 1 -- 172.21.15.114:0/3333280648 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a40d3720 con 0x7f21a4160710 2023-10-18T12:20:44.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.244+0000 7f21a3fff700 1 --2- 172.21.15.114:0/3333280648 >> v2:172.21.15.172:3300/0 conn(0x7f21a40b5ae0 0x7f21a406db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:44.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.244+0000 7f21a2ffd700 1 --2- 172.21.15.114:0/3333280648 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21a4160710 0x7f21a40d31e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2198009910 tx=0x7f2198009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d80c409ab8a8b47 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:44.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.244+0000 7f21a27fc700 1 -- 172.21.15.114:0/3333280648 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2198011830 con 0x7f21a4160710 2023-10-18T12:20:44.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.244+0000 7f21a27fc700 1 -- 172.21.15.114:0/3333280648 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2198011990 con 0x7f21a4160710 2023-10-18T12:20:44.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.244+0000 7f21a27fc700 1 -- 172.21.15.114:0/3333280648 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2198011d40 con 0x7f21a4160710 2023-10-18T12:20:44.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.248+0000 7f21a8936700 1 -- 172.21.15.114:0/3333280648 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21a4160710 msgr2=0x7f21a40d31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:44.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.248+0000 7f21a8936700 1 --2- 172.21.15.114:0/3333280648 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21a4160710 0x7f21a40d31e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f2198009910 tx=0x7f2198009c20 comp rx=0 tx=0).stop 2023-10-18T12:20:44.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.248+0000 7f21a8936700 1 -- 172.21.15.114:0/3333280648 shutdown_connections 2023-10-18T12:20:44.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.248+0000 7f21a8936700 1 --2- 172.21.15.114:0/3333280648 >> v2:172.21.15.172:3300/0 conn(0x7f21a40b5ae0 0x7f21a406db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:44.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.248+0000 7f21a8936700 1 --2- 172.21.15.114:0/3333280648 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21a4160710 0x7f21a40d31e0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:44.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.248+0000 7f21a8936700 1 --2- 172.21.15.114:0/3333280648 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f21a40d2e00 0x7f21a40b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:44.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.248+0000 7f21a8936700 1 -- 172.21.15.114:0/3333280648 >> 172.21.15.114:0/3333280648 conn(0x7f21a4069f20 msgr2=0x7f21a406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:44.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.248+0000 7f21a8936700 1 -- 172.21.15.114:0/3333280648 shutdown_connections 2023-10-18T12:20:44.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.248+0000 7f21a8936700 1 -- 172.21.15.114:0/3333280648 wait complete. 2023-10-18T12:20:44.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.248+0000 7f21a8936700 1 Processor -- start 2023-10-18T12:20:44.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.248+0000 7f21a8936700 1 -- start start 2023-10-18T12:20:44.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.248+0000 7f21a8936700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21a40b5ae0 0x7f21a40af670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:44.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.248+0000 7f21a8936700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21a40d2e00 0x7f21a41581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:44.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.248+0000 7f21a8936700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f21a4160710 0x7f21a40b5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:44.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.248+0000 7f21a8936700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a40b56d0 con 0x7f21a40b5ae0 2023-10-18T12:20:44.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.248+0000 7f21a8936700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a40ae250 con 0x7f21a40d2e00 2023-10-18T12:20:44.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.248+0000 7f21a8936700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a40b4f00 con 0x7f21a4160710 2023-10-18T12:20:44.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.252+0000 7f21a37fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21a40b5ae0 0x7f21a40af670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:44.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.252+0000 7f21a37fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21a40b5ae0 0x7f21a40af670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39902/0 (socket says 172.21.15.114:39902) 2023-10-18T12:20:44.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.252+0000 7f21a37fe700 1 -- 172.21.15.114:0/3670633431 learned_addr learned my addr 172.21.15.114:0/3670633431 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:44.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.252+0000 7f21a3fff700 1 --2- 172.21.15.114:0/3670633431 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f21a4160710 0x7f21a40b5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:44.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.252+0000 7f21a2ffd700 1 --2- 172.21.15.114:0/3670633431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21a40d2e00 0x7f21a41581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:44.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.252+0000 7f21a37fe700 1 -- 172.21.15.114:0/3670633431 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f21a4160710 msgr2=0x7f21a40b5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:44.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.252+0000 7f21a37fe700 1 --2- 172.21.15.114:0/3670633431 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f21a4160710 0x7f21a40b5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:44.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.252+0000 7f21a37fe700 1 -- 172.21.15.114:0/3670633431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21a40d2e00 msgr2=0x7f21a41581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:44.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.252+0000 7f21a37fe700 1 --2- 172.21.15.114:0/3670633431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21a40d2e00 0x7f21a41581a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:44.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.252+0000 7f21a37fe700 1 -- 172.21.15.114:0/3670633431 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2198009570 con 0x7f21a40b5ae0 2023-10-18T12:20:44.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.252+0000 7f21a37fe700 1 --2- 172.21.15.114:0/3670633431 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21a40b5ae0 0x7f21a40af670 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f219400e870 tx=0x7f219400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:44.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.252+0000 7f218bfff700 1 -- 172.21.15.114:0/3670633431 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21940095a0 con 0x7f21a40b5ae0 2023-10-18T12:20:44.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.252+0000 7f218bfff700 1 -- 172.21.15.114:0/3670633431 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f219400ee70 con 0x7f21a40b5ae0 2023-10-18T12:20:44.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.252+0000 7f218bfff700 1 -- 172.21.15.114:0/3670633431 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219400c9f0 con 0x7f21a40b5ae0 2023-10-18T12:20:44.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.252+0000 7f21a8936700 1 -- 172.21.15.114:0/3670633431 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21a40afd50 con 0x7f21a40b5ae0 2023-10-18T12:20:44.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.252+0000 7f21a8936700 1 -- 172.21.15.114:0/3670633431 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21a40b0310 con 0x7f21a40b5ae0 2023-10-18T12:20:44.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.252+0000 7f21a8936700 1 -- 172.21.15.114:0/3670633431 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21a40b6d40 con 0x7f21a40b5ae0 2023-10-18T12:20:44.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.256+0000 7f218bfff700 1 -- 172.21.15.114:0/3670633431 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f219400cb50 con 0x7f21a40b5ae0 2023-10-18T12:20:44.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.256+0000 7f218bfff700 1 --2- 172.21.15.114:0/3670633431 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f21900656f0 0x7f2190067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:44.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.256+0000 7f218bfff700 1 -- 172.21.15.114:0/3670633431 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2194083080 con 0x7f21a40b5ae0 2023-10-18T12:20:44.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.256+0000 7f21a2ffd700 1 --2- 172.21.15.114:0/3670633431 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f21900656f0 0x7f2190067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:44.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.260+0000 7f21a2ffd700 1 --2- 172.21.15.114:0/3670633431 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f21900656f0 0x7f2190067bb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2198014040 tx=0x7f2198008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:44.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.264+0000 7f218bfff700 1 -- 172.21.15.114:0/3670633431 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f21940b3d40 con 0x7f21a40b5ae0 2023-10-18T12:20:44.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.448+0000 7f21a8936700 1 -- 172.21.15.114:0/3670633431 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f21a404e910 con 0x7f21a40b5ae0 2023-10-18T12:20:44.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.448+0000 7f218bfff700 1 -- 172.21.15.114:0/3670633431 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2194054290 con 0x7f21a40b5ae0 2023-10-18T12:20:44.455 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-10-18T12:20:44.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.452+0000 7f21a8936700 1 -- 172.21.15.114:0/3670633431 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f21900656f0 msgr2=0x7f2190067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:44.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.452+0000 7f21a8936700 1 --2- 172.21.15.114:0/3670633431 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f21900656f0 0x7f2190067bb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2198014040 tx=0x7f2198008030 comp rx=0 tx=0).stop 2023-10-18T12:20:44.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.452+0000 7f21a8936700 1 -- 172.21.15.114:0/3670633431 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21a40b5ae0 msgr2=0x7f21a40af670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:44.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.452+0000 7f21a8936700 1 --2- 172.21.15.114:0/3670633431 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21a40b5ae0 0x7f21a40af670 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f219400e870 tx=0x7f219400ec30 comp rx=0 tx=0).stop 2023-10-18T12:20:44.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.452+0000 7f21a8936700 1 -- 172.21.15.114:0/3670633431 shutdown_connections 2023-10-18T12:20:44.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.452+0000 7f21a8936700 1 --2- 172.21.15.114:0/3670633431 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f21900656f0 0x7f2190067bb0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:44.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.452+0000 7f21a8936700 1 --2- 172.21.15.114:0/3670633431 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f21a4160710 0x7f21a40b5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:44.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.452+0000 7f21a8936700 1 --2- 172.21.15.114:0/3670633431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f21a40d2e00 0x7f21a41581a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:44.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.452+0000 7f21a8936700 1 --2- 172.21.15.114:0/3670633431 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21a40b5ae0 0x7f21a40af670 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:44.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.452+0000 7f21a8936700 1 -- 172.21.15.114:0/3670633431 >> 172.21.15.114:0/3670633431 conn(0x7f21a4069f20 msgr2=0x7f21a406a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:44.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.452+0000 7f21a8936700 1 -- 172.21.15.114:0/3670633431 shutdown_connections 2023-10-18T12:20:44.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.452+0000 7f21a8936700 1 -- 172.21.15.114:0/3670633431 wait complete. 2023-10-18T12:20:44.481 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-18T12:20:44.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.648+0000 7f0d4d820700 1 Processor -- start 2023-10-18T12:20:44.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.648+0000 7f0d4d820700 1 -- start start 2023-10-18T12:20:44.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.652+0000 7f0d4d820700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0d480cb500 0x7f0d480b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:44.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.652+0000 7f0d4d820700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d480b2720 0x7f0d4806fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:44.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.652+0000 7f0d4d820700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d480b16d0 con 0x7f0d48160e50 2023-10-18T12:20:44.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.652+0000 7f0d4d820700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d480b1ee0 con 0x7f0d480cb500 2023-10-18T12:20:44.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.652+0000 7f0d4d820700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d480b2bb0 con 0x7f0d480b2720 2023-10-18T12:20:44.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.652+0000 7f0d4c81e700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f0d48160e50 0x7f0d4806e3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:56120/0 (socket says 172.21.15.114:56120) 2023-10-18T12:20:44.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.652+0000 7f0d4c81e700 1 -- 172.21.15.114:0/2862382879 learned_addr learned my addr 172.21.15.114:0/2862382879 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:44.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.652+0000 7f0d3ffff700 1 --2- 172.21.15.114:0/2862382879 >> v2:172.21.15.172:3300/0 conn(0x7f0d480cb500 0x7f0d480b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:44.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.652+0000 7f0d3f7fe700 1 -- 172.21.15.114:0/2862382879 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 934470395 0 0) 0x7f0d480b16d0 con 0x7f0d48160e50 2023-10-18T12:20:44.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.652+0000 7f0d3f7fe700 1 -- 172.21.15.114:0/2862382879 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d300035d0 con 0x7f0d48160e50 2023-10-18T12:20:44.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.652+0000 7f0d4d01f700 1 --2- 172.21.15.114:0/2862382879 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d480b2720 0x7f0d4806fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:44.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.652+0000 7f0d3f7fe700 1 -- 172.21.15.114:0/2862382879 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3698433253 0 0) 0x7f0d300035d0 con 0x7f0d48160e50 2023-10-18T12:20:44.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.652+0000 7f0d3f7fe700 1 -- 172.21.15.114:0/2862382879 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d480b2720 msgr2=0x7f0d4806fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:44.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.652+0000 7f0d3f7fe700 1 --2- 172.21.15.114:0/2862382879 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d480b2720 0x7f0d4806fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:44.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.652+0000 7f0d3f7fe700 1 -- 172.21.15.114:0/2862382879 >> v2:172.21.15.172:3300/0 conn(0x7f0d480cb500 msgr2=0x7f0d480b21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:44.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.652+0000 7f0d3f7fe700 1 --2- 172.21.15.114:0/2862382879 >> v2:172.21.15.172:3300/0 conn(0x7f0d480cb500 0x7f0d480b21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:44.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.652+0000 7f0d3f7fe700 1 -- 172.21.15.114:0/2862382879 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d4806eaf0 con 0x7f0d48160e50 2023-10-18T12:20:44.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.652+0000 7f0d3f7fe700 1 -- 172.21.15.114:0/2862382879 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3368469509 0 0) 0x7f0d440019f0 con 0x7f0d48160e50 2023-10-18T12:20:44.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.652+0000 7f0d3f7fe700 1 -- 172.21.15.114:0/2862382879 >> v1:172.21.15.114:6789/0 conn(0x7f0d48160e50 legacy=0x7f0d4806e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:44.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.652+0000 7f0d3f7fe700 1 --2- 172.21.15.114:0/2862382879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d30003a20 0x7f0d30003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:44.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.652+0000 7f0d3f7fe700 1 --2- 172.21.15.114:0/2862382879 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d30004870 0x7f0d30004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:44.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.652+0000 7f0d3f7fe700 1 --2- 172.21.15.114:0/2862382879 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d30005230 0x7f0d3000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:44.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.652+0000 7f0d3f7fe700 1 -- 172.21.15.114:0/2862382879 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d480b1ee0 con 0x7f0d30005230 2023-10-18T12:20:44.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.652+0000 7f0d3f7fe700 1 -- 172.21.15.114:0/2862382879 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d480b2bb0 con 0x7f0d30003a20 2023-10-18T12:20:44.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.652+0000 7f0d3f7fe700 1 -- 172.21.15.114:0/2862382879 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3000c0a0 con 0x7f0d30004870 2023-10-18T12:20:44.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.652+0000 7f0d4d01f700 1 --2- 172.21.15.114:0/2862382879 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d480b2720 0x7f0d4806fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:44.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.652+0000 7f0d4d01f700 1 --2- 172.21.15.114:0/2862382879 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d30005230 0x7f0d3000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:44.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.652+0000 7f0d4c81e700 1 --2- 172.21.15.114:0/2862382879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d30003a20 0x7f0d30003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:44.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.652+0000 7f0d3ffff700 1 --2- 172.21.15.114:0/2862382879 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d30004870 0x7f0d30004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:44.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.652+0000 7f0d4d01f700 1 -- 172.21.15.114:0/2862382879 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d30004870 msgr2=0x7f0d30004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:44.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.652+0000 7f0d4d01f700 1 --2- 172.21.15.114:0/2862382879 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d30004870 0x7f0d30004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:44.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.652+0000 7f0d4d01f700 1 -- 172.21.15.114:0/2862382879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d30003a20 msgr2=0x7f0d30003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:44.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.652+0000 7f0d4d01f700 1 --2- 172.21.15.114:0/2862382879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d30003a20 0x7f0d30003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:44.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.652+0000 7f0d4d01f700 1 -- 172.21.15.114:0/2862382879 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d300035d0 con 0x7f0d30005230 2023-10-18T12:20:44.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.656+0000 7f0d4d01f700 1 --2- 172.21.15.114:0/2862382879 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d30005230 0x7f0d3000ba30 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0d480b2b00 tx=0x7f0d300058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa0b6aa11ee149ce server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:44.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.656+0000 7f0d3f7fe700 1 -- 172.21.15.114:0/2862382879 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d40004230 con 0x7f0d30005230 2023-10-18T12:20:44.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.656+0000 7f0d3f7fe700 1 -- 172.21.15.114:0/2862382879 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d40004390 con 0x7f0d30005230 2023-10-18T12:20:44.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.656+0000 7f0d3f7fe700 1 -- 172.21.15.114:0/2862382879 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d400036c0 con 0x7f0d30005230 2023-10-18T12:20:44.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.656+0000 7f0d4d820700 1 -- 172.21.15.114:0/2862382879 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d30005230 msgr2=0x7f0d3000ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:44.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.656+0000 7f0d4d820700 1 --2- 172.21.15.114:0/2862382879 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d30005230 0x7f0d3000ba30 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0d480b2b00 tx=0x7f0d300058a0 comp rx=0 tx=0).stop 2023-10-18T12:20:44.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.656+0000 7f0d4d01f700 1 -- 172.21.15.114:0/2862382879 reap_dead start 2023-10-18T12:20:44.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.656+0000 7f0d4d820700 1 -- 172.21.15.114:0/2862382879 shutdown_connections 2023-10-18T12:20:44.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.656+0000 7f0d4d820700 1 -- 172.21.15.114:0/2862382879 >> 172.21.15.114:0/2862382879 conn(0x7f0d480b0bf0 msgr2=0x7f0d480ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:44.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.656+0000 7f0d4d820700 1 -- 172.21.15.114:0/2862382879 shutdown_connections 2023-10-18T12:20:44.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.656+0000 7f0d4d820700 1 -- 172.21.15.114:0/2862382879 wait complete. 2023-10-18T12:20:44.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.660+0000 7f0d4d820700 1 Processor -- start 2023-10-18T12:20:44.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.660+0000 7f0d4d820700 1 -- start start 2023-10-18T12:20:44.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.660+0000 7f0d4d820700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d30005230 0x7f0d481ebbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:44.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.660+0000 7f0d4d820700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d481ea1a0 0x7f0d480a74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:44.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.660+0000 7f0d4d820700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d48163a40 0x7f0d4815a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:44.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.660+0000 7f0d4d820700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d48161e20 con 0x7f0d30005230 2023-10-18T12:20:44.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.660+0000 7f0d4d820700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d48161230 con 0x7f0d48163a40 2023-10-18T12:20:44.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.660+0000 7f0d4d820700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d48161480 con 0x7f0d481ea1a0 2023-10-18T12:20:44.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.660+0000 7f0d4c81e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d30005230 0x7f0d481ebbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:44.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.660+0000 7f0d4c81e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d30005230 0x7f0d481ebbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39928/0 (socket says 172.21.15.114:39928) 2023-10-18T12:20:44.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.660+0000 7f0d4c81e700 1 -- 172.21.15.114:0/2096563776 learned_addr learned my addr 172.21.15.114:0/2096563776 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:44.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.664+0000 7f0d3ffff700 1 --2- 172.21.15.114:0/2096563776 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d481ea1a0 0x7f0d480a74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:44.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.664+0000 7f0d4d01f700 1 --2- 172.21.15.114:0/2096563776 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d48163a40 0x7f0d4815a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:44.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.664+0000 7f0d4c81e700 1 -- 172.21.15.114:0/2096563776 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d481ea1a0 msgr2=0x7f0d480a74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:44.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.664+0000 7f0d4c81e700 1 --2- 172.21.15.114:0/2096563776 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d481ea1a0 0x7f0d480a74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:44.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.664+0000 7f0d4c81e700 1 -- 172.21.15.114:0/2096563776 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d48163a40 msgr2=0x7f0d4815a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:44.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.664+0000 7f0d4c81e700 1 --2- 172.21.15.114:0/2096563776 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d48163a40 0x7f0d4815a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:44.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.664+0000 7f0d4c81e700 1 -- 172.21.15.114:0/2096563776 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d48161760 con 0x7f0d30005230 2023-10-18T12:20:44.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.664+0000 7f0d3ffff700 1 --2- 172.21.15.114:0/2096563776 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d481ea1a0 0x7f0d480a74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:44.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.664+0000 7f0d4c81e700 1 --2- 172.21.15.114:0/2096563776 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d30005230 0x7f0d481ebbf0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0d4400a490 tx=0x7f0d4400a4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:44.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.664+0000 7f0d3d7fa700 1 -- 172.21.15.114:0/2096563776 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4400ac60 con 0x7f0d30005230 2023-10-18T12:20:44.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.664+0000 7f0d3d7fa700 1 -- 172.21.15.114:0/2096563776 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4400adc0 con 0x7f0d30005230 2023-10-18T12:20:44.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.664+0000 7f0d4d820700 1 -- 172.21.15.114:0/2096563776 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d48161a40 con 0x7f0d30005230 2023-10-18T12:20:44.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.664+0000 7f0d3d7fa700 1 -- 172.21.15.114:0/2096563776 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d44013630 con 0x7f0d30005230 2023-10-18T12:20:44.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.664+0000 7f0d4d820700 1 -- 172.21.15.114:0/2096563776 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d480a7a10 con 0x7f0d30005230 2023-10-18T12:20:44.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.664+0000 7f0d4d820700 1 -- 172.21.15.114:0/2096563776 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d48164490 con 0x7f0d30005230 2023-10-18T12:20:44.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.668+0000 7f0d3d7fa700 1 -- 172.21.15.114:0/2096563776 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f0d44013790 con 0x7f0d30005230 2023-10-18T12:20:44.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.668+0000 7f0d3d7fa700 1 --2- 172.21.15.114:0/2096563776 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0d34065720 0x7f0d34067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:44.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.668+0000 7f0d3d7fa700 1 -- 172.21.15.114:0/2096563776 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0d44083cd0 con 0x7f0d30005230 2023-10-18T12:20:44.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.668+0000 7f0d3ffff700 1 --2- 172.21.15.114:0/2096563776 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0d34065720 0x7f0d34067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:44.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.668+0000 7f0d3ffff700 1 --2- 172.21.15.114:0/2096563776 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0d34065720 0x7f0d34067be0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0d481f9f40 tx=0x7f0d38008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:44.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.676+0000 7f0d3d7fa700 1 -- 172.21.15.114:0/2096563776 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f0d44051450 con 0x7f0d30005230 2023-10-18T12:20:44.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.880+0000 7f0d4d820700 1 -- 172.21.15.114:0/2096563776 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0d48072e60 con 0x7f0d30005230 2023-10-18T12:20:44.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.884+0000 7f0d3d7fa700 1 -- 172.21.15.114:0/2096563776 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0d44017070 con 0x7f0d30005230 2023-10-18T12:20:44.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.884+0000 7f0d4d820700 1 -- 172.21.15.114:0/2096563776 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0d34065720 msgr2=0x7f0d34067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:44.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.884+0000 7f0d4d820700 1 --2- 172.21.15.114:0/2096563776 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0d34065720 0x7f0d34067be0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0d481f9f40 tx=0x7f0d38008040 comp rx=0 tx=0).stop 2023-10-18T12:20:44.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.884+0000 7f0d4d820700 1 -- 172.21.15.114:0/2096563776 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d30005230 msgr2=0x7f0d481ebbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:44.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.884+0000 7f0d4d820700 1 --2- 172.21.15.114:0/2096563776 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d30005230 0x7f0d481ebbf0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0d4400a490 tx=0x7f0d4400a4c0 comp rx=0 tx=0).stop 2023-10-18T12:20:44.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.884+0000 7f0d4d820700 1 -- 172.21.15.114:0/2096563776 shutdown_connections 2023-10-18T12:20:44.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.884+0000 7f0d4d820700 1 --2- 172.21.15.114:0/2096563776 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0d34065720 0x7f0d34067be0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:44.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.884+0000 7f0d4d820700 1 --2- 172.21.15.114:0/2096563776 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0d481ea1a0 0x7f0d480a74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:44.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.884+0000 7f0d4d820700 1 --2- 172.21.15.114:0/2096563776 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0d48163a40 0x7f0d4815a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:44.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.884+0000 7f0d4d820700 1 --2- 172.21.15.114:0/2096563776 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d30005230 0x7f0d481ebbf0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:44.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.884+0000 7f0d4d820700 1 -- 172.21.15.114:0/2096563776 >> 172.21.15.114:0/2096563776 conn(0x7f0d480b0bf0 msgr2=0x7f0d4806fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:44.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.884+0000 7f0d4d820700 1 -- 172.21.15.114:0/2096563776 shutdown_connections 2023-10-18T12:20:44.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:44.884+0000 7f0d4d820700 1 -- 172.21.15.114:0/2096563776 wait complete. 2023-10-18T12:20:44.894 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2023-10-18T12:20:44.913 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-18T12:20:44.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:44.914 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-18T12:20:44.966 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2023-10-18T12:20:44.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:44.967 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-18T12:20:45.026 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T12:20:45.026 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-18T12:20:45.048 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T12:20:45.048 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-18T12:20:45.109 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T12:20:45.110 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-18T12:20:45.171 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T12:20:45.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.344+0000 7f5de814d700 1 Processor -- start 2023-10-18T12:20:45.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.344+0000 7f5de814d700 1 -- start start 2023-10-18T12:20:45.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.348+0000 7f5de814d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5de0155420 0x7f5de00cb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:45.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.348+0000 7f5de814d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5de015bf00 0x7f5de00cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:45.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.348+0000 7f5de814d700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5de00cbc80 con 0x7f5de00b0f90 2023-10-18T12:20:45.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.348+0000 7f5de814d700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5de0155800 con 0x7f5de0155420 2023-10-18T12:20:45.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.348+0000 7f5de814d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de00cb9a0 con 0x7f5de015bf00 2023-10-18T12:20:45.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.348+0000 7f5de5ee9700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5de0155420 0x7f5de00cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:45.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.348+0000 7f5de66ea700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f5de00b0f90 0x7f5de00cc680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49856/0 (socket says 172.21.15.114:49856) 2023-10-18T12:20:45.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.348+0000 7f5de66ea700 1 -- 172.21.15.114:0/1691058186 learned_addr learned my addr 172.21.15.114:0/1691058186 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:45.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.348+0000 7f5de56e8700 1 --2- 172.21.15.114:0/1691058186 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5de015bf00 0x7f5de00cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:45.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.348+0000 7f5de5ee9700 1 -- 172.21.15.114:0/1691058186 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5de015bf00 msgr2=0x7f5de00cdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:45.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.348+0000 7f5de5ee9700 1 --2- 172.21.15.114:0/1691058186 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5de015bf00 0x7f5de00cdc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:45.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.348+0000 7f5de5ee9700 1 -- 172.21.15.114:0/1691058186 >> v1:172.21.15.114:6789/0 conn(0x7f5de00b0f90 legacy=0x7f5de00cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:45.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.348+0000 7f5de5ee9700 1 -- 172.21.15.114:0/1691058186 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de015b420 con 0x7f5de0155420 2023-10-18T12:20:45.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.348+0000 7f5de4ee7700 1 -- 172.21.15.114:0/1691058186 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3027067660 0 0) 0x7f5de00cbc80 con 0x7f5de00b0f90 2023-10-18T12:20:45.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.352+0000 7f5de5ee9700 1 --2- 172.21.15.114:0/1691058186 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5de0155420 0x7f5de00cb150 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc009850 tx=0x7f5ddc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2706f770d8a2c359 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:45.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.352+0000 7f5de4ee7700 1 -- 172.21.15.114:0/1691058186 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc011830 con 0x7f5de0155420 2023-10-18T12:20:45.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.352+0000 7f5de4ee7700 1 -- 172.21.15.114:0/1691058186 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ddc011990 con 0x7f5de0155420 2023-10-18T12:20:45.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.352+0000 7f5de4ee7700 1 -- 172.21.15.114:0/1691058186 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc011d40 con 0x7f5de0155420 2023-10-18T12:20:45.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.352+0000 7f5de814d700 1 -- 172.21.15.114:0/1691058186 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5de0155420 msgr2=0x7f5de00cb150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:45.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.352+0000 7f5de814d700 1 --2- 172.21.15.114:0/1691058186 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5de0155420 0x7f5de00cb150 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc009850 tx=0x7f5ddc009b60 comp rx=0 tx=0).stop 2023-10-18T12:20:45.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.352+0000 7f5de814d700 1 -- 172.21.15.114:0/1691058186 shutdown_connections 2023-10-18T12:20:45.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.352+0000 7f5de814d700 1 --2- 172.21.15.114:0/1691058186 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5de015bf00 0x7f5de00cdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:45.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.352+0000 7f5de814d700 1 --2- 172.21.15.114:0/1691058186 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5de0155420 0x7f5de00cb150 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:45.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.352+0000 7f5de814d700 1 -- 172.21.15.114:0/1691058186 >> 172.21.15.114:0/1691058186 conn(0x7f5de006a340 msgr2=0x7f5de00b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:45.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.352+0000 7f5de814d700 1 -- 172.21.15.114:0/1691058186 shutdown_connections 2023-10-18T12:20:45.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.352+0000 7f5de814d700 1 -- 172.21.15.114:0/1691058186 wait complete. 2023-10-18T12:20:45.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.356+0000 7f5de814d700 1 Processor -- start 2023-10-18T12:20:45.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.356+0000 7f5de814d700 1 -- start start 2023-10-18T12:20:45.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.356+0000 7f5de814d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5de00b0f90 0x7f5de00ad710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:45.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.356+0000 7f5de814d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5de0155420 0x7f5de01f1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:45.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.356+0000 7f5de814d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5de015bf00 0x7f5de00cc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:45.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.356+0000 7f5de814d700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de01f2290 con 0x7f5de0155420 2023-10-18T12:20:45.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.356+0000 7f5de814d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de0134c70 con 0x7f5de015bf00 2023-10-18T12:20:45.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.356+0000 7f5de814d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de01371e0 con 0x7f5de00b0f90 2023-10-18T12:20:45.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.356+0000 7f5de56e8700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5de0155420 0x7f5de01f1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:45.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.356+0000 7f5de56e8700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5de0155420 0x7f5de01f1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39530/0 (socket says 172.21.15.114:39530) 2023-10-18T12:20:45.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.356+0000 7f5de56e8700 1 -- 172.21.15.114:0/1499180824 learned_addr learned my addr 172.21.15.114:0/1499180824 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:45.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.356+0000 7f5de5ee9700 1 --2- 172.21.15.114:0/1499180824 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5de00b0f90 0x7f5de00ad710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:45.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.356+0000 7f5de66ea700 1 --2- 172.21.15.114:0/1499180824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5de015bf00 0x7f5de00cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:45.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.360+0000 7f5de56e8700 1 -- 172.21.15.114:0/1499180824 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5de00b0f90 msgr2=0x7f5de00ad710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:45.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.360+0000 7f5de56e8700 1 --2- 172.21.15.114:0/1499180824 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5de00b0f90 0x7f5de00ad710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:45.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.360+0000 7f5de56e8700 1 -- 172.21.15.114:0/1499180824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5de015bf00 msgr2=0x7f5de00cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:45.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.360+0000 7f5de56e8700 1 --2- 172.21.15.114:0/1499180824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5de015bf00 0x7f5de00cc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:45.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.360+0000 7f5de56e8700 1 -- 172.21.15.114:0/1499180824 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ddc0094b0 con 0x7f5de0155420 2023-10-18T12:20:45.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.360+0000 7f5de66ea700 1 --2- 172.21.15.114:0/1499180824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5de015bf00 0x7f5de00cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:45.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.360+0000 7f5de56e8700 1 --2- 172.21.15.114:0/1499180824 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5de0155420 0x7f5de01f1d50 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5dd000ebe0 tx=0x7f5dd000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:45.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.360+0000 7f5dd67fc700 1 -- 172.21.15.114:0/1499180824 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd0009740 con 0x7f5de0155420 2023-10-18T12:20:45.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.360+0000 7f5dd67fc700 1 -- 172.21.15.114:0/1499180824 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd000c850 con 0x7f5de0155420 2023-10-18T12:20:45.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.360+0000 7f5dd67fc700 1 -- 172.21.15.114:0/1499180824 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd000cbe0 con 0x7f5de0155420 2023-10-18T12:20:45.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.360+0000 7f5de814d700 1 -- 172.21.15.114:0/1499180824 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5de01374c0 con 0x7f5de0155420 2023-10-18T12:20:45.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.360+0000 7f5de814d700 1 -- 172.21.15.114:0/1499180824 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5de0137a80 con 0x7f5de0155420 2023-10-18T12:20:45.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.360+0000 7f5de814d700 1 -- 172.21.15.114:0/1499180824 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5de0134e20 con 0x7f5de0155420 2023-10-18T12:20:45.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.360+0000 7f5dd67fc700 1 -- 172.21.15.114:0/1499180824 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f5dd000cd40 con 0x7f5de0155420 2023-10-18T12:20:45.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.364+0000 7f5dd67fc700 1 --2- 172.21.15.114:0/1499180824 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5dc4065720 0x7f5dc4067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:45.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.364+0000 7f5dd67fc700 1 -- 172.21.15.114:0/1499180824 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5dd0083210 con 0x7f5de0155420 2023-10-18T12:20:45.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.364+0000 7f5de5ee9700 1 --2- 172.21.15.114:0/1499180824 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5dc4065720 0x7f5dc4067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:45.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.364+0000 7f5de5ee9700 1 --2- 172.21.15.114:0/1499180824 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5dc4065720 0x7f5dc4067be0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc0090b0 tx=0x7f5ddc01c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:45.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.372+0000 7f5dd67fc700 1 -- 172.21.15.114:0/1499180824 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f5de0134e20 con 0x7f5de0155420 2023-10-18T12:20:45.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.548+0000 7f5de814d700 1 -- 172.21.15.114:0/1499180824 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5de0137ca0 con 0x7f5de0155420 2023-10-18T12:20:45.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.552+0000 7f5dd67fc700 1 -- 172.21.15.114:0/1499180824 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20240 (secure 0 0 0) 0x7f5dd0050900 con 0x7f5de0155420 2023-10-18T12:20:45.558 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:20:45.558 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":30,"fsid":"240ea340-5d3d-4f52-a4bc-af075aca3deb","created":"2023-10-18T12:19:12.512994+0000","modified":"2023-10-18T12:20:20.604528+0000","last_up_change":"2023-10-18T12:19:25.286009+0000","last_in_change":"2023-10-18T12:19:15.850693+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T12:19:27.040638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-18T12:19:32.358094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-18T12:19:37.333855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-18T12:19:38.055385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-18T12:19:41.679218+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c3578978-1a03-4857-b9d2-34a5da3d7731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6817","nonce":1506287862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6820","nonce":1506287862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6830","nonce":1506287862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6825","nonce":1506287862}]},"public_addr":"172.21.15.114:6817/1506287862","cluster_addr":"172.21.15.114:6820/1506287862","heartbeat_back_addr":"172.21.15.114:6830/1506287862","heartbeat_front_addr":"172.21.15.114:6825/1506287862","state":["exists","up"]},{"osd":1,"uuid":"43eb26a6-e2b3-4670-9559-bd053b5140d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6801","nonce":3302727047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6803","nonce":3302727047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6807","nonce":3302727047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6805","nonce":3302727047}]},"public_addr":"172.21.15.114:6801/3302727047","cluster_addr":"172.21.15.114:6803/3302727047","heartbeat_back_addr":"172.21.15.114:6807/3302727047","heartbeat_front_addr":"172.21.15.114:6805/3302727047","state":["exists","up"]},{"osd":2,"uuid":"f3d4dbd5-521c-4dd2-b687-5768cc7d0938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6809","nonce":2699151351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6811","nonce":2699151351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6815","nonce":2699151351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6813","nonce":2699151351}]},"public_addr":"172.21.15.114:6809/2699151351","cluster_addr":"172.21.15.114:6811/2699151351","heartbeat_back_addr":"172.21.15.114:6815/2699151351","heartbeat_front_addr":"172.21.15.114:6813/2699151351","state":["exists","up"]},{"osd":3,"uuid":"823e5802-92b7-4f0d-b32d-a5748993f1b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6821","nonce":1361608073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6824","nonce":1361608073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6829","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6831","nonce":1361608073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6827","nonce":1361608073}]},"public_addr":"172.21.15.114:6821/1361608073","cluster_addr":"172.21.15.114:6824/1361608073","heartbeat_back_addr":"172.21.15.114:6831/1361608073","heartbeat_front_addr":"172.21.15.114:6827/1361608073","state":["exists","up"]},{"osd":4,"uuid":"e47fb93e-13b4-44a4-b084-8c4384ceb41e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6801","nonce":930839681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6803","nonce":930839681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6807","nonce":930839681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6805","nonce":930839681}]},"public_addr":"172.21.15.172:6801/930839681","cluster_addr":"172.21.15.172:6803/930839681","heartbeat_back_addr":"172.21.15.172:6807/930839681","heartbeat_front_addr":"172.21.15.172:6805/930839681","state":["exists","up"]},{"osd":5,"uuid":"7561a973-f479-45a0-af40-f324728d622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6814","nonce":571761850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6818","nonce":571761850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6824","nonce":571761850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6821","nonce":571761850}]},"public_addr":"172.21.15.172:6814/571761850","cluster_addr":"172.21.15.172:6818/571761850","heartbeat_back_addr":"172.21.15.172:6824/571761850","heartbeat_front_addr":"172.21.15.172:6821/571761850","state":["exists","up"]},{"osd":6,"uuid":"51753f4b-7f06-4f1c-9ec7-6e18a66eb980","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6825","nonce":1680398853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6827","nonce":1680398853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6831","nonce":1680398853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6829","nonce":1680398853}]},"public_addr":"172.21.15.172:6825/1680398853","cluster_addr":"172.21.15.172:6827/1680398853","heartbeat_back_addr":"172.21.15.172:6831/1680398853","heartbeat_front_addr":"172.21.15.172:6829/1680398853","state":["exists","up"]},{"osd":7,"uuid":"4d8b1e15-143d-4d17-9074-59d92f0f9af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6809","nonce":349710101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6811","nonce":349710101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6819","nonce":349710101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6815","nonce":349710101}]},"public_addr":"172.21.15.172:6809/349710101","cluster_addr":"172.21.15.172:6811/349710101","heartbeat_back_addr":"172.21.15.172:6819/349710101","heartbeat_front_addr":"172.21.15.172:6815/349710101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.889460+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.475494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.911473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.648596+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.609994+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.636248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.854589+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.885826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T12:20:45.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.556+0000 7f5de814d700 1 -- 172.21.15.114:0/1499180824 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5dc4065720 msgr2=0x7f5dc4067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:45.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.556+0000 7f5de814d700 1 --2- 172.21.15.114:0/1499180824 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5dc4065720 0x7f5dc4067be0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc0090b0 tx=0x7f5ddc01c040 comp rx=0 tx=0).stop 2023-10-18T12:20:45.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.556+0000 7f5de814d700 1 -- 172.21.15.114:0/1499180824 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5de0155420 msgr2=0x7f5de01f1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:45.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.556+0000 7f5de814d700 1 --2- 172.21.15.114:0/1499180824 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5de0155420 0x7f5de01f1d50 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5dd000ebe0 tx=0x7f5dd000eef0 comp rx=0 tx=0).stop 2023-10-18T12:20:45.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.556+0000 7f5de814d700 1 -- 172.21.15.114:0/1499180824 shutdown_connections 2023-10-18T12:20:45.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.556+0000 7f5de814d700 1 --2- 172.21.15.114:0/1499180824 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5dc4065720 0x7f5dc4067be0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:45.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.556+0000 7f5de814d700 1 --2- 172.21.15.114:0/1499180824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5de015bf00 0x7f5de00cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:45.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.556+0000 7f5de814d700 1 --2- 172.21.15.114:0/1499180824 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5de0155420 0x7f5de01f1d50 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:45.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.556+0000 7f5de814d700 1 --2- 172.21.15.114:0/1499180824 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5de00b0f90 0x7f5de00ad710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:45.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.556+0000 7f5de814d700 1 -- 172.21.15.114:0/1499180824 >> 172.21.15.114:0/1499180824 conn(0x7f5de006a340 msgr2=0x7f5de0143ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:45.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.556+0000 7f5de814d700 1 -- 172.21.15.114:0/1499180824 shutdown_connections 2023-10-18T12:20:45.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.556+0000 7f5de814d700 1 -- 172.21.15.114:0/1499180824 wait complete. 2023-10-18T12:20:45.584 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-18T12:19:27.040638+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-18T12:19:32.358094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-18T12:19:37.333855+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-18T12:19:38.055385+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-18T12:19:41.679218+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-18T12:20:45.585 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-18T12:20:45.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.756+0000 7f82ab59e700 1 Processor -- start 2023-10-18T12:20:45.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.756+0000 7f82ab59e700 1 -- start start 2023-10-18T12:20:45.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.756+0000 7f82ab59e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f82ac160710 0x7f82ac0b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:45.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.756+0000 7f82ab59e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f82ac0b5ae0 0x7f82ac06db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:45.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.756+0000 7f82ab59e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82ac15d0d0 con 0x7f82ac0d2e00 2023-10-18T12:20:45.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.756+0000 7f82ab59e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82ac15df90 con 0x7f82ac160710 2023-10-18T12:20:45.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.756+0000 7f82ab59e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82ac06f0f0 con 0x7f82ac0b5ae0 2023-10-18T12:20:45.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.756+0000 7f82a9d9b700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f82ac160710 0x7f82ac0b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:45.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.760+0000 7f82a9d9b700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f82ac160710 0x7f82ac0b6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39544/0 (socket says 172.21.15.114:39544) 2023-10-18T12:20:45.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.760+0000 7f82a9d9b700 1 -- 172.21.15.114:0/3554030992 learned_addr learned my addr 172.21.15.114:0/3554030992 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:45.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.760+0000 7f82aad9d700 1 --2- 172.21.15.114:0/3554030992 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f82ac0b5ae0 0x7f82ac06db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:45.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.760+0000 7f82aa59c700 1 --1- 172.21.15.114:0/3554030992 >> v1:172.21.15.172:6789/0 conn(0x7f82ac0d2e00 0x7f82ac0d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.114:39514/0 (socket says 172.21.15.114:39514) 2023-10-18T12:20:45.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.760+0000 7f82a9d9b700 1 -- 172.21.15.114:0/3554030992 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f82ac0b5ae0 msgr2=0x7f82ac06db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:45.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.760+0000 7f82a9d9b700 1 --2- 172.21.15.114:0/3554030992 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f82ac0b5ae0 0x7f82ac06db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:45.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.760+0000 7f82a9d9b700 1 -- 172.21.15.114:0/3554030992 >> v1:172.21.15.172:6789/0 conn(0x7f82ac0d2e00 legacy=0x7f82ac0d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:45.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.760+0000 7f82a9d9b700 1 -- 172.21.15.114:0/3554030992 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82ac15d310 con 0x7f82ac160710 2023-10-18T12:20:45.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.760+0000 7f82a9d9b700 1 --2- 172.21.15.114:0/3554030992 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82ac160710 0x7f82ac0b6e00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f82a0009910 tx=0x7f82a0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f384f7216f05957 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:45.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.760+0000 7f82a959a700 1 -- 172.21.15.114:0/3554030992 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a0011830 con 0x7f82ac160710 2023-10-18T12:20:45.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.760+0000 7f82a959a700 1 -- 172.21.15.114:0/3554030992 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a0011990 con 0x7f82ac160710 2023-10-18T12:20:45.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.760+0000 7f82a959a700 1 -- 172.21.15.114:0/3554030992 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a0011d40 con 0x7f82ac160710 2023-10-18T12:20:45.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.760+0000 7f82ab59e700 1 -- 172.21.15.114:0/3554030992 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82ac160710 msgr2=0x7f82ac0b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:45.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.760+0000 7f82ab59e700 1 --2- 172.21.15.114:0/3554030992 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82ac160710 0x7f82ac0b6e00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f82a0009910 tx=0x7f82a0009c20 comp rx=0 tx=0).stop 2023-10-18T12:20:45.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.760+0000 7f82ab59e700 1 -- 172.21.15.114:0/3554030992 shutdown_connections 2023-10-18T12:20:45.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.760+0000 7f82ab59e700 1 --2- 172.21.15.114:0/3554030992 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f82ac0b5ae0 0x7f82ac06db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:45.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.760+0000 7f82ab59e700 1 --2- 172.21.15.114:0/3554030992 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82ac160710 0x7f82ac0b6e00 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:45.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.760+0000 7f82ab59e700 1 -- 172.21.15.114:0/3554030992 >> 172.21.15.114:0/3554030992 conn(0x7f82ac069f20 msgr2=0x7f82ac06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:45.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.760+0000 7f82ab59e700 1 -- 172.21.15.114:0/3554030992 shutdown_connections 2023-10-18T12:20:45.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.760+0000 7f82ab59e700 1 -- 172.21.15.114:0/3554030992 wait complete. 2023-10-18T12:20:45.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.764+0000 7f82ab59e700 1 Processor -- start 2023-10-18T12:20:45.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.764+0000 7f82ab59e700 1 -- start start 2023-10-18T12:20:45.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.764+0000 7f82ab59e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82ac0b5ae0 0x7f82ac0b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:45.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.764+0000 7f82ab59e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f82ac0d2e00 0x7f82ac0ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:45.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.764+0000 7f82ab59e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82ac160710 0x7f82ac15f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:45.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.764+0000 7f82ab59e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82ac1f5cd0 con 0x7f82ac160710 2023-10-18T12:20:45.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.764+0000 7f82ab59e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82ac0b1790 con 0x7f82ac0b5ae0 2023-10-18T12:20:45.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.764+0000 7f82ab59e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82ac0ae800 con 0x7f82ac0d2e00 2023-10-18T12:20:45.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.768+0000 7f82aad9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82ac160710 0x7f82ac15f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:45.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.768+0000 7f82aad9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82ac160710 0x7f82ac15f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39552/0 (socket says 172.21.15.114:39552) 2023-10-18T12:20:45.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.768+0000 7f82aad9d700 1 -- 172.21.15.114:0/622948327 learned_addr learned my addr 172.21.15.114:0/622948327 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:45.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.768+0000 7f82aa59c700 1 --2- 172.21.15.114:0/622948327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82ac0b5ae0 0x7f82ac0b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:45.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.768+0000 7f82a9d9b700 1 --2- 172.21.15.114:0/622948327 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f82ac0d2e00 0x7f82ac0ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:45.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.768+0000 7f82aad9d700 1 -- 172.21.15.114:0/622948327 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f82ac0d2e00 msgr2=0x7f82ac0ae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:45.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.768+0000 7f82aad9d700 1 --2- 172.21.15.114:0/622948327 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f82ac0d2e00 0x7f82ac0ae2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:45.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.768+0000 7f82aad9d700 1 -- 172.21.15.114:0/622948327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82ac0b5ae0 msgr2=0x7f82ac0b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:45.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.768+0000 7f82aad9d700 1 --2- 172.21.15.114:0/622948327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82ac0b5ae0 0x7f82ac0b1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:45.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.768+0000 7f82aad9d700 1 -- 172.21.15.114:0/622948327 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a0009570 con 0x7f82ac160710 2023-10-18T12:20:45.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.768+0000 7f82aa59c700 1 --2- 172.21.15.114:0/622948327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82ac0b5ae0 0x7f82ac0b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:45.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.768+0000 7f82aad9d700 1 --2- 172.21.15.114:0/622948327 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82ac160710 0x7f82ac15f950 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f82a4009d30 tx=0x7f82a400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:45.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.768+0000 7f829affd700 1 -- 172.21.15.114:0/622948327 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a400cd40 con 0x7f82ac160710 2023-10-18T12:20:45.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.768+0000 7f829affd700 1 -- 172.21.15.114:0/622948327 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a400f040 con 0x7f82ac160710 2023-10-18T12:20:45.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.768+0000 7f82ab59e700 1 -- 172.21.15.114:0/622948327 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82ac1f5f20 con 0x7f82ac160710 2023-10-18T12:20:45.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.768+0000 7f829affd700 1 -- 172.21.15.114:0/622948327 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a40146c0 con 0x7f82ac160710 2023-10-18T12:20:45.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.768+0000 7f82ab59e700 1 -- 172.21.15.114:0/622948327 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82ac1f64e0 con 0x7f82ac160710 2023-10-18T12:20:45.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.768+0000 7f82ab59e700 1 -- 172.21.15.114:0/622948327 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82ac04e910 con 0x7f82ac160710 2023-10-18T12:20:45.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.772+0000 7f829affd700 1 -- 172.21.15.114:0/622948327 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f82a4014820 con 0x7f82ac160710 2023-10-18T12:20:45.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.772+0000 7f829affd700 1 --2- 172.21.15.114:0/622948327 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f828c065720 0x7f828c067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:45.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.772+0000 7f829affd700 1 -- 172.21.15.114:0/622948327 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f82a4006e40 con 0x7f82ac160710 2023-10-18T12:20:45.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.776+0000 7f82aa59c700 1 --2- 172.21.15.114:0/622948327 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f828c065720 0x7f828c067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:45.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.776+0000 7f82aa59c700 1 --2- 172.21.15.114:0/622948327 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f828c065720 0x7f828c067be0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f829c000f60 tx=0x7f829c007df0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:45.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.780+0000 7f829affd700 1 -- 172.21.15.114:0/622948327 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f82a4051140 con 0x7f82ac160710 2023-10-18T12:20:45.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.956+0000 7f82ab59e700 1 -- 172.21.15.114:0/622948327 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f82ac06d3e0 con 0x7f82ac160710 2023-10-18T12:20:45.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.956+0000 7f829affd700 1 -- 172.21.15.114:0/622948327 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f82a400cea0 con 0x7f82ac160710 2023-10-18T12:20:45.964 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-10-18T12:20:45.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.960+0000 7f82ab59e700 1 -- 172.21.15.114:0/622948327 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f828c065720 msgr2=0x7f828c067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:45.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.960+0000 7f82ab59e700 1 --2- 172.21.15.114:0/622948327 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f828c065720 0x7f828c067be0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f829c000f60 tx=0x7f829c007df0 comp rx=0 tx=0).stop 2023-10-18T12:20:45.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.960+0000 7f82ab59e700 1 -- 172.21.15.114:0/622948327 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82ac160710 msgr2=0x7f82ac15f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:45.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.960+0000 7f82ab59e700 1 --2- 172.21.15.114:0/622948327 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82ac160710 0x7f82ac15f950 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f82a4009d30 tx=0x7f82a400c3a0 comp rx=0 tx=0).stop 2023-10-18T12:20:45.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.964+0000 7f82ab59e700 1 -- 172.21.15.114:0/622948327 shutdown_connections 2023-10-18T12:20:45.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.964+0000 7f82ab59e700 1 --2- 172.21.15.114:0/622948327 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f828c065720 0x7f828c067be0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:45.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.964+0000 7f82ab59e700 1 --2- 172.21.15.114:0/622948327 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f82ac0d2e00 0x7f82ac0ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:45.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.964+0000 7f82ab59e700 1 --2- 172.21.15.114:0/622948327 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82ac160710 0x7f82ac15f950 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:45.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.964+0000 7f82ab59e700 1 --2- 172.21.15.114:0/622948327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82ac0b5ae0 0x7f82ac0b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:45.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.964+0000 7f82ab59e700 1 -- 172.21.15.114:0/622948327 >> 172.21.15.114:0/622948327 conn(0x7f82ac069f20 msgr2=0x7f82ac0b47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:45.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.964+0000 7f82ab59e700 1 -- 172.21.15.114:0/622948327 shutdown_connections 2023-10-18T12:20:45.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:45.964+0000 7f82ab59e700 1 -- 172.21.15.114:0/622948327 wait complete. 2023-10-18T12:20:45.994 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-18T12:20:46.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.172+0000 7fa7aa862700 1 Processor -- start 2023-10-18T12:20:46.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.172+0000 7fa7aa862700 1 -- start start 2023-10-18T12:20:46.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.176+0000 7fa7aa862700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa7a40d23e0 0x7fa7a415dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:46.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.176+0000 7fa7aa862700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa7a406fef0 0x7fa7a40b65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:46.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.176+0000 7fa7aa862700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7a40b6e40 con 0x7fa7a40d2e20 2023-10-18T12:20:46.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.176+0000 7fa7aa862700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7a4070360 con 0x7fa7a40d23e0 2023-10-18T12:20:46.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.176+0000 7fa7aa862700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a40b7120 con 0x7fa7a406fef0 2023-10-18T12:20:46.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.176+0000 7fa7a3fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa7a40d23e0 0x7fa7a415dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:46.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.176+0000 7fa7a3fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa7a40d23e0 0x7fa7a415dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39558/0 (socket says 172.21.15.114:39558) 2023-10-18T12:20:46.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.176+0000 7fa7a3fff700 1 -- 172.21.15.114:0/757804206 learned_addr learned my addr 172.21.15.114:0/757804206 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:46.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.176+0000 7fa79bfff700 1 --2- 172.21.15.114:0/757804206 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa7a406fef0 0x7fa7a40b65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:46.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.176+0000 7fa7a3fff700 1 -- 172.21.15.114:0/757804206 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa7a406fef0 msgr2=0x7fa7a40b65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:46.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.176+0000 7fa7a3fff700 1 --2- 172.21.15.114:0/757804206 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa7a406fef0 0x7fa7a40b65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:46.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.176+0000 7fa7a3fff700 1 -- 172.21.15.114:0/757804206 >> v1:172.21.15.172:6789/0 conn(0x7fa7a40d2e20 legacy=0x7fa7a41607d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:46.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.176+0000 7fa7a3fff700 1 -- 172.21.15.114:0/757804206 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a415d4f0 con 0x7fa7a40d23e0 2023-10-18T12:20:46.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.176+0000 7fa7a3fff700 1 --2- 172.21.15.114:0/757804206 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7a40d23e0 0x7fa7a415dcf0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa794009910 tx=0x7fa794009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb146af766da1bc server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:46.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.176+0000 7fa7a37fe700 1 -- 172.21.15.114:0/757804206 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa794011830 con 0x7fa7a40d23e0 2023-10-18T12:20:46.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.176+0000 7fa7a37fe700 1 -- 172.21.15.114:0/757804206 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa794011990 con 0x7fa7a40d23e0 2023-10-18T12:20:46.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.176+0000 7fa7a37fe700 1 -- 172.21.15.114:0/757804206 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa794011d40 con 0x7fa7a40d23e0 2023-10-18T12:20:46.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.180+0000 7fa7aa862700 1 -- 172.21.15.114:0/757804206 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7a40d23e0 msgr2=0x7fa7a415dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:46.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.180+0000 7fa7aa862700 1 --2- 172.21.15.114:0/757804206 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7a40d23e0 0x7fa7a415dcf0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa794009910 tx=0x7fa794009c20 comp rx=0 tx=0).stop 2023-10-18T12:20:46.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.180+0000 7fa7aa862700 1 -- 172.21.15.114:0/757804206 shutdown_connections 2023-10-18T12:20:46.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.180+0000 7fa7aa862700 1 --2- 172.21.15.114:0/757804206 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa7a406fef0 0x7fa7a40b65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:46.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.180+0000 7fa7aa862700 1 --2- 172.21.15.114:0/757804206 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7a40d23e0 0x7fa7a415dcf0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:46.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.180+0000 7fa7aa862700 1 -- 172.21.15.114:0/757804206 >> 172.21.15.114:0/757804206 conn(0x7fa7a4069f20 msgr2=0x7fa7a406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:46.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.180+0000 7fa7aa862700 1 -- 172.21.15.114:0/757804206 shutdown_connections 2023-10-18T12:20:46.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.180+0000 7fa7aa862700 1 -- 172.21.15.114:0/757804206 wait complete. 2023-10-18T12:20:46.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.184+0000 7fa7aa862700 1 Processor -- start 2023-10-18T12:20:46.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.184+0000 7fa7aa862700 1 -- start start 2023-10-18T12:20:46.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.184+0000 7fa7aa862700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa7a406fef0 0x7fa7a40af480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:46.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.184+0000 7fa7aa862700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7a40d23e0 0x7fa7a40b4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:46.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.184+0000 7fa7aa862700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7a40d2e20 0x7fa7a40ad5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:46.191 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.184+0000 7fa7aa862700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a40b2750 con 0x7fa7a40d23e0 2023-10-18T12:20:46.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.184+0000 7fa7aa862700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a40ac940 con 0x7fa7a40d2e20 2023-10-18T12:20:46.192 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.184+0000 7fa7aa862700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a40b2a10 con 0x7fa7a406fef0 2023-10-18T12:20:46.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.184+0000 7fa79bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7a40d23e0 0x7fa7a40b4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:46.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.184+0000 7fa79bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7a40d23e0 0x7fa7a40b4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39566/0 (socket says 172.21.15.114:39566) 2023-10-18T12:20:46.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.184+0000 7fa79bfff700 1 -- 172.21.15.114:0/286343252 learned_addr learned my addr 172.21.15.114:0/286343252 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:46.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.184+0000 7fa7a3fff700 1 --2- 172.21.15.114:0/286343252 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa7a406fef0 0x7fa7a40af480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:46.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.184+0000 7fa7a8dff700 1 --2- 172.21.15.114:0/286343252 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7a40d2e20 0x7fa7a40ad5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:46.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.188+0000 7fa79bfff700 1 -- 172.21.15.114:0/286343252 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa7a406fef0 msgr2=0x7fa7a40af480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:46.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.188+0000 7fa79bfff700 1 --2- 172.21.15.114:0/286343252 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa7a406fef0 0x7fa7a40af480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:46.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.188+0000 7fa79bfff700 1 -- 172.21.15.114:0/286343252 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7a40d2e20 msgr2=0x7fa7a40ad5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:46.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.188+0000 7fa79bfff700 1 --2- 172.21.15.114:0/286343252 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7a40d2e20 0x7fa7a40ad5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:46.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.188+0000 7fa79bfff700 1 -- 172.21.15.114:0/286343252 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa794009570 con 0x7fa7a40d23e0 2023-10-18T12:20:46.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.188+0000 7fa79bfff700 1 --2- 172.21.15.114:0/286343252 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7a40d23e0 0x7fa7a40b4c80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa78c00e9d0 tx=0x7fa78c00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:46.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.188+0000 7fa7a17fa700 1 -- 172.21.15.114:0/286343252 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78c009720 con 0x7fa7a40d23e0 2023-10-18T12:20:46.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.188+0000 7fa7a17fa700 1 -- 172.21.15.114:0/286343252 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa78c00c850 con 0x7fa7a40d23e0 2023-10-18T12:20:46.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.188+0000 7fa7aa862700 1 -- 172.21.15.114:0/286343252 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7a40b2cf0 con 0x7fa7a40d23e0 2023-10-18T12:20:46.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.188+0000 7fa7a17fa700 1 -- 172.21.15.114:0/286343252 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78c00cbc0 con 0x7fa7a40d23e0 2023-10-18T12:20:46.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.188+0000 7fa7aa862700 1 -- 172.21.15.114:0/286343252 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7a40af9c0 con 0x7fa7a40d23e0 2023-10-18T12:20:46.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.188+0000 7fa7aa862700 1 -- 172.21.15.114:0/286343252 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7a404e910 con 0x7fa7a40d23e0 2023-10-18T12:20:46.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.192+0000 7fa7a17fa700 1 -- 172.21.15.114:0/286343252 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fa78c00cd20 con 0x7fa7a40d23e0 2023-10-18T12:20:46.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.192+0000 7fa7a17fa700 1 --2- 172.21.15.114:0/286343252 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa7840656f0 0x7fa784067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:46.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.192+0000 7fa7a17fa700 1 -- 172.21.15.114:0/286343252 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa78c083260 con 0x7fa7a40d23e0 2023-10-18T12:20:46.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.192+0000 7fa7a3fff700 1 --2- 172.21.15.114:0/286343252 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa7840656f0 0x7fa784067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:46.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.196+0000 7fa7a3fff700 1 --2- 172.21.15.114:0/286343252 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa7840656f0 0x7fa784067bb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa794000c00 tx=0x7fa794008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:46.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.196+0000 7fa7a17fa700 1 -- 172.21.15.114:0/286343252 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fa78c054470 con 0x7fa7a40d23e0 2023-10-18T12:20:46.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.368+0000 7fa7aa862700 1 -- 172.21.15.114:0/286343252 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa7a406d450 con 0x7fa7a40d23e0 2023-10-18T12:20:46.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.372+0000 7fa7a17fa700 1 -- 172.21.15.114:0/286343252 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa78c054000 con 0x7fa7a40d23e0 2023-10-18T12:20:46.376 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 8 2023-10-18T12:20:46.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.372+0000 7fa7aa862700 1 -- 172.21.15.114:0/286343252 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa7840656f0 msgr2=0x7fa784067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:46.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.372+0000 7fa7aa862700 1 --2- 172.21.15.114:0/286343252 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa7840656f0 0x7fa784067bb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa794000c00 tx=0x7fa794008030 comp rx=0 tx=0).stop 2023-10-18T12:20:46.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.372+0000 7fa7aa862700 1 -- 172.21.15.114:0/286343252 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7a40d23e0 msgr2=0x7fa7a40b4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:46.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.372+0000 7fa7aa862700 1 --2- 172.21.15.114:0/286343252 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7a40d23e0 0x7fa7a40b4c80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa78c00e9d0 tx=0x7fa78c00ed90 comp rx=0 tx=0).stop 2023-10-18T12:20:46.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.372+0000 7fa7aa862700 1 -- 172.21.15.114:0/286343252 shutdown_connections 2023-10-18T12:20:46.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.372+0000 7fa7aa862700 1 --2- 172.21.15.114:0/286343252 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa7840656f0 0x7fa784067bb0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:46.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.372+0000 7fa7aa862700 1 --2- 172.21.15.114:0/286343252 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa7a40d2e20 0x7fa7a40ad5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:46.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.372+0000 7fa7aa862700 1 --2- 172.21.15.114:0/286343252 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa7a40d23e0 0x7fa7a40b4c80 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:46.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.372+0000 7fa7aa862700 1 --2- 172.21.15.114:0/286343252 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa7a406fef0 0x7fa7a40af480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:46.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.372+0000 7fa7aa862700 1 -- 172.21.15.114:0/286343252 >> 172.21.15.114:0/286343252 conn(0x7fa7a4069f20 msgr2=0x7fa7a4158f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:46.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.372+0000 7fa7aa862700 1 -- 172.21.15.114:0/286343252 shutdown_connections 2023-10-18T12:20:46.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.372+0000 7fa7aa862700 1 -- 172.21.15.114:0/286343252 wait complete. 2023-10-18T12:20:46.400 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-18T12:20:46.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.576+0000 7faf51cb8700 1 Processor -- start 2023-10-18T12:20:46.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.576+0000 7faf51cb8700 1 -- start start 2023-10-18T12:20:46.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.576+0000 7faf51cb8700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7faf4c15cc80 0x7faf4c0d13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:46.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.576+0000 7faf51cb8700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf4c15d060 con 0x7faf4c0b1df0 2023-10-18T12:20:46.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.576+0000 7faf51cb8700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf4c06d830 con 0x7faf4c0d30e0 2023-10-18T12:20:46.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.576+0000 7faf51cb8700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf4c06dd60 con 0x7faf4c15cc80 2023-10-18T12:20:46.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.580+0000 7faf50cb6700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7faf4c15cc80 0x7faf4c0d13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:46.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.580+0000 7faf4bfff700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7faf4c0b1df0 0x7faf4c0d29d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49872/0 (socket says 172.21.15.114:49872) 2023-10-18T12:20:46.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.580+0000 7faf4bfff700 1 -- 172.21.15.114:0/1315291832 learned_addr learned my addr 172.21.15.114:0/1315291832 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:46.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.580+0000 7faf4b7fe700 1 -- 172.21.15.114:0/1315291832 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2275396631 0 0) 0x7faf4c15d060 con 0x7faf4c0b1df0 2023-10-18T12:20:46.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.580+0000 7faf4b7fe700 1 -- 172.21.15.114:0/1315291832 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf3c0035d0 con 0x7faf4c0b1df0 2023-10-18T12:20:46.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.580+0000 7faf4b7fe700 1 -- 172.21.15.114:0/1315291832 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3771441864 0 0) 0x7faf4c06d830 con 0x7faf4c0d30e0 2023-10-18T12:20:46.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.580+0000 7faf50cb6700 1 -- 172.21.15.114:0/1315291832 >> v1:172.21.15.172:6789/0 conn(0x7faf4c0d30e0 legacy=0x7faf4c160730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:46.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.580+0000 7faf50cb6700 1 -- 172.21.15.114:0/1315291832 >> v1:172.21.15.114:6789/0 conn(0x7faf4c0b1df0 legacy=0x7faf4c0d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:46.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.580+0000 7faf50cb6700 1 -- 172.21.15.114:0/1315291832 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf4c06da80 con 0x7faf4c15cc80 2023-10-18T12:20:46.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.580+0000 7faf50cb6700 1 --2- 172.21.15.114:0/1315291832 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf4c15cc80 0x7faf4c0d13c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7faf40009840 tx=0x7faf40009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed04f4248c61054f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:46.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.580+0000 7faf4b7fe700 1 -- 172.21.15.114:0/1315291832 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf40011830 con 0x7faf4c15cc80 2023-10-18T12:20:46.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.580+0000 7faf4b7fe700 1 -- 172.21.15.114:0/1315291832 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf40011990 con 0x7faf4c15cc80 2023-10-18T12:20:46.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.580+0000 7faf4b7fe700 1 -- 172.21.15.114:0/1315291832 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf40011d20 con 0x7faf4c15cc80 2023-10-18T12:20:46.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.580+0000 7faf51cb8700 1 -- 172.21.15.114:0/1315291832 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf4c15cc80 msgr2=0x7faf4c0d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:46.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.580+0000 7faf51cb8700 1 --2- 172.21.15.114:0/1315291832 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf4c15cc80 0x7faf4c0d13c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7faf40009840 tx=0x7faf40009b50 comp rx=0 tx=0).stop 2023-10-18T12:20:46.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.580+0000 7faf51cb8700 1 -- 172.21.15.114:0/1315291832 shutdown_connections 2023-10-18T12:20:46.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.580+0000 7faf51cb8700 1 --2- 172.21.15.114:0/1315291832 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf4c15cc80 0x7faf4c0d13c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:46.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.584+0000 7faf51cb8700 1 -- 172.21.15.114:0/1315291832 >> 172.21.15.114:0/1315291832 conn(0x7faf4c0cf530 msgr2=0x7faf4c0cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:46.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.584+0000 7faf51cb8700 1 -- 172.21.15.114:0/1315291832 shutdown_connections 2023-10-18T12:20:46.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.584+0000 7faf51cb8700 1 -- 172.21.15.114:0/1315291832 wait complete. 2023-10-18T12:20:46.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.584+0000 7faf51cb8700 1 Processor -- start 2023-10-18T12:20:46.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.584+0000 7faf51cb8700 1 -- start start 2023-10-18T12:20:46.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.588+0000 7faf51cb8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faf4c0b1df0 0x7faf4c153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:46.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.588+0000 7faf51cb8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf4c0d30e0 0x7faf4c15ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:46.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.588+0000 7faf51cb8700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf4c15cc80 0x7faf4c154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:46.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.588+0000 7faf51cb8700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf4c1f3230 con 0x7faf4c15cc80 2023-10-18T12:20:46.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.588+0000 7faf51cb8700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf4c1f26b0 con 0x7faf4c0d30e0 2023-10-18T12:20:46.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.588+0000 7faf51cb8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf4c1f2990 con 0x7faf4c0b1df0 2023-10-18T12:20:46.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.588+0000 7faf514b7700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf4c15cc80 0x7faf4c154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:46.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.588+0000 7faf514b7700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf4c15cc80 0x7faf4c154480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39592/0 (socket says 172.21.15.114:39592) 2023-10-18T12:20:46.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.588+0000 7faf514b7700 1 -- 172.21.15.114:0/498301136 learned_addr learned my addr 172.21.15.114:0/498301136 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:46.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.588+0000 7faf4bfff700 1 --2- 172.21.15.114:0/498301136 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf4c0d30e0 0x7faf4c15ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:46.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.588+0000 7faf50cb6700 1 --2- 172.21.15.114:0/498301136 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faf4c0b1df0 0x7faf4c153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:46.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.588+0000 7faf514b7700 1 -- 172.21.15.114:0/498301136 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faf4c0b1df0 msgr2=0x7faf4c153130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:46.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.588+0000 7faf514b7700 1 --2- 172.21.15.114:0/498301136 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faf4c0b1df0 0x7faf4c153130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:46.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.588+0000 7faf514b7700 1 -- 172.21.15.114:0/498301136 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf4c0d30e0 msgr2=0x7faf4c15ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:46.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.588+0000 7faf514b7700 1 --2- 172.21.15.114:0/498301136 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf4c0d30e0 0x7faf4c15ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:46.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.588+0000 7faf514b7700 1 -- 172.21.15.114:0/498301136 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf40009450 con 0x7faf4c15cc80 2023-10-18T12:20:46.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.588+0000 7faf50cb6700 1 --2- 172.21.15.114:0/498301136 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faf4c0b1df0 0x7faf4c153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:20:46.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.588+0000 7faf514b7700 1 --2- 172.21.15.114:0/498301136 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf4c15cc80 0x7faf4c154480 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7faf4400cc10 tx=0x7faf4400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:46.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.588+0000 7faf497fa700 1 -- 172.21.15.114:0/498301136 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf44003e50 con 0x7faf4c15cc80 2023-10-18T12:20:46.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.588+0000 7faf497fa700 1 -- 172.21.15.114:0/498301136 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf4400a7e0 con 0x7faf4c15cc80 2023-10-18T12:20:46.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.588+0000 7faf497fa700 1 -- 172.21.15.114:0/498301136 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4400ab90 con 0x7faf4c15cc80 2023-10-18T12:20:46.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.588+0000 7faf51cb8700 1 -- 172.21.15.114:0/498301136 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf4c1f2c70 con 0x7faf4c15cc80 2023-10-18T12:20:46.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.588+0000 7faf51cb8700 1 -- 172.21.15.114:0/498301136 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf4c153670 con 0x7faf4c15cc80 2023-10-18T12:20:46.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.588+0000 7faf51cb8700 1 -- 172.21.15.114:0/498301136 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf4c0709d0 con 0x7faf4c15cc80 2023-10-18T12:20:46.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.592+0000 7faf497fa700 1 -- 172.21.15.114:0/498301136 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7faf4400acf0 con 0x7faf4c15cc80 2023-10-18T12:20:46.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.592+0000 7faf497fa700 1 --2- 172.21.15.114:0/498301136 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7faf300656f0 0x7faf30067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:46.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.592+0000 7faf497fa700 1 -- 172.21.15.114:0/498301136 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7faf44082c40 con 0x7faf4c15cc80 2023-10-18T12:20:46.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.596+0000 7faf50cb6700 1 --2- 172.21.15.114:0/498301136 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7faf300656f0 0x7faf30067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:46.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.596+0000 7faf50cb6700 1 --2- 172.21.15.114:0/498301136 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7faf300656f0 0x7faf30067bb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7faf4c0d1920 tx=0x7faf40008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:46.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.600+0000 7faf497fa700 1 -- 172.21.15.114:0/498301136 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7faf440503c0 con 0x7faf4c15cc80 2023-10-18T12:20:46.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.776+0000 7faf51cb8700 1 -- 172.21.15.114:0/498301136 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faf4c04e910 con 0x7faf4c15cc80 2023-10-18T12:20:46.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.780+0000 7faf497fa700 1 -- 172.21.15.114:0/498301136 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7faf440170a0 con 0x7faf4c15cc80 2023-10-18T12:20:46.785 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-10-18T12:20:46.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.780+0000 7faf51cb8700 1 -- 172.21.15.114:0/498301136 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7faf300656f0 msgr2=0x7faf30067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:46.787 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.780+0000 7faf51cb8700 1 --2- 172.21.15.114:0/498301136 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7faf300656f0 0x7faf30067bb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7faf4c0d1920 tx=0x7faf40008030 comp rx=0 tx=0).stop 2023-10-18T12:20:46.787 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.780+0000 7faf51cb8700 1 -- 172.21.15.114:0/498301136 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf4c15cc80 msgr2=0x7faf4c154480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:46.787 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.780+0000 7faf51cb8700 1 --2- 172.21.15.114:0/498301136 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf4c15cc80 0x7faf4c154480 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7faf4400cc10 tx=0x7faf4400a060 comp rx=0 tx=0).stop 2023-10-18T12:20:46.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.780+0000 7faf51cb8700 1 -- 172.21.15.114:0/498301136 shutdown_connections 2023-10-18T12:20:46.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.780+0000 7faf51cb8700 1 --2- 172.21.15.114:0/498301136 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7faf300656f0 0x7faf30067bb0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:46.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.780+0000 7faf51cb8700 1 --2- 172.21.15.114:0/498301136 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf4c15cc80 0x7faf4c154480 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:46.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.780+0000 7faf51cb8700 1 --2- 172.21.15.114:0/498301136 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf4c0d30e0 0x7faf4c15ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:46.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.780+0000 7faf51cb8700 1 --2- 172.21.15.114:0/498301136 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faf4c0b1df0 0x7faf4c153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:46.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.780+0000 7faf51cb8700 1 -- 172.21.15.114:0/498301136 >> 172.21.15.114:0/498301136 conn(0x7faf4c0cf530 msgr2=0x7faf4c0b38d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:46.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.780+0000 7faf51cb8700 1 -- 172.21.15.114:0/498301136 shutdown_connections 2023-10-18T12:20:46.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.780+0000 7faf51cb8700 1 -- 172.21.15.114:0/498301136 wait complete. 2023-10-18T12:20:46.808 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-18T12:20:46.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.984+0000 7f73916cd700 1 Processor -- start 2023-10-18T12:20:46.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.984+0000 7f73916cd700 1 -- start start 2023-10-18T12:20:46.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.988+0000 7f73916cd700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f738c0d2e00 0x7f738c0b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:46.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.988+0000 7f73916cd700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f738c15d0d0 con 0x7f738c0b5ae0 2023-10-18T12:20:46.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.988+0000 7f73916cd700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f738c06f0f0 con 0x7f738c160710 2023-10-18T12:20:46.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.988+0000 7f73916cd700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f738c15df90 con 0x7f738c0d2e00 2023-10-18T12:20:46.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.988+0000 7f738b7fe700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f738c0b5ae0 0x7f738c06db60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49888/0 (socket says 172.21.15.114:49888) 2023-10-18T12:20:46.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.988+0000 7f738b7fe700 1 -- 172.21.15.114:0/604099473 learned_addr learned my addr 172.21.15.114:0/604099473 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:46.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.988+0000 7f738affd700 1 --2- 172.21.15.114:0/604099473 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f738c0d2e00 0x7f738c0b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:46.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.988+0000 7f7389ffb700 1 -- 172.21.15.114:0/604099473 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1245388421 0 0) 0x7f73840014e0 con 0x7f738c0b5ae0 2023-10-18T12:20:46.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.988+0000 7f7389ffb700 1 -- 172.21.15.114:0/604099473 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73740035d0 con 0x7f738c0b5ae0 2023-10-18T12:20:46.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.988+0000 7f738affd700 1 -- 172.21.15.114:0/604099473 >> v1:172.21.15.172:6789/0 conn(0x7f738c160710 legacy=0x7f738c0d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:46.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.988+0000 7f738affd700 1 -- 172.21.15.114:0/604099473 >> v1:172.21.15.114:6789/0 conn(0x7f738c0b5ae0 legacy=0x7f738c06db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:46.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.988+0000 7f738affd700 1 -- 172.21.15.114:0/604099473 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f738c15d310 con 0x7f738c0d2e00 2023-10-18T12:20:46.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.988+0000 7f738affd700 1 --2- 172.21.15.114:0/604099473 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f738c0d2e00 0x7f738c0b6e00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f737c0098b0 tx=0x7f737c009bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9ec4847a74c88b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:46.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.988+0000 7f7389ffb700 1 -- 172.21.15.114:0/604099473 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737c011830 con 0x7f738c0d2e00 2023-10-18T12:20:46.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.988+0000 7f7389ffb700 1 -- 172.21.15.114:0/604099473 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f737c011990 con 0x7f738c0d2e00 2023-10-18T12:20:46.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.988+0000 7f7389ffb700 1 -- 172.21.15.114:0/604099473 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737c011d00 con 0x7f738c0d2e00 2023-10-18T12:20:46.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.992+0000 7f73916cd700 1 -- 172.21.15.114:0/604099473 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f738c0d2e00 msgr2=0x7f738c0b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:46.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.992+0000 7f73916cd700 1 --2- 172.21.15.114:0/604099473 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f738c0d2e00 0x7f738c0b6e00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f737c0098b0 tx=0x7f737c009bc0 comp rx=0 tx=0).stop 2023-10-18T12:20:46.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.992+0000 7f73916cd700 1 -- 172.21.15.114:0/604099473 shutdown_connections 2023-10-18T12:20:46.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.992+0000 7f73916cd700 1 --2- 172.21.15.114:0/604099473 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f738c0d2e00 0x7f738c0b6e00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:46.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.992+0000 7f73916cd700 1 -- 172.21.15.114:0/604099473 >> 172.21.15.114:0/604099473 conn(0x7f738c069f20 msgr2=0x7f738c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:46.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.992+0000 7f73916cd700 1 -- 172.21.15.114:0/604099473 shutdown_connections 2023-10-18T12:20:46.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.992+0000 7f73916cd700 1 -- 172.21.15.114:0/604099473 wait complete. 2023-10-18T12:20:47.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.992+0000 7f73916cd700 1 Processor -- start 2023-10-18T12:20:47.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.992+0000 7f73916cd700 1 -- start start 2023-10-18T12:20:47.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.996+0000 7f73916cd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f738c0b5ae0 0x7f738c0d0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:47.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.996+0000 7f73916cd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f738c0d2e00 0x7f738c0afb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:47.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.996+0000 7f73916cd700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f738c160710 0x7f738c0b0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:47.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.996+0000 7f73916cd700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738c0ada40 con 0x7f738c0d2e00 2023-10-18T12:20:47.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.996+0000 7f73916cd700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738c0ad110 con 0x7f738c0b5ae0 2023-10-18T12:20:47.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.996+0000 7f73916cd700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f738c0b05a0 con 0x7f738c160710 2023-10-18T12:20:47.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.996+0000 7f738a7fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f738c0d2e00 0x7f738c0afb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:47.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.996+0000 7f738a7fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f738c0d2e00 0x7f738c0afb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39608/0 (socket says 172.21.15.114:39608) 2023-10-18T12:20:47.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.996+0000 7f738a7fc700 1 -- 172.21.15.114:0/2434316339 learned_addr learned my addr 172.21.15.114:0/2434316339 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:47.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.996+0000 7f738b7fe700 1 --2- 172.21.15.114:0/2434316339 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f738c160710 0x7f738c0b0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:47.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.996+0000 7f738affd700 1 --2- 172.21.15.114:0/2434316339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f738c0b5ae0 0x7f738c0d0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:47.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.996+0000 7f738a7fc700 1 -- 172.21.15.114:0/2434316339 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f738c160710 msgr2=0x7f738c0b0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:47.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.996+0000 7f738a7fc700 1 --2- 172.21.15.114:0/2434316339 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f738c160710 0x7f738c0b0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:47.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.996+0000 7f738a7fc700 1 -- 172.21.15.114:0/2434316339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f738c0b5ae0 msgr2=0x7f738c0d0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:47.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.996+0000 7f738a7fc700 1 --2- 172.21.15.114:0/2434316339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f738c0b5ae0 0x7f738c0d0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:47.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.996+0000 7f738a7fc700 1 -- 172.21.15.114:0/2434316339 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f737c0094b0 con 0x7f738c0d2e00 2023-10-18T12:20:47.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.996+0000 7f738affd700 1 --2- 172.21.15.114:0/2434316339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f738c0b5ae0 0x7f738c0d0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:20:47.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.996+0000 7f738a7fc700 1 --2- 172.21.15.114:0/2434316339 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f738c0d2e00 0x7f738c0afb20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f738000c530 tx=0x7f738000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:47.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.996+0000 7f73737fe700 1 -- 172.21.15.114:0/2434316339 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73800052d0 con 0x7f738c0d2e00 2023-10-18T12:20:47.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.996+0000 7f73737fe700 1 -- 172.21.15.114:0/2434316339 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7380005430 con 0x7f738c0d2e00 2023-10-18T12:20:47.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.996+0000 7f73916cd700 1 -- 172.21.15.114:0/2434316339 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f738c0ad380 con 0x7f738c0d2e00 2023-10-18T12:20:47.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:46.996+0000 7f73737fe700 1 -- 172.21.15.114:0/2434316339 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73800055a0 con 0x7f738c0d2e00 2023-10-18T12:20:47.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.000+0000 7f73916cd700 1 -- 172.21.15.114:0/2434316339 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f738c1f6700 con 0x7f738c0d2e00 2023-10-18T12:20:47.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.000+0000 7f73916cd700 1 -- 172.21.15.114:0/2434316339 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f738c0adb80 con 0x7f738c0d2e00 2023-10-18T12:20:47.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.000+0000 7f73737fe700 1 -- 172.21.15.114:0/2434316339 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f73800036a0 con 0x7f738c0d2e00 2023-10-18T12:20:47.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.000+0000 7f73737fe700 1 --2- 172.21.15.114:0/2434316339 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f73780656f0 0x7f7378067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:47.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.000+0000 7f73737fe700 1 -- 172.21.15.114:0/2434316339 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7380082270 con 0x7f738c0d2e00 2023-10-18T12:20:47.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.000+0000 7f738affd700 1 --2- 172.21.15.114:0/2434316339 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f73780656f0 0x7f7378067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:47.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.004+0000 7f738affd700 1 --2- 172.21.15.114:0/2434316339 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f73780656f0 0x7f7378067bb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f737c0090b0 tx=0x7f737c01c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:47.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.008+0000 7f73737fe700 1 -- 172.21.15.114:0/2434316339 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f738c0adb80 con 0x7f738c0d2e00 2023-10-18T12:20:47.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.184+0000 7f73916cd700 1 -- 172.21.15.114:0/2434316339 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f738c0adb80 con 0x7f738c0d2e00 2023-10-18T12:20:47.189 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.184+0000 7f73737fe700 1 -- 172.21.15.114:0/2434316339 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f738c0adb80 con 0x7f738c0d2e00 2023-10-18T12:20:47.190 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-10-18T12:20:47.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.188+0000 7f73916cd700 1 -- 172.21.15.114:0/2434316339 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f73780656f0 msgr2=0x7f7378067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:47.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.188+0000 7f73916cd700 1 --2- 172.21.15.114:0/2434316339 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f73780656f0 0x7f7378067bb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f737c0090b0 tx=0x7f737c01c040 comp rx=0 tx=0).stop 2023-10-18T12:20:47.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.188+0000 7f73916cd700 1 -- 172.21.15.114:0/2434316339 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f738c0d2e00 msgr2=0x7f738c0afb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:47.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.188+0000 7f73916cd700 1 --2- 172.21.15.114:0/2434316339 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f738c0d2e00 0x7f738c0afb20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f738000c530 tx=0x7f738000c840 comp rx=0 tx=0).stop 2023-10-18T12:20:47.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.188+0000 7f73916cd700 1 -- 172.21.15.114:0/2434316339 shutdown_connections 2023-10-18T12:20:47.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.188+0000 7f73916cd700 1 --2- 172.21.15.114:0/2434316339 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f73780656f0 0x7f7378067bb0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:47.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.188+0000 7f73916cd700 1 --2- 172.21.15.114:0/2434316339 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f738c160710 0x7f738c0b0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:47.194 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.188+0000 7f73916cd700 1 --2- 172.21.15.114:0/2434316339 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f738c0d2e00 0x7f738c0afb20 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:47.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.188+0000 7f73916cd700 1 --2- 172.21.15.114:0/2434316339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f738c0b5ae0 0x7f738c0d0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:47.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.188+0000 7f73916cd700 1 -- 172.21.15.114:0/2434316339 >> 172.21.15.114:0/2434316339 conn(0x7f738c069f20 msgr2=0x7f738c0b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:47.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.188+0000 7f73916cd700 1 -- 172.21.15.114:0/2434316339 shutdown_connections 2023-10-18T12:20:47.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.188+0000 7f73916cd700 1 -- 172.21.15.114:0/2434316339 wait complete. 2023-10-18T12:20:47.213 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-18T12:20:47.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.384+0000 7f0a90cdf700 1 Processor -- start 2023-10-18T12:20:47.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.384+0000 7f0a90cdf700 1 -- start start 2023-10-18T12:20:47.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.384+0000 7f0a90cdf700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0a8c0b5ae0 0x7f0a8c0b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:47.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.384+0000 7f0a90cdf700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a8c15d0d0 con 0x7f0a8c0d2e00 2023-10-18T12:20:47.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.388+0000 7f0a90cdf700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a8c06f0f0 con 0x7f0a8c160710 2023-10-18T12:20:47.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.388+0000 7f0a90cdf700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a8c15df90 con 0x7f0a8c0b5ae0 2023-10-18T12:20:47.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.388+0000 7f0a8b7fe700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f0a8c0d2e00 0x7f0a8c0d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49894/0 (socket says 172.21.15.114:49894) 2023-10-18T12:20:47.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.388+0000 7f0a8b7fe700 1 -- 172.21.15.114:0/996255198 learned_addr learned my addr 172.21.15.114:0/996255198 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:47.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.388+0000 7f0a8bfff700 1 --2- 172.21.15.114:0/996255198 >> v2:172.21.15.172:3300/0 conn(0x7f0a8c0b5ae0 0x7f0a8c0b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:47.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.388+0000 7f0a8affd700 1 -- 172.21.15.114:0/996255198 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 711682582 0 0) 0x7f0a7c001110 con 0x7f0a8c0d2e00 2023-10-18T12:20:47.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.388+0000 7f0a8affd700 1 -- 172.21.15.114:0/996255198 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a780035d0 con 0x7f0a8c0d2e00 2023-10-18T12:20:47.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.388+0000 7f0a8bfff700 1 -- 172.21.15.114:0/996255198 >> v1:172.21.15.172:6789/0 conn(0x7f0a8c160710 legacy=0x7f0a8c06db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:47.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.388+0000 7f0a8bfff700 1 -- 172.21.15.114:0/996255198 >> v1:172.21.15.114:6789/0 conn(0x7f0a8c0d2e00 legacy=0x7f0a8c0d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:47.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.388+0000 7f0a8bfff700 1 -- 172.21.15.114:0/996255198 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a8c15d310 con 0x7f0a8c0b5ae0 2023-10-18T12:20:47.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.388+0000 7f0a8bfff700 1 --2- 172.21.15.114:0/996255198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a8c0b5ae0 0x7f0a8c0b6e00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0a84009d90 tx=0x7f0a8400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22323ac9969ac11f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:47.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.388+0000 7f0a8affd700 1 -- 172.21.15.114:0/996255198 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8400e070 con 0x7f0a8c0b5ae0 2023-10-18T12:20:47.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.388+0000 7f0a8affd700 1 -- 172.21.15.114:0/996255198 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8400bb20 con 0x7f0a8c0b5ae0 2023-10-18T12:20:47.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.388+0000 7f0a8affd700 1 -- 172.21.15.114:0/996255198 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a84012430 con 0x7f0a8c0b5ae0 2023-10-18T12:20:47.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.388+0000 7f0a90cdf700 1 -- 172.21.15.114:0/996255198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a8c0b5ae0 msgr2=0x7f0a8c0b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:47.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.388+0000 7f0a90cdf700 1 --2- 172.21.15.114:0/996255198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a8c0b5ae0 0x7f0a8c0b6e00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0a84009d90 tx=0x7f0a8400b330 comp rx=0 tx=0).stop 2023-10-18T12:20:47.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.388+0000 7f0a90cdf700 1 -- 172.21.15.114:0/996255198 shutdown_connections 2023-10-18T12:20:47.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.388+0000 7f0a90cdf700 1 --2- 172.21.15.114:0/996255198 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a8c0b5ae0 0x7f0a8c0b6e00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:47.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.388+0000 7f0a90cdf700 1 -- 172.21.15.114:0/996255198 >> 172.21.15.114:0/996255198 conn(0x7f0a8c069f20 msgr2=0x7f0a8c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:47.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.392+0000 7f0a90cdf700 1 -- 172.21.15.114:0/996255198 shutdown_connections 2023-10-18T12:20:47.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.392+0000 7f0a90cdf700 1 -- 172.21.15.114:0/996255198 wait complete. 2023-10-18T12:20:47.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.392+0000 7f0a90cdf700 1 Processor -- start 2023-10-18T12:20:47.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.392+0000 7f0a90cdf700 1 -- start start 2023-10-18T12:20:47.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.396+0000 7f0a90cdf700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a8c0b5ae0 0x7f0a8c15a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:47.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.396+0000 7f0a90cdf700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a8c0d2e00 0x7f0a8c1570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:47.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.396+0000 7f0a90cdf700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0a8c160710 0x7f0a8c1efaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:47.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.396+0000 7f0a90cdf700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c152510 con 0x7f0a8c0b5ae0 2023-10-18T12:20:47.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.396+0000 7f0a90cdf700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c157620 con 0x7f0a8c0d2e00 2023-10-18T12:20:47.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.396+0000 7f0a90cdf700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c1effe0 con 0x7f0a8c160710 2023-10-18T12:20:47.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.396+0000 7f0a8b7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a8c0b5ae0 0x7f0a8c15a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:47.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.396+0000 7f0a8b7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a8c0b5ae0 0x7f0a8c15a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39624/0 (socket says 172.21.15.114:39624) 2023-10-18T12:20:47.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.396+0000 7f0a8b7fe700 1 -- 172.21.15.114:0/3401677165 learned_addr learned my addr 172.21.15.114:0/3401677165 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:47.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.396+0000 7f0a83fff700 1 --2- 172.21.15.114:0/3401677165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a8c0d2e00 0x7f0a8c1570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:47.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.396+0000 7f0a8bfff700 1 --2- 172.21.15.114:0/3401677165 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0a8c160710 0x7f0a8c1efaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:47.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.396+0000 7f0a8b7fe700 1 -- 172.21.15.114:0/3401677165 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0a8c160710 msgr2=0x7f0a8c1efaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:47.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.396+0000 7f0a8b7fe700 1 --2- 172.21.15.114:0/3401677165 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0a8c160710 0x7f0a8c1efaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:47.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.396+0000 7f0a8b7fe700 1 -- 172.21.15.114:0/3401677165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a8c0d2e00 msgr2=0x7f0a8c1570e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:47.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.396+0000 7f0a8b7fe700 1 --2- 172.21.15.114:0/3401677165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a8c0d2e00 0x7f0a8c1570e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:47.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.396+0000 7f0a8b7fe700 1 -- 172.21.15.114:0/3401677165 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a84009a70 con 0x7f0a8c0b5ae0 2023-10-18T12:20:47.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.396+0000 7f0a8b7fe700 1 --2- 172.21.15.114:0/3401677165 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a8c0b5ae0 0x7f0a8c15a9e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c001270 tx=0x7f0a7c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:47.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.396+0000 7f0a88ff9700 1 -- 172.21.15.114:0/3401677165 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c005d90 con 0x7f0a8c0b5ae0 2023-10-18T12:20:47.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.396+0000 7f0a88ff9700 1 -- 172.21.15.114:0/3401677165 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a7c0070d0 con 0x7f0a8c0b5ae0 2023-10-18T12:20:47.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.396+0000 7f0a90cdf700 1 -- 172.21.15.114:0/3401677165 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a8c1f6ad0 con 0x7f0a8c0b5ae0 2023-10-18T12:20:47.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.396+0000 7f0a88ff9700 1 -- 172.21.15.114:0/3401677165 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c007480 con 0x7f0a8c0b5ae0 2023-10-18T12:20:47.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.396+0000 7f0a90cdf700 1 -- 172.21.15.114:0/3401677165 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a8c1f6230 con 0x7f0a8c0b5ae0 2023-10-18T12:20:47.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.400+0000 7f0a90cdf700 1 -- 172.21.15.114:0/3401677165 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a8c04e910 con 0x7f0a8c0b5ae0 2023-10-18T12:20:47.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.400+0000 7f0a88ff9700 1 -- 172.21.15.114:0/3401677165 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f0a7c0075e0 con 0x7f0a8c0b5ae0 2023-10-18T12:20:47.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.400+0000 7f0a88ff9700 1 --2- 172.21.15.114:0/3401677165 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0a6c0656f0 0x7f0a6c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:47.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.400+0000 7f0a88ff9700 1 -- 172.21.15.114:0/3401677165 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0a7c082550 con 0x7f0a8c0b5ae0 2023-10-18T12:20:47.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.400+0000 7f0a83fff700 1 --2- 172.21.15.114:0/3401677165 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0a6c0656f0 0x7f0a6c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:47.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.404+0000 7f0a83fff700 1 --2- 172.21.15.114:0/3401677165 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0a6c0656f0 0x7f0a6c067bb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c15c4b0 tx=0x7f0a74009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:47.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.408+0000 7f0a88ff9700 1 -- 172.21.15.114:0/3401677165 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f0a7c04fc40 con 0x7f0a8c0b5ae0 2023-10-18T12:20:47.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.600+0000 7f0a90cdf700 1 -- 172.21.15.114:0/3401677165 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0a8c15d0d0 con 0x7f0a8c0b5ae0 2023-10-18T12:20:47.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.600+0000 7f0a88ff9700 1 -- 172.21.15.114:0/3401677165 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0a8c15d0d0 con 0x7f0a8c0b5ae0 2023-10-18T12:20:47.606 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-10-18T12:20:47.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.604+0000 7f0a90cdf700 1 -- 172.21.15.114:0/3401677165 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0a6c0656f0 msgr2=0x7f0a6c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:47.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.604+0000 7f0a90cdf700 1 --2- 172.21.15.114:0/3401677165 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0a6c0656f0 0x7f0a6c067bb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c15c4b0 tx=0x7f0a74009040 comp rx=0 tx=0).stop 2023-10-18T12:20:47.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.604+0000 7f0a90cdf700 1 -- 172.21.15.114:0/3401677165 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a8c0b5ae0 msgr2=0x7f0a8c15a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:47.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.604+0000 7f0a90cdf700 1 --2- 172.21.15.114:0/3401677165 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a8c0b5ae0 0x7f0a8c15a9e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c001270 tx=0x7f0a7c00c880 comp rx=0 tx=0).stop 2023-10-18T12:20:47.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.604+0000 7f0a90cdf700 1 -- 172.21.15.114:0/3401677165 shutdown_connections 2023-10-18T12:20:47.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.604+0000 7f0a90cdf700 1 --2- 172.21.15.114:0/3401677165 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0a6c0656f0 0x7f0a6c067bb0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:47.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.604+0000 7f0a90cdf700 1 --2- 172.21.15.114:0/3401677165 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0a8c160710 0x7f0a8c1efaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:47.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.604+0000 7f0a90cdf700 1 --2- 172.21.15.114:0/3401677165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0a8c0d2e00 0x7f0a8c1570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:47.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.604+0000 7f0a90cdf700 1 --2- 172.21.15.114:0/3401677165 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a8c0b5ae0 0x7f0a8c15a9e0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:47.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.604+0000 7f0a90cdf700 1 -- 172.21.15.114:0/3401677165 >> 172.21.15.114:0/3401677165 conn(0x7f0a8c069f20 msgr2=0x7f0a8c0b2980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:47.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.604+0000 7f0a90cdf700 1 -- 172.21.15.114:0/3401677165 shutdown_connections 2023-10-18T12:20:47.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.604+0000 7f0a90cdf700 1 -- 172.21.15.114:0/3401677165 wait complete. 2023-10-18T12:20:47.632 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-18T12:20:47.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.808+0000 7f32ae835700 1 Processor -- start 2023-10-18T12:20:47.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.808+0000 7f32ae835700 1 -- start start 2023-10-18T12:20:47.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.808+0000 7f32ae835700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f32a80b6c70 0x7f32a806a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:47.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.808+0000 7f32ae835700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f32a80b5ae0 0x7f32a806a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:47.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.808+0000 7f32ae835700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32a806e390 con 0x7f32a815cbd0 2023-10-18T12:20:47.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.808+0000 7f32ae835700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32a815cfb0 con 0x7f32a80b5ae0 2023-10-18T12:20:47.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.808+0000 7f32ae835700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32a80b6050 con 0x7f32a80b6c70 2023-10-18T12:20:47.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.808+0000 7f32ad833700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f32a815cbd0 0x7f32a80b6560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49906/0 (socket says 172.21.15.114:49906) 2023-10-18T12:20:47.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.808+0000 7f32ad833700 1 -- 172.21.15.114:0/400468092 learned_addr learned my addr 172.21.15.114:0/400468092 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:47.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.812+0000 7f32ae034700 1 --2- 172.21.15.114:0/400468092 >> v2:172.21.15.172:3300/0 conn(0x7f32a80b5ae0 0x7f32a806a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:47.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.812+0000 7f32ad032700 1 --2- 172.21.15.114:0/400468092 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f32a80b6c70 0x7f32a806a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:47.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.812+0000 7f32ac831700 1 -- 172.21.15.114:0/400468092 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2081393427 0 0) 0x7f32a806e390 con 0x7f32a815cbd0 2023-10-18T12:20:47.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.812+0000 7f32ac831700 1 -- 172.21.15.114:0/400468092 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32940035d0 con 0x7f32a815cbd0 2023-10-18T12:20:47.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.812+0000 7f32ae034700 1 -- 172.21.15.114:0/400468092 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f32a80b6c70 msgr2=0x7f32a806a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:47.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.812+0000 7f32ae034700 1 --2- 172.21.15.114:0/400468092 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f32a80b6c70 0x7f32a806a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:47.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.812+0000 7f32ae034700 1 -- 172.21.15.114:0/400468092 >> v1:172.21.15.114:6789/0 conn(0x7f32a815cbd0 legacy=0x7f32a80b6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:47.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.812+0000 7f32ae034700 1 -- 172.21.15.114:0/400468092 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a806e5e0 con 0x7f32a80b5ae0 2023-10-18T12:20:47.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.812+0000 7f32ae034700 1 --2- 172.21.15.114:0/400468092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f32a80b5ae0 0x7f32a806a610 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f32a0009d90 tx=0x7f32a000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3af456721308a46 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:47.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.812+0000 7f32ac831700 1 -- 172.21.15.114:0/400468092 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a000e070 con 0x7f32a80b5ae0 2023-10-18T12:20:47.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.812+0000 7f32ac831700 1 -- 172.21.15.114:0/400468092 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a000bb20 con 0x7f32a80b5ae0 2023-10-18T12:20:47.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.812+0000 7f32ac831700 1 -- 172.21.15.114:0/400468092 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a000be90 con 0x7f32a80b5ae0 2023-10-18T12:20:47.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.812+0000 7f32ae835700 1 -- 172.21.15.114:0/400468092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f32a80b5ae0 msgr2=0x7f32a806a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:47.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.812+0000 7f32ae835700 1 --2- 172.21.15.114:0/400468092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f32a80b5ae0 0x7f32a806a610 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f32a0009d90 tx=0x7f32a000b330 comp rx=0 tx=0).stop 2023-10-18T12:20:47.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.812+0000 7f32ae835700 1 -- 172.21.15.114:0/400468092 shutdown_connections 2023-10-18T12:20:47.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.812+0000 7f32ae835700 1 --2- 172.21.15.114:0/400468092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f32a80b5ae0 0x7f32a806a610 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:47.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.812+0000 7f32ae835700 1 --2- 172.21.15.114:0/400468092 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f32a80b6c70 0x7f32a806a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:47.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.812+0000 7f32ae835700 1 -- 172.21.15.114:0/400468092 >> 172.21.15.114:0/400468092 conn(0x7f32a806f450 msgr2=0x7f32a806f860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:47.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.812+0000 7f32ae835700 1 -- 172.21.15.114:0/400468092 shutdown_connections 2023-10-18T12:20:47.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.812+0000 7f32ae835700 1 -- 172.21.15.114:0/400468092 wait complete. 2023-10-18T12:20:47.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.816+0000 7f32ae835700 1 Processor -- start 2023-10-18T12:20:47.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.816+0000 7f32ae835700 1 -- start start 2023-10-18T12:20:47.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.816+0000 7f32ae835700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f32a80b5ae0 0x7f32a81532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:47.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.816+0000 7f32ae835700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32a80b6c70 0x7f32a814c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:47.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.816+0000 7f32ae835700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f32a815cbd0 0x7f32a806d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:47.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.816+0000 7f32ae835700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a814fd10 con 0x7f32a80b6c70 2023-10-18T12:20:47.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.816+0000 7f32ae835700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a81f2670 con 0x7f32a815cbd0 2023-10-18T12:20:47.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.816+0000 7f32ae835700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32a814f190 con 0x7f32a80b5ae0 2023-10-18T12:20:47.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.816+0000 7f32ad032700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32a80b6c70 0x7f32a814c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:47.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.816+0000 7f32ad032700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32a80b6c70 0x7f32a814c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39640/0 (socket says 172.21.15.114:39640) 2023-10-18T12:20:47.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.816+0000 7f32ad032700 1 -- 172.21.15.114:0/2423299981 learned_addr learned my addr 172.21.15.114:0/2423299981 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:47.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.816+0000 7f32ad833700 1 --2- 172.21.15.114:0/2423299981 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f32a80b5ae0 0x7f32a81532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:47.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.816+0000 7f32ae034700 1 --2- 172.21.15.114:0/2423299981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f32a815cbd0 0x7f32a806d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:47.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.816+0000 7f32ad032700 1 -- 172.21.15.114:0/2423299981 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f32a80b5ae0 msgr2=0x7f32a81532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:47.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.816+0000 7f32ad032700 1 --2- 172.21.15.114:0/2423299981 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f32a80b5ae0 0x7f32a81532a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:47.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.816+0000 7f32ad032700 1 -- 172.21.15.114:0/2423299981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f32a815cbd0 msgr2=0x7f32a806d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:47.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.816+0000 7f32ad032700 1 --2- 172.21.15.114:0/2423299981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f32a815cbd0 0x7f32a806d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:47.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.816+0000 7f32ad032700 1 -- 172.21.15.114:0/2423299981 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a0009a70 con 0x7f32a80b6c70 2023-10-18T12:20:47.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.816+0000 7f32ad833700 1 --2- 172.21.15.114:0/2423299981 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f32a80b5ae0 0x7f32a81532a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:47.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.820+0000 7f32ad032700 1 --2- 172.21.15.114:0/2423299981 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32a80b6c70 0x7f32a814c8c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f329800e9d0 tx=0x7f329800ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:47.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.820+0000 7f329e7fc700 1 -- 172.21.15.114:0/2423299981 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3298009720 con 0x7f32a80b6c70 2023-10-18T12:20:47.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.820+0000 7f329e7fc700 1 -- 172.21.15.114:0/2423299981 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f329800c850 con 0x7f32a80b6c70 2023-10-18T12:20:47.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.820+0000 7f32ae835700 1 -- 172.21.15.114:0/2423299981 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32a814f470 con 0x7f32a80b6c70 2023-10-18T12:20:47.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.820+0000 7f329e7fc700 1 -- 172.21.15.114:0/2423299981 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329800cbc0 con 0x7f32a80b6c70 2023-10-18T12:20:47.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.820+0000 7f32ae835700 1 -- 172.21.15.114:0/2423299981 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32a814fa30 con 0x7f32a80b6c70 2023-10-18T12:20:47.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.820+0000 7f32ae835700 1 -- 172.21.15.114:0/2423299981 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32a8072e60 con 0x7f32a80b6c70 2023-10-18T12:20:47.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.820+0000 7f329e7fc700 1 -- 172.21.15.114:0/2423299981 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f329800cd20 con 0x7f32a80b6c70 2023-10-18T12:20:47.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.824+0000 7f329e7fc700 1 --2- 172.21.15.114:0/2423299981 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f328c065720 0x7f328c067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:47.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.824+0000 7f329e7fc700 1 -- 172.21.15.114:0/2423299981 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f32980831c0 con 0x7f32a80b6c70 2023-10-18T12:20:47.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.824+0000 7f32ad833700 1 --2- 172.21.15.114:0/2423299981 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f328c065720 0x7f328c067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:47.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.824+0000 7f32ad833700 1 --2- 172.21.15.114:0/2423299981 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f328c065720 0x7f328c067be0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f32a4005930 tx=0x7f32a4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:47.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:47.832+0000 7f329e7fc700 1 -- 172.21.15.114:0/2423299981 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f32980543e0 con 0x7f32a80b6c70 2023-10-18T12:20:48.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.032+0000 7f32ae835700 1 -- 172.21.15.114:0/2423299981 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f32a80cf700 con 0x7f32a80b6c70 2023-10-18T12:20:48.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.032+0000 7f329e7fc700 1 -- 172.21.15.114:0/2423299981 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3298053f70 con 0x7f32a80b6c70 2023-10-18T12:20:48.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.036+0000 7f32ae835700 1 -- 172.21.15.114:0/2423299981 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f328c065720 msgr2=0x7f328c067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:48.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.036+0000 7f32ae835700 1 --2- 172.21.15.114:0/2423299981 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f328c065720 0x7f328c067be0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f32a4005930 tx=0x7f32a4009040 comp rx=0 tx=0).stop 2023-10-18T12:20:48.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.036+0000 7f32ae835700 1 -- 172.21.15.114:0/2423299981 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32a80b6c70 msgr2=0x7f32a814c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:48.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.036+0000 7f32ae835700 1 --2- 172.21.15.114:0/2423299981 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32a80b6c70 0x7f32a814c8c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f329800e9d0 tx=0x7f329800ed90 comp rx=0 tx=0).stop 2023-10-18T12:20:48.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.036+0000 7f32ae835700 1 -- 172.21.15.114:0/2423299981 shutdown_connections 2023-10-18T12:20:48.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.036+0000 7f32ae835700 1 --2- 172.21.15.114:0/2423299981 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f328c065720 0x7f328c067be0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:48.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.036+0000 7f32ae835700 1 --2- 172.21.15.114:0/2423299981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f32a815cbd0 0x7f32a806d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:48.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.036+0000 7f32ae835700 1 --2- 172.21.15.114:0/2423299981 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32a80b6c70 0x7f32a814c8c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:48.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.036+0000 7f32ae835700 1 --2- 172.21.15.114:0/2423299981 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f32a80b5ae0 0x7f32a81532a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:48.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.036+0000 7f32ae835700 1 -- 172.21.15.114:0/2423299981 >> 172.21.15.114:0/2423299981 conn(0x7f32a806f450 msgr2=0x7f32a80706c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:48.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.036+0000 7f32ae835700 1 -- 172.21.15.114:0/2423299981 shutdown_connections 2023-10-18T12:20:48.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.036+0000 7f32ae835700 1 -- 172.21.15.114:0/2423299981 wait complete. 2023-10-18T12:20:48.044 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2023-10-18T12:20:48.061 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-18T12:20:48.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:48.062 DEBUG:teuthology.orchestra.run.smithi172:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-10-18T12:20:48.120 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi172.front.sepia.ceph.com 2023-10-18T12:20:48.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:48.121 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-18T12:20:48.150 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:20:48.150 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-18T12:20:48.168 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:20:48.169 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-18T12:20:48.232 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:20:48.233 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-18T12:20:48.293 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T12:20:48.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.500+0000 7f751cd41700 1 Processor -- start 2023-10-18T12:20:48.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.500+0000 7f751cd41700 1 -- start start 2023-10-18T12:20:48.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.500+0000 7f751cd41700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7518154040 0x7f75180cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:48.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.500+0000 7f751cd41700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f751806e8a0 0x7f75180cb190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:48.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.500+0000 7f751cd41700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f751815e130 con 0x7f75180cb6d0 2023-10-18T12:20:48.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.500+0000 7f751cd41700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75180cbb60 con 0x7f751806e8a0 2023-10-18T12:20:48.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.500+0000 7f751cd41700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75180cdfa0 con 0x7f7518154040 2023-10-18T12:20:48.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.500+0000 7f7516d9d700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f75180cb6d0 0x7f751806f970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49920/0 (socket says 172.21.15.114:49920) 2023-10-18T12:20:48.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.500+0000 7f7516d9d700 1 -- 172.21.15.114:0/3364638635 learned_addr learned my addr 172.21.15.114:0/3364638635 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:48.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.500+0000 7f751659c700 1 --2- 172.21.15.114:0/3364638635 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7518154040 0x7f75180cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:48.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.500+0000 7f750dd9b700 1 --2- 172.21.15.114:0/3364638635 >> v2:172.21.15.172:3300/0 conn(0x7f751806e8a0 0x7f75180cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:48.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.504+0000 7f751659c700 1 -- 172.21.15.114:0/3364638635 >> v2:172.21.15.172:3300/0 conn(0x7f751806e8a0 msgr2=0x7f75180cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:48.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.504+0000 7f751659c700 1 --2- 172.21.15.114:0/3364638635 >> v2:172.21.15.172:3300/0 conn(0x7f751806e8a0 0x7f75180cb190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:48.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.504+0000 7f751659c700 1 -- 172.21.15.114:0/3364638635 >> v1:172.21.15.114:6789/0 conn(0x7f75180cb6d0 legacy=0x7f751806f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:48.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.504+0000 7f751659c700 1 -- 172.21.15.114:0/3364638635 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75180ce1b0 con 0x7f7518154040 2023-10-18T12:20:48.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.504+0000 7f7515d9b700 1 -- 172.21.15.114:0/3364638635 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 902736053 0 0) 0x7f751815e130 con 0x7f75180cb6d0 2023-10-18T12:20:48.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.504+0000 7f750dd9b700 1 --2- 172.21.15.114:0/3364638635 >> v2:172.21.15.172:3300/0 conn(0x7f751806e8a0 0x7f75180cb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:48.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.504+0000 7f751659c700 1 --2- 172.21.15.114:0/3364638635 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7518154040 0x7f75180cc680 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7508009850 tx=0x7f7508009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=197691fe08fb8931 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:48.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.504+0000 7f7515d9b700 1 -- 172.21.15.114:0/3364638635 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7508011830 con 0x7f7518154040 2023-10-18T12:20:48.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.504+0000 7f7515d9b700 1 -- 172.21.15.114:0/3364638635 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7508011990 con 0x7f7518154040 2023-10-18T12:20:48.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.504+0000 7f7515d9b700 1 -- 172.21.15.114:0/3364638635 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7508011d20 con 0x7f7518154040 2023-10-18T12:20:48.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.504+0000 7f751cd41700 1 -- 172.21.15.114:0/3364638635 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7518154040 msgr2=0x7f75180cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:48.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.504+0000 7f751cd41700 1 --2- 172.21.15.114:0/3364638635 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7518154040 0x7f75180cc680 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7508009850 tx=0x7f7508009b60 comp rx=0 tx=0).stop 2023-10-18T12:20:48.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.504+0000 7f751cd41700 1 -- 172.21.15.114:0/3364638635 shutdown_connections 2023-10-18T12:20:48.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.504+0000 7f751cd41700 1 --2- 172.21.15.114:0/3364638635 >> v2:172.21.15.172:3300/0 conn(0x7f751806e8a0 0x7f75180cb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:48.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.504+0000 7f751cd41700 1 --2- 172.21.15.114:0/3364638635 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7518154040 0x7f75180cc680 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:48.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.504+0000 7f751cd41700 1 -- 172.21.15.114:0/3364638635 >> 172.21.15.114:0/3364638635 conn(0x7f751806a340 msgr2=0x7f75180b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:48.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.504+0000 7f751cd41700 1 -- 172.21.15.114:0/3364638635 shutdown_connections 2023-10-18T12:20:48.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.504+0000 7f751cd41700 1 -- 172.21.15.114:0/3364638635 wait complete. 2023-10-18T12:20:48.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.508+0000 7f751cd41700 1 Processor -- start 2023-10-18T12:20:48.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.508+0000 7f751cd41700 1 -- start start 2023-10-18T12:20:48.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.508+0000 7f751cd41700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f751806e8a0 0x7f75181587b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:48.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.508+0000 7f751cd41700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f75180cb6d0 0x7f75181523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:48.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.508+0000 7f751cd41700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7518154040 0x7f7518156130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:48.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.508+0000 7f751cd41700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75181f38d0 con 0x7f751806e8a0 2023-10-18T12:20:48.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.508+0000 7f751cd41700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7518156960 con 0x7f7518154040 2023-10-18T12:20:48.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.508+0000 7f751cd41700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7518156c40 con 0x7f75180cb6d0 2023-10-18T12:20:48.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.508+0000 7f751659c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f751806e8a0 0x7f75181587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:48.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.508+0000 7f751659c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f751806e8a0 0x7f75181587b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39654/0 (socket says 172.21.15.114:39654) 2023-10-18T12:20:48.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.512+0000 7f751659c700 1 -- 172.21.15.114:0/3392582960 learned_addr learned my addr 172.21.15.114:0/3392582960 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:48.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.512+0000 7f7516d9d700 1 --2- 172.21.15.114:0/3392582960 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7518154040 0x7f7518156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:48.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.512+0000 7f750dd9b700 1 --2- 172.21.15.114:0/3392582960 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f75180cb6d0 0x7f75181523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:48.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.512+0000 7f751659c700 1 -- 172.21.15.114:0/3392582960 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f75180cb6d0 msgr2=0x7f75181523e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:48.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.512+0000 7f751659c700 1 --2- 172.21.15.114:0/3392582960 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f75180cb6d0 0x7f75181523e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:48.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.512+0000 7f751659c700 1 -- 172.21.15.114:0/3392582960 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7518154040 msgr2=0x7f7518156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:48.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.512+0000 7f751659c700 1 --2- 172.21.15.114:0/3392582960 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7518154040 0x7f7518156130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:48.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.512+0000 7f751659c700 1 -- 172.21.15.114:0/3392582960 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75080094b0 con 0x7f751806e8a0 2023-10-18T12:20:48.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.512+0000 7f750dd9b700 1 --2- 172.21.15.114:0/3392582960 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f75180cb6d0 0x7f75181523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:20:48.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.512+0000 7f751659c700 1 --2- 172.21.15.114:0/3392582960 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f751806e8a0 0x7f75181587b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7508000c00 tx=0x7f7508004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:48.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.512+0000 7f750f7fe700 1 -- 172.21.15.114:0/3392582960 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75080038c0 con 0x7f751806e8a0 2023-10-18T12:20:48.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.512+0000 7f750f7fe700 1 -- 172.21.15.114:0/3392582960 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750801e070 con 0x7f751806e8a0 2023-10-18T12:20:48.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.512+0000 7f751cd41700 1 -- 172.21.15.114:0/3392582960 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7518156f20 con 0x7f751806e8a0 2023-10-18T12:20:48.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.512+0000 7f750f7fe700 1 -- 172.21.15.114:0/3392582960 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7508003c80 con 0x7f751806e8a0 2023-10-18T12:20:48.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.512+0000 7f751cd41700 1 -- 172.21.15.114:0/3392582960 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7518156670 con 0x7f751806e8a0 2023-10-18T12:20:48.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.512+0000 7f751cd41700 1 -- 172.21.15.114:0/3392582960 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75181f3a40 con 0x7f751806e8a0 2023-10-18T12:20:48.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.516+0000 7f750f7fe700 1 -- 172.21.15.114:0/3392582960 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f750802d450 con 0x7f751806e8a0 2023-10-18T12:20:48.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.516+0000 7f750f7fe700 1 --2- 172.21.15.114:0/3392582960 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f74f8065720 0x7f74f8067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:48.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.516+0000 7f750f7fe700 1 -- 172.21.15.114:0/3392582960 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7508084150 con 0x7f751806e8a0 2023-10-18T12:20:48.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.516+0000 7f750dd9b700 1 --2- 172.21.15.114:0/3392582960 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f74f8065720 0x7f74f8067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:48.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.520+0000 7f750dd9b700 1 --2- 172.21.15.114:0/3392582960 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f74f8065720 0x7f74f8067be0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f75180cafe0 tx=0x7f7500008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:48.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.520+0000 7f750f7fe700 1 -- 172.21.15.114:0/3392582960 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f75181f3a40 con 0x7f751806e8a0 2023-10-18T12:20:48.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.700+0000 7f751cd41700 1 -- 172.21.15.114:0/3392582960 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75181f3a10 con 0x7f751806e8a0 2023-10-18T12:20:48.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.704+0000 7f750f7fe700 1 -- 172.21.15.114:0/3392582960 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20240 (secure 0 0 0) 0x7f75080518d0 con 0x7f751806e8a0 2023-10-18T12:20:48.709 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:20:48.709 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":30,"fsid":"240ea340-5d3d-4f52-a4bc-af075aca3deb","created":"2023-10-18T12:19:12.512994+0000","modified":"2023-10-18T12:20:20.604528+0000","last_up_change":"2023-10-18T12:19:25.286009+0000","last_in_change":"2023-10-18T12:19:15.850693+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T12:19:27.040638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-18T12:19:32.358094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-18T12:19:37.333855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-18T12:19:38.055385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-18T12:19:41.679218+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c3578978-1a03-4857-b9d2-34a5da3d7731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6817","nonce":1506287862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6820","nonce":1506287862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6830","nonce":1506287862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6825","nonce":1506287862}]},"public_addr":"172.21.15.114:6817/1506287862","cluster_addr":"172.21.15.114:6820/1506287862","heartbeat_back_addr":"172.21.15.114:6830/1506287862","heartbeat_front_addr":"172.21.15.114:6825/1506287862","state":["exists","up"]},{"osd":1,"uuid":"43eb26a6-e2b3-4670-9559-bd053b5140d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6801","nonce":3302727047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6803","nonce":3302727047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6807","nonce":3302727047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6805","nonce":3302727047}]},"public_addr":"172.21.15.114:6801/3302727047","cluster_addr":"172.21.15.114:6803/3302727047","heartbeat_back_addr":"172.21.15.114:6807/3302727047","heartbeat_front_addr":"172.21.15.114:6805/3302727047","state":["exists","up"]},{"osd":2,"uuid":"f3d4dbd5-521c-4dd2-b687-5768cc7d0938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6809","nonce":2699151351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6811","nonce":2699151351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6815","nonce":2699151351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6813","nonce":2699151351}]},"public_addr":"172.21.15.114:6809/2699151351","cluster_addr":"172.21.15.114:6811/2699151351","heartbeat_back_addr":"172.21.15.114:6815/2699151351","heartbeat_front_addr":"172.21.15.114:6813/2699151351","state":["exists","up"]},{"osd":3,"uuid":"823e5802-92b7-4f0d-b32d-a5748993f1b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6821","nonce":1361608073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6824","nonce":1361608073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6829","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6831","nonce":1361608073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6827","nonce":1361608073}]},"public_addr":"172.21.15.114:6821/1361608073","cluster_addr":"172.21.15.114:6824/1361608073","heartbeat_back_addr":"172.21.15.114:6831/1361608073","heartbeat_front_addr":"172.21.15.114:6827/1361608073","state":["exists","up"]},{"osd":4,"uuid":"e47fb93e-13b4-44a4-b084-8c4384ceb41e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6801","nonce":930839681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6803","nonce":930839681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6807","nonce":930839681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6805","nonce":930839681}]},"public_addr":"172.21.15.172:6801/930839681","cluster_addr":"172.21.15.172:6803/930839681","heartbeat_back_addr":"172.21.15.172:6807/930839681","heartbeat_front_addr":"172.21.15.172:6805/930839681","state":["exists","up"]},{"osd":5,"uuid":"7561a973-f479-45a0-af40-f324728d622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6814","nonce":571761850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6818","nonce":571761850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6824","nonce":571761850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6821","nonce":571761850}]},"public_addr":"172.21.15.172:6814/571761850","cluster_addr":"172.21.15.172:6818/571761850","heartbeat_back_addr":"172.21.15.172:6824/571761850","heartbeat_front_addr":"172.21.15.172:6821/571761850","state":["exists","up"]},{"osd":6,"uuid":"51753f4b-7f06-4f1c-9ec7-6e18a66eb980","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6825","nonce":1680398853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6827","nonce":1680398853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6831","nonce":1680398853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6829","nonce":1680398853}]},"public_addr":"172.21.15.172:6825/1680398853","cluster_addr":"172.21.15.172:6827/1680398853","heartbeat_back_addr":"172.21.15.172:6831/1680398853","heartbeat_front_addr":"172.21.15.172:6829/1680398853","state":["exists","up"]},{"osd":7,"uuid":"4d8b1e15-143d-4d17-9074-59d92f0f9af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6809","nonce":349710101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6811","nonce":349710101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6819","nonce":349710101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6815","nonce":349710101}]},"public_addr":"172.21.15.172:6809/349710101","cluster_addr":"172.21.15.172:6811/349710101","heartbeat_back_addr":"172.21.15.172:6819/349710101","heartbeat_front_addr":"172.21.15.172:6815/349710101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.889460+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.475494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.911473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.648596+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.609994+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.636248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.854589+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.885826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T12:20:48.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.704+0000 7f751cd41700 1 -- 172.21.15.114:0/3392582960 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f74f8065720 msgr2=0x7f74f8067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:48.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.704+0000 7f751cd41700 1 --2- 172.21.15.114:0/3392582960 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f74f8065720 0x7f74f8067be0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f75180cafe0 tx=0x7f7500008040 comp rx=0 tx=0).stop 2023-10-18T12:20:48.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.704+0000 7f751cd41700 1 -- 172.21.15.114:0/3392582960 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f751806e8a0 msgr2=0x7f75181587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:48.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.704+0000 7f751cd41700 1 --2- 172.21.15.114:0/3392582960 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f751806e8a0 0x7f75181587b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7508000c00 tx=0x7f7508004770 comp rx=0 tx=0).stop 2023-10-18T12:20:48.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.704+0000 7f751cd41700 1 -- 172.21.15.114:0/3392582960 shutdown_connections 2023-10-18T12:20:48.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.704+0000 7f751cd41700 1 --2- 172.21.15.114:0/3392582960 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f74f8065720 0x7f74f8067be0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:48.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.704+0000 7f751cd41700 1 --2- 172.21.15.114:0/3392582960 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f75180cb6d0 0x7f75181523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:48.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.704+0000 7f751cd41700 1 --2- 172.21.15.114:0/3392582960 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7518154040 0x7f7518156130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:48.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.704+0000 7f751cd41700 1 --2- 172.21.15.114:0/3392582960 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f751806e8a0 0x7f75181587b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:48.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.704+0000 7f751cd41700 1 -- 172.21.15.114:0/3392582960 >> 172.21.15.114:0/3392582960 conn(0x7f751806a340 msgr2=0x7f75180afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:48.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.704+0000 7f751cd41700 1 -- 172.21.15.114:0/3392582960 shutdown_connections 2023-10-18T12:20:48.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.704+0000 7f751cd41700 1 -- 172.21.15.114:0/3392582960 wait complete. 2023-10-18T12:20:48.734 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-18T12:19:27.040638+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-18T12:19:32.358094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-18T12:19:37.333855+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-18T12:19:38.055385+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-18T12:19:41.679218+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-18T12:20:48.735 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-18T12:20:48.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.920+0000 7f6c5b2d1700 1 Processor -- start 2023-10-18T12:20:48.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.920+0000 7f6c5b2d1700 1 -- start start 2023-10-18T12:20:48.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.924+0000 7f6c5b2d1700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6c54159750 0x7f6c54070560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:48.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.924+0000 7f6c5b2d1700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c54070f00 con 0x7f6c54070aa0 2023-10-18T12:20:48.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.924+0000 7f6c5b2d1700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c540b14f0 con 0x7f6c540ce040 2023-10-18T12:20:48.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.924+0000 7f6c5b2d1700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c540c9aa0 con 0x7f6c54159750 2023-10-18T12:20:48.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.924+0000 7f6c59ace700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f6c54070aa0 0x7f6c540cd930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49928/0 (socket says 172.21.15.114:49928) 2023-10-18T12:20:48.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.924+0000 7f6c59ace700 1 -- 172.21.15.114:0/2526841036 learned_addr learned my addr 172.21.15.114:0/2526841036 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:48.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.924+0000 7f6c5a2cf700 1 --2- 172.21.15.114:0/2526841036 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6c54159750 0x7f6c54070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:48.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.924+0000 7f6c592cd700 1 -- 172.21.15.114:0/2526841036 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1499979452 0 0) 0x7f6c54070f00 con 0x7f6c54070aa0 2023-10-18T12:20:48.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.924+0000 7f6c592cd700 1 -- 172.21.15.114:0/2526841036 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c400035d0 con 0x7f6c54070aa0 2023-10-18T12:20:48.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.924+0000 7f6c592cd700 1 -- 172.21.15.114:0/2526841036 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 788816695 0 0) 0x7f6c540b14f0 con 0x7f6c540ce040 2023-10-18T12:20:48.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.924+0000 7f6c592cd700 1 -- 172.21.15.114:0/2526841036 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c54070f00 con 0x7f6c540ce040 2023-10-18T12:20:48.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.924+0000 7f6c592cd700 1 -- 172.21.15.114:0/2526841036 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2357699608 0 0) 0x7f6c400035d0 con 0x7f6c54070aa0 2023-10-18T12:20:48.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.924+0000 7f6c5a2cf700 1 -- 172.21.15.114:0/2526841036 >> v1:172.21.15.172:6789/0 conn(0x7f6c540ce040 legacy=0x7f6c5406cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:48.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.924+0000 7f6c5a2cf700 1 -- 172.21.15.114:0/2526841036 >> v1:172.21.15.114:6789/0 conn(0x7f6c54070aa0 legacy=0x7f6c540cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:48.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.924+0000 7f6c5a2cf700 1 -- 172.21.15.114:0/2526841036 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c5415d590 con 0x7f6c54159750 2023-10-18T12:20:48.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.924+0000 7f6c5a2cf700 1 --2- 172.21.15.114:0/2526841036 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6c54159750 0x7f6c54070560 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6c50009880 tx=0x7f6c50009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3911010432a2db7 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:48.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.924+0000 7f6c592cd700 1 -- 172.21.15.114:0/2526841036 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c440015f0 con 0x7f6c54159750 2023-10-18T12:20:48.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.924+0000 7f6c592cd700 1 -- 172.21.15.114:0/2526841036 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c50004030 con 0x7f6c54159750 2023-10-18T12:20:48.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.928+0000 7f6c592cd700 1 -- 172.21.15.114:0/2526841036 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c500043c0 con 0x7f6c54159750 2023-10-18T12:20:48.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.928+0000 7f6c5b2d1700 1 -- 172.21.15.114:0/2526841036 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6c54159750 msgr2=0x7f6c54070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:48.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.928+0000 7f6c5b2d1700 1 --2- 172.21.15.114:0/2526841036 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6c54159750 0x7f6c54070560 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6c50009880 tx=0x7f6c50009b90 comp rx=0 tx=0).stop 2023-10-18T12:20:48.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.928+0000 7f6c5b2d1700 1 -- 172.21.15.114:0/2526841036 shutdown_connections 2023-10-18T12:20:48.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.928+0000 7f6c5b2d1700 1 --2- 172.21.15.114:0/2526841036 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6c54159750 0x7f6c54070560 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:48.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.928+0000 7f6c5b2d1700 1 -- 172.21.15.114:0/2526841036 >> 172.21.15.114:0/2526841036 conn(0x7f6c540ce5c0 msgr2=0x7f6c540ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:48.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.928+0000 7f6c5b2d1700 1 -- 172.21.15.114:0/2526841036 shutdown_connections 2023-10-18T12:20:48.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.928+0000 7f6c5b2d1700 1 -- 172.21.15.114:0/2526841036 wait complete. 2023-10-18T12:20:48.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.932+0000 7f6c5b2d1700 1 Processor -- start 2023-10-18T12:20:48.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.932+0000 7f6c5b2d1700 1 -- start start 2023-10-18T12:20:48.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.932+0000 7f6c5b2d1700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6c54070aa0 0x7f6c540c6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:48.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.932+0000 7f6c5b2d1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c540ce040 0x7f6c54148540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:48.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.932+0000 7f6c5b2d1700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c54159750 0x7f6c540c71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:48.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.932+0000 7f6c5b2d1700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c540c7ef0 con 0x7f6c540ce040 2023-10-18T12:20:48.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.932+0000 7f6c5b2d1700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c540c5e80 con 0x7f6c54159750 2023-10-18T12:20:48.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.932+0000 7f6c5b2d1700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c54148a80 con 0x7f6c54070aa0 2023-10-18T12:20:48.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.932+0000 7f6c59ace700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c540ce040 0x7f6c54148540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:48.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.932+0000 7f6c59ace700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c540ce040 0x7f6c54148540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39656/0 (socket says 172.21.15.114:39656) 2023-10-18T12:20:48.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.932+0000 7f6c59ace700 1 -- 172.21.15.114:0/1784028508 learned_addr learned my addr 172.21.15.114:0/1784028508 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:48.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.932+0000 7f6c5a2cf700 1 --2- 172.21.15.114:0/1784028508 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6c54070aa0 0x7f6c540c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:48.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.932+0000 7f6c5aad0700 1 --2- 172.21.15.114:0/1784028508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c54159750 0x7f6c540c71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:48.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.932+0000 7f6c59ace700 1 -- 172.21.15.114:0/1784028508 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6c54070aa0 msgr2=0x7f6c540c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:48.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.932+0000 7f6c59ace700 1 --2- 172.21.15.114:0/1784028508 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6c54070aa0 0x7f6c540c6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:48.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.932+0000 7f6c59ace700 1 -- 172.21.15.114:0/1784028508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c54159750 msgr2=0x7f6c540c71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:48.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.932+0000 7f6c59ace700 1 --2- 172.21.15.114:0/1784028508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c54159750 0x7f6c540c71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:48.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.932+0000 7f6c59ace700 1 -- 172.21.15.114:0/1784028508 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c500094b0 con 0x7f6c540ce040 2023-10-18T12:20:48.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.936+0000 7f6c59ace700 1 --2- 172.21.15.114:0/1784028508 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c540ce040 0x7f6c54148540 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6c4400c470 tx=0x7f6c4400c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:48.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.936+0000 7f6c4affd700 1 -- 172.21.15.114:0/1784028508 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c44004ca0 con 0x7f6c540ce040 2023-10-18T12:20:48.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.936+0000 7f6c4affd700 1 -- 172.21.15.114:0/1784028508 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c44004e00 con 0x7f6c540ce040 2023-10-18T12:20:48.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.936+0000 7f6c5b2d1700 1 -- 172.21.15.114:0/1784028508 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c540c7c10 con 0x7f6c540ce040 2023-10-18T12:20:48.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.936+0000 7f6c4affd700 1 -- 172.21.15.114:0/1784028508 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c44007310 con 0x7f6c540ce040 2023-10-18T12:20:48.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.936+0000 7f6c5b2d1700 1 -- 172.21.15.114:0/1784028508 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c540c5b10 con 0x7f6c540ce040 2023-10-18T12:20:48.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.936+0000 7f6c5b2d1700 1 -- 172.21.15.114:0/1784028508 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c540c6030 con 0x7f6c540ce040 2023-10-18T12:20:48.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.940+0000 7f6c4affd700 1 -- 172.21.15.114:0/1784028508 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f6c44007470 con 0x7f6c540ce040 2023-10-18T12:20:48.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.940+0000 7f6c4affd700 1 --2- 172.21.15.114:0/1784028508 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6c380656f0 0x7f6c38067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:48.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.940+0000 7f6c4affd700 1 -- 172.21.15.114:0/1784028508 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6c44082c70 con 0x7f6c540ce040 2023-10-18T12:20:48.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.940+0000 7f6c5a2cf700 1 --2- 172.21.15.114:0/1784028508 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6c380656f0 0x7f6c38067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:48.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.940+0000 7f6c5a2cf700 1 --2- 172.21.15.114:0/1784028508 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6c380656f0 0x7f6c38067bb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6c500097d0 tx=0x7f6c50010000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:48.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:48.944+0000 7f6c4affd700 1 -- 172.21.15.114:0/1784028508 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f6c540c6030 con 0x7f6c540ce040 2023-10-18T12:20:49.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.128+0000 7f6c5b2d1700 1 -- 172.21.15.114:0/1784028508 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6c540c5670 con 0x7f6c540ce040 2023-10-18T12:20:49.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.128+0000 7f6c4affd700 1 -- 172.21.15.114:0/1784028508 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6c440503f0 con 0x7f6c540ce040 2023-10-18T12:20:49.134 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-10-18T12:20:49.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.132+0000 7f6c5b2d1700 1 -- 172.21.15.114:0/1784028508 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6c380656f0 msgr2=0x7f6c38067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:49.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.132+0000 7f6c5b2d1700 1 --2- 172.21.15.114:0/1784028508 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6c380656f0 0x7f6c38067bb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6c500097d0 tx=0x7f6c50010000 comp rx=0 tx=0).stop 2023-10-18T12:20:49.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.132+0000 7f6c5b2d1700 1 -- 172.21.15.114:0/1784028508 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c540ce040 msgr2=0x7f6c54148540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:49.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.132+0000 7f6c5b2d1700 1 --2- 172.21.15.114:0/1784028508 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c540ce040 0x7f6c54148540 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6c4400c470 tx=0x7f6c4400c780 comp rx=0 tx=0).stop 2023-10-18T12:20:49.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.132+0000 7f6c5b2d1700 1 -- 172.21.15.114:0/1784028508 shutdown_connections 2023-10-18T12:20:49.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.132+0000 7f6c5b2d1700 1 --2- 172.21.15.114:0/1784028508 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6c380656f0 0x7f6c38067bb0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:49.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.132+0000 7f6c5b2d1700 1 --2- 172.21.15.114:0/1784028508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6c54159750 0x7f6c540c71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:49.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.132+0000 7f6c5b2d1700 1 --2- 172.21.15.114:0/1784028508 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c540ce040 0x7f6c54148540 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:49.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.132+0000 7f6c5b2d1700 1 --2- 172.21.15.114:0/1784028508 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6c54070aa0 0x7f6c540c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:49.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.132+0000 7f6c5b2d1700 1 -- 172.21.15.114:0/1784028508 >> 172.21.15.114:0/1784028508 conn(0x7f6c540ce5c0 msgr2=0x7f6c540cc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:49.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.132+0000 7f6c5b2d1700 1 -- 172.21.15.114:0/1784028508 shutdown_connections 2023-10-18T12:20:49.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.132+0000 7f6c5b2d1700 1 -- 172.21.15.114:0/1784028508 wait complete. 2023-10-18T12:20:49.162 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-18T12:20:49.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.336+0000 7f896bf2d700 1 Processor -- start 2023-10-18T12:20:49.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.336+0000 7f896bf2d700 1 -- start start 2023-10-18T12:20:49.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.340+0000 7f896bf2d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89640b5b80 0x7f896415d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:49.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.340+0000 7f896bf2d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f896406f9a0 0x7f896406fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:49.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.340+0000 7f896bf2d700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8964146ba0 con 0x7f89641467c0 2023-10-18T12:20:49.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.340+0000 7f896bf2d700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8964070350 con 0x7f896406f9a0 2023-10-18T12:20:49.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.340+0000 7f896bf2d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89640d0920 con 0x7f89640b5b80 2023-10-18T12:20:49.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.340+0000 7f896a4ca700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f896406f9a0 0x7f896406fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:49.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.340+0000 7f896a4ca700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f896406f9a0 0x7f896406fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39662/0 (socket says 172.21.15.114:39662) 2023-10-18T12:20:49.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.340+0000 7f896a4ca700 1 -- 172.21.15.114:0/575502341 learned_addr learned my addr 172.21.15.114:0/575502341 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:49.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.340+0000 7f89694c8700 1 --2- 172.21.15.114:0/575502341 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89640b5b80 0x7f896415d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:49.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.340+0000 7f896a4ca700 1 -- 172.21.15.114:0/575502341 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89640b5b80 msgr2=0x7f896415d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:49.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.340+0000 7f896a4ca700 1 --2- 172.21.15.114:0/575502341 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89640b5b80 0x7f896415d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:49.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.340+0000 7f896a4ca700 1 -- 172.21.15.114:0/575502341 >> v1:172.21.15.172:6789/0 conn(0x7f89641467c0 legacy=0x7f89641612e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:49.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.340+0000 7f896a4ca700 1 -- 172.21.15.114:0/575502341 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89640b6160 con 0x7f896406f9a0 2023-10-18T12:20:49.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.340+0000 7f896a4ca700 1 --2- 172.21.15.114:0/575502341 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f896406f9a0 0x7f896406fe10 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f895c009e50 tx=0x7f895c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7d9ec94891119ca server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:49.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.340+0000 7f8968cc7700 1 -- 172.21.15.114:0/575502341 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895c00e070 con 0x7f896406f9a0 2023-10-18T12:20:49.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.340+0000 7f8968cc7700 1 -- 172.21.15.114:0/575502341 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895c00b910 con 0x7f896406f9a0 2023-10-18T12:20:49.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.340+0000 7f8968cc7700 1 -- 172.21.15.114:0/575502341 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895c00bcc0 con 0x7f896406f9a0 2023-10-18T12:20:49.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.344+0000 7f896bf2d700 1 -- 172.21.15.114:0/575502341 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f896406f9a0 msgr2=0x7f896406fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:49.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.344+0000 7f896bf2d700 1 --2- 172.21.15.114:0/575502341 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f896406f9a0 0x7f896406fe10 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f895c009e50 tx=0x7f895c00b330 comp rx=0 tx=0).stop 2023-10-18T12:20:49.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.344+0000 7f896bf2d700 1 -- 172.21.15.114:0/575502341 shutdown_connections 2023-10-18T12:20:49.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.344+0000 7f896bf2d700 1 --2- 172.21.15.114:0/575502341 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f896406f9a0 0x7f896406fe10 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:49.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.344+0000 7f896bf2d700 1 --2- 172.21.15.114:0/575502341 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89640b5b80 0x7f896415d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:49.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.344+0000 7f896bf2d700 1 -- 172.21.15.114:0/575502341 >> 172.21.15.114:0/575502341 conn(0x7f896406a130 msgr2=0x7f896406a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:49.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.344+0000 7f896bf2d700 1 -- 172.21.15.114:0/575502341 shutdown_connections 2023-10-18T12:20:49.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.344+0000 7f896bf2d700 1 -- 172.21.15.114:0/575502341 wait complete. 2023-10-18T12:20:49.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.348+0000 7f896bf2d700 1 Processor -- start 2023-10-18T12:20:49.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.348+0000 7f896bf2d700 1 -- start start 2023-10-18T12:20:49.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.348+0000 7f896bf2d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f896406f9a0 0x7f896413f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:49.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.348+0000 7f896bf2d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89640b5b80 0x7f896413c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:49.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.348+0000 7f896bf2d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89641467c0 0x7f89641f2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:49.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.348+0000 7f896bf2d700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896413ee30 con 0x7f89640b5b80 2023-10-18T12:20:49.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.348+0000 7f896bf2d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896413f790 con 0x7f896406f9a0 2023-10-18T12:20:49.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.348+0000 7f896bf2d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f896413e800 con 0x7f89641467c0 2023-10-18T12:20:49.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.348+0000 7f89694c8700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89640b5b80 0x7f896413c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:49.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.348+0000 7f89694c8700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89640b5b80 0x7f896413c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39672/0 (socket says 172.21.15.114:39672) 2023-10-18T12:20:49.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.348+0000 7f89694c8700 1 -- 172.21.15.114:0/465631090 learned_addr learned my addr 172.21.15.114:0/465631090 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:49.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.348+0000 7f8969cc9700 1 --2- 172.21.15.114:0/465631090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f896406f9a0 0x7f896413f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:49.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.348+0000 7f896a4ca700 1 --2- 172.21.15.114:0/465631090 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89641467c0 0x7f89641f2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:49.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.348+0000 7f89694c8700 1 -- 172.21.15.114:0/465631090 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89641467c0 msgr2=0x7f89641f2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:49.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.348+0000 7f89694c8700 1 --2- 172.21.15.114:0/465631090 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89641467c0 0x7f89641f2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:49.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.348+0000 7f89694c8700 1 -- 172.21.15.114:0/465631090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f896406f9a0 msgr2=0x7f896413f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:49.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.348+0000 7f89694c8700 1 --2- 172.21.15.114:0/465631090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f896406f9a0 0x7f896413f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:49.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.348+0000 7f89694c8700 1 -- 172.21.15.114:0/465631090 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f895c009b30 con 0x7f89640b5b80 2023-10-18T12:20:49.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.348+0000 7f896a4ca700 1 --2- 172.21.15.114:0/465631090 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89641467c0 0x7f89641f2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:49.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.348+0000 7f89694c8700 1 --2- 172.21.15.114:0/465631090 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89640b5b80 0x7f896413c5d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f895400ea00 tx=0x7f895400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:49.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.352+0000 7f895a7fc700 1 -- 172.21.15.114:0/465631090 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8954009720 con 0x7f89640b5b80 2023-10-18T12:20:49.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.352+0000 7f895a7fc700 1 -- 172.21.15.114:0/465631090 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895400c850 con 0x7f89640b5b80 2023-10-18T12:20:49.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.352+0000 7f896bf2d700 1 -- 172.21.15.114:0/465631090 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89641f3540 con 0x7f89640b5b80 2023-10-18T12:20:49.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.352+0000 7f895a7fc700 1 -- 172.21.15.114:0/465631090 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895400cbc0 con 0x7f89640b5b80 2023-10-18T12:20:49.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.352+0000 7f896bf2d700 1 -- 172.21.15.114:0/465631090 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f896413ea50 con 0x7f89640b5b80 2023-10-18T12:20:49.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.352+0000 7f896bf2d700 1 -- 172.21.15.114:0/465631090 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8964072e60 con 0x7f89640b5b80 2023-10-18T12:20:49.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.356+0000 7f895a7fc700 1 -- 172.21.15.114:0/465631090 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f895400cd20 con 0x7f89640b5b80 2023-10-18T12:20:49.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.356+0000 7f895a7fc700 1 --2- 172.21.15.114:0/465631090 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f89480656f0 0x7f8948067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:49.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.356+0000 7f895a7fc700 1 -- 172.21.15.114:0/465631090 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8954083170 con 0x7f89640b5b80 2023-10-18T12:20:49.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.356+0000 7f8969cc9700 1 --2- 172.21.15.114:0/465631090 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f89480656f0 0x7f8948067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:49.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.356+0000 7f8969cc9700 1 --2- 172.21.15.114:0/465631090 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f89480656f0 0x7f8948067bb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8960000f60 tx=0x7f8960009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:49.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.360+0000 7f895a7fc700 1 -- 172.21.15.114:0/465631090 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f8954054420 con 0x7f89640b5b80 2023-10-18T12:20:49.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.540+0000 7f896bf2d700 1 -- 172.21.15.114:0/465631090 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f89640b7200 con 0x7f89640b5b80 2023-10-18T12:20:49.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.544+0000 7f895a7fc700 1 -- 172.21.15.114:0/465631090 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8954053fb0 con 0x7f89640b5b80 2023-10-18T12:20:49.549 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 8 2023-10-18T12:20:49.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.544+0000 7f896bf2d700 1 -- 172.21.15.114:0/465631090 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f89480656f0 msgr2=0x7f8948067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:49.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.544+0000 7f896bf2d700 1 --2- 172.21.15.114:0/465631090 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f89480656f0 0x7f8948067bb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8960000f60 tx=0x7f8960009040 comp rx=0 tx=0).stop 2023-10-18T12:20:49.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.544+0000 7f896bf2d700 1 -- 172.21.15.114:0/465631090 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89640b5b80 msgr2=0x7f896413c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:49.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.544+0000 7f896bf2d700 1 --2- 172.21.15.114:0/465631090 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89640b5b80 0x7f896413c5d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f895400ea00 tx=0x7f895400edc0 comp rx=0 tx=0).stop 2023-10-18T12:20:49.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.544+0000 7f896bf2d700 1 -- 172.21.15.114:0/465631090 shutdown_connections 2023-10-18T12:20:49.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.544+0000 7f896bf2d700 1 --2- 172.21.15.114:0/465631090 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f89480656f0 0x7f8948067bb0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:49.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.544+0000 7f896bf2d700 1 --2- 172.21.15.114:0/465631090 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89641467c0 0x7f89641f2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:49.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.544+0000 7f896bf2d700 1 --2- 172.21.15.114:0/465631090 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89640b5b80 0x7f896413c5d0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:49.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.544+0000 7f896bf2d700 1 --2- 172.21.15.114:0/465631090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f896406f9a0 0x7f896413f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:49.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.544+0000 7f896bf2d700 1 -- 172.21.15.114:0/465631090 >> 172.21.15.114:0/465631090 conn(0x7f896406a130 msgr2=0x7f89640b7420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:49.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.544+0000 7f896bf2d700 1 -- 172.21.15.114:0/465631090 shutdown_connections 2023-10-18T12:20:49.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.544+0000 7f896bf2d700 1 -- 172.21.15.114:0/465631090 wait complete. 2023-10-18T12:20:49.572 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-18T12:20:49.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.740+0000 7efc0214f700 1 Processor -- start 2023-10-18T12:20:49.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.744+0000 7efc0214f700 1 -- start start 2023-10-18T12:20:49.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.744+0000 7efc0214f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efbfc160710 0x7efbfc0b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:49.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.744+0000 7efc0214f700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efbfc0b5ae0 0x7efbfc06db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:49.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.744+0000 7efc0214f700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbfc15d0d0 con 0x7efbfc0d2e00 2023-10-18T12:20:49.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.744+0000 7efc0214f700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efbfc15df90 con 0x7efbfc0b5ae0 2023-10-18T12:20:49.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.744+0000 7efc0214f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbfc06f0f0 con 0x7efbfc160710 2023-10-18T12:20:49.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.744+0000 7efc0114d700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7efbfc0d2e00 0x7efbfc0d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49944/0 (socket says 172.21.15.114:49944) 2023-10-18T12:20:49.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.744+0000 7efc0114d700 1 -- 172.21.15.114:0/2967606903 learned_addr learned my addr 172.21.15.114:0/2967606903 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:49.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.744+0000 7efc0194e700 1 --2- 172.21.15.114:0/2967606903 >> v2:172.21.15.114:3300/0 conn(0x7efbfc0b5ae0 0x7efbfc06db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:49.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.748+0000 7efc0094c700 1 --2- 172.21.15.114:0/2967606903 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efbfc160710 0x7efbfc0b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:49.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.748+0000 7efbf3fff700 1 -- 172.21.15.114:0/2967606903 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1184116578 0 0) 0x7efbf8001110 con 0x7efbfc0d2e00 2023-10-18T12:20:49.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.748+0000 7efbf3fff700 1 -- 172.21.15.114:0/2967606903 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efbe80035d0 con 0x7efbfc0d2e00 2023-10-18T12:20:49.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.748+0000 7efc0194e700 1 -- 172.21.15.114:0/2967606903 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efbfc160710 msgr2=0x7efbfc0b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:49.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.748+0000 7efc0194e700 1 --2- 172.21.15.114:0/2967606903 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efbfc160710 0x7efbfc0b6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:49.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.748+0000 7efc0194e700 1 -- 172.21.15.114:0/2967606903 >> v1:172.21.15.114:6789/0 conn(0x7efbfc0d2e00 legacy=0x7efbfc0d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:49.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.748+0000 7efc0194e700 1 -- 172.21.15.114:0/2967606903 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbfc15d310 con 0x7efbfc0b5ae0 2023-10-18T12:20:49.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.748+0000 7efc0094c700 1 --2- 172.21.15.114:0/2967606903 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efbfc160710 0x7efbfc0b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:20:49.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.748+0000 7efc0194e700 1 --2- 172.21.15.114:0/2967606903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efbfc0b5ae0 0x7efbfc06db60 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7efbf4009dc0 tx=0x7efbf400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a67b2bc52708d23 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:49.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.748+0000 7efbf3fff700 1 -- 172.21.15.114:0/2967606903 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf400e070 con 0x7efbfc0b5ae0 2023-10-18T12:20:49.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.748+0000 7efbf3fff700 1 -- 172.21.15.114:0/2967606903 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf400bae0 con 0x7efbfc0b5ae0 2023-10-18T12:20:49.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.748+0000 7efbf3fff700 1 -- 172.21.15.114:0/2967606903 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf400be90 con 0x7efbfc0b5ae0 2023-10-18T12:20:49.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.748+0000 7efc0214f700 1 -- 172.21.15.114:0/2967606903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efbfc0b5ae0 msgr2=0x7efbfc06db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:49.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.748+0000 7efc0214f700 1 --2- 172.21.15.114:0/2967606903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efbfc0b5ae0 0x7efbfc06db60 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7efbf4009dc0 tx=0x7efbf400b330 comp rx=0 tx=0).stop 2023-10-18T12:20:49.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.748+0000 7efc0214f700 1 -- 172.21.15.114:0/2967606903 shutdown_connections 2023-10-18T12:20:49.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.748+0000 7efc0214f700 1 --2- 172.21.15.114:0/2967606903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efbfc0b5ae0 0x7efbfc06db60 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:49.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.748+0000 7efc0214f700 1 --2- 172.21.15.114:0/2967606903 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efbfc160710 0x7efbfc0b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:49.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.748+0000 7efc0214f700 1 -- 172.21.15.114:0/2967606903 >> 172.21.15.114:0/2967606903 conn(0x7efbfc069f20 msgr2=0x7efbfc06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:49.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.748+0000 7efc0214f700 1 -- 172.21.15.114:0/2967606903 shutdown_connections 2023-10-18T12:20:49.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.748+0000 7efc0214f700 1 -- 172.21.15.114:0/2967606903 wait complete. 2023-10-18T12:20:49.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.752+0000 7efc0214f700 1 Processor -- start 2023-10-18T12:20:49.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.752+0000 7efc0214f700 1 -- start start 2023-10-18T12:20:49.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.752+0000 7efc0214f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efbfc0b5ae0 0x7efbfc0d0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:49.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.752+0000 7efc0214f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efbfc0d2e00 0x7efbfc146460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:49.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.752+0000 7efc0214f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efbfc160710 0x7efbfc1555c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:49.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.752+0000 7efc0214f700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbfc1564b0 con 0x7efbfc160710 2023-10-18T12:20:49.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.752+0000 7efc0214f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbfc158010 con 0x7efbfc0b5ae0 2023-10-18T12:20:49.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.752+0000 7efc0214f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbfc157d30 con 0x7efbfc0d2e00 2023-10-18T12:20:49.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.752+0000 7efc0194e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efbfc160710 0x7efbfc1555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:49.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.752+0000 7efc0194e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efbfc160710 0x7efbfc1555c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39694/0 (socket says 172.21.15.114:39694) 2023-10-18T12:20:49.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.752+0000 7efc0194e700 1 -- 172.21.15.114:0/144092780 learned_addr learned my addr 172.21.15.114:0/144092780 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:49.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.752+0000 7efc0114d700 1 --2- 172.21.15.114:0/144092780 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efbfc0b5ae0 0x7efbfc0d0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:49.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.752+0000 7efc0094c700 1 --2- 172.21.15.114:0/144092780 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efbfc0d2e00 0x7efbfc146460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:49.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.756+0000 7efc0194e700 1 -- 172.21.15.114:0/144092780 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efbfc0d2e00 msgr2=0x7efbfc146460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:49.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.756+0000 7efc0194e700 1 --2- 172.21.15.114:0/144092780 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efbfc0d2e00 0x7efbfc146460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:49.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.756+0000 7efc0194e700 1 -- 172.21.15.114:0/144092780 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efbfc0b5ae0 msgr2=0x7efbfc0d0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:49.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.756+0000 7efc0194e700 1 --2- 172.21.15.114:0/144092780 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efbfc0b5ae0 0x7efbfc0d0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:49.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.756+0000 7efc0194e700 1 -- 172.21.15.114:0/144092780 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbec0094b0 con 0x7efbfc160710 2023-10-18T12:20:49.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.756+0000 7efc0114d700 1 --2- 172.21.15.114:0/144092780 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efbfc0b5ae0 0x7efbfc0d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:20:49.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.756+0000 7efc0194e700 1 --2- 172.21.15.114:0/144092780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efbfc160710 0x7efbfc1555c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7efbf400b370 tx=0x7efbf4004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:49.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.756+0000 7efbf1ffb700 1 -- 172.21.15.114:0/144092780 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf40044d0 con 0x7efbfc160710 2023-10-18T12:20:49.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.756+0000 7efbf1ffb700 1 -- 172.21.15.114:0/144092780 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf4020070 con 0x7efbfc160710 2023-10-18T12:20:49.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.756+0000 7efc0214f700 1 -- 172.21.15.114:0/144092780 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbf4009a70 con 0x7efbfc160710 2023-10-18T12:20:49.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.756+0000 7efbf1ffb700 1 -- 172.21.15.114:0/144092780 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf4004870 con 0x7efbfc160710 2023-10-18T12:20:49.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.756+0000 7efc0214f700 1 -- 172.21.15.114:0/144092780 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbfc0d07b0 con 0x7efbfc160710 2023-10-18T12:20:49.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.756+0000 7efc0214f700 1 -- 172.21.15.114:0/144092780 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbfc04e910 con 0x7efbfc160710 2023-10-18T12:20:49.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.760+0000 7efbf1ffb700 1 -- 172.21.15.114:0/144092780 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7efbf4012430 con 0x7efbfc160710 2023-10-18T12:20:49.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.760+0000 7efbf1ffb700 1 --2- 172.21.15.114:0/144092780 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7efbe0065740 0x7efbe0067c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:49.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.760+0000 7efbf1ffb700 1 -- 172.21.15.114:0/144092780 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7efbf4022070 con 0x7efbfc160710 2023-10-18T12:20:49.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.760+0000 7efc0114d700 1 --2- 172.21.15.114:0/144092780 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7efbe0065740 0x7efbe0067c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:49.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.760+0000 7efc0114d700 1 --2- 172.21.15.114:0/144092780 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7efbe0065740 0x7efbe0067c00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efbf8007fd0 tx=0x7efbf8007c60 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:49.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.768+0000 7efbf1ffb700 1 -- 172.21.15.114:0/144092780 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7efbf40525a0 con 0x7efbfc160710 2023-10-18T12:20:50.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.996+0000 7efc0214f700 1 -- 172.21.15.114:0/144092780 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efbfc0b4ed0 con 0x7efbfc160710 2023-10-18T12:20:50.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:49.996+0000 7efbf1ffb700 1 -- 172.21.15.114:0/144092780 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7efbf402c020 con 0x7efbfc160710 2023-10-18T12:20:50.004 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-10-18T12:20:50.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.004+0000 7efc0214f700 1 -- 172.21.15.114:0/144092780 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7efbe0065740 msgr2=0x7efbe0067c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:50.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.004+0000 7efc0214f700 1 --2- 172.21.15.114:0/144092780 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7efbe0065740 0x7efbe0067c00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efbf8007fd0 tx=0x7efbf8007c60 comp rx=0 tx=0).stop 2023-10-18T12:20:50.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.004+0000 7efc0214f700 1 -- 172.21.15.114:0/144092780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efbfc160710 msgr2=0x7efbfc1555c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:50.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.004+0000 7efc0214f700 1 --2- 172.21.15.114:0/144092780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efbfc160710 0x7efbfc1555c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7efbf400b370 tx=0x7efbf4004b40 comp rx=0 tx=0).stop 2023-10-18T12:20:50.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.004+0000 7efc0214f700 1 -- 172.21.15.114:0/144092780 shutdown_connections 2023-10-18T12:20:50.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.004+0000 7efc0214f700 1 --2- 172.21.15.114:0/144092780 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7efbe0065740 0x7efbe0067c00 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:50.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.004+0000 7efc0214f700 1 --2- 172.21.15.114:0/144092780 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efbfc0d2e00 0x7efbfc146460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:50.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.004+0000 7efc0214f700 1 --2- 172.21.15.114:0/144092780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efbfc160710 0x7efbfc1555c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:50.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.004+0000 7efc0214f700 1 --2- 172.21.15.114:0/144092780 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efbfc0b5ae0 0x7efbfc0d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:50.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.004+0000 7efc0214f700 1 -- 172.21.15.114:0/144092780 >> 172.21.15.114:0/144092780 conn(0x7efbfc069f20 msgr2=0x7efbfc0b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:50.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.004+0000 7efc0214f700 1 -- 172.21.15.114:0/144092780 shutdown_connections 2023-10-18T12:20:50.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.004+0000 7efc0214f700 1 -- 172.21.15.114:0/144092780 wait complete. 2023-10-18T12:20:50.031 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-18T12:20:50.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.208+0000 7fe8cf458700 1 Processor -- start 2023-10-18T12:20:50.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.208+0000 7fe8cf458700 1 -- start start 2023-10-18T12:20:50.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.208+0000 7fe8cf458700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe8c80b5b80 0x7fe8c815d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:50.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.208+0000 7fe8cf458700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe8c806f9a0 0x7fe8c806fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:50.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.212+0000 7fe8cf458700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8c8146ba0 con 0x7fe8c81467c0 2023-10-18T12:20:50.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.212+0000 7fe8cf458700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8c80d0920 con 0x7fe8c80b5b80 2023-10-18T12:20:50.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.212+0000 7fe8cf458700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c8070320 con 0x7fe8c806f9a0 2023-10-18T12:20:50.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.212+0000 7fe8cd1f4700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe8c81467c0 0x7fe8c81612e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49958/0 (socket says 172.21.15.114:49958) 2023-10-18T12:20:50.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.212+0000 7fe8cd1f4700 1 -- 172.21.15.114:0/1096822311 learned_addr learned my addr 172.21.15.114:0/1096822311 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:50.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.212+0000 7fe8cc9f3700 1 --2- 172.21.15.114:0/1096822311 >> v2:172.21.15.114:3300/0 conn(0x7fe8c80b5b80 0x7fe8c815d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:50.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.212+0000 7fe8cd9f5700 1 --2- 172.21.15.114:0/1096822311 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe8c806f9a0 0x7fe8c806fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:50.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.212+0000 7fe8bffff700 1 -- 172.21.15.114:0/1096822311 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 915251430 0 0) 0x7fe8c8146ba0 con 0x7fe8c81467c0 2023-10-18T12:20:50.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.212+0000 7fe8bffff700 1 -- 172.21.15.114:0/1096822311 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8b40035d0 con 0x7fe8c81467c0 2023-10-18T12:20:50.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.212+0000 7fe8cc9f3700 1 -- 172.21.15.114:0/1096822311 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe8c806f9a0 msgr2=0x7fe8c806fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:50.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.212+0000 7fe8cc9f3700 1 --2- 172.21.15.114:0/1096822311 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe8c806f9a0 0x7fe8c806fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:50.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.212+0000 7fe8cc9f3700 1 -- 172.21.15.114:0/1096822311 >> v1:172.21.15.114:6789/0 conn(0x7fe8c81467c0 legacy=0x7fe8c81612e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:50.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.212+0000 7fe8cc9f3700 1 -- 172.21.15.114:0/1096822311 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c80b6160 con 0x7fe8c80b5b80 2023-10-18T12:20:50.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.212+0000 7fe8cd9f5700 1 --2- 172.21.15.114:0/1096822311 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe8c806f9a0 0x7fe8c806fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:50.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.212+0000 7fe8cc9f3700 1 --2- 172.21.15.114:0/1096822311 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8c80b5b80 0x7fe8c815d310 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8009850 tx=0x7fe8b8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b35c51c8968c02a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:50.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.212+0000 7fe8bffff700 1 -- 172.21.15.114:0/1096822311 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b8011830 con 0x7fe8c80b5b80 2023-10-18T12:20:50.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.212+0000 7fe8bffff700 1 -- 172.21.15.114:0/1096822311 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b8011990 con 0x7fe8c80b5b80 2023-10-18T12:20:50.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.212+0000 7fe8bffff700 1 -- 172.21.15.114:0/1096822311 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b8011d40 con 0x7fe8c80b5b80 2023-10-18T12:20:50.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.212+0000 7fe8cf458700 1 -- 172.21.15.114:0/1096822311 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8c80b5b80 msgr2=0x7fe8c815d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:50.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.212+0000 7fe8cf458700 1 --2- 172.21.15.114:0/1096822311 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8c80b5b80 0x7fe8c815d310 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8009850 tx=0x7fe8b8009b60 comp rx=0 tx=0).stop 2023-10-18T12:20:50.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.212+0000 7fe8cf458700 1 -- 172.21.15.114:0/1096822311 shutdown_connections 2023-10-18T12:20:50.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.212+0000 7fe8cf458700 1 --2- 172.21.15.114:0/1096822311 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe8c806f9a0 0x7fe8c806fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:50.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.212+0000 7fe8cf458700 1 --2- 172.21.15.114:0/1096822311 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8c80b5b80 0x7fe8c815d310 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:50.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.216+0000 7fe8cf458700 1 -- 172.21.15.114:0/1096822311 >> 172.21.15.114:0/1096822311 conn(0x7fe8c806a130 msgr2=0x7fe8c806a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:50.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.216+0000 7fe8cf458700 1 -- 172.21.15.114:0/1096822311 shutdown_connections 2023-10-18T12:20:50.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.216+0000 7fe8cf458700 1 -- 172.21.15.114:0/1096822311 wait complete. 2023-10-18T12:20:50.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.216+0000 7fe8cf458700 1 Processor -- start 2023-10-18T12:20:50.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.216+0000 7fe8cf458700 1 -- start start 2023-10-18T12:20:50.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.220+0000 7fe8cf458700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8c806f9a0 0x7fe8c81f29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:50.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.220+0000 7fe8cf458700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe8c80b5b80 0x7fe8c815c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:50.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.220+0000 7fe8cf458700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8c81467c0 0x7fe8c80d0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:50.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.220+0000 7fe8cf458700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c813c7f0 con 0x7fe8c806f9a0 2023-10-18T12:20:50.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.220+0000 7fe8cf458700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c813bf30 con 0x7fe8c81467c0 2023-10-18T12:20:50.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.220+0000 7fe8cf458700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c813ca60 con 0x7fe8c80b5b80 2023-10-18T12:20:50.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.220+0000 7fe8cd1f4700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8c806f9a0 0x7fe8c81f29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:50.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.220+0000 7fe8cd1f4700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8c806f9a0 0x7fe8c81f29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39706/0 (socket says 172.21.15.114:39706) 2023-10-18T12:20:50.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.220+0000 7fe8cd1f4700 1 -- 172.21.15.114:0/4162361503 learned_addr learned my addr 172.21.15.114:0/4162361503 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:50.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.220+0000 7fe8cd9f5700 1 --2- 172.21.15.114:0/4162361503 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8c81467c0 0x7fe8c80d0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:50.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.220+0000 7fe8cc9f3700 1 --2- 172.21.15.114:0/4162361503 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe8c80b5b80 0x7fe8c815c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:50.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.220+0000 7fe8cd1f4700 1 -- 172.21.15.114:0/4162361503 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe8c80b5b80 msgr2=0x7fe8c815c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:50.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.220+0000 7fe8cd1f4700 1 --2- 172.21.15.114:0/4162361503 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe8c80b5b80 0x7fe8c815c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:50.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.220+0000 7fe8cd1f4700 1 -- 172.21.15.114:0/4162361503 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8c81467c0 msgr2=0x7fe8c80d0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:50.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.220+0000 7fe8cd1f4700 1 --2- 172.21.15.114:0/4162361503 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8c81467c0 0x7fe8c80d0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:50.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.220+0000 7fe8cd1f4700 1 -- 172.21.15.114:0/4162361503 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b80094b0 con 0x7fe8c806f9a0 2023-10-18T12:20:50.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.220+0000 7fe8cd1f4700 1 --2- 172.21.15.114:0/4162361503 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8c806f9a0 0x7fe8c81f29b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe8c400c4d0 tx=0x7fe8c400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:50.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.220+0000 7fe8bdffb700 1 -- 172.21.15.114:0/4162361503 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c4005d90 con 0x7fe8c806f9a0 2023-10-18T12:20:50.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.220+0000 7fe8bdffb700 1 -- 172.21.15.114:0/4162361503 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c40070d0 con 0x7fe8c806f9a0 2023-10-18T12:20:50.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.220+0000 7fe8cf458700 1 -- 172.21.15.114:0/4162361503 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8c813cd40 con 0x7fe8c806f9a0 2023-10-18T12:20:50.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.220+0000 7fe8bdffb700 1 -- 172.21.15.114:0/4162361503 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c4007480 con 0x7fe8c806f9a0 2023-10-18T12:20:50.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.220+0000 7fe8cf458700 1 -- 172.21.15.114:0/4162361503 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8c813c210 con 0x7fe8c806f9a0 2023-10-18T12:20:50.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.224+0000 7fe8cf458700 1 -- 172.21.15.114:0/4162361503 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8c80b69e0 con 0x7fe8c806f9a0 2023-10-18T12:20:50.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.224+0000 7fe8bdffb700 1 -- 172.21.15.114:0/4162361503 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fe8c40075e0 con 0x7fe8c806f9a0 2023-10-18T12:20:50.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.224+0000 7fe8bdffb700 1 --2- 172.21.15.114:0/4162361503 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe8ac0656f0 0x7fe8ac067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:50.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.224+0000 7fe8bdffb700 1 -- 172.21.15.114:0/4162361503 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe8c40825b0 con 0x7fe8c806f9a0 2023-10-18T12:20:50.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.224+0000 7fe8cc9f3700 1 --2- 172.21.15.114:0/4162361503 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe8ac0656f0 0x7fe8ac067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:50.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.228+0000 7fe8cc9f3700 1 --2- 172.21.15.114:0/4162361503 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe8ac0656f0 0x7fe8ac067bb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe8b80090b0 tx=0x7fe8b8008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:50.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.232+0000 7fe8bdffb700 1 -- 172.21.15.114:0/4162361503 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fe8c80b69e0 con 0x7fe8c806f9a0 2023-10-18T12:20:50.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.408+0000 7fe8cf458700 1 -- 172.21.15.114:0/4162361503 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe8c80b69e0 con 0x7fe8c806f9a0 2023-10-18T12:20:50.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.408+0000 7fe8bdffb700 1 -- 172.21.15.114:0/4162361503 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe8c80b69e0 con 0x7fe8c806f9a0 2023-10-18T12:20:50.414 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-10-18T12:20:50.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.412+0000 7fe8cf458700 1 -- 172.21.15.114:0/4162361503 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe8ac0656f0 msgr2=0x7fe8ac067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:50.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.412+0000 7fe8cf458700 1 --2- 172.21.15.114:0/4162361503 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe8ac0656f0 0x7fe8ac067bb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe8b80090b0 tx=0x7fe8b8008030 comp rx=0 tx=0).stop 2023-10-18T12:20:50.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.412+0000 7fe8cf458700 1 -- 172.21.15.114:0/4162361503 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8c806f9a0 msgr2=0x7fe8c81f29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:50.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.412+0000 7fe8cf458700 1 --2- 172.21.15.114:0/4162361503 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8c806f9a0 0x7fe8c81f29b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe8c400c4d0 tx=0x7fe8c400c7e0 comp rx=0 tx=0).stop 2023-10-18T12:20:50.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.412+0000 7fe8cf458700 1 -- 172.21.15.114:0/4162361503 shutdown_connections 2023-10-18T12:20:50.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.412+0000 7fe8cf458700 1 --2- 172.21.15.114:0/4162361503 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe8ac0656f0 0x7fe8ac067bb0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:50.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.412+0000 7fe8cf458700 1 --2- 172.21.15.114:0/4162361503 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe8c80b5b80 0x7fe8c815c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:50.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.412+0000 7fe8cf458700 1 --2- 172.21.15.114:0/4162361503 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8c81467c0 0x7fe8c80d0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:50.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.412+0000 7fe8cf458700 1 --2- 172.21.15.114:0/4162361503 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8c806f9a0 0x7fe8c81f29b0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:50.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.412+0000 7fe8cf458700 1 -- 172.21.15.114:0/4162361503 >> 172.21.15.114:0/4162361503 conn(0x7fe8c806a130 msgr2=0x7fe8c806a510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:50.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.412+0000 7fe8cf458700 1 -- 172.21.15.114:0/4162361503 shutdown_connections 2023-10-18T12:20:50.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.412+0000 7fe8cf458700 1 -- 172.21.15.114:0/4162361503 wait complete. 2023-10-18T12:20:50.443 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-18T12:20:50.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.616+0000 7f9082698700 1 Processor -- start 2023-10-18T12:20:50.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.616+0000 7f9082698700 1 -- start start 2023-10-18T12:20:50.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.620+0000 7f9082698700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f907c160710 0x7f907c0b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:50.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.620+0000 7f9082698700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f907c0b5ae0 0x7f907c06db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:50.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.620+0000 7f9082698700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f907c15d0d0 con 0x7f907c0d2e00 2023-10-18T12:20:50.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.620+0000 7f9082698700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f907c15df90 con 0x7f907c0b5ae0 2023-10-18T12:20:50.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.620+0000 7f9082698700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f907c06f0f0 con 0x7f907c160710 2023-10-18T12:20:50.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.620+0000 7f9081696700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f907c0d2e00 0x7f907c0d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49970/0 (socket says 172.21.15.114:49970) 2023-10-18T12:20:50.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.620+0000 7f9081696700 1 -- 172.21.15.114:0/2356026923 learned_addr learned my addr 172.21.15.114:0/2356026923 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:50.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.620+0000 7f9081e97700 1 --2- 172.21.15.114:0/2356026923 >> v2:172.21.15.114:3300/0 conn(0x7f907c0b5ae0 0x7f907c06db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:50.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.620+0000 7f9080e95700 1 --2- 172.21.15.114:0/2356026923 >> v2:172.21.15.172:3300/0 conn(0x7f907c160710 0x7f907c0b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:50.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.620+0000 7f9073fff700 1 -- 172.21.15.114:0/2356026923 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2594143134 0 0) 0x7f9078001110 con 0x7f907c0d2e00 2023-10-18T12:20:50.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.620+0000 7f9073fff700 1 -- 172.21.15.114:0/2356026923 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90680035d0 con 0x7f907c0d2e00 2023-10-18T12:20:50.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.620+0000 7f9081e97700 1 -- 172.21.15.114:0/2356026923 >> v2:172.21.15.172:3300/0 conn(0x7f907c160710 msgr2=0x7f907c0b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:50.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.620+0000 7f9081e97700 1 --2- 172.21.15.114:0/2356026923 >> v2:172.21.15.172:3300/0 conn(0x7f907c160710 0x7f907c0b6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:50.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.620+0000 7f9081e97700 1 -- 172.21.15.114:0/2356026923 >> v1:172.21.15.114:6789/0 conn(0x7f907c0d2e00 legacy=0x7f907c0d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:50.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.620+0000 7f9081e97700 1 -- 172.21.15.114:0/2356026923 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f907c15d310 con 0x7f907c0b5ae0 2023-10-18T12:20:50.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.620+0000 7f9081e97700 1 --2- 172.21.15.114:0/2356026923 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f907c0b5ae0 0x7f907c06db60 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f907c0d2420 tx=0x7f907400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c9342921da5670 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:50.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.620+0000 7f9073fff700 1 -- 172.21.15.114:0/2356026923 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907400e070 con 0x7f907c0b5ae0 2023-10-18T12:20:50.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.620+0000 7f9073fff700 1 -- 172.21.15.114:0/2356026923 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f907400bb20 con 0x7f907c0b5ae0 2023-10-18T12:20:50.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.620+0000 7f9073fff700 1 -- 172.21.15.114:0/2356026923 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9074012430 con 0x7f907c0b5ae0 2023-10-18T12:20:50.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.624+0000 7f9082698700 1 -- 172.21.15.114:0/2356026923 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f907c0b5ae0 msgr2=0x7f907c06db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:50.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.624+0000 7f9082698700 1 --2- 172.21.15.114:0/2356026923 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f907c0b5ae0 0x7f907c06db60 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f907c0d2420 tx=0x7f907400b330 comp rx=0 tx=0).stop 2023-10-18T12:20:50.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.624+0000 7f9082698700 1 -- 172.21.15.114:0/2356026923 shutdown_connections 2023-10-18T12:20:50.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.624+0000 7f9082698700 1 --2- 172.21.15.114:0/2356026923 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f907c0b5ae0 0x7f907c06db60 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:50.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.624+0000 7f9082698700 1 --2- 172.21.15.114:0/2356026923 >> v2:172.21.15.172:3300/0 conn(0x7f907c160710 0x7f907c0b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:50.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.624+0000 7f9082698700 1 -- 172.21.15.114:0/2356026923 >> 172.21.15.114:0/2356026923 conn(0x7f907c069f20 msgr2=0x7f907c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:50.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.624+0000 7f9082698700 1 -- 172.21.15.114:0/2356026923 shutdown_connections 2023-10-18T12:20:50.632 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.624+0000 7f9082698700 1 -- 172.21.15.114:0/2356026923 wait complete. 2023-10-18T12:20:50.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.624+0000 7f9082698700 1 Processor -- start 2023-10-18T12:20:50.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.624+0000 7f9082698700 1 -- start start 2023-10-18T12:20:50.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.624+0000 7f9082698700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f907c0b5ae0 0x7f907c154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:50.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.624+0000 7f9082698700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f907c0d2e00 0x7f907c155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:50.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.624+0000 7f9082698700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f907c160710 0x7f907c15b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:50.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.624+0000 7f9082698700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f907c155e80 con 0x7f907c160710 2023-10-18T12:20:50.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.628+0000 7f9082698700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f907c159ba0 con 0x7f907c0d2e00 2023-10-18T12:20:50.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.628+0000 7f9082698700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f907c156090 con 0x7f907c0b5ae0 2023-10-18T12:20:50.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.628+0000 7f9081e97700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f907c160710 0x7f907c15b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:50.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.628+0000 7f9081e97700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f907c160710 0x7f907c15b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39720/0 (socket says 172.21.15.114:39720) 2023-10-18T12:20:50.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.628+0000 7f9081e97700 1 -- 172.21.15.114:0/3597278270 learned_addr learned my addr 172.21.15.114:0/3597278270 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:50.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.628+0000 7f9080e95700 1 --2- 172.21.15.114:0/3597278270 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f907c0d2e00 0x7f907c155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:50.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.628+0000 7f9081696700 1 --2- 172.21.15.114:0/3597278270 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f907c0b5ae0 0x7f907c154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:50.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.628+0000 7f9081e97700 1 -- 172.21.15.114:0/3597278270 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f907c0b5ae0 msgr2=0x7f907c154920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:50.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.628+0000 7f9081e97700 1 --2- 172.21.15.114:0/3597278270 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f907c0b5ae0 0x7f907c154920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:50.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.628+0000 7f9081e97700 1 -- 172.21.15.114:0/3597278270 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f907c0d2e00 msgr2=0x7f907c155940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:50.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.628+0000 7f9081e97700 1 --2- 172.21.15.114:0/3597278270 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f907c0d2e00 0x7f907c155940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:50.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.628+0000 7f9081e97700 1 -- 172.21.15.114:0/3597278270 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9074009a70 con 0x7f907c160710 2023-10-18T12:20:50.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.628+0000 7f9081e97700 1 --2- 172.21.15.114:0/3597278270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f907c160710 0x7f907c15b0d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f907400b370 tx=0x7f9074004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:50.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.628+0000 7f9071ffb700 1 -- 172.21.15.114:0/3597278270 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9074012430 con 0x7f907c160710 2023-10-18T12:20:50.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.628+0000 7f9071ffb700 1 -- 172.21.15.114:0/3597278270 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9074020070 con 0x7f907c160710 2023-10-18T12:20:50.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.628+0000 7f9082698700 1 -- 172.21.15.114:0/3597278270 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f907c156370 con 0x7f907c160710 2023-10-18T12:20:50.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.628+0000 7f9071ffb700 1 -- 172.21.15.114:0/3597278270 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9074004280 con 0x7f907c160710 2023-10-18T12:20:50.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.628+0000 7f9082698700 1 -- 172.21.15.114:0/3597278270 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f907c156930 con 0x7f907c160710 2023-10-18T12:20:50.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.628+0000 7f9082698700 1 -- 172.21.15.114:0/3597278270 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f907c0ab8e0 con 0x7f907c160710 2023-10-18T12:20:50.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.632+0000 7f9071ffb700 1 -- 172.21.15.114:0/3597278270 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f90740043e0 con 0x7f907c160710 2023-10-18T12:20:50.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.632+0000 7f9071ffb700 1 --2- 172.21.15.114:0/3597278270 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f90600656f0 0x7f9060067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:50.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.632+0000 7f9071ffb700 1 -- 172.21.15.114:0/3597278270 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9074022070 con 0x7f907c160710 2023-10-18T12:20:50.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.632+0000 7f9081696700 1 --2- 172.21.15.114:0/3597278270 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f90600656f0 0x7f9060067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:50.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.632+0000 7f9081696700 1 --2- 172.21.15.114:0/3597278270 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f90600656f0 0x7f9060067bb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9078001270 tx=0x7f9078009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:50.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.636+0000 7f9071ffb700 1 -- 172.21.15.114:0/3597278270 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f907c0ab8e0 con 0x7f907c160710 2023-10-18T12:20:50.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.812+0000 7f9082698700 1 -- 172.21.15.114:0/3597278270 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f907c0ab8e0 con 0x7f907c160710 2023-10-18T12:20:50.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.812+0000 7f9071ffb700 1 -- 172.21.15.114:0/3597278270 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f907c0ab8e0 con 0x7f907c160710 2023-10-18T12:20:50.818 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-10-18T12:20:50.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.816+0000 7f9082698700 1 -- 172.21.15.114:0/3597278270 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f90600656f0 msgr2=0x7f9060067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:50.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.816+0000 7f9082698700 1 --2- 172.21.15.114:0/3597278270 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f90600656f0 0x7f9060067bb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9078001270 tx=0x7f9078009040 comp rx=0 tx=0).stop 2023-10-18T12:20:50.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.816+0000 7f9082698700 1 -- 172.21.15.114:0/3597278270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f907c160710 msgr2=0x7f907c15b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:50.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.816+0000 7f9082698700 1 --2- 172.21.15.114:0/3597278270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f907c160710 0x7f907c15b0d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f907400b370 tx=0x7f9074004b40 comp rx=0 tx=0).stop 2023-10-18T12:20:50.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.816+0000 7f9082698700 1 -- 172.21.15.114:0/3597278270 shutdown_connections 2023-10-18T12:20:50.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.816+0000 7f9082698700 1 --2- 172.21.15.114:0/3597278270 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f90600656f0 0x7f9060067bb0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:50.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.816+0000 7f9082698700 1 --2- 172.21.15.114:0/3597278270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f907c160710 0x7f907c15b0d0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:50.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.816+0000 7f9082698700 1 --2- 172.21.15.114:0/3597278270 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f907c0d2e00 0x7f907c155940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:50.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.816+0000 7f9082698700 1 --2- 172.21.15.114:0/3597278270 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f907c0b5ae0 0x7f907c154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:50.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.816+0000 7f9082698700 1 -- 172.21.15.114:0/3597278270 >> 172.21.15.114:0/3597278270 conn(0x7f907c069f20 msgr2=0x7f907c0b3920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:50.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.816+0000 7f9082698700 1 -- 172.21.15.114:0/3597278270 shutdown_connections 2023-10-18T12:20:50.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:50.816+0000 7f9082698700 1 -- 172.21.15.114:0/3597278270 wait complete. 2023-10-18T12:20:50.846 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-18T12:20:51.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.008+0000 7fe6a99af700 1 Processor -- start 2023-10-18T12:20:51.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.008+0000 7fe6a99af700 1 -- start start 2023-10-18T12:20:51.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.012+0000 7fe6a99af700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe6a40b1ab0 0x7fe6a40b4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:51.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.012+0000 7fe6a99af700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe6a40b1e90 0x7fe6a40b4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:51.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.012+0000 7fe6a99af700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6a40d03b0 con 0x7fe6a415def0 2023-10-18T12:20:51.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.012+0000 7fe6a99af700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6a415e440 con 0x7fe6a40b1ab0 2023-10-18T12:20:51.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.012+0000 7fe6a99af700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6a40cfdf0 con 0x7fe6a40b1e90 2023-10-18T12:20:51.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.012+0000 7fe6a89ad700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe6a40b1ab0 0x7fe6a40b4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:51.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.012+0000 7fe6a89ad700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe6a40b1ab0 0x7fe6a40b4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39726/0 (socket says 172.21.15.114:39726) 2023-10-18T12:20:51.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.012+0000 7fe6a89ad700 1 -- 172.21.15.114:0/1657296037 learned_addr learned my addr 172.21.15.114:0/1657296037 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:51.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.012+0000 7fe6a3fff700 1 --2- 172.21.15.114:0/1657296037 >> v2:172.21.15.172:3300/0 conn(0x7fe6a40b1e90 0x7fe6a40b4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:51.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.012+0000 7fe6a89ad700 1 -- 172.21.15.114:0/1657296037 >> v2:172.21.15.172:3300/0 conn(0x7fe6a40b1e90 msgr2=0x7fe6a40b4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:51.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.012+0000 7fe6a89ad700 1 --2- 172.21.15.114:0/1657296037 >> v2:172.21.15.172:3300/0 conn(0x7fe6a40b1e90 0x7fe6a40b4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:51.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.012+0000 7fe6a89ad700 1 -- 172.21.15.114:0/1657296037 >> v1:172.21.15.172:6789/0 conn(0x7fe6a415def0 legacy=0x7fe6a406e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:51.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.012+0000 7fe6a89ad700 1 -- 172.21.15.114:0/1657296037 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a40d00d0 con 0x7fe6a40b1ab0 2023-10-18T12:20:51.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.012+0000 7fe6a89ad700 1 --2- 172.21.15.114:0/1657296037 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6a40b1ab0 0x7fe6a40b4ab0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe6a406c3e0 tx=0x7fe698009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a1fcd73f35574a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:51.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.012+0000 7fe6a37fe700 1 -- 172.21.15.114:0/1657296037 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe698004230 con 0x7fe6a40b1ab0 2023-10-18T12:20:51.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.012+0000 7fe6a37fe700 1 -- 172.21.15.114:0/1657296037 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe698004390 con 0x7fe6a40b1ab0 2023-10-18T12:20:51.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.012+0000 7fe6a37fe700 1 -- 172.21.15.114:0/1657296037 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6980036c0 con 0x7fe6a40b1ab0 2023-10-18T12:20:51.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.012+0000 7fe6a99af700 1 -- 172.21.15.114:0/1657296037 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6a40b1ab0 msgr2=0x7fe6a40b4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:51.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.012+0000 7fe6a99af700 1 --2- 172.21.15.114:0/1657296037 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6a40b1ab0 0x7fe6a40b4ab0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe6a406c3e0 tx=0x7fe698009bf0 comp rx=0 tx=0).stop 2023-10-18T12:20:51.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.012+0000 7fe6a99af700 1 -- 172.21.15.114:0/1657296037 shutdown_connections 2023-10-18T12:20:51.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.012+0000 7fe6a99af700 1 --2- 172.21.15.114:0/1657296037 >> v2:172.21.15.172:3300/0 conn(0x7fe6a40b1e90 0x7fe6a40b4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:51.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.012+0000 7fe6a99af700 1 --2- 172.21.15.114:0/1657296037 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6a40b1ab0 0x7fe6a40b4ab0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:51.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.012+0000 7fe6a99af700 1 -- 172.21.15.114:0/1657296037 >> 172.21.15.114:0/1657296037 conn(0x7fe6a4069d10 msgr2=0x7fe6a406a120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:51.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.012+0000 7fe6a99af700 1 -- 172.21.15.114:0/1657296037 shutdown_connections 2023-10-18T12:20:51.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.012+0000 7fe6a99af700 1 -- 172.21.15.114:0/1657296037 wait complete. 2023-10-18T12:20:51.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.016+0000 7fe6a99af700 1 Processor -- start 2023-10-18T12:20:51.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.016+0000 7fe6a99af700 1 -- start start 2023-10-18T12:20:51.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.016+0000 7fe6a99af700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe6a40b1ab0 0x7fe6a40c8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:51.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.016+0000 7fe6a99af700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6a40b1e90 0x7fe6a4159f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:51.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.016+0000 7fe6a99af700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6a415def0 0x7fe6a415ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:51.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.016+0000 7fe6a99af700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a40c8e50 con 0x7fe6a40b1e90 2023-10-18T12:20:51.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.016+0000 7fe6a99af700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a415a920 con 0x7fe6a415def0 2023-10-18T12:20:51.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.016+0000 7fe6a99af700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a415ac00 con 0x7fe6a40b1ab0 2023-10-18T12:20:51.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.020+0000 7fe6a3fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6a40b1e90 0x7fe6a4159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:51.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.020+0000 7fe6a3fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6a40b1e90 0x7fe6a4159f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39730/0 (socket says 172.21.15.114:39730) 2023-10-18T12:20:51.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.020+0000 7fe6a3fff700 1 -- 172.21.15.114:0/1451391589 learned_addr learned my addr 172.21.15.114:0/1451391589 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:51.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.020+0000 7fe6a89ad700 1 --2- 172.21.15.114:0/1451391589 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe6a40b1ab0 0x7fe6a40c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:51.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.020+0000 7fe6a91ae700 1 --2- 172.21.15.114:0/1451391589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6a415def0 0x7fe6a415ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:51.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.020+0000 7fe6a3fff700 1 -- 172.21.15.114:0/1451391589 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe6a40b1ab0 msgr2=0x7fe6a40c8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:51.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.020+0000 7fe6a3fff700 1 --2- 172.21.15.114:0/1451391589 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe6a40b1ab0 0x7fe6a40c8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:51.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.020+0000 7fe6a3fff700 1 -- 172.21.15.114:0/1451391589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6a415def0 msgr2=0x7fe6a415ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:51.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.020+0000 7fe6a3fff700 1 --2- 172.21.15.114:0/1451391589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6a415def0 0x7fe6a415ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:51.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.020+0000 7fe6a3fff700 1 -- 172.21.15.114:0/1451391589 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe698009570 con 0x7fe6a40b1e90 2023-10-18T12:20:51.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.020+0000 7fe6a3fff700 1 --2- 172.21.15.114:0/1451391589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6a40b1e90 0x7fe6a4159f20 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe69000d800 tx=0x7fe69000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:51.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.020+0000 7fe6a17fa700 1 -- 172.21.15.114:0/1451391589 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe690004240 con 0x7fe6a40b1e90 2023-10-18T12:20:51.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.020+0000 7fe6a17fa700 1 -- 172.21.15.114:0/1451391589 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6900043a0 con 0x7fe6a40b1e90 2023-10-18T12:20:51.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.020+0000 7fe6a99af700 1 -- 172.21.15.114:0/1451391589 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6a415aee0 con 0x7fe6a40b1e90 2023-10-18T12:20:51.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.020+0000 7fe6a17fa700 1 -- 172.21.15.114:0/1451391589 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6900036c0 con 0x7fe6a40b1e90 2023-10-18T12:20:51.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.020+0000 7fe6a99af700 1 -- 172.21.15.114:0/1451391589 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6a415b1c0 con 0x7fe6a40b1e90 2023-10-18T12:20:51.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.020+0000 7fe6a99af700 1 -- 172.21.15.114:0/1451391589 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6a404e910 con 0x7fe6a40b1e90 2023-10-18T12:20:51.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.024+0000 7fe6a17fa700 1 -- 172.21.15.114:0/1451391589 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fe690003820 con 0x7fe6a40b1e90 2023-10-18T12:20:51.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.024+0000 7fe6a17fa700 1 --2- 172.21.15.114:0/1451391589 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe6880656f0 0x7fe688067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:51.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.024+0000 7fe6a17fa700 1 -- 172.21.15.114:0/1451391589 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe690082eb0 con 0x7fe6a40b1e90 2023-10-18T12:20:51.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.024+0000 7fe6a89ad700 1 --2- 172.21.15.114:0/1451391589 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe6880656f0 0x7fe688067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:51.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.028+0000 7fe6a89ad700 1 --2- 172.21.15.114:0/1451391589 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe6880656f0 0x7fe688067bb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe6a406c3e0 tx=0x7fe698008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:51.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.032+0000 7fe6a17fa700 1 -- 172.21.15.114:0/1451391589 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fe6900505a0 con 0x7fe6a40b1e90 2023-10-18T12:20:51.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.232+0000 7fe6a99af700 1 -- 172.21.15.114:0/1451391589 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe6a40d3510 con 0x7fe6a40b1e90 2023-10-18T12:20:51.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.232+0000 7fe6a17fa700 1 -- 172.21.15.114:0/1451391589 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe690053bc0 con 0x7fe6a40b1e90 2023-10-18T12:20:51.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.236+0000 7fe6a99af700 1 -- 172.21.15.114:0/1451391589 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe6880656f0 msgr2=0x7fe688067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:51.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.236+0000 7fe6a99af700 1 --2- 172.21.15.114:0/1451391589 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe6880656f0 0x7fe688067bb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe6a406c3e0 tx=0x7fe698008030 comp rx=0 tx=0).stop 2023-10-18T12:20:51.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.236+0000 7fe6a99af700 1 -- 172.21.15.114:0/1451391589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6a40b1e90 msgr2=0x7fe6a4159f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:51.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.236+0000 7fe6a99af700 1 --2- 172.21.15.114:0/1451391589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6a40b1e90 0x7fe6a4159f20 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe69000d800 tx=0x7fe69000db10 comp rx=0 tx=0).stop 2023-10-18T12:20:51.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.240+0000 7fe6a99af700 1 -- 172.21.15.114:0/1451391589 shutdown_connections 2023-10-18T12:20:51.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.240+0000 7fe6a99af700 1 --2- 172.21.15.114:0/1451391589 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe6880656f0 0x7fe688067bb0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:51.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.240+0000 7fe6a99af700 1 --2- 172.21.15.114:0/1451391589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6a415def0 0x7fe6a415ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:51.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.240+0000 7fe6a99af700 1 --2- 172.21.15.114:0/1451391589 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe6a40b1e90 0x7fe6a4159f20 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:51.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.240+0000 7fe6a99af700 1 --2- 172.21.15.114:0/1451391589 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe6a40b1ab0 0x7fe6a40c8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:51.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.240+0000 7fe6a99af700 1 -- 172.21.15.114:0/1451391589 >> 172.21.15.114:0/1451391589 conn(0x7fe6a4069d10 msgr2=0x7fe6a40b5930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:51.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.240+0000 7fe6a99af700 1 -- 172.21.15.114:0/1451391589 shutdown_connections 2023-10-18T12:20:51.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.240+0000 7fe6a99af700 1 -- 172.21.15.114:0/1451391589 wait complete. 2023-10-18T12:20:51.247 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2023-10-18T12:20:51.266 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-10-18T12:20:51.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:51.267 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-10-18T12:20:51.304 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2023-10-18T12:20:51.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:51.305 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-18T12:20:51.369 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T12:20:51.369 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-18T12:20:51.390 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T12:20:51.391 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-18T12:20:51.457 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T12:20:51.457 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-18T12:20:51.522 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T12:20:51.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.700+0000 7f5589261700 1 Processor -- start 2023-10-18T12:20:51.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.700+0000 7f5589261700 1 -- start start 2023-10-18T12:20:51.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.704+0000 7f5589261700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f558406d090 0x7f55840b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:51.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.704+0000 7f5589261700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f558406d470 0x7f5584070a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:51.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.704+0000 7f5589261700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f558415e990 con 0x7f5584070f50 2023-10-18T12:20:51.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.704+0000 7f5589261700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f558415f4f0 con 0x7f558406d470 2023-10-18T12:20:51.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.704+0000 7f5589261700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f558415ec50 con 0x7f558406d090 2023-10-18T12:20:51.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.704+0000 7f5583fff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f558406d090 0x7f55840b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:51.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.704+0000 7f5588a60700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f5584070f50 0x7f558415a410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.114:39598/0 (socket says 172.21.15.114:39598) 2023-10-18T12:20:51.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.704+0000 7f5588a60700 1 -- 172.21.15.114:0/3449527245 learned_addr learned my addr 172.21.15.114:0/3449527245 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:51.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.704+0000 7f557bfff700 1 --2- 172.21.15.114:0/3449527245 >> v2:172.21.15.172:3300/0 conn(0x7f558406d470 0x7f5584070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:51.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.704+0000 7f5583fff700 1 -- 172.21.15.114:0/3449527245 >> v2:172.21.15.172:3300/0 conn(0x7f558406d470 msgr2=0x7f5584070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:51.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.704+0000 7f5583fff700 1 --2- 172.21.15.114:0/3449527245 >> v2:172.21.15.172:3300/0 conn(0x7f558406d470 0x7f5584070a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:51.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.704+0000 7f5583fff700 1 -- 172.21.15.114:0/3449527245 >> v1:172.21.15.172:6789/0 conn(0x7f5584070f50 legacy=0x7f558415a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:51.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.704+0000 7f55837fe700 1 -- 172.21.15.114:0/3449527245 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1931494129 0 0) 0x7f558415e990 con 0x7f5584070f50 2023-10-18T12:20:51.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.704+0000 7f5583fff700 1 -- 172.21.15.114:0/3449527245 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f558415ef30 con 0x7f558406d090 2023-10-18T12:20:51.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.704+0000 7f5583fff700 1 --2- 172.21.15.114:0/3449527245 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f558406d090 0x7f55840b2590 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5574009850 tx=0x7f5574009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ea451d0515eaf09 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:51.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.704+0000 7f55837fe700 1 -- 172.21.15.114:0/3449527245 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5574011830 con 0x7f558406d090 2023-10-18T12:20:51.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.704+0000 7f55837fe700 1 -- 172.21.15.114:0/3449527245 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5574011990 con 0x7f558406d090 2023-10-18T12:20:51.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.704+0000 7f55837fe700 1 -- 172.21.15.114:0/3449527245 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5574011d40 con 0x7f558406d090 2023-10-18T12:20:51.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.708+0000 7f5589261700 1 -- 172.21.15.114:0/3449527245 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f558406d090 msgr2=0x7f55840b2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:51.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.708+0000 7f5589261700 1 --2- 172.21.15.114:0/3449527245 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f558406d090 0x7f55840b2590 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5574009850 tx=0x7f5574009b60 comp rx=0 tx=0).stop 2023-10-18T12:20:51.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.708+0000 7f5589261700 1 -- 172.21.15.114:0/3449527245 shutdown_connections 2023-10-18T12:20:51.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.708+0000 7f5589261700 1 --2- 172.21.15.114:0/3449527245 >> v2:172.21.15.172:3300/0 conn(0x7f558406d470 0x7f5584070a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:51.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.708+0000 7f5589261700 1 --2- 172.21.15.114:0/3449527245 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f558406d090 0x7f55840b2590 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:51.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.708+0000 7f5589261700 1 -- 172.21.15.114:0/3449527245 >> 172.21.15.114:0/3449527245 conn(0x7f55840ce5c0 msgr2=0x7f55840ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:51.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.708+0000 7f5589261700 1 -- 172.21.15.114:0/3449527245 shutdown_connections 2023-10-18T12:20:51.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.708+0000 7f5589261700 1 -- 172.21.15.114:0/3449527245 wait complete. 2023-10-18T12:20:51.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.712+0000 7f5589261700 1 Processor -- start 2023-10-18T12:20:51.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.712+0000 7f5589261700 1 -- start start 2023-10-18T12:20:51.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.712+0000 7f5589261700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f558406d090 0x7f558406f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:51.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.712+0000 7f5589261700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f558406d470 0x7f5584145c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:51.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.712+0000 7f5589261700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5584070f50 0x7f5584146190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:51.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.712+0000 7f5589261700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5584146880 con 0x7f558406d090 2023-10-18T12:20:51.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.712+0000 7f5589261700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55840c5690 con 0x7f558406d470 2023-10-18T12:20:51.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.712+0000 7f5589261700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55840c58e0 con 0x7f5584070f50 2023-10-18T12:20:51.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.712+0000 7f5583fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f558406d090 0x7f558406f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:51.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.712+0000 7f5583fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f558406d090 0x7f558406f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39744/0 (socket says 172.21.15.114:39744) 2023-10-18T12:20:51.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.712+0000 7f5583fff700 1 -- 172.21.15.114:0/933131300 learned_addr learned my addr 172.21.15.114:0/933131300 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:51.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.712+0000 7f5588a60700 1 --2- 172.21.15.114:0/933131300 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5584070f50 0x7f5584146190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:51.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.712+0000 7f557bfff700 1 --2- 172.21.15.114:0/933131300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f558406d470 0x7f5584145c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:51.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.716+0000 7f5583fff700 1 -- 172.21.15.114:0/933131300 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5584070f50 msgr2=0x7f5584146190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:51.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.716+0000 7f5583fff700 1 --2- 172.21.15.114:0/933131300 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5584070f50 0x7f5584146190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:51.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.716+0000 7f5583fff700 1 -- 172.21.15.114:0/933131300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f558406d470 msgr2=0x7f5584145c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:51.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.716+0000 7f5583fff700 1 --2- 172.21.15.114:0/933131300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f558406d470 0x7f5584145c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:51.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.716+0000 7f5583fff700 1 -- 172.21.15.114:0/933131300 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55740094b0 con 0x7f558406d090 2023-10-18T12:20:51.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.716+0000 7f5583fff700 1 --2- 172.21.15.114:0/933131300 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f558406d090 0x7f558406f6c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5574000c00 tx=0x7f5574004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:51.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.716+0000 7f55817fa700 1 -- 172.21.15.114:0/933131300 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557401aac0 con 0x7f558406d090 2023-10-18T12:20:51.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.716+0000 7f55817fa700 1 -- 172.21.15.114:0/933131300 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f557401f070 con 0x7f558406d090 2023-10-18T12:20:51.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.716+0000 7f5589261700 1 -- 172.21.15.114:0/933131300 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55840c5bc0 con 0x7f558406d090 2023-10-18T12:20:51.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.716+0000 7f55817fa700 1 -- 172.21.15.114:0/933131300 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557401ae60 con 0x7f558406d090 2023-10-18T12:20:51.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.716+0000 7f5589261700 1 -- 172.21.15.114:0/933131300 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55840c6180 con 0x7f558406d090 2023-10-18T12:20:51.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.716+0000 7f5589261700 1 -- 172.21.15.114:0/933131300 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5584072e60 con 0x7f558406d090 2023-10-18T12:20:51.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.720+0000 7f55817fa700 1 -- 172.21.15.114:0/933131300 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f557401b430 con 0x7f558406d090 2023-10-18T12:20:51.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.720+0000 7f55817fa700 1 --2- 172.21.15.114:0/933131300 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f55640656f0 0x7f5564067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:51.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.720+0000 7f55817fa700 1 -- 172.21.15.114:0/933131300 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5574084290 con 0x7f558406d090 2023-10-18T12:20:51.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.720+0000 7f557bfff700 1 --2- 172.21.15.114:0/933131300 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f55640656f0 0x7f5564067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:51.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.724+0000 7f557bfff700 1 --2- 172.21.15.114:0/933131300 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f55640656f0 0x7f5564067bb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5584153c50 tx=0x7f556c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:51.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.728+0000 7f55817fa700 1 -- 172.21.15.114:0/933131300 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f5574051a10 con 0x7f558406d090 2023-10-18T12:20:51.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.904+0000 7f5589261700 1 -- 172.21.15.114:0/933131300 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f558415e6d0 con 0x7f558406d090 2023-10-18T12:20:51.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.908+0000 7f55817fa700 1 -- 172.21.15.114:0/933131300 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20240 (secure 0 0 0) 0x7f5574055030 con 0x7f558406d090 2023-10-18T12:20:51.915 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:20:51.915 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":30,"fsid":"240ea340-5d3d-4f52-a4bc-af075aca3deb","created":"2023-10-18T12:19:12.512994+0000","modified":"2023-10-18T12:20:20.604528+0000","last_up_change":"2023-10-18T12:19:25.286009+0000","last_in_change":"2023-10-18T12:19:15.850693+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T12:19:27.040638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-18T12:19:32.358094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-18T12:19:37.333855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-18T12:19:38.055385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-18T12:19:41.679218+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c3578978-1a03-4857-b9d2-34a5da3d7731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6817","nonce":1506287862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6820","nonce":1506287862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6830","nonce":1506287862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6825","nonce":1506287862}]},"public_addr":"172.21.15.114:6817/1506287862","cluster_addr":"172.21.15.114:6820/1506287862","heartbeat_back_addr":"172.21.15.114:6830/1506287862","heartbeat_front_addr":"172.21.15.114:6825/1506287862","state":["exists","up"]},{"osd":1,"uuid":"43eb26a6-e2b3-4670-9559-bd053b5140d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6801","nonce":3302727047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6803","nonce":3302727047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6807","nonce":3302727047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6805","nonce":3302727047}]},"public_addr":"172.21.15.114:6801/3302727047","cluster_addr":"172.21.15.114:6803/3302727047","heartbeat_back_addr":"172.21.15.114:6807/3302727047","heartbeat_front_addr":"172.21.15.114:6805/3302727047","state":["exists","up"]},{"osd":2,"uuid":"f3d4dbd5-521c-4dd2-b687-5768cc7d0938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6809","nonce":2699151351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6811","nonce":2699151351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6815","nonce":2699151351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6813","nonce":2699151351}]},"public_addr":"172.21.15.114:6809/2699151351","cluster_addr":"172.21.15.114:6811/2699151351","heartbeat_back_addr":"172.21.15.114:6815/2699151351","heartbeat_front_addr":"172.21.15.114:6813/2699151351","state":["exists","up"]},{"osd":3,"uuid":"823e5802-92b7-4f0d-b32d-a5748993f1b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6821","nonce":1361608073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6824","nonce":1361608073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6829","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6831","nonce":1361608073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6827","nonce":1361608073}]},"public_addr":"172.21.15.114:6821/1361608073","cluster_addr":"172.21.15.114:6824/1361608073","heartbeat_back_addr":"172.21.15.114:6831/1361608073","heartbeat_front_addr":"172.21.15.114:6827/1361608073","state":["exists","up"]},{"osd":4,"uuid":"e47fb93e-13b4-44a4-b084-8c4384ceb41e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6801","nonce":930839681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6803","nonce":930839681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6807","nonce":930839681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6805","nonce":930839681}]},"public_addr":"172.21.15.172:6801/930839681","cluster_addr":"172.21.15.172:6803/930839681","heartbeat_back_addr":"172.21.15.172:6807/930839681","heartbeat_front_addr":"172.21.15.172:6805/930839681","state":["exists","up"]},{"osd":5,"uuid":"7561a973-f479-45a0-af40-f324728d622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6814","nonce":571761850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6818","nonce":571761850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6824","nonce":571761850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6821","nonce":571761850}]},"public_addr":"172.21.15.172:6814/571761850","cluster_addr":"172.21.15.172:6818/571761850","heartbeat_back_addr":"172.21.15.172:6824/571761850","heartbeat_front_addr":"172.21.15.172:6821/571761850","state":["exists","up"]},{"osd":6,"uuid":"51753f4b-7f06-4f1c-9ec7-6e18a66eb980","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6825","nonce":1680398853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6827","nonce":1680398853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6831","nonce":1680398853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6829","nonce":1680398853}]},"public_addr":"172.21.15.172:6825/1680398853","cluster_addr":"172.21.15.172:6827/1680398853","heartbeat_back_addr":"172.21.15.172:6831/1680398853","heartbeat_front_addr":"172.21.15.172:6829/1680398853","state":["exists","up"]},{"osd":7,"uuid":"4d8b1e15-143d-4d17-9074-59d92f0f9af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6809","nonce":349710101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6811","nonce":349710101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6819","nonce":349710101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6815","nonce":349710101}]},"public_addr":"172.21.15.172:6809/349710101","cluster_addr":"172.21.15.172:6811/349710101","heartbeat_back_addr":"172.21.15.172:6819/349710101","heartbeat_front_addr":"172.21.15.172:6815/349710101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.889460+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.475494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.911473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.648596+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.609994+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.636248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.854589+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.885826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T12:20:51.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.912+0000 7f5589261700 1 -- 172.21.15.114:0/933131300 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f55640656f0 msgr2=0x7f5564067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:51.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.912+0000 7f5589261700 1 --2- 172.21.15.114:0/933131300 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f55640656f0 0x7f5564067bb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5584153c50 tx=0x7f556c008040 comp rx=0 tx=0).stop 2023-10-18T12:20:51.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.912+0000 7f5589261700 1 -- 172.21.15.114:0/933131300 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f558406d090 msgr2=0x7f558406f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:51.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.912+0000 7f5589261700 1 --2- 172.21.15.114:0/933131300 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f558406d090 0x7f558406f6c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5574000c00 tx=0x7f5574004770 comp rx=0 tx=0).stop 2023-10-18T12:20:51.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.912+0000 7f5589261700 1 -- 172.21.15.114:0/933131300 shutdown_connections 2023-10-18T12:20:51.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.912+0000 7f5589261700 1 --2- 172.21.15.114:0/933131300 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f55640656f0 0x7f5564067bb0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:51.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.912+0000 7f5589261700 1 --2- 172.21.15.114:0/933131300 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5584070f50 0x7f5584146190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:51.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.912+0000 7f5589261700 1 --2- 172.21.15.114:0/933131300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f558406d470 0x7f5584145c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:51.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.912+0000 7f5589261700 1 --2- 172.21.15.114:0/933131300 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f558406d090 0x7f558406f6c0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:51.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.912+0000 7f5589261700 1 -- 172.21.15.114:0/933131300 >> 172.21.15.114:0/933131300 conn(0x7f55840ce5c0 msgr2=0x7f55840c9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:51.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.912+0000 7f5589261700 1 -- 172.21.15.114:0/933131300 shutdown_connections 2023-10-18T12:20:51.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:51.912+0000 7f5589261700 1 -- 172.21.15.114:0/933131300 wait complete. 2023-10-18T12:20:51.940 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-18T12:19:27.040638+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-18T12:19:32.358094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-18T12:19:37.333855+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-18T12:19:38.055385+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-18T12:19:41.679218+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-18T12:20:51.941 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-18T12:20:52.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.160+0000 7f8d554b5700 1 Processor -- start 2023-10-18T12:20:52.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.160+0000 7f8d554b5700 1 -- start start 2023-10-18T12:20:52.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.160+0000 7f8d554b5700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8d500cb8d0 0x7f8d5006f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:52.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.160+0000 7f8d554b5700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8d5006dc30 0x7f8d5006fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:52.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.160+0000 7f8d554b5700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d5006d7a0 con 0x7f8d50158d60 2023-10-18T12:20:52.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.160+0000 7f8d554b5700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d5006cf40 con 0x7f8d500cb8d0 2023-10-18T12:20:52.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.160+0000 7f8d554b5700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d500cc930 con 0x7f8d5006dc30 2023-10-18T12:20:52.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.164+0000 7f8d4e7fc700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8d500cb8d0 0x7f8d5006f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:52.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.164+0000 7f8d4e7fc700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8d500cb8d0 0x7f8d5006f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39752/0 (socket says 172.21.15.114:39752) 2023-10-18T12:20:52.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.164+0000 7f8d4e7fc700 1 -- 172.21.15.114:0/1364003967 learned_addr learned my addr 172.21.15.114:0/1364003967 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:52.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.164+0000 7f8d4effd700 1 --1- 172.21.15.114:0/1364003967 >> v1:172.21.15.172:6789/0 conn(0x7f8d50158d60 0x7f8d500cb1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.114:39602/0 (socket says 172.21.15.114:39602) 2023-10-18T12:20:52.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.164+0000 7f8d4f7fe700 1 --2- 172.21.15.114:0/1364003967 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8d5006dc30 0x7f8d5006fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:52.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.164+0000 7f8d4e7fc700 1 -- 172.21.15.114:0/1364003967 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8d5006dc30 msgr2=0x7f8d5006fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:52.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.164+0000 7f8d4e7fc700 1 --2- 172.21.15.114:0/1364003967 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8d5006dc30 0x7f8d5006fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:52.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.164+0000 7f8d4e7fc700 1 -- 172.21.15.114:0/1364003967 >> v1:172.21.15.172:6789/0 conn(0x7f8d50158d60 legacy=0x7f8d500cb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:52.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.164+0000 7f8d4e7fc700 1 -- 172.21.15.114:0/1364003967 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d5006d150 con 0x7f8d500cb8d0 2023-10-18T12:20:52.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.164+0000 7f8d4e7fc700 1 --2- 172.21.15.114:0/1364003967 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d500cb8d0 0x7f8d5006f9a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8d44006fd0 tx=0x7f8d4400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e6e783937717 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:52.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.164+0000 7f8d4dffb700 1 -- 172.21.15.114:0/1364003967 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4400dc40 con 0x7f8d500cb8d0 2023-10-18T12:20:52.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.164+0000 7f8d4dffb700 1 -- 172.21.15.114:0/1364003967 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d4400dda0 con 0x7f8d500cb8d0 2023-10-18T12:20:52.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.164+0000 7f8d4dffb700 1 -- 172.21.15.114:0/1364003967 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d44004250 con 0x7f8d500cb8d0 2023-10-18T12:20:52.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.164+0000 7f8d554b5700 1 -- 172.21.15.114:0/1364003967 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d500cb8d0 msgr2=0x7f8d5006f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:52.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.164+0000 7f8d554b5700 1 --2- 172.21.15.114:0/1364003967 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d500cb8d0 0x7f8d5006f9a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8d44006fd0 tx=0x7f8d4400bea0 comp rx=0 tx=0).stop 2023-10-18T12:20:52.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.164+0000 7f8d554b5700 1 -- 172.21.15.114:0/1364003967 shutdown_connections 2023-10-18T12:20:52.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.164+0000 7f8d554b5700 1 --2- 172.21.15.114:0/1364003967 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8d5006dc30 0x7f8d5006fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:52.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.164+0000 7f8d554b5700 1 --2- 172.21.15.114:0/1364003967 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d500cb8d0 0x7f8d5006f9a0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:52.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.164+0000 7f8d554b5700 1 -- 172.21.15.114:0/1364003967 >> 172.21.15.114:0/1364003967 conn(0x7f8d500b03d0 msgr2=0x7f8d500b07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:52.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.164+0000 7f8d554b5700 1 -- 172.21.15.114:0/1364003967 shutdown_connections 2023-10-18T12:20:52.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.164+0000 7f8d554b5700 1 -- 172.21.15.114:0/1364003967 wait complete. 2023-10-18T12:20:52.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.168+0000 7f8d554b5700 1 Processor -- start 2023-10-18T12:20:52.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.168+0000 7f8d554b5700 1 -- start start 2023-10-18T12:20:52.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.168+0000 7f8d554b5700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d5006dc30 0x7f8d5014f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:52.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.168+0000 7f8d554b5700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8d500cb8d0 0x7f8d501e6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:52.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.168+0000 7f8d554b5700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d50158d60 0x7f8d501e7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:52.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.168+0000 7f8d554b5700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d500c4d00 con 0x7f8d50158d60 2023-10-18T12:20:52.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.168+0000 7f8d554b5700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d50151230 con 0x7f8d5006dc30 2023-10-18T12:20:52.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.168+0000 7f8d554b5700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d50150f50 con 0x7f8d500cb8d0 2023-10-18T12:20:52.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.172+0000 7f8d4f7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d50158d60 0x7f8d501e7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:52.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.172+0000 7f8d4f7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d50158d60 0x7f8d501e7210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39754/0 (socket says 172.21.15.114:39754) 2023-10-18T12:20:52.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.172+0000 7f8d4f7fe700 1 -- 172.21.15.114:0/3588662545 learned_addr learned my addr 172.21.15.114:0/3588662545 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:52.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.172+0000 7f8d4e7fc700 1 --2- 172.21.15.114:0/3588662545 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8d500cb8d0 0x7f8d501e6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:52.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.172+0000 7f8d4effd700 1 --2- 172.21.15.114:0/3588662545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d5006dc30 0x7f8d5014f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:52.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.172+0000 7f8d4f7fe700 1 -- 172.21.15.114:0/3588662545 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8d500cb8d0 msgr2=0x7f8d501e6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:52.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.172+0000 7f8d4f7fe700 1 --2- 172.21.15.114:0/3588662545 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8d500cb8d0 0x7f8d501e6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:52.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.172+0000 7f8d4f7fe700 1 -- 172.21.15.114:0/3588662545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d5006dc30 msgr2=0x7f8d5014f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:52.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.172+0000 7f8d4f7fe700 1 --2- 172.21.15.114:0/3588662545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d5006dc30 0x7f8d5014f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:52.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.172+0000 7f8d4f7fe700 1 -- 172.21.15.114:0/3588662545 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d4400b820 con 0x7f8d50158d60 2023-10-18T12:20:52.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.172+0000 7f8d4f7fe700 1 --2- 172.21.15.114:0/3588662545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d50158d60 0x7f8d501e7210 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8d48007e30 tx=0x7f8d4800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:52.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.172+0000 7f8d377fe700 1 -- 172.21.15.114:0/3588662545 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4800eea0 con 0x7f8d50158d60 2023-10-18T12:20:52.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.172+0000 7f8d377fe700 1 -- 172.21.15.114:0/3588662545 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d48014420 con 0x7f8d50158d60 2023-10-18T12:20:52.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.172+0000 7f8d554b5700 1 -- 172.21.15.114:0/3588662545 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d501e4910 con 0x7f8d50158d60 2023-10-18T12:20:52.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.172+0000 7f8d377fe700 1 -- 172.21.15.114:0/3588662545 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d480147d0 con 0x7f8d50158d60 2023-10-18T12:20:52.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.172+0000 7f8d554b5700 1 -- 172.21.15.114:0/3588662545 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d501e4ed0 con 0x7f8d50158d60 2023-10-18T12:20:52.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.172+0000 7f8d554b5700 1 -- 172.21.15.114:0/3588662545 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d50072e60 con 0x7f8d50158d60 2023-10-18T12:20:52.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.176+0000 7f8d377fe700 1 -- 172.21.15.114:0/3588662545 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f8d48014930 con 0x7f8d50158d60 2023-10-18T12:20:52.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.176+0000 7f8d377fe700 1 --2- 172.21.15.114:0/3588662545 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8d3c0656f0 0x7f8d3c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:52.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.176+0000 7f8d377fe700 1 -- 172.21.15.114:0/3588662545 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8d48083940 con 0x7f8d50158d60 2023-10-18T12:20:52.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.176+0000 7f8d4effd700 1 --2- 172.21.15.114:0/3588662545 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8d3c0656f0 0x7f8d3c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:52.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.180+0000 7f8d4effd700 1 --2- 172.21.15.114:0/3588662545 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8d3c0656f0 0x7f8d3c067bb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8d40000f60 tx=0x7f8d40007d30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:52.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.180+0000 7f8d377fe700 1 -- 172.21.15.114:0/3588662545 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f8d480510e0 con 0x7f8d50158d60 2023-10-18T12:20:52.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.364+0000 7f8d554b5700 1 -- 172.21.15.114:0/3588662545 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8d501e45e0 con 0x7f8d50158d60 2023-10-18T12:20:52.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.364+0000 7f8d377fe700 1 -- 172.21.15.114:0/3588662545 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8d48054700 con 0x7f8d50158d60 2023-10-18T12:20:52.370 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-10-18T12:20:52.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.368+0000 7f8d554b5700 1 -- 172.21.15.114:0/3588662545 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8d3c0656f0 msgr2=0x7f8d3c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:52.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.368+0000 7f8d554b5700 1 --2- 172.21.15.114:0/3588662545 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8d3c0656f0 0x7f8d3c067bb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8d40000f60 tx=0x7f8d40007d30 comp rx=0 tx=0).stop 2023-10-18T12:20:52.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.368+0000 7f8d554b5700 1 -- 172.21.15.114:0/3588662545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d50158d60 msgr2=0x7f8d501e7210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:52.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.368+0000 7f8d554b5700 1 --2- 172.21.15.114:0/3588662545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d50158d60 0x7f8d501e7210 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8d48007e30 tx=0x7f8d4800e3c0 comp rx=0 tx=0).stop 2023-10-18T12:20:52.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.368+0000 7f8d554b5700 1 -- 172.21.15.114:0/3588662545 shutdown_connections 2023-10-18T12:20:52.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.368+0000 7f8d554b5700 1 --2- 172.21.15.114:0/3588662545 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8d3c0656f0 0x7f8d3c067bb0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:52.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.368+0000 7f8d554b5700 1 --2- 172.21.15.114:0/3588662545 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8d500cb8d0 0x7f8d501e6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:52.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.368+0000 7f8d554b5700 1 --2- 172.21.15.114:0/3588662545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8d50158d60 0x7f8d501e7210 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:52.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.368+0000 7f8d554b5700 1 --2- 172.21.15.114:0/3588662545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8d5006dc30 0x7f8d5014f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:52.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.368+0000 7f8d554b5700 1 -- 172.21.15.114:0/3588662545 >> 172.21.15.114:0/3588662545 conn(0x7f8d500b03d0 msgr2=0x7f8d500afc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:52.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.368+0000 7f8d554b5700 1 -- 172.21.15.114:0/3588662545 shutdown_connections 2023-10-18T12:20:52.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.368+0000 7f8d554b5700 1 -- 172.21.15.114:0/3588662545 wait complete. 2023-10-18T12:20:52.396 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-18T12:20:52.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.568+0000 7f311d724700 1 Processor -- start 2023-10-18T12:20:52.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.568+0000 7f311d724700 1 -- start start 2023-10-18T12:20:52.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.572+0000 7f311d724700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f311806d530 0x7f31180cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:52.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.572+0000 7f311d724700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31180ca4c0 con 0x7f3118164a20 2023-10-18T12:20:52.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.572+0000 7f311d724700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31180ca7a0 con 0x7f31180b3d40 2023-10-18T12:20:52.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.572+0000 7f311d724700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f311806e2d0 con 0x7f311806d530 2023-10-18T12:20:52.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.572+0000 7f31167fc700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f3118164a20 0x7f311806ce20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49974/0 (socket says 172.21.15.114:49974) 2023-10-18T12:20:52.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.572+0000 7f31167fc700 1 -- 172.21.15.114:0/1871935718 learned_addr learned my addr 172.21.15.114:0/1871935718 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:52.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.572+0000 7f31177fe700 1 --2- 172.21.15.114:0/1871935718 >> v2:172.21.15.172:3300/0 conn(0x7f311806d530 0x7f31180cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:52.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.572+0000 7f3115ffb700 1 -- 172.21.15.114:0/1871935718 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3678024922 0 0) 0x7f31180ca4c0 con 0x7f3118164a20 2023-10-18T12:20:52.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.572+0000 7f3115ffb700 1 -- 172.21.15.114:0/1871935718 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31000035d0 con 0x7f3118164a20 2023-10-18T12:20:52.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.572+0000 7f3115ffb700 1 -- 172.21.15.114:0/1871935718 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2230825623 0 0) 0x7f31000035d0 con 0x7f3118164a20 2023-10-18T12:20:52.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.572+0000 7f3115ffb700 1 -- 172.21.15.114:0/1871935718 >> v2:172.21.15.172:3300/0 conn(0x7f311806d530 msgr2=0x7f31180cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:52.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.572+0000 7f3115ffb700 1 --2- 172.21.15.114:0/1871935718 >> v2:172.21.15.172:3300/0 conn(0x7f311806d530 0x7f31180cc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:52.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.572+0000 7f3115ffb700 1 -- 172.21.15.114:0/1871935718 >> v1:172.21.15.172:6789/0 conn(0x7f31180b3d40 legacy=0x7f31180c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:52.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.572+0000 7f3115ffb700 1 -- 172.21.15.114:0/1871935718 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31180caa80 con 0x7f3118164a20 2023-10-18T12:20:52.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.572+0000 7f3115ffb700 1 -- 172.21.15.114:0/1871935718 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3368469509 0 0) 0x7f310c001670 con 0x7f3118164a20 2023-10-18T12:20:52.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.572+0000 7f3115ffb700 1 -- 172.21.15.114:0/1871935718 >> v1:172.21.15.114:6789/0 conn(0x7f3118164a20 legacy=0x7f311806ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:52.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.572+0000 7f3115ffb700 1 --2- 172.21.15.114:0/1871935718 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3100003a90 0x7f3100003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:52.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.576+0000 7f3115ffb700 1 --2- 172.21.15.114:0/1871935718 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3100004870 0x7f3100004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:52.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.576+0000 7f3115ffb700 1 --2- 172.21.15.114:0/1871935718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31000052a0 0x7f310000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:52.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.576+0000 7f3115ffb700 1 -- 172.21.15.114:0/1871935718 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311806e2d0 con 0x7f3100003a90 2023-10-18T12:20:52.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.576+0000 7f3115ffb700 1 -- 172.21.15.114:0/1871935718 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310000c200 con 0x7f31000052a0 2023-10-18T12:20:52.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.576+0000 7f3115ffb700 1 -- 172.21.15.114:0/1871935718 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f310000c3c0 con 0x7f3100004870 2023-10-18T12:20:52.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.576+0000 7f3116ffd700 1 --2- 172.21.15.114:0/1871935718 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3100003a90 0x7f3100003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:52.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.576+0000 7f31177fe700 1 --2- 172.21.15.114:0/1871935718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31000052a0 0x7f310000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:52.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.576+0000 7f31167fc700 1 --2- 172.21.15.114:0/1871935718 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3100004870 0x7f3100004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:52.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.576+0000 7f3116ffd700 1 -- 172.21.15.114:0/1871935718 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3100004870 msgr2=0x7f3100004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:52.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.576+0000 7f3116ffd700 1 --2- 172.21.15.114:0/1871935718 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3100004870 0x7f3100004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:52.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.576+0000 7f3116ffd700 1 -- 172.21.15.114:0/1871935718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31000052a0 msgr2=0x7f310000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:52.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.576+0000 7f3116ffd700 1 --2- 172.21.15.114:0/1871935718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31000052a0 0x7f310000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:52.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.576+0000 7f3116ffd700 1 -- 172.21.15.114:0/1871935718 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31000035d0 con 0x7f3100003a90 2023-10-18T12:20:52.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.576+0000 7f31167fc700 1 --2- 172.21.15.114:0/1871935718 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3100004870 0x7f3100004cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:20:52.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.576+0000 7f31177fe700 1 --2- 172.21.15.114:0/1871935718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31000052a0 0x7f310000ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:20:52.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.576+0000 7f31177fe700 1 -- 172.21.15.114:0/1871935718 reap_dead start 2023-10-18T12:20:52.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.576+0000 7f3116ffd700 1 --2- 172.21.15.114:0/1871935718 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3100003a90 0x7f3100003eb0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f31080017e0 tx=0x7f31000058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f12013671d371a3e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:52.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.576+0000 7f3115ffb700 1 -- 172.21.15.114:0/1871935718 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31080052d0 con 0x7f3100003a90 2023-10-18T12:20:52.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.576+0000 7f3115ffb700 1 -- 172.21.15.114:0/1871935718 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3108005450 con 0x7f3100003a90 2023-10-18T12:20:52.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.576+0000 7f3115ffb700 1 -- 172.21.15.114:0/1871935718 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31080038e0 con 0x7f3100003a90 2023-10-18T12:20:52.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.576+0000 7f311d724700 1 -- 172.21.15.114:0/1871935718 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3100003a90 msgr2=0x7f3100003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:52.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.576+0000 7f311d724700 1 --2- 172.21.15.114:0/1871935718 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3100003a90 0x7f3100003eb0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f31080017e0 tx=0x7f31000058a0 comp rx=0 tx=0).stop 2023-10-18T12:20:52.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.576+0000 7f311d724700 1 -- 172.21.15.114:0/1871935718 shutdown_connections 2023-10-18T12:20:52.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.576+0000 7f311d724700 1 --2- 172.21.15.114:0/1871935718 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3100003a90 0x7f3100003eb0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:52.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.576+0000 7f311d724700 1 -- 172.21.15.114:0/1871935718 >> 172.21.15.114:0/1871935718 conn(0x7f31180ce5c0 msgr2=0x7f31180ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:52.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.576+0000 7f311d724700 1 -- 172.21.15.114:0/1871935718 shutdown_connections 2023-10-18T12:20:52.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.576+0000 7f311d724700 1 -- 172.21.15.114:0/1871935718 wait complete. 2023-10-18T12:20:52.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.580+0000 7f311d724700 1 Processor -- start 2023-10-18T12:20:52.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.580+0000 7f311d724700 1 -- start start 2023-10-18T12:20:52.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.580+0000 7f311d724700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3100003a90 0x7f3118163d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:52.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.580+0000 7f311d724700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31180b25a0 0x7f31180c5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:52.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.580+0000 7f311d724700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31181e9f00 0x7f31181ea380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:52.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.580+0000 7f311d724700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31181ea8c0 con 0x7f31180b25a0 2023-10-18T12:20:52.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.580+0000 7f311d724700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31181642c0 con 0x7f31181e9f00 2023-10-18T12:20:52.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.580+0000 7f311d724700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31180c5f90 con 0x7f3100003a90 2023-10-18T12:20:52.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.580+0000 7f31167fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31180b25a0 0x7f31180c5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:52.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.584+0000 7f31167fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31180b25a0 0x7f31180c5690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39778/0 (socket says 172.21.15.114:39778) 2023-10-18T12:20:52.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.584+0000 7f31167fc700 1 -- 172.21.15.114:0/2182106060 learned_addr learned my addr 172.21.15.114:0/2182106060 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:52.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.584+0000 7f3116ffd700 1 --2- 172.21.15.114:0/2182106060 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3100003a90 0x7f3118163d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:52.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.584+0000 7f31177fe700 1 --2- 172.21.15.114:0/2182106060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31181e9f00 0x7f31181ea380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:52.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.584+0000 7f31167fc700 1 -- 172.21.15.114:0/2182106060 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3100003a90 msgr2=0x7f3118163d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:52.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.584+0000 7f31167fc700 1 --2- 172.21.15.114:0/2182106060 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3100003a90 0x7f3118163d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:52.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.584+0000 7f31167fc700 1 -- 172.21.15.114:0/2182106060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31181e9f00 msgr2=0x7f31181ea380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:52.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.584+0000 7f31167fc700 1 --2- 172.21.15.114:0/2182106060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31181e9f00 0x7f31181ea380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:52.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.584+0000 7f31167fc700 1 -- 172.21.15.114:0/2182106060 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31180c6270 con 0x7f31180b25a0 2023-10-18T12:20:52.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.584+0000 7f31177fe700 1 --2- 172.21.15.114:0/2182106060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31181e9f00 0x7f31181ea380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:52.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.584+0000 7f31167fc700 1 --2- 172.21.15.114:0/2182106060 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31180b25a0 0x7f31180c5690 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f310c00db10 tx=0x7f310c00de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:52.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.584+0000 7f30ff7fe700 1 -- 172.21.15.114:0/2182106060 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310c004ca0 con 0x7f31180b25a0 2023-10-18T12:20:52.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.584+0000 7f30ff7fe700 1 -- 172.21.15.114:0/2182106060 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310c004e00 con 0x7f31180b25a0 2023-10-18T12:20:52.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.584+0000 7f311d724700 1 -- 172.21.15.114:0/2182106060 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31180c6550 con 0x7f31180b25a0 2023-10-18T12:20:52.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.584+0000 7f30ff7fe700 1 -- 172.21.15.114:0/2182106060 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310c0072d0 con 0x7f31180b25a0 2023-10-18T12:20:52.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.584+0000 7f311d724700 1 -- 172.21.15.114:0/2182106060 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3118161870 con 0x7f31180b25a0 2023-10-18T12:20:52.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.584+0000 7f311d724700 1 -- 172.21.15.114:0/2182106060 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f311804e910 con 0x7f31180b25a0 2023-10-18T12:20:52.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.584+0000 7f30ff7fe700 1 -- 172.21.15.114:0/2182106060 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f310c007430 con 0x7f31180b25a0 2023-10-18T12:20:52.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.588+0000 7f30ff7fe700 1 --2- 172.21.15.114:0/2182106060 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f3104065720 0x7f3104067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:52.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.588+0000 7f30ff7fe700 1 -- 172.21.15.114:0/2182106060 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f310c082aa0 con 0x7f31180b25a0 2023-10-18T12:20:52.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.588+0000 7f3116ffd700 1 --2- 172.21.15.114:0/2182106060 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f3104065720 0x7f3104067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:52.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.588+0000 7f3116ffd700 1 --2- 172.21.15.114:0/2182106060 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f3104065720 0x7f3104067be0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3108005040 tx=0x7f3108009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:52.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.592+0000 7f30ff7fe700 1 -- 172.21.15.114:0/2182106060 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f310c0501b0 con 0x7f31180b25a0 2023-10-18T12:20:52.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.768+0000 7f311d724700 1 -- 172.21.15.114:0/2182106060 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3118073f00 con 0x7f31180b25a0 2023-10-18T12:20:52.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.772+0000 7f30ff7fe700 1 -- 172.21.15.114:0/2182106060 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f310c019020 con 0x7f31180b25a0 2023-10-18T12:20:52.777 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 8 2023-10-18T12:20:52.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.772+0000 7f311d724700 1 -- 172.21.15.114:0/2182106060 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f3104065720 msgr2=0x7f3104067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:52.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.772+0000 7f311d724700 1 --2- 172.21.15.114:0/2182106060 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f3104065720 0x7f3104067be0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3108005040 tx=0x7f3108009030 comp rx=0 tx=0).stop 2023-10-18T12:20:52.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.772+0000 7f311d724700 1 -- 172.21.15.114:0/2182106060 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31180b25a0 msgr2=0x7f31180c5690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:52.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.772+0000 7f311d724700 1 --2- 172.21.15.114:0/2182106060 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31180b25a0 0x7f31180c5690 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f310c00db10 tx=0x7f310c00de20 comp rx=0 tx=0).stop 2023-10-18T12:20:52.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.772+0000 7f311d724700 1 -- 172.21.15.114:0/2182106060 shutdown_connections 2023-10-18T12:20:52.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.772+0000 7f311d724700 1 --2- 172.21.15.114:0/2182106060 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f3104065720 0x7f3104067be0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:52.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.772+0000 7f311d724700 1 --2- 172.21.15.114:0/2182106060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31181e9f00 0x7f31181ea380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:52.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.772+0000 7f311d724700 1 --2- 172.21.15.114:0/2182106060 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f31180b25a0 0x7f31180c5690 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:52.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.772+0000 7f311d724700 1 --2- 172.21.15.114:0/2182106060 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3100003a90 0x7f3118163d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:52.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.772+0000 7f311d724700 1 -- 172.21.15.114:0/2182106060 >> 172.21.15.114:0/2182106060 conn(0x7f31180ce5c0 msgr2=0x7f31180c3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:52.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.772+0000 7f311d724700 1 -- 172.21.15.114:0/2182106060 shutdown_connections 2023-10-18T12:20:52.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.772+0000 7f311d724700 1 -- 172.21.15.114:0/2182106060 wait complete. 2023-10-18T12:20:52.800 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-18T12:20:52.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.972+0000 7f1f8f019700 1 Processor -- start 2023-10-18T12:20:52.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.972+0000 7f1f8f019700 1 -- start start 2023-10-18T12:20:52.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.972+0000 7f1f8f019700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1f8806d530 0x7f1f880cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:52.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.972+0000 7f1f8f019700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f880ca4c0 con 0x7f1f880b3d40 2023-10-18T12:20:52.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.972+0000 7f1f8f019700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f880ca7a0 con 0x7f1f88164a20 2023-10-18T12:20:52.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.972+0000 7f1f8f019700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f8806e2d0 con 0x7f1f8806d530 2023-10-18T12:20:52.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.976+0000 7f1f8e818700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1f8806d530 0x7f1f880cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:52.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.976+0000 7f1f8d816700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f1f88164a20 0x7f1f8806ce20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.114:39608/0 (socket says 172.21.15.114:39608) 2023-10-18T12:20:52.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.976+0000 7f1f8d816700 1 -- 172.21.15.114:0/3469493906 learned_addr learned my addr 172.21.15.114:0/3469493906 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:52.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.976+0000 7f1f8e818700 1 -- 172.21.15.114:0/3469493906 >> v1:172.21.15.172:6789/0 conn(0x7f1f88164a20 legacy=0x7f1f8806ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:52.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.976+0000 7f1f8e818700 1 -- 172.21.15.114:0/3469493906 >> v1:172.21.15.114:6789/0 conn(0x7f1f880b3d40 legacy=0x7f1f880c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:52.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.976+0000 7f1f8e818700 1 -- 172.21.15.114:0/3469493906 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f880caa80 con 0x7f1f8806d530 2023-10-18T12:20:52.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.976+0000 7f1f8d015700 1 -- 172.21.15.114:0/3469493906 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2144049602 0 0) 0x7f1f880ca7a0 con 0x7f1f88164a20 2023-10-18T12:20:52.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.976+0000 7f1f8e818700 1 --2- 172.21.15.114:0/3469493906 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f8806d530 0x7f1f880cc190 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f1f80009d90 tx=0x7f1f8000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c31cddd4abdf358d server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:52.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.976+0000 7f1f8d015700 1 -- 172.21.15.114:0/3469493906 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8000e070 con 0x7f1f8806d530 2023-10-18T12:20:52.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.976+0000 7f1f8d015700 1 -- 172.21.15.114:0/3469493906 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8000bbd0 con 0x7f1f8806d530 2023-10-18T12:20:52.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.976+0000 7f1f8d015700 1 -- 172.21.15.114:0/3469493906 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f80012430 con 0x7f1f8806d530 2023-10-18T12:20:52.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.976+0000 7f1f8f019700 1 -- 172.21.15.114:0/3469493906 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f8806d530 msgr2=0x7f1f880cc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:52.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.976+0000 7f1f8f019700 1 --2- 172.21.15.114:0/3469493906 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f8806d530 0x7f1f880cc190 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f1f80009d90 tx=0x7f1f8000b330 comp rx=0 tx=0).stop 2023-10-18T12:20:52.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.980+0000 7f1f8f019700 1 -- 172.21.15.114:0/3469493906 shutdown_connections 2023-10-18T12:20:52.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.980+0000 7f1f8f019700 1 --2- 172.21.15.114:0/3469493906 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f8806d530 0x7f1f880cc190 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:52.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.980+0000 7f1f8f019700 1 -- 172.21.15.114:0/3469493906 >> 172.21.15.114:0/3469493906 conn(0x7f1f880ce5c0 msgr2=0x7f1f880ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:52.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.980+0000 7f1f8f019700 1 -- 172.21.15.114:0/3469493906 shutdown_connections 2023-10-18T12:20:52.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.980+0000 7f1f8f019700 1 -- 172.21.15.114:0/3469493906 wait complete. 2023-10-18T12:20:52.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.980+0000 7f1f8f019700 1 Processor -- start 2023-10-18T12:20:52.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.980+0000 7f1f8f019700 1 -- start start 2023-10-18T12:20:52.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.984+0000 7f1f8f019700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f8806d530 0x7f1f880c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:52.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.984+0000 7f1f8f019700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f880b3d40 0x7f1f880c5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:52.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.984+0000 7f1f8f019700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1f88164a20 0x7f1f881554b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:52.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.984+0000 7f1f8f019700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f880c84a0 con 0x7f1f8806d530 2023-10-18T12:20:52.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.984+0000 7f1f8f019700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f881598a0 con 0x7f1f880b3d40 2023-10-18T12:20:52.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.984+0000 7f1f8f019700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8815ea10 con 0x7f1f88164a20 2023-10-18T12:20:52.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.984+0000 7f1f8e017700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f8806d530 0x7f1f880c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:52.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.984+0000 7f1f8e017700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f8806d530 0x7f1f880c7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39784/0 (socket says 172.21.15.114:39784) 2023-10-18T12:20:52.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.984+0000 7f1f8e017700 1 -- 172.21.15.114:0/3022791700 learned_addr learned my addr 172.21.15.114:0/3022791700 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:52.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.984+0000 7f1f8d816700 1 --2- 172.21.15.114:0/3022791700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f880b3d40 0x7f1f880c5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:52.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.984+0000 7f1f8e818700 1 --2- 172.21.15.114:0/3022791700 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1f88164a20 0x7f1f881554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:52.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.984+0000 7f1f8e017700 1 -- 172.21.15.114:0/3022791700 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1f88164a20 msgr2=0x7f1f881554b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:52.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.984+0000 7f1f8e017700 1 --2- 172.21.15.114:0/3022791700 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1f88164a20 0x7f1f881554b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:52.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.984+0000 7f1f8e017700 1 -- 172.21.15.114:0/3022791700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f880b3d40 msgr2=0x7f1f880c5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:52.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.984+0000 7f1f8e017700 1 --2- 172.21.15.114:0/3022791700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f880b3d40 0x7f1f880c5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:52.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.984+0000 7f1f8e017700 1 -- 172.21.15.114:0/3022791700 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f80009a70 con 0x7f1f8806d530 2023-10-18T12:20:52.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.984+0000 7f1f8e017700 1 --2- 172.21.15.114:0/3022791700 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f8806d530 0x7f1f880c7f60 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f1f8400c500 tx=0x7f1f8400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:52.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.984+0000 7f1f7effd700 1 -- 172.21.15.114:0/3022791700 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f840052d0 con 0x7f1f8806d530 2023-10-18T12:20:52.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.984+0000 7f1f7effd700 1 -- 172.21.15.114:0/3022791700 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f84005430 con 0x7f1f8806d530 2023-10-18T12:20:52.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.984+0000 7f1f7effd700 1 -- 172.21.15.114:0/3022791700 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f840055a0 con 0x7f1f8806d530 2023-10-18T12:20:52.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.984+0000 7f1f8f019700 1 -- 172.21.15.114:0/3022791700 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f8815e450 con 0x7f1f8806d530 2023-10-18T12:20:52.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.984+0000 7f1f8f019700 1 -- 172.21.15.114:0/3022791700 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f880b1380 con 0x7f1f8806d530 2023-10-18T12:20:52.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.988+0000 7f1f8f019700 1 -- 172.21.15.114:0/3022791700 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f8804e910 con 0x7f1f8806d530 2023-10-18T12:20:52.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.988+0000 7f1f7effd700 1 -- 172.21.15.114:0/3022791700 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f1f840038e0 con 0x7f1f8806d530 2023-10-18T12:20:52.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.988+0000 7f1f7effd700 1 --2- 172.21.15.114:0/3022791700 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1f6c0656f0 0x7f1f6c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:52.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.988+0000 7f1f7effd700 1 -- 172.21.15.114:0/3022791700 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1f84082640 con 0x7f1f8806d530 2023-10-18T12:20:52.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.988+0000 7f1f8d816700 1 --2- 172.21.15.114:0/3022791700 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1f6c0656f0 0x7f1f6c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:52.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.992+0000 7f1f8d816700 1 --2- 172.21.15.114:0/3022791700 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1f6c0656f0 0x7f1f6c067bb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1f880c5840 tx=0x7f1f78007db0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:53.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:52.996+0000 7f1f7effd700 1 -- 172.21.15.114:0/3022791700 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f1f8404fdc0 con 0x7f1f8806d530 2023-10-18T12:20:53.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.188+0000 7f1f8f019700 1 -- 172.21.15.114:0/3022791700 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1f880ce1e0 con 0x7f1f8806d530 2023-10-18T12:20:53.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.192+0000 7f1f7effd700 1 -- 172.21.15.114:0/3022791700 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1f840533e0 con 0x7f1f8806d530 2023-10-18T12:20:53.196 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-10-18T12:20:53.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.192+0000 7f1f8f019700 1 -- 172.21.15.114:0/3022791700 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1f6c0656f0 msgr2=0x7f1f6c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:53.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.192+0000 7f1f8f019700 1 --2- 172.21.15.114:0/3022791700 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1f6c0656f0 0x7f1f6c067bb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1f880c5840 tx=0x7f1f78007db0 comp rx=0 tx=0).stop 2023-10-18T12:20:53.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.192+0000 7f1f8f019700 1 -- 172.21.15.114:0/3022791700 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f8806d530 msgr2=0x7f1f880c7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:53.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.192+0000 7f1f8f019700 1 --2- 172.21.15.114:0/3022791700 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f8806d530 0x7f1f880c7f60 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f1f8400c500 tx=0x7f1f8400c8c0 comp rx=0 tx=0).stop 2023-10-18T12:20:53.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.192+0000 7f1f8f019700 1 -- 172.21.15.114:0/3022791700 shutdown_connections 2023-10-18T12:20:53.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.192+0000 7f1f8f019700 1 --2- 172.21.15.114:0/3022791700 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1f6c0656f0 0x7f1f6c067bb0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:53.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.192+0000 7f1f8f019700 1 --2- 172.21.15.114:0/3022791700 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1f88164a20 0x7f1f881554b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:53.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.192+0000 7f1f8f019700 1 --2- 172.21.15.114:0/3022791700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f880b3d40 0x7f1f880c5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:53.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.192+0000 7f1f8f019700 1 --2- 172.21.15.114:0/3022791700 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1f8806d530 0x7f1f880c7f60 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:53.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.192+0000 7f1f8f019700 1 -- 172.21.15.114:0/3022791700 >> 172.21.15.114:0/3022791700 conn(0x7f1f880ce5c0 msgr2=0x7f1f880cd410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:53.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.192+0000 7f1f8f019700 1 -- 172.21.15.114:0/3022791700 shutdown_connections 2023-10-18T12:20:53.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.192+0000 7f1f8f019700 1 -- 172.21.15.114:0/3022791700 wait complete. 2023-10-18T12:20:53.220 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-18T12:20:53.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.416+0000 7ff59704d700 1 Processor -- start 2023-10-18T12:20:53.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.416+0000 7ff59704d700 1 -- start start 2023-10-18T12:20:53.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.416+0000 7ff59704d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff590160440 0x7ff5900ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:53.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.416+0000 7ff59704d700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff5900adf10 0x7ff59006d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:53.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.416+0000 7ff59704d700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff59006dc90 con 0x7ff5900cb6f0 2023-10-18T12:20:53.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.416+0000 7ff59704d700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff59006df70 con 0x7ff590160440 2023-10-18T12:20:53.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.416+0000 7ff59704d700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff59006f9c0 con 0x7ff5900adf10 2023-10-18T12:20:53.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.416+0000 7ff594de9700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff590160440 0x7ff5900ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:53.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.416+0000 7ff594de9700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff590160440 0x7ff5900ccd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39792/0 (socket says 172.21.15.114:39792) 2023-10-18T12:20:53.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.416+0000 7ff594de9700 1 -- 172.21.15.114:0/2896466096 learned_addr learned my addr 172.21.15.114:0/2896466096 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:53.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.416+0000 7ff58ffff700 1 --2- 172.21.15.114:0/2896466096 >> v2:172.21.15.172:3300/0 conn(0x7ff5900adf10 0x7ff59006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:53.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.420+0000 7ff594de9700 1 -- 172.21.15.114:0/2896466096 >> v2:172.21.15.172:3300/0 conn(0x7ff5900adf10 msgr2=0x7ff59006d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:53.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.420+0000 7ff594de9700 1 --2- 172.21.15.114:0/2896466096 >> v2:172.21.15.172:3300/0 conn(0x7ff5900adf10 0x7ff59006d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:53.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.420+0000 7ff594de9700 1 -- 172.21.15.114:0/2896466096 >> v1:172.21.15.172:6789/0 conn(0x7ff5900cb6f0 legacy=0x7ff5900701c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:53.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.420+0000 7ff594de9700 1 -- 172.21.15.114:0/2896466096 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff59006fca0 con 0x7ff590160440 2023-10-18T12:20:53.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.420+0000 7ff58ffff700 1 --2- 172.21.15.114:0/2896466096 >> v2:172.21.15.172:3300/0 conn(0x7ff5900adf10 0x7ff59006d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:20:53.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.420+0000 7ff594de9700 1 --2- 172.21.15.114:0/2896466096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff590160440 0x7ff5900ccd70 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff59006eea0 tx=0x7ff584009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d0c42260b6a42b server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:53.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.420+0000 7ff58f7fe700 1 -- 172.21.15.114:0/2896466096 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58400b8a0 con 0x7ff590160440 2023-10-18T12:20:53.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.420+0000 7ff58f7fe700 1 -- 172.21.15.114:0/2896466096 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58400ba00 con 0x7ff590160440 2023-10-18T12:20:53.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.420+0000 7ff58f7fe700 1 -- 172.21.15.114:0/2896466096 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58400bd90 con 0x7ff590160440 2023-10-18T12:20:53.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.420+0000 7ff59704d700 1 -- 172.21.15.114:0/2896466096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff590160440 msgr2=0x7ff5900ccd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:53.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.420+0000 7ff59704d700 1 --2- 172.21.15.114:0/2896466096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff590160440 0x7ff5900ccd70 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff59006eea0 tx=0x7ff584009bf0 comp rx=0 tx=0).stop 2023-10-18T12:20:53.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.420+0000 7ff59704d700 1 -- 172.21.15.114:0/2896466096 shutdown_connections 2023-10-18T12:20:53.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.420+0000 7ff59704d700 1 --2- 172.21.15.114:0/2896466096 >> v2:172.21.15.172:3300/0 conn(0x7ff5900adf10 0x7ff59006d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:53.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.420+0000 7ff59704d700 1 --2- 172.21.15.114:0/2896466096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff590160440 0x7ff5900ccd70 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:53.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.420+0000 7ff59704d700 1 -- 172.21.15.114:0/2896466096 >> 172.21.15.114:0/2896466096 conn(0x7ff5900b0910 msgr2=0x7ff5900b0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:53.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.420+0000 7ff59704d700 1 -- 172.21.15.114:0/2896466096 shutdown_connections 2023-10-18T12:20:53.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.420+0000 7ff59704d700 1 -- 172.21.15.114:0/2896466096 wait complete. 2023-10-18T12:20:53.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.424+0000 7ff59704d700 1 Processor -- start 2023-10-18T12:20:53.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.424+0000 7ff59704d700 1 -- start start 2023-10-18T12:20:53.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.424+0000 7ff59704d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff5900adf10 0x7ff5900b3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:53.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.424+0000 7ff59704d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5900cb6f0 0x7ff5900c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:53.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.424+0000 7ff59704d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff590160440 0x7ff5900c6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:53.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.424+0000 7ff59704d700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5900c5e50 con 0x7ff5900cb6f0 2023-10-18T12:20:53.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.424+0000 7ff59704d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5900c6130 con 0x7ff590160440 2023-10-18T12:20:53.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.424+0000 7ff59704d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5900c6410 con 0x7ff5900adf10 2023-10-18T12:20:53.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.428+0000 7ff58ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5900cb6f0 0x7ff5900c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:53.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.428+0000 7ff58ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5900cb6f0 0x7ff5900c84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39802/0 (socket says 172.21.15.114:39802) 2023-10-18T12:20:53.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.428+0000 7ff58ffff700 1 -- 172.21.15.114:0/871519279 learned_addr learned my addr 172.21.15.114:0/871519279 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:53.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.428+0000 7ff5955ea700 1 --2- 172.21.15.114:0/871519279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff590160440 0x7ff5900c6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:53.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.428+0000 7ff594de9700 1 --2- 172.21.15.114:0/871519279 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff5900adf10 0x7ff5900b3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:53.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.428+0000 7ff58ffff700 1 -- 172.21.15.114:0/871519279 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff5900adf10 msgr2=0x7ff5900b3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:53.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.428+0000 7ff58ffff700 1 --2- 172.21.15.114:0/871519279 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff5900adf10 0x7ff5900b3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:53.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.428+0000 7ff58ffff700 1 -- 172.21.15.114:0/871519279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff590160440 msgr2=0x7ff5900c6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:53.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.428+0000 7ff58ffff700 1 --2- 172.21.15.114:0/871519279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff590160440 0x7ff5900c6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:53.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.428+0000 7ff58ffff700 1 -- 172.21.15.114:0/871519279 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff584009570 con 0x7ff5900cb6f0 2023-10-18T12:20:53.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.428+0000 7ff58ffff700 1 --2- 172.21.15.114:0/871519279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5900cb6f0 0x7ff5900c84e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff57c00c7f0 tx=0x7ff57c00cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:53.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.428+0000 7ff58d7fa700 1 -- 172.21.15.114:0/871519279 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57c011800 con 0x7ff5900cb6f0 2023-10-18T12:20:53.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.428+0000 7ff58d7fa700 1 -- 172.21.15.114:0/871519279 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff57c011960 con 0x7ff5900cb6f0 2023-10-18T12:20:53.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.428+0000 7ff58d7fa700 1 -- 172.21.15.114:0/871519279 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57c011cf0 con 0x7ff5900cb6f0 2023-10-18T12:20:53.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.428+0000 7ff59704d700 1 -- 172.21.15.114:0/871519279 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5900c66f0 con 0x7ff5900cb6f0 2023-10-18T12:20:53.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.428+0000 7ff59704d700 1 -- 172.21.15.114:0/871519279 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5900b42b0 con 0x7ff5900cb6f0 2023-10-18T12:20:53.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.432+0000 7ff59704d700 1 -- 172.21.15.114:0/871519279 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff590072e60 con 0x7ff5900cb6f0 2023-10-18T12:20:53.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.432+0000 7ff58d7fa700 1 -- 172.21.15.114:0/871519279 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff57c01a450 con 0x7ff5900cb6f0 2023-10-18T12:20:53.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.432+0000 7ff58d7fa700 1 --2- 172.21.15.114:0/871519279 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff574065720 0x7ff574067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:53.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.432+0000 7ff58d7fa700 1 -- 172.21.15.114:0/871519279 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff57c083320 con 0x7ff5900cb6f0 2023-10-18T12:20:53.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.436+0000 7ff594de9700 1 --2- 172.21.15.114:0/871519279 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff574065720 0x7ff574067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:53.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.436+0000 7ff594de9700 1 --2- 172.21.15.114:0/871519279 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff574065720 0x7ff574067be0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff584000c00 tx=0x7ff58401d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:53.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.440+0000 7ff58d7fa700 1 -- 172.21.15.114:0/871519279 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7ff57c054550 con 0x7ff5900cb6f0 2023-10-18T12:20:53.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.616+0000 7ff59704d700 1 -- 172.21.15.114:0/871519279 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff5900c9090 con 0x7ff5900cb6f0 2023-10-18T12:20:53.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.616+0000 7ff58d7fa700 1 -- 172.21.15.114:0/871519279 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff57c0540e0 con 0x7ff5900cb6f0 2023-10-18T12:20:53.622 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-10-18T12:20:53.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.620+0000 7ff59704d700 1 -- 172.21.15.114:0/871519279 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff574065720 msgr2=0x7ff574067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:53.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.620+0000 7ff59704d700 1 --2- 172.21.15.114:0/871519279 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff574065720 0x7ff574067be0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff584000c00 tx=0x7ff58401d040 comp rx=0 tx=0).stop 2023-10-18T12:20:53.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.620+0000 7ff59704d700 1 -- 172.21.15.114:0/871519279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5900cb6f0 msgr2=0x7ff5900c84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:53.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.620+0000 7ff59704d700 1 --2- 172.21.15.114:0/871519279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5900cb6f0 0x7ff5900c84e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff57c00c7f0 tx=0x7ff57c00cb00 comp rx=0 tx=0).stop 2023-10-18T12:20:53.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.620+0000 7ff59704d700 1 -- 172.21.15.114:0/871519279 shutdown_connections 2023-10-18T12:20:53.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.620+0000 7ff59704d700 1 --2- 172.21.15.114:0/871519279 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff574065720 0x7ff574067be0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:53.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.620+0000 7ff59704d700 1 --2- 172.21.15.114:0/871519279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff590160440 0x7ff5900c6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:53.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.620+0000 7ff59704d700 1 --2- 172.21.15.114:0/871519279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5900cb6f0 0x7ff5900c84e0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:53.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.620+0000 7ff59704d700 1 --2- 172.21.15.114:0/871519279 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff5900adf10 0x7ff5900b3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:53.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.620+0000 7ff59704d700 1 -- 172.21.15.114:0/871519279 >> 172.21.15.114:0/871519279 conn(0x7ff5900b0910 msgr2=0x7ff5900ac180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:53.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.620+0000 7ff59704d700 1 -- 172.21.15.114:0/871519279 shutdown_connections 2023-10-18T12:20:53.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.620+0000 7ff59704d700 1 -- 172.21.15.114:0/871519279 wait complete. 2023-10-18T12:20:53.647 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-18T12:20:53.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.824+0000 7fd5d3399700 1 Processor -- start 2023-10-18T12:20:53.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.824+0000 7fd5d3399700 1 -- start start 2023-10-18T12:20:53.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.828+0000 7fd5d3399700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5cc1467c0 0x7fd5cc0b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:53.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.828+0000 7fd5d3399700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd5cc06f9a0 0x7fd5cc06fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:53.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.828+0000 7fd5d3399700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5cc146ba0 con 0x7fd5cc1612e0 2023-10-18T12:20:53.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.828+0000 7fd5d3399700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5cc070350 con 0x7fd5cc06f9a0 2023-10-18T12:20:53.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.828+0000 7fd5d3399700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5cc0d0920 con 0x7fd5cc1467c0 2023-10-18T12:20:53.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.828+0000 7fd5d0934700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd5cc1612e0 0x7fd5cc15d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49992/0 (socket says 172.21.15.114:49992) 2023-10-18T12:20:53.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.828+0000 7fd5d0934700 1 -- 172.21.15.114:0/4255669723 learned_addr learned my addr 172.21.15.114:0/4255669723 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:53.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.828+0000 7fd5d1936700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd5cc06f9a0 0x7fd5cc06fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:53.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.828+0000 7fd5d1135700 1 --2- 172.21.15.114:0/4255669723 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5cc1467c0 0x7fd5cc0b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:53.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.828+0000 7fd5d1936700 1 -- 172.21.15.114:0/4255669723 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5cc1467c0 msgr2=0x7fd5cc0b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:53.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.828+0000 7fd5d1936700 1 --2- 172.21.15.114:0/4255669723 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5cc1467c0 0x7fd5cc0b5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:53.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.828+0000 7fd5d1936700 1 -- 172.21.15.114:0/4255669723 >> v1:172.21.15.114:6789/0 conn(0x7fd5cc1612e0 legacy=0x7fd5cc15d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:53.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.828+0000 7fd5d1936700 1 -- 172.21.15.114:0/4255669723 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5cc0b6160 con 0x7fd5cc06f9a0 2023-10-18T12:20:53.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.828+0000 7fd5c3fff700 1 -- 172.21.15.114:0/4255669723 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2354990809 0 0) 0x7fd5cc146ba0 con 0x7fd5cc1612e0 2023-10-18T12:20:53.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.828+0000 7fd5d1936700 1 --2- 172.21.15.114:0/4255669723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5cc06f9a0 0x7fd5cc06fe10 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd5c4009d90 tx=0x7fd5c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=667c33eaae79b2a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:53.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.828+0000 7fd5c3fff700 1 -- 172.21.15.114:0/4255669723 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c400e070 con 0x7fd5cc06f9a0 2023-10-18T12:20:53.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.828+0000 7fd5c3fff700 1 -- 172.21.15.114:0/4255669723 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c400bb20 con 0x7fd5cc06f9a0 2023-10-18T12:20:53.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.828+0000 7fd5c3fff700 1 -- 172.21.15.114:0/4255669723 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c4012430 con 0x7fd5cc06f9a0 2023-10-18T12:20:53.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.832+0000 7fd5d3399700 1 -- 172.21.15.114:0/4255669723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5cc06f9a0 msgr2=0x7fd5cc06fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:53.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.832+0000 7fd5d3399700 1 --2- 172.21.15.114:0/4255669723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5cc06f9a0 0x7fd5cc06fe10 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd5c4009d90 tx=0x7fd5c400b330 comp rx=0 tx=0).stop 2023-10-18T12:20:53.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.832+0000 7fd5d3399700 1 -- 172.21.15.114:0/4255669723 shutdown_connections 2023-10-18T12:20:53.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.832+0000 7fd5d3399700 1 --2- 172.21.15.114:0/4255669723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5cc06f9a0 0x7fd5cc06fe10 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:53.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.832+0000 7fd5d3399700 1 --2- 172.21.15.114:0/4255669723 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5cc1467c0 0x7fd5cc0b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:53.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.832+0000 7fd5d3399700 1 -- 172.21.15.114:0/4255669723 >> 172.21.15.114:0/4255669723 conn(0x7fd5cc06a130 msgr2=0x7fd5cc06a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:53.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.832+0000 7fd5d3399700 1 -- 172.21.15.114:0/4255669723 shutdown_connections 2023-10-18T12:20:53.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.832+0000 7fd5d3399700 1 -- 172.21.15.114:0/4255669723 wait complete. 2023-10-18T12:20:53.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.836+0000 7fd5d3399700 1 Processor -- start 2023-10-18T12:20:53.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.836+0000 7fd5d3399700 1 -- start start 2023-10-18T12:20:53.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.836+0000 7fd5d3399700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5cc06f9a0 0x7fd5cc13ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:53.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.836+0000 7fd5d3399700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5cc1467c0 0x7fd5cc06d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:53.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.836+0000 7fd5d3399700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5cc1612e0 0x7fd5cc13f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:53.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.836+0000 7fd5d3399700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5cc1f6890 con 0x7fd5cc1467c0 2023-10-18T12:20:53.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.836+0000 7fd5d3399700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5cc1f5c80 con 0x7fd5cc1612e0 2023-10-18T12:20:53.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.836+0000 7fd5d3399700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5cc1f5f60 con 0x7fd5cc06f9a0 2023-10-18T12:20:53.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.836+0000 7fd5d0934700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5cc1467c0 0x7fd5cc06d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:53.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.836+0000 7fd5d0934700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5cc1467c0 0x7fd5cc06d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39820/0 (socket says 172.21.15.114:39820) 2023-10-18T12:20:53.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.836+0000 7fd5d0934700 1 -- 172.21.15.114:0/1962425436 learned_addr learned my addr 172.21.15.114:0/1962425436 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:53.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.836+0000 7fd5d1936700 1 --2- 172.21.15.114:0/1962425436 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5cc1612e0 0x7fd5cc13f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:53.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.836+0000 7fd5d1135700 1 --2- 172.21.15.114:0/1962425436 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5cc06f9a0 0x7fd5cc13ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:53.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.836+0000 7fd5d0934700 1 -- 172.21.15.114:0/1962425436 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5cc06f9a0 msgr2=0x7fd5cc13ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:53.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.836+0000 7fd5d0934700 1 --2- 172.21.15.114:0/1962425436 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5cc06f9a0 0x7fd5cc13ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:53.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.836+0000 7fd5d0934700 1 -- 172.21.15.114:0/1962425436 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5cc1612e0 msgr2=0x7fd5cc13f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:53.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.836+0000 7fd5d0934700 1 --2- 172.21.15.114:0/1962425436 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5cc1612e0 0x7fd5cc13f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:53.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.836+0000 7fd5d0934700 1 -- 172.21.15.114:0/1962425436 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c4009a70 con 0x7fd5cc1467c0 2023-10-18T12:20:53.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.836+0000 7fd5d1936700 1 --2- 172.21.15.114:0/1962425436 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5cc1612e0 0x7fd5cc13f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:53.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.836+0000 7fd5d1135700 1 --2- 172.21.15.114:0/1962425436 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5cc06f9a0 0x7fd5cc13ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:53.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.840+0000 7fd5d0934700 1 --2- 172.21.15.114:0/1962425436 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5cc1467c0 0x7fd5cc06d370 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc00c4e0 tx=0x7fd5bc00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:53.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.840+0000 7fd5c1ffb700 1 -- 172.21.15.114:0/1962425436 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc004ca0 con 0x7fd5cc1467c0 2023-10-18T12:20:53.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.840+0000 7fd5c1ffb700 1 -- 172.21.15.114:0/1962425436 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5bc004e20 con 0x7fd5cc1467c0 2023-10-18T12:20:53.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.840+0000 7fd5c1ffb700 1 -- 172.21.15.114:0/1962425436 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc007310 con 0x7fd5cc1467c0 2023-10-18T12:20:53.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.840+0000 7fd5d3399700 1 -- 172.21.15.114:0/1962425436 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5cc1f6240 con 0x7fd5cc1467c0 2023-10-18T12:20:53.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.840+0000 7fd5d3399700 1 -- 172.21.15.114:0/1962425436 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5cc06d8b0 con 0x7fd5cc1467c0 2023-10-18T12:20:53.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.840+0000 7fd5d3399700 1 -- 172.21.15.114:0/1962425436 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5cc06daa0 con 0x7fd5cc1467c0 2023-10-18T12:20:53.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.844+0000 7fd5c1ffb700 1 -- 172.21.15.114:0/1962425436 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fd5bc007470 con 0x7fd5cc1467c0 2023-10-18T12:20:53.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.844+0000 7fd5c1ffb700 1 --2- 172.21.15.114:0/1962425436 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd5b00656f0 0x7fd5b0067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:53.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.844+0000 7fd5c1ffb700 1 -- 172.21.15.114:0/1962425436 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd5bc082eb0 con 0x7fd5cc1467c0 2023-10-18T12:20:53.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.844+0000 7fd5d1135700 1 --2- 172.21.15.114:0/1962425436 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd5b00656f0 0x7fd5b0067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:53.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.844+0000 7fd5d1135700 1 --2- 172.21.15.114:0/1962425436 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd5b00656f0 0x7fd5b0067bb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd5c8009c40 tx=0x7fd5c8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:53.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:53.848+0000 7fd5c1ffb700 1 -- 172.21.15.114:0/1962425436 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fd5bc0505a0 con 0x7fd5cc1467c0 2023-10-18T12:20:54.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.028+0000 7fd5d3399700 1 -- 172.21.15.114:0/1962425436 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd5cc072e60 con 0x7fd5cc1467c0 2023-10-18T12:20:54.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.028+0000 7fd5c1ffb700 1 -- 172.21.15.114:0/1962425436 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd5bc007720 con 0x7fd5cc1467c0 2023-10-18T12:20:54.035 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-10-18T12:20:54.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.032+0000 7fd5d3399700 1 -- 172.21.15.114:0/1962425436 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd5b00656f0 msgr2=0x7fd5b0067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:54.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.032+0000 7fd5d3399700 1 --2- 172.21.15.114:0/1962425436 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd5b00656f0 0x7fd5b0067bb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd5c8009c40 tx=0x7fd5c8008040 comp rx=0 tx=0).stop 2023-10-18T12:20:54.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.032+0000 7fd5d3399700 1 -- 172.21.15.114:0/1962425436 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5cc1467c0 msgr2=0x7fd5cc06d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:54.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.032+0000 7fd5d3399700 1 --2- 172.21.15.114:0/1962425436 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5cc1467c0 0x7fd5cc06d370 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc00c4e0 tx=0x7fd5bc00c8a0 comp rx=0 tx=0).stop 2023-10-18T12:20:54.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.032+0000 7fd5d3399700 1 -- 172.21.15.114:0/1962425436 shutdown_connections 2023-10-18T12:20:54.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.032+0000 7fd5d3399700 1 --2- 172.21.15.114:0/1962425436 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd5b00656f0 0x7fd5b0067bb0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:54.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.032+0000 7fd5d3399700 1 --2- 172.21.15.114:0/1962425436 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5cc1612e0 0x7fd5cc13f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:54.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.032+0000 7fd5d3399700 1 --2- 172.21.15.114:0/1962425436 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5cc1467c0 0x7fd5cc06d370 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:54.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.032+0000 7fd5d3399700 1 --2- 172.21.15.114:0/1962425436 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5cc06f9a0 0x7fd5cc13ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:54.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.032+0000 7fd5d3399700 1 -- 172.21.15.114:0/1962425436 >> 172.21.15.114:0/1962425436 conn(0x7fd5cc06a130 msgr2=0x7fd5cc0b7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:54.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.032+0000 7fd5d3399700 1 -- 172.21.15.114:0/1962425436 shutdown_connections 2023-10-18T12:20:54.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.032+0000 7fd5d3399700 1 -- 172.21.15.114:0/1962425436 wait complete. 2023-10-18T12:20:54.057 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-18T12:20:54.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.228+0000 7f1c61ed8700 1 Processor -- start 2023-10-18T12:20:54.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.228+0000 7f1c61ed8700 1 -- start start 2023-10-18T12:20:54.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.228+0000 7f1c61ed8700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1c5c15cbd0 0x7f1c5c0b6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:54.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.228+0000 7f1c61ed8700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1c5c0b5ae0 0x7f1c5c0b6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:54.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.228+0000 7f1c61ed8700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c5c06e390 con 0x7f1c5c0b1d10 2023-10-18T12:20:54.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.228+0000 7f1c61ed8700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c5c15cfb0 con 0x7f1c5c15cbd0 2023-10-18T12:20:54.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.228+0000 7f1c61ed8700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c5c0b6050 con 0x7f1c5c0b5ae0 2023-10-18T12:20:54.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.232+0000 7f1c60ed6700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1c5c15cbd0 0x7f1c5c0b6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:54.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.232+0000 7f1c60ed6700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f1c5c15cbd0 0x7f1c5c0b6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39822/0 (socket says 172.21.15.114:39822) 2023-10-18T12:20:54.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.232+0000 7f1c60ed6700 1 -- 172.21.15.114:0/427140677 learned_addr learned my addr 172.21.15.114:0/427140677 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:54.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.232+0000 7f1c5bfff700 1 --2- 172.21.15.114:0/427140677 >> v2:172.21.15.172:3300/0 conn(0x7f1c5c0b5ae0 0x7f1c5c0b6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:54.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.232+0000 7f1c60ed6700 1 -- 172.21.15.114:0/427140677 >> v2:172.21.15.172:3300/0 conn(0x7f1c5c0b5ae0 msgr2=0x7f1c5c0b6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:54.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.232+0000 7f1c60ed6700 1 --2- 172.21.15.114:0/427140677 >> v2:172.21.15.172:3300/0 conn(0x7f1c5c0b5ae0 0x7f1c5c0b6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:54.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.232+0000 7f1c60ed6700 1 -- 172.21.15.114:0/427140677 >> v1:172.21.15.172:6789/0 conn(0x7f1c5c0b1d10 legacy=0x7f1c5c160750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:54.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.232+0000 7f1c60ed6700 1 -- 172.21.15.114:0/427140677 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c5c06e5e0 con 0x7f1c5c15cbd0 2023-10-18T12:20:54.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.232+0000 7f1c5bfff700 1 --2- 172.21.15.114:0/427140677 >> v2:172.21.15.172:3300/0 conn(0x7f1c5c0b5ae0 0x7f1c5c0b6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:54.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.232+0000 7f1c60ed6700 1 --2- 172.21.15.114:0/427140677 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c5c15cbd0 0x7f1c5c0b6560 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c071980 tx=0x7f1c50009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=952b28a1b4470962 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:54.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.232+0000 7f1c5b7fe700 1 -- 172.21.15.114:0/427140677 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5000b8a0 con 0x7f1c5c15cbd0 2023-10-18T12:20:54.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.232+0000 7f1c5b7fe700 1 -- 172.21.15.114:0/427140677 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5000ba00 con 0x7f1c5c15cbd0 2023-10-18T12:20:54.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.232+0000 7f1c5b7fe700 1 -- 172.21.15.114:0/427140677 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5000bd90 con 0x7f1c5c15cbd0 2023-10-18T12:20:54.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.232+0000 7f1c61ed8700 1 -- 172.21.15.114:0/427140677 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c5c15cbd0 msgr2=0x7f1c5c0b6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:54.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.232+0000 7f1c61ed8700 1 --2- 172.21.15.114:0/427140677 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c5c15cbd0 0x7f1c5c0b6560 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c071980 tx=0x7f1c50009bf0 comp rx=0 tx=0).stop 2023-10-18T12:20:54.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.236+0000 7f1c61ed8700 1 -- 172.21.15.114:0/427140677 shutdown_connections 2023-10-18T12:20:54.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.236+0000 7f1c61ed8700 1 --2- 172.21.15.114:0/427140677 >> v2:172.21.15.172:3300/0 conn(0x7f1c5c0b5ae0 0x7f1c5c0b6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:54.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.236+0000 7f1c61ed8700 1 --2- 172.21.15.114:0/427140677 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c5c15cbd0 0x7f1c5c0b6560 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:54.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.236+0000 7f1c61ed8700 1 -- 172.21.15.114:0/427140677 >> 172.21.15.114:0/427140677 conn(0x7f1c5c06f450 msgr2=0x7f1c5c06f860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:54.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.236+0000 7f1c61ed8700 1 -- 172.21.15.114:0/427140677 shutdown_connections 2023-10-18T12:20:54.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.236+0000 7f1c61ed8700 1 -- 172.21.15.114:0/427140677 wait complete. 2023-10-18T12:20:54.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.236+0000 7f1c61ed8700 1 Processor -- start 2023-10-18T12:20:54.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.236+0000 7f1c61ed8700 1 -- start start 2023-10-18T12:20:54.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.240+0000 7f1c61ed8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1c5c0b1d10 0x7f1c5c1541b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:54.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.240+0000 7f1c61ed8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c5c0b5ae0 0x7f1c5c14d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:54.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.240+0000 7f1c61ed8700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c5c15cbd0 0x7f1c5c06a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:54.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.240+0000 7f1c61ed8700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5c1534c0 con 0x7f1c5c15cbd0 2023-10-18T12:20:54.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.240+0000 7f1c61ed8700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5c152ca0 con 0x7f1c5c0b5ae0 2023-10-18T12:20:54.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.240+0000 7f1c61ed8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5c1f75e0 con 0x7f1c5c0b1d10 2023-10-18T12:20:54.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.240+0000 7f1c616d7700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c5c15cbd0 0x7f1c5c06a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:54.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.240+0000 7f1c60ed6700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1c5c0b1d10 0x7f1c5c1541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:54.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.240+0000 7f1c5bfff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c5c0b5ae0 0x7f1c5c14d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:54.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.240+0000 7f1c616d7700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c5c15cbd0 0x7f1c5c06a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39840/0 (socket says 172.21.15.114:39840) 2023-10-18T12:20:54.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.240+0000 7f1c60ed6700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1c5c0b1d10 0x7f1c5c1541b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.114:48992/0 (socket says 172.21.15.114:48992) 2023-10-18T12:20:54.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.240+0000 7f1c616d7700 1 -- 172.21.15.114:0/309197533 learned_addr learned my addr 172.21.15.114:0/309197533 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:54.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.240+0000 7f1c616d7700 1 -- 172.21.15.114:0/309197533 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1c5c0b1d10 msgr2=0x7f1c5c1541b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:54.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.240+0000 7f1c616d7700 1 --2- 172.21.15.114:0/309197533 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1c5c0b1d10 0x7f1c5c1541b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:54.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.240+0000 7f1c616d7700 1 -- 172.21.15.114:0/309197533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c5c0b5ae0 msgr2=0x7f1c5c14d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:54.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.240+0000 7f1c616d7700 1 --2- 172.21.15.114:0/309197533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c5c0b5ae0 0x7f1c5c14d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:54.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.240+0000 7f1c616d7700 1 -- 172.21.15.114:0/309197533 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c50009570 con 0x7f1c5c15cbd0 2023-10-18T12:20:54.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.240+0000 7f1c616d7700 1 --2- 172.21.15.114:0/309197533 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c5c15cbd0 0x7f1c5c06a160 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1c5400cc50 tx=0x7f1c5400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:54.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.240+0000 7f1c597fa700 1 -- 172.21.15.114:0/309197533 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c54003c20 con 0x7f1c5c15cbd0 2023-10-18T12:20:54.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.240+0000 7f1c597fa700 1 -- 172.21.15.114:0/309197533 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c54003d80 con 0x7f1c5c15cbd0 2023-10-18T12:20:54.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.240+0000 7f1c597fa700 1 -- 172.21.15.114:0/309197533 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5400aab0 con 0x7f1c5c15cbd0 2023-10-18T12:20:54.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.240+0000 7f1c61ed8700 1 -- 172.21.15.114:0/309197533 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c5c1536d0 con 0x7f1c5c15cbd0 2023-10-18T12:20:54.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.240+0000 7f1c61ed8700 1 -- 172.21.15.114:0/309197533 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c5c153c90 con 0x7f1c5c15cbd0 2023-10-18T12:20:54.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.244+0000 7f1c61ed8700 1 -- 172.21.15.114:0/309197533 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c5c072e60 con 0x7f1c5c15cbd0 2023-10-18T12:20:54.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.244+0000 7f1c597fa700 1 -- 172.21.15.114:0/309197533 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f1c5400ac10 con 0x7f1c5c15cbd0 2023-10-18T12:20:54.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.248+0000 7f1c597fa700 1 --2- 172.21.15.114:0/309197533 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1c400656f0 0x7f1c40067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:54.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.248+0000 7f1c597fa700 1 -- 172.21.15.114:0/309197533 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1c540830f0 con 0x7f1c5c15cbd0 2023-10-18T12:20:54.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.248+0000 7f1c60ed6700 1 --2- 172.21.15.114:0/309197533 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1c400656f0 0x7f1c40067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:54.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.248+0000 7f1c60ed6700 1 --2- 172.21.15.114:0/309197533 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1c400656f0 0x7f1c40067bb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1c50000c00 tx=0x7f1c50008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:54.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.252+0000 7f1c597fa700 1 -- 172.21.15.114:0/309197533 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f1c54050880 con 0x7f1c5c15cbd0 2023-10-18T12:20:54.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.456+0000 7f1c61ed8700 1 -- 172.21.15.114:0/309197533 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1c5c06d530 con 0x7f1c5c15cbd0 2023-10-18T12:20:54.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.456+0000 7f1c597fa700 1 -- 172.21.15.114:0/309197533 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1c54053ea0 con 0x7f1c5c15cbd0 2023-10-18T12:20:54.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.460+0000 7f1c61ed8700 1 -- 172.21.15.114:0/309197533 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1c400656f0 msgr2=0x7f1c40067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:54.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.460+0000 7f1c61ed8700 1 --2- 172.21.15.114:0/309197533 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1c400656f0 0x7f1c40067bb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1c50000c00 tx=0x7f1c50008030 comp rx=0 tx=0).stop 2023-10-18T12:20:54.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.460+0000 7f1c61ed8700 1 -- 172.21.15.114:0/309197533 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c5c15cbd0 msgr2=0x7f1c5c06a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:54.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.460+0000 7f1c61ed8700 1 --2- 172.21.15.114:0/309197533 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c5c15cbd0 0x7f1c5c06a160 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1c5400cc50 tx=0x7f1c5400cf60 comp rx=0 tx=0).stop 2023-10-18T12:20:54.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.460+0000 7f1c61ed8700 1 -- 172.21.15.114:0/309197533 shutdown_connections 2023-10-18T12:20:54.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.460+0000 7f1c61ed8700 1 --2- 172.21.15.114:0/309197533 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1c400656f0 0x7f1c40067bb0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:54.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.460+0000 7f1c61ed8700 1 --2- 172.21.15.114:0/309197533 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c5c15cbd0 0x7f1c5c06a160 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:54.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.460+0000 7f1c61ed8700 1 --2- 172.21.15.114:0/309197533 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c5c0b5ae0 0x7f1c5c14d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:54.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.460+0000 7f1c61ed8700 1 --2- 172.21.15.114:0/309197533 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1c5c0b1d10 0x7f1c5c1541b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:54.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.460+0000 7f1c61ed8700 1 -- 172.21.15.114:0/309197533 >> 172.21.15.114:0/309197533 conn(0x7f1c5c06f450 msgr2=0x7f1c5c070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:54.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.460+0000 7f1c61ed8700 1 -- 172.21.15.114:0/309197533 shutdown_connections 2023-10-18T12:20:54.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.460+0000 7f1c61ed8700 1 -- 172.21.15.114:0/309197533 wait complete. 2023-10-18T12:20:54.469 INFO:teuthology.orchestra.run.smithi114.stderr:listed 0 entries 2023-10-18T12:20:54.486 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-10-18T12:20:54.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:54.487 DEBUG:teuthology.orchestra.run.smithi172:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-10-18T12:20:54.533 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi172.front.sepia.ceph.com 2023-10-18T12:20:54.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:20:54.534 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-18T12:20:54.598 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-18T12:20:54.599 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T12:20:54.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.772+0000 7fdd6be51700 1 Processor -- start 2023-10-18T12:20:54.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.772+0000 7fdd6be51700 1 -- start start 2023-10-18T12:20:54.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.772+0000 7fdd6be51700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdd6415ee50 0x7fdd640cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:54.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.772+0000 7fdd6be51700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdd6406e8a0 0x7fdd640caf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:54.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.772+0000 7fdd6be51700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd640cb8c0 con 0x7fdd640cb470 2023-10-18T12:20:54.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.772+0000 7fdd6be51700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd6406d4e0 con 0x7fdd6415ee50 2023-10-18T12:20:54.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.772+0000 7fdd6be51700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd64162780 con 0x7fdd6406e8a0 2023-10-18T12:20:54.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.772+0000 7fdd69bed700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdd6415ee50 0x7fdd640cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:54.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.772+0000 7fdd6a3ee700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fdd640cb470 0x7fdd6406f8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50002/0 (socket says 172.21.15.114:50002) 2023-10-18T12:20:54.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.772+0000 7fdd6a3ee700 1 -- 172.21.15.114:0/1990082273 learned_addr learned my addr 172.21.15.114:0/1990082273 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:54.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.776+0000 7fdd693ec700 1 --2- 172.21.15.114:0/1990082273 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdd6406e8a0 0x7fdd640caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:54.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.776+0000 7fdd68beb700 1 -- 172.21.15.114:0/1990082273 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 662377878 0 0) 0x7fdd5c001490 con 0x7fdd640cb470 2023-10-18T12:20:54.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.776+0000 7fdd68beb700 1 -- 172.21.15.114:0/1990082273 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd500035d0 con 0x7fdd640cb470 2023-10-18T12:20:54.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.776+0000 7fdd69bed700 1 -- 172.21.15.114:0/1990082273 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdd6406e8a0 msgr2=0x7fdd640caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:54.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.776+0000 7fdd69bed700 1 --2- 172.21.15.114:0/1990082273 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdd6406e8a0 0x7fdd640caf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:54.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.776+0000 7fdd69bed700 1 -- 172.21.15.114:0/1990082273 >> v1:172.21.15.114:6789/0 conn(0x7fdd640cb470 legacy=0x7fdd6406f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:54.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.776+0000 7fdd69bed700 1 -- 172.21.15.114:0/1990082273 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd6406f450 con 0x7fdd6415ee50 2023-10-18T12:20:54.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.776+0000 7fdd69bed700 1 --2- 172.21.15.114:0/1990082273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd6415ee50 0x7fdd640cc680 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fdd60009850 tx=0x7fdd60009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c00f666ae5df6fc7 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:54.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.776+0000 7fdd68beb700 1 -- 172.21.15.114:0/1990082273 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd60011830 con 0x7fdd6415ee50 2023-10-18T12:20:54.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.776+0000 7fdd68beb700 1 -- 172.21.15.114:0/1990082273 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd60011990 con 0x7fdd6415ee50 2023-10-18T12:20:54.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.776+0000 7fdd68beb700 1 -- 172.21.15.114:0/1990082273 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd60011d00 con 0x7fdd6415ee50 2023-10-18T12:20:54.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.776+0000 7fdd6be51700 1 -- 172.21.15.114:0/1990082273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd6415ee50 msgr2=0x7fdd640cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:54.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.776+0000 7fdd6be51700 1 --2- 172.21.15.114:0/1990082273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd6415ee50 0x7fdd640cc680 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fdd60009850 tx=0x7fdd60009b60 comp rx=0 tx=0).stop 2023-10-18T12:20:54.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.776+0000 7fdd6be51700 1 -- 172.21.15.114:0/1990082273 shutdown_connections 2023-10-18T12:20:54.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.776+0000 7fdd6be51700 1 --2- 172.21.15.114:0/1990082273 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdd6406e8a0 0x7fdd640caf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:54.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.776+0000 7fdd6be51700 1 --2- 172.21.15.114:0/1990082273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd6415ee50 0x7fdd640cc680 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:54.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.776+0000 7fdd6be51700 1 -- 172.21.15.114:0/1990082273 >> 172.21.15.114:0/1990082273 conn(0x7fdd6406a340 msgr2=0x7fdd640b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:54.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.776+0000 7fdd6be51700 1 -- 172.21.15.114:0/1990082273 shutdown_connections 2023-10-18T12:20:54.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.776+0000 7fdd6be51700 1 -- 172.21.15.114:0/1990082273 wait complete. 2023-10-18T12:20:54.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.780+0000 7fdd6be51700 1 Processor -- start 2023-10-18T12:20:54.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.780+0000 7fdd6be51700 1 -- start start 2023-10-18T12:20:54.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.780+0000 7fdd6be51700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdd6406e8a0 0x7fdd64156f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:54.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.780+0000 7fdd6be51700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd640cb470 0x7fdd6415b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:54.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.780+0000 7fdd6be51700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd6415ee50 0x7fdd64163340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:54.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.780+0000 7fdd6be51700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd64163880 con 0x7fdd6415ee50 2023-10-18T12:20:54.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.780+0000 7fdd6be51700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd641552e0 con 0x7fdd640cb470 2023-10-18T12:20:54.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.780+0000 7fdd6be51700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd641575a0 con 0x7fdd6406e8a0 2023-10-18T12:20:54.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.780+0000 7fdd6a3ee700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd6415ee50 0x7fdd64163340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:54.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.780+0000 7fdd6a3ee700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd6415ee50 0x7fdd64163340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39868/0 (socket says 172.21.15.114:39868) 2023-10-18T12:20:54.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.780+0000 7fdd6a3ee700 1 -- 172.21.15.114:0/1033944629 learned_addr learned my addr 172.21.15.114:0/1033944629 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:54.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.780+0000 7fdd693ec700 1 --2- 172.21.15.114:0/1033944629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd640cb470 0x7fdd6415b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:54.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.784+0000 7fdd69bed700 1 --2- 172.21.15.114:0/1033944629 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdd6406e8a0 0x7fdd64156f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:54.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.784+0000 7fdd6a3ee700 1 -- 172.21.15.114:0/1033944629 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdd6406e8a0 msgr2=0x7fdd64156f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:54.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.784+0000 7fdd6a3ee700 1 --2- 172.21.15.114:0/1033944629 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdd6406e8a0 0x7fdd64156f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:54.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.784+0000 7fdd6a3ee700 1 -- 172.21.15.114:0/1033944629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd640cb470 msgr2=0x7fdd6415b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:54.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.784+0000 7fdd6a3ee700 1 --2- 172.21.15.114:0/1033944629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd640cb470 0x7fdd6415b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:54.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.784+0000 7fdd6a3ee700 1 -- 172.21.15.114:0/1033944629 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd600094b0 con 0x7fdd6415ee50 2023-10-18T12:20:54.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.784+0000 7fdd693ec700 1 --2- 172.21.15.114:0/1033944629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd640cb470 0x7fdd6415b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:54.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.784+0000 7fdd6a3ee700 1 --2- 172.21.15.114:0/1033944629 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd6415ee50 0x7fdd64163340 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c00ca70 tx=0x7fdd5c00cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:54.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.784+0000 7fdd5a7fc700 1 -- 172.21.15.114:0/1033944629 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c00a770 con 0x7fdd6415ee50 2023-10-18T12:20:54.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.784+0000 7fdd5a7fc700 1 -- 172.21.15.114:0/1033944629 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5c00a8f0 con 0x7fdd6415ee50 2023-10-18T12:20:54.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.784+0000 7fdd5a7fc700 1 -- 172.21.15.114:0/1033944629 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c00aca0 con 0x7fdd6415ee50 2023-10-18T12:20:54.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.784+0000 7fdd6be51700 1 -- 172.21.15.114:0/1033944629 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd64157880 con 0x7fdd6415ee50 2023-10-18T12:20:54.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.784+0000 7fdd6be51700 1 -- 172.21.15.114:0/1033944629 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd64157e40 con 0x7fdd6415ee50 2023-10-18T12:20:54.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.784+0000 7fdd6be51700 1 -- 172.21.15.114:0/1033944629 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd64072e60 con 0x7fdd6415ee50 2023-10-18T12:20:54.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.788+0000 7fdd5a7fc700 1 -- 172.21.15.114:0/1033944629 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fdd5c01b3b0 con 0x7fdd6415ee50 2023-10-18T12:20:54.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.788+0000 7fdd5a7fc700 1 --2- 172.21.15.114:0/1033944629 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdd480656f0 0x7fdd48067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:54.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.788+0000 7fdd5a7fc700 1 -- 172.21.15.114:0/1033944629 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdd5c0829e0 con 0x7fdd6415ee50 2023-10-18T12:20:54.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.788+0000 7fdd69bed700 1 --2- 172.21.15.114:0/1033944629 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdd480656f0 0x7fdd48067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:54.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.788+0000 7fdd69bed700 1 --2- 172.21.15.114:0/1033944629 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdd480656f0 0x7fdd48067bb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdd600090b0 tx=0x7fdd60008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:54.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:54.796+0000 7fdd5a7fc700 1 -- 172.21.15.114:0/1033944629 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fdd5c0500d0 con 0x7fdd6415ee50 2023-10-18T12:20:55.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.068+0000 7fdd6be51700 1 -- 172.21.15.114:0/1033944629 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdd640cb8c0 con 0x7fdd6415ee50 2023-10-18T12:20:55.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.072+0000 7fdd5a7fc700 1 -- 172.21.15.114:0/1033944629 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4877 (secure 0 0 0) 0x7fdd640cb8c0 con 0x7fdd6415ee50 2023-10-18T12:20:55.077 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:20:55.077 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1054658298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1054658298},{"type":"v1","addr":"172.21.15.172:6835","nonce":1054658298}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2715800167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2715800167},{"type":"v1","addr":"172.21.15.114:6833","nonce":2715800167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/22518579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":22518579},{"type":"v1","addr":"172.21.15.114:6835","nonce":22518579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T12:19:39.077734+0000","modified":"2023-10-18T12:20:01.448709+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4303":{"gid":4303,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3028221887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3028221887},{"type":"v1","addr":"172.21.15.172:6837","nonce":3028221887}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-18T12:20:55.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.072+0000 7fdd6be51700 1 -- 172.21.15.114:0/1033944629 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdd480656f0 msgr2=0x7fdd48067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:55.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.072+0000 7fdd6be51700 1 --2- 172.21.15.114:0/1033944629 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdd480656f0 0x7fdd48067bb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdd600090b0 tx=0x7fdd60008030 comp rx=0 tx=0).stop 2023-10-18T12:20:55.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.072+0000 7fdd6be51700 1 -- 172.21.15.114:0/1033944629 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd6415ee50 msgr2=0x7fdd64163340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:55.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.072+0000 7fdd6be51700 1 --2- 172.21.15.114:0/1033944629 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd6415ee50 0x7fdd64163340 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c00ca70 tx=0x7fdd5c00cb50 comp rx=0 tx=0).stop 2023-10-18T12:20:55.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.072+0000 7fdd6be51700 1 -- 172.21.15.114:0/1033944629 shutdown_connections 2023-10-18T12:20:55.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.072+0000 7fdd6be51700 1 --2- 172.21.15.114:0/1033944629 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdd480656f0 0x7fdd48067bb0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:55.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.072+0000 7fdd6be51700 1 --2- 172.21.15.114:0/1033944629 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd6415ee50 0x7fdd64163340 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:55.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.072+0000 7fdd6be51700 1 --2- 172.21.15.114:0/1033944629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd640cb470 0x7fdd6415b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:55.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.072+0000 7fdd6be51700 1 --2- 172.21.15.114:0/1033944629 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdd6406e8a0 0x7fdd64156f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:55.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.072+0000 7fdd6be51700 1 -- 172.21.15.114:0/1033944629 >> 172.21.15.114:0/1033944629 conn(0x7fdd6406a340 msgr2=0x7fdd640ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:55.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.076+0000 7fdd6be51700 1 -- 172.21.15.114:0/1033944629 shutdown_connections 2023-10-18T12:20:55.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.076+0000 7fdd6be51700 1 -- 172.21.15.114:0/1033944629 wait complete. 2023-10-18T12:20:55.082 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 9 2023-10-18T12:20:55.102 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T12:20:55.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.276+0000 7f2cadcd1700 1 Processor -- start 2023-10-18T12:20:55.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.276+0000 7f2cadcd1700 1 -- start start 2023-10-18T12:20:55.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.280+0000 7f2cadcd1700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ca806d470 0x7f2ca8070a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:55.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.280+0000 7f2cadcd1700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2ca8070f50 0x7f2ca815a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:55.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.280+0000 7f2cadcd1700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ca815e990 con 0x7f2ca806d090 2023-10-18T12:20:55.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.280+0000 7f2cadcd1700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ca815f4f0 con 0x7f2ca8070f50 2023-10-18T12:20:55.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.280+0000 7f2cadcd1700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca80b2ca0 con 0x7f2ca806d470 2023-10-18T12:20:55.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.280+0000 7f2cacccf700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f2ca806d090 0x7f2ca80b2590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46622/0 (socket says 172.21.15.114:46622) 2023-10-18T12:20:55.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.280+0000 7f2cacccf700 1 -- 172.21.15.114:0/963108761 learned_addr learned my addr 172.21.15.114:0/963108761 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:55.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.280+0000 7f2cad4d0700 1 --2- 172.21.15.114:0/963108761 >> v2:172.21.15.172:3300/0 conn(0x7f2ca8070f50 0x7f2ca815a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:55.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.280+0000 7f2ca7fff700 1 --2- 172.21.15.114:0/963108761 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ca806d470 0x7f2ca8070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:55.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.280+0000 7f2ca77fe700 1 -- 172.21.15.114:0/963108761 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2506576270 0 0) 0x7f2ca815e990 con 0x7f2ca806d090 2023-10-18T12:20:55.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.280+0000 7f2ca77fe700 1 -- 172.21.15.114:0/963108761 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c980035d0 con 0x7f2ca806d090 2023-10-18T12:20:55.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.280+0000 7f2cad4d0700 1 -- 172.21.15.114:0/963108761 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ca806d470 msgr2=0x7f2ca8070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:55.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.280+0000 7f2cad4d0700 1 --2- 172.21.15.114:0/963108761 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ca806d470 0x7f2ca8070a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:55.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.280+0000 7f2cad4d0700 1 -- 172.21.15.114:0/963108761 >> v1:172.21.15.114:6789/0 conn(0x7f2ca806d090 legacy=0x7f2ca80b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:55.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.280+0000 7f2ca77fe700 1 -- 172.21.15.114:0/963108761 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3096682284 0 0) 0x7f2c980035d0 con 0x7f2ca806d090 2023-10-18T12:20:55.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.280+0000 7f2cad4d0700 1 -- 172.21.15.114:0/963108761 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca815ec50 con 0x7f2ca8070f50 2023-10-18T12:20:55.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.280+0000 7f2cad4d0700 1 --2- 172.21.15.114:0/963108761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ca8070f50 0x7f2ca815a410 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0009d90 tx=0x7f2ca000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61af45f5ed7885e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:55.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.280+0000 7f2ca77fe700 1 -- 172.21.15.114:0/963108761 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca000e070 con 0x7f2ca8070f50 2023-10-18T12:20:55.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.280+0000 7f2ca77fe700 1 -- 172.21.15.114:0/963108761 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca0003a40 con 0x7f2ca8070f50 2023-10-18T12:20:55.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.280+0000 7f2ca77fe700 1 -- 172.21.15.114:0/963108761 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c001670 con 0x7f2ca8070f50 2023-10-18T12:20:55.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.284+0000 7f2cadcd1700 1 -- 172.21.15.114:0/963108761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ca8070f50 msgr2=0x7f2ca815a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:55.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.284+0000 7f2cadcd1700 1 --2- 172.21.15.114:0/963108761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ca8070f50 0x7f2ca815a410 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0009d90 tx=0x7f2ca000b330 comp rx=0 tx=0).stop 2023-10-18T12:20:55.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.284+0000 7f2cadcd1700 1 -- 172.21.15.114:0/963108761 shutdown_connections 2023-10-18T12:20:55.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.284+0000 7f2cadcd1700 1 --2- 172.21.15.114:0/963108761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ca8070f50 0x7f2ca815a410 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:55.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.284+0000 7f2cadcd1700 1 --2- 172.21.15.114:0/963108761 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ca806d470 0x7f2ca8070a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:55.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.284+0000 7f2cadcd1700 1 -- 172.21.15.114:0/963108761 >> 172.21.15.114:0/963108761 conn(0x7f2ca80ce5c0 msgr2=0x7f2ca80ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:55.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.284+0000 7f2cadcd1700 1 -- 172.21.15.114:0/963108761 shutdown_connections 2023-10-18T12:20:55.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.284+0000 7f2cadcd1700 1 -- 172.21.15.114:0/963108761 wait complete. 2023-10-18T12:20:55.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.284+0000 7f2cadcd1700 1 Processor -- start 2023-10-18T12:20:55.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.288+0000 7f2cadcd1700 1 -- start start 2023-10-18T12:20:55.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.288+0000 7f2cadcd1700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ca806d090 0x7f2ca814c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:55.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.288+0000 7f2cadcd1700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ca806d470 0x7f2ca81551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:55.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.288+0000 7f2cadcd1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ca8070f50 0x7f2ca81556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:55.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.288+0000 7f2cadcd1700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca80cdd20 con 0x7f2ca8070f50 2023-10-18T12:20:55.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.288+0000 7f2cadcd1700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca81593d0 con 0x7f2ca806d090 2023-10-18T12:20:55.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.288+0000 7f2cadcd1700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca81596b0 con 0x7f2ca806d470 2023-10-18T12:20:55.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.288+0000 7f2cad4d0700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ca8070f50 0x7f2ca81556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:55.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.288+0000 7f2cad4d0700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ca8070f50 0x7f2ca81556e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58560/0 (socket says 172.21.15.114:58560) 2023-10-18T12:20:55.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.288+0000 7f2cad4d0700 1 -- 172.21.15.114:0/280530777 learned_addr learned my addr 172.21.15.114:0/280530777 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:55.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.288+0000 7f2cacccf700 1 --2- 172.21.15.114:0/280530777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ca806d090 0x7f2ca814c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:55.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.288+0000 7f2ca7fff700 1 --2- 172.21.15.114:0/280530777 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ca806d470 0x7f2ca81551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:55.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.288+0000 7f2cad4d0700 1 -- 172.21.15.114:0/280530777 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ca806d470 msgr2=0x7f2ca81551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:55.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.288+0000 7f2cad4d0700 1 --2- 172.21.15.114:0/280530777 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ca806d470 0x7f2ca81551a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:55.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.288+0000 7f2cad4d0700 1 -- 172.21.15.114:0/280530777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ca806d090 msgr2=0x7f2ca814c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:55.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.288+0000 7f2cad4d0700 1 --2- 172.21.15.114:0/280530777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ca806d090 0x7f2ca814c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:55.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.288+0000 7f2cad4d0700 1 -- 172.21.15.114:0/280530777 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca0009a70 con 0x7f2ca8070f50 2023-10-18T12:20:55.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.292+0000 7f2cad4d0700 1 --2- 172.21.15.114:0/280530777 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ca8070f50 0x7f2ca81556e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0004000 tx=0x7f2ca0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:55.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.292+0000 7f2ca57fa700 1 -- 172.21.15.114:0/280530777 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca00044c0 con 0x7f2ca8070f50 2023-10-18T12:20:55.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.292+0000 7f2ca57fa700 1 -- 172.21.15.114:0/280530777 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca0004640 con 0x7f2ca8070f50 2023-10-18T12:20:55.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.292+0000 7f2ca57fa700 1 -- 172.21.15.114:0/280530777 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca0012430 con 0x7f2ca8070f50 2023-10-18T12:20:55.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.292+0000 7f2cadcd1700 1 -- 172.21.15.114:0/280530777 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ca80ccc40 con 0x7f2ca8070f50 2023-10-18T12:20:55.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.292+0000 7f2cadcd1700 1 -- 172.21.15.114:0/280530777 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ca80c71f0 con 0x7f2ca8070f50 2023-10-18T12:20:55.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.292+0000 7f2cadcd1700 1 -- 172.21.15.114:0/280530777 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ca8072e60 con 0x7f2ca8070f50 2023-10-18T12:20:55.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.296+0000 7f2ca57fa700 1 -- 172.21.15.114:0/280530777 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f2ca0012590 con 0x7f2ca8070f50 2023-10-18T12:20:55.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.296+0000 7f2ca57fa700 1 --2- 172.21.15.114:0/280530777 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2c8c0656f0 0x7f2c8c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:55.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.296+0000 7f2ca57fa700 1 -- 172.21.15.114:0/280530777 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2ca0084ff0 con 0x7f2ca8070f50 2023-10-18T12:20:55.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.296+0000 7f2cacccf700 1 --2- 172.21.15.114:0/280530777 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2c8c0656f0 0x7f2c8c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:55.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.296+0000 7f2cacccf700 1 --2- 172.21.15.114:0/280530777 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2c8c0656f0 0x7f2c8c067bb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c000f60 tx=0x7f2c9c001e00 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:55.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.304+0000 7f2ca57fa700 1 -- 172.21.15.114:0/280530777 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f2ca0052770 con 0x7f2ca8070f50 2023-10-18T12:20:55.496 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.488+0000 7f2cadcd1700 1 -- 172.21.15.114:0/280530777 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ca806e030 con 0x7f2ca8070f50 2023-10-18T12:20:55.500 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.492+0000 7f2ca57fa700 1 -- 172.21.15.114:0/280530777 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20240 (secure 0 0 0) 0x7f2ca0055d90 con 0x7f2ca8070f50 2023-10-18T12:20:55.500 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:20:55.501 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":30,"fsid":"240ea340-5d3d-4f52-a4bc-af075aca3deb","created":"2023-10-18T12:19:12.512994+0000","modified":"2023-10-18T12:20:20.604528+0000","last_up_change":"2023-10-18T12:19:25.286009+0000","last_in_change":"2023-10-18T12:19:15.850693+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T12:19:27.040638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-18T12:19:32.358094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-18T12:19:37.333855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-18T12:19:38.055385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-18T12:19:41.679218+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c3578978-1a03-4857-b9d2-34a5da3d7731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6817","nonce":1506287862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6820","nonce":1506287862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6830","nonce":1506287862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6825","nonce":1506287862}]},"public_addr":"172.21.15.114:6817/1506287862","cluster_addr":"172.21.15.114:6820/1506287862","heartbeat_back_addr":"172.21.15.114:6830/1506287862","heartbeat_front_addr":"172.21.15.114:6825/1506287862","state":["exists","up"]},{"osd":1,"uuid":"43eb26a6-e2b3-4670-9559-bd053b5140d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6801","nonce":3302727047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6803","nonce":3302727047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6807","nonce":3302727047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6805","nonce":3302727047}]},"public_addr":"172.21.15.114:6801/3302727047","cluster_addr":"172.21.15.114:6803/3302727047","heartbeat_back_addr":"172.21.15.114:6807/3302727047","heartbeat_front_addr":"172.21.15.114:6805/3302727047","state":["exists","up"]},{"osd":2,"uuid":"f3d4dbd5-521c-4dd2-b687-5768cc7d0938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6809","nonce":2699151351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6811","nonce":2699151351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6815","nonce":2699151351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6813","nonce":2699151351}]},"public_addr":"172.21.15.114:6809/2699151351","cluster_addr":"172.21.15.114:6811/2699151351","heartbeat_back_addr":"172.21.15.114:6815/2699151351","heartbeat_front_addr":"172.21.15.114:6813/2699151351","state":["exists","up"]},{"osd":3,"uuid":"823e5802-92b7-4f0d-b32d-a5748993f1b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6821","nonce":1361608073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6824","nonce":1361608073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6829","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6831","nonce":1361608073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6827","nonce":1361608073}]},"public_addr":"172.21.15.114:6821/1361608073","cluster_addr":"172.21.15.114:6824/1361608073","heartbeat_back_addr":"172.21.15.114:6831/1361608073","heartbeat_front_addr":"172.21.15.114:6827/1361608073","state":["exists","up"]},{"osd":4,"uuid":"e47fb93e-13b4-44a4-b084-8c4384ceb41e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6801","nonce":930839681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6803","nonce":930839681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6807","nonce":930839681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6805","nonce":930839681}]},"public_addr":"172.21.15.172:6801/930839681","cluster_addr":"172.21.15.172:6803/930839681","heartbeat_back_addr":"172.21.15.172:6807/930839681","heartbeat_front_addr":"172.21.15.172:6805/930839681","state":["exists","up"]},{"osd":5,"uuid":"7561a973-f479-45a0-af40-f324728d622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6814","nonce":571761850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6818","nonce":571761850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6824","nonce":571761850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6821","nonce":571761850}]},"public_addr":"172.21.15.172:6814/571761850","cluster_addr":"172.21.15.172:6818/571761850","heartbeat_back_addr":"172.21.15.172:6824/571761850","heartbeat_front_addr":"172.21.15.172:6821/571761850","state":["exists","up"]},{"osd":6,"uuid":"51753f4b-7f06-4f1c-9ec7-6e18a66eb980","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6825","nonce":1680398853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6827","nonce":1680398853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6831","nonce":1680398853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6829","nonce":1680398853}]},"public_addr":"172.21.15.172:6825/1680398853","cluster_addr":"172.21.15.172:6827/1680398853","heartbeat_back_addr":"172.21.15.172:6831/1680398853","heartbeat_front_addr":"172.21.15.172:6829/1680398853","state":["exists","up"]},{"osd":7,"uuid":"4d8b1e15-143d-4d17-9074-59d92f0f9af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6809","nonce":349710101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6811","nonce":349710101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6819","nonce":349710101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6815","nonce":349710101}]},"public_addr":"172.21.15.172:6809/349710101","cluster_addr":"172.21.15.172:6811/349710101","heartbeat_back_addr":"172.21.15.172:6819/349710101","heartbeat_front_addr":"172.21.15.172:6815/349710101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.889460+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.475494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.911473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.648596+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.609994+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.636248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.854589+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.885826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T12:20:55.503 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.496+0000 7f2cadcd1700 1 -- 172.21.15.114:0/280530777 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2c8c0656f0 msgr2=0x7f2c8c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:55.503 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.496+0000 7f2cadcd1700 1 --2- 172.21.15.114:0/280530777 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2c8c0656f0 0x7f2c8c067bb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c000f60 tx=0x7f2c9c001e00 comp rx=0 tx=0).stop 2023-10-18T12:20:55.503 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.496+0000 7f2cadcd1700 1 -- 172.21.15.114:0/280530777 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ca8070f50 msgr2=0x7f2ca81556e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:55.503 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.496+0000 7f2cadcd1700 1 --2- 172.21.15.114:0/280530777 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ca8070f50 0x7f2ca81556e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0004000 tx=0x7f2ca0004af0 comp rx=0 tx=0).stop 2023-10-18T12:20:55.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.496+0000 7f2cadcd1700 1 -- 172.21.15.114:0/280530777 shutdown_connections 2023-10-18T12:20:55.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.496+0000 7f2cadcd1700 1 --2- 172.21.15.114:0/280530777 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2c8c0656f0 0x7f2c8c067bb0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:55.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.496+0000 7f2cadcd1700 1 --2- 172.21.15.114:0/280530777 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ca806d470 0x7f2ca81551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:55.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.496+0000 7f2cadcd1700 1 --2- 172.21.15.114:0/280530777 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ca8070f50 0x7f2ca81556e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:55.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.496+0000 7f2cadcd1700 1 --2- 172.21.15.114:0/280530777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ca806d090 0x7f2ca814c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:55.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.496+0000 7f2cadcd1700 1 -- 172.21.15.114:0/280530777 >> 172.21.15.114:0/280530777 conn(0x7f2ca80ce5c0 msgr2=0x7f2ca80c9520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:55.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.496+0000 7f2cadcd1700 1 -- 172.21.15.114:0/280530777 shutdown_connections 2023-10-18T12:20:55.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.496+0000 7f2cadcd1700 1 -- 172.21.15.114:0/280530777 wait complete. 2023-10-18T12:20:55.524 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-18T12:19:27.040638+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-18T12:19:32.358094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-18T12:19:37.333855+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-18T12:19:38.055385+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-18T12:19:41.679218+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-18T12:20:55.525 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-18T12:20:55.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.696+0000 7f9fc747d700 1 Processor -- start 2023-10-18T12:20:55.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.696+0000 7f9fc747d700 1 -- start start 2023-10-18T12:20:55.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.700+0000 7f9fc747d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9fc0160710 0x7f9fc00b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:55.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.700+0000 7f9fc747d700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9fc00b5ae0 0x7f9fc006db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:55.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.700+0000 7f9fc747d700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fc015d0d0 con 0x7f9fc00d2e00 2023-10-18T12:20:55.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.700+0000 7f9fc747d700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fc015df90 con 0x7f9fc0160710 2023-10-18T12:20:55.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.700+0000 7f9fc747d700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fc006f0f0 con 0x7f9fc00b5ae0 2023-10-18T12:20:55.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.700+0000 7f9fc5c7a700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9fc0160710 0x7f9fc00b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:55.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.700+0000 7f9fc5c7a700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9fc0160710 0x7f9fc00b6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58564/0 (socket says 172.21.15.114:58564) 2023-10-18T12:20:55.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.700+0000 7f9fc5c7a700 1 -- 172.21.15.114:0/2544228276 learned_addr learned my addr 172.21.15.114:0/2544228276 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:55.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.700+0000 7f9fc6c7c700 1 --2- 172.21.15.114:0/2544228276 >> v2:172.21.15.172:3300/0 conn(0x7f9fc00b5ae0 0x7f9fc006db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:55.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.700+0000 7f9fc5c7a700 1 -- 172.21.15.114:0/2544228276 >> v2:172.21.15.172:3300/0 conn(0x7f9fc00b5ae0 msgr2=0x7f9fc006db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:55.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.700+0000 7f9fc5c7a700 1 --2- 172.21.15.114:0/2544228276 >> v2:172.21.15.172:3300/0 conn(0x7f9fc00b5ae0 0x7f9fc006db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:55.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.700+0000 7f9fc5c7a700 1 -- 172.21.15.114:0/2544228276 >> v1:172.21.15.172:6789/0 conn(0x7f9fc00d2e00 legacy=0x7f9fc00d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:55.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.700+0000 7f9fc5c7a700 1 -- 172.21.15.114:0/2544228276 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc015d310 con 0x7f9fc0160710 2023-10-18T12:20:55.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.700+0000 7f9fc6c7c700 1 --2- 172.21.15.114:0/2544228276 >> v2:172.21.15.172:3300/0 conn(0x7f9fc00b5ae0 0x7f9fc006db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:55.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.700+0000 7f9fc5c7a700 1 --2- 172.21.15.114:0/2544228276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fc0160710 0x7f9fc00b6e00 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9fc006d040 tx=0x7f9fb0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6fb5eef8641cf35 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:55.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.700+0000 7f9fc5479700 1 -- 172.21.15.114:0/2544228276 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb000b8a0 con 0x7f9fc0160710 2023-10-18T12:20:55.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.700+0000 7f9fc5479700 1 -- 172.21.15.114:0/2544228276 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb000ba00 con 0x7f9fc0160710 2023-10-18T12:20:55.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.700+0000 7f9fc5479700 1 -- 172.21.15.114:0/2544228276 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb000bd90 con 0x7f9fc0160710 2023-10-18T12:20:55.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.700+0000 7f9fc747d700 1 -- 172.21.15.114:0/2544228276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fc0160710 msgr2=0x7f9fc00b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:55.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.700+0000 7f9fc747d700 1 --2- 172.21.15.114:0/2544228276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fc0160710 0x7f9fc00b6e00 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9fc006d040 tx=0x7f9fb0009bf0 comp rx=0 tx=0).stop 2023-10-18T12:20:55.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.704+0000 7f9fc747d700 1 -- 172.21.15.114:0/2544228276 shutdown_connections 2023-10-18T12:20:55.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.704+0000 7f9fc747d700 1 --2- 172.21.15.114:0/2544228276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fc0160710 0x7f9fc00b6e00 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:55.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.704+0000 7f9fc747d700 1 --2- 172.21.15.114:0/2544228276 >> v2:172.21.15.172:3300/0 conn(0x7f9fc00b5ae0 0x7f9fc006db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:55.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.704+0000 7f9fc747d700 1 -- 172.21.15.114:0/2544228276 >> 172.21.15.114:0/2544228276 conn(0x7f9fc0069f20 msgr2=0x7f9fc006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:55.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.704+0000 7f9fc747d700 1 -- 172.21.15.114:0/2544228276 shutdown_connections 2023-10-18T12:20:55.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.704+0000 7f9fc747d700 1 -- 172.21.15.114:0/2544228276 wait complete. 2023-10-18T12:20:55.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.704+0000 7f9fc747d700 1 Processor -- start 2023-10-18T12:20:55.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.704+0000 7f9fc747d700 1 -- start start 2023-10-18T12:20:55.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.704+0000 7f9fc747d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fc00b5ae0 0x7f9fc00b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:55.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.704+0000 7f9fc747d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fc00d2e00 0x7f9fc01f4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:55.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.704+0000 7f9fc747d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9fc0160710 0x7f9fc01f5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:55.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.704+0000 7f9fc747d700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc01f5760 con 0x7f9fc00d2e00 2023-10-18T12:20:55.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.704+0000 7f9fc747d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc01f2320 con 0x7f9fc00b5ae0 2023-10-18T12:20:55.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.704+0000 7f9fc747d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc01f2530 con 0x7f9fc0160710 2023-10-18T12:20:55.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.704+0000 7f9fc5c7a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fc00d2e00 0x7f9fc01f4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:55.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.708+0000 7f9fc5c7a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fc00d2e00 0x7f9fc01f4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58572/0 (socket says 172.21.15.114:58572) 2023-10-18T12:20:55.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.708+0000 7f9fc5c7a700 1 -- 172.21.15.114:0/4204510899 learned_addr learned my addr 172.21.15.114:0/4204510899 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:55.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.708+0000 7f9fc5c7a700 1 -- 172.21.15.114:0/4204510899 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9fc0160710 msgr2=0x7f9fc01f5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:55.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.708+0000 7f9fc5c7a700 1 --2- 172.21.15.114:0/4204510899 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9fc0160710 0x7f9fc01f5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:55.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.708+0000 7f9fc5c7a700 1 -- 172.21.15.114:0/4204510899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fc00b5ae0 msgr2=0x7f9fc00b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:55.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.708+0000 7f9fc5c7a700 1 --2- 172.21.15.114:0/4204510899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fc00b5ae0 0x7f9fc00b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:55.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.708+0000 7f9fc5c7a700 1 -- 172.21.15.114:0/4204510899 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb0009570 con 0x7f9fc00d2e00 2023-10-18T12:20:55.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.708+0000 7f9fc5c7a700 1 --2- 172.21.15.114:0/4204510899 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fc00d2e00 0x7f9fc01f4ce0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0013000 tx=0x7f9fb0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:55.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.708+0000 7f9fb6ffd700 1 -- 172.21.15.114:0/4204510899 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb0004440 con 0x7f9fc00d2e00 2023-10-18T12:20:55.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.708+0000 7f9fb6ffd700 1 -- 172.21.15.114:0/4204510899 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb00045a0 con 0x7f9fc00d2e00 2023-10-18T12:20:55.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.708+0000 7f9fc747d700 1 -- 172.21.15.114:0/4204510899 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fc01f2830 con 0x7f9fc00d2e00 2023-10-18T12:20:55.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.708+0000 7f9fb6ffd700 1 -- 172.21.15.114:0/4204510899 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb0011ae0 con 0x7f9fc00d2e00 2023-10-18T12:20:55.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.708+0000 7f9fc747d700 1 -- 172.21.15.114:0/4204510899 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fc01f3070 con 0x7f9fc00d2e00 2023-10-18T12:20:55.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.708+0000 7f9fc747d700 1 -- 172.21.15.114:0/4204510899 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fc01f3290 con 0x7f9fc00d2e00 2023-10-18T12:20:55.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.712+0000 7f9fb6ffd700 1 -- 172.21.15.114:0/4204510899 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f9fb0011c40 con 0x7f9fc00d2e00 2023-10-18T12:20:55.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.712+0000 7f9fb6ffd700 1 --2- 172.21.15.114:0/4204510899 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9fa40656f0 0x7f9fa4067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:55.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.712+0000 7f9fb6ffd700 1 -- 172.21.15.114:0/4204510899 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9fb0021030 con 0x7f9fc00d2e00 2023-10-18T12:20:55.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.712+0000 7f9fc647b700 1 --2- 172.21.15.114:0/4204510899 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9fa40656f0 0x7f9fa4067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:55.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.716+0000 7f9fc647b700 1 --2- 172.21.15.114:0/4204510899 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9fa40656f0 0x7f9fa4067bb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc000f60 tx=0x7f9fbc007a80 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:55.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.720+0000 7f9fb6ffd700 1 -- 172.21.15.114:0/4204510899 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f9fb00522c0 con 0x7f9fc00d2e00 2023-10-18T12:20:55.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.896+0000 7f9fc747d700 1 -- 172.21.15.114:0/4204510899 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9fc004e910 con 0x7f9fc00d2e00 2023-10-18T12:20:55.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.900+0000 7f9fb6ffd700 1 -- 172.21.15.114:0/4204510899 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9fb00558e0 con 0x7f9fc00d2e00 2023-10-18T12:20:55.905 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-10-18T12:20:55.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.900+0000 7f9fc747d700 1 -- 172.21.15.114:0/4204510899 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9fa40656f0 msgr2=0x7f9fa4067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:55.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.900+0000 7f9fc747d700 1 --2- 172.21.15.114:0/4204510899 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9fa40656f0 0x7f9fa4067bb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc000f60 tx=0x7f9fbc007a80 comp rx=0 tx=0).stop 2023-10-18T12:20:55.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.900+0000 7f9fc747d700 1 -- 172.21.15.114:0/4204510899 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fc00d2e00 msgr2=0x7f9fc01f4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:55.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.900+0000 7f9fc747d700 1 --2- 172.21.15.114:0/4204510899 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fc00d2e00 0x7f9fc01f4ce0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0013000 tx=0x7f9fb0004770 comp rx=0 tx=0).stop 2023-10-18T12:20:55.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.900+0000 7f9fc747d700 1 -- 172.21.15.114:0/4204510899 shutdown_connections 2023-10-18T12:20:55.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.900+0000 7f9fc747d700 1 --2- 172.21.15.114:0/4204510899 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9fa40656f0 0x7f9fa4067bb0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:55.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.900+0000 7f9fc747d700 1 --2- 172.21.15.114:0/4204510899 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9fc0160710 0x7f9fc01f5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:55.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.900+0000 7f9fc747d700 1 --2- 172.21.15.114:0/4204510899 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fc00d2e00 0x7f9fc01f4ce0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:55.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.900+0000 7f9fc747d700 1 --2- 172.21.15.114:0/4204510899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fc00b5ae0 0x7f9fc00b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:55.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.900+0000 7f9fc747d700 1 -- 172.21.15.114:0/4204510899 >> 172.21.15.114:0/4204510899 conn(0x7f9fc0069f20 msgr2=0x7f9fc015b160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:55.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.900+0000 7f9fc747d700 1 -- 172.21.15.114:0/4204510899 shutdown_connections 2023-10-18T12:20:55.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:55.900+0000 7f9fc747d700 1 -- 172.21.15.114:0/4204510899 wait complete. 2023-10-18T12:20:55.928 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-18T12:20:56.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.100+0000 7f6d2d53e700 1 Processor -- start 2023-10-18T12:20:56.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.100+0000 7f6d2d53e700 1 -- start start 2023-10-18T12:20:56.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.104+0000 7f6d2d53e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d280d23e0 0x7f6d2815dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:56.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.104+0000 7f6d2d53e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f6d2806fef0 0x7f6d280b65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:56.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.104+0000 7f6d2d53e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6d280d2e20 0x7f6d280d32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:56.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.104+0000 7f6d2d53e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d280d37f0 con 0x7f6d280d2e20 2023-10-18T12:20:56.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.104+0000 7f6d2d53e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d28070330 con 0x7f6d2806fef0 2023-10-18T12:20:56.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.104+0000 7f6d2d53e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d280b6e40 con 0x7f6d280d23e0 2023-10-18T12:20:56.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.104+0000 7f6d2cd3d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6d280d2e20 0x7f6d280d32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:56.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.104+0000 7f6d2cd3d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6d280d2e20 0x7f6d280d32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58574/0 (socket says 172.21.15.114:58574) 2023-10-18T12:20:56.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.104+0000 7f6d2cd3d700 1 -- 172.21.15.114:0/4265515848 learned_addr learned my addr 172.21.15.114:0/4265515848 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:56.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.104+0000 7f6d27fff700 1 --2- 172.21.15.114:0/4265515848 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d280d23e0 0x7f6d2815dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:56.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.104+0000 7f6d277fe700 1 --2- 172.21.15.114:0/4265515848 >> v2:172.21.15.172:3300/0 conn(0x7f6d2806fef0 0x7f6d280b65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:56.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.104+0000 7f6d2cd3d700 1 -- 172.21.15.114:0/4265515848 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d280d23e0 msgr2=0x7f6d2815dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:56.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.104+0000 7f6d2cd3d700 1 --2- 172.21.15.114:0/4265515848 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d280d23e0 0x7f6d2815dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:56.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.104+0000 7f6d2cd3d700 1 -- 172.21.15.114:0/4265515848 >> v2:172.21.15.172:3300/0 conn(0x7f6d2806fef0 msgr2=0x7f6d280b65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:56.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.104+0000 7f6d2cd3d700 1 --2- 172.21.15.114:0/4265515848 >> v2:172.21.15.172:3300/0 conn(0x7f6d2806fef0 0x7f6d280b65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:56.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.104+0000 7f6d2cd3d700 1 -- 172.21.15.114:0/4265515848 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d280b7120 con 0x7f6d280d2e20 2023-10-18T12:20:56.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.104+0000 7f6d2cd3d700 1 --2- 172.21.15.114:0/4265515848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d280d2e20 0x7f6d280d32b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6d280d3a90 tx=0x7f6d2000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e51d09c81669e8f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:56.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.108+0000 7f6d26ffd700 1 -- 172.21.15.114:0/4265515848 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2000e070 con 0x7f6d280d2e20 2023-10-18T12:20:56.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.108+0000 7f6d26ffd700 1 -- 172.21.15.114:0/4265515848 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d2000b8d0 con 0x7f6d280d2e20 2023-10-18T12:20:56.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.108+0000 7f6d26ffd700 1 -- 172.21.15.114:0/4265515848 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2000bc80 con 0x7f6d280d2e20 2023-10-18T12:20:56.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.108+0000 7f6d2d53e700 1 -- 172.21.15.114:0/4265515848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d280d2e20 msgr2=0x7f6d280d32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:56.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.108+0000 7f6d2d53e700 1 --2- 172.21.15.114:0/4265515848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d280d2e20 0x7f6d280d32b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6d280d3a90 tx=0x7f6d2000b330 comp rx=0 tx=0).stop 2023-10-18T12:20:56.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.108+0000 7f6d2d53e700 1 -- 172.21.15.114:0/4265515848 shutdown_connections 2023-10-18T12:20:56.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.108+0000 7f6d2d53e700 1 --2- 172.21.15.114:0/4265515848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d280d2e20 0x7f6d280d32b0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:56.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.108+0000 7f6d2d53e700 1 --2- 172.21.15.114:0/4265515848 >> v2:172.21.15.172:3300/0 conn(0x7f6d2806fef0 0x7f6d280b65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:56.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.108+0000 7f6d2d53e700 1 --2- 172.21.15.114:0/4265515848 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d280d23e0 0x7f6d2815dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:56.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.108+0000 7f6d2d53e700 1 -- 172.21.15.114:0/4265515848 >> 172.21.15.114:0/4265515848 conn(0x7f6d28069f20 msgr2=0x7f6d2806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:56.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.108+0000 7f6d2d53e700 1 -- 172.21.15.114:0/4265515848 shutdown_connections 2023-10-18T12:20:56.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.108+0000 7f6d2d53e700 1 -- 172.21.15.114:0/4265515848 wait complete. 2023-10-18T12:20:56.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.112+0000 7f6d2d53e700 1 Processor -- start 2023-10-18T12:20:56.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.112+0000 7f6d2d53e700 1 -- start start 2023-10-18T12:20:56.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.112+0000 7f6d2d53e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d2806fef0 0x7f6d2815e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:56.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.112+0000 7f6d2d53e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d280d23e0 0x7f6d2814ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:56.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.112+0000 7f6d2d53e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d280d2e20 0x7f6d2815f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:56.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.112+0000 7f6d2d53e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2815fe20 con 0x7f6d2806fef0 2023-10-18T12:20:56.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.112+0000 7f6d2d53e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2815e840 con 0x7f6d280d23e0 2023-10-18T12:20:56.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.112+0000 7f6d2d53e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2815eb20 con 0x7f6d280d2e20 2023-10-18T12:20:56.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.112+0000 7f6d27fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d2806fef0 0x7f6d2815e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:56.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.112+0000 7f6d27fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d2806fef0 0x7f6d2815e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58584/0 (socket says 172.21.15.114:58584) 2023-10-18T12:20:56.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.112+0000 7f6d27fff700 1 -- 172.21.15.114:0/835896009 learned_addr learned my addr 172.21.15.114:0/835896009 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:56.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.116+0000 7f6d277fe700 1 --2- 172.21.15.114:0/835896009 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d280d23e0 0x7f6d2814ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:56.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.116+0000 7f6d2cd3d700 1 --2- 172.21.15.114:0/835896009 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d280d2e20 0x7f6d2815f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:56.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.116+0000 7f6d27fff700 1 -- 172.21.15.114:0/835896009 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d280d2e20 msgr2=0x7f6d2815f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:56.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.116+0000 7f6d27fff700 1 --2- 172.21.15.114:0/835896009 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d280d2e20 0x7f6d2815f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:56.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.116+0000 7f6d27fff700 1 -- 172.21.15.114:0/835896009 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d280d23e0 msgr2=0x7f6d2814ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:56.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.116+0000 7f6d27fff700 1 --2- 172.21.15.114:0/835896009 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d280d23e0 0x7f6d2814ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:56.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.116+0000 7f6d27fff700 1 -- 172.21.15.114:0/835896009 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d20009b30 con 0x7f6d2806fef0 2023-10-18T12:20:56.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.116+0000 7f6d2cd3d700 1 --2- 172.21.15.114:0/835896009 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d280d2e20 0x7f6d2815f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:56.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.116+0000 7f6d27fff700 1 --2- 172.21.15.114:0/835896009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d2806fef0 0x7f6d2815e260 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6d1800ebe0 tx=0x7f6d1800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:56.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.116+0000 7f6d24ff9700 1 -- 172.21.15.114:0/835896009 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d18009740 con 0x7f6d2806fef0 2023-10-18T12:20:56.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.116+0000 7f6d24ff9700 1 -- 172.21.15.114:0/835896009 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d1800c850 con 0x7f6d2806fef0 2023-10-18T12:20:56.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.116+0000 7f6d2d53e700 1 -- 172.21.15.114:0/835896009 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d2815ee00 con 0x7f6d2806fef0 2023-10-18T12:20:56.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.116+0000 7f6d24ff9700 1 -- 172.21.15.114:0/835896009 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1800cbe0 con 0x7f6d2806fef0 2023-10-18T12:20:56.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.116+0000 7f6d2d53e700 1 -- 172.21.15.114:0/835896009 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d2815f3c0 con 0x7f6d2806fef0 2023-10-18T12:20:56.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.116+0000 7f6d2d53e700 1 -- 172.21.15.114:0/835896009 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d280cf330 con 0x7f6d2806fef0 2023-10-18T12:20:56.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.116+0000 7f6d24ff9700 1 -- 172.21.15.114:0/835896009 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f6d1800cd40 con 0x7f6d2806fef0 2023-10-18T12:20:56.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.120+0000 7f6d24ff9700 1 --2- 172.21.15.114:0/835896009 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6d140656f0 0x7f6d14067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:56.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.120+0000 7f6d24ff9700 1 -- 172.21.15.114:0/835896009 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6d180832a0 con 0x7f6d2806fef0 2023-10-18T12:20:56.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.120+0000 7f6d277fe700 1 --2- 172.21.15.114:0/835896009 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6d140656f0 0x7f6d14067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:56.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.120+0000 7f6d277fe700 1 --2- 172.21.15.114:0/835896009 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6d140656f0 0x7f6d14067bb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6d280addc0 tx=0x7f6d1c009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:56.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.128+0000 7f6d24ff9700 1 -- 172.21.15.114:0/835896009 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f6d18050990 con 0x7f6d2806fef0 2023-10-18T12:20:56.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.304+0000 7f6d2d53e700 1 -- 172.21.15.114:0/835896009 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6d2804e910 con 0x7f6d2806fef0 2023-10-18T12:20:56.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.304+0000 7f6d24ff9700 1 -- 172.21.15.114:0/835896009 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6d18053fb0 con 0x7f6d2806fef0 2023-10-18T12:20:56.311 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 8 2023-10-18T12:20:56.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.308+0000 7f6d2d53e700 1 -- 172.21.15.114:0/835896009 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6d140656f0 msgr2=0x7f6d14067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:56.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.308+0000 7f6d2d53e700 1 --2- 172.21.15.114:0/835896009 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6d140656f0 0x7f6d14067bb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6d280addc0 tx=0x7f6d1c009240 comp rx=0 tx=0).stop 2023-10-18T12:20:56.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.308+0000 7f6d2d53e700 1 -- 172.21.15.114:0/835896009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d2806fef0 msgr2=0x7f6d2815e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:56.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.308+0000 7f6d2d53e700 1 --2- 172.21.15.114:0/835896009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d2806fef0 0x7f6d2815e260 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6d1800ebe0 tx=0x7f6d1800eef0 comp rx=0 tx=0).stop 2023-10-18T12:20:56.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.308+0000 7f6d2d53e700 1 -- 172.21.15.114:0/835896009 shutdown_connections 2023-10-18T12:20:56.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.308+0000 7f6d2d53e700 1 --2- 172.21.15.114:0/835896009 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6d140656f0 0x7f6d14067bb0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:56.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.308+0000 7f6d2d53e700 1 --2- 172.21.15.114:0/835896009 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6d280d2e20 0x7f6d2815f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:56.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.308+0000 7f6d2d53e700 1 --2- 172.21.15.114:0/835896009 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d280d23e0 0x7f6d2814ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:56.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.308+0000 7f6d2d53e700 1 --2- 172.21.15.114:0/835896009 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6d2806fef0 0x7f6d2815e260 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:56.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.308+0000 7f6d2d53e700 1 -- 172.21.15.114:0/835896009 >> 172.21.15.114:0/835896009 conn(0x7f6d28069f20 msgr2=0x7f6d2815c850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:56.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.308+0000 7f6d2d53e700 1 -- 172.21.15.114:0/835896009 shutdown_connections 2023-10-18T12:20:56.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.308+0000 7f6d2d53e700 1 -- 172.21.15.114:0/835896009 wait complete. 2023-10-18T12:20:56.334 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-18T12:20:56.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.512+0000 7fa1dcf24700 1 Processor -- start 2023-10-18T12:20:56.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.512+0000 7fa1dcf24700 1 -- start start 2023-10-18T12:20:56.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.516+0000 7fa1dcf24700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa1d806f9a0 0x7fa1d806fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:56.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.516+0000 7fa1dcf24700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1d8146ba0 con 0x7fa1d80b5b80 2023-10-18T12:20:56.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.516+0000 7fa1dcf24700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1d80d0920 con 0x7fa1d81467c0 2023-10-18T12:20:56.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.516+0000 7fa1dcf24700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1d8070320 con 0x7fa1d806f9a0 2023-10-18T12:20:56.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.516+0000 7fa1d5d9b700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa1d80b5b80 0x7fa1d815d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46628/0 (socket says 172.21.15.114:46628) 2023-10-18T12:20:56.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.516+0000 7fa1d5d9b700 1 -- 172.21.15.114:0/2013108172 learned_addr learned my addr 172.21.15.114:0/2013108172 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:56.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.516+0000 7fa1d559a700 1 -- 172.21.15.114:0/2013108172 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3659004131 0 0) 0x7fa1d8146ba0 con 0x7fa1d80b5b80 2023-10-18T12:20:56.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.516+0000 7fa1d559a700 1 -- 172.21.15.114:0/2013108172 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1c00035d0 con 0x7fa1d80b5b80 2023-10-18T12:20:56.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.516+0000 7fa1d6d9d700 1 --2- 172.21.15.114:0/2013108172 >> v2:172.21.15.172:3300/0 conn(0x7fa1d806f9a0 0x7fa1d806fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:56.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.516+0000 7fa1d559a700 1 -- 172.21.15.114:0/2013108172 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2860446252 0 0) 0x7fa1c00035d0 con 0x7fa1d80b5b80 2023-10-18T12:20:56.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.516+0000 7fa1d559a700 1 -- 172.21.15.114:0/2013108172 >> v2:172.21.15.172:3300/0 conn(0x7fa1d806f9a0 msgr2=0x7fa1d806fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:56.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.516+0000 7fa1d559a700 1 --2- 172.21.15.114:0/2013108172 >> v2:172.21.15.172:3300/0 conn(0x7fa1d806f9a0 0x7fa1d806fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:56.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.516+0000 7fa1d559a700 1 -- 172.21.15.114:0/2013108172 >> v1:172.21.15.172:6789/0 conn(0x7fa1d81467c0 legacy=0x7fa1d81612e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:56.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.516+0000 7fa1d559a700 1 -- 172.21.15.114:0/2013108172 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d80b6160 con 0x7fa1d80b5b80 2023-10-18T12:20:56.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.516+0000 7fa1d559a700 1 -- 172.21.15.114:0/2013108172 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3368469509 0 0) 0x7fa1cc001670 con 0x7fa1d80b5b80 2023-10-18T12:20:56.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.516+0000 7fa1d559a700 1 -- 172.21.15.114:0/2013108172 >> v1:172.21.15.114:6789/0 conn(0x7fa1d80b5b80 legacy=0x7fa1d815d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:56.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.516+0000 7fa1d559a700 1 --2- 172.21.15.114:0/2013108172 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa1c0003ae0 0x7fa1c0003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:56.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.516+0000 7fa1d559a700 1 --2- 172.21.15.114:0/2013108172 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1c0004870 0x7fa1c0004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:56.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.516+0000 7fa1d559a700 1 --2- 172.21.15.114:0/2013108172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1c0005350 0x7fa1c000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:56.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.516+0000 7fa1d559a700 1 -- 172.21.15.114:0/2013108172 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d8070320 con 0x7fa1c0005350 2023-10-18T12:20:56.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.516+0000 7fa1d559a700 1 -- 172.21.15.114:0/2013108172 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c000c250 con 0x7fa1c0004870 2023-10-18T12:20:56.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.516+0000 7fa1d559a700 1 -- 172.21.15.114:0/2013108172 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c000c410 con 0x7fa1c0003ae0 2023-10-18T12:20:56.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.516+0000 7fa1d6d9d700 1 --2- 172.21.15.114:0/2013108172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1c0005350 0x7fa1c000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:56.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.516+0000 7fa1d5d9b700 1 --2- 172.21.15.114:0/2013108172 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1c0004870 0x7fa1c0004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:56.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.516+0000 7fa1d659c700 1 --2- 172.21.15.114:0/2013108172 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa1c0003ae0 0x7fa1c0003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:56.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.516+0000 7fa1d6d9d700 1 -- 172.21.15.114:0/2013108172 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa1c0003ae0 msgr2=0x7fa1c0003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:56.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.516+0000 7fa1d6d9d700 1 --2- 172.21.15.114:0/2013108172 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa1c0003ae0 0x7fa1c0003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:56.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.516+0000 7fa1d6d9d700 1 -- 172.21.15.114:0/2013108172 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1c0004870 msgr2=0x7fa1c0004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:56.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.516+0000 7fa1d6d9d700 1 --2- 172.21.15.114:0/2013108172 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1c0004870 0x7fa1c0004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:56.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.516+0000 7fa1d6d9d700 1 -- 172.21.15.114:0/2013108172 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c00035d0 con 0x7fa1c0005350 2023-10-18T12:20:56.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.520+0000 7fa1d6d9d700 1 -- 172.21.15.114:0/2013108172 reap_dead start 2023-10-18T12:20:56.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.520+0000 7fa1d6d9d700 1 --2- 172.21.15.114:0/2013108172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1c0005350 0x7fa1c000ba30 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0007330 tx=0x7fa1c00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19ca1fb362a6607e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:56.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.520+0000 7fa1d559a700 1 -- 172.21.15.114:0/2013108172 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d0007e50 con 0x7fa1c0005350 2023-10-18T12:20:56.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.520+0000 7fa1d559a700 1 -- 172.21.15.114:0/2013108172 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d0003a40 con 0x7fa1c0005350 2023-10-18T12:20:56.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.520+0000 7fa1d559a700 1 -- 172.21.15.114:0/2013108172 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d0003df0 con 0x7fa1c0005350 2023-10-18T12:20:56.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.520+0000 7fa1dcf24700 1 -- 172.21.15.114:0/2013108172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1c0005350 msgr2=0x7fa1c000ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:56.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.520+0000 7fa1dcf24700 1 --2- 172.21.15.114:0/2013108172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1c0005350 0x7fa1c000ba30 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0007330 tx=0x7fa1c00058a0 comp rx=0 tx=0).stop 2023-10-18T12:20:56.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.520+0000 7fa1dcf24700 1 -- 172.21.15.114:0/2013108172 shutdown_connections 2023-10-18T12:20:56.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.520+0000 7fa1dcf24700 1 --2- 172.21.15.114:0/2013108172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1c0005350 0x7fa1c000ba30 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:56.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.520+0000 7fa1dcf24700 1 -- 172.21.15.114:0/2013108172 >> 172.21.15.114:0/2013108172 conn(0x7fa1d806a130 msgr2=0x7fa1d806a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:56.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.520+0000 7fa1dcf24700 1 -- 172.21.15.114:0/2013108172 shutdown_connections 2023-10-18T12:20:56.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.520+0000 7fa1dcf24700 1 -- 172.21.15.114:0/2013108172 wait complete. 2023-10-18T12:20:56.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.524+0000 7fa1dcf24700 1 Processor -- start 2023-10-18T12:20:56.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.524+0000 7fa1dcf24700 1 -- start start 2023-10-18T12:20:56.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.524+0000 7fa1dcf24700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa1c0005350 0x7fa1d81f25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:56.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.524+0000 7fa1dcf24700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1d81f6600 0x7fa1d813c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:56.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.524+0000 7fa1dcf24700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1d815c660 0x7fa1d815ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:56.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.524+0000 7fa1dcf24700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d813ee50 con 0x7fa1d81f6600 2023-10-18T12:20:56.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.524+0000 7fa1dcf24700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d81f2cc0 con 0x7fa1d815c660 2023-10-18T12:20:56.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.524+0000 7fa1dcf24700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d81f2fa0 con 0x7fa1c0005350 2023-10-18T12:20:56.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.524+0000 7fa1d5d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1d81f6600 0x7fa1d813c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:56.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.524+0000 7fa1d5d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1d81f6600 0x7fa1d813c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58604/0 (socket says 172.21.15.114:58604) 2023-10-18T12:20:56.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.524+0000 7fa1d5d9b700 1 -- 172.21.15.114:0/1252916129 learned_addr learned my addr 172.21.15.114:0/1252916129 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:56.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.528+0000 7fa1d659c700 1 --2- 172.21.15.114:0/1252916129 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa1c0005350 0x7fa1d81f25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:56.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.528+0000 7fa1d6d9d700 1 --2- 172.21.15.114:0/1252916129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1d815c660 0x7fa1d815ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:56.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.528+0000 7fa1d5d9b700 1 -- 172.21.15.114:0/1252916129 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa1c0005350 msgr2=0x7fa1d81f25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:56.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.528+0000 7fa1d5d9b700 1 --2- 172.21.15.114:0/1252916129 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa1c0005350 0x7fa1d81f25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:56.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.528+0000 7fa1d5d9b700 1 -- 172.21.15.114:0/1252916129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1d815c660 msgr2=0x7fa1d815ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:56.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.528+0000 7fa1d5d9b700 1 --2- 172.21.15.114:0/1252916129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1d815c660 0x7fa1d815ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:56.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.528+0000 7fa1d5d9b700 1 -- 172.21.15.114:0/1252916129 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d81f3280 con 0x7fa1d81f6600 2023-10-18T12:20:56.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.528+0000 7fa1d5d9b700 1 --2- 172.21.15.114:0/1252916129 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1d81f6600 0x7fa1d813c410 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc007290 tx=0x7fa1cc0075a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:56.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.528+0000 7fa1c6ffd700 1 -- 172.21.15.114:0/1252916129 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc011580 con 0x7fa1d81f6600 2023-10-18T12:20:56.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.528+0000 7fa1c6ffd700 1 -- 172.21.15.114:0/1252916129 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1cc0116e0 con 0x7fa1d81f6600 2023-10-18T12:20:56.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.528+0000 7fa1dcf24700 1 -- 172.21.15.114:0/1252916129 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1d81f3560 con 0x7fa1d81f6600 2023-10-18T12:20:56.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.528+0000 7fa1c6ffd700 1 -- 172.21.15.114:0/1252916129 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc011a70 con 0x7fa1d81f6600 2023-10-18T12:20:56.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.528+0000 7fa1dcf24700 1 -- 172.21.15.114:0/1252916129 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1d81f6a80 con 0x7fa1d81f6600 2023-10-18T12:20:56.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.528+0000 7fa1dcf24700 1 -- 172.21.15.114:0/1252916129 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1d813f000 con 0x7fa1d81f6600 2023-10-18T12:20:56.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.532+0000 7fa1c6ffd700 1 -- 172.21.15.114:0/1252916129 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fa1cc011bd0 con 0x7fa1d81f6600 2023-10-18T12:20:56.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.532+0000 7fa1c6ffd700 1 --2- 172.21.15.114:0/1252916129 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa1b8065720 0x7fa1b8067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:56.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.532+0000 7fa1c6ffd700 1 -- 172.21.15.114:0/1252916129 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa1cc0830d0 con 0x7fa1d81f6600 2023-10-18T12:20:56.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.532+0000 7fa1d659c700 1 --2- 172.21.15.114:0/1252916129 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa1b8065720 0x7fa1b8067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:56.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.536+0000 7fa1d659c700 1 --2- 172.21.15.114:0/1252916129 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa1b8065720 0x7fa1b8067be0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8000f60 tx=0x7fa1c8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:56.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.540+0000 7fa1c6ffd700 1 -- 172.21.15.114:0/1252916129 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fa1d813f000 con 0x7fa1d81f6600 2023-10-18T12:20:56.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.772+0000 7fa1dcf24700 1 -- 172.21.15.114:0/1252916129 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa1d8072e60 con 0x7fa1d81f6600 2023-10-18T12:20:56.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.772+0000 7fa1c6ffd700 1 -- 172.21.15.114:0/1252916129 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa1cc050870 con 0x7fa1d81f6600 2023-10-18T12:20:56.779 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-10-18T12:20:56.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.776+0000 7fa1dcf24700 1 -- 172.21.15.114:0/1252916129 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa1b8065720 msgr2=0x7fa1b8067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:56.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.776+0000 7fa1dcf24700 1 --2- 172.21.15.114:0/1252916129 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa1b8065720 0x7fa1b8067be0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8000f60 tx=0x7fa1c8009040 comp rx=0 tx=0).stop 2023-10-18T12:20:56.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.776+0000 7fa1dcf24700 1 -- 172.21.15.114:0/1252916129 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1d81f6600 msgr2=0x7fa1d813c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:56.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.776+0000 7fa1dcf24700 1 --2- 172.21.15.114:0/1252916129 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1d81f6600 0x7fa1d813c410 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc007290 tx=0x7fa1cc0075a0 comp rx=0 tx=0).stop 2023-10-18T12:20:56.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.776+0000 7fa1dcf24700 1 -- 172.21.15.114:0/1252916129 shutdown_connections 2023-10-18T12:20:56.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.776+0000 7fa1dcf24700 1 --2- 172.21.15.114:0/1252916129 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa1b8065720 0x7fa1b8067be0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:56.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.776+0000 7fa1dcf24700 1 --2- 172.21.15.114:0/1252916129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1d815c660 0x7fa1d815ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:56.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.776+0000 7fa1dcf24700 1 --2- 172.21.15.114:0/1252916129 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1d81f6600 0x7fa1d813c410 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:56.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.776+0000 7fa1dcf24700 1 --2- 172.21.15.114:0/1252916129 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa1c0005350 0x7fa1d81f25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:56.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.776+0000 7fa1dcf24700 1 -- 172.21.15.114:0/1252916129 >> 172.21.15.114:0/1252916129 conn(0x7fa1d806a130 msgr2=0x7fa1d8144a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:56.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.776+0000 7fa1dcf24700 1 -- 172.21.15.114:0/1252916129 shutdown_connections 2023-10-18T12:20:56.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.776+0000 7fa1dcf24700 1 -- 172.21.15.114:0/1252916129 wait complete. 2023-10-18T12:20:56.807 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-18T12:20:56.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.972+0000 7fc94759e700 1 Processor -- start 2023-10-18T12:20:56.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.972+0000 7fc94759e700 1 -- start start 2023-10-18T12:20:56.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.976+0000 7fc94759e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc9480cc190 0x7fc9480b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:56.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.976+0000 7fc94759e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc94815e000 con 0x7fc9480cdd90 2023-10-18T12:20:56.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.976+0000 7fc94759e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9480ce170 con 0x7fc9480b4140 2023-10-18T12:20:56.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.976+0000 7fc94759e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9480b45d0 con 0x7fc9480cc190 2023-10-18T12:20:56.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.976+0000 7fc94659c700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc9480cdd90 0x7fc94806d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46630/0 (socket says 172.21.15.114:46630) 2023-10-18T12:20:56.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.976+0000 7fc94659c700 1 -- 172.21.15.114:0/2337995595 learned_addr learned my addr 172.21.15.114:0/2337995595 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:56.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.976+0000 7fc93dd9b700 1 --2- 172.21.15.114:0/2337995595 >> v2:172.21.15.114:3300/0 conn(0x7fc9480cc190 0x7fc9480b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:56.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.976+0000 7fc93dd9b700 1 -- 172.21.15.114:0/2337995595 >> v1:172.21.15.172:6789/0 conn(0x7fc9480b4140 legacy=0x7fc9480ca0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:56.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.976+0000 7fc93dd9b700 1 -- 172.21.15.114:0/2337995595 >> v1:172.21.15.114:6789/0 conn(0x7fc9480cdd90 legacy=0x7fc94806d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:56.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.976+0000 7fc93dd9b700 1 -- 172.21.15.114:0/2337995595 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc94815d3f0 con 0x7fc9480cc190 2023-10-18T12:20:56.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.976+0000 7fc945d9b700 1 -- 172.21.15.114:0/2337995595 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3716494576 0 0) 0x7fc94815e000 con 0x7fc9480cdd90 2023-10-18T12:20:56.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.976+0000 7fc93dd9b700 1 --2- 172.21.15.114:0/2337995595 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9480cc190 0x7fc9480b3c00 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc930009d90 tx=0x7fc93000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc7a8eb232766c37 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:56.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.976+0000 7fc945d9b700 1 -- 172.21.15.114:0/2337995595 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93000e070 con 0x7fc9480cc190 2023-10-18T12:20:56.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.976+0000 7fc945d9b700 1 -- 172.21.15.114:0/2337995595 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc93000bbd0 con 0x7fc9480cc190 2023-10-18T12:20:56.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.976+0000 7fc945d9b700 1 -- 172.21.15.114:0/2337995595 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc930012430 con 0x7fc9480cc190 2023-10-18T12:20:56.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.980+0000 7fc94759e700 1 -- 172.21.15.114:0/2337995595 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9480cc190 msgr2=0x7fc9480b3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:56.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.980+0000 7fc94759e700 1 --2- 172.21.15.114:0/2337995595 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9480cc190 0x7fc9480b3c00 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc930009d90 tx=0x7fc93000b330 comp rx=0 tx=0).stop 2023-10-18T12:20:56.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.980+0000 7fc94759e700 1 -- 172.21.15.114:0/2337995595 shutdown_connections 2023-10-18T12:20:56.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.980+0000 7fc94759e700 1 --2- 172.21.15.114:0/2337995595 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9480cc190 0x7fc9480b3c00 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:56.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.980+0000 7fc94759e700 1 -- 172.21.15.114:0/2337995595 >> 172.21.15.114:0/2337995595 conn(0x7fc9480ce5c0 msgr2=0x7fc9480ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:56.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.980+0000 7fc94759e700 1 -- 172.21.15.114:0/2337995595 shutdown_connections 2023-10-18T12:20:56.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.980+0000 7fc94759e700 1 -- 172.21.15.114:0/2337995595 wait complete. 2023-10-18T12:20:56.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.980+0000 7fc94759e700 1 Processor -- start 2023-10-18T12:20:56.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.980+0000 7fc94759e700 1 -- start start 2023-10-18T12:20:56.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.984+0000 7fc94759e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc9480b4140 0x7fc94814f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:56.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.984+0000 7fc94759e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9480cc190 0x7fc9480ca680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:56.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.984+0000 7fc94759e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9480cdd90 0x7fc9480cabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:56.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.984+0000 7fc94759e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94815ee70 con 0x7fc9480cdd90 2023-10-18T12:20:56.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.984+0000 7fc94759e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94815f150 con 0x7fc9480cc190 2023-10-18T12:20:56.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.984+0000 7fc94759e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94815f430 con 0x7fc9480b4140 2023-10-18T12:20:56.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.984+0000 7fc946d9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9480cdd90 0x7fc9480cabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:56.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.984+0000 7fc946d9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9480cdd90 0x7fc9480cabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58608/0 (socket says 172.21.15.114:58608) 2023-10-18T12:20:56.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.984+0000 7fc946d9d700 1 -- 172.21.15.114:0/3256580753 learned_addr learned my addr 172.21.15.114:0/3256580753 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:56.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.984+0000 7fc93dd9b700 1 --2- 172.21.15.114:0/3256580753 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9480cc190 0x7fc9480ca680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:56.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.984+0000 7fc94659c700 1 --2- 172.21.15.114:0/3256580753 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc9480b4140 0x7fc94814f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:56.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.984+0000 7fc946d9d700 1 -- 172.21.15.114:0/3256580753 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc9480b4140 msgr2=0x7fc94814f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:56.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.984+0000 7fc946d9d700 1 --2- 172.21.15.114:0/3256580753 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc9480b4140 0x7fc94814f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:56.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.984+0000 7fc946d9d700 1 -- 172.21.15.114:0/3256580753 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9480cc190 msgr2=0x7fc9480ca680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:56.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.984+0000 7fc946d9d700 1 --2- 172.21.15.114:0/3256580753 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9480cc190 0x7fc9480ca680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:56.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.984+0000 7fc946d9d700 1 -- 172.21.15.114:0/3256580753 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc930009a70 con 0x7fc9480cdd90 2023-10-18T12:20:56.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.984+0000 7fc946d9d700 1 --2- 172.21.15.114:0/3256580753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9480cdd90 0x7fc9480cabc0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc94000c430 tx=0x7fc94000c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:56.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.984+0000 7fc93f7fe700 1 -- 172.21.15.114:0/3256580753 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9400052d0 con 0x7fc9480cdd90 2023-10-18T12:20:56.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.984+0000 7fc93f7fe700 1 -- 172.21.15.114:0/3256580753 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc940005430 con 0x7fc9480cdd90 2023-10-18T12:20:56.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.984+0000 7fc94759e700 1 -- 172.21.15.114:0/3256580753 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc94815f710 con 0x7fc9480cdd90 2023-10-18T12:20:56.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.984+0000 7fc93f7fe700 1 -- 172.21.15.114:0/3256580753 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9400055a0 con 0x7fc9480cdd90 2023-10-18T12:20:56.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.984+0000 7fc94759e700 1 -- 172.21.15.114:0/3256580753 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc94815e1b0 con 0x7fc9480cdd90 2023-10-18T12:20:56.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.988+0000 7fc94759e700 1 -- 172.21.15.114:0/3256580753 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc94804e910 con 0x7fc9480cdd90 2023-10-18T12:20:56.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.988+0000 7fc93f7fe700 1 -- 172.21.15.114:0/3256580753 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fc9400038e0 con 0x7fc9480cdd90 2023-10-18T12:20:56.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.992+0000 7fc93f7fe700 1 --2- 172.21.15.114:0/3256580753 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc9280656f0 0x7fc928067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:56.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.992+0000 7fc93f7fe700 1 -- 172.21.15.114:0/3256580753 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc940082450 con 0x7fc9480cdd90 2023-10-18T12:20:56.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.992+0000 7fc94659c700 1 --2- 172.21.15.114:0/3256580753 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc9280656f0 0x7fc928067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:56.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.992+0000 7fc94659c700 1 --2- 172.21.15.114:0/3256580753 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc9280656f0 0x7fc928067bb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc938007b30 tx=0x7fc938007a80 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:57.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:56.996+0000 7fc93f7fe700 1 -- 172.21.15.114:0/3256580753 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fc94004fb40 con 0x7fc9480cdd90 2023-10-18T12:20:57.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.172+0000 7fc94759e700 1 -- 172.21.15.114:0/3256580753 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc94815d980 con 0x7fc9480cdd90 2023-10-18T12:20:57.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.176+0000 7fc93f7fe700 1 -- 172.21.15.114:0/3256580753 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc940053160 con 0x7fc9480cdd90 2023-10-18T12:20:57.181 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-10-18T12:20:57.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.176+0000 7fc94759e700 1 -- 172.21.15.114:0/3256580753 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc9280656f0 msgr2=0x7fc928067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:57.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.176+0000 7fc94759e700 1 --2- 172.21.15.114:0/3256580753 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc9280656f0 0x7fc928067bb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc938007b30 tx=0x7fc938007a80 comp rx=0 tx=0).stop 2023-10-18T12:20:57.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.176+0000 7fc94759e700 1 -- 172.21.15.114:0/3256580753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9480cdd90 msgr2=0x7fc9480cabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:57.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.176+0000 7fc94759e700 1 --2- 172.21.15.114:0/3256580753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9480cdd90 0x7fc9480cabc0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc94000c430 tx=0x7fc94000c740 comp rx=0 tx=0).stop 2023-10-18T12:20:57.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.180+0000 7fc94759e700 1 -- 172.21.15.114:0/3256580753 shutdown_connections 2023-10-18T12:20:57.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.180+0000 7fc94759e700 1 --2- 172.21.15.114:0/3256580753 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc9280656f0 0x7fc928067bb0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:57.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.180+0000 7fc94759e700 1 --2- 172.21.15.114:0/3256580753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9480cdd90 0x7fc9480cabc0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:57.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.180+0000 7fc94759e700 1 --2- 172.21.15.114:0/3256580753 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9480cc190 0x7fc9480ca680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:57.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.180+0000 7fc94759e700 1 --2- 172.21.15.114:0/3256580753 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc9480b4140 0x7fc94814f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:57.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.180+0000 7fc94759e700 1 -- 172.21.15.114:0/3256580753 >> 172.21.15.114:0/3256580753 conn(0x7fc9480ce5c0 msgr2=0x7fc948158cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:57.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.180+0000 7fc94759e700 1 -- 172.21.15.114:0/3256580753 shutdown_connections 2023-10-18T12:20:57.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.180+0000 7fc94759e700 1 -- 172.21.15.114:0/3256580753 wait complete. 2023-10-18T12:20:57.204 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-18T12:20:57.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.376+0000 7fb27f247700 1 Processor -- start 2023-10-18T12:20:57.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.376+0000 7fb27f247700 1 -- start start 2023-10-18T12:20:57.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.380+0000 7fb27f247700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb278160710 0x7fb2780b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:57.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.380+0000 7fb27f247700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb2780b5ae0 0x7fb27806db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:57.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.380+0000 7fb27f247700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb27815d0d0 con 0x7fb2780d2e00 2023-10-18T12:20:57.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.380+0000 7fb27f247700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb27815df90 con 0x7fb2780b5ae0 2023-10-18T12:20:57.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.380+0000 7fb27f247700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb27806f0f0 con 0x7fb278160710 2023-10-18T12:20:57.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.380+0000 7fb27ea46700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb2780b5ae0 0x7fb27806db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:57.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.380+0000 7fb27ea46700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb2780b5ae0 0x7fb27806db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58614/0 (socket says 172.21.15.114:58614) 2023-10-18T12:20:57.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.380+0000 7fb27ea46700 1 -- 172.21.15.114:0/3140578207 learned_addr learned my addr 172.21.15.114:0/3140578207 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:57.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.380+0000 7fb27da44700 1 --2- 172.21.15.114:0/3140578207 >> v2:172.21.15.172:3300/0 conn(0x7fb278160710 0x7fb2780b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:57.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.384+0000 7fb27da44700 1 -- 172.21.15.114:0/3140578207 >> v2:172.21.15.114:3300/0 conn(0x7fb2780b5ae0 msgr2=0x7fb27806db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:57.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.384+0000 7fb27da44700 1 --2- 172.21.15.114:0/3140578207 >> v2:172.21.15.114:3300/0 conn(0x7fb2780b5ae0 0x7fb27806db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:57.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.384+0000 7fb27da44700 1 -- 172.21.15.114:0/3140578207 >> v1:172.21.15.172:6789/0 conn(0x7fb2780d2e00 legacy=0x7fb2780d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:57.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.384+0000 7fb27da44700 1 -- 172.21.15.114:0/3140578207 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb27815d310 con 0x7fb278160710 2023-10-18T12:20:57.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.384+0000 7fb27da44700 1 --2- 172.21.15.114:0/3140578207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb278160710 0x7fb2780b6e00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb2780d2420 tx=0x7fb268009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57f91f4de909577 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:57.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.384+0000 7fb27d243700 1 -- 172.21.15.114:0/3140578207 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb268011830 con 0x7fb278160710 2023-10-18T12:20:57.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.384+0000 7fb27d243700 1 -- 172.21.15.114:0/3140578207 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb268011990 con 0x7fb278160710 2023-10-18T12:20:57.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.384+0000 7fb27d243700 1 -- 172.21.15.114:0/3140578207 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb268011d20 con 0x7fb278160710 2023-10-18T12:20:57.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.384+0000 7fb27f247700 1 -- 172.21.15.114:0/3140578207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb278160710 msgr2=0x7fb2780b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:57.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.384+0000 7fb27f247700 1 --2- 172.21.15.114:0/3140578207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb278160710 0x7fb2780b6e00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb2780d2420 tx=0x7fb268009b30 comp rx=0 tx=0).stop 2023-10-18T12:20:57.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.384+0000 7fb27f247700 1 -- 172.21.15.114:0/3140578207 shutdown_connections 2023-10-18T12:20:57.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.384+0000 7fb27f247700 1 --2- 172.21.15.114:0/3140578207 >> v2:172.21.15.114:3300/0 conn(0x7fb2780b5ae0 0x7fb27806db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:57.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.384+0000 7fb27f247700 1 --2- 172.21.15.114:0/3140578207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb278160710 0x7fb2780b6e00 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:57.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.384+0000 7fb27f247700 1 -- 172.21.15.114:0/3140578207 >> 172.21.15.114:0/3140578207 conn(0x7fb278069f20 msgr2=0x7fb27806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:57.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.384+0000 7fb27f247700 1 -- 172.21.15.114:0/3140578207 shutdown_connections 2023-10-18T12:20:57.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.384+0000 7fb27f247700 1 -- 172.21.15.114:0/3140578207 wait complete. 2023-10-18T12:20:57.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.388+0000 7fb27f247700 1 Processor -- start 2023-10-18T12:20:57.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.388+0000 7fb27f247700 1 -- start start 2023-10-18T12:20:57.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.388+0000 7fb27f247700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2780b5ae0 0x7fb2781f6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:57.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.388+0000 7fb27f247700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2780d2e00 0x7fb27806fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:57.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.388+0000 7fb27f247700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb278160710 0x7fb27815e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:57.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.388+0000 7fb27f247700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27815e310 con 0x7fb2780d2e00 2023-10-18T12:20:57.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.388+0000 7fb27f247700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27815fed0 con 0x7fb2780b5ae0 2023-10-18T12:20:57.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.388+0000 7fb27f247700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2781f26b0 con 0x7fb278160710 2023-10-18T12:20:57.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.392+0000 7fb27da44700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2780d2e00 0x7fb27806fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:57.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.392+0000 7fb27da44700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2780d2e00 0x7fb27806fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58624/0 (socket says 172.21.15.114:58624) 2023-10-18T12:20:57.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.392+0000 7fb27da44700 1 -- 172.21.15.114:0/4105281991 learned_addr learned my addr 172.21.15.114:0/4105281991 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:57.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.392+0000 7fb27e245700 1 --2- 172.21.15.114:0/4105281991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2780b5ae0 0x7fb2781f6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:57.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.392+0000 7fb27ea46700 1 --2- 172.21.15.114:0/4105281991 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb278160710 0x7fb27815e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:57.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.392+0000 7fb27da44700 1 -- 172.21.15.114:0/4105281991 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb278160710 msgr2=0x7fb27815e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:57.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.392+0000 7fb27da44700 1 --2- 172.21.15.114:0/4105281991 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb278160710 0x7fb27815e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:57.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.392+0000 7fb27da44700 1 -- 172.21.15.114:0/4105281991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2780b5ae0 msgr2=0x7fb2781f6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:57.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.392+0000 7fb27da44700 1 --2- 172.21.15.114:0/4105281991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2780b5ae0 0x7fb2781f6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:57.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.392+0000 7fb27da44700 1 -- 172.21.15.114:0/4105281991 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2680094b0 con 0x7fb2780d2e00 2023-10-18T12:20:57.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.392+0000 7fb27da44700 1 --2- 172.21.15.114:0/4105281991 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2780d2e00 0x7fb27806fc60 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb2680090b0 tx=0x7fb268004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:57.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.392+0000 7fb26effd700 1 -- 172.21.15.114:0/4105281991 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb268004520 con 0x7fb2780d2e00 2023-10-18T12:20:57.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.392+0000 7fb26effd700 1 -- 172.21.15.114:0/4105281991 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb26801f070 con 0x7fb2780d2e00 2023-10-18T12:20:57.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.392+0000 7fb26effd700 1 -- 172.21.15.114:0/4105281991 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2680038c0 con 0x7fb2780d2e00 2023-10-18T12:20:57.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.392+0000 7fb27f247700 1 -- 172.21.15.114:0/4105281991 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2781f2990 con 0x7fb2780d2e00 2023-10-18T12:20:57.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.392+0000 7fb27f247700 1 -- 172.21.15.114:0/4105281991 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2781f2f50 con 0x7fb2780d2e00 2023-10-18T12:20:57.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.392+0000 7fb27f247700 1 -- 172.21.15.114:0/4105281991 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb27815e450 con 0x7fb2780d2e00 2023-10-18T12:20:57.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.396+0000 7fb26effd700 1 -- 172.21.15.114:0/4105281991 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fb268003a20 con 0x7fb2780d2e00 2023-10-18T12:20:57.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.396+0000 7fb26effd700 1 --2- 172.21.15.114:0/4105281991 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb25c0656f0 0x7fb25c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:57.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.396+0000 7fb26effd700 1 -- 172.21.15.114:0/4105281991 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb268021070 con 0x7fb2780d2e00 2023-10-18T12:20:57.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.396+0000 7fb27e245700 1 --2- 172.21.15.114:0/4105281991 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb25c0656f0 0x7fb25c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:57.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.400+0000 7fb27e245700 1 --2- 172.21.15.114:0/4105281991 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb25c0656f0 0x7fb25c067bb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb274000f60 tx=0x7fb274009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:57.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.400+0000 7fb26effd700 1 -- 172.21.15.114:0/4105281991 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fb27815e450 con 0x7fb2780d2e00 2023-10-18T12:20:57.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.580+0000 7fb27f247700 1 -- 172.21.15.114:0/4105281991 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb27815e450 con 0x7fb2780d2e00 2023-10-18T12:20:57.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.580+0000 7fb26effd700 1 -- 172.21.15.114:0/4105281991 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb27815e450 con 0x7fb2780d2e00 2023-10-18T12:20:57.586 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-10-18T12:20:57.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.584+0000 7fb27f247700 1 -- 172.21.15.114:0/4105281991 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb25c0656f0 msgr2=0x7fb25c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:57.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.584+0000 7fb27f247700 1 --2- 172.21.15.114:0/4105281991 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb25c0656f0 0x7fb25c067bb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb274000f60 tx=0x7fb274009040 comp rx=0 tx=0).stop 2023-10-18T12:20:57.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.584+0000 7fb27f247700 1 -- 172.21.15.114:0/4105281991 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2780d2e00 msgr2=0x7fb27806fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:57.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.584+0000 7fb27f247700 1 --2- 172.21.15.114:0/4105281991 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2780d2e00 0x7fb27806fc60 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb2680090b0 tx=0x7fb268004770 comp rx=0 tx=0).stop 2023-10-18T12:20:57.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.584+0000 7fb27f247700 1 -- 172.21.15.114:0/4105281991 shutdown_connections 2023-10-18T12:20:57.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.584+0000 7fb27f247700 1 --2- 172.21.15.114:0/4105281991 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb25c0656f0 0x7fb25c067bb0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:57.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.584+0000 7fb27f247700 1 --2- 172.21.15.114:0/4105281991 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb278160710 0x7fb27815e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:57.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.584+0000 7fb27f247700 1 --2- 172.21.15.114:0/4105281991 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2780d2e00 0x7fb27806fc60 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:57.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.584+0000 7fb27f247700 1 --2- 172.21.15.114:0/4105281991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb2780b5ae0 0x7fb2781f6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:57.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.584+0000 7fb27f247700 1 -- 172.21.15.114:0/4105281991 >> 172.21.15.114:0/4105281991 conn(0x7fb278069f20 msgr2=0x7fb2780b3b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:57.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.584+0000 7fb27f247700 1 -- 172.21.15.114:0/4105281991 shutdown_connections 2023-10-18T12:20:57.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.584+0000 7fb27f247700 1 -- 172.21.15.114:0/4105281991 wait complete. 2023-10-18T12:20:57.613 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T12:20:57.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.796+0000 7f2ed0fb3700 1 Processor -- start 2023-10-18T12:20:57.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.796+0000 7f2ed0fb3700 1 -- start start 2023-10-18T12:20:57.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.800+0000 7f2ed0fb3700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ecc15bf00 0x7f2ecc0cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:57.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.800+0000 7f2ed0fb3700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2ecc0b0f90 0x7f2ecc0ce150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:57.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.800+0000 7f2ed0fb3700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ecc0cbc80 con 0x7f2ecc155420 2023-10-18T12:20:57.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.800+0000 7f2ed0fb3700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ecc155800 con 0x7f2ecc0b0f90 2023-10-18T12:20:57.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.800+0000 7f2ed0fb3700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc0cb9a0 con 0x7f2ecc15bf00 2023-10-18T12:20:57.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.800+0000 7f2ec9d9b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ecc15bf00 0x7f2ecc0cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:57.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.800+0000 7f2eca59c700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f2ecc155420 0x7f2ecc0cb150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.114:57890/0 (socket says 172.21.15.114:57890) 2023-10-18T12:20:57.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.800+0000 7f2eca59c700 1 -- 172.21.15.114:0/1491247927 learned_addr learned my addr 172.21.15.114:0/1491247927 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:57.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.800+0000 7f2ecad9d700 1 --2- 172.21.15.114:0/1491247927 >> v2:172.21.15.172:3300/0 conn(0x7f2ecc0b0f90 0x7f2ecc0ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:57.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.804+0000 7f2ec959a700 1 -- 172.21.15.114:0/1491247927 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4106790818 0 0) 0x7f2ecc0cbc80 con 0x7f2ecc155420 2023-10-18T12:20:57.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.804+0000 7f2ec959a700 1 -- 172.21.15.114:0/1491247927 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2eb40035d0 con 0x7f2ecc155420 2023-10-18T12:20:57.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.804+0000 7f2ec9d9b700 1 -- 172.21.15.114:0/1491247927 >> v2:172.21.15.172:3300/0 conn(0x7f2ecc0b0f90 msgr2=0x7f2ecc0ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:57.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.804+0000 7f2ec9d9b700 1 --2- 172.21.15.114:0/1491247927 >> v2:172.21.15.172:3300/0 conn(0x7f2ecc0b0f90 0x7f2ecc0ce150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:57.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.804+0000 7f2ec9d9b700 1 -- 172.21.15.114:0/1491247927 >> v1:172.21.15.172:6789/0 conn(0x7f2ecc155420 legacy=0x7f2ecc0cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:57.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.804+0000 7f2ec9d9b700 1 -- 172.21.15.114:0/1491247927 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ecc15b420 con 0x7f2ecc15bf00 2023-10-18T12:20:57.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.804+0000 7f2ec9d9b700 1 --2- 172.21.15.114:0/1491247927 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ecc15bf00 0x7f2ecc0cdc10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0009850 tx=0x7f2ec0009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7091b9091c0b8cd server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:57.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.804+0000 7f2ec959a700 1 -- 172.21.15.114:0/1491247927 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec0011830 con 0x7f2ecc15bf00 2023-10-18T12:20:57.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.804+0000 7f2ec959a700 1 -- 172.21.15.114:0/1491247927 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec0011990 con 0x7f2ecc15bf00 2023-10-18T12:20:57.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.804+0000 7f2ec959a700 1 -- 172.21.15.114:0/1491247927 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec0011d40 con 0x7f2ecc15bf00 2023-10-18T12:20:57.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.804+0000 7f2ed0fb3700 1 -- 172.21.15.114:0/1491247927 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ecc15bf00 msgr2=0x7f2ecc0cdc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:57.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.804+0000 7f2ed0fb3700 1 --2- 172.21.15.114:0/1491247927 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ecc15bf00 0x7f2ecc0cdc10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0009850 tx=0x7f2ec0009b60 comp rx=0 tx=0).stop 2023-10-18T12:20:57.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.804+0000 7f2ed0fb3700 1 -- 172.21.15.114:0/1491247927 shutdown_connections 2023-10-18T12:20:57.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.804+0000 7f2ed0fb3700 1 --2- 172.21.15.114:0/1491247927 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ecc15bf00 0x7f2ecc0cdc10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:57.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.804+0000 7f2ed0fb3700 1 --2- 172.21.15.114:0/1491247927 >> v2:172.21.15.172:3300/0 conn(0x7f2ecc0b0f90 0x7f2ecc0ce150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:57.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.804+0000 7f2ed0fb3700 1 -- 172.21.15.114:0/1491247927 >> 172.21.15.114:0/1491247927 conn(0x7f2ecc06a340 msgr2=0x7f2ecc0b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:57.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.804+0000 7f2ed0fb3700 1 -- 172.21.15.114:0/1491247927 shutdown_connections 2023-10-18T12:20:57.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.804+0000 7f2ed0fb3700 1 -- 172.21.15.114:0/1491247927 wait complete. 2023-10-18T12:20:57.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.808+0000 7f2ed0fb3700 1 Processor -- start 2023-10-18T12:20:57.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.808+0000 7f2ed0fb3700 1 -- start start 2023-10-18T12:20:57.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.808+0000 7f2ed0fb3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ecc0b0f90 0x7f2ecc1f1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:57.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.808+0000 7f2ed0fb3700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ecc155420 0x7f2ecc136cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:57.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.808+0000 7f2ed0fb3700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ecc15bf00 0x7f2ecc0aeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:57.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.808+0000 7f2ed0fb3700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc154e00 con 0x7f2ecc15bf00 2023-10-18T12:20:57.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.808+0000 7f2ed0fb3700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc135140 con 0x7f2ecc0b0f90 2023-10-18T12:20:57.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.808+0000 7f2ed0fb3700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc134df0 con 0x7f2ecc155420 2023-10-18T12:20:57.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.808+0000 7f2ecad9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ecc15bf00 0x7f2ecc0aeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:57.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.808+0000 7f2ecad9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ecc15bf00 0x7f2ecc0aeeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58634/0 (socket says 172.21.15.114:58634) 2023-10-18T12:20:57.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.808+0000 7f2ecad9d700 1 -- 172.21.15.114:0/2189210452 learned_addr learned my addr 172.21.15.114:0/2189210452 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:57.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.808+0000 7f2eca59c700 1 --2- 172.21.15.114:0/2189210452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ecc0b0f90 0x7f2ecc1f1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:57.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.808+0000 7f2ec9d9b700 1 --2- 172.21.15.114:0/2189210452 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ecc155420 0x7f2ecc136cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:57.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.808+0000 7f2ecad9d700 1 -- 172.21.15.114:0/2189210452 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ecc155420 msgr2=0x7f2ecc136cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:57.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.808+0000 7f2ecad9d700 1 --2- 172.21.15.114:0/2189210452 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ecc155420 0x7f2ecc136cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:57.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.808+0000 7f2ecad9d700 1 -- 172.21.15.114:0/2189210452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ecc0b0f90 msgr2=0x7f2ecc1f1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:57.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.808+0000 7f2ecad9d700 1 --2- 172.21.15.114:0/2189210452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ecc0b0f90 0x7f2ecc1f1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:57.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.808+0000 7f2ecad9d700 1 -- 172.21.15.114:0/2189210452 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec00094b0 con 0x7f2ecc15bf00 2023-10-18T12:20:57.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.808+0000 7f2eca59c700 1 --2- 172.21.15.114:0/2189210452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ecc0b0f90 0x7f2ecc1f1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:57.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.808+0000 7f2ecad9d700 1 --2- 172.21.15.114:0/2189210452 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ecc15bf00 0x7f2ecc0aeeb0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2ec400efc0 tx=0x7f2ec400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:57.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.812+0000 7f2ebaffd700 1 -- 172.21.15.114:0/2189210452 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec4009ea0 con 0x7f2ecc15bf00 2023-10-18T12:20:57.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.812+0000 7f2ebaffd700 1 -- 172.21.15.114:0/2189210452 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec400f040 con 0x7f2ecc15bf00 2023-10-18T12:20:57.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.812+0000 7f2ed0fb3700 1 -- 172.21.15.114:0/2189210452 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ecc137750 con 0x7f2ecc15bf00 2023-10-18T12:20:57.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.812+0000 7f2ebaffd700 1 -- 172.21.15.114:0/2189210452 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec4014480 con 0x7f2ecc15bf00 2023-10-18T12:20:57.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.812+0000 7f2ed0fb3700 1 -- 172.21.15.114:0/2189210452 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ecc13afc0 con 0x7f2ecc15bf00 2023-10-18T12:20:57.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.812+0000 7f2ed0fb3700 1 -- 172.21.15.114:0/2189210452 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ecc137c70 con 0x7f2ecc15bf00 2023-10-18T12:20:57.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.812+0000 7f2ebaffd700 1 -- 172.21.15.114:0/2189210452 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f2ec40145e0 con 0x7f2ecc15bf00 2023-10-18T12:20:57.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.816+0000 7f2ebaffd700 1 --2- 172.21.15.114:0/2189210452 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2eac0656f0 0x7f2eac067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:57.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.816+0000 7f2ebaffd700 1 -- 172.21.15.114:0/2189210452 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2ec4083a20 con 0x7f2ecc15bf00 2023-10-18T12:20:57.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.816+0000 7f2eca59c700 1 --2- 172.21.15.114:0/2189210452 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2eac0656f0 0x7f2eac067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:57.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.816+0000 7f2eca59c700 1 --2- 172.21.15.114:0/2189210452 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2eac0656f0 0x7f2eac067bb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc0011e0 tx=0x7f2ebc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:57.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:57.824+0000 7f2ebaffd700 1 -- 172.21.15.114:0/2189210452 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f2ec4051110 con 0x7f2ecc15bf00 2023-10-18T12:20:58.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.036+0000 7f2ed0fb3700 1 -- 172.21.15.114:0/2189210452 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ecc1352b0 con 0x7f2ecc15bf00 2023-10-18T12:20:58.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.036+0000 7f2ebaffd700 1 -- 172.21.15.114:0/2189210452 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4877 (secure 0 0 0) 0x7f2ec4054730 con 0x7f2ecc15bf00 2023-10-18T12:20:58.042 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:20:58.042 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1054658298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1054658298},{"type":"v1","addr":"172.21.15.172:6835","nonce":1054658298}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2715800167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2715800167},{"type":"v1","addr":"172.21.15.114:6833","nonce":2715800167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/22518579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":22518579},{"type":"v1","addr":"172.21.15.114:6835","nonce":22518579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T12:19:39.077734+0000","modified":"2023-10-18T12:20:01.448709+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4303":{"gid":4303,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3028221887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3028221887},{"type":"v1","addr":"172.21.15.172:6837","nonce":3028221887}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-18T12:20:58.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.040+0000 7f2ed0fb3700 1 -- 172.21.15.114:0/2189210452 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2eac0656f0 msgr2=0x7f2eac067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:58.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.040+0000 7f2ed0fb3700 1 --2- 172.21.15.114:0/2189210452 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2eac0656f0 0x7f2eac067bb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc0011e0 tx=0x7f2ebc009040 comp rx=0 tx=0).stop 2023-10-18T12:20:58.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.040+0000 7f2ed0fb3700 1 -- 172.21.15.114:0/2189210452 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ecc15bf00 msgr2=0x7f2ecc0aeeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:58.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.040+0000 7f2ed0fb3700 1 --2- 172.21.15.114:0/2189210452 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ecc15bf00 0x7f2ecc0aeeb0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2ec400efc0 tx=0x7f2ec400c3a0 comp rx=0 tx=0).stop 2023-10-18T12:20:58.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.040+0000 7f2ed0fb3700 1 -- 172.21.15.114:0/2189210452 shutdown_connections 2023-10-18T12:20:58.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.040+0000 7f2ed0fb3700 1 --2- 172.21.15.114:0/2189210452 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2eac0656f0 0x7f2eac067bb0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:58.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.040+0000 7f2ed0fb3700 1 --2- 172.21.15.114:0/2189210452 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ecc155420 0x7f2ecc136cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:58.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.040+0000 7f2ed0fb3700 1 --2- 172.21.15.114:0/2189210452 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ecc15bf00 0x7f2ecc0aeeb0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:58.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.040+0000 7f2ed0fb3700 1 --2- 172.21.15.114:0/2189210452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ecc0b0f90 0x7f2ecc1f1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:58.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.040+0000 7f2ed0fb3700 1 -- 172.21.15.114:0/2189210452 >> 172.21.15.114:0/2189210452 conn(0x7f2ecc06a340 msgr2=0x7f2ecc060730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:58.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.040+0000 7f2ed0fb3700 1 -- 172.21.15.114:0/2189210452 shutdown_connections 2023-10-18T12:20:58.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.040+0000 7f2ed0fb3700 1 -- 172.21.15.114:0/2189210452 wait complete. 2023-10-18T12:20:58.047 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 9 2023-10-18T12:20:58.070 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T12:20:58.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.236+0000 7f498193f700 1 Processor -- start 2023-10-18T12:20:58.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.236+0000 7f498193f700 1 -- start start 2023-10-18T12:20:58.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.236+0000 7f498193f700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f497c0700b0 0x7f497c167c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:58.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.236+0000 7f498193f700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f497c15e680 con 0x7f497c146800 2023-10-18T12:20:58.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.236+0000 7f498193f700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f497c0b6180 con 0x7f497c0b5b80 2023-10-18T12:20:58.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.236+0000 7f498193f700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f497c0b6460 con 0x7f497c0700b0 2023-10-18T12:20:58.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.240+0000 7f497affd700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f497c146800 0x7f497c15dd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46638/0 (socket says 172.21.15.114:46638) 2023-10-18T12:20:58.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.240+0000 7f497affd700 1 -- 172.21.15.114:0/4216950999 learned_addr learned my addr 172.21.15.114:0/4216950999 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:58.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.240+0000 7f497b7fe700 1 --2- 172.21.15.114:0/4216950999 >> v2:172.21.15.114:3300/0 conn(0x7f497c0700b0 0x7f497c167c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:58.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.240+0000 7f497b7fe700 1 -- 172.21.15.114:0/4216950999 >> v1:172.21.15.172:6789/0 conn(0x7f497c0b5b80 legacy=0x7f497c06f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:58.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.240+0000 7f497b7fe700 1 -- 172.21.15.114:0/4216950999 >> v1:172.21.15.114:6789/0 conn(0x7f497c146800 legacy=0x7f497c15dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:58.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.240+0000 7f497b7fe700 1 -- 172.21.15.114:0/4216950999 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f497c0b6740 con 0x7f497c0700b0 2023-10-18T12:20:58.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.240+0000 7f497b7fe700 1 --2- 172.21.15.114:0/4216950999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f497c0700b0 0x7f497c167c30 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f4974009d90 tx=0x7f497400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69c48d2d27108abe server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:58.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.240+0000 7f4979ffb700 1 -- 172.21.15.114:0/4216950999 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497400e070 con 0x7f497c0700b0 2023-10-18T12:20:58.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.240+0000 7f4979ffb700 1 -- 172.21.15.114:0/4216950999 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f497400bbd0 con 0x7f497c0700b0 2023-10-18T12:20:58.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.240+0000 7f4979ffb700 1 -- 172.21.15.114:0/4216950999 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4974012430 con 0x7f497c0700b0 2023-10-18T12:20:58.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.240+0000 7f498193f700 1 -- 172.21.15.114:0/4216950999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f497c0700b0 msgr2=0x7f497c167c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:58.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.240+0000 7f498193f700 1 --2- 172.21.15.114:0/4216950999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f497c0700b0 0x7f497c167c30 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f4974009d90 tx=0x7f497400b330 comp rx=0 tx=0).stop 2023-10-18T12:20:58.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.240+0000 7f498193f700 1 -- 172.21.15.114:0/4216950999 shutdown_connections 2023-10-18T12:20:58.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.240+0000 7f498193f700 1 --2- 172.21.15.114:0/4216950999 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f497c0700b0 0x7f497c167c30 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:58.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.240+0000 7f498193f700 1 -- 172.21.15.114:0/4216950999 >> 172.21.15.114:0/4216950999 conn(0x7f497c06a130 msgr2=0x7f497c06a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:58.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.240+0000 7f498193f700 1 -- 172.21.15.114:0/4216950999 shutdown_connections 2023-10-18T12:20:58.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.240+0000 7f498193f700 1 -- 172.21.15.114:0/4216950999 wait complete. 2023-10-18T12:20:58.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.244+0000 7f498193f700 1 Processor -- start 2023-10-18T12:20:58.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.244+0000 7f498193f700 1 -- start start 2023-10-18T12:20:58.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.244+0000 7f498193f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f497c0700b0 0x7f497c15be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:58.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.244+0000 7f498193f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f497c0b5b80 0x7f497c13de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:58.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.244+0000 7f498193f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f497c146800 0x7f497c13c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:58.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.244+0000 7f498193f700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f497c13cd80 con 0x7f497c0b5b80 2023-10-18T12:20:58.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.244+0000 7f498193f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f497c13d060 con 0x7f497c0700b0 2023-10-18T12:20:58.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.244+0000 7f498193f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f497c13d340 con 0x7f497c146800 2023-10-18T12:20:58.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.244+0000 7f497a7fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f497c0b5b80 0x7f497c13de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:58.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.244+0000 7f497a7fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f497c0b5b80 0x7f497c13de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58664/0 (socket says 172.21.15.114:58664) 2023-10-18T12:20:58.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.244+0000 7f497a7fc700 1 -- 172.21.15.114:0/4275264107 learned_addr learned my addr 172.21.15.114:0/4275264107 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:58.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.244+0000 7f497affd700 1 --2- 172.21.15.114:0/4275264107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f497c0700b0 0x7f497c15be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:58.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.244+0000 7f497b7fe700 1 --2- 172.21.15.114:0/4275264107 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f497c146800 0x7f497c13c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:58.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.244+0000 7f497a7fc700 1 -- 172.21.15.114:0/4275264107 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f497c146800 msgr2=0x7f497c13c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:58.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.244+0000 7f497a7fc700 1 --2- 172.21.15.114:0/4275264107 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f497c146800 0x7f497c13c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:58.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.244+0000 7f497a7fc700 1 -- 172.21.15.114:0/4275264107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f497c0700b0 msgr2=0x7f497c15be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:58.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.244+0000 7f497a7fc700 1 --2- 172.21.15.114:0/4275264107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f497c0700b0 0x7f497c15be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:58.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.244+0000 7f497a7fc700 1 -- 172.21.15.114:0/4275264107 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4974009a70 con 0x7f497c0b5b80 2023-10-18T12:20:58.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.244+0000 7f497b7fe700 1 --2- 172.21.15.114:0/4275264107 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f497c146800 0x7f497c13c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:20:58.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.244+0000 7f497affd700 1 --2- 172.21.15.114:0/4275264107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f497c0700b0 0x7f497c15be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:20:58.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.244+0000 7f497a7fc700 1 --2- 172.21.15.114:0/4275264107 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f497c0b5b80 0x7f497c13de20 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f497000c500 tx=0x7f497000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:58.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.244+0000 7f4963fff700 1 -- 172.21.15.114:0/4275264107 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49700052d0 con 0x7f497c0b5b80 2023-10-18T12:20:58.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.244+0000 7f4963fff700 1 -- 172.21.15.114:0/4275264107 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4970005430 con 0x7f497c0b5b80 2023-10-18T12:20:58.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.244+0000 7f498193f700 1 -- 172.21.15.114:0/4275264107 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f497c13d620 con 0x7f497c0b5b80 2023-10-18T12:20:58.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.244+0000 7f4963fff700 1 -- 172.21.15.114:0/4275264107 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49700055a0 con 0x7f497c0b5b80 2023-10-18T12:20:58.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.244+0000 7f498193f700 1 -- 172.21.15.114:0/4275264107 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f497c15c3c0 con 0x7f497c0b5b80 2023-10-18T12:20:58.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.248+0000 7f498193f700 1 -- 172.21.15.114:0/4275264107 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f497c13db40 con 0x7f497c0b5b80 2023-10-18T12:20:58.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.248+0000 7f4963fff700 1 -- 172.21.15.114:0/4275264107 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f49700036a0 con 0x7f497c0b5b80 2023-10-18T12:20:58.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.252+0000 7f4963fff700 1 --2- 172.21.15.114:0/4275264107 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f49680656f0 0x7f4968067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:58.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.252+0000 7f4963fff700 1 -- 172.21.15.114:0/4275264107 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f49700823e0 con 0x7f497c0b5b80 2023-10-18T12:20:58.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.252+0000 7f497affd700 1 --2- 172.21.15.114:0/4275264107 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f49680656f0 0x7f4968067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:58.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.252+0000 7f497affd700 1 --2- 172.21.15.114:0/4275264107 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f49680656f0 0x7f4968067bb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f496c005930 tx=0x7f496c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:58.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.256+0000 7f4963fff700 1 -- 172.21.15.114:0/4275264107 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f497c13db40 con 0x7f497c0b5b80 2023-10-18T12:20:58.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.432+0000 7f498193f700 1 -- 172.21.15.114:0/4275264107 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f497c13db40 con 0x7f497c0b5b80 2023-10-18T12:20:58.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.436+0000 7f4963fff700 1 -- 172.21.15.114:0/4275264107 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20240 (secure 0 0 0) 0x7f497c13db40 con 0x7f497c0b5b80 2023-10-18T12:20:58.442 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:20:58.442 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":30,"fsid":"240ea340-5d3d-4f52-a4bc-af075aca3deb","created":"2023-10-18T12:19:12.512994+0000","modified":"2023-10-18T12:20:20.604528+0000","last_up_change":"2023-10-18T12:19:25.286009+0000","last_in_change":"2023-10-18T12:19:15.850693+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T12:19:27.040638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-18T12:19:32.358094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-18T12:19:37.333855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-18T12:19:38.055385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-18T12:19:41.679218+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c3578978-1a03-4857-b9d2-34a5da3d7731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6817","nonce":1506287862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6820","nonce":1506287862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6830","nonce":1506287862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6825","nonce":1506287862}]},"public_addr":"172.21.15.114:6817/1506287862","cluster_addr":"172.21.15.114:6820/1506287862","heartbeat_back_addr":"172.21.15.114:6830/1506287862","heartbeat_front_addr":"172.21.15.114:6825/1506287862","state":["exists","up"]},{"osd":1,"uuid":"43eb26a6-e2b3-4670-9559-bd053b5140d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6801","nonce":3302727047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6803","nonce":3302727047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6807","nonce":3302727047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6805","nonce":3302727047}]},"public_addr":"172.21.15.114:6801/3302727047","cluster_addr":"172.21.15.114:6803/3302727047","heartbeat_back_addr":"172.21.15.114:6807/3302727047","heartbeat_front_addr":"172.21.15.114:6805/3302727047","state":["exists","up"]},{"osd":2,"uuid":"f3d4dbd5-521c-4dd2-b687-5768cc7d0938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6809","nonce":2699151351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6811","nonce":2699151351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6815","nonce":2699151351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6813","nonce":2699151351}]},"public_addr":"172.21.15.114:6809/2699151351","cluster_addr":"172.21.15.114:6811/2699151351","heartbeat_back_addr":"172.21.15.114:6815/2699151351","heartbeat_front_addr":"172.21.15.114:6813/2699151351","state":["exists","up"]},{"osd":3,"uuid":"823e5802-92b7-4f0d-b32d-a5748993f1b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6821","nonce":1361608073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6824","nonce":1361608073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6829","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6831","nonce":1361608073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6827","nonce":1361608073}]},"public_addr":"172.21.15.114:6821/1361608073","cluster_addr":"172.21.15.114:6824/1361608073","heartbeat_back_addr":"172.21.15.114:6831/1361608073","heartbeat_front_addr":"172.21.15.114:6827/1361608073","state":["exists","up"]},{"osd":4,"uuid":"e47fb93e-13b4-44a4-b084-8c4384ceb41e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6801","nonce":930839681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6803","nonce":930839681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6807","nonce":930839681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6805","nonce":930839681}]},"public_addr":"172.21.15.172:6801/930839681","cluster_addr":"172.21.15.172:6803/930839681","heartbeat_back_addr":"172.21.15.172:6807/930839681","heartbeat_front_addr":"172.21.15.172:6805/930839681","state":["exists","up"]},{"osd":5,"uuid":"7561a973-f479-45a0-af40-f324728d622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6814","nonce":571761850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6818","nonce":571761850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6824","nonce":571761850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6821","nonce":571761850}]},"public_addr":"172.21.15.172:6814/571761850","cluster_addr":"172.21.15.172:6818/571761850","heartbeat_back_addr":"172.21.15.172:6824/571761850","heartbeat_front_addr":"172.21.15.172:6821/571761850","state":["exists","up"]},{"osd":6,"uuid":"51753f4b-7f06-4f1c-9ec7-6e18a66eb980","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6825","nonce":1680398853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6827","nonce":1680398853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6831","nonce":1680398853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6829","nonce":1680398853}]},"public_addr":"172.21.15.172:6825/1680398853","cluster_addr":"172.21.15.172:6827/1680398853","heartbeat_back_addr":"172.21.15.172:6831/1680398853","heartbeat_front_addr":"172.21.15.172:6829/1680398853","state":["exists","up"]},{"osd":7,"uuid":"4d8b1e15-143d-4d17-9074-59d92f0f9af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6809","nonce":349710101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6811","nonce":349710101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6819","nonce":349710101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6815","nonce":349710101}]},"public_addr":"172.21.15.172:6809/349710101","cluster_addr":"172.21.15.172:6811/349710101","heartbeat_back_addr":"172.21.15.172:6819/349710101","heartbeat_front_addr":"172.21.15.172:6815/349710101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.889460+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.475494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.911473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.648596+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.609994+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.636248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.854589+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.885826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T12:20:58.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.440+0000 7f498193f700 1 -- 172.21.15.114:0/4275264107 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f49680656f0 msgr2=0x7f4968067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:58.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.440+0000 7f498193f700 1 --2- 172.21.15.114:0/4275264107 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f49680656f0 0x7f4968067bb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f496c005930 tx=0x7f496c009040 comp rx=0 tx=0).stop 2023-10-18T12:20:58.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.440+0000 7f498193f700 1 -- 172.21.15.114:0/4275264107 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f497c0b5b80 msgr2=0x7f497c13de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:58.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.440+0000 7f498193f700 1 --2- 172.21.15.114:0/4275264107 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f497c0b5b80 0x7f497c13de20 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f497000c500 tx=0x7f497000c8c0 comp rx=0 tx=0).stop 2023-10-18T12:20:58.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.440+0000 7f498193f700 1 -- 172.21.15.114:0/4275264107 shutdown_connections 2023-10-18T12:20:58.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.440+0000 7f498193f700 1 --2- 172.21.15.114:0/4275264107 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f49680656f0 0x7f4968067bb0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:58.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.440+0000 7f498193f700 1 --2- 172.21.15.114:0/4275264107 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f497c146800 0x7f497c13c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:58.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.440+0000 7f498193f700 1 --2- 172.21.15.114:0/4275264107 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f497c0b5b80 0x7f497c13de20 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:58.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.440+0000 7f498193f700 1 --2- 172.21.15.114:0/4275264107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f497c0700b0 0x7f497c15be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:58.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.440+0000 7f498193f700 1 -- 172.21.15.114:0/4275264107 >> 172.21.15.114:0/4275264107 conn(0x7f497c06a130 msgr2=0x7f497c0d2550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:58.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.440+0000 7f498193f700 1 -- 172.21.15.114:0/4275264107 shutdown_connections 2023-10-18T12:20:58.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.440+0000 7f498193f700 1 -- 172.21.15.114:0/4275264107 wait complete. 2023-10-18T12:20:58.466 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-18T12:20:58.467 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T12:20:58.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.644+0000 7ff2353ed700 1 Processor -- start 2023-10-18T12:20:58.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.644+0000 7ff2353ed700 1 -- start start 2023-10-18T12:20:58.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.644+0000 7ff2353ed700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff23015bf00 0x7ff2300cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:58.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.644+0000 7ff2353ed700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff2300b0f90 0x7ff2300ce150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:58.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.644+0000 7ff2353ed700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2300cbc80 con 0x7ff230155420 2023-10-18T12:20:58.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.644+0000 7ff2353ed700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff230155800 con 0x7ff23015bf00 2023-10-18T12:20:58.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.644+0000 7ff2353ed700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2300cb9a0 con 0x7ff2300b0f90 2023-10-18T12:20:58.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.648+0000 7ff22effd700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff230155420 0x7ff2300cb150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46652/0 (socket says 172.21.15.114:46652) 2023-10-18T12:20:58.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.648+0000 7ff22effd700 1 -- 172.21.15.114:0/252976777 learned_addr learned my addr 172.21.15.114:0/252976777 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:58.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.648+0000 7ff2267fc700 1 --2- 172.21.15.114:0/252976777 >> v2:172.21.15.114:3300/0 conn(0x7ff23015bf00 0x7ff2300cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:58.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.648+0000 7ff22f7fe700 1 --2- 172.21.15.114:0/252976777 >> v2:172.21.15.172:3300/0 conn(0x7ff2300b0f90 0x7ff2300ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:58.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.648+0000 7ff22e7fc700 1 -- 172.21.15.114:0/252976777 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2776037287 0 0) 0x7ff2300cbc80 con 0x7ff230155420 2023-10-18T12:20:58.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.648+0000 7ff22e7fc700 1 -- 172.21.15.114:0/252976777 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff21c0035d0 con 0x7ff230155420 2023-10-18T12:20:58.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.648+0000 7ff22e7fc700 1 -- 172.21.15.114:0/252976777 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2465875584 0 0) 0x7ff21c0035d0 con 0x7ff230155420 2023-10-18T12:20:58.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.648+0000 7ff22e7fc700 1 -- 172.21.15.114:0/252976777 >> v2:172.21.15.172:3300/0 conn(0x7ff2300b0f90 msgr2=0x7ff2300ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:58.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.648+0000 7ff22e7fc700 1 --2- 172.21.15.114:0/252976777 >> v2:172.21.15.172:3300/0 conn(0x7ff2300b0f90 0x7ff2300ce150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:58.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.648+0000 7ff22e7fc700 1 -- 172.21.15.114:0/252976777 >> v2:172.21.15.114:3300/0 conn(0x7ff23015bf00 msgr2=0x7ff2300cdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:58.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.648+0000 7ff22e7fc700 1 --2- 172.21.15.114:0/252976777 >> v2:172.21.15.114:3300/0 conn(0x7ff23015bf00 0x7ff2300cdc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:58.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.648+0000 7ff22e7fc700 1 -- 172.21.15.114:0/252976777 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff23015b420 con 0x7ff230155420 2023-10-18T12:20:58.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.648+0000 7ff22e7fc700 1 -- 172.21.15.114:0/252976777 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3368469509 0 0) 0x7ff220001670 con 0x7ff230155420 2023-10-18T12:20:58.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.648+0000 7ff22e7fc700 1 -- 172.21.15.114:0/252976777 >> v1:172.21.15.114:6789/0 conn(0x7ff230155420 legacy=0x7ff2300cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:58.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.648+0000 7ff22e7fc700 1 --2- 172.21.15.114:0/252976777 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff21c003a70 0x7ff21c003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:58.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.648+0000 7ff22e7fc700 1 --2- 172.21.15.114:0/252976777 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff21c004870 0x7ff21c004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:58.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.648+0000 7ff22e7fc700 1 --2- 172.21.15.114:0/252976777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff21c005230 0x7ff21c00fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:58.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.648+0000 7ff22e7fc700 1 -- 172.21.15.114:0/252976777 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff230155800 con 0x7ff21c004870 2023-10-18T12:20:58.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.648+0000 7ff22e7fc700 1 -- 172.21.15.114:0/252976777 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2300cb9a0 con 0x7ff21c005230 2023-10-18T12:20:58.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.648+0000 7ff22e7fc700 1 -- 172.21.15.114:0/252976777 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff21c0104e0 con 0x7ff21c003a70 2023-10-18T12:20:58.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.648+0000 7ff2267fc700 1 --2- 172.21.15.114:0/252976777 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff21c004870 0x7ff21c004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:58.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.648+0000 7ff22f7fe700 1 --2- 172.21.15.114:0/252976777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff21c005230 0x7ff21c00fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:58.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.648+0000 7ff22effd700 1 --2- 172.21.15.114:0/252976777 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff21c003a70 0x7ff21c003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:58.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.648+0000 7ff2267fc700 1 -- 172.21.15.114:0/252976777 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff21c003a70 msgr2=0x7ff21c003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:58.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.648+0000 7ff2267fc700 1 --2- 172.21.15.114:0/252976777 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff21c003a70 0x7ff21c003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:58.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.648+0000 7ff2267fc700 1 -- 172.21.15.114:0/252976777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff21c005230 msgr2=0x7ff21c00fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:58.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.648+0000 7ff2267fc700 1 --2- 172.21.15.114:0/252976777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff21c005230 0x7ff21c00fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:58.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.648+0000 7ff2267fc700 1 -- 172.21.15.114:0/252976777 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff21c0035d0 con 0x7ff21c004870 2023-10-18T12:20:58.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.648+0000 7ff22f7fe700 1 -- 172.21.15.114:0/252976777 reap_dead start 2023-10-18T12:20:58.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.648+0000 7ff2267fc700 1 --2- 172.21.15.114:0/252976777 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff21c004870 0x7ff21c004cf0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff218009b70 tx=0x7ff21c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7541bb2007c337c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:58.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.648+0000 7ff22e7fc700 1 -- 172.21.15.114:0/252976777 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21800e6c0 con 0x7ff21c004870 2023-10-18T12:20:58.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.648+0000 7ff22e7fc700 1 -- 172.21.15.114:0/252976777 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff21800e820 con 0x7ff21c004870 2023-10-18T12:20:58.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.648+0000 7ff22e7fc700 1 -- 172.21.15.114:0/252976777 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21800eb90 con 0x7ff21c004870 2023-10-18T12:20:58.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.652+0000 7ff2353ed700 1 -- 172.21.15.114:0/252976777 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff21c004870 msgr2=0x7ff21c004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:58.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.652+0000 7ff2353ed700 1 --2- 172.21.15.114:0/252976777 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff21c004870 0x7ff21c004cf0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff218009b70 tx=0x7ff21c0058a0 comp rx=0 tx=0).stop 2023-10-18T12:20:58.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.652+0000 7ff2353ed700 1 -- 172.21.15.114:0/252976777 shutdown_connections 2023-10-18T12:20:58.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.652+0000 7ff2353ed700 1 --2- 172.21.15.114:0/252976777 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff21c004870 0x7ff21c004cf0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:58.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.652+0000 7ff2353ed700 1 -- 172.21.15.114:0/252976777 >> 172.21.15.114:0/252976777 conn(0x7ff23006a340 msgr2=0x7ff2300b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:58.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.652+0000 7ff2353ed700 1 -- 172.21.15.114:0/252976777 shutdown_connections 2023-10-18T12:20:58.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.652+0000 7ff2353ed700 1 -- 172.21.15.114:0/252976777 wait complete. 2023-10-18T12:20:58.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.652+0000 7ff2353ed700 1 Processor -- start 2023-10-18T12:20:58.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.652+0000 7ff2353ed700 1 -- start start 2023-10-18T12:20:58.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.652+0000 7ff2353ed700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff21c004870 0x7ff230141b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:58.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.652+0000 7ff2353ed700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2301eecb0 0x7ff2301ef3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:58.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.656+0000 7ff2353ed700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff2300b17b0 0x7ff2300b1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:58.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.656+0000 7ff2353ed700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2300b2170 con 0x7ff2301eecb0 2023-10-18T12:20:58.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.656+0000 7ff2353ed700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2301f15f0 con 0x7ff21c004870 2023-10-18T12:20:58.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.656+0000 7ff2353ed700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff230156e60 con 0x7ff2300b17b0 2023-10-18T12:20:58.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.656+0000 7ff2267fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2301eecb0 0x7ff2301ef3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:58.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.656+0000 7ff2267fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2301eecb0 0x7ff2301ef3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58684/0 (socket says 172.21.15.114:58684) 2023-10-18T12:20:58.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.656+0000 7ff2267fc700 1 -- 172.21.15.114:0/3252302921 learned_addr learned my addr 172.21.15.114:0/3252302921 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:58.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.656+0000 7ff22effd700 1 --2- 172.21.15.114:0/3252302921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff21c004870 0x7ff230141b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:58.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.656+0000 7ff22f7fe700 1 --2- 172.21.15.114:0/3252302921 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff2300b17b0 0x7ff2300b1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:58.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.656+0000 7ff2267fc700 1 -- 172.21.15.114:0/3252302921 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff2300b17b0 msgr2=0x7ff2300b1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:58.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.656+0000 7ff2267fc700 1 --2- 172.21.15.114:0/3252302921 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff2300b17b0 0x7ff2300b1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:58.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.656+0000 7ff2267fc700 1 -- 172.21.15.114:0/3252302921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff21c004870 msgr2=0x7ff230141b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:58.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.656+0000 7ff2267fc700 1 --2- 172.21.15.114:0/3252302921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff21c004870 0x7ff230141b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:58.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.656+0000 7ff2267fc700 1 -- 172.21.15.114:0/3252302921 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff230157100 con 0x7ff2301eecb0 2023-10-18T12:20:58.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.656+0000 7ff22effd700 1 --2- 172.21.15.114:0/3252302921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff21c004870 0x7ff230141b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:58.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.656+0000 7ff2267fc700 1 --2- 172.21.15.114:0/3252302921 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2301eecb0 0x7ff2301ef3f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff21c010430 tx=0x7ff2180047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:58.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.656+0000 7ff227fff700 1 -- 172.21.15.114:0/3252302921 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21800e6c0 con 0x7ff2301eecb0 2023-10-18T12:20:58.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.656+0000 7ff2353ed700 1 -- 172.21.15.114:0/3252302921 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2301573e0 con 0x7ff2301eecb0 2023-10-18T12:20:58.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.656+0000 7ff227fff700 1 -- 172.21.15.114:0/3252302921 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff218003af0 con 0x7ff2301eecb0 2023-10-18T12:20:58.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.656+0000 7ff227fff700 1 -- 172.21.15.114:0/3252302921 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff218003ea0 con 0x7ff2301eecb0 2023-10-18T12:20:58.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.656+0000 7ff2353ed700 1 -- 172.21.15.114:0/3252302921 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2301579a0 con 0x7ff2301eecb0 2023-10-18T12:20:58.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.660+0000 7ff2353ed700 1 -- 172.21.15.114:0/3252302921 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff230072e60 con 0x7ff2301eecb0 2023-10-18T12:20:58.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.660+0000 7ff227fff700 1 -- 172.21.15.114:0/3252302921 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff218013470 con 0x7ff2301eecb0 2023-10-18T12:20:58.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.660+0000 7ff227fff700 1 --2- 172.21.15.114:0/3252302921 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff2100656f0 0x7ff210067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:58.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.660+0000 7ff227fff700 1 -- 172.21.15.114:0/3252302921 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff2180848d0 con 0x7ff2301eecb0 2023-10-18T12:20:58.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.664+0000 7ff22effd700 1 --2- 172.21.15.114:0/3252302921 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff2100656f0 0x7ff210067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:58.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.664+0000 7ff22effd700 1 --2- 172.21.15.114:0/3252302921 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff2100656f0 0x7ff210067bb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff220000fb0 tx=0x7ff220009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:58.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.668+0000 7ff227fff700 1 -- 172.21.15.114:0/3252302921 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7ff218052210 con 0x7ff2301eecb0 2023-10-18T12:20:58.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.900+0000 7ff2353ed700 1 -- 172.21.15.114:0/3252302921 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff2300cca00 con 0x7ff2301eecb0 2023-10-18T12:20:58.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.900+0000 7ff227fff700 1 -- 172.21.15.114:0/3252302921 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4877 (secure 0 0 0) 0x7ff218055830 con 0x7ff2301eecb0 2023-10-18T12:20:58.906 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:20:58.906 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1054658298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1054658298},{"type":"v1","addr":"172.21.15.172:6835","nonce":1054658298}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2715800167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2715800167},{"type":"v1","addr":"172.21.15.114:6833","nonce":2715800167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/22518579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":22518579},{"type":"v1","addr":"172.21.15.114:6835","nonce":22518579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T12:19:39.077734+0000","modified":"2023-10-18T12:20:01.448709+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4303":{"gid":4303,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3028221887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3028221887},{"type":"v1","addr":"172.21.15.172:6837","nonce":3028221887}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-18T12:20:58.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.904+0000 7ff2353ed700 1 -- 172.21.15.114:0/3252302921 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff2100656f0 msgr2=0x7ff210067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:58.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.904+0000 7ff2353ed700 1 --2- 172.21.15.114:0/3252302921 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff2100656f0 0x7ff210067bb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff220000fb0 tx=0x7ff220009040 comp rx=0 tx=0).stop 2023-10-18T12:20:58.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.904+0000 7ff2353ed700 1 -- 172.21.15.114:0/3252302921 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2301eecb0 msgr2=0x7ff2301ef3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:58.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.904+0000 7ff2353ed700 1 --2- 172.21.15.114:0/3252302921 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2301eecb0 0x7ff2301ef3f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff21c010430 tx=0x7ff2180047e0 comp rx=0 tx=0).stop 2023-10-18T12:20:58.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.904+0000 7ff2353ed700 1 -- 172.21.15.114:0/3252302921 shutdown_connections 2023-10-18T12:20:58.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.904+0000 7ff2353ed700 1 --2- 172.21.15.114:0/3252302921 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff2100656f0 0x7ff210067bb0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:58.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.904+0000 7ff2353ed700 1 --2- 172.21.15.114:0/3252302921 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff2300b17b0 0x7ff2300b1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:58.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.904+0000 7ff2353ed700 1 --2- 172.21.15.114:0/3252302921 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff2301eecb0 0x7ff2301ef3f0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:58.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.904+0000 7ff2353ed700 1 --2- 172.21.15.114:0/3252302921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff21c004870 0x7ff230141b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:58.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.904+0000 7ff2353ed700 1 -- 172.21.15.114:0/3252302921 >> 172.21.15.114:0/3252302921 conn(0x7ff23006a340 msgr2=0x7ff230143ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:58.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.904+0000 7ff2353ed700 1 -- 172.21.15.114:0/3252302921 shutdown_connections 2023-10-18T12:20:58.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:58.904+0000 7ff2353ed700 1 -- 172.21.15.114:0/3252302921 wait complete. 2023-10-18T12:20:58.912 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 9 2023-10-18T12:20:58.930 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T12:20:59.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.092+0000 7ff71b287700 1 Processor -- start 2023-10-18T12:20:59.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.092+0000 7ff71b287700 1 -- start start 2023-10-18T12:20:59.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.096+0000 7ff71b287700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff71406e8a0 0x7ff7140cb190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:59.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.096+0000 7ff71b287700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff7140cb6d0 0x7ff71406f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:59.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.096+0000 7ff71b287700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff71415e130 con 0x7ff714154040 2023-10-18T12:20:59.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.096+0000 7ff71b287700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7140cbb60 con 0x7ff7140cb6d0 2023-10-18T12:20:59.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.096+0000 7ff71b287700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7140cdfa0 con 0x7ff71406e8a0 2023-10-18T12:20:59.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.096+0000 7ff719824700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff7140cb6d0 0x7ff71406f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:59.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.096+0000 7ff719023700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff714154040 0x7ff7140cc680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46654/0 (socket says 172.21.15.114:46654) 2023-10-18T12:20:59.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.096+0000 7ff719023700 1 -- 172.21.15.114:0/2717243077 learned_addr learned my addr 172.21.15.114:0/2717243077 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:59.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.096+0000 7ff718822700 1 --2- 172.21.15.114:0/2717243077 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff71406e8a0 0x7ff7140cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:59.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.096+0000 7ff719824700 1 -- 172.21.15.114:0/2717243077 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff71406e8a0 msgr2=0x7ff7140cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:59.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.096+0000 7ff719824700 1 --2- 172.21.15.114:0/2717243077 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff71406e8a0 0x7ff7140cb190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:59.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.096+0000 7ff719824700 1 -- 172.21.15.114:0/2717243077 >> v1:172.21.15.114:6789/0 conn(0x7ff714154040 legacy=0x7ff7140cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:59.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.096+0000 7ff719824700 1 -- 172.21.15.114:0/2717243077 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7140ce1b0 con 0x7ff7140cb6d0 2023-10-18T12:20:59.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.096+0000 7ff719824700 1 --2- 172.21.15.114:0/2717243077 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7140cb6d0 0x7ff71406f970 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff70c009d90 tx=0x7ff70c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cabc0678d1be9a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:59.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.096+0000 7ff70bfff700 1 -- 172.21.15.114:0/2717243077 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70c00e070 con 0x7ff7140cb6d0 2023-10-18T12:20:59.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.096+0000 7ff70bfff700 1 -- 172.21.15.114:0/2717243077 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff70c00bbd0 con 0x7ff7140cb6d0 2023-10-18T12:20:59.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.096+0000 7ff70bfff700 1 -- 172.21.15.114:0/2717243077 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70c012430 con 0x7ff7140cb6d0 2023-10-18T12:20:59.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.100+0000 7ff71b287700 1 -- 172.21.15.114:0/2717243077 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7140cb6d0 msgr2=0x7ff71406f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:59.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.100+0000 7ff71b287700 1 --2- 172.21.15.114:0/2717243077 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7140cb6d0 0x7ff71406f970 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff70c009d90 tx=0x7ff70c00b330 comp rx=0 tx=0).stop 2023-10-18T12:20:59.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.100+0000 7ff71b287700 1 -- 172.21.15.114:0/2717243077 shutdown_connections 2023-10-18T12:20:59.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.100+0000 7ff71b287700 1 --2- 172.21.15.114:0/2717243077 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7140cb6d0 0x7ff71406f970 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:59.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.100+0000 7ff71b287700 1 --2- 172.21.15.114:0/2717243077 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff71406e8a0 0x7ff7140cb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:59.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.100+0000 7ff71b287700 1 -- 172.21.15.114:0/2717243077 >> 172.21.15.114:0/2717243077 conn(0x7ff71406a340 msgr2=0x7ff7140b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:59.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.100+0000 7ff71b287700 1 -- 172.21.15.114:0/2717243077 shutdown_connections 2023-10-18T12:20:59.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.100+0000 7ff71b287700 1 -- 172.21.15.114:0/2717243077 wait complete. 2023-10-18T12:20:59.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.104+0000 7ff71b287700 1 Processor -- start 2023-10-18T12:20:59.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.104+0000 7ff71b287700 1 -- start start 2023-10-18T12:20:59.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.104+0000 7ff71b287700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff71406e8a0 0x7ff7140adee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:59.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.104+0000 7ff71b287700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff7140cb6d0 0x7ff71414efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:59.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.104+0000 7ff71b287700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff714154040 0x7ff71414f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:59.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.104+0000 7ff71b287700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7140ae710 con 0x7ff714154040 2023-10-18T12:20:59.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.104+0000 7ff71b287700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7140ae9f0 con 0x7ff71406e8a0 2023-10-18T12:20:59.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.104+0000 7ff71b287700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7140aecd0 con 0x7ff7140cb6d0 2023-10-18T12:20:59.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.104+0000 7ff719824700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff714154040 0x7ff71414f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:59.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.104+0000 7ff719824700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff714154040 0x7ff71414f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58712/0 (socket says 172.21.15.114:58712) 2023-10-18T12:20:59.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.104+0000 7ff719824700 1 -- 172.21.15.114:0/2362949209 learned_addr learned my addr 172.21.15.114:0/2362949209 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:59.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.104+0000 7ff719023700 1 --2- 172.21.15.114:0/2362949209 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff71406e8a0 0x7ff7140adee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:59.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.104+0000 7ff718822700 1 --2- 172.21.15.114:0/2362949209 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff7140cb6d0 0x7ff71414efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:59.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.104+0000 7ff719824700 1 -- 172.21.15.114:0/2362949209 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff7140cb6d0 msgr2=0x7ff71414efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:59.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.104+0000 7ff719824700 1 --2- 172.21.15.114:0/2362949209 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff7140cb6d0 0x7ff71414efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:59.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.104+0000 7ff719824700 1 -- 172.21.15.114:0/2362949209 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff71406e8a0 msgr2=0x7ff7140adee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:59.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.104+0000 7ff719824700 1 --2- 172.21.15.114:0/2362949209 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff71406e8a0 0x7ff7140adee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:59.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.104+0000 7ff719824700 1 -- 172.21.15.114:0/2362949209 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff70c009a70 con 0x7ff714154040 2023-10-18T12:20:59.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.104+0000 7ff719824700 1 --2- 172.21.15.114:0/2362949209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff714154040 0x7ff71414f510 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff70c014040 tx=0x7ff70c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:59.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.104+0000 7ff709ffb700 1 -- 172.21.15.114:0/2362949209 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70c012430 con 0x7ff714154040 2023-10-18T12:20:59.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.108+0000 7ff709ffb700 1 -- 172.21.15.114:0/2362949209 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff70c020070 con 0x7ff714154040 2023-10-18T12:20:59.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.108+0000 7ff71b287700 1 -- 172.21.15.114:0/2362949209 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7140aefb0 con 0x7ff714154040 2023-10-18T12:20:59.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.108+0000 7ff709ffb700 1 -- 172.21.15.114:0/2362949209 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70c004280 con 0x7ff714154040 2023-10-18T12:20:59.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.108+0000 7ff71b287700 1 -- 172.21.15.114:0/2362949209 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7140ae420 con 0x7ff714154040 2023-10-18T12:20:59.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.108+0000 7ff71b287700 1 -- 172.21.15.114:0/2362949209 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff714072e60 con 0x7ff714154040 2023-10-18T12:20:59.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.112+0000 7ff709ffb700 1 -- 172.21.15.114:0/2362949209 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff70c0043e0 con 0x7ff714154040 2023-10-18T12:20:59.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.112+0000 7ff709ffb700 1 --2- 172.21.15.114:0/2362949209 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff6f80656f0 0x7ff6f8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:59.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.112+0000 7ff709ffb700 1 -- 172.21.15.114:0/2362949209 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff70c022070 con 0x7ff714154040 2023-10-18T12:20:59.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.112+0000 7ff719023700 1 --2- 172.21.15.114:0/2362949209 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff6f80656f0 0x7ff6f8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:59.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.112+0000 7ff719023700 1 --2- 172.21.15.114:0/2362949209 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff6f80656f0 0x7ff6f8067bb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff710005930 tx=0x7ff710009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:59.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.116+0000 7ff709ffb700 1 -- 172.21.15.114:0/2362949209 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7ff70c0526c0 con 0x7ff714154040 2023-10-18T12:20:59.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.340+0000 7ff71b287700 1 -- 172.21.15.114:0/2362949209 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7140b1160 con 0x7ff714154040 2023-10-18T12:20:59.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.340+0000 7ff709ffb700 1 -- 172.21.15.114:0/2362949209 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4877 (secure 0 0 0) 0x7ff70c02c020 con 0x7ff714154040 2023-10-18T12:20:59.348 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:20:59.348 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/1054658298","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":1054658298},{"type":"v1","addr":"172.21.15.172:6835","nonce":1054658298}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2715800167","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2715800167},{"type":"v1","addr":"172.21.15.114:6833","nonce":2715800167}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/22518579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":22518579},{"type":"v1","addr":"172.21.15.114:6835","nonce":22518579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T12:19:39.077734+0000","modified":"2023-10-18T12:20:01.448709+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4303":{"gid":4303,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.172:6837/3028221887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":3028221887},{"type":"v1","addr":"172.21.15.172:6837","nonce":3028221887}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-18T12:20:59.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.344+0000 7ff71b287700 1 -- 172.21.15.114:0/2362949209 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff6f80656f0 msgr2=0x7ff6f8067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:59.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.344+0000 7ff71b287700 1 --2- 172.21.15.114:0/2362949209 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff6f80656f0 0x7ff6f8067bb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff710005930 tx=0x7ff710009040 comp rx=0 tx=0).stop 2023-10-18T12:20:59.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.344+0000 7ff71b287700 1 -- 172.21.15.114:0/2362949209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff714154040 msgr2=0x7ff71414f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:59.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.344+0000 7ff71b287700 1 --2- 172.21.15.114:0/2362949209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff714154040 0x7ff71414f510 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff70c014040 tx=0x7ff70c004af0 comp rx=0 tx=0).stop 2023-10-18T12:20:59.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.344+0000 7ff71b287700 1 -- 172.21.15.114:0/2362949209 shutdown_connections 2023-10-18T12:20:59.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.344+0000 7ff71b287700 1 --2- 172.21.15.114:0/2362949209 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff6f80656f0 0x7ff6f8067bb0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:59.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.344+0000 7ff71b287700 1 --2- 172.21.15.114:0/2362949209 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff7140cb6d0 0x7ff71414efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:59.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.344+0000 7ff71b287700 1 --2- 172.21.15.114:0/2362949209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff714154040 0x7ff71414f510 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:59.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.344+0000 7ff71b287700 1 --2- 172.21.15.114:0/2362949209 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff71406e8a0 0x7ff7140adee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:59.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.344+0000 7ff71b287700 1 -- 172.21.15.114:0/2362949209 >> 172.21.15.114:0/2362949209 conn(0x7ff71406a340 msgr2=0x7ff7140b34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:59.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.344+0000 7ff71b287700 1 -- 172.21.15.114:0/2362949209 shutdown_connections 2023-10-18T12:20:59.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.344+0000 7ff71b287700 1 -- 172.21.15.114:0/2362949209 wait complete. 2023-10-18T12:20:59.353 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 9 2023-10-18T12:20:59.373 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T12:20:59.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.536+0000 7fdc4d741700 1 Processor -- start 2023-10-18T12:20:59.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.536+0000 7fdc4d741700 1 -- start start 2023-10-18T12:20:59.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.536+0000 7fdc4d741700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fdc48160710 0x7fdc480b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:59.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.536+0000 7fdc4d741700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdc480b5ae0 0x7fdc4806db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:59.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.536+0000 7fdc4d741700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc4815d0d0 con 0x7fdc480d2e00 2023-10-18T12:20:59.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.536+0000 7fdc4d741700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc4815df90 con 0x7fdc480b5ae0 2023-10-18T12:20:59.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.536+0000 7fdc4d741700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc4806f0f0 con 0x7fdc48160710 2023-10-18T12:20:59.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.536+0000 7fdc47fff700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fdc480d2e00 0x7fdc480d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46660/0 (socket says 172.21.15.114:46660) 2023-10-18T12:20:59.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.536+0000 7fdc47fff700 1 -- 172.21.15.114:0/755380279 learned_addr learned my addr 172.21.15.114:0/755380279 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:59.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.540+0000 7fdc4cf40700 1 --2- 172.21.15.114:0/755380279 >> v2:172.21.15.114:3300/0 conn(0x7fdc480b5ae0 0x7fdc4806db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:59.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.540+0000 7fdc477fe700 1 --2- 172.21.15.114:0/755380279 >> v2:172.21.15.172:3300/0 conn(0x7fdc48160710 0x7fdc480b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:59.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.540+0000 7fdc4cf40700 1 -- 172.21.15.114:0/755380279 >> v2:172.21.15.172:3300/0 conn(0x7fdc48160710 msgr2=0x7fdc480b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:20:59.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.540+0000 7fdc4cf40700 1 --2- 172.21.15.114:0/755380279 >> v2:172.21.15.172:3300/0 conn(0x7fdc48160710 0x7fdc480b6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:59.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.540+0000 7fdc46ffd700 1 -- 172.21.15.114:0/755380279 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4272141013 0 0) 0x7fdc38001110 con 0x7fdc480d2e00 2023-10-18T12:20:59.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.540+0000 7fdc4cf40700 1 -- 172.21.15.114:0/755380279 >> v1:172.21.15.114:6789/0 conn(0x7fdc480d2e00 legacy=0x7fdc480d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:59.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.540+0000 7fdc4cf40700 1 -- 172.21.15.114:0/755380279 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc4815d310 con 0x7fdc480b5ae0 2023-10-18T12:20:59.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.540+0000 7fdc4cf40700 1 --2- 172.21.15.114:0/755380279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc480b5ae0 0x7fdc4806db60 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fdc480d2420 tx=0x7fdc4000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7f601d690111bfc server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:59.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.540+0000 7fdc46ffd700 1 -- 172.21.15.114:0/755380279 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4000e070 con 0x7fdc480b5ae0 2023-10-18T12:20:59.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.540+0000 7fdc46ffd700 1 -- 172.21.15.114:0/755380279 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4000bb20 con 0x7fdc480b5ae0 2023-10-18T12:20:59.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.540+0000 7fdc46ffd700 1 -- 172.21.15.114:0/755380279 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc40012430 con 0x7fdc480b5ae0 2023-10-18T12:20:59.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.540+0000 7fdc4d741700 1 -- 172.21.15.114:0/755380279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc480b5ae0 msgr2=0x7fdc4806db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:59.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.540+0000 7fdc4d741700 1 --2- 172.21.15.114:0/755380279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc480b5ae0 0x7fdc4806db60 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fdc480d2420 tx=0x7fdc4000b330 comp rx=0 tx=0).stop 2023-10-18T12:20:59.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.540+0000 7fdc4d741700 1 -- 172.21.15.114:0/755380279 shutdown_connections 2023-10-18T12:20:59.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.540+0000 7fdc4d741700 1 --2- 172.21.15.114:0/755380279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc480b5ae0 0x7fdc4806db60 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:59.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.540+0000 7fdc4d741700 1 --2- 172.21.15.114:0/755380279 >> v2:172.21.15.172:3300/0 conn(0x7fdc48160710 0x7fdc480b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:59.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.540+0000 7fdc4d741700 1 -- 172.21.15.114:0/755380279 >> 172.21.15.114:0/755380279 conn(0x7fdc48069f20 msgr2=0x7fdc4806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:59.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.540+0000 7fdc4d741700 1 -- 172.21.15.114:0/755380279 shutdown_connections 2023-10-18T12:20:59.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.540+0000 7fdc4d741700 1 -- 172.21.15.114:0/755380279 wait complete. 2023-10-18T12:20:59.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.544+0000 7fdc4d741700 1 Processor -- start 2023-10-18T12:20:59.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.544+0000 7fdc4d741700 1 -- start start 2023-10-18T12:20:59.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.544+0000 7fdc4d741700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdc480b5ae0 0x7fdc481576e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:59.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.544+0000 7fdc4d741700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc480d2e00 0x7fdc4815b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:59.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.544+0000 7fdc4d741700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc48160710 0x7fdc4815bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:59.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.544+0000 7fdc4d741700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc480ac680 con 0x7fdc480d2e00 2023-10-18T12:20:59.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.544+0000 7fdc4d741700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc480ac960 con 0x7fdc48160710 2023-10-18T12:20:59.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.544+0000 7fdc4d741700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc480acc40 con 0x7fdc480b5ae0 2023-10-18T12:20:59.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.544+0000 7fdc477fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc480d2e00 0x7fdc4815b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:59.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.544+0000 7fdc477fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc480d2e00 0x7fdc4815b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58728/0 (socket says 172.21.15.114:58728) 2023-10-18T12:20:59.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.544+0000 7fdc477fe700 1 -- 172.21.15.114:0/800859259 learned_addr learned my addr 172.21.15.114:0/800859259 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:59.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.544+0000 7fdc47fff700 1 --2- 172.21.15.114:0/800859259 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdc480b5ae0 0x7fdc481576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:59.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.544+0000 7fdc4cf40700 1 --2- 172.21.15.114:0/800859259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc48160710 0x7fdc4815bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:59.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.548+0000 7fdc477fe700 1 -- 172.21.15.114:0/800859259 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdc480b5ae0 msgr2=0x7fdc481576e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:59.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.548+0000 7fdc477fe700 1 --2- 172.21.15.114:0/800859259 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdc480b5ae0 0x7fdc481576e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:59.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.548+0000 7fdc477fe700 1 -- 172.21.15.114:0/800859259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc48160710 msgr2=0x7fdc4815bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:59.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.548+0000 7fdc477fe700 1 --2- 172.21.15.114:0/800859259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc48160710 0x7fdc4815bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:59.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.548+0000 7fdc477fe700 1 -- 172.21.15.114:0/800859259 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc40009a70 con 0x7fdc480d2e00 2023-10-18T12:20:59.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.548+0000 7fdc477fe700 1 --2- 172.21.15.114:0/800859259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc480d2e00 0x7fdc4815b700 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c00e9a0 tx=0x7fdc3c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:59.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.548+0000 7fdc44ff9700 1 -- 172.21.15.114:0/800859259 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c009720 con 0x7fdc480d2e00 2023-10-18T12:20:59.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.548+0000 7fdc44ff9700 1 -- 172.21.15.114:0/800859259 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc3c00c690 con 0x7fdc480d2e00 2023-10-18T12:20:59.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.548+0000 7fdc44ff9700 1 -- 172.21.15.114:0/800859259 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c00ca20 con 0x7fdc480d2e00 2023-10-18T12:20:59.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.548+0000 7fdc4d741700 1 -- 172.21.15.114:0/800859259 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc480acf20 con 0x7fdc480d2e00 2023-10-18T12:20:59.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.548+0000 7fdc4d741700 1 -- 172.21.15.114:0/800859259 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc480ab950 con 0x7fdc480d2e00 2023-10-18T12:20:59.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.548+0000 7fdc4d741700 1 -- 172.21.15.114:0/800859259 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc480ad570 con 0x7fdc480d2e00 2023-10-18T12:20:59.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.552+0000 7fdc44ff9700 1 -- 172.21.15.114:0/800859259 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fdc3c00cb80 con 0x7fdc480d2e00 2023-10-18T12:20:59.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.552+0000 7fdc44ff9700 1 --2- 172.21.15.114:0/800859259 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdc340656f0 0x7fdc34067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:59.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.552+0000 7fdc44ff9700 1 -- 172.21.15.114:0/800859259 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdc3c0831a0 con 0x7fdc480d2e00 2023-10-18T12:20:59.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.552+0000 7fdc47fff700 1 --2- 172.21.15.114:0/800859259 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdc340656f0 0x7fdc34067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:59.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.552+0000 7fdc47fff700 1 --2- 172.21.15.114:0/800859259 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdc340656f0 0x7fdc34067bb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fdc38000f60 tx=0x7fdc38007e90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:59.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.556+0000 7fdc44ff9700 1 -- 172.21.15.114:0/800859259 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fdc3c050890 con 0x7fdc480d2e00 2023-10-18T12:20:59.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.736+0000 7fdc4d741700 1 -- 172.21.15.114:0/800859259 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc48072e60 con 0x7fdc480d2e00 2023-10-18T12:20:59.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.736+0000 7fdc44ff9700 1 -- 172.21.15.114:0/800859259 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20240 (secure 0 0 0) 0x7fdc3c053eb0 con 0x7fdc480d2e00 2023-10-18T12:20:59.743 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:20:59.743 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":30,"fsid":"240ea340-5d3d-4f52-a4bc-af075aca3deb","created":"2023-10-18T12:19:12.512994+0000","modified":"2023-10-18T12:20:20.604528+0000","last_up_change":"2023-10-18T12:19:25.286009+0000","last_in_change":"2023-10-18T12:19:15.850693+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T12:19:27.040638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-18T12:19:32.358094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-18T12:19:37.333855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-18T12:19:38.055385+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-18T12:19:41.679218+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c3578978-1a03-4857-b9d2-34a5da3d7731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6817","nonce":1506287862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6820","nonce":1506287862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6830","nonce":1506287862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6825","nonce":1506287862}]},"public_addr":"172.21.15.114:6817/1506287862","cluster_addr":"172.21.15.114:6820/1506287862","heartbeat_back_addr":"172.21.15.114:6830/1506287862","heartbeat_front_addr":"172.21.15.114:6825/1506287862","state":["exists","up"]},{"osd":1,"uuid":"43eb26a6-e2b3-4670-9559-bd053b5140d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6801","nonce":3302727047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6803","nonce":3302727047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6807","nonce":3302727047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6805","nonce":3302727047}]},"public_addr":"172.21.15.114:6801/3302727047","cluster_addr":"172.21.15.114:6803/3302727047","heartbeat_back_addr":"172.21.15.114:6807/3302727047","heartbeat_front_addr":"172.21.15.114:6805/3302727047","state":["exists","up"]},{"osd":2,"uuid":"f3d4dbd5-521c-4dd2-b687-5768cc7d0938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6809","nonce":2699151351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6811","nonce":2699151351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6815","nonce":2699151351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6813","nonce":2699151351}]},"public_addr":"172.21.15.114:6809/2699151351","cluster_addr":"172.21.15.114:6811/2699151351","heartbeat_back_addr":"172.21.15.114:6815/2699151351","heartbeat_front_addr":"172.21.15.114:6813/2699151351","state":["exists","up"]},{"osd":3,"uuid":"823e5802-92b7-4f0d-b32d-a5748993f1b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6821","nonce":1361608073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6824","nonce":1361608073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6829","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6831","nonce":1361608073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6827","nonce":1361608073}]},"public_addr":"172.21.15.114:6821/1361608073","cluster_addr":"172.21.15.114:6824/1361608073","heartbeat_back_addr":"172.21.15.114:6831/1361608073","heartbeat_front_addr":"172.21.15.114:6827/1361608073","state":["exists","up"]},{"osd":4,"uuid":"e47fb93e-13b4-44a4-b084-8c4384ceb41e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6801","nonce":930839681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6803","nonce":930839681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6807","nonce":930839681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6805","nonce":930839681}]},"public_addr":"172.21.15.172:6801/930839681","cluster_addr":"172.21.15.172:6803/930839681","heartbeat_back_addr":"172.21.15.172:6807/930839681","heartbeat_front_addr":"172.21.15.172:6805/930839681","state":["exists","up"]},{"osd":5,"uuid":"7561a973-f479-45a0-af40-f324728d622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6814","nonce":571761850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6818","nonce":571761850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6824","nonce":571761850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6821","nonce":571761850}]},"public_addr":"172.21.15.172:6814/571761850","cluster_addr":"172.21.15.172:6818/571761850","heartbeat_back_addr":"172.21.15.172:6824/571761850","heartbeat_front_addr":"172.21.15.172:6821/571761850","state":["exists","up"]},{"osd":6,"uuid":"51753f4b-7f06-4f1c-9ec7-6e18a66eb980","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6825","nonce":1680398853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6827","nonce":1680398853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6831","nonce":1680398853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6829","nonce":1680398853}]},"public_addr":"172.21.15.172:6825/1680398853","cluster_addr":"172.21.15.172:6827/1680398853","heartbeat_back_addr":"172.21.15.172:6831/1680398853","heartbeat_front_addr":"172.21.15.172:6829/1680398853","state":["exists","up"]},{"osd":7,"uuid":"4d8b1e15-143d-4d17-9074-59d92f0f9af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6809","nonce":349710101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6811","nonce":349710101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6819","nonce":349710101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6815","nonce":349710101}]},"public_addr":"172.21.15.172:6809/349710101","cluster_addr":"172.21.15.172:6811/349710101","heartbeat_back_addr":"172.21.15.172:6819/349710101","heartbeat_front_addr":"172.21.15.172:6815/349710101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.889460+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.475494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.911473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.648596+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.609994+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.636248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.854589+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.885826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T12:20:59.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.740+0000 7fdc4d741700 1 -- 172.21.15.114:0/800859259 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdc340656f0 msgr2=0x7fdc34067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:59.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.740+0000 7fdc4d741700 1 --2- 172.21.15.114:0/800859259 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdc340656f0 0x7fdc34067bb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fdc38000f60 tx=0x7fdc38007e90 comp rx=0 tx=0).stop 2023-10-18T12:20:59.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.740+0000 7fdc4d741700 1 -- 172.21.15.114:0/800859259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc480d2e00 msgr2=0x7fdc4815b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:59.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.740+0000 7fdc4d741700 1 --2- 172.21.15.114:0/800859259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc480d2e00 0x7fdc4815b700 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c00e9a0 tx=0x7fdc3c00ecb0 comp rx=0 tx=0).stop 2023-10-18T12:20:59.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.740+0000 7fdc4d741700 1 -- 172.21.15.114:0/800859259 shutdown_connections 2023-10-18T12:20:59.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.740+0000 7fdc4d741700 1 --2- 172.21.15.114:0/800859259 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdc340656f0 0x7fdc34067bb0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:59.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.740+0000 7fdc4d741700 1 --2- 172.21.15.114:0/800859259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc48160710 0x7fdc4815bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:59.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.740+0000 7fdc4d741700 1 --2- 172.21.15.114:0/800859259 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc480d2e00 0x7fdc4815b700 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:59.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.740+0000 7fdc4d741700 1 --2- 172.21.15.114:0/800859259 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdc480b5ae0 0x7fdc481576e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:59.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.740+0000 7fdc4d741700 1 -- 172.21.15.114:0/800859259 >> 172.21.15.114:0/800859259 conn(0x7fdc48069f20 msgr2=0x7fdc480b2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:59.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.740+0000 7fdc4d741700 1 -- 172.21.15.114:0/800859259 shutdown_connections 2023-10-18T12:20:59.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.740+0000 7fdc4d741700 1 -- 172.21.15.114:0/800859259 wait complete. 2023-10-18T12:20:59.769 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-18T12:20:59.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.932+0000 7f14bb3e8700 1 Processor -- start 2023-10-18T12:20:59.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.936+0000 7f14bb3e8700 1 -- start start 2023-10-18T12:20:59.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.936+0000 7f14bb3e8700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f14b40adb60 0x7f14b40cb190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:59.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.936+0000 7f14bb3e8700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14b4165770 con 0x7f14b40cb6d0 2023-10-18T12:20:59.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.940+0000 7f14bb3e8700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14b40cbb00 con 0x7f14b4161230 2023-10-18T12:20:59.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.940+0000 7f14bb3e8700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14b406ea40 con 0x7f14b40adb60 2023-10-18T12:20:59.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.940+0000 7f14b9985700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f14b40cb6d0 0x7f14b40cc9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46668/0 (socket says 172.21.15.114:46668) 2023-10-18T12:20:59.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.940+0000 7f14b9985700 1 -- 172.21.15.114:0/2532003749 learned_addr learned my addr 172.21.15.114:0/2532003749 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:20:59.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.940+0000 7f14b8983700 1 --2- 172.21.15.114:0/2532003749 >> v2:172.21.15.114:3300/0 conn(0x7f14b40adb60 0x7f14b40cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:59.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.940+0000 7f14abfff700 1 -- 172.21.15.114:0/2532003749 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1396387085 0 0) 0x7f14b4165770 con 0x7f14b40cb6d0 2023-10-18T12:20:59.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.940+0000 7f14abfff700 1 -- 172.21.15.114:0/2532003749 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14a00035d0 con 0x7f14b40cb6d0 2023-10-18T12:20:59.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.940+0000 7f14abfff700 1 -- 172.21.15.114:0/2532003749 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 549079760 0 0) 0x7f14b40cbb00 con 0x7f14b4161230 2023-10-18T12:20:59.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.940+0000 7f14b8983700 1 -- 172.21.15.114:0/2532003749 >> v1:172.21.15.172:6789/0 conn(0x7f14b4161230 legacy=0x7f14b406ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:59.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.940+0000 7f14b8983700 1 -- 172.21.15.114:0/2532003749 >> v1:172.21.15.114:6789/0 conn(0x7f14b40cb6d0 legacy=0x7f14b40cc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:59.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.940+0000 7f14b8983700 1 -- 172.21.15.114:0/2532003749 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b4161610 con 0x7f14b40adb60 2023-10-18T12:20:59.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.940+0000 7f14b8983700 1 --2- 172.21.15.114:0/2532003749 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14b40adb60 0x7f14b40cb190 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f14a4009850 tx=0x7f14a4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58271bb77e7e4a90 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:59.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.940+0000 7f14abfff700 1 -- 172.21.15.114:0/2532003749 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a4011830 con 0x7f14b40adb60 2023-10-18T12:20:59.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.940+0000 7f14abfff700 1 -- 172.21.15.114:0/2532003749 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a4011990 con 0x7f14b40adb60 2023-10-18T12:20:59.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.940+0000 7f14abfff700 1 -- 172.21.15.114:0/2532003749 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a4011d40 con 0x7f14b40adb60 2023-10-18T12:20:59.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.940+0000 7f14bb3e8700 1 -- 172.21.15.114:0/2532003749 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14b40adb60 msgr2=0x7f14b40cb190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:59.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.940+0000 7f14bb3e8700 1 --2- 172.21.15.114:0/2532003749 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14b40adb60 0x7f14b40cb190 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f14a4009850 tx=0x7f14a4009b60 comp rx=0 tx=0).stop 2023-10-18T12:20:59.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.940+0000 7f14bb3e8700 1 -- 172.21.15.114:0/2532003749 shutdown_connections 2023-10-18T12:20:59.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.940+0000 7f14bb3e8700 1 --2- 172.21.15.114:0/2532003749 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14b40adb60 0x7f14b40cb190 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:59.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.940+0000 7f14bb3e8700 1 -- 172.21.15.114:0/2532003749 >> 172.21.15.114:0/2532003749 conn(0x7f14b406a340 msgr2=0x7f14b40b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:20:59.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.944+0000 7f14bb3e8700 1 -- 172.21.15.114:0/2532003749 shutdown_connections 2023-10-18T12:20:59.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.944+0000 7f14bb3e8700 1 -- 172.21.15.114:0/2532003749 wait complete. 2023-10-18T12:20:59.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.944+0000 7f14bb3e8700 1 Processor -- start 2023-10-18T12:20:59.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.944+0000 7f14bb3e8700 1 -- start start 2023-10-18T12:20:59.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.948+0000 7f14bb3e8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14b40adb60 0x7f14b4158c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:59.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.948+0000 7f14bb3e8700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14b40cb6d0 0x7f14b4161800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:59.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.948+0000 7f14bb3e8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14b4161230 0x7f14b415d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:59.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.948+0000 7f14bb3e8700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b41646a0 con 0x7f14b40cb6d0 2023-10-18T12:20:59.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.948+0000 7f14bb3e8700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b4161d40 con 0x7f14b40adb60 2023-10-18T12:20:59.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.948+0000 7f14bb3e8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b4161f70 con 0x7f14b4161230 2023-10-18T12:20:59.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.948+0000 7f14b8983700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14b40cb6d0 0x7f14b4161800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:59.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.948+0000 7f14b8983700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14b40cb6d0 0x7f14b4161800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58742/0 (socket says 172.21.15.114:58742) 2023-10-18T12:20:59.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.948+0000 7f14b8983700 1 -- 172.21.15.114:0/2685468028 learned_addr learned my addr 172.21.15.114:0/2685468028 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:20:59.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.948+0000 7f14b9184700 1 --2- 172.21.15.114:0/2685468028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14b40adb60 0x7f14b4158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:59.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.948+0000 7f14b9985700 1 --2- 172.21.15.114:0/2685468028 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14b4161230 0x7f14b415d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:59.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.948+0000 7f14b8983700 1 -- 172.21.15.114:0/2685468028 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14b4161230 msgr2=0x7f14b415d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:59.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.948+0000 7f14b8983700 1 --2- 172.21.15.114:0/2685468028 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14b4161230 0x7f14b415d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:59.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.948+0000 7f14b8983700 1 -- 172.21.15.114:0/2685468028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14b40adb60 msgr2=0x7f14b4158c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:20:59.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.948+0000 7f14b8983700 1 --2- 172.21.15.114:0/2685468028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14b40adb60 0x7f14b4158c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:20:59.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.948+0000 7f14b8983700 1 -- 172.21.15.114:0/2685468028 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a40094b0 con 0x7f14b40cb6d0 2023-10-18T12:20:59.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.948+0000 7f14b9184700 1 --2- 172.21.15.114:0/2685468028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14b40adb60 0x7f14b4158c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:20:59.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.948+0000 7f14b8983700 1 --2- 172.21.15.114:0/2685468028 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14b40cb6d0 0x7f14b4161800 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f14a40090b0 tx=0x7f14a4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:59.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.948+0000 7f14a9ffb700 1 -- 172.21.15.114:0/2685468028 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a4019b60 con 0x7f14b40cb6d0 2023-10-18T12:20:59.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.948+0000 7f14a9ffb700 1 -- 172.21.15.114:0/2685468028 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a401e070 con 0x7f14b40cb6d0 2023-10-18T12:20:59.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.948+0000 7f14bb3e8700 1 -- 172.21.15.114:0/2685468028 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14b41f6890 con 0x7f14b40cb6d0 2023-10-18T12:20:59.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.948+0000 7f14a9ffb700 1 -- 172.21.15.114:0/2685468028 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a401a420 con 0x7f14b40cb6d0 2023-10-18T12:20:59.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.948+0000 7f14bb3e8700 1 -- 172.21.15.114:0/2685468028 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b41f6e50 con 0x7f14b40cb6d0 2023-10-18T12:20:59.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.952+0000 7f14bb3e8700 1 -- 172.21.15.114:0/2685468028 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14b4072e60 con 0x7f14b40cb6d0 2023-10-18T12:20:59.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.952+0000 7f14a9ffb700 1 -- 172.21.15.114:0/2685468028 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f14a401a580 con 0x7f14b40cb6d0 2023-10-18T12:20:59.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.956+0000 7f14a9ffb700 1 --2- 172.21.15.114:0/2685468028 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f14980656f0 0x7f1498067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:20:59.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.956+0000 7f14a9ffb700 1 -- 172.21.15.114:0/2685468028 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f14a4084130 con 0x7f14b40cb6d0 2023-10-18T12:20:59.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.956+0000 7f14b9184700 1 --2- 172.21.15.114:0/2685468028 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f14980656f0 0x7f1498067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:20:59.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.956+0000 7f14b9184700 1 --2- 172.21.15.114:0/2685468028 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f14980656f0 0x7f1498067bb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f14b0000f60 tx=0x7f14b0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:20:59.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:20:59.960+0000 7f14a9ffb700 1 -- 172.21.15.114:0/2685468028 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f14a4051950 con 0x7f14b40cb6d0 2023-10-18T12:21:00.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.444+0000 7f14bb3e8700 1 -- 172.21.15.114:0/2685468028 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f14b40b1130 con 0x7f14b40cb6d0 2023-10-18T12:21:00.449 INFO:tasks.ceph.mon.a.smithi114.stderr:2023-10-18T12:21:00.444+0000 7f4626df4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T12:21:00.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.452+0000 7f14a9ffb700 1 -- 172.21.15.114:0/2685468028 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f14a4054f70 con 0x7f14b40cb6d0 2023-10-18T12:21:00.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.456+0000 7f14bb3e8700 1 -- 172.21.15.114:0/2685468028 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f14980656f0 msgr2=0x7f1498067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:00.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.456+0000 7f14bb3e8700 1 --2- 172.21.15.114:0/2685468028 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f14980656f0 0x7f1498067bb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f14b0000f60 tx=0x7f14b0009040 comp rx=0 tx=0).stop 2023-10-18T12:21:00.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.456+0000 7f14bb3e8700 1 -- 172.21.15.114:0/2685468028 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14b40cb6d0 msgr2=0x7f14b4161800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:00.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.456+0000 7f14bb3e8700 1 --2- 172.21.15.114:0/2685468028 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14b40cb6d0 0x7f14b4161800 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f14a40090b0 tx=0x7f14a4004770 comp rx=0 tx=0).stop 2023-10-18T12:21:00.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.456+0000 7f14bb3e8700 1 -- 172.21.15.114:0/2685468028 shutdown_connections 2023-10-18T12:21:00.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.456+0000 7f14bb3e8700 1 --2- 172.21.15.114:0/2685468028 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f14980656f0 0x7f1498067bb0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:00.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.456+0000 7f14bb3e8700 1 --2- 172.21.15.114:0/2685468028 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f14b4161230 0x7f14b415d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:00.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.456+0000 7f14bb3e8700 1 --2- 172.21.15.114:0/2685468028 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14b40cb6d0 0x7f14b4161800 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:00.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.456+0000 7f14bb3e8700 1 --2- 172.21.15.114:0/2685468028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14b40adb60 0x7f14b4158c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:00.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.456+0000 7f14bb3e8700 1 -- 172.21.15.114:0/2685468028 >> 172.21.15.114:0/2685468028 conn(0x7f14b406a340 msgr2=0x7f14b4159b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:00.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.460+0000 7f14bb3e8700 1 -- 172.21.15.114:0/2685468028 shutdown_connections 2023-10-18T12:21:00.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.460+0000 7f14bb3e8700 1 -- 172.21.15.114:0/2685468028 wait complete. 2023-10-18T12:21:00.467 INFO:teuthology.orchestra.run.smithi114.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-18T12:21:00.472 INFO:tasks.ceph.mds.b.smithi172.stderr: -5755> 2023-10-18T12:19:44.700+0000 7f26b49b5700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-18T12:21:00.483 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-18T12:21:00.542 INFO:tasks.ceph.mds.b.smithi172.stdout:starting mds.b at 2023-10-18T12:21:00.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.660+0000 7f4869411700 1 Processor -- start 2023-10-18T12:21:00.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.660+0000 7f4869411700 1 -- start start 2023-10-18T12:21:00.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.664+0000 7f4869411700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48640d2e00 0x7f48640b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:00.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.664+0000 7f4869411700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f486415d0d0 con 0x7f48640b5ae0 2023-10-18T12:21:00.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.664+0000 7f4869411700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f486406f0f0 con 0x7f4864160710 2023-10-18T12:21:00.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.664+0000 7f4869411700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f486415df90 con 0x7f48640d2e00 2023-10-18T12:21:00.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.664+0000 7f48637fe700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f48640b5ae0 0x7f486406db60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46680/0 (socket says 172.21.15.114:46680) 2023-10-18T12:21:00.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.664+0000 7f48637fe700 1 -- 172.21.15.114:0/2079454860 learned_addr learned my addr 172.21.15.114:0/2079454860 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:21:00.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.664+0000 7f4862ffd700 1 --2- 172.21.15.114:0/2079454860 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48640d2e00 0x7f48640b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:00.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.664+0000 7f4861ffb700 1 -- 172.21.15.114:0/2079454860 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1548468305 0 0) 0x7f485c0014e0 con 0x7f48640b5ae0 2023-10-18T12:21:00.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.664+0000 7f4861ffb700 1 -- 172.21.15.114:0/2079454860 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f484c0035d0 con 0x7f48640b5ae0 2023-10-18T12:21:00.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.664+0000 7f4862ffd700 1 -- 172.21.15.114:0/2079454860 >> v1:172.21.15.172:6789/0 conn(0x7f4864160710 legacy=0x7f48640d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:00.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.664+0000 7f4862ffd700 1 -- 172.21.15.114:0/2079454860 >> v1:172.21.15.114:6789/0 conn(0x7f48640b5ae0 legacy=0x7f486406db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:00.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.664+0000 7f4862ffd700 1 -- 172.21.15.114:0/2079454860 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f486415d310 con 0x7f48640d2e00 2023-10-18T12:21:00.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.664+0000 7f4862ffd700 1 --2- 172.21.15.114:0/2079454860 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48640d2e00 0x7f48640b6e00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f48540098b0 tx=0x7f4854009bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=497ff04a36f2a561 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:00.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.664+0000 7f4861ffb700 1 -- 172.21.15.114:0/2079454860 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4854011830 con 0x7f48640d2e00 2023-10-18T12:21:00.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.664+0000 7f4861ffb700 1 -- 172.21.15.114:0/2079454860 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4854011990 con 0x7f48640d2e00 2023-10-18T12:21:00.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.664+0000 7f4861ffb700 1 -- 172.21.15.114:0/2079454860 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4854011d20 con 0x7f48640d2e00 2023-10-18T12:21:00.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.668+0000 7f4869411700 1 -- 172.21.15.114:0/2079454860 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48640d2e00 msgr2=0x7f48640b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:00.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.668+0000 7f4869411700 1 --2- 172.21.15.114:0/2079454860 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48640d2e00 0x7f48640b6e00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f48540098b0 tx=0x7f4854009bc0 comp rx=0 tx=0).stop 2023-10-18T12:21:00.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.668+0000 7f4869411700 1 -- 172.21.15.114:0/2079454860 shutdown_connections 2023-10-18T12:21:00.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.668+0000 7f4869411700 1 --2- 172.21.15.114:0/2079454860 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48640d2e00 0x7f48640b6e00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:00.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.668+0000 7f4869411700 1 -- 172.21.15.114:0/2079454860 >> 172.21.15.114:0/2079454860 conn(0x7f4864069f20 msgr2=0x7f486406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:00.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.668+0000 7f4869411700 1 -- 172.21.15.114:0/2079454860 shutdown_connections 2023-10-18T12:21:00.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.668+0000 7f4869411700 1 -- 172.21.15.114:0/2079454860 wait complete. 2023-10-18T12:21:00.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.672+0000 7f4869411700 1 Processor -- start 2023-10-18T12:21:00.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.672+0000 7f4869411700 1 -- start start 2023-10-18T12:21:00.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.672+0000 7f4869411700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48640b5ae0 0x7f486415f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:00.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.672+0000 7f4869411700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48640d2e00 0x7f4864156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:00.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.672+0000 7f4869411700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4864160710 0x7f48641570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:00.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.672+0000 7f4869411700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4864158780 con 0x7f4864160710 2023-10-18T12:21:00.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.672+0000 7f4869411700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48641589d0 con 0x7f48640b5ae0 2023-10-18T12:21:00.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.672+0000 7f4869411700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4864158cb0 con 0x7f48640d2e00 2023-10-18T12:21:00.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.672+0000 7f48637fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4864160710 0x7f48641570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:00.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.672+0000 7f48637fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4864160710 0x7f48641570b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58754/0 (socket says 172.21.15.114:58754) 2023-10-18T12:21:00.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.672+0000 7f48637fe700 1 -- 172.21.15.114:0/2605996636 learned_addr learned my addr 172.21.15.114:0/2605996636 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:00.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.672+0000 7f48627fc700 1 --2- 172.21.15.114:0/2605996636 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48640d2e00 0x7f4864156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:00.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.672+0000 7f4862ffd700 1 --2- 172.21.15.114:0/2605996636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48640b5ae0 0x7f486415f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:00.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.672+0000 7f48637fe700 1 -- 172.21.15.114:0/2605996636 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48640d2e00 msgr2=0x7f4864156b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:00.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.672+0000 7f48637fe700 1 --2- 172.21.15.114:0/2605996636 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48640d2e00 0x7f4864156b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:00.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.672+0000 7f48637fe700 1 -- 172.21.15.114:0/2605996636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48640b5ae0 msgr2=0x7f486415f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:00.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.672+0000 7f48637fe700 1 --2- 172.21.15.114:0/2605996636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48640b5ae0 0x7f486415f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:00.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.672+0000 7f48637fe700 1 -- 172.21.15.114:0/2605996636 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48540094b0 con 0x7f4864160710 2023-10-18T12:21:00.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.672+0000 7f48637fe700 1 --2- 172.21.15.114:0/2605996636 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4864160710 0x7f48641570b0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f485c002280 tx=0x7f485c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:00.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.676+0000 7f484b7fe700 1 -- 172.21.15.114:0/2605996636 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485c00a9e0 con 0x7f4864160710 2023-10-18T12:21:00.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.676+0000 7f484b7fe700 1 -- 172.21.15.114:0/2605996636 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485c00ab40 con 0x7f4864160710 2023-10-18T12:21:00.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.676+0000 7f484b7fe700 1 -- 172.21.15.114:0/2605996636 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485c012400 con 0x7f4864160710 2023-10-18T12:21:00.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.676+0000 7f4869411700 1 -- 172.21.15.114:0/2605996636 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4864158f90 con 0x7f4864160710 2023-10-18T12:21:00.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.676+0000 7f4869411700 1 -- 172.21.15.114:0/2605996636 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4864159550 con 0x7f4864160710 2023-10-18T12:21:00.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.676+0000 7f4869411700 1 -- 172.21.15.114:0/2605996636 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4864159770 con 0x7f4864160710 2023-10-18T12:21:00.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.680+0000 7f484b7fe700 1 -- 172.21.15.114:0/2605996636 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f485c005d50 con 0x7f4864160710 2023-10-18T12:21:00.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.680+0000 7f484b7fe700 1 --2- 172.21.15.114:0/2605996636 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f48500656f0 0x7f4850067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:00.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.680+0000 7f484b7fe700 1 -- 172.21.15.114:0/2605996636 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6957+0+0 (secure 0 0 0) 0x7f485c082820 con 0x7f4864160710 2023-10-18T12:21:00.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.680+0000 7f4862ffd700 1 --2- 172.21.15.114:0/2605996636 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f48500656f0 0x7f4850067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:00.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.680+0000 7f4862ffd700 1 --2- 172.21.15.114:0/2605996636 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f48500656f0 0x7f4850067bb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f48540090b0 tx=0x7f4854008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:00.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:00.684+0000 7f484b7fe700 1 -- 172.21.15.114:0/2605996636 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f485c04ff60 con 0x7f4864160710 2023-10-18T12:21:01.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.216+0000 7f4869411700 1 -- 172.21.15.114:0/2605996636 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f486415d0d0 con 0x7f4864160710 2023-10-18T12:21:01.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.540+0000 7f484b7fe700 1 -- 172.21.15.114:0/2605996636 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f486415d0d0 con 0x7f4864160710 2023-10-18T12:21:01.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.544+0000 7f4869411700 1 -- 172.21.15.114:0/2605996636 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f48500656f0 msgr2=0x7f4850067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:01.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.544+0000 7f4869411700 1 --2- 172.21.15.114:0/2605996636 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f48500656f0 0x7f4850067bb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f48540090b0 tx=0x7f4854008030 comp rx=0 tx=0).stop 2023-10-18T12:21:01.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.544+0000 7f4869411700 1 -- 172.21.15.114:0/2605996636 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4864160710 msgr2=0x7f48641570b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:01.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.544+0000 7f4869411700 1 --2- 172.21.15.114:0/2605996636 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4864160710 0x7f48641570b0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f485c002280 tx=0x7f485c00cd50 comp rx=0 tx=0).stop 2023-10-18T12:21:01.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.544+0000 7f4869411700 1 -- 172.21.15.114:0/2605996636 shutdown_connections 2023-10-18T12:21:01.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.544+0000 7f4869411700 1 --2- 172.21.15.114:0/2605996636 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f48500656f0 0x7f4850067bb0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:01.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.544+0000 7f4869411700 1 --2- 172.21.15.114:0/2605996636 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f48640d2e00 0x7f4864156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:01.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.544+0000 7f4869411700 1 --2- 172.21.15.114:0/2605996636 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4864160710 0x7f48641570b0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:01.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.544+0000 7f4869411700 1 --2- 172.21.15.114:0/2605996636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48640b5ae0 0x7f486415f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:01.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.544+0000 7f4869411700 1 -- 172.21.15.114:0/2605996636 >> 172.21.15.114:0/2605996636 conn(0x7f4864069f20 msgr2=0x7f48640b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:01.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.544+0000 7f4869411700 1 -- 172.21.15.114:0/2605996636 shutdown_connections 2023-10-18T12:21:01.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.544+0000 7f4869411700 1 -- 172.21.15.114:0/2605996636 wait complete. 2023-10-18T12:21:01.572 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-18T12:21:01.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.752+0000 7fbf96b70700 1 Processor -- start 2023-10-18T12:21:01.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.756+0000 7fbf96b70700 1 -- start start 2023-10-18T12:21:01.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.756+0000 7fbf96b70700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf900b4990 0x7fbf900b27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:01.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.756+0000 7fbf96b70700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf90070700 con 0x7fbf900610a0 2023-10-18T12:21:01.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.756+0000 7fbf96b70700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf9006e4e0 con 0x7fbf90069d10 2023-10-18T12:21:01.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.756+0000 7fbf96b70700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf900ca060 con 0x7fbf900b4990 2023-10-18T12:21:01.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.756+0000 7fbf8ffff700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fbf900610a0 0x7fbf900b2090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46686/0 (socket says 172.21.15.114:46686) 2023-10-18T12:21:01.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.756+0000 7fbf8ffff700 1 -- 172.21.15.114:0/38399316 learned_addr learned my addr 172.21.15.114:0/38399316 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:21:01.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.760+0000 7fbf9510d700 1 --2- 172.21.15.114:0/38399316 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf900b4990 0x7fbf900b27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:01.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.760+0000 7fbf8f7fe700 1 -- 172.21.15.114:0/38399316 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2416255949 0 0) 0x7fbf90070700 con 0x7fbf900610a0 2023-10-18T12:21:01.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.760+0000 7fbf8f7fe700 1 -- 172.21.15.114:0/38399316 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf800035d0 con 0x7fbf900610a0 2023-10-18T12:21:01.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.760+0000 7fbf9510d700 1 -- 172.21.15.114:0/38399316 >> v1:172.21.15.172:6789/0 conn(0x7fbf90069d10 legacy=0x7fbf9006a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:01.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.760+0000 7fbf9510d700 1 -- 172.21.15.114:0/38399316 >> v1:172.21.15.114:6789/0 conn(0x7fbf900610a0 legacy=0x7fbf900b2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:01.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.760+0000 7fbf9510d700 1 -- 172.21.15.114:0/38399316 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf900ca270 con 0x7fbf900b4990 2023-10-18T12:21:01.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.760+0000 7fbf9510d700 1 --2- 172.21.15.114:0/38399316 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf900b4990 0x7fbf900b27a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbf88009dc0 tx=0x7fbf8800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51462049e0cc8d5b server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:01.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.760+0000 7fbf8f7fe700 1 -- 172.21.15.114:0/38399316 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8800e070 con 0x7fbf900b4990 2023-10-18T12:21:01.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.760+0000 7fbf8f7fe700 1 -- 172.21.15.114:0/38399316 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf8800bb20 con 0x7fbf900b4990 2023-10-18T12:21:01.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.760+0000 7fbf8f7fe700 1 -- 172.21.15.114:0/38399316 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf88012430 con 0x7fbf900b4990 2023-10-18T12:21:01.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.760+0000 7fbf96b70700 1 -- 172.21.15.114:0/38399316 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf900b4990 msgr2=0x7fbf900b27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:01.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.760+0000 7fbf96b70700 1 --2- 172.21.15.114:0/38399316 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf900b4990 0x7fbf900b27a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbf88009dc0 tx=0x7fbf8800b330 comp rx=0 tx=0).stop 2023-10-18T12:21:01.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.760+0000 7fbf96b70700 1 -- 172.21.15.114:0/38399316 shutdown_connections 2023-10-18T12:21:01.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.760+0000 7fbf96b70700 1 --2- 172.21.15.114:0/38399316 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf900b4990 0x7fbf900b27a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:01.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.760+0000 7fbf96b70700 1 -- 172.21.15.114:0/38399316 >> 172.21.15.114:0/38399316 conn(0x7fbf900cbb10 msgr2=0x7fbf900cbef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:01.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.760+0000 7fbf96b70700 1 -- 172.21.15.114:0/38399316 shutdown_connections 2023-10-18T12:21:01.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.760+0000 7fbf96b70700 1 -- 172.21.15.114:0/38399316 wait complete. 2023-10-18T12:21:01.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.764+0000 7fbf96b70700 1 Processor -- start 2023-10-18T12:21:01.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.764+0000 7fbf96b70700 1 -- start start 2023-10-18T12:21:01.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.764+0000 7fbf96b70700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf900610a0 0x7fbf901f2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:01.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.764+0000 7fbf96b70700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf90069d10 0x7fbf900c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:01.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.764+0000 7fbf96b70700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf900b4990 0x7fbf9015d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:01.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.764+0000 7fbf96b70700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf901f32a0 con 0x7fbf900b4990 2023-10-18T12:21:01.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.764+0000 7fbf96b70700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf900adc90 con 0x7fbf90069d10 2023-10-18T12:21:01.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.764+0000 7fbf96b70700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9015c440 con 0x7fbf900610a0 2023-10-18T12:21:01.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.764+0000 7fbf9510d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf900b4990 0x7fbf9015d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:01.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.764+0000 7fbf9490c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf900610a0 0x7fbf901f2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:01.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.764+0000 7fbf8ffff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf90069d10 0x7fbf900c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:01.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.764+0000 7fbf9490c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf900610a0 0x7fbf901f2d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.114:53858/0 (socket says 172.21.15.114:53858) 2023-10-18T12:21:01.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.764+0000 7fbf9490c700 1 -- 172.21.15.114:0/3828197935 learned_addr learned my addr 172.21.15.114:0/3828197935 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:01.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.768+0000 7fbf9490c700 1 -- 172.21.15.114:0/3828197935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf90069d10 msgr2=0x7fbf900c8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:01.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.768+0000 7fbf9490c700 1 --2- 172.21.15.114:0/3828197935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf90069d10 0x7fbf900c8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:01.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.768+0000 7fbf9490c700 1 -- 172.21.15.114:0/3828197935 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf900b4990 msgr2=0x7fbf9015d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:01.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.768+0000 7fbf9490c700 1 --2- 172.21.15.114:0/3828197935 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf900b4990 0x7fbf9015d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:01.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.768+0000 7fbf9490c700 1 -- 172.21.15.114:0/3828197935 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf88009a70 con 0x7fbf900610a0 2023-10-18T12:21:01.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.768+0000 7fbf9510d700 1 --2- 172.21.15.114:0/3828197935 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf900b4990 0x7fbf9015d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:21:01.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.768+0000 7fbf9490c700 1 --2- 172.21.15.114:0/3828197935 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf900610a0 0x7fbf901f2d60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbf8400c500 tx=0x7fbf8400c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:01.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.768+0000 7fbf8d7fa700 1 -- 172.21.15.114:0/3828197935 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf840052d0 con 0x7fbf900610a0 2023-10-18T12:21:01.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.768+0000 7fbf8d7fa700 1 -- 172.21.15.114:0/3828197935 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf84005430 con 0x7fbf900610a0 2023-10-18T12:21:01.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.768+0000 7fbf96b70700 1 -- 172.21.15.114:0/3828197935 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf9015b3a0 con 0x7fbf900610a0 2023-10-18T12:21:01.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.768+0000 7fbf8d7fa700 1 -- 172.21.15.114:0/3828197935 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf840055a0 con 0x7fbf900610a0 2023-10-18T12:21:01.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.768+0000 7fbf96b70700 1 -- 172.21.15.114:0/3828197935 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf9015b960 con 0x7fbf900610a0 2023-10-18T12:21:01.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.768+0000 7fbf96b70700 1 -- 172.21.15.114:0/3828197935 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf90073f00 con 0x7fbf900610a0 2023-10-18T12:21:01.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.772+0000 7fbf8d7fa700 1 -- 172.21.15.114:0/3828197935 <== mon.2 v2:172.21.15.172:3301/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fbf840038e0 con 0x7fbf900610a0 2023-10-18T12:21:01.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.772+0000 7fbf8d7fa700 1 --2- 172.21.15.114:0/3828197935 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fbf740656f0 0x7fbf74067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:01.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.772+0000 7fbf8d7fa700 1 -- 172.21.15.114:0/3828197935 <== mon.2 v2:172.21.15.172:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6957+0+0 (secure 0 0 0) 0x7fbf840827f0 con 0x7fbf900610a0 2023-10-18T12:21:01.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.772+0000 7fbf8ffff700 1 --2- 172.21.15.114:0/3828197935 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fbf740656f0 0x7fbf74067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:01.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.776+0000 7fbf8ffff700 1 --2- 172.21.15.114:0/3828197935 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fbf740656f0 0x7fbf74067bb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c007fd0 tx=0x7fbf7c007de0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:01.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.780+0000 7fbf8d7fa700 1 -- 172.21.15.114:0/3828197935 <== mon.2 v2:172.21.15.172:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fbf8404ff10 con 0x7fbf900610a0 2023-10-18T12:21:01.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:01.960+0000 7fbf96b70700 1 -- 172.21.15.114:0/3828197935 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbf900cabb0 con 0x7fbf900610a0 2023-10-18T12:21:02.170 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:21:02.178 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:21:02.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.556+0000 7fbf8d7fa700 1 -- 172.21.15.114:0/3828197935 <== mon.2 v2:172.21.15.172:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v32) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbf84053530 con 0x7fbf900610a0 2023-10-18T12:21:02.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.560+0000 7fbf96b70700 1 -- 172.21.15.114:0/3828197935 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fbf740656f0 msgr2=0x7fbf74067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:02.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.560+0000 7fbf96b70700 1 --2- 172.21.15.114:0/3828197935 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fbf740656f0 0x7fbf74067bb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c007fd0 tx=0x7fbf7c007de0 comp rx=0 tx=0).stop 2023-10-18T12:21:02.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.560+0000 7fbf96b70700 1 -- 172.21.15.114:0/3828197935 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf900610a0 msgr2=0x7fbf901f2d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:02.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.560+0000 7fbf96b70700 1 --2- 172.21.15.114:0/3828197935 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf900610a0 0x7fbf901f2d60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbf8400c500 tx=0x7fbf8400c810 comp rx=0 tx=0).stop 2023-10-18T12:21:02.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.564+0000 7fbf96b70700 1 -- 172.21.15.114:0/3828197935 shutdown_connections 2023-10-18T12:21:02.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.564+0000 7fbf96b70700 1 --2- 172.21.15.114:0/3828197935 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fbf740656f0 0x7fbf74067bb0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:02.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.564+0000 7fbf96b70700 1 --2- 172.21.15.114:0/3828197935 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbf900b4990 0x7fbf9015d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:02.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.564+0000 7fbf96b70700 1 --2- 172.21.15.114:0/3828197935 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbf90069d10 0x7fbf900c8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:02.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.564+0000 7fbf96b70700 1 --2- 172.21.15.114:0/3828197935 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbf900610a0 0x7fbf901f2d60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:02.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.564+0000 7fbf96b70700 1 -- 172.21.15.114:0/3828197935 >> 172.21.15.114:0/3828197935 conn(0x7fbf900cbb10 msgr2=0x7fbf900af880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:02.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.564+0000 7fbf96b70700 1 -- 172.21.15.114:0/3828197935 shutdown_connections 2023-10-18T12:21:02.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.564+0000 7fbf96b70700 1 -- 172.21.15.114:0/3828197935 wait complete. 2023-10-18T12:21:02.573 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' removed 2023-10-18T12:21:02.593 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-18T12:21:02.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.780+0000 7f24224df700 1 Processor -- start 2023-10-18T12:21:02.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.780+0000 7f24224df700 1 -- start start 2023-10-18T12:21:02.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.780+0000 7f24224df700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f241c1467a0 0x7f241c0b5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:02.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.784+0000 7f24224df700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f241c06f5f0 con 0x7f241c0b5560 2023-10-18T12:21:02.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.784+0000 7f24224df700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f241c0d1960 con 0x7f241c0cf490 2023-10-18T12:21:02.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.784+0000 7f24224df700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f241c0cf9f0 con 0x7f241c1467a0 2023-10-18T12:21:02.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.784+0000 7f24214dd700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f241c1467a0 0x7f241c0b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:02.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.784+0000 7f24214dd700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f241c1467a0 0x7f241c0b5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58770/0 (socket says 172.21.15.114:58770) 2023-10-18T12:21:02.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.784+0000 7f24214dd700 1 -- 172.21.15.114:0/3287843494 learned_addr learned my addr 172.21.15.114:0/3287843494 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:02.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.784+0000 7f2420cdc700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f241c0b5560 0x7f241c0ced80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:46694/0 (socket says 172.21.15.114:46694) 2023-10-18T12:21:02.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.784+0000 7f24214dd700 1 -- 172.21.15.114:0/3287843494 >> v1:172.21.15.172:6789/0 conn(0x7f241c0cf490 legacy=0x7f241c06fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:02.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.784+0000 7f24214dd700 1 -- 172.21.15.114:0/3287843494 >> v1:172.21.15.114:6789/0 conn(0x7f241c0b5560 legacy=0x7f241c0ced80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:02.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.784+0000 7f24214dd700 1 -- 172.21.15.114:0/3287843494 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f241c0d1c40 con 0x7f241c1467a0 2023-10-18T12:21:02.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.784+0000 7f24214dd700 1 --2- 172.21.15.114:0/3287843494 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f241c1467a0 0x7f241c0b5020 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f2418009910 tx=0x7f2418009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af79198cb117094b server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:02.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.784+0000 7f2413fff700 1 -- 172.21.15.114:0/3287843494 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2418004230 con 0x7f241c1467a0 2023-10-18T12:21:02.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.784+0000 7f2413fff700 1 -- 172.21.15.114:0/3287843494 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2418004390 con 0x7f241c1467a0 2023-10-18T12:21:02.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.784+0000 7f2413fff700 1 -- 172.21.15.114:0/3287843494 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2418009e60 con 0x7f241c1467a0 2023-10-18T12:21:02.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.784+0000 7f24224df700 1 -- 172.21.15.114:0/3287843494 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f241c1467a0 msgr2=0x7f241c0b5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:02.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.784+0000 7f24224df700 1 --2- 172.21.15.114:0/3287843494 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f241c1467a0 0x7f241c0b5020 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f2418009910 tx=0x7f2418009c20 comp rx=0 tx=0).stop 2023-10-18T12:21:02.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.784+0000 7f24224df700 1 -- 172.21.15.114:0/3287843494 shutdown_connections 2023-10-18T12:21:02.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.784+0000 7f24224df700 1 --2- 172.21.15.114:0/3287843494 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f241c1467a0 0x7f241c0b5020 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:02.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.784+0000 7f24224df700 1 -- 172.21.15.114:0/3287843494 >> 172.21.15.114:0/3287843494 conn(0x7f241c06ce90 msgr2=0x7f241c0b7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:02.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.784+0000 7f24224df700 1 -- 172.21.15.114:0/3287843494 shutdown_connections 2023-10-18T12:21:02.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.784+0000 7f24224df700 1 -- 172.21.15.114:0/3287843494 wait complete. 2023-10-18T12:21:02.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.788+0000 7f24224df700 1 Processor -- start 2023-10-18T12:21:02.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.788+0000 7f24224df700 1 -- start start 2023-10-18T12:21:02.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.792+0000 7f24224df700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f241c0b5560 0x7f241c15c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:02.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.792+0000 7f24224df700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f241c0cf490 0x7f241c130e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:02.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.792+0000 7f24224df700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f241c1467a0 0x7f241c144da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:02.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.792+0000 7f24224df700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241c131df0 con 0x7f241c1467a0 2023-10-18T12:21:02.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.792+0000 7f24224df700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241c12f280 con 0x7f241c0cf490 2023-10-18T12:21:02.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.792+0000 7f24224df700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f241c131830 con 0x7f241c0b5560 2023-10-18T12:21:02.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.792+0000 7f2421cde700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f241c1467a0 0x7f241c144da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:02.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.792+0000 7f2421cde700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f241c1467a0 0x7f241c144da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58780/0 (socket says 172.21.15.114:58780) 2023-10-18T12:21:02.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.792+0000 7f2421cde700 1 -- 172.21.15.114:0/642216276 learned_addr learned my addr 172.21.15.114:0/642216276 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:02.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.792+0000 7f24214dd700 1 --2- 172.21.15.114:0/642216276 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f241c0b5560 0x7f241c15c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:02.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.792+0000 7f2420cdc700 1 --2- 172.21.15.114:0/642216276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f241c0cf490 0x7f241c130e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:02.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.792+0000 7f2421cde700 1 -- 172.21.15.114:0/642216276 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f241c0b5560 msgr2=0x7f241c15c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:02.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.792+0000 7f2421cde700 1 --2- 172.21.15.114:0/642216276 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f241c0b5560 0x7f241c15c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:02.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.792+0000 7f2421cde700 1 -- 172.21.15.114:0/642216276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f241c0cf490 msgr2=0x7f241c130e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:02.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.792+0000 7f2421cde700 1 --2- 172.21.15.114:0/642216276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f241c0cf490 0x7f241c130e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:02.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.792+0000 7f2421cde700 1 -- 172.21.15.114:0/642216276 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2418009570 con 0x7f241c1467a0 2023-10-18T12:21:02.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.792+0000 7f2421cde700 1 --2- 172.21.15.114:0/642216276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f241c1467a0 0x7f241c144da0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f241400cc10 tx=0x7f241400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:02.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.792+0000 7f2411ffb700 1 -- 172.21.15.114:0/642216276 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2414004bb0 con 0x7f241c1467a0 2023-10-18T12:21:02.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.792+0000 7f2411ffb700 1 -- 172.21.15.114:0/642216276 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2414004d10 con 0x7f241c1467a0 2023-10-18T12:21:02.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.792+0000 7f2411ffb700 1 -- 172.21.15.114:0/642216276 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241400aae0 con 0x7f241c1467a0 2023-10-18T12:21:02.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.792+0000 7f24224df700 1 -- 172.21.15.114:0/642216276 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f241c131b10 con 0x7f241c1467a0 2023-10-18T12:21:02.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.792+0000 7f24224df700 1 -- 172.21.15.114:0/642216276 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f241c142580 con 0x7f241c1467a0 2023-10-18T12:21:02.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.796+0000 7f24224df700 1 -- 172.21.15.114:0/642216276 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f241c072e60 con 0x7f241c1467a0 2023-10-18T12:21:02.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.796+0000 7f2411ffb700 1 -- 172.21.15.114:0/642216276 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f241400ac40 con 0x7f241c1467a0 2023-10-18T12:21:02.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.796+0000 7f2411ffb700 1 --2- 172.21.15.114:0/642216276 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f24000656f0 0x7f2400067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:02.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.796+0000 7f2411ffb700 1 -- 172.21.15.114:0/642216276 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6519+0+0 (secure 0 0 0) 0x7f2414082880 con 0x7f241c1467a0 2023-10-18T12:21:02.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.796+0000 7f24214dd700 1 --2- 172.21.15.114:0/642216276 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f24000656f0 0x7f2400067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:02.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.800+0000 7f24214dd700 1 --2- 172.21.15.114:0/642216276 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f24000656f0 0x7f2400067bb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2418009910 tx=0x7f2418008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:02.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:02.800+0000 7f2411ffb700 1 -- 172.21.15.114:0/642216276 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f2414050200 con 0x7f241c1467a0 2023-10-18T12:21:03.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.076+0000 7f24224df700 1 -- 172.21.15.114:0/642216276 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f241c12f3c0 con 0x7f241c1467a0 2023-10-18T12:21:03.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.572+0000 7f2411ffb700 1 -- 172.21.15.114:0/642216276 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v33) v1 ==== 169+0+0 (secure 0 0 0) 0x7f24140170d0 con 0x7f241c1467a0 2023-10-18T12:21:03.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.576+0000 7f24224df700 1 -- 172.21.15.114:0/642216276 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f24000656f0 msgr2=0x7f2400067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:03.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.576+0000 7f24224df700 1 --2- 172.21.15.114:0/642216276 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f24000656f0 0x7f2400067bb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2418009910 tx=0x7f2418008030 comp rx=0 tx=0).stop 2023-10-18T12:21:03.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.576+0000 7f24224df700 1 -- 172.21.15.114:0/642216276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f241c1467a0 msgr2=0x7f241c144da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:03.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.576+0000 7f24224df700 1 --2- 172.21.15.114:0/642216276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f241c1467a0 0x7f241c144da0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f241400cc10 tx=0x7f241400cf20 comp rx=0 tx=0).stop 2023-10-18T12:21:03.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.580+0000 7f24224df700 1 -- 172.21.15.114:0/642216276 shutdown_connections 2023-10-18T12:21:03.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.580+0000 7f24224df700 1 --2- 172.21.15.114:0/642216276 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f24000656f0 0x7f2400067bb0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:03.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.580+0000 7f24224df700 1 --2- 172.21.15.114:0/642216276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f241c1467a0 0x7f241c144da0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:03.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.580+0000 7f24224df700 1 --2- 172.21.15.114:0/642216276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f241c0cf490 0x7f241c130e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:03.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.580+0000 7f24224df700 1 --2- 172.21.15.114:0/642216276 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f241c0b5560 0x7f241c15c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:03.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.580+0000 7f24224df700 1 -- 172.21.15.114:0/642216276 >> 172.21.15.114:0/642216276 conn(0x7f241c06ce90 msgr2=0x7f241c0b61e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:03.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.580+0000 7f24224df700 1 -- 172.21.15.114:0/642216276 shutdown_connections 2023-10-18T12:21:03.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.580+0000 7f24224df700 1 -- 172.21.15.114:0/642216276 wait complete. 2023-10-18T12:21:03.587 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' removed 2023-10-18T12:21:03.607 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-10-18T12:21:03.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.788+0000 7f767f59e700 1 Processor -- start 2023-10-18T12:21:03.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.788+0000 7f767f59e700 1 -- start start 2023-10-18T12:21:03.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.792+0000 7f767f59e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f76801467a0 0x7f76800b5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:03.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.792+0000 7f767f59e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f76800cf490 0x7f768006fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:03.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.792+0000 7f767f59e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f768006f5f0 con 0x7f76800b5560 2023-10-18T12:21:03.798 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.792+0000 7f767f59e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76800cf9f0 con 0x7f76800cf490 2023-10-18T12:21:03.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.792+0000 7f767f59e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76800d2200 con 0x7f76801467a0 2023-10-18T12:21:03.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.792+0000 7f767e59c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f76801467a0 0x7f76800b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:03.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.792+0000 7f767ed9d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f76800cf490 0x7f768006fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:03.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.792+0000 7f767e59c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f76801467a0 0x7f76800b5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.114:53874/0 (socket says 172.21.15.114:53874) 2023-10-18T12:21:03.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.792+0000 7f767e59c700 1 -- 172.21.15.114:0/3029162284 learned_addr learned my addr 172.21.15.114:0/3029162284 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:03.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.792+0000 7f767e59c700 1 -- 172.21.15.114:0/3029162284 >> v2:172.21.15.114:3300/0 conn(0x7f76800cf490 msgr2=0x7f768006fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:03.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.792+0000 7f767e59c700 1 --2- 172.21.15.114:0/3029162284 >> v2:172.21.15.114:3300/0 conn(0x7f76800cf490 0x7f768006fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:03.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.792+0000 7f767e59c700 1 -- 172.21.15.114:0/3029162284 >> v1:172.21.15.172:6789/0 conn(0x7f76800b5560 legacy=0x7f76800ced80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:03.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.792+0000 7f767e59c700 1 -- 172.21.15.114:0/3029162284 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76800d1960 con 0x7f76801467a0 2023-10-18T12:21:03.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.796+0000 7f767e59c700 1 --2- 172.21.15.114:0/3029162284 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f76801467a0 0x7f76800b5020 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7670009910 tx=0x7f7670009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b91fcec9ca05ef79 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:03.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.796+0000 7f767d59a700 1 -- 172.21.15.114:0/3029162284 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7670011830 con 0x7f76801467a0 2023-10-18T12:21:03.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.796+0000 7f767d59a700 1 -- 172.21.15.114:0/3029162284 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7670011990 con 0x7f76801467a0 2023-10-18T12:21:03.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.796+0000 7f767d59a700 1 -- 172.21.15.114:0/3029162284 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7670011d40 con 0x7f76801467a0 2023-10-18T12:21:03.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.796+0000 7f767f59e700 1 -- 172.21.15.114:0/3029162284 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f76801467a0 msgr2=0x7f76800b5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:03.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.796+0000 7f767f59e700 1 --2- 172.21.15.114:0/3029162284 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f76801467a0 0x7f76800b5020 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7670009910 tx=0x7f7670009c20 comp rx=0 tx=0).stop 2023-10-18T12:21:03.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.796+0000 7f767f59e700 1 -- 172.21.15.114:0/3029162284 shutdown_connections 2023-10-18T12:21:03.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.796+0000 7f767f59e700 1 --2- 172.21.15.114:0/3029162284 >> v2:172.21.15.114:3300/0 conn(0x7f76800cf490 0x7f768006fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:03.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.796+0000 7f767f59e700 1 --2- 172.21.15.114:0/3029162284 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f76801467a0 0x7f76800b5020 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:03.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.796+0000 7f767f59e700 1 -- 172.21.15.114:0/3029162284 >> 172.21.15.114:0/3029162284 conn(0x7f768006ce90 msgr2=0x7f76800b7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:03.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.796+0000 7f767f59e700 1 -- 172.21.15.114:0/3029162284 shutdown_connections 2023-10-18T12:21:03.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.796+0000 7f767f59e700 1 -- 172.21.15.114:0/3029162284 wait complete. 2023-10-18T12:21:03.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.800+0000 7f767f59e700 1 Processor -- start 2023-10-18T12:21:03.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.800+0000 7f767f59e700 1 -- start start 2023-10-18T12:21:03.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.800+0000 7f767f59e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76800b5560 0x7f7680140620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:03.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.800+0000 7f767f59e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76800cf490 0x7f76800b7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:03.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.800+0000 7f767f59e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f76801467a0 0x7f76800b7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:03.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.800+0000 7f767f59e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76801f6a40 con 0x7f76800cf490 2023-10-18T12:21:03.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.800+0000 7f767f59e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76801f24b0 con 0x7f76800b5560 2023-10-18T12:21:03.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.800+0000 7f767f59e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76801f6760 con 0x7f76801467a0 2023-10-18T12:21:03.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.800+0000 7f767dd9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76800cf490 0x7f76800b7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:03.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.800+0000 7f767dd9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76800cf490 0x7f76800b7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58792/0 (socket says 172.21.15.114:58792) 2023-10-18T12:21:03.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.800+0000 7f767dd9b700 1 -- 172.21.15.114:0/3403086098 learned_addr learned my addr 172.21.15.114:0/3403086098 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:03.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.800+0000 7f767ed9d700 1 --2- 172.21.15.114:0/3403086098 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f76801467a0 0x7f76800b7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:03.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.800+0000 7f767e59c700 1 --2- 172.21.15.114:0/3403086098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76800b5560 0x7f7680140620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:03.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.800+0000 7f767dd9b700 1 -- 172.21.15.114:0/3403086098 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f76801467a0 msgr2=0x7f76800b7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:03.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.800+0000 7f767dd9b700 1 --2- 172.21.15.114:0/3403086098 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f76801467a0 0x7f76800b7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:03.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.800+0000 7f767dd9b700 1 -- 172.21.15.114:0/3403086098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76800b5560 msgr2=0x7f7680140620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:03.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.800+0000 7f767dd9b700 1 --2- 172.21.15.114:0/3403086098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76800b5560 0x7f7680140620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:03.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.800+0000 7f767dd9b700 1 -- 172.21.15.114:0/3403086098 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7670009570 con 0x7f76800cf490 2023-10-18T12:21:03.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.800+0000 7f767dd9b700 1 --2- 172.21.15.114:0/3403086098 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76800cf490 0x7f76800b7520 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f767400c500 tx=0x7f767400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:03.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.800+0000 7f766effd700 1 -- 172.21.15.114:0/3403086098 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76740052d0 con 0x7f76800cf490 2023-10-18T12:21:03.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.800+0000 7f766effd700 1 -- 172.21.15.114:0/3403086098 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7674005430 con 0x7f76800cf490 2023-10-18T12:21:03.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.800+0000 7f766effd700 1 -- 172.21.15.114:0/3403086098 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76740055a0 con 0x7f76800cf490 2023-10-18T12:21:03.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.800+0000 7f767f59e700 1 -- 172.21.15.114:0/3403086098 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76801f26c0 con 0x7f76800cf490 2023-10-18T12:21:03.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.804+0000 7f767f59e700 1 -- 172.21.15.114:0/3403086098 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76801f2c80 con 0x7f76800cf490 2023-10-18T12:21:03.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.804+0000 7f767f59e700 1 -- 172.21.15.114:0/3403086098 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7680072e60 con 0x7f76800cf490 2023-10-18T12:21:03.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.804+0000 7f766effd700 1 -- 172.21.15.114:0/3403086098 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f76740038e0 con 0x7f76800cf490 2023-10-18T12:21:03.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.808+0000 7f766effd700 1 --2- 172.21.15.114:0/3403086098 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f76600656f0 0x7f7660067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:03.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.808+0000 7f766effd700 1 -- 172.21.15.114:0/3403086098 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f76740821e0 con 0x7f76800cf490 2023-10-18T12:21:03.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.808+0000 7f767e59c700 1 --2- 172.21.15.114:0/3403086098 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f76600656f0 0x7f7660067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:03.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.808+0000 7f767e59c700 1 --2- 172.21.15.114:0/3403086098 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f76600656f0 0x7f7660067bb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7670009150 tx=0x7f7670008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:03.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:03.812+0000 7f766effd700 1 -- 172.21.15.114:0/3403086098 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f767404fcb0 con 0x7f76800cf490 2023-10-18T12:21:04.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.084+0000 7f767f59e700 1 -- 172.21.15.114:0/3403086098 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f76800b1be0 con 0x7f76800cf490 2023-10-18T12:21:04.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.568+0000 7f766effd700 1 -- 172.21.15.114:0/3403086098 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v34) v1 ==== 178+0+0 (secure 0 0 0) 0x7f76740532d0 con 0x7f76800cf490 2023-10-18T12:21:04.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.572+0000 7f767f59e700 1 -- 172.21.15.114:0/3403086098 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f76600656f0 msgr2=0x7f7660067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:04.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.572+0000 7f767f59e700 1 --2- 172.21.15.114:0/3403086098 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f76600656f0 0x7f7660067bb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7670009150 tx=0x7f7670008030 comp rx=0 tx=0).stop 2023-10-18T12:21:04.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.572+0000 7f767f59e700 1 -- 172.21.15.114:0/3403086098 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76800cf490 msgr2=0x7f76800b7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:04.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.572+0000 7f767f59e700 1 --2- 172.21.15.114:0/3403086098 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76800cf490 0x7f76800b7520 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f767400c500 tx=0x7f767400c810 comp rx=0 tx=0).stop 2023-10-18T12:21:04.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.572+0000 7f767f59e700 1 -- 172.21.15.114:0/3403086098 shutdown_connections 2023-10-18T12:21:04.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.572+0000 7f767f59e700 1 --2- 172.21.15.114:0/3403086098 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f76600656f0 0x7f7660067bb0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:04.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.572+0000 7f767f59e700 1 --2- 172.21.15.114:0/3403086098 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f76801467a0 0x7f76800b7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:04.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.572+0000 7f767f59e700 1 --2- 172.21.15.114:0/3403086098 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76800cf490 0x7f76800b7520 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:04.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.572+0000 7f767f59e700 1 --2- 172.21.15.114:0/3403086098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f76800b5560 0x7f7680140620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:04.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.572+0000 7f767f59e700 1 -- 172.21.15.114:0/3403086098 >> 172.21.15.114:0/3403086098 conn(0x7f768006ce90 msgr2=0x7f768006f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:04.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.572+0000 7f767f59e700 1 -- 172.21.15.114:0/3403086098 shutdown_connections 2023-10-18T12:21:04.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.572+0000 7f767f59e700 1 -- 172.21.15.114:0/3403086098 wait complete. 2023-10-18T12:21:04.581 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data_ec' removed 2023-10-18T12:21:04.601 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-18T12:21:04.601 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-18T12:21:04.602 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-18T12:21:04.602 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T12:21:04.602 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-18T12:21:04.603 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-18T12:21:04.603 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-18T12:21:04.603 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T12:21:04.604 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-18T12:21:04.604 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-18T12:21:04.604 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-18T12:21:04.604 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T12:21:04.605 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-18T12:21:04.605 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-18T12:21:04.605 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-18T12:21:04.606 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T12:21:04.621 INFO:tasks.ceph.mds.a:Stopped 2023-10-18T12:21:04.622 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-18T12:21:04.623 INFO:tasks.ceph.mds.b:Stopped 2023-10-18T12:21:04.623 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-18T12:21:04.624 INFO:tasks.ceph.mds.d:Stopped 2023-10-18T12:21:04.624 DEBUG:teuthology.orchestra.run.smithi172:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-18T12:21:04.625 INFO:tasks.ceph.mds.c:Stopped 2023-10-18T12:21:04.626 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-18T12:21:04.673 INFO:tasks.ceph.mds.a:Started 2023-10-18T12:21:04.674 DEBUG:teuthology.parallel:result is None 2023-10-18T12:21:04.675 INFO:tasks.ceph.mds.b:Started 2023-10-18T12:21:04.676 DEBUG:teuthology.parallel:result is None 2023-10-18T12:21:04.677 INFO:tasks.ceph.mds.c:Started 2023-10-18T12:21:04.678 DEBUG:teuthology.parallel:result is None 2023-10-18T12:21:04.681 INFO:tasks.ceph.mds.d:Started 2023-10-18T12:21:04.681 DEBUG:teuthology.parallel:result is None 2023-10-18T12:21:04.681 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-18T12:21:04.792 INFO:tasks.ceph.mds.c.smithi114.stdout:starting mds.c at 2023-10-18T12:21:04.799 INFO:tasks.ceph.mds.d.smithi172.stdout:starting mds.d at 2023-10-18T12:21:04.801 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2023-10-18T12:21:04.802 INFO:tasks.ceph.mds.b.smithi172.stdout:starting mds.b at 2023-10-18T12:21:04.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.840+0000 7fca0359e700 1 Processor -- start 2023-10-18T12:21:04.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.840+0000 7fca0359e700 1 -- start start 2023-10-18T12:21:04.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.840+0000 7fca0359e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fca040cb8a0 0x7fca040cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:04.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.840+0000 7fca0359e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fca040b22f0 0x7fca040b2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:04.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.840+0000 7fca0359e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca04070de0 con 0x7fca04144150 2023-10-18T12:21:04.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.840+0000 7fca0359e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca040cc270 con 0x7fca040b22f0 2023-10-18T12:21:04.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.840+0000 7fca0359e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca040701d0 con 0x7fca040cb8a0 2023-10-18T12:21:04.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.840+0000 7fca01d9b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fca040cb8a0 0x7fca040cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:04.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.840+0000 7fca02d9d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fca040b22f0 0x7fca040b2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:04.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.840+0000 7fca01d9b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fca040cb8a0 0x7fca040cbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:36558/0 (socket says 172.21.15.114:36558) 2023-10-18T12:21:04.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.840+0000 7fca01d9b700 1 -- 172.21.15.114:0/125648934 learned_addr learned my addr 172.21.15.114:0/125648934 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:04.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.840+0000 7fca01d9b700 1 -- 172.21.15.114:0/125648934 >> v2:172.21.15.114:3300/0 conn(0x7fca040b22f0 msgr2=0x7fca040b2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:04.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.840+0000 7fca01d9b700 1 --2- 172.21.15.114:0/125648934 >> v2:172.21.15.114:3300/0 conn(0x7fca040b22f0 0x7fca040b2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:04.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.840+0000 7fca01d9b700 1 -- 172.21.15.114:0/125648934 >> v1:172.21.15.172:6789/0 conn(0x7fca04144150 legacy=0x7fca040cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:04.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.840+0000 7fca01d9b700 1 -- 172.21.15.114:0/125648934 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca040704b0 con 0x7fca040cb8a0 2023-10-18T12:21:04.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.840+0000 7fca01d9b700 1 --2- 172.21.15.114:0/125648934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca040cb8a0 0x7fca040cbd30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fca0406adb0 tx=0x7fc9f8009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7d595c82f665357 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:04.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.844+0000 7fca0159a700 1 -- 172.21.15.114:0/125648934 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f8011830 con 0x7fca040cb8a0 2023-10-18T12:21:04.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.844+0000 7fca0159a700 1 -- 172.21.15.114:0/125648934 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f8011990 con 0x7fca040cb8a0 2023-10-18T12:21:04.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.844+0000 7fca0159a700 1 -- 172.21.15.114:0/125648934 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f8011d20 con 0x7fca040cb8a0 2023-10-18T12:21:04.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.844+0000 7fca0359e700 1 -- 172.21.15.114:0/125648934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca040cb8a0 msgr2=0x7fca040cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:04.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.844+0000 7fca0359e700 1 --2- 172.21.15.114:0/125648934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca040cb8a0 0x7fca040cbd30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fca0406adb0 tx=0x7fc9f8009bf0 comp rx=0 tx=0).stop 2023-10-18T12:21:04.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.844+0000 7fca0359e700 1 -- 172.21.15.114:0/125648934 shutdown_connections 2023-10-18T12:21:04.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.844+0000 7fca0359e700 1 --2- 172.21.15.114:0/125648934 >> v2:172.21.15.114:3300/0 conn(0x7fca040b22f0 0x7fca040b2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:04.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.844+0000 7fca0359e700 1 --2- 172.21.15.114:0/125648934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca040cb8a0 0x7fca040cbd30 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:04.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.844+0000 7fca0359e700 1 -- 172.21.15.114:0/125648934 >> 172.21.15.114:0/125648934 conn(0x7fca040b0bf0 msgr2=0x7fca040ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:04.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.844+0000 7fca0359e700 1 -- 172.21.15.114:0/125648934 shutdown_connections 2023-10-18T12:21:04.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.844+0000 7fca0359e700 1 -- 172.21.15.114:0/125648934 wait complete. 2023-10-18T12:21:04.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.844+0000 7fca0359e700 1 Processor -- start 2023-10-18T12:21:04.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.848+0000 7fca0359e700 1 -- start start 2023-10-18T12:21:04.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.848+0000 7fca0359e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca040b22f0 0x7fca0415d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:04.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.848+0000 7fca0359e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca040cb8a0 0x7fca040c4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:04.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.848+0000 7fca0359e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fca04144150 0x7fca041f5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:04.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.848+0000 7fca0359e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0415d320 con 0x7fca040b22f0 2023-10-18T12:21:04.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.848+0000 7fca0359e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca040c3d30 con 0x7fca040cb8a0 2023-10-18T12:21:04.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.848+0000 7fca0359e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca040c3770 con 0x7fca04144150 2023-10-18T12:21:04.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.848+0000 7fca0259c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca040b22f0 0x7fca0415d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:04.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.848+0000 7fca0259c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca040b22f0 0x7fca0415d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58850/0 (socket says 172.21.15.114:58850) 2023-10-18T12:21:04.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.848+0000 7fca0259c700 1 -- 172.21.15.114:0/935579764 learned_addr learned my addr 172.21.15.114:0/935579764 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:04.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.848+0000 7fca01d9b700 1 --2- 172.21.15.114:0/935579764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca040cb8a0 0x7fca040c4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:04.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.848+0000 7fca02d9d700 1 --2- 172.21.15.114:0/935579764 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fca04144150 0x7fca041f5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:04.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.848+0000 7fca0259c700 1 -- 172.21.15.114:0/935579764 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fca04144150 msgr2=0x7fca041f5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:04.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.848+0000 7fca0259c700 1 --2- 172.21.15.114:0/935579764 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fca04144150 0x7fca041f5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:04.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.848+0000 7fca0259c700 1 -- 172.21.15.114:0/935579764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca040cb8a0 msgr2=0x7fca040c4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:04.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.848+0000 7fca0259c700 1 --2- 172.21.15.114:0/935579764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca040cb8a0 0x7fca040c4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:04.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.848+0000 7fca0259c700 1 -- 172.21.15.114:0/935579764 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f8009570 con 0x7fca040b22f0 2023-10-18T12:21:04.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.848+0000 7fca01d9b700 1 --2- 172.21.15.114:0/935579764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca040cb8a0 0x7fca040c4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:21:04.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.848+0000 7fca0259c700 1 --2- 172.21.15.114:0/935579764 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca040b22f0 0x7fca0415d740 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fc9f400c500 tx=0x7fc9f400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:04.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.852+0000 7fc9f2ffd700 1 -- 172.21.15.114:0/935579764 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f40052d0 con 0x7fca040b22f0 2023-10-18T12:21:04.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.852+0000 7fc9f2ffd700 1 -- 172.21.15.114:0/935579764 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f4005430 con 0x7fca040b22f0 2023-10-18T12:21:04.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.852+0000 7fc9f2ffd700 1 -- 172.21.15.114:0/935579764 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f40055a0 con 0x7fca040b22f0 2023-10-18T12:21:04.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.852+0000 7fca0359e700 1 -- 172.21.15.114:0/935579764 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca040c3a50 con 0x7fca040b22f0 2023-10-18T12:21:04.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.852+0000 7fca0359e700 1 -- 172.21.15.114:0/935579764 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca0415dc80 con 0x7fca040b22f0 2023-10-18T12:21:04.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.852+0000 7fca0359e700 1 -- 172.21.15.114:0/935579764 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca04072e60 con 0x7fca040b22f0 2023-10-18T12:21:04.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.852+0000 7fc9f2ffd700 1 -- 172.21.15.114:0/935579764 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fc9f40038e0 con 0x7fca040b22f0 2023-10-18T12:21:04.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.856+0000 7fc9f2ffd700 1 --2- 172.21.15.114:0/935579764 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc9e40656f0 0x7fc9e4067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:04.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.856+0000 7fc9f2ffd700 1 -- 172.21.15.114:0/935579764 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fc9f4081f50 con 0x7fca040b22f0 2023-10-18T12:21:04.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.856+0000 7fca01d9b700 1 --2- 172.21.15.114:0/935579764 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc9e40656f0 0x7fc9e4067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:04.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.856+0000 7fca01d9b700 1 --2- 172.21.15.114:0/935579764 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc9e40656f0 0x7fc9e4067bb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8009860 tx=0x7fc9f8008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:04.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:04.860+0000 7fc9f2ffd700 1 -- 172.21.15.114:0/935579764 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fc9f404fbe0 con 0x7fca040b22f0 2023-10-18T12:21:05.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.064+0000 7fca0359e700 1 -- 172.21.15.114:0/935579764 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fca040b2a70 con 0x7fca040b22f0 2023-10-18T12:21:05.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.604+0000 7fc9f2ffd700 1 -- 172.21.15.114:0/935579764 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v36) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc9f4053200 con 0x7fca040b22f0 2023-10-18T12:21:05.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.608+0000 7fca0359e700 1 -- 172.21.15.114:0/935579764 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc9e40656f0 msgr2=0x7fc9e4067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:05.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.608+0000 7fca0359e700 1 --2- 172.21.15.114:0/935579764 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc9e40656f0 0x7fc9e4067bb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8009860 tx=0x7fc9f8008030 comp rx=0 tx=0).stop 2023-10-18T12:21:05.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.608+0000 7fca0359e700 1 -- 172.21.15.114:0/935579764 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca040b22f0 msgr2=0x7fca0415d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:05.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.608+0000 7fca0359e700 1 --2- 172.21.15.114:0/935579764 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca040b22f0 0x7fca0415d740 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fc9f400c500 tx=0x7fc9f400c810 comp rx=0 tx=0).stop 2023-10-18T12:21:05.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.608+0000 7fca0359e700 1 -- 172.21.15.114:0/935579764 shutdown_connections 2023-10-18T12:21:05.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.608+0000 7fca0359e700 1 --2- 172.21.15.114:0/935579764 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc9e40656f0 0x7fc9e4067bb0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:05.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.608+0000 7fca0359e700 1 --2- 172.21.15.114:0/935579764 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fca04144150 0x7fca041f5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:05.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.608+0000 7fca0359e700 1 --2- 172.21.15.114:0/935579764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca040cb8a0 0x7fca040c4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:05.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.608+0000 7fca0359e700 1 --2- 172.21.15.114:0/935579764 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fca040b22f0 0x7fca0415d740 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:05.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.608+0000 7fca0359e700 1 -- 172.21.15.114:0/935579764 >> 172.21.15.114:0/935579764 conn(0x7fca040b0bf0 msgr2=0x7fca0415e420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:05.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.608+0000 7fca0359e700 1 -- 172.21.15.114:0/935579764 shutdown_connections 2023-10-18T12:21:05.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.608+0000 7fca0359e700 1 -- 172.21.15.114:0/935579764 wait complete. 2023-10-18T12:21:05.617 INFO:teuthology.orchestra.run.smithi114.stderr: removed all blocklist entries 2023-10-18T12:21:05.636 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-18T12:21:05.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.800+0000 7f325c2cd700 1 Processor -- start 2023-10-18T12:21:05.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.800+0000 7f325c2cd700 1 -- start start 2023-10-18T12:21:05.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.804+0000 7f325c2cd700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f32540b5b80 0x7f325406f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:05.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.804+0000 7f325c2cd700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f325415e680 con 0x7f3254146800 2023-10-18T12:21:05.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.804+0000 7f325c2cd700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3254070310 con 0x7f325406fee0 2023-10-18T12:21:05.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.804+0000 7f325c2cd700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32540b6180 con 0x7f32540b5b80 2023-10-18T12:21:05.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.804+0000 7f325a069700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f3254146800 0x7f325415dd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45954/0 (socket says 172.21.15.114:45954) 2023-10-18T12:21:05.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.804+0000 7f325a069700 1 -- 172.21.15.114:0/2456349753 learned_addr learned my addr 172.21.15.114:0/2456349753 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:21:05.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.804+0000 7f3259868700 1 --2- 172.21.15.114:0/2456349753 >> v2:172.21.15.172:3300/0 conn(0x7f32540b5b80 0x7f325406f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:05.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.804+0000 7f3259067700 1 -- 172.21.15.114:0/2456349753 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1524477503 0 0) 0x7f325415e680 con 0x7f3254146800 2023-10-18T12:21:05.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.804+0000 7f3259067700 1 -- 172.21.15.114:0/2456349753 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32400035d0 con 0x7f3254146800 2023-10-18T12:21:05.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.804+0000 7f3259067700 1 -- 172.21.15.114:0/2456349753 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1611259316 0 0) 0x7f32400035d0 con 0x7f3254146800 2023-10-18T12:21:05.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.808+0000 7f3259067700 1 -- 172.21.15.114:0/2456349753 >> v2:172.21.15.172:3300/0 conn(0x7f32540b5b80 msgr2=0x7f325406f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:05.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.808+0000 7f3259067700 1 --2- 172.21.15.114:0/2456349753 >> v2:172.21.15.172:3300/0 conn(0x7f32540b5b80 0x7f325406f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:05.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.808+0000 7f3259067700 1 -- 172.21.15.114:0/2456349753 >> v1:172.21.15.172:6789/0 conn(0x7f325406fee0 legacy=0x7f325415eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:05.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.808+0000 7f3259067700 1 -- 172.21.15.114:0/2456349753 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32540b6460 con 0x7f3254146800 2023-10-18T12:21:05.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.808+0000 7f3259067700 1 -- 172.21.15.114:0/2456349753 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3368469509 0 0) 0x7f3250001670 con 0x7f3254146800 2023-10-18T12:21:05.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.808+0000 7f3259067700 1 -- 172.21.15.114:0/2456349753 >> v1:172.21.15.114:6789/0 conn(0x7f3254146800 legacy=0x7f325415dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:05.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.808+0000 7f3259067700 1 --2- 172.21.15.114:0/2456349753 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3240003a70 0x7f3240003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:05.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.808+0000 7f3259067700 1 --2- 172.21.15.114:0/2456349753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3240004870 0x7f3240004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:05.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.808+0000 7f3259067700 1 --2- 172.21.15.114:0/2456349753 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3240005230 0x7f324000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:05.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.808+0000 7f3259067700 1 -- 172.21.15.114:0/2456349753 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32540b6180 con 0x7f3240004870 2023-10-18T12:21:05.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.808+0000 7f3259067700 1 -- 172.21.15.114:0/2456349753 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f324000c130 con 0x7f3240005230 2023-10-18T12:21:05.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.808+0000 7f3259067700 1 -- 172.21.15.114:0/2456349753 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f324000c2f0 con 0x7f3240003a70 2023-10-18T12:21:05.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.808+0000 7f3259868700 1 --2- 172.21.15.114:0/2456349753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3240004870 0x7f3240004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:05.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.808+0000 7f325a069700 1 --2- 172.21.15.114:0/2456349753 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3240003a70 0x7f3240003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:05.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.808+0000 7f325a86a700 1 --2- 172.21.15.114:0/2456349753 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3240005230 0x7f324000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:05.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.808+0000 7f3259868700 1 -- 172.21.15.114:0/2456349753 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3240003a70 msgr2=0x7f3240003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:05.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.808+0000 7f3259868700 1 --2- 172.21.15.114:0/2456349753 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3240003a70 0x7f3240003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:05.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.808+0000 7f3259868700 1 -- 172.21.15.114:0/2456349753 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3240005230 msgr2=0x7f324000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:05.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.808+0000 7f3259868700 1 --2- 172.21.15.114:0/2456349753 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3240005230 0x7f324000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:05.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.808+0000 7f3259868700 1 -- 172.21.15.114:0/2456349753 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32400035d0 con 0x7f3240004870 2023-10-18T12:21:05.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.808+0000 7f325a86a700 1 -- 172.21.15.114:0/2456349753 reap_dead start 2023-10-18T12:21:05.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.808+0000 7f3259868700 1 --2- 172.21.15.114:0/2456349753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3240004870 0x7f3240004cf0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3244009b70 tx=0x7f32400058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b864e5b2eecdd6e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:05.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.808+0000 7f3259067700 1 -- 172.21.15.114:0/2456349753 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324400e6c0 con 0x7f3240004870 2023-10-18T12:21:05.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.808+0000 7f3259067700 1 -- 172.21.15.114:0/2456349753 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f324400e820 con 0x7f3240004870 2023-10-18T12:21:05.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.808+0000 7f3259067700 1 -- 172.21.15.114:0/2456349753 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324400eb90 con 0x7f3240004870 2023-10-18T12:21:05.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.808+0000 7f325c2cd700 1 -- 172.21.15.114:0/2456349753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3240004870 msgr2=0x7f3240004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:05.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.808+0000 7f325c2cd700 1 --2- 172.21.15.114:0/2456349753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3240004870 0x7f3240004cf0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3244009b70 tx=0x7f32400058a0 comp rx=0 tx=0).stop 2023-10-18T12:21:05.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.808+0000 7f325c2cd700 1 -- 172.21.15.114:0/2456349753 shutdown_connections 2023-10-18T12:21:05.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.808+0000 7f325c2cd700 1 --2- 172.21.15.114:0/2456349753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3240004870 0x7f3240004cf0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:05.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.808+0000 7f325c2cd700 1 -- 172.21.15.114:0/2456349753 >> 172.21.15.114:0/2456349753 conn(0x7f325406a130 msgr2=0x7f325406a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:05.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.808+0000 7f325c2cd700 1 -- 172.21.15.114:0/2456349753 shutdown_connections 2023-10-18T12:21:05.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.808+0000 7f325c2cd700 1 -- 172.21.15.114:0/2456349753 wait complete. 2023-10-18T12:21:05.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.812+0000 7f325c2cd700 1 Processor -- start 2023-10-18T12:21:05.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.812+0000 7f325c2cd700 1 -- start start 2023-10-18T12:21:05.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.816+0000 7f325c2cd700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3240004870 0x7f32540d0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:05.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.816+0000 7f325c2cd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32541f6930 0x7f325406d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:05.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.816+0000 7f325c2cd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f325406db90 0x7f325414dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:05.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.816+0000 7f325c2cd700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f325413be90 con 0x7f32541f6930 2023-10-18T12:21:05.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.816+0000 7f325c2cd700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3254152340 con 0x7f325406db90 2023-10-18T12:21:05.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.816+0000 7f325c2cd700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f325406e010 con 0x7f3240004870 2023-10-18T12:21:05.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.816+0000 7f3259868700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32541f6930 0x7f325406d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:05.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.816+0000 7f3259868700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32541f6930 0x7f325406d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36546/0 (socket says 172.21.15.114:36546) 2023-10-18T12:21:05.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.816+0000 7f3259868700 1 -- 172.21.15.114:0/440610943 learned_addr learned my addr 172.21.15.114:0/440610943 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:05.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.816+0000 7f325a069700 1 --2- 172.21.15.114:0/440610943 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3240004870 0x7f32540d0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:05.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.816+0000 7f325a86a700 1 --2- 172.21.15.114:0/440610943 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f325406db90 0x7f325414dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:05.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.816+0000 7f3259868700 1 -- 172.21.15.114:0/440610943 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3240004870 msgr2=0x7f32540d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:05.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.816+0000 7f3259868700 1 --2- 172.21.15.114:0/440610943 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3240004870 0x7f32540d0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:05.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.816+0000 7f3259868700 1 -- 172.21.15.114:0/440610943 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f325406db90 msgr2=0x7f325414dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:05.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.816+0000 7f3259868700 1 --2- 172.21.15.114:0/440610943 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f325406db90 0x7f325414dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:05.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.816+0000 7f3259868700 1 -- 172.21.15.114:0/440610943 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f325414ef20 con 0x7f32541f6930 2023-10-18T12:21:05.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.816+0000 7f3259868700 1 --2- 172.21.15.114:0/440610943 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32541f6930 0x7f325406d650 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f324000c100 tx=0x7f32440047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:05.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.816+0000 7f324affd700 1 -- 172.21.15.114:0/440610943 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324400e6c0 con 0x7f32541f6930 2023-10-18T12:21:05.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.816+0000 7f324affd700 1 -- 172.21.15.114:0/440610943 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32440038e0 con 0x7f32541f6930 2023-10-18T12:21:05.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.816+0000 7f324affd700 1 -- 172.21.15.114:0/440610943 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3244003c90 con 0x7f32541f6930 2023-10-18T12:21:05.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.816+0000 7f325c2cd700 1 -- 172.21.15.114:0/440610943 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32540d0cc0 con 0x7f32541f6930 2023-10-18T12:21:05.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.816+0000 7f325c2cd700 1 -- 172.21.15.114:0/440610943 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32541f5e50 con 0x7f32541f6930 2023-10-18T12:21:05.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.820+0000 7f325c2cd700 1 -- 172.21.15.114:0/440610943 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f325406f920 con 0x7f32541f6930 2023-10-18T12:21:05.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.820+0000 7f324affd700 1 -- 172.21.15.114:0/440610943 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f3244013470 con 0x7f32541f6930 2023-10-18T12:21:05.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.820+0000 7f324affd700 1 --2- 172.21.15.114:0/440610943 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f3238065720 0x7f3238067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:05.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.820+0000 7f324affd700 1 -- 172.21.15.114:0/440610943 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f32440840d0 con 0x7f32541f6930 2023-10-18T12:21:05.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.824+0000 7f325a069700 1 --2- 172.21.15.114:0/440610943 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f3238065720 0x7f3238067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:05.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.824+0000 7f325a069700 1 --2- 172.21.15.114:0/440610943 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f3238065720 0x7f3238067be0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3250001eb0 tx=0x7f3250007040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:05.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:05.828+0000 7f324affd700 1 -- 172.21.15.114:0/440610943 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f3244051ed0 con 0x7f32541f6930 2023-10-18T12:21:06.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.088+0000 7f325c2cd700 1 -- 172.21.15.114:0/440610943 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f3254072e60 con 0x7f32541f6930 2023-10-18T12:21:06.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.092+0000 7f324affd700 1 -- 172.21.15.114:0/440610943 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f32440554f0 con 0x7f32541f6930 2023-10-18T12:21:06.097 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:21:06.098 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T12:21:06.098 INFO:teuthology.orchestra.run.smithi114.stdout: "auth_dump": [ 2023-10-18T12:21:06.098 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T12:21:06.098 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.a", 2023-10-18T12:21:06.098 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQAbzS9lMbyvAhAATn1ZaKPr2Ob+mCfUpnZQUA==", 2023-10-18T12:21:06.099 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-10-18T12:21:06.099 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-10-18T12:21:06.099 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2023-10-18T12:21:06.099 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2023-10-18T12:21:06.100 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-10-18T12:21:06.100 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T12:21:06.100 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T12:21:06.100 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T12:21:06.100 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.b", 2023-10-18T12:21:06.101 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQAbzS9lzdA8FhAAym50uH2oXqGiGudL16qy6Q==", 2023-10-18T12:21:06.101 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-10-18T12:21:06.101 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-10-18T12:21:06.101 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2023-10-18T12:21:06.101 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2023-10-18T12:21:06.102 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-10-18T12:21:06.102 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T12:21:06.102 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T12:21:06.102 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T12:21:06.102 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.c", 2023-10-18T12:21:06.103 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQAbzS9l9G+wDRAAcQa3OTTltHsp5Nh+xTkX6Q==", 2023-10-18T12:21:06.103 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-10-18T12:21:06.103 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-10-18T12:21:06.103 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2023-10-18T12:21:06.103 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2023-10-18T12:21:06.103 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-10-18T12:21:06.104 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T12:21:06.104 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T12:21:06.104 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T12:21:06.104 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mds.d", 2023-10-18T12:21:06.104 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQAbzS9lCDNHIRAAId2KJl4jXDLItVs/sNHz4w==", 2023-10-18T12:21:06.105 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-10-18T12:21:06.105 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-10-18T12:21:06.105 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2023-10-18T12:21:06.105 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2023-10-18T12:21:06.105 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-10-18T12:21:06.105 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T12:21:06.106 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T12:21:06.106 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T12:21:06.106 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.0", 2023-10-18T12:21:06.106 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQAfzS9l3DgLFBAAbJK3lC1fDC5KHhqSo1EZkQ==", 2023-10-18T12:21:06.107 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-10-18T12:21:06.107 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-10-18T12:21:06.107 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-10-18T12:21:06.107 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-10-18T12:21:06.107 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T12:21:06.108 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T12:21:06.108 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T12:21:06.108 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.1", 2023-10-18T12:21:06.108 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQAizS9ltCswIxAAG1lZDDOl9sU9AR2utwvvKQ==", 2023-10-18T12:21:06.108 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-10-18T12:21:06.108 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-10-18T12:21:06.109 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-10-18T12:21:06.109 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-10-18T12:21:06.109 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T12:21:06.109 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T12:21:06.109 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T12:21:06.110 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.2", 2023-10-18T12:21:06.110 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQAlzS9lbGnJMBAAz85FiF64SOQgdYCs9rE+sQ==", 2023-10-18T12:21:06.110 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-10-18T12:21:06.110 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-10-18T12:21:06.110 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-10-18T12:21:06.111 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-10-18T12:21:06.111 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T12:21:06.111 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T12:21:06.111 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T12:21:06.111 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.3", 2023-10-18T12:21:06.111 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQApzS9lFK4hBBAAooq9vTE7xBf29aEG4axrDA==", 2023-10-18T12:21:06.112 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-10-18T12:21:06.112 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-10-18T12:21:06.112 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-10-18T12:21:06.112 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-10-18T12:21:06.112 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T12:21:06.112 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T12:21:06.113 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T12:21:06.113 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.4", 2023-10-18T12:21:06.113 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQAvzS9lXL6QHBAAMQ3Rjr6npggc+oOqT9I+iw==", 2023-10-18T12:21:06.113 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-10-18T12:21:06.113 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-10-18T12:21:06.113 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-10-18T12:21:06.114 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-10-18T12:21:06.114 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T12:21:06.114 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T12:21:06.114 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T12:21:06.114 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.5", 2023-10-18T12:21:06.115 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQAyzS9l3DC7LBAADbHf9qkpz7b/2Bud5C91DA==", 2023-10-18T12:21:06.115 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-10-18T12:21:06.115 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-10-18T12:21:06.115 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-10-18T12:21:06.115 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-10-18T12:21:06.116 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T12:21:06.116 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T12:21:06.116 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T12:21:06.116 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.6", 2023-10-18T12:21:06.116 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQA1zS9lFPlgOxAAhywc45lH31kl0/orIit6Ow==", 2023-10-18T12:21:06.116 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-10-18T12:21:06.117 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-10-18T12:21:06.117 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-10-18T12:21:06.117 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-10-18T12:21:06.117 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T12:21:06.117 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T12:21:06.118 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T12:21:06.118 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "osd.7", 2023-10-18T12:21:06.118 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQA5zS9lygFYDxAAZkt1EJ8ZIUpQ6uDYIwDL+Q==", 2023-10-18T12:21:06.118 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-10-18T12:21:06.118 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow profile osd", 2023-10-18T12:21:06.119 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile osd", 2023-10-18T12:21:06.119 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-10-18T12:21:06.119 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T12:21:06.119 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T12:21:06.119 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T12:21:06.120 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.0", 2023-10-18T12:21:06.120 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQAbzS9l47iuKBAAvzsyy0FyscOq8i4BEhLnMQ==", 2023-10-18T12:21:06.120 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-10-18T12:21:06.120 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-10-18T12:21:06.120 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2023-10-18T12:21:06.120 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2023-10-18T12:21:06.121 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2023-10-18T12:21:06.121 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T12:21:06.121 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T12:21:06.121 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T12:21:06.121 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.1", 2023-10-18T12:21:06.122 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQAbzS9lNEArNRAAMiz4XCbs4GnXl/PhN3nQWg==", 2023-10-18T12:21:06.122 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-10-18T12:21:06.122 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-10-18T12:21:06.122 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2023-10-18T12:21:06.122 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2023-10-18T12:21:06.122 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2023-10-18T12:21:06.123 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T12:21:06.123 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T12:21:06.123 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T12:21:06.123 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.2", 2023-10-18T12:21:06.123 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQAbzS9l7ybULhAA4NpR5cL6mpcRvb/MJLSttQ==", 2023-10-18T12:21:06.124 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-10-18T12:21:06.124 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-10-18T12:21:06.124 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2023-10-18T12:21:06.124 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2023-10-18T12:21:06.124 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2023-10-18T12:21:06.124 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T12:21:06.125 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T12:21:06.125 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T12:21:06.125 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.3", 2023-10-18T12:21:06.125 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQAbzS9lV0psOxAAvAYUD9M9Ernw6QGuxS9htQ==", 2023-10-18T12:21:06.125 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-10-18T12:21:06.126 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow", 2023-10-18T12:21:06.126 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow r", 2023-10-18T12:21:06.126 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow rw", 2023-10-18T12:21:06.126 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow rwx" 2023-10-18T12:21:06.126 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T12:21:06.127 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T12:21:06.127 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T12:21:06.127 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.admin", 2023-10-18T12:21:06.127 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQAazS9l/mbyEhAAhySDTR8ujk+L18uhu2ObJQ==", 2023-10-18T12:21:06.127 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-10-18T12:21:06.127 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2023-10-18T12:21:06.128 INFO:teuthology.orchestra.run.smithi114.stdout: "mgr": "allow *", 2023-10-18T12:21:06.128 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow *", 2023-10-18T12:21:06.128 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-10-18T12:21:06.128 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T12:21:06.128 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T12:21:06.128 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T12:21:06.129 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.bootstrap-mds", 2023-10-18T12:21:06.129 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBAzS9lgligHhAA9t7uJdT3lyOXqbhCfwB+EA==", 2023-10-18T12:21:06.129 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-10-18T12:21:06.129 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile bootstrap-mds" 2023-10-18T12:21:06.129 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T12:21:06.130 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T12:21:06.130 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T12:21:06.130 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.bootstrap-mgr", 2023-10-18T12:21:06.130 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBAzS9l62WgHhAAi4RrJxoQX2jzpFiNPmq6LQ==", 2023-10-18T12:21:06.130 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-10-18T12:21:06.131 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-18T12:21:06.131 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T12:21:06.131 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T12:21:06.131 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T12:21:06.131 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.bootstrap-osd", 2023-10-18T12:21:06.131 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBAzS9l4HGgHhAAMCURLKEvCaQGmUsGuFI0Sw==", 2023-10-18T12:21:06.132 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-10-18T12:21:06.132 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile bootstrap-osd" 2023-10-18T12:21:06.132 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T12:21:06.132 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T12:21:06.132 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T12:21:06.132 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.bootstrap-rbd", 2023-10-18T12:21:06.133 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBAzS9lpn2gHhAA4ZL9elF7xO1ZHLAi8q4++Q==", 2023-10-18T12:21:06.133 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-10-18T12:21:06.133 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-18T12:21:06.133 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T12:21:06.133 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T12:21:06.134 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T12:21:06.134 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-18T12:21:06.134 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBAzS9ltomgHhAAsfvwss4SCQiwuiMAuteIYg==", 2023-10-18T12:21:06.134 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-10-18T12:21:06.134 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-18T12:21:06.135 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T12:21:06.135 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T12:21:06.135 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T12:21:06.135 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "client.bootstrap-rgw", 2023-10-18T12:21:06.135 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQBAzS9lypWgHhAAluD3Pd8tTFONvOwTljK/BQ==", 2023-10-18T12:21:06.136 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-10-18T12:21:06.136 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-18T12:21:06.136 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T12:21:06.136 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T12:21:06.136 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T12:21:06.137 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.x", 2023-10-18T12:21:06.137 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQAazS9lzU+PNhAAoye+ayO3tsf1cPX7DqGbFw==", 2023-10-18T12:21:06.137 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-10-18T12:21:06.137 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2023-10-18T12:21:06.137 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2023-10-18T12:21:06.137 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-10-18T12:21:06.138 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T12:21:06.138 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T12:21:06.138 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T12:21:06.138 INFO:teuthology.orchestra.run.smithi114.stdout: "entity": "mgr.y", 2023-10-18T12:21:06.138 INFO:teuthology.orchestra.run.smithi114.stdout: "key": "AQAazS9lPYgEMBAAK3W1/+VlrciLsySV2Mwc3w==", 2023-10-18T12:21:06.139 INFO:teuthology.orchestra.run.smithi114.stdout: "caps": { 2023-10-18T12:21:06.139 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": "allow *", 2023-10-18T12:21:06.139 INFO:teuthology.orchestra.run.smithi114.stdout: "mon": "allow profile mgr", 2023-10-18T12:21:06.139 INFO:teuthology.orchestra.run.smithi114.stdout: "osd": "allow *" 2023-10-18T12:21:06.139 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T12:21:06.140 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T12:21:06.140 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2023-10-18T12:21:06.140 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T12:21:06.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.092+0000 7f325c2cd700 1 -- 172.21.15.114:0/440610943 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f3238065720 msgr2=0x7f3238067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:06.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.092+0000 7f325c2cd700 1 --2- 172.21.15.114:0/440610943 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f3238065720 0x7f3238067be0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3250001eb0 tx=0x7f3250007040 comp rx=0 tx=0).stop 2023-10-18T12:21:06.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.092+0000 7f325c2cd700 1 -- 172.21.15.114:0/440610943 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32541f6930 msgr2=0x7f325406d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:06.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.092+0000 7f325c2cd700 1 --2- 172.21.15.114:0/440610943 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32541f6930 0x7f325406d650 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f324000c100 tx=0x7f32440047e0 comp rx=0 tx=0).stop 2023-10-18T12:21:06.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.092+0000 7f325c2cd700 1 -- 172.21.15.114:0/440610943 shutdown_connections 2023-10-18T12:21:06.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.092+0000 7f325c2cd700 1 --2- 172.21.15.114:0/440610943 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f3238065720 0x7f3238067be0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:06.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.092+0000 7f325c2cd700 1 --2- 172.21.15.114:0/440610943 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f325406db90 0x7f325414dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:06.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.092+0000 7f325c2cd700 1 --2- 172.21.15.114:0/440610943 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32541f6930 0x7f325406d650 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:06.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.092+0000 7f325c2cd700 1 --2- 172.21.15.114:0/440610943 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f3240004870 0x7f32540d0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:06.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.092+0000 7f325c2cd700 1 -- 172.21.15.114:0/440610943 >> 172.21.15.114:0/440610943 conn(0x7f325406a130 msgr2=0x7f325406e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:06.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.096+0000 7f325c2cd700 1 -- 172.21.15.114:0/440610943 shutdown_connections 2023-10-18T12:21:06.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.096+0000 7f325c2cd700 1 -- 172.21.15.114:0/440610943 wait complete. 2023-10-18T12:21:06.144 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-18T12:21:06.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.324+0000 7f23b3fcd700 1 Processor -- start 2023-10-18T12:21:06.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.324+0000 7f23b3fcd700 1 -- start start 2023-10-18T12:21:06.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.324+0000 7f23b3fcd700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f23ac0adb60 0x7f23ac0cb190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:06.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.324+0000 7f23b3fcd700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23ac0cb6d0 0x7f23ac0cc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:06.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.324+0000 7f23b3fcd700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23ac165770 con 0x7f23ac161230 2023-10-18T12:21:06.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.324+0000 7f23b3fcd700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23ac0cbb00 con 0x7f23ac0adb60 2023-10-18T12:21:06.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.324+0000 7f23b3fcd700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac06ea40 con 0x7f23ac0cb6d0 2023-10-18T12:21:06.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.324+0000 7f23b1568700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f23ac0adb60 0x7f23ac0cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:06.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.328+0000 7f23b1568700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f23ac0adb60 0x7f23ac0cb190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36558/0 (socket says 172.21.15.114:36558) 2023-10-18T12:21:06.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.328+0000 7f23b1568700 1 -- 172.21.15.114:0/1332938755 learned_addr learned my addr 172.21.15.114:0/1332938755 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:06.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.328+0000 7f23b256a700 1 --2- 172.21.15.114:0/1332938755 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23ac0cb6d0 0x7f23ac0cc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:06.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.328+0000 7f23b1568700 1 -- 172.21.15.114:0/1332938755 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23ac0cb6d0 msgr2=0x7f23ac0cc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:06.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.328+0000 7f23b1568700 1 --2- 172.21.15.114:0/1332938755 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23ac0cb6d0 0x7f23ac0cc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:06.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.328+0000 7f23b1568700 1 -- 172.21.15.114:0/1332938755 >> v1:172.21.15.172:6789/0 conn(0x7f23ac161230 legacy=0x7f23ac06ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:06.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.328+0000 7f23b1568700 1 -- 172.21.15.114:0/1332938755 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23ac161610 con 0x7f23ac0adb60 2023-10-18T12:21:06.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.328+0000 7f23b1568700 1 --2- 172.21.15.114:0/1332938755 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f23ac0adb60 0x7f23ac0cb190 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f239c009910 tx=0x7f239c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e2df3b33cffba2f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:06.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.328+0000 7f23b0d67700 1 -- 172.21.15.114:0/1332938755 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f239c00ba60 con 0x7f23ac0adb60 2023-10-18T12:21:06.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.328+0000 7f23b0d67700 1 -- 172.21.15.114:0/1332938755 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f239c00bbc0 con 0x7f23ac0adb60 2023-10-18T12:21:06.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.328+0000 7f23b0d67700 1 -- 172.21.15.114:0/1332938755 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f239c009e60 con 0x7f23ac0adb60 2023-10-18T12:21:06.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.328+0000 7f23b3fcd700 1 -- 172.21.15.114:0/1332938755 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f23ac0adb60 msgr2=0x7f23ac0cb190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:06.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.328+0000 7f23b3fcd700 1 --2- 172.21.15.114:0/1332938755 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f23ac0adb60 0x7f23ac0cb190 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f239c009910 tx=0x7f239c009c20 comp rx=0 tx=0).stop 2023-10-18T12:21:06.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.328+0000 7f23b3fcd700 1 -- 172.21.15.114:0/1332938755 shutdown_connections 2023-10-18T12:21:06.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.328+0000 7f23b3fcd700 1 --2- 172.21.15.114:0/1332938755 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23ac0cb6d0 0x7f23ac0cc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:06.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.328+0000 7f23b3fcd700 1 --2- 172.21.15.114:0/1332938755 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f23ac0adb60 0x7f23ac0cb190 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:06.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.328+0000 7f23b3fcd700 1 -- 172.21.15.114:0/1332938755 >> 172.21.15.114:0/1332938755 conn(0x7f23ac06a340 msgr2=0x7f23ac0b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:06.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.328+0000 7f23b3fcd700 1 -- 172.21.15.114:0/1332938755 shutdown_connections 2023-10-18T12:21:06.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.328+0000 7f23b3fcd700 1 -- 172.21.15.114:0/1332938755 wait complete. 2023-10-18T12:21:06.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.332+0000 7f23b3fcd700 1 Processor -- start 2023-10-18T12:21:06.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.332+0000 7f23b3fcd700 1 -- start start 2023-10-18T12:21:06.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.336+0000 7f23b3fcd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f23ac0adb60 0x7f23ac158810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:06.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.336+0000 7f23b3fcd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23ac0cb6d0 0x7f23ac159e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:06.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.336+0000 7f23b3fcd700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23ac161230 0x7f23ac15a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:06.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.336+0000 7f23b3fcd700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac15c510 con 0x7f23ac0adb60 2023-10-18T12:21:06.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.336+0000 7f23b3fcd700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac1f6730 con 0x7f23ac0cb6d0 2023-10-18T12:21:06.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.336+0000 7f23b3fcd700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac158d50 con 0x7f23ac161230 2023-10-18T12:21:06.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.336+0000 7f23b1d69700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f23ac0adb60 0x7f23ac158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:06.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.336+0000 7f23b1d69700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f23ac0adb60 0x7f23ac158810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36570/0 (socket says 172.21.15.114:36570) 2023-10-18T12:21:06.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.336+0000 7f23b1d69700 1 -- 172.21.15.114:0/2890644272 learned_addr learned my addr 172.21.15.114:0/2890644272 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:06.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.336+0000 7f23b1568700 1 --2- 172.21.15.114:0/2890644272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23ac0cb6d0 0x7f23ac159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:06.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.336+0000 7f23b256a700 1 --2- 172.21.15.114:0/2890644272 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23ac161230 0x7f23ac15a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:06.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.336+0000 7f23b1d69700 1 -- 172.21.15.114:0/2890644272 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23ac161230 msgr2=0x7f23ac15a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:06.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.336+0000 7f23b1d69700 1 --2- 172.21.15.114:0/2890644272 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23ac161230 0x7f23ac15a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:06.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.336+0000 7f23b1d69700 1 -- 172.21.15.114:0/2890644272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23ac0cb6d0 msgr2=0x7f23ac159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:06.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.336+0000 7f23b1d69700 1 --2- 172.21.15.114:0/2890644272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23ac0cb6d0 0x7f23ac159e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:06.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.336+0000 7f23b1d69700 1 -- 172.21.15.114:0/2890644272 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f239c009570 con 0x7f23ac0adb60 2023-10-18T12:21:06.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.336+0000 7f23b1d69700 1 --2- 172.21.15.114:0/2890644272 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f23ac0adb60 0x7f23ac158810 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f23a800c500 tx=0x7f23a800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:06.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.336+0000 7f23a27fc700 1 -- 172.21.15.114:0/2890644272 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a80052d0 con 0x7f23ac0adb60 2023-10-18T12:21:06.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.336+0000 7f23a27fc700 1 -- 172.21.15.114:0/2890644272 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a8005430 con 0x7f23ac0adb60 2023-10-18T12:21:06.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.336+0000 7f23a27fc700 1 -- 172.21.15.114:0/2890644272 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a80055a0 con 0x7f23ac0adb60 2023-10-18T12:21:06.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.336+0000 7f23b3fcd700 1 -- 172.21.15.114:0/2890644272 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23ac162a10 con 0x7f23ac0adb60 2023-10-18T12:21:06.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.336+0000 7f23b3fcd700 1 -- 172.21.15.114:0/2890644272 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23ac162fd0 con 0x7f23ac0adb60 2023-10-18T12:21:06.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.340+0000 7f23b3fcd700 1 -- 172.21.15.114:0/2890644272 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23ac072e60 con 0x7f23ac0adb60 2023-10-18T12:21:06.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.340+0000 7f23a27fc700 1 -- 172.21.15.114:0/2890644272 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f23a80038e0 con 0x7f23ac0adb60 2023-10-18T12:21:06.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.344+0000 7f23a27fc700 1 --2- 172.21.15.114:0/2890644272 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2390065740 0x7f2390067c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:06.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.344+0000 7f23a27fc700 1 -- 172.21.15.114:0/2890644272 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f23a8081f40 con 0x7f23ac0adb60 2023-10-18T12:21:06.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.344+0000 7f23b1568700 1 --2- 172.21.15.114:0/2890644272 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2390065740 0x7f2390067c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:06.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.344+0000 7f23b1568700 1 --2- 172.21.15.114:0/2890644272 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2390065740 0x7f2390067c00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f239c000c00 tx=0x7f239c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:06.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.348+0000 7f23a27fc700 1 -- 172.21.15.114:0/2890644272 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f23a804fbf0 con 0x7f23ac0adb60 2023-10-18T12:21:06.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.584+0000 7f23b3fcd700 1 -- 172.21.15.114:0/2890644272 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f23ac0b1130 con 0x7f23ac0adb60 2023-10-18T12:21:06.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.592+0000 7f23a27fc700 1 -- 172.21.15.114:0/2890644272 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f23a8053210 con 0x7f23ac0adb60 2023-10-18T12:21:06.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.592+0000 7f23b3fcd700 1 -- 172.21.15.114:0/2890644272 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2390065740 msgr2=0x7f2390067c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:06.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.592+0000 7f23b3fcd700 1 --2- 172.21.15.114:0/2890644272 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2390065740 0x7f2390067c00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f239c000c00 tx=0x7f239c008030 comp rx=0 tx=0).stop 2023-10-18T12:21:06.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.592+0000 7f23b3fcd700 1 -- 172.21.15.114:0/2890644272 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f23ac0adb60 msgr2=0x7f23ac158810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:06.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.592+0000 7f23b3fcd700 1 --2- 172.21.15.114:0/2890644272 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f23ac0adb60 0x7f23ac158810 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f23a800c500 tx=0x7f23a800c810 comp rx=0 tx=0).stop 2023-10-18T12:21:06.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.592+0000 7f23b3fcd700 1 -- 172.21.15.114:0/2890644272 shutdown_connections 2023-10-18T12:21:06.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.592+0000 7f23b3fcd700 1 --2- 172.21.15.114:0/2890644272 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2390065740 0x7f2390067c00 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:06.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.592+0000 7f23b3fcd700 1 --2- 172.21.15.114:0/2890644272 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f23ac161230 0x7f23ac15a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:06.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.592+0000 7f23b3fcd700 1 --2- 172.21.15.114:0/2890644272 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23ac0cb6d0 0x7f23ac159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:06.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.592+0000 7f23b3fcd700 1 --2- 172.21.15.114:0/2890644272 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f23ac0adb60 0x7f23ac158810 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:06.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.592+0000 7f23b3fcd700 1 -- 172.21.15.114:0/2890644272 >> 172.21.15.114:0/2890644272 conn(0x7f23ac06a340 msgr2=0x7f23ac0b3580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:06.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.592+0000 7f23b3fcd700 1 -- 172.21.15.114:0/2890644272 shutdown_connections 2023-10-18T12:21:06.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.592+0000 7f23b3fcd700 1 -- 172.21.15.114:0/2890644272 wait complete. 2023-10-18T12:21:06.623 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-18T12:21:06.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.792+0000 7f28ea564700 1 Processor -- start 2023-10-18T12:21:06.797 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.792+0000 7f28ea564700 1 -- start start 2023-10-18T12:21:06.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.796+0000 7f28ea564700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f28e40cb8a0 0x7f28e416c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:06.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.796+0000 7f28ea564700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28e4165770 con 0x7f28e4161230 2023-10-18T12:21:06.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.796+0000 7f28ea564700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28e406ea40 con 0x7f28e40adb60 2023-10-18T12:21:06.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.796+0000 7f28ea564700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28e4161610 con 0x7f28e40cb8a0 2023-10-18T12:21:06.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.796+0000 7f28e3fff700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f28e4161230 0x7f28e406ced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45956/0 (socket says 172.21.15.114:45956) 2023-10-18T12:21:06.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.796+0000 7f28e3fff700 1 -- 172.21.15.114:0/4011081649 learned_addr learned my addr 172.21.15.114:0/4011081649 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:21:06.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.796+0000 7f28e8b01700 1 --2- 172.21.15.114:0/4011081649 >> v2:172.21.15.172:3300/0 conn(0x7f28e40cb8a0 0x7f28e416c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:06.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.796+0000 7f28e37fe700 1 -- 172.21.15.114:0/4011081649 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2922139367 0 0) 0x7f28e4165770 con 0x7f28e4161230 2023-10-18T12:21:06.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.796+0000 7f28e37fe700 1 -- 172.21.15.114:0/4011081649 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28d00035d0 con 0x7f28e4161230 2023-10-18T12:21:06.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.796+0000 7f28e37fe700 1 -- 172.21.15.114:0/4011081649 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2246925485 0 0) 0x7f28e406ea40 con 0x7f28e40adb60 2023-10-18T12:21:06.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.796+0000 7f28e37fe700 1 -- 172.21.15.114:0/4011081649 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28e4165770 con 0x7f28e40adb60 2023-10-18T12:21:06.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.796+0000 7f28e37fe700 1 -- 172.21.15.114:0/4011081649 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2427127974 0 0) 0x7f28d00035d0 con 0x7f28e4161230 2023-10-18T12:21:06.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.796+0000 7f28e37fe700 1 -- 172.21.15.114:0/4011081649 >> v2:172.21.15.172:3300/0 conn(0x7f28e40cb8a0 msgr2=0x7f28e416c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:06.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.796+0000 7f28e37fe700 1 --2- 172.21.15.114:0/4011081649 >> v2:172.21.15.172:3300/0 conn(0x7f28e40cb8a0 0x7f28e416c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:06.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.796+0000 7f28e37fe700 1 -- 172.21.15.114:0/4011081649 >> v1:172.21.15.172:6789/0 conn(0x7f28e40adb60 legacy=0x7f28e40cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:06.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.796+0000 7f28e37fe700 1 -- 172.21.15.114:0/4011081649 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e4165ca0 con 0x7f28e4161230 2023-10-18T12:21:06.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.796+0000 7f28e37fe700 1 -- 172.21.15.114:0/4011081649 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3368469509 0 0) 0x7f28d4001670 con 0x7f28e4161230 2023-10-18T12:21:06.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.796+0000 7f28e37fe700 1 -- 172.21.15.114:0/4011081649 >> v1:172.21.15.114:6789/0 conn(0x7f28e4161230 legacy=0x7f28e406ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:06.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.796+0000 7f28e37fe700 1 --2- 172.21.15.114:0/4011081649 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28d0003bb0 0x7f28d0003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:06.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.796+0000 7f28e37fe700 1 --2- 172.21.15.114:0/4011081649 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28d0004870 0x7f28d0004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:06.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.796+0000 7f28e37fe700 1 --2- 172.21.15.114:0/4011081649 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f28d0005230 0x7f28d000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:06.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.796+0000 7f28e37fe700 1 -- 172.21.15.114:0/4011081649 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e4161610 con 0x7f28d0004870 2023-10-18T12:21:06.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.796+0000 7f28e37fe700 1 -- 172.21.15.114:0/4011081649 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d000c160 con 0x7f28d0003bb0 2023-10-18T12:21:06.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.796+0000 7f28e37fe700 1 -- 172.21.15.114:0/4011081649 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d000c320 con 0x7f28d0005230 2023-10-18T12:21:06.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.796+0000 7f28db7fe700 1 --2- 172.21.15.114:0/4011081649 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28d0004870 0x7f28d0004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:06.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.796+0000 7f28e3fff700 1 --2- 172.21.15.114:0/4011081649 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28d0003bb0 0x7f28d0003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:06.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.796+0000 7f28e8b01700 1 --2- 172.21.15.114:0/4011081649 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f28d0005230 0x7f28d000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:06.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.796+0000 7f28db7fe700 1 -- 172.21.15.114:0/4011081649 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f28d0005230 msgr2=0x7f28d000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:06.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.796+0000 7f28db7fe700 1 --2- 172.21.15.114:0/4011081649 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f28d0005230 0x7f28d000ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:06.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.796+0000 7f28db7fe700 1 -- 172.21.15.114:0/4011081649 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28d0003bb0 msgr2=0x7f28d0003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:06.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.796+0000 7f28db7fe700 1 --2- 172.21.15.114:0/4011081649 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28d0003bb0 0x7f28d0003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:06.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.796+0000 7f28db7fe700 1 -- 172.21.15.114:0/4011081649 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d00035d0 con 0x7f28d0004870 2023-10-18T12:21:06.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.796+0000 7f28e8b01700 1 -- 172.21.15.114:0/4011081649 reap_dead start 2023-10-18T12:21:06.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.796+0000 7f28db7fe700 1 --2- 172.21.15.114:0/4011081649 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28d0004870 0x7f28d0004cf0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f28cc001960 tx=0x7f28d00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34e8ae9adc9c8360 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:06.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.796+0000 7f28e37fe700 1 -- 172.21.15.114:0/4011081649 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc001450 con 0x7f28d0004870 2023-10-18T12:21:06.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.796+0000 7f28e37fe700 1 -- 172.21.15.114:0/4011081649 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28cc0052f0 con 0x7f28d0004870 2023-10-18T12:21:06.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.796+0000 7f28e37fe700 1 -- 172.21.15.114:0/4011081649 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc001d30 con 0x7f28d0004870 2023-10-18T12:21:06.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.800+0000 7f28ea564700 1 -- 172.21.15.114:0/4011081649 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28d0004870 msgr2=0x7f28d0004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:06.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.800+0000 7f28ea564700 1 --2- 172.21.15.114:0/4011081649 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28d0004870 0x7f28d0004cf0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f28cc001960 tx=0x7f28d00058a0 comp rx=0 tx=0).stop 2023-10-18T12:21:06.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.800+0000 7f28ea564700 1 -- 172.21.15.114:0/4011081649 shutdown_connections 2023-10-18T12:21:06.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.800+0000 7f28ea564700 1 --2- 172.21.15.114:0/4011081649 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28d0004870 0x7f28d0004cf0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:06.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.800+0000 7f28ea564700 1 -- 172.21.15.114:0/4011081649 >> 172.21.15.114:0/4011081649 conn(0x7f28e406a340 msgr2=0x7f28e40b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:06.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.800+0000 7f28ea564700 1 -- 172.21.15.114:0/4011081649 shutdown_connections 2023-10-18T12:21:06.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.800+0000 7f28ea564700 1 -- 172.21.15.114:0/4011081649 wait complete. 2023-10-18T12:21:06.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.804+0000 7f28ea564700 1 Processor -- start 2023-10-18T12:21:06.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.804+0000 7f28ea564700 1 -- start start 2023-10-18T12:21:06.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.804+0000 7f28ea564700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28d0004870 0x7f28e4158c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:06.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.804+0000 7f28ea564700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f28e414dc50 0x7f28e414d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:06.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.804+0000 7f28ea564700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28e41f6470 0x7f28e40ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:06.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.804+0000 7f28ea564700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e40b2b60 con 0x7f28d0004870 2023-10-18T12:21:06.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.804+0000 7f28ea564700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e40b2550 con 0x7f28e41f6470 2023-10-18T12:21:06.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.804+0000 7f28ea564700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e415f6e0 con 0x7f28e414dc50 2023-10-18T12:21:06.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.804+0000 7f28e3fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28d0004870 0x7f28e4158c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:06.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.804+0000 7f28e3fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28d0004870 0x7f28e4158c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36592/0 (socket says 172.21.15.114:36592) 2023-10-18T12:21:06.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.804+0000 7f28e3fff700 1 -- 172.21.15.114:0/1499775957 learned_addr learned my addr 172.21.15.114:0/1499775957 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:06.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.804+0000 7f28db7fe700 1 --2- 172.21.15.114:0/1499775957 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f28e414dc50 0x7f28e414d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:06.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.804+0000 7f28e8b01700 1 --2- 172.21.15.114:0/1499775957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28e41f6470 0x7f28e40ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:06.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.804+0000 7f28e3fff700 1 -- 172.21.15.114:0/1499775957 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f28e414dc50 msgr2=0x7f28e414d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:06.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.804+0000 7f28e3fff700 1 --2- 172.21.15.114:0/1499775957 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f28e414dc50 0x7f28e414d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:06.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.804+0000 7f28e3fff700 1 -- 172.21.15.114:0/1499775957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28e41f6470 msgr2=0x7f28e40ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:06.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.804+0000 7f28e3fff700 1 --2- 172.21.15.114:0/1499775957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28e41f6470 0x7f28e40ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:06.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.804+0000 7f28e3fff700 1 -- 172.21.15.114:0/1499775957 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e40b27f0 con 0x7f28d0004870 2023-10-18T12:21:06.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.808+0000 7f28e3fff700 1 --2- 172.21.15.114:0/1499775957 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28d0004870 0x7f28e4158c90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f28d400e7b0 tx=0x7f28d400eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:06.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.808+0000 7f28e17fa700 1 -- 172.21.15.114:0/1499775957 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d40105d0 con 0x7f28d0004870 2023-10-18T12:21:06.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.808+0000 7f28e17fa700 1 -- 172.21.15.114:0/1499775957 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d4010730 con 0x7f28d0004870 2023-10-18T12:21:06.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.808+0000 7f28e17fa700 1 -- 172.21.15.114:0/1499775957 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d4010ae0 con 0x7f28d0004870 2023-10-18T12:21:06.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.808+0000 7f28ea564700 1 -- 172.21.15.114:0/1499775957 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28e415f9c0 con 0x7f28d0004870 2023-10-18T12:21:06.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.808+0000 7f28ea564700 1 -- 172.21.15.114:0/1499775957 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28e41f68f0 con 0x7f28d0004870 2023-10-18T12:21:06.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.808+0000 7f28ea564700 1 -- 172.21.15.114:0/1499775957 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28e4072e60 con 0x7f28d0004870 2023-10-18T12:21:06.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.808+0000 7f28e17fa700 1 -- 172.21.15.114:0/1499775957 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f28d4010c40 con 0x7f28d0004870 2023-10-18T12:21:06.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.812+0000 7f28e17fa700 1 --2- 172.21.15.114:0/1499775957 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f28c40656f0 0x7f28c4067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:06.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.812+0000 7f28e17fa700 1 -- 172.21.15.114:0/1499775957 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f28d4082340 con 0x7f28d0004870 2023-10-18T12:21:06.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.812+0000 7f28db7fe700 1 --2- 172.21.15.114:0/1499775957 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f28c40656f0 0x7f28c4067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:06.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.812+0000 7f28db7fe700 1 --2- 172.21.15.114:0/1499775957 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f28c40656f0 0x7f28c4067bb0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f28cc000c00 tx=0x7f28cc00a000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:06.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:06.816+0000 7f28e17fa700 1 -- 172.21.15.114:0/1499775957 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f28d4050000 con 0x7f28d0004870 2023-10-18T12:21:07.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.052+0000 7f28ea564700 1 -- 172.21.15.114:0/1499775957 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f28e40b1130 con 0x7f28d0004870 2023-10-18T12:21:07.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.060+0000 7f28e17fa700 1 -- 172.21.15.114:0/1499775957 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f28d4053620 con 0x7f28d0004870 2023-10-18T12:21:07.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.064+0000 7f28ea564700 1 -- 172.21.15.114:0/1499775957 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f28c40656f0 msgr2=0x7f28c4067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:07.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.064+0000 7f28ea564700 1 --2- 172.21.15.114:0/1499775957 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f28c40656f0 0x7f28c4067bb0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f28cc000c00 tx=0x7f28cc00a000 comp rx=0 tx=0).stop 2023-10-18T12:21:07.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.064+0000 7f28ea564700 1 -- 172.21.15.114:0/1499775957 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28d0004870 msgr2=0x7f28e4158c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:07.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.064+0000 7f28ea564700 1 --2- 172.21.15.114:0/1499775957 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28d0004870 0x7f28e4158c90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f28d400e7b0 tx=0x7f28d400eac0 comp rx=0 tx=0).stop 2023-10-18T12:21:07.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.064+0000 7f28ea564700 1 -- 172.21.15.114:0/1499775957 shutdown_connections 2023-10-18T12:21:07.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.064+0000 7f28ea564700 1 --2- 172.21.15.114:0/1499775957 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f28c40656f0 0x7f28c4067bb0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:07.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.064+0000 7f28ea564700 1 --2- 172.21.15.114:0/1499775957 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f28e414dc50 0x7f28e414d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:07.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.064+0000 7f28ea564700 1 --2- 172.21.15.114:0/1499775957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f28e41f6470 0x7f28e40ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:07.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.064+0000 7f28ea564700 1 --2- 172.21.15.114:0/1499775957 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f28d0004870 0x7f28e4158c90 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:07.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.064+0000 7f28ea564700 1 -- 172.21.15.114:0/1499775957 >> 172.21.15.114:0/1499775957 conn(0x7f28e406a340 msgr2=0x7f28e40af6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:07.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.064+0000 7f28ea564700 1 -- 172.21.15.114:0/1499775957 shutdown_connections 2023-10-18T12:21:07.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.064+0000 7f28ea564700 1 -- 172.21.15.114:0/1499775957 wait complete. 2023-10-18T12:21:07.096 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-18T12:21:07.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.264+0000 7fb14f733700 1 Processor -- start 2023-10-18T12:21:07.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.264+0000 7fb14f733700 1 -- start start 2023-10-18T12:21:07.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.264+0000 7fb14f733700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb148161230 0x7fb14806ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:07.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.264+0000 7fb14f733700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb1480adb60 0x7fb1480cb190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:07.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.264+0000 7fb14f733700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb148165770 con 0x7fb1480cb6d0 2023-10-18T12:21:07.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.264+0000 7fb14f733700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb14806ea40 con 0x7fb1480adb60 2023-10-18T12:21:07.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.264+0000 7fb14f733700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1480cbad0 con 0x7fb148161230 2023-10-18T12:21:07.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.268+0000 7fb14ccce700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb1480adb60 0x7fb1480cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:07.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.268+0000 7fb14ccce700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb1480adb60 0x7fb1480cb190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36606/0 (socket says 172.21.15.114:36606) 2023-10-18T12:21:07.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.268+0000 7fb14ccce700 1 -- 172.21.15.114:0/877289018 learned_addr learned my addr 172.21.15.114:0/877289018 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:07.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.268+0000 7fb14d4cf700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb148161230 0x7fb14806ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:07.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.268+0000 7fb14ccce700 1 -- 172.21.15.114:0/877289018 >> v2:172.21.15.172:3300/0 conn(0x7fb148161230 msgr2=0x7fb14806ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:07.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.268+0000 7fb14ccce700 1 --2- 172.21.15.114:0/877289018 >> v2:172.21.15.172:3300/0 conn(0x7fb148161230 0x7fb14806ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:07.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.268+0000 7fb14ccce700 1 -- 172.21.15.114:0/877289018 >> v1:172.21.15.172:6789/0 conn(0x7fb1480cb6d0 legacy=0x7fb14806f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:07.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.268+0000 7fb14ccce700 1 -- 172.21.15.114:0/877289018 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb148161610 con 0x7fb1480adb60 2023-10-18T12:21:07.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.268+0000 7fb14ccce700 1 --2- 172.21.15.114:0/877289018 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1480adb60 0x7fb1480cb190 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fb1480b0e60 tx=0x7fb138009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5f3c7d2b7bc385b server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:07.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.268+0000 7fb13ffff700 1 -- 172.21.15.114:0/877289018 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb138011830 con 0x7fb1480adb60 2023-10-18T12:21:07.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.268+0000 7fb13ffff700 1 -- 172.21.15.114:0/877289018 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb138011990 con 0x7fb1480adb60 2023-10-18T12:21:07.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.268+0000 7fb13ffff700 1 -- 172.21.15.114:0/877289018 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb138011d20 con 0x7fb1480adb60 2023-10-18T12:21:07.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.268+0000 7fb14f733700 1 -- 172.21.15.114:0/877289018 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1480adb60 msgr2=0x7fb1480cb190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:07.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.268+0000 7fb14f733700 1 --2- 172.21.15.114:0/877289018 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1480adb60 0x7fb1480cb190 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fb1480b0e60 tx=0x7fb138009bf0 comp rx=0 tx=0).stop 2023-10-18T12:21:07.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.268+0000 7fb14f733700 1 -- 172.21.15.114:0/877289018 shutdown_connections 2023-10-18T12:21:07.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.268+0000 7fb14f733700 1 --2- 172.21.15.114:0/877289018 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1480adb60 0x7fb1480cb190 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:07.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.268+0000 7fb14f733700 1 --2- 172.21.15.114:0/877289018 >> v2:172.21.15.172:3300/0 conn(0x7fb148161230 0x7fb14806ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:07.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.268+0000 7fb14f733700 1 -- 172.21.15.114:0/877289018 >> 172.21.15.114:0/877289018 conn(0x7fb14806a340 msgr2=0x7fb1480b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:07.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.268+0000 7fb14f733700 1 -- 172.21.15.114:0/877289018 shutdown_connections 2023-10-18T12:21:07.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.268+0000 7fb14f733700 1 -- 172.21.15.114:0/877289018 wait complete. 2023-10-18T12:21:07.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.272+0000 7fb14f733700 1 Processor -- start 2023-10-18T12:21:07.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.272+0000 7fb14f733700 1 -- start start 2023-10-18T12:21:07.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.272+0000 7fb14f733700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1480adb60 0x7fb1480a7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:07.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.272+0000 7fb14f733700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb1480cb6d0 0x7fb148158a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:07.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.272+0000 7fb14f733700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb148161230 0x7fb14815f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:07.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.272+0000 7fb14f733700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1480a8160 con 0x7fb1480adb60 2023-10-18T12:21:07.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.272+0000 7fb14f733700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb148161c90 con 0x7fb148161230 2023-10-18T12:21:07.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.272+0000 7fb14f733700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb148161f70 con 0x7fb1480cb6d0 2023-10-18T12:21:07.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.272+0000 7fb14d4cf700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1480adb60 0x7fb1480a7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:07.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.272+0000 7fb14d4cf700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1480adb60 0x7fb1480a7c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36616/0 (socket says 172.21.15.114:36616) 2023-10-18T12:21:07.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.272+0000 7fb14d4cf700 1 -- 172.21.15.114:0/1001501179 learned_addr learned my addr 172.21.15.114:0/1001501179 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:07.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.272+0000 7fb14ccce700 1 --2- 172.21.15.114:0/1001501179 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb1480cb6d0 0x7fb148158a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:07.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.272+0000 7fb14dcd0700 1 --2- 172.21.15.114:0/1001501179 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb148161230 0x7fb14815f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:07.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.276+0000 7fb14d4cf700 1 -- 172.21.15.114:0/1001501179 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb1480cb6d0 msgr2=0x7fb148158a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:07.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.276+0000 7fb14d4cf700 1 --2- 172.21.15.114:0/1001501179 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb1480cb6d0 0x7fb148158a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:07.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.276+0000 7fb14d4cf700 1 -- 172.21.15.114:0/1001501179 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb148161230 msgr2=0x7fb14815f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:07.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.276+0000 7fb14d4cf700 1 --2- 172.21.15.114:0/1001501179 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb148161230 0x7fb14815f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:07.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.276+0000 7fb14d4cf700 1 -- 172.21.15.114:0/1001501179 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb138009570 con 0x7fb1480adb60 2023-10-18T12:21:07.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.276+0000 7fb14d4cf700 1 --2- 172.21.15.114:0/1001501179 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1480adb60 0x7fb1480a7c20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb14400e9d0 tx=0x7fb14400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:07.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.276+0000 7fb13dffb700 1 -- 172.21.15.114:0/1001501179 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb144009720 con 0x7fb1480adb60 2023-10-18T12:21:07.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.276+0000 7fb13dffb700 1 -- 172.21.15.114:0/1001501179 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb14400ee70 con 0x7fb1480adb60 2023-10-18T12:21:07.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.276+0000 7fb13dffb700 1 -- 172.21.15.114:0/1001501179 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14400ca50 con 0x7fb1480adb60 2023-10-18T12:21:07.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.276+0000 7fb14f733700 1 -- 172.21.15.114:0/1001501179 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb148162250 con 0x7fb1480adb60 2023-10-18T12:21:07.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.276+0000 7fb14f733700 1 -- 172.21.15.114:0/1001501179 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb148162810 con 0x7fb1480adb60 2023-10-18T12:21:07.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.276+0000 7fb14f733700 1 -- 172.21.15.114:0/1001501179 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb148072e60 con 0x7fb1480adb60 2023-10-18T12:21:07.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.280+0000 7fb13dffb700 1 -- 172.21.15.114:0/1001501179 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fb14400cbb0 con 0x7fb1480adb60 2023-10-18T12:21:07.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.280+0000 7fb13dffb700 1 --2- 172.21.15.114:0/1001501179 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb12c0656f0 0x7fb12c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:07.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.280+0000 7fb13dffb700 1 -- 172.21.15.114:0/1001501179 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fb144082c10 con 0x7fb1480adb60 2023-10-18T12:21:07.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.280+0000 7fb14ccce700 1 --2- 172.21.15.114:0/1001501179 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb12c0656f0 0x7fb12c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:07.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.284+0000 7fb14ccce700 1 --2- 172.21.15.114:0/1001501179 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb12c0656f0 0x7fb12c067bb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb138000c00 tx=0x7fb138008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:07.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.288+0000 7fb13dffb700 1 -- 172.21.15.114:0/1001501179 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fb144054360 con 0x7fb1480adb60 2023-10-18T12:21:07.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.684+0000 7fb14f733700 1 -- 172.21.15.114:0/1001501179 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fb1480b1130 con 0x7fb1480adb60 2023-10-18T12:21:07.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.696+0000 7fb13dffb700 1 -- 172.21.15.114:0/1001501179 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb144017020 con 0x7fb1480adb60 2023-10-18T12:21:07.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.696+0000 7fb14f733700 1 -- 172.21.15.114:0/1001501179 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb12c0656f0 msgr2=0x7fb12c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:07.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.696+0000 7fb14f733700 1 --2- 172.21.15.114:0/1001501179 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb12c0656f0 0x7fb12c067bb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb138000c00 tx=0x7fb138008030 comp rx=0 tx=0).stop 2023-10-18T12:21:07.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.696+0000 7fb14f733700 1 -- 172.21.15.114:0/1001501179 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1480adb60 msgr2=0x7fb1480a7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:07.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.696+0000 7fb14f733700 1 --2- 172.21.15.114:0/1001501179 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1480adb60 0x7fb1480a7c20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb14400e9d0 tx=0x7fb14400ece0 comp rx=0 tx=0).stop 2023-10-18T12:21:07.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.700+0000 7fb14f733700 1 -- 172.21.15.114:0/1001501179 shutdown_connections 2023-10-18T12:21:07.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.700+0000 7fb14f733700 1 --2- 172.21.15.114:0/1001501179 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb12c0656f0 0x7fb12c067bb0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:07.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.700+0000 7fb14f733700 1 --2- 172.21.15.114:0/1001501179 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb1480cb6d0 0x7fb148158a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:07.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.700+0000 7fb14f733700 1 --2- 172.21.15.114:0/1001501179 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb148161230 0x7fb14815f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:07.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.700+0000 7fb14f733700 1 --2- 172.21.15.114:0/1001501179 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb1480adb60 0x7fb1480a7c20 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:07.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.700+0000 7fb14f733700 1 -- 172.21.15.114:0/1001501179 >> 172.21.15.114:0/1001501179 conn(0x7fb14806a340 msgr2=0x7fb1480b34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:07.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.700+0000 7fb14f733700 1 -- 172.21.15.114:0/1001501179 shutdown_connections 2023-10-18T12:21:07.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.700+0000 7fb14f733700 1 -- 172.21.15.114:0/1001501179 wait complete. 2023-10-18T12:21:07.727 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-18T12:21:07.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.900+0000 7fe865e19700 1 Processor -- start 2023-10-18T12:21:07.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.900+0000 7fe865e19700 1 -- start start 2023-10-18T12:21:07.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.904+0000 7fe865e19700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe8600cb8a0 0x7fe8600cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:07.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.904+0000 7fe865e19700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe8600b22f0 0x7fe8600b2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:07.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.904+0000 7fe865e19700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe860070de0 con 0x7fe860144150 2023-10-18T12:21:07.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.904+0000 7fe865e19700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8600cc270 con 0x7fe8600b22f0 2023-10-18T12:21:07.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.904+0000 7fe865e19700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8600701d0 con 0x7fe8600cb8a0 2023-10-18T12:21:07.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.904+0000 7fe865618700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe8600b22f0 0x7fe8600b2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:07.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.904+0000 7fe864e17700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fe860144150 0x7fe8600cdc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.114:49380/0 (socket says 172.21.15.114:49380) 2023-10-18T12:21:07.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.904+0000 7fe864e17700 1 -- 172.21.15.114:0/3092207060 learned_addr learned my addr 172.21.15.114:0/3092207060 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:21:07.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.904+0000 7fe85ffff700 1 --2- 172.21.15.114:0/3092207060 >> v2:172.21.15.172:3300/0 conn(0x7fe8600cb8a0 0x7fe8600cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:07.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.904+0000 7fe865618700 1 -- 172.21.15.114:0/3092207060 >> v2:172.21.15.172:3300/0 conn(0x7fe8600cb8a0 msgr2=0x7fe8600cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:07.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.904+0000 7fe865618700 1 --2- 172.21.15.114:0/3092207060 >> v2:172.21.15.172:3300/0 conn(0x7fe8600cb8a0 0x7fe8600cbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:07.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.904+0000 7fe865618700 1 -- 172.21.15.114:0/3092207060 >> v1:172.21.15.172:6789/0 conn(0x7fe860144150 legacy=0x7fe8600cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:07.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.904+0000 7fe865618700 1 -- 172.21.15.114:0/3092207060 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8600704b0 con 0x7fe8600b22f0 2023-10-18T12:21:07.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.904+0000 7fe865618700 1 --2- 172.21.15.114:0/3092207060 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8600b22f0 0x7fe8600b2740 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe86006adb0 tx=0x7fe85800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cd659e7a5f92b4d server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:07.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.904+0000 7fe85f7fe700 1 -- 172.21.15.114:0/3092207060 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85800e070 con 0x7fe8600b22f0 2023-10-18T12:21:07.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.904+0000 7fe85f7fe700 1 -- 172.21.15.114:0/3092207060 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe85800bbd0 con 0x7fe8600b22f0 2023-10-18T12:21:07.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.904+0000 7fe85f7fe700 1 -- 172.21.15.114:0/3092207060 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe858012430 con 0x7fe8600b22f0 2023-10-18T12:21:07.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.908+0000 7fe865e19700 1 -- 172.21.15.114:0/3092207060 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8600b22f0 msgr2=0x7fe8600b2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:07.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.908+0000 7fe865e19700 1 --2- 172.21.15.114:0/3092207060 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8600b22f0 0x7fe8600b2740 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe86006adb0 tx=0x7fe85800b330 comp rx=0 tx=0).stop 2023-10-18T12:21:07.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.908+0000 7fe865e19700 1 -- 172.21.15.114:0/3092207060 shutdown_connections 2023-10-18T12:21:07.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.908+0000 7fe865e19700 1 --2- 172.21.15.114:0/3092207060 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8600b22f0 0x7fe8600b2740 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:07.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.908+0000 7fe865e19700 1 --2- 172.21.15.114:0/3092207060 >> v2:172.21.15.172:3300/0 conn(0x7fe8600cb8a0 0x7fe8600cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:07.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.908+0000 7fe865e19700 1 -- 172.21.15.114:0/3092207060 >> 172.21.15.114:0/3092207060 conn(0x7fe8600b0bf0 msgr2=0x7fe8600ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:07.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.908+0000 7fe865e19700 1 -- 172.21.15.114:0/3092207060 shutdown_connections 2023-10-18T12:21:07.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.908+0000 7fe865e19700 1 -- 172.21.15.114:0/3092207060 wait complete. 2023-10-18T12:21:07.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.908+0000 7fe865e19700 1 Processor -- start 2023-10-18T12:21:07.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.912+0000 7fe865e19700 1 -- start start 2023-10-18T12:21:07.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.912+0000 7fe865e19700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8600b22f0 0x7fe8600aec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:07.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.912+0000 7fe865e19700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe8600cb8a0 0x7fe8601f4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:07.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.912+0000 7fe865e19700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe860144150 0x7fe8601f21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:07.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.912+0000 7fe865e19700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8600c5440 con 0x7fe8600b22f0 2023-10-18T12:21:07.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.912+0000 7fe865e19700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8600c50f0 con 0x7fe860144150 2023-10-18T12:21:07.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.912+0000 7fe865e19700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8600c44e0 con 0x7fe8600cb8a0 2023-10-18T12:21:07.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.912+0000 7fe864e17700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8600b22f0 0x7fe8600aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:07.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.912+0000 7fe864e17700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8600b22f0 0x7fe8600aec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36626/0 (socket says 172.21.15.114:36626) 2023-10-18T12:21:07.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.912+0000 7fe864e17700 1 -- 172.21.15.114:0/3384045937 learned_addr learned my addr 172.21.15.114:0/3384045937 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:07.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.912+0000 7fe85ffff700 1 --2- 172.21.15.114:0/3384045937 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe8600cb8a0 0x7fe8601f4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:07.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.912+0000 7fe865618700 1 --2- 172.21.15.114:0/3384045937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe860144150 0x7fe8601f21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:07.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.912+0000 7fe864e17700 1 -- 172.21.15.114:0/3384045937 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe8600cb8a0 msgr2=0x7fe8601f4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:07.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.912+0000 7fe864e17700 1 --2- 172.21.15.114:0/3384045937 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe8600cb8a0 0x7fe8601f4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:07.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.912+0000 7fe864e17700 1 -- 172.21.15.114:0/3384045937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe860144150 msgr2=0x7fe8601f21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:07.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.912+0000 7fe864e17700 1 --2- 172.21.15.114:0/3384045937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe860144150 0x7fe8601f21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:07.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.912+0000 7fe864e17700 1 -- 172.21.15.114:0/3384045937 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe858009a70 con 0x7fe8600b22f0 2023-10-18T12:21:07.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.912+0000 7fe865618700 1 --2- 172.21.15.114:0/3384045937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe860144150 0x7fe8601f21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:21:07.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.912+0000 7fe864e17700 1 --2- 172.21.15.114:0/3384045937 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8600b22f0 0x7fe8600aec10 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe85400c410 tx=0x7fe85400c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:07.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.912+0000 7fe85d7fa700 1 -- 172.21.15.114:0/3384045937 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe854005d90 con 0x7fe8600b22f0 2023-10-18T12:21:07.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.912+0000 7fe85d7fa700 1 -- 172.21.15.114:0/3384045937 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8540070d0 con 0x7fe8600b22f0 2023-10-18T12:21:07.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.912+0000 7fe85d7fa700 1 -- 172.21.15.114:0/3384045937 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe854007460 con 0x7fe8600b22f0 2023-10-18T12:21:07.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.912+0000 7fe865e19700 1 -- 172.21.15.114:0/3384045937 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8600c47c0 con 0x7fe8600b22f0 2023-10-18T12:21:07.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.912+0000 7fe865e19700 1 -- 172.21.15.114:0/3384045937 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8600c4d80 con 0x7fe8600b22f0 2023-10-18T12:21:07.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.916+0000 7fe865e19700 1 -- 172.21.15.114:0/3384045937 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe860072e60 con 0x7fe8600b22f0 2023-10-18T12:21:07.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.916+0000 7fe85d7fa700 1 -- 172.21.15.114:0/3384045937 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fe8540075c0 con 0x7fe8600b22f0 2023-10-18T12:21:07.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.916+0000 7fe85d7fa700 1 --2- 172.21.15.114:0/3384045937 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe844065720 0x7fe844067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:07.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.916+0000 7fe85d7fa700 1 -- 172.21.15.114:0/3384045937 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fe854082160 con 0x7fe8600b22f0 2023-10-18T12:21:07.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.920+0000 7fe85ffff700 1 --2- 172.21.15.114:0/3384045937 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe844065720 0x7fe844067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:07.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.920+0000 7fe85ffff700 1 --2- 172.21.15.114:0/3384045937 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe844065720 0x7fe844067be0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe8600c6590 tx=0x7fe84c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:07.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:07.924+0000 7fe85d7fa700 1 -- 172.21.15.114:0/3384045937 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fe85404fd00 con 0x7fe8600b22f0 2023-10-18T12:21:08.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.384+0000 7fe865e19700 1 -- 172.21.15.114:0/3384045937 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fe8600cb4f0 con 0x7fe8600b22f0 2023-10-18T12:21:08.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.392+0000 7fe85d7fa700 1 -- 172.21.15.114:0/3384045937 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe8540170a0 con 0x7fe8600b22f0 2023-10-18T12:21:08.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.392+0000 7fe865e19700 1 -- 172.21.15.114:0/3384045937 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe844065720 msgr2=0x7fe844067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:08.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.392+0000 7fe865e19700 1 --2- 172.21.15.114:0/3384045937 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe844065720 0x7fe844067be0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe8600c6590 tx=0x7fe84c008040 comp rx=0 tx=0).stop 2023-10-18T12:21:08.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.392+0000 7fe865e19700 1 -- 172.21.15.114:0/3384045937 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8600b22f0 msgr2=0x7fe8600aec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:08.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.392+0000 7fe865e19700 1 --2- 172.21.15.114:0/3384045937 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8600b22f0 0x7fe8600aec10 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe85400c410 tx=0x7fe85400c7d0 comp rx=0 tx=0).stop 2023-10-18T12:21:08.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.396+0000 7fe865e19700 1 -- 172.21.15.114:0/3384045937 shutdown_connections 2023-10-18T12:21:08.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.396+0000 7fe865e19700 1 --2- 172.21.15.114:0/3384045937 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe844065720 0x7fe844067be0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:08.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.396+0000 7fe865e19700 1 --2- 172.21.15.114:0/3384045937 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe8600cb8a0 0x7fe8601f4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:08.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.396+0000 7fe865e19700 1 --2- 172.21.15.114:0/3384045937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe860144150 0x7fe8601f21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:08.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.396+0000 7fe865e19700 1 --2- 172.21.15.114:0/3384045937 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe8600b22f0 0x7fe8600aec10 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:08.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.396+0000 7fe865e19700 1 -- 172.21.15.114:0/3384045937 >> 172.21.15.114:0/3384045937 conn(0x7fe8600b0bf0 msgr2=0x7fe860142e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:08.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.396+0000 7fe865e19700 1 -- 172.21.15.114:0/3384045937 shutdown_connections 2023-10-18T12:21:08.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.396+0000 7fe865e19700 1 -- 172.21.15.114:0/3384045937 wait complete. 2023-10-18T12:21:08.422 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-18T12:21:08.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.592+0000 7fb018c19700 1 Processor -- start 2023-10-18T12:21:08.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.596+0000 7fb018c19700 1 -- start start 2023-10-18T12:21:08.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.596+0000 7fb018c19700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb0140b6c70 0x7fb01406a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:08.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.596+0000 7fb018c19700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb0140b5ae0 0x7fb01406a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:08.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.596+0000 7fb018c19700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb01406e390 con 0x7fb01415cbd0 2023-10-18T12:21:08.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.596+0000 7fb018c19700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb01415cfb0 con 0x7fb0140b5ae0 2023-10-18T12:21:08.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.596+0000 7fb018c19700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0140b6050 con 0x7fb0140b6c70 2023-10-18T12:21:08.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.600+0000 7fb013fff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb0140b5ae0 0x7fb01406a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:08.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.600+0000 7fb012ffd700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb0140b6c70 0x7fb01406a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:08.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.600+0000 7fb013fff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb0140b5ae0 0x7fb01406a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:47016/0 (socket says 172.21.15.114:47016) 2023-10-18T12:21:08.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.600+0000 7fb0137fe700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fb01415cbd0 0x7fb0140b6560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.114:49382/0 (socket says 172.21.15.114:49382) 2023-10-18T12:21:08.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.600+0000 7fb013fff700 1 -- 172.21.15.114:0/1686265743 learned_addr learned my addr 172.21.15.114:0/1686265743 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:08.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.600+0000 7fb013fff700 1 -- 172.21.15.114:0/1686265743 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb0140b6c70 msgr2=0x7fb01406a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:08.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.600+0000 7fb013fff700 1 --2- 172.21.15.114:0/1686265743 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb0140b6c70 0x7fb01406a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:08.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.600+0000 7fb013fff700 1 -- 172.21.15.114:0/1686265743 >> v1:172.21.15.172:6789/0 conn(0x7fb01415cbd0 legacy=0x7fb0140b6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:08.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.600+0000 7fb013fff700 1 -- 172.21.15.114:0/1686265743 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb01406e5e0 con 0x7fb0140b5ae0 2023-10-18T12:21:08.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.600+0000 7fb012ffd700 1 --2- 172.21.15.114:0/1686265743 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb0140b6c70 0x7fb01406a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:21:08.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.600+0000 7fb0127fc700 1 -- 172.21.15.114:0/1686265743 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 291617923 0 0) 0x7fb01406e390 con 0x7fb01415cbd0 2023-10-18T12:21:08.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.600+0000 7fb013fff700 1 --2- 172.21.15.114:0/1686265743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0140b5ae0 0x7fb01406a610 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb00c009e50 tx=0x7fb00c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b943203e66ea18ca server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:08.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.600+0000 7fb0127fc700 1 -- 172.21.15.114:0/1686265743 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c00e070 con 0x7fb0140b5ae0 2023-10-18T12:21:08.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.600+0000 7fb0127fc700 1 -- 172.21.15.114:0/1686265743 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00c00b910 con 0x7fb0140b5ae0 2023-10-18T12:21:08.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.600+0000 7fb0127fc700 1 -- 172.21.15.114:0/1686265743 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c00bcc0 con 0x7fb0140b5ae0 2023-10-18T12:21:08.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.600+0000 7fb018c19700 1 -- 172.21.15.114:0/1686265743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0140b5ae0 msgr2=0x7fb01406a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:08.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.600+0000 7fb018c19700 1 --2- 172.21.15.114:0/1686265743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0140b5ae0 0x7fb01406a610 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb00c009e50 tx=0x7fb00c00b330 comp rx=0 tx=0).stop 2023-10-18T12:21:08.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.600+0000 7fb018c19700 1 -- 172.21.15.114:0/1686265743 shutdown_connections 2023-10-18T12:21:08.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.600+0000 7fb018c19700 1 --2- 172.21.15.114:0/1686265743 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb0140b6c70 0x7fb01406a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:08.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.600+0000 7fb018c19700 1 --2- 172.21.15.114:0/1686265743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0140b5ae0 0x7fb01406a610 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:08.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.600+0000 7fb018c19700 1 -- 172.21.15.114:0/1686265743 >> 172.21.15.114:0/1686265743 conn(0x7fb01406f450 msgr2=0x7fb01406f860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:08.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.604+0000 7fb018c19700 1 -- 172.21.15.114:0/1686265743 shutdown_connections 2023-10-18T12:21:08.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.604+0000 7fb018c19700 1 -- 172.21.15.114:0/1686265743 wait complete. 2023-10-18T12:21:08.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.604+0000 7fb018c19700 1 Processor -- start 2023-10-18T12:21:08.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.604+0000 7fb018c19700 1 -- start start 2023-10-18T12:21:08.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.604+0000 7fb018c19700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0140b5ae0 0x7fb0141586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:08.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.604+0000 7fb018c19700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0140b6c70 0x7fb014150240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:08.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.604+0000 7fb018c19700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb01415cbd0 0x7fb014151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:08.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.604+0000 7fb018c19700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01414fdb0 con 0x7fb0140b6c70 2023-10-18T12:21:08.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.604+0000 7fb018c19700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01414f780 con 0x7fb0140b5ae0 2023-10-18T12:21:08.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.604+0000 7fb018c19700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb014158c10 con 0x7fb01415cbd0 2023-10-18T12:21:08.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.604+0000 7fb012ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0140b6c70 0x7fb014150240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:08.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.604+0000 7fb012ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0140b6c70 0x7fb014150240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36628/0 (socket says 172.21.15.114:36628) 2023-10-18T12:21:08.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.604+0000 7fb012ffd700 1 -- 172.21.15.114:0/3151405601 learned_addr learned my addr 172.21.15.114:0/3151405601 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:08.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.608+0000 7fb0137fe700 1 --2- 172.21.15.114:0/3151405601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0140b5ae0 0x7fb0141586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:08.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.608+0000 7fb013fff700 1 --2- 172.21.15.114:0/3151405601 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb01415cbd0 0x7fb014151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:08.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.608+0000 7fb012ffd700 1 -- 172.21.15.114:0/3151405601 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb01415cbd0 msgr2=0x7fb014151c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:08.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.608+0000 7fb012ffd700 1 --2- 172.21.15.114:0/3151405601 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb01415cbd0 0x7fb014151c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:08.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.608+0000 7fb012ffd700 1 -- 172.21.15.114:0/3151405601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0140b5ae0 msgr2=0x7fb0141586d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:08.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.608+0000 7fb012ffd700 1 --2- 172.21.15.114:0/3151405601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0140b5ae0 0x7fb0141586d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:08.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.608+0000 7fb012ffd700 1 -- 172.21.15.114:0/3151405601 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0080094b0 con 0x7fb0140b6c70 2023-10-18T12:21:08.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.608+0000 7fb012ffd700 1 --2- 172.21.15.114:0/3151405601 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0140b6c70 0x7fb014150240 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb00800ebe0 tx=0x7fb00800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:08.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.608+0000 7faffbfff700 1 -- 172.21.15.114:0/3151405601 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00800c850 con 0x7fb0140b6c70 2023-10-18T12:21:08.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.608+0000 7faffbfff700 1 -- 172.21.15.114:0/3151405601 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00800c9b0 con 0x7fb0140b6c70 2023-10-18T12:21:08.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.608+0000 7fb018c19700 1 -- 172.21.15.114:0/3151405601 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb00c009b30 con 0x7fb0140b6c70 2023-10-18T12:21:08.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.608+0000 7faffbfff700 1 -- 172.21.15.114:0/3151405601 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00800cd40 con 0x7fb0140b6c70 2023-10-18T12:21:08.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.608+0000 7fb018c19700 1 -- 172.21.15.114:0/3151405601 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb01415b400 con 0x7fb0140b6c70 2023-10-18T12:21:08.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.608+0000 7fb018c19700 1 -- 172.21.15.114:0/3151405601 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb01414ff20 con 0x7fb0140b6c70 2023-10-18T12:21:08.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.612+0000 7faffbfff700 1 -- 172.21.15.114:0/3151405601 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fb008013470 con 0x7fb0140b6c70 2023-10-18T12:21:08.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.612+0000 7faffbfff700 1 --2- 172.21.15.114:0/3151405601 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb000065720 0x7fb000067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:08.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.612+0000 7faffbfff700 1 -- 172.21.15.114:0/3151405601 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fb008082c20 con 0x7fb0140b6c70 2023-10-18T12:21:08.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.612+0000 7fb0137fe700 1 --2- 172.21.15.114:0/3151405601 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb000065720 0x7fb000067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:08.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.612+0000 7fb0137fe700 1 --2- 172.21.15.114:0/3151405601 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb000065720 0x7fb000067be0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb004000f60 tx=0x7fb004007e90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:08.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:08.616+0000 7faffbfff700 1 -- 172.21.15.114:0/3151405601 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fb0080508e0 con 0x7fb0140b6c70 2023-10-18T12:21:09.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.336+0000 7fb018c19700 1 -- 172.21.15.114:0/3151405601 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fb014072e60 con 0x7fb0140b6c70 2023-10-18T12:21:09.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.348+0000 7faffbfff700 1 -- 172.21.15.114:0/3151405601 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb00800cea0 con 0x7fb0140b6c70 2023-10-18T12:21:09.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.352+0000 7fb018c19700 1 -- 172.21.15.114:0/3151405601 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb000065720 msgr2=0x7fb000067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:09.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.352+0000 7fb018c19700 1 --2- 172.21.15.114:0/3151405601 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb000065720 0x7fb000067be0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb004000f60 tx=0x7fb004007e90 comp rx=0 tx=0).stop 2023-10-18T12:21:09.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.352+0000 7fb018c19700 1 -- 172.21.15.114:0/3151405601 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0140b6c70 msgr2=0x7fb014150240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:09.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.352+0000 7fb018c19700 1 --2- 172.21.15.114:0/3151405601 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0140b6c70 0x7fb014150240 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb00800ebe0 tx=0x7fb00800eef0 comp rx=0 tx=0).stop 2023-10-18T12:21:09.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.352+0000 7fb018c19700 1 -- 172.21.15.114:0/3151405601 shutdown_connections 2023-10-18T12:21:09.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.352+0000 7fb018c19700 1 --2- 172.21.15.114:0/3151405601 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb000065720 0x7fb000067be0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:09.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.352+0000 7fb018c19700 1 --2- 172.21.15.114:0/3151405601 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb01415cbd0 0x7fb014151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:09.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.352+0000 7fb018c19700 1 --2- 172.21.15.114:0/3151405601 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0140b6c70 0x7fb014150240 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:09.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.352+0000 7fb018c19700 1 --2- 172.21.15.114:0/3151405601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0140b5ae0 0x7fb0141586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:09.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.352+0000 7fb018c19700 1 -- 172.21.15.114:0/3151405601 >> 172.21.15.114:0/3151405601 conn(0x7fb01406f450 msgr2=0x7fb0140b4050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:09.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.352+0000 7fb018c19700 1 -- 172.21.15.114:0/3151405601 shutdown_connections 2023-10-18T12:21:09.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.352+0000 7fb018c19700 1 -- 172.21.15.114:0/3151405601 wait complete. 2023-10-18T12:21:09.382 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-18T12:21:09.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.552+0000 7f91de44d700 1 Processor -- start 2023-10-18T12:21:09.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.552+0000 7f91de44d700 1 -- start start 2023-10-18T12:21:09.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.556+0000 7f91de44d700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f91d8146800 0x7f91d80b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:09.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.556+0000 7f91de44d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f91d815dd30 0x7f91d806f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:09.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.556+0000 7f91de44d700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91d815e680 con 0x7f91d806fee0 2023-10-18T12:21:09.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.556+0000 7f91de44d700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91d8070310 con 0x7f91d815dd30 2023-10-18T12:21:09.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.556+0000 7f91de44d700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91d80b6180 con 0x7f91d8146800 2023-10-18T12:21:09.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.556+0000 7f91d7fff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f91d8146800 0x7f91d80b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:09.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.556+0000 7f91dc9ea700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f91d806fee0 0x7f91d81608a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.114:49388/0 (socket says 172.21.15.114:49388) 2023-10-18T12:21:09.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.556+0000 7f91dc9ea700 1 -- 172.21.15.114:0/3015273795 learned_addr learned my addr 172.21.15.114:0/3015273795 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:21:09.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.556+0000 7f91cf7fe700 1 --2- 172.21.15.114:0/3015273795 >> v2:172.21.15.114:3300/0 conn(0x7f91d815dd30 0x7f91d806f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:09.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.556+0000 7f91d7fff700 1 -- 172.21.15.114:0/3015273795 >> v2:172.21.15.114:3300/0 conn(0x7f91d815dd30 msgr2=0x7f91d806f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:09.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.556+0000 7f91d7fff700 1 --2- 172.21.15.114:0/3015273795 >> v2:172.21.15.114:3300/0 conn(0x7f91d815dd30 0x7f91d806f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:09.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.556+0000 7f91d7fff700 1 -- 172.21.15.114:0/3015273795 >> v1:172.21.15.172:6789/0 conn(0x7f91d806fee0 legacy=0x7f91d81608a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:09.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.556+0000 7f91d7fff700 1 -- 172.21.15.114:0/3015273795 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d80b6460 con 0x7f91d8146800 2023-10-18T12:21:09.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.556+0000 7f91d77fe700 1 -- 172.21.15.114:0/3015273795 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3171501123 0 0) 0x7f91d815e680 con 0x7f91d806fee0 2023-10-18T12:21:09.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.556+0000 7f91cf7fe700 1 --2- 172.21.15.114:0/3015273795 >> v2:172.21.15.114:3300/0 conn(0x7f91d815dd30 0x7f91d806f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:21:09.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.556+0000 7f91d7fff700 1 --2- 172.21.15.114:0/3015273795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91d8146800 0x7f91d80b5b80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f91d80706b0 tx=0x7f91c8009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d953973f1892649f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:09.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.556+0000 7f91d77fe700 1 -- 172.21.15.114:0/3015273795 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c8011830 con 0x7f91d8146800 2023-10-18T12:21:09.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.556+0000 7f91d77fe700 1 -- 172.21.15.114:0/3015273795 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c8011990 con 0x7f91d8146800 2023-10-18T12:21:09.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.556+0000 7f91d77fe700 1 -- 172.21.15.114:0/3015273795 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c8011d20 con 0x7f91d8146800 2023-10-18T12:21:09.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.560+0000 7f91de44d700 1 -- 172.21.15.114:0/3015273795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91d8146800 msgr2=0x7f91d80b5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:09.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.560+0000 7f91de44d700 1 --2- 172.21.15.114:0/3015273795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91d8146800 0x7f91d80b5b80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f91d80706b0 tx=0x7f91c8009b30 comp rx=0 tx=0).stop 2023-10-18T12:21:09.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.560+0000 7f91de44d700 1 -- 172.21.15.114:0/3015273795 shutdown_connections 2023-10-18T12:21:09.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.560+0000 7f91de44d700 1 --2- 172.21.15.114:0/3015273795 >> v2:172.21.15.114:3300/0 conn(0x7f91d815dd30 0x7f91d806f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:09.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.560+0000 7f91de44d700 1 --2- 172.21.15.114:0/3015273795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91d8146800 0x7f91d80b5b80 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:09.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.560+0000 7f91de44d700 1 -- 172.21.15.114:0/3015273795 >> 172.21.15.114:0/3015273795 conn(0x7f91d806a130 msgr2=0x7f91d806a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:09.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.560+0000 7f91de44d700 1 -- 172.21.15.114:0/3015273795 shutdown_connections 2023-10-18T12:21:09.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.560+0000 7f91de44d700 1 -- 172.21.15.114:0/3015273795 wait complete. 2023-10-18T12:21:09.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.560+0000 7f91de44d700 1 Processor -- start 2023-10-18T12:21:09.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.560+0000 7f91de44d700 1 -- start start 2023-10-18T12:21:09.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.560+0000 7f91de44d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91d806fee0 0x7f91d813fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:09.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.560+0000 7f91de44d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91d8146800 0x7f91d80c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:09.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.560+0000 7f91de44d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91d815dd30 0x7f91d81ef770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:09.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.560+0000 7f91de44d700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d81f3a50 con 0x7f91d806fee0 2023-10-18T12:21:09.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.560+0000 7f91de44d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d8140600 con 0x7f91d815dd30 2023-10-18T12:21:09.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.560+0000 7f91de44d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d81408e0 con 0x7f91d8146800 2023-10-18T12:21:09.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.564+0000 7f91d7fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91d806fee0 0x7f91d813fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:09.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.564+0000 7f91d7fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91d806fee0 0x7f91d813fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36644/0 (socket says 172.21.15.114:36644) 2023-10-18T12:21:09.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.564+0000 7f91d7fff700 1 -- 172.21.15.114:0/665616227 learned_addr learned my addr 172.21.15.114:0/665616227 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:09.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.564+0000 7f91cf7fe700 1 --2- 172.21.15.114:0/665616227 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91d8146800 0x7f91d80c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:09.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.564+0000 7f91dc9ea700 1 --2- 172.21.15.114:0/665616227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91d815dd30 0x7f91d81ef770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:09.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.564+0000 7f91d7fff700 1 -- 172.21.15.114:0/665616227 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91d8146800 msgr2=0x7f91d80c80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:09.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.564+0000 7f91d7fff700 1 --2- 172.21.15.114:0/665616227 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91d8146800 0x7f91d80c80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:09.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.564+0000 7f91d7fff700 1 -- 172.21.15.114:0/665616227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91d815dd30 msgr2=0x7f91d81ef770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:09.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.564+0000 7f91d7fff700 1 --2- 172.21.15.114:0/665616227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91d815dd30 0x7f91d81ef770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:09.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.564+0000 7f91d7fff700 1 -- 172.21.15.114:0/665616227 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c00094b0 con 0x7f91d806fee0 2023-10-18T12:21:09.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.564+0000 7f91dc9ea700 1 --2- 172.21.15.114:0/665616227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91d815dd30 0x7f91d81ef770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:21:09.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.564+0000 7f91d7fff700 1 --2- 172.21.15.114:0/665616227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91d806fee0 0x7f91d813fdb0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f91c8009fd0 tx=0x7f91c8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:09.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.564+0000 7f91d57fa700 1 -- 172.21.15.114:0/665616227 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c80045b0 con 0x7f91d806fee0 2023-10-18T12:21:09.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.564+0000 7f91d57fa700 1 -- 172.21.15.114:0/665616227 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c801f070 con 0x7f91d806fee0 2023-10-18T12:21:09.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.564+0000 7f91de44d700 1 -- 172.21.15.114:0/665616227 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91c80094b0 con 0x7f91d806fee0 2023-10-18T12:21:09.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.564+0000 7f91d57fa700 1 -- 172.21.15.114:0/665616227 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c80038e0 con 0x7f91d806fee0 2023-10-18T12:21:09.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.564+0000 7f91de44d700 1 -- 172.21.15.114:0/665616227 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91d81402f0 con 0x7f91d806fee0 2023-10-18T12:21:09.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.564+0000 7f91de44d700 1 -- 172.21.15.114:0/665616227 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91d8140e00 con 0x7f91d806fee0 2023-10-18T12:21:09.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.568+0000 7f91d57fa700 1 -- 172.21.15.114:0/665616227 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f91c8021030 con 0x7f91d806fee0 2023-10-18T12:21:09.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.568+0000 7f91d57fa700 1 --2- 172.21.15.114:0/665616227 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f91bc0656f0 0x7f91bc067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:09.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.568+0000 7f91d57fa700 1 -- 172.21.15.114:0/665616227 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f91c8084080 con 0x7f91d806fee0 2023-10-18T12:21:09.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.568+0000 7f91cf7fe700 1 --2- 172.21.15.114:0/665616227 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f91bc0656f0 0x7f91bc067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:09.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.572+0000 7f91cf7fe700 1 --2- 172.21.15.114:0/665616227 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f91bc0656f0 0x7f91bc067bb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f91d815cd10 tx=0x7f91c0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:09.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.572+0000 7f91d57fa700 1 -- 172.21.15.114:0/665616227 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f91c80b4d40 con 0x7f91d806fee0 2023-10-18T12:21:09.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.984+0000 7f91de44d700 1 -- 172.21.15.114:0/665616227 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f91d8072e60 con 0x7f91d806fee0 2023-10-18T12:21:10.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:09.996+0000 7f91d57fa700 1 -- 172.21.15.114:0/665616227 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f91d8140e00 con 0x7f91d806fee0 2023-10-18T12:21:10.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.000+0000 7f91de44d700 1 -- 172.21.15.114:0/665616227 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f91bc0656f0 msgr2=0x7f91bc067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:10.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.000+0000 7f91de44d700 1 --2- 172.21.15.114:0/665616227 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f91bc0656f0 0x7f91bc067bb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f91d815cd10 tx=0x7f91c0008040 comp rx=0 tx=0).stop 2023-10-18T12:21:10.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.000+0000 7f91de44d700 1 -- 172.21.15.114:0/665616227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91d806fee0 msgr2=0x7f91d813fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:10.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.000+0000 7f91de44d700 1 --2- 172.21.15.114:0/665616227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91d806fee0 0x7f91d813fdb0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f91c8009fd0 tx=0x7f91c8004770 comp rx=0 tx=0).stop 2023-10-18T12:21:10.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.000+0000 7f91de44d700 1 -- 172.21.15.114:0/665616227 shutdown_connections 2023-10-18T12:21:10.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.000+0000 7f91de44d700 1 --2- 172.21.15.114:0/665616227 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f91bc0656f0 0x7f91bc067bb0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:10.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.000+0000 7f91de44d700 1 --2- 172.21.15.114:0/665616227 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91d8146800 0x7f91d80c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:10.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.000+0000 7f91de44d700 1 --2- 172.21.15.114:0/665616227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91d815dd30 0x7f91d81ef770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:10.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.000+0000 7f91de44d700 1 --2- 172.21.15.114:0/665616227 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91d806fee0 0x7f91d813fdb0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:10.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.000+0000 7f91de44d700 1 -- 172.21.15.114:0/665616227 >> 172.21.15.114:0/665616227 conn(0x7f91d806a130 msgr2=0x7f91d815f190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:10.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.000+0000 7f91de44d700 1 -- 172.21.15.114:0/665616227 shutdown_connections 2023-10-18T12:21:10.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.000+0000 7f91de44d700 1 -- 172.21.15.114:0/665616227 wait complete. 2023-10-18T12:21:10.029 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T12:21:10.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.204+0000 7f2f97e45700 1 Processor -- start 2023-10-18T12:21:10.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.204+0000 7f2f97e45700 1 -- start start 2023-10-18T12:21:10.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.204+0000 7f2f97e45700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2f9015ee50 0x7f2f900cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:10.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.204+0000 7f2f97e45700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2f9006e8a0 0x7f2f900caf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:10.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.204+0000 7f2f97e45700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f900cb8c0 con 0x7f2f900cb470 2023-10-18T12:21:10.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.204+0000 7f2f97e45700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f9006d4e0 con 0x7f2f9015ee50 2023-10-18T12:21:10.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.204+0000 7f2f97e45700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f90162780 con 0x7f2f9006e8a0 2023-10-18T12:21:10.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.204+0000 7f2f95be1700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2f9015ee50 0x7f2f900cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:10.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.204+0000 7f2f95be1700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2f9015ee50 0x7f2f900cc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36652/0 (socket says 172.21.15.114:36652) 2023-10-18T12:21:10.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.204+0000 7f2f95be1700 1 -- 172.21.15.114:0/991101471 learned_addr learned my addr 172.21.15.114:0/991101471 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:10.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.204+0000 7f2f953e0700 1 --2- 172.21.15.114:0/991101471 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2f9006e8a0 0x7f2f900caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:10.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.208+0000 7f2f95be1700 1 -- 172.21.15.114:0/991101471 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2f9006e8a0 msgr2=0x7f2f900caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:10.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.208+0000 7f2f95be1700 1 --2- 172.21.15.114:0/991101471 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2f9006e8a0 0x7f2f900caf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:10.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.208+0000 7f2f95be1700 1 -- 172.21.15.114:0/991101471 >> v1:172.21.15.172:6789/0 conn(0x7f2f900cb470 legacy=0x7f2f9006f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:10.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.208+0000 7f2f94bdf700 1 -- 172.21.15.114:0/991101471 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 727977194 0 0) 0x7f2f88001490 con 0x7f2f900cb470 2023-10-18T12:21:10.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.208+0000 7f2f95be1700 1 -- 172.21.15.114:0/991101471 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f9006f450 con 0x7f2f9015ee50 2023-10-18T12:21:10.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.208+0000 7f2f953e0700 1 --2- 172.21.15.114:0/991101471 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2f9006e8a0 0x7f2f900caf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:21:10.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.208+0000 7f2f95be1700 1 --2- 172.21.15.114:0/991101471 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f9015ee50 0x7f2f900cc680 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c009910 tx=0x7f2f8c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53efcd8af980e7e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:10.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.208+0000 7f2f94bdf700 1 -- 172.21.15.114:0/991101471 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8c011830 con 0x7f2f9015ee50 2023-10-18T12:21:10.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.208+0000 7f2f94bdf700 1 -- 172.21.15.114:0/991101471 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8c011990 con 0x7f2f9015ee50 2023-10-18T12:21:10.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.208+0000 7f2f94bdf700 1 -- 172.21.15.114:0/991101471 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8c011d40 con 0x7f2f9015ee50 2023-10-18T12:21:10.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.208+0000 7f2f97e45700 1 -- 172.21.15.114:0/991101471 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f9015ee50 msgr2=0x7f2f900cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:10.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.208+0000 7f2f97e45700 1 --2- 172.21.15.114:0/991101471 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f9015ee50 0x7f2f900cc680 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c009910 tx=0x7f2f8c009c20 comp rx=0 tx=0).stop 2023-10-18T12:21:10.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.208+0000 7f2f97e45700 1 -- 172.21.15.114:0/991101471 shutdown_connections 2023-10-18T12:21:10.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.208+0000 7f2f97e45700 1 --2- 172.21.15.114:0/991101471 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2f9006e8a0 0x7f2f900caf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:10.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.208+0000 7f2f97e45700 1 --2- 172.21.15.114:0/991101471 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f9015ee50 0x7f2f900cc680 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:10.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.208+0000 7f2f97e45700 1 -- 172.21.15.114:0/991101471 >> 172.21.15.114:0/991101471 conn(0x7f2f9006a340 msgr2=0x7f2f900b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:10.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.208+0000 7f2f97e45700 1 -- 172.21.15.114:0/991101471 shutdown_connections 2023-10-18T12:21:10.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.208+0000 7f2f97e45700 1 -- 172.21.15.114:0/991101471 wait complete. 2023-10-18T12:21:10.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.212+0000 7f2f97e45700 1 Processor -- start 2023-10-18T12:21:10.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.212+0000 7f2f97e45700 1 -- start start 2023-10-18T12:21:10.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.212+0000 7f2f97e45700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2f9006e8a0 0x7f2f9015dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:10.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.212+0000 7f2f97e45700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f900cb470 0x7f2f90152020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:10.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.212+0000 7f2f97e45700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f9015ee50 0x7f2f900af580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:10.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.212+0000 7f2f97e45700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f90152560 con 0x7f2f9015ee50 2023-10-18T12:21:10.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.212+0000 7f2f97e45700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f90155790 con 0x7f2f900cb470 2023-10-18T12:21:10.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.212+0000 7f2f97e45700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f90155460 con 0x7f2f9006e8a0 2023-10-18T12:21:10.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.216+0000 7f2f963e2700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f9015ee50 0x7f2f900af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:10.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.216+0000 7f2f963e2700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f9015ee50 0x7f2f900af580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36668/0 (socket says 172.21.15.114:36668) 2023-10-18T12:21:10.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.216+0000 7f2f963e2700 1 -- 172.21.15.114:0/1073864645 learned_addr learned my addr 172.21.15.114:0/1073864645 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:10.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.216+0000 7f2f95be1700 1 --2- 172.21.15.114:0/1073864645 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2f9006e8a0 0x7f2f9015dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:10.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.216+0000 7f2f963e2700 1 -- 172.21.15.114:0/1073864645 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2f9006e8a0 msgr2=0x7f2f9015dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:10.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.216+0000 7f2f963e2700 1 --2- 172.21.15.114:0/1073864645 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2f9006e8a0 0x7f2f9015dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:10.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.216+0000 7f2f963e2700 1 -- 172.21.15.114:0/1073864645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f900cb470 msgr2=0x7f2f90152020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:10.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.216+0000 7f2f963e2700 1 --2- 172.21.15.114:0/1073864645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f900cb470 0x7f2f90152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:10.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.216+0000 7f2f963e2700 1 -- 172.21.15.114:0/1073864645 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f800094b0 con 0x7f2f9015ee50 2023-10-18T12:21:10.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.216+0000 7f2f963e2700 1 --2- 172.21.15.114:0/1073864645 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f9015ee50 0x7f2f900af580 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f2f8800cca0 tx=0x7f2f8800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:10.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.216+0000 7f2f867fc700 1 -- 172.21.15.114:0/1073864645 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f88003e50 con 0x7f2f9015ee50 2023-10-18T12:21:10.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.216+0000 7f2f97e45700 1 -- 172.21.15.114:0/1073864645 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f8c009570 con 0x7f2f9015ee50 2023-10-18T12:21:10.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.216+0000 7f2f867fc700 1 -- 172.21.15.114:0/1073864645 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8800a7d0 con 0x7f2f9015ee50 2023-10-18T12:21:10.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.216+0000 7f2f867fc700 1 -- 172.21.15.114:0/1073864645 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8800ab80 con 0x7f2f9015ee50 2023-10-18T12:21:10.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.216+0000 7f2f97e45700 1 -- 172.21.15.114:0/1073864645 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f900b0090 con 0x7f2f9015ee50 2023-10-18T12:21:10.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.216+0000 7f2f97e45700 1 -- 172.21.15.114:0/1073864645 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f90155920 con 0x7f2f9015ee50 2023-10-18T12:21:10.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.220+0000 7f2f867fc700 1 -- 172.21.15.114:0/1073864645 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f2f8800ace0 con 0x7f2f9015ee50 2023-10-18T12:21:10.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.220+0000 7f2f867fc700 1 --2- 172.21.15.114:0/1073864645 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2f740656f0 0x7f2f74067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:10.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.220+0000 7f2f867fc700 1 -- 172.21.15.114:0/1073864645 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f2f88082680 con 0x7f2f9015ee50 2023-10-18T12:21:10.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.220+0000 7f2f95be1700 1 --2- 172.21.15.114:0/1073864645 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2f740656f0 0x7f2f74067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:10.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.224+0000 7f2f95be1700 1 --2- 172.21.15.114:0/1073864645 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2f740656f0 0x7f2f74067bb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c000c00 tx=0x7f2f8c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:10.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.228+0000 7f2f867fc700 1 -- 172.21.15.114:0/1073864645 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f2f88050230 con 0x7f2f9015ee50 2023-10-18T12:21:10.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.404+0000 7f2f97e45700 1 -- 172.21.15.114:0/1073864645 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f900cb8c0 con 0x7f2f9015ee50 2023-10-18T12:21:10.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.408+0000 7f2f867fc700 1 -- 172.21.15.114:0/1073864645 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+14868 (secure 0 0 0) 0x7f2f900cb8c0 con 0x7f2f9015ee50 2023-10-18T12:21:10.413 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:21:10.413 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":38,"fsid":"240ea340-5d3d-4f52-a4bc-af075aca3deb","created":"2023-10-18T12:19:12.512994+0000","modified":"2023-10-18T12:21:05.618970+0000","last_up_change":"2023-10-18T12:19:25.286009+0000","last_in_change":"2023-10-18T12:19:15.850693+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T12:19:27.040638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-18T12:19:32.358094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c3578978-1a03-4857-b9d2-34a5da3d7731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6817","nonce":1506287862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6820","nonce":1506287862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6830","nonce":1506287862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6825","nonce":1506287862}]},"public_addr":"172.21.15.114:6817/1506287862","cluster_addr":"172.21.15.114:6820/1506287862","heartbeat_back_addr":"172.21.15.114:6830/1506287862","heartbeat_front_addr":"172.21.15.114:6825/1506287862","state":["exists","up"]},{"osd":1,"uuid":"43eb26a6-e2b3-4670-9559-bd053b5140d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6801","nonce":3302727047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6803","nonce":3302727047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6807","nonce":3302727047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6805","nonce":3302727047}]},"public_addr":"172.21.15.114:6801/3302727047","cluster_addr":"172.21.15.114:6803/3302727047","heartbeat_back_addr":"172.21.15.114:6807/3302727047","heartbeat_front_addr":"172.21.15.114:6805/3302727047","state":["exists","up"]},{"osd":2,"uuid":"f3d4dbd5-521c-4dd2-b687-5768cc7d0938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6809","nonce":2699151351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6811","nonce":2699151351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6815","nonce":2699151351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6813","nonce":2699151351}]},"public_addr":"172.21.15.114:6809/2699151351","cluster_addr":"172.21.15.114:6811/2699151351","heartbeat_back_addr":"172.21.15.114:6815/2699151351","heartbeat_front_addr":"172.21.15.114:6813/2699151351","state":["exists","up"]},{"osd":3,"uuid":"823e5802-92b7-4f0d-b32d-a5748993f1b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6821","nonce":1361608073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6824","nonce":1361608073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6829","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6831","nonce":1361608073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6827","nonce":1361608073}]},"public_addr":"172.21.15.114:6821/1361608073","cluster_addr":"172.21.15.114:6824/1361608073","heartbeat_back_addr":"172.21.15.114:6831/1361608073","heartbeat_front_addr":"172.21.15.114:6827/1361608073","state":["exists","up"]},{"osd":4,"uuid":"e47fb93e-13b4-44a4-b084-8c4384ceb41e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6801","nonce":930839681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6803","nonce":930839681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6807","nonce":930839681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6805","nonce":930839681}]},"public_addr":"172.21.15.172:6801/930839681","cluster_addr":"172.21.15.172:6803/930839681","heartbeat_back_addr":"172.21.15.172:6807/930839681","heartbeat_front_addr":"172.21.15.172:6805/930839681","state":["exists","up"]},{"osd":5,"uuid":"7561a973-f479-45a0-af40-f324728d622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6814","nonce":571761850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6818","nonce":571761850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6824","nonce":571761850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6821","nonce":571761850}]},"public_addr":"172.21.15.172:6814/571761850","cluster_addr":"172.21.15.172:6818/571761850","heartbeat_back_addr":"172.21.15.172:6824/571761850","heartbeat_front_addr":"172.21.15.172:6821/571761850","state":["exists","up"]},{"osd":6,"uuid":"51753f4b-7f06-4f1c-9ec7-6e18a66eb980","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6825","nonce":1680398853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6827","nonce":1680398853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6831","nonce":1680398853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6829","nonce":1680398853}]},"public_addr":"172.21.15.172:6825/1680398853","cluster_addr":"172.21.15.172:6827/1680398853","heartbeat_back_addr":"172.21.15.172:6831/1680398853","heartbeat_front_addr":"172.21.15.172:6829/1680398853","state":["exists","up"]},{"osd":7,"uuid":"4d8b1e15-143d-4d17-9074-59d92f0f9af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6809","nonce":349710101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6811","nonce":349710101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6819","nonce":349710101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6815","nonce":349710101}]},"public_addr":"172.21.15.172:6809/349710101","cluster_addr":"172.21.15.172:6811/349710101","heartbeat_back_addr":"172.21.15.172:6819/349710101","heartbeat_front_addr":"172.21.15.172:6815/349710101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.889460+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.475494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.911473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.648596+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.609994+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.636248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.854589+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.885826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T12:21:10.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.408+0000 7f2f97e45700 1 -- 172.21.15.114:0/1073864645 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2f740656f0 msgr2=0x7f2f74067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:10.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.408+0000 7f2f97e45700 1 --2- 172.21.15.114:0/1073864645 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2f740656f0 0x7f2f74067bb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c000c00 tx=0x7f2f8c008030 comp rx=0 tx=0).stop 2023-10-18T12:21:10.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.408+0000 7f2f97e45700 1 -- 172.21.15.114:0/1073864645 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f9015ee50 msgr2=0x7f2f900af580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:10.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.408+0000 7f2f97e45700 1 --2- 172.21.15.114:0/1073864645 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f9015ee50 0x7f2f900af580 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f2f8800cca0 tx=0x7f2f8800a060 comp rx=0 tx=0).stop 2023-10-18T12:21:10.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.408+0000 7f2f97e45700 1 -- 172.21.15.114:0/1073864645 shutdown_connections 2023-10-18T12:21:10.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.408+0000 7f2f97e45700 1 --2- 172.21.15.114:0/1073864645 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2f740656f0 0x7f2f74067bb0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:10.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.408+0000 7f2f97e45700 1 --2- 172.21.15.114:0/1073864645 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f9015ee50 0x7f2f900af580 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:10.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.408+0000 7f2f97e45700 1 --2- 172.21.15.114:0/1073864645 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f900cb470 0x7f2f90152020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:10.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.408+0000 7f2f97e45700 1 --2- 172.21.15.114:0/1073864645 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2f9006e8a0 0x7f2f9015dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:10.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.408+0000 7f2f97e45700 1 -- 172.21.15.114:0/1073864645 >> 172.21.15.114:0/1073864645 conn(0x7f2f9006a340 msgr2=0x7f2f9015fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:10.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.408+0000 7f2f97e45700 1 -- 172.21.15.114:0/1073864645 shutdown_connections 2023-10-18T12:21:10.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.408+0000 7f2f97e45700 1 -- 172.21.15.114:0/1073864645 wait complete. 2023-10-18T12:21:10.437 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-18T12:19:27.040638+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-18T12:19:32.358094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-18T12:21:10.438 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-18T12:21:10.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.612+0000 7efcab4f0700 1 Processor -- start 2023-10-18T12:21:10.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.612+0000 7efcab4f0700 1 -- start start 2023-10-18T12:21:10.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.612+0000 7efcab4f0700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efca4160f60 0x7efca40b7000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:10.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.612+0000 7efcab4f0700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7efca40d3660 0x7efca4161340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:10.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.612+0000 7efcab4f0700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efca40cf700 con 0x7efca40cef60 2023-10-18T12:21:10.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.612+0000 7efcab4f0700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efca4165c40 con 0x7efca4160f60 2023-10-18T12:21:10.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.612+0000 7efcab4f0700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efca406d7d0 con 0x7efca40d3660 2023-10-18T12:21:10.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.616+0000 7efca928c700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7efca4160f60 0x7efca40b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:10.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.616+0000 7efca8a8b700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7efca40cef60 0x7efca40d2f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45960/0 (socket says 172.21.15.114:45960) 2023-10-18T12:21:10.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.616+0000 7efca8a8b700 1 -- 172.21.15.114:0/2109342158 learned_addr learned my addr 172.21.15.114:0/2109342158 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:21:10.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.616+0000 7efca9a8d700 1 --2- 172.21.15.114:0/2109342158 >> v2:172.21.15.172:3300/0 conn(0x7efca40d3660 0x7efca4161340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:10.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.616+0000 7efca928c700 1 -- 172.21.15.114:0/2109342158 >> v2:172.21.15.172:3300/0 conn(0x7efca40d3660 msgr2=0x7efca4161340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:10.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.616+0000 7efca928c700 1 --2- 172.21.15.114:0/2109342158 >> v2:172.21.15.172:3300/0 conn(0x7efca40d3660 0x7efca4161340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:10.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.616+0000 7efca928c700 1 -- 172.21.15.114:0/2109342158 >> v1:172.21.15.114:6789/0 conn(0x7efca40cef60 legacy=0x7efca40d2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:10.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.616+0000 7efca928c700 1 -- 172.21.15.114:0/2109342158 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca4164e80 con 0x7efca4160f60 2023-10-18T12:21:10.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.616+0000 7efca928c700 1 --2- 172.21.15.114:0/2109342158 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efca4160f60 0x7efca40b7000 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7efca408e2e0 tx=0x7efca0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=752d037b67ccf4a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:10.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.616+0000 7efc9bfff700 1 -- 172.21.15.114:0/2109342158 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca0011830 con 0x7efca4160f60 2023-10-18T12:21:10.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.616+0000 7efc9bfff700 1 -- 172.21.15.114:0/2109342158 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca0011990 con 0x7efca4160f60 2023-10-18T12:21:10.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.616+0000 7efc9bfff700 1 -- 172.21.15.114:0/2109342158 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca0011d20 con 0x7efca4160f60 2023-10-18T12:21:10.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.616+0000 7efcab4f0700 1 -- 172.21.15.114:0/2109342158 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efca4160f60 msgr2=0x7efca40b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:10.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.616+0000 7efcab4f0700 1 --2- 172.21.15.114:0/2109342158 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efca4160f60 0x7efca40b7000 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7efca408e2e0 tx=0x7efca0009b30 comp rx=0 tx=0).stop 2023-10-18T12:21:10.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.616+0000 7efcab4f0700 1 -- 172.21.15.114:0/2109342158 shutdown_connections 2023-10-18T12:21:10.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.616+0000 7efcab4f0700 1 --2- 172.21.15.114:0/2109342158 >> v2:172.21.15.172:3300/0 conn(0x7efca40d3660 0x7efca4161340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:10.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.616+0000 7efcab4f0700 1 --2- 172.21.15.114:0/2109342158 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efca4160f60 0x7efca40b7000 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:10.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.616+0000 7efcab4f0700 1 -- 172.21.15.114:0/2109342158 >> 172.21.15.114:0/2109342158 conn(0x7efca4069f20 msgr2=0x7efca406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:10.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.616+0000 7efcab4f0700 1 -- 172.21.15.114:0/2109342158 shutdown_connections 2023-10-18T12:21:10.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.616+0000 7efcab4f0700 1 -- 172.21.15.114:0/2109342158 wait complete. 2023-10-18T12:21:10.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.620+0000 7efcab4f0700 1 Processor -- start 2023-10-18T12:21:10.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.620+0000 7efcab4f0700 1 -- start start 2023-10-18T12:21:10.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.624+0000 7efcab4f0700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efca40cef60 0x7efca40b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:10.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.624+0000 7efcab4f0700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efca40d3660 0x7efca414da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:10.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.624+0000 7efcab4f0700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efca4160f60 0x7efca414df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:10.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.624+0000 7efcab4f0700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca41627f0 con 0x7efca40cef60 2023-10-18T12:21:10.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.624+0000 7efcab4f0700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca415a610 con 0x7efca4160f60 2023-10-18T12:21:10.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.624+0000 7efcab4f0700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca41f6c00 con 0x7efca40d3660 2023-10-18T12:21:10.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.624+0000 7efca928c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efca40cef60 0x7efca40b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:10.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.624+0000 7efca928c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efca40cef60 0x7efca40b2f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36680/0 (socket says 172.21.15.114:36680) 2023-10-18T12:21:10.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.624+0000 7efca928c700 1 -- 172.21.15.114:0/771168818 learned_addr learned my addr 172.21.15.114:0/771168818 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:10.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.624+0000 7efca9a8d700 1 --2- 172.21.15.114:0/771168818 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efca4160f60 0x7efca414df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:10.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.624+0000 7efca8a8b700 1 --2- 172.21.15.114:0/771168818 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efca40d3660 0x7efca414da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:10.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.624+0000 7efca928c700 1 -- 172.21.15.114:0/771168818 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efca40d3660 msgr2=0x7efca414da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:10.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.624+0000 7efca928c700 1 --2- 172.21.15.114:0/771168818 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efca40d3660 0x7efca414da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:10.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.624+0000 7efca928c700 1 -- 172.21.15.114:0/771168818 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efca4160f60 msgr2=0x7efca414df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:10.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.624+0000 7efca928c700 1 --2- 172.21.15.114:0/771168818 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efca4160f60 0x7efca414df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:10.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.624+0000 7efca928c700 1 -- 172.21.15.114:0/771168818 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca00094b0 con 0x7efca40cef60 2023-10-18T12:21:10.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.624+0000 7efca8a8b700 1 --2- 172.21.15.114:0/771168818 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efca40d3660 0x7efca414da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:21:10.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.624+0000 7efca928c700 1 --2- 172.21.15.114:0/771168818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efca40cef60 0x7efca40b2f30 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7efca0014040 tx=0x7efca0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:10.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.624+0000 7efc99ffb700 1 -- 172.21.15.114:0/771168818 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca00036c0 con 0x7efca40cef60 2023-10-18T12:21:10.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.624+0000 7efc99ffb700 1 -- 172.21.15.114:0/771168818 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca001e070 con 0x7efca40cef60 2023-10-18T12:21:10.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.624+0000 7efc99ffb700 1 -- 172.21.15.114:0/771168818 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca0003a40 con 0x7efca40cef60 2023-10-18T12:21:10.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.624+0000 7efcab4f0700 1 -- 172.21.15.114:0/771168818 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efca4162510 con 0x7efca40cef60 2023-10-18T12:21:10.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.624+0000 7efcab4f0700 1 -- 172.21.15.114:0/771168818 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efca41f7160 con 0x7efca40cef60 2023-10-18T12:21:10.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.628+0000 7efcab4f0700 1 -- 172.21.15.114:0/771168818 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efca4072e60 con 0x7efca40cef60 2023-10-18T12:21:10.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.628+0000 7efc99ffb700 1 -- 172.21.15.114:0/771168818 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7efca0003ba0 con 0x7efca40cef60 2023-10-18T12:21:10.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.628+0000 7efc99ffb700 1 --2- 172.21.15.114:0/771168818 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7efc880656f0 0x7efc88067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:10.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.628+0000 7efc99ffb700 1 -- 172.21.15.114:0/771168818 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7efca0083cc0 con 0x7efca40cef60 2023-10-18T12:21:10.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.628+0000 7efca8a8b700 1 --2- 172.21.15.114:0/771168818 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7efc880656f0 0x7efc88067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:10.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.632+0000 7efca8a8b700 1 --2- 172.21.15.114:0/771168818 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7efc880656f0 0x7efc88067bb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7efca408e060 tx=0x7efc94009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:10.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.636+0000 7efc99ffb700 1 -- 172.21.15.114:0/771168818 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7efca008a080 con 0x7efca40cef60 2023-10-18T12:21:10.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.812+0000 7efcab4f0700 1 -- 172.21.15.114:0/771168818 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efca406d5b0 con 0x7efca40cef60 2023-10-18T12:21:10.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.812+0000 7efc99ffb700 1 -- 172.21.15.114:0/771168818 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7efca0051980 con 0x7efca40cef60 2023-10-18T12:21:10.818 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-10-18T12:21:10.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.816+0000 7efcab4f0700 1 -- 172.21.15.114:0/771168818 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7efc880656f0 msgr2=0x7efc88067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:10.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.816+0000 7efcab4f0700 1 --2- 172.21.15.114:0/771168818 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7efc880656f0 0x7efc88067bb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7efca408e060 tx=0x7efc94009040 comp rx=0 tx=0).stop 2023-10-18T12:21:10.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.816+0000 7efcab4f0700 1 -- 172.21.15.114:0/771168818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efca40cef60 msgr2=0x7efca40b2f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:10.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.816+0000 7efcab4f0700 1 --2- 172.21.15.114:0/771168818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efca40cef60 0x7efca40b2f30 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7efca0014040 tx=0x7efca0004770 comp rx=0 tx=0).stop 2023-10-18T12:21:10.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.816+0000 7efcab4f0700 1 -- 172.21.15.114:0/771168818 shutdown_connections 2023-10-18T12:21:10.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.816+0000 7efcab4f0700 1 --2- 172.21.15.114:0/771168818 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7efc880656f0 0x7efc88067bb0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:10.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.816+0000 7efcab4f0700 1 --2- 172.21.15.114:0/771168818 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efca40d3660 0x7efca414da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:10.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.816+0000 7efcab4f0700 1 --2- 172.21.15.114:0/771168818 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efca4160f60 0x7efca414df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:10.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.816+0000 7efcab4f0700 1 --2- 172.21.15.114:0/771168818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efca40cef60 0x7efca40b2f30 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:10.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.816+0000 7efcab4f0700 1 -- 172.21.15.114:0/771168818 >> 172.21.15.114:0/771168818 conn(0x7efca4069f20 msgr2=0x7efca40b47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:10.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.816+0000 7efcab4f0700 1 -- 172.21.15.114:0/771168818 shutdown_connections 2023-10-18T12:21:10.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:10.816+0000 7efcab4f0700 1 -- 172.21.15.114:0/771168818 wait complete. 2023-10-18T12:21:10.844 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-18T12:21:11.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.012+0000 7f4e7c9d2700 1 Processor -- start 2023-10-18T12:21:11.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.012+0000 7f4e7c9d2700 1 -- start start 2023-10-18T12:21:11.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.016+0000 7f4e7c9d2700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4e780cc010 0x7f4e780cc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:11.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.016+0000 7f4e7c9d2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e780ca510 0x7f4e780ca9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:11.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.016+0000 7f4e7c9d2700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e780ca080 con 0x7f4e7815cbb0 2023-10-18T12:21:11.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.016+0000 7f4e7c9d2700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e78070950 con 0x7f4e780cc010 2023-10-18T12:21:11.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.016+0000 7f4e7c9d2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e78070c30 con 0x7f4e780ca510 2023-10-18T12:21:11.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.016+0000 7f4e7659c700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f4e7815cbb0 0x7f4e7806fe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45968/0 (socket says 172.21.15.114:45968) 2023-10-18T12:21:11.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.016+0000 7f4e7659c700 1 -- 172.21.15.114:0/987472385 learned_addr learned my addr 172.21.15.114:0/987472385 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:21:11.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.016+0000 7f4e6ffff700 1 --2- 172.21.15.114:0/987472385 >> v2:172.21.15.114:3300/0 conn(0x7f4e780cc010 0x7f4e780cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:11.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.016+0000 7f4e76d9d700 1 --2- 172.21.15.114:0/987472385 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e780ca510 0x7f4e780ca9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:11.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.016+0000 7f4e6ffff700 1 -- 172.21.15.114:0/987472385 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e780ca510 msgr2=0x7f4e780ca9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:11.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.016+0000 7f4e6ffff700 1 --2- 172.21.15.114:0/987472385 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e780ca510 0x7f4e780ca9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:11.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.016+0000 7f4e6ffff700 1 -- 172.21.15.114:0/987472385 >> v1:172.21.15.114:6789/0 conn(0x7f4e7815cbb0 legacy=0x7f4e7806fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:11.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.016+0000 7f4e6ffff700 1 -- 172.21.15.114:0/987472385 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e78070f10 con 0x7f4e780cc010 2023-10-18T12:21:11.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.020+0000 7f4e6ffff700 1 --2- 172.21.15.114:0/987472385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e780cc010 0x7f4e780cc450 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f4e60009850 tx=0x7f4e60009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=459f357498615f30 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:11.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.020+0000 7f4e75d9b700 1 -- 172.21.15.114:0/987472385 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e60011830 con 0x7f4e780cc010 2023-10-18T12:21:11.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.020+0000 7f4e75d9b700 1 -- 172.21.15.114:0/987472385 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e60011990 con 0x7f4e780cc010 2023-10-18T12:21:11.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.020+0000 7f4e75d9b700 1 -- 172.21.15.114:0/987472385 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e60011d40 con 0x7f4e780cc010 2023-10-18T12:21:11.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.020+0000 7f4e7c9d2700 1 -- 172.21.15.114:0/987472385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e780cc010 msgr2=0x7f4e780cc450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:11.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.020+0000 7f4e7c9d2700 1 --2- 172.21.15.114:0/987472385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e780cc010 0x7f4e780cc450 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f4e60009850 tx=0x7f4e60009b60 comp rx=0 tx=0).stop 2023-10-18T12:21:11.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.020+0000 7f4e7c9d2700 1 -- 172.21.15.114:0/987472385 shutdown_connections 2023-10-18T12:21:11.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.020+0000 7f4e7c9d2700 1 --2- 172.21.15.114:0/987472385 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e780ca510 0x7f4e780ca9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:11.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.020+0000 7f4e7c9d2700 1 --2- 172.21.15.114:0/987472385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e780cc010 0x7f4e780cc450 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:11.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.020+0000 7f4e7c9d2700 1 -- 172.21.15.114:0/987472385 >> 172.21.15.114:0/987472385 conn(0x7f4e780b1410 msgr2=0x7f4e780b17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:11.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.020+0000 7f4e7c9d2700 1 -- 172.21.15.114:0/987472385 shutdown_connections 2023-10-18T12:21:11.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.020+0000 7f4e7c9d2700 1 -- 172.21.15.114:0/987472385 wait complete. 2023-10-18T12:21:11.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.024+0000 7f4e7c9d2700 1 Processor -- start 2023-10-18T12:21:11.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.024+0000 7f4e7c9d2700 1 -- start start 2023-10-18T12:21:11.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.024+0000 7f4e7c9d2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e780ca510 0x7f4e780b2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:11.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.024+0000 7f4e7c9d2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e780cc010 0x7f4e780b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:11.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.024+0000 7f4e7c9d2700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e7815cbb0 0x7f4e781f60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:11.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.024+0000 7f4e7c9d2700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e780cdeb0 con 0x7f4e7815cbb0 2023-10-18T12:21:11.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.024+0000 7f4e7c9d2700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e780b4f40 con 0x7f4e780ca510 2023-10-18T12:21:11.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.024+0000 7f4e7c9d2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e780b51e0 con 0x7f4e780cc010 2023-10-18T12:21:11.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.024+0000 7f4e76d9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e7815cbb0 0x7f4e781f60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:11.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.024+0000 7f4e76d9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e7815cbb0 0x7f4e781f60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36696/0 (socket says 172.21.15.114:36696) 2023-10-18T12:21:11.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.024+0000 7f4e76d9d700 1 -- 172.21.15.114:0/724530161 learned_addr learned my addr 172.21.15.114:0/724530161 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:11.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.028+0000 7f4e7659c700 1 --2- 172.21.15.114:0/724530161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e780ca510 0x7f4e780b2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:11.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.028+0000 7f4e6ffff700 1 --2- 172.21.15.114:0/724530161 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e780cc010 0x7f4e780b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:11.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.028+0000 7f4e76d9d700 1 -- 172.21.15.114:0/724530161 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e780cc010 msgr2=0x7f4e780b4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:11.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.028+0000 7f4e76d9d700 1 --2- 172.21.15.114:0/724530161 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e780cc010 0x7f4e780b4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:11.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.028+0000 7f4e76d9d700 1 -- 172.21.15.114:0/724530161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e780ca510 msgr2=0x7f4e780b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:11.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.028+0000 7f4e76d9d700 1 --2- 172.21.15.114:0/724530161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e780ca510 0x7f4e780b2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:11.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.028+0000 7f4e76d9d700 1 -- 172.21.15.114:0/724530161 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e600094b0 con 0x7f4e7815cbb0 2023-10-18T12:21:11.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.028+0000 7f4e76d9d700 1 --2- 172.21.15.114:0/724530161 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e7815cbb0 0x7f4e781f60c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f4e7000efc0 tx=0x7f4e7000c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:11.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.028+0000 7f4e6effd700 1 -- 172.21.15.114:0/724530161 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7000cad0 con 0x7f4e7815cbb0 2023-10-18T12:21:11.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.028+0000 7f4e6effd700 1 -- 172.21.15.114:0/724530161 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e7000f040 con 0x7f4e7815cbb0 2023-10-18T12:21:11.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.028+0000 7f4e7c9d2700 1 -- 172.21.15.114:0/724530161 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e780b54c0 con 0x7f4e7815cbb0 2023-10-18T12:21:11.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.028+0000 7f4e6effd700 1 -- 172.21.15.114:0/724530161 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7000ce70 con 0x7f4e7815cbb0 2023-10-18T12:21:11.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.028+0000 7f4e7c9d2700 1 -- 172.21.15.114:0/724530161 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e780ce3e0 con 0x7f4e7815cbb0 2023-10-18T12:21:11.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.028+0000 7f4e7c9d2700 1 -- 172.21.15.114:0/724530161 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e780ce600 con 0x7f4e7815cbb0 2023-10-18T12:21:11.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.032+0000 7f4e6effd700 1 -- 172.21.15.114:0/724530161 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f4e70014480 con 0x7f4e7815cbb0 2023-10-18T12:21:11.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.032+0000 7f4e6effd700 1 --2- 172.21.15.114:0/724530161 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4e580656f0 0x7f4e58067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:11.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.032+0000 7f4e6effd700 1 -- 172.21.15.114:0/724530161 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f4e70083380 con 0x7f4e7815cbb0 2023-10-18T12:21:11.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.032+0000 7f4e7659c700 1 --2- 172.21.15.114:0/724530161 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4e580656f0 0x7f4e58067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:11.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.036+0000 7f4e7659c700 1 --2- 172.21.15.114:0/724530161 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4e580656f0 0x7f4e58067bb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4e68005930 tx=0x7f4e68009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:11.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.040+0000 7f4e6effd700 1 -- 172.21.15.114:0/724530161 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f4e70051060 con 0x7f4e7815cbb0 2023-10-18T12:21:11.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.220+0000 7f4e7c9d2700 1 -- 172.21.15.114:0/724530161 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4e78072e60 con 0x7f4e7815cbb0 2023-10-18T12:21:11.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.220+0000 7f4e6effd700 1 -- 172.21.15.114:0/724530161 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v38) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4e70054680 con 0x7f4e7815cbb0 2023-10-18T12:21:11.227 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 8 2023-10-18T12:21:11.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.224+0000 7f4e7c9d2700 1 -- 172.21.15.114:0/724530161 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4e580656f0 msgr2=0x7f4e58067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:11.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.224+0000 7f4e7c9d2700 1 --2- 172.21.15.114:0/724530161 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4e580656f0 0x7f4e58067bb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4e68005930 tx=0x7f4e68009040 comp rx=0 tx=0).stop 2023-10-18T12:21:11.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.224+0000 7f4e7c9d2700 1 -- 172.21.15.114:0/724530161 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e7815cbb0 msgr2=0x7f4e781f60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:11.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.224+0000 7f4e7c9d2700 1 --2- 172.21.15.114:0/724530161 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e7815cbb0 0x7f4e781f60c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f4e7000efc0 tx=0x7f4e7000c0c0 comp rx=0 tx=0).stop 2023-10-18T12:21:11.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.224+0000 7f4e7c9d2700 1 -- 172.21.15.114:0/724530161 shutdown_connections 2023-10-18T12:21:11.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.224+0000 7f4e7c9d2700 1 --2- 172.21.15.114:0/724530161 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4e580656f0 0x7f4e58067bb0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:11.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.224+0000 7f4e7c9d2700 1 --2- 172.21.15.114:0/724530161 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e780cc010 0x7f4e780b4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:11.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.224+0000 7f4e7c9d2700 1 --2- 172.21.15.114:0/724530161 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e7815cbb0 0x7f4e781f60c0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:11.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.224+0000 7f4e7c9d2700 1 --2- 172.21.15.114:0/724530161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e780ca510 0x7f4e780b2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:11.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.224+0000 7f4e7c9d2700 1 -- 172.21.15.114:0/724530161 >> 172.21.15.114:0/724530161 conn(0x7f4e780b1410 msgr2=0x7f4e78157360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:11.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.224+0000 7f4e7c9d2700 1 -- 172.21.15.114:0/724530161 shutdown_connections 2023-10-18T12:21:11.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.224+0000 7f4e7c9d2700 1 -- 172.21.15.114:0/724530161 wait complete. 2023-10-18T12:21:11.251 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-18T12:21:11.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.412+0000 7f18a88d5700 1 Processor -- start 2023-10-18T12:21:11.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.412+0000 7f18a88d5700 1 -- start start 2023-10-18T12:21:11.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.416+0000 7f18a88d5700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f18a40d2e00 0x7f18a40b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:11.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.416+0000 7f18a88d5700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18a415d0d0 con 0x7f18a4160710 2023-10-18T12:21:11.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.416+0000 7f18a88d5700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18a406f0f0 con 0x7f18a40b5ae0 2023-10-18T12:21:11.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.416+0000 7f18a88d5700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18a415df90 con 0x7f18a40d2e00 2023-10-18T12:21:11.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.416+0000 7f18a259c700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f18a4160710 0x7f18a40d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45984/0 (socket says 172.21.15.114:45984) 2023-10-18T12:21:11.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.416+0000 7f18a259c700 1 -- 172.21.15.114:0/3888587635 learned_addr learned my addr 172.21.15.114:0/3888587635 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:21:11.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.416+0000 7f18a2d9d700 1 --2- 172.21.15.114:0/3888587635 >> v2:172.21.15.172:3300/0 conn(0x7f18a40d2e00 0x7f18a40b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:11.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.416+0000 7f18a1d9b700 1 -- 172.21.15.114:0/3888587635 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2176339192 0 0) 0x7f1898001110 con 0x7f18a4160710 2023-10-18T12:21:11.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.416+0000 7f18a1d9b700 1 -- 172.21.15.114:0/3888587635 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f188c0035d0 con 0x7f18a4160710 2023-10-18T12:21:11.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.416+0000 7f18a2d9d700 1 -- 172.21.15.114:0/3888587635 >> v1:172.21.15.172:6789/0 conn(0x7f18a40b5ae0 legacy=0x7f18a406db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:11.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.416+0000 7f18a2d9d700 1 -- 172.21.15.114:0/3888587635 >> v1:172.21.15.114:6789/0 conn(0x7f18a4160710 legacy=0x7f18a40d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:11.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.416+0000 7f18a2d9d700 1 -- 172.21.15.114:0/3888587635 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a415d310 con 0x7f18a40d2e00 2023-10-18T12:21:11.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.416+0000 7f18a2d9d700 1 --2- 172.21.15.114:0/3888587635 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18a40d2e00 0x7f18a40b6e00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1894009850 tx=0x7f1894009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37cd03668a012baa server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:11.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.416+0000 7f18a1d9b700 1 -- 172.21.15.114:0/3888587635 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1894011830 con 0x7f18a40d2e00 2023-10-18T12:21:11.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.416+0000 7f18a1d9b700 1 -- 172.21.15.114:0/3888587635 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1894011990 con 0x7f18a40d2e00 2023-10-18T12:21:11.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.416+0000 7f18a1d9b700 1 -- 172.21.15.114:0/3888587635 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1894011d40 con 0x7f18a40d2e00 2023-10-18T12:21:11.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.420+0000 7f18a88d5700 1 -- 172.21.15.114:0/3888587635 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18a40d2e00 msgr2=0x7f18a40b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:11.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.420+0000 7f18a88d5700 1 --2- 172.21.15.114:0/3888587635 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18a40d2e00 0x7f18a40b6e00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1894009850 tx=0x7f1894009b60 comp rx=0 tx=0).stop 2023-10-18T12:21:11.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.420+0000 7f18a88d5700 1 -- 172.21.15.114:0/3888587635 shutdown_connections 2023-10-18T12:21:11.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.420+0000 7f18a88d5700 1 --2- 172.21.15.114:0/3888587635 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18a40d2e00 0x7f18a40b6e00 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:11.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.420+0000 7f18a88d5700 1 -- 172.21.15.114:0/3888587635 >> 172.21.15.114:0/3888587635 conn(0x7f18a4069f20 msgr2=0x7f18a406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:11.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.420+0000 7f18a88d5700 1 -- 172.21.15.114:0/3888587635 shutdown_connections 2023-10-18T12:21:11.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.420+0000 7f18a88d5700 1 -- 172.21.15.114:0/3888587635 wait complete. 2023-10-18T12:21:11.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.420+0000 7f18a88d5700 1 Processor -- start 2023-10-18T12:21:11.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.424+0000 7f18a88d5700 1 -- start start 2023-10-18T12:21:11.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.424+0000 7f18a88d5700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18a40b5ae0 0x7f18a414dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:11.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.424+0000 7f18a88d5700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f18a40d2e00 0x7f18a40cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:11.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.424+0000 7f18a88d5700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18a4160710 0x7f18a40cff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:11.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.424+0000 7f18a88d5700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a414e260 con 0x7f18a40b5ae0 2023-10-18T12:21:11.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.424+0000 7f18a88d5700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a41f5aa0 con 0x7f18a4160710 2023-10-18T12:21:11.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.424+0000 7f18a88d5700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a41f5cf0 con 0x7f18a40d2e00 2023-10-18T12:21:11.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.424+0000 7f18a2d9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18a40b5ae0 0x7f18a414dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:11.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.424+0000 7f18a2d9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18a40b5ae0 0x7f18a414dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36708/0 (socket says 172.21.15.114:36708) 2023-10-18T12:21:11.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.424+0000 7f18a2d9d700 1 -- 172.21.15.114:0/2779198899 learned_addr learned my addr 172.21.15.114:0/2779198899 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:11.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.424+0000 7f18a259c700 1 --2- 172.21.15.114:0/2779198899 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f18a40d2e00 0x7f18a40cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:11.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.424+0000 7f18a2d9d700 1 -- 172.21.15.114:0/2779198899 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f18a40d2e00 msgr2=0x7f18a40cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:11.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.424+0000 7f18a2d9d700 1 --2- 172.21.15.114:0/2779198899 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f18a40d2e00 0x7f18a40cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:11.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.424+0000 7f18a2d9d700 1 -- 172.21.15.114:0/2779198899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18a4160710 msgr2=0x7f18a40cff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:11.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.424+0000 7f18a2d9d700 1 --2- 172.21.15.114:0/2779198899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18a4160710 0x7f18a40cff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:11.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.424+0000 7f18a2d9d700 1 -- 172.21.15.114:0/2779198899 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18940094b0 con 0x7f18a40b5ae0 2023-10-18T12:21:11.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.424+0000 7f18a2d9d700 1 --2- 172.21.15.114:0/2779198899 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18a40b5ae0 0x7f18a414dd20 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1894000c00 tx=0x7f1894004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:11.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.424+0000 7f188b7fe700 1 -- 172.21.15.114:0/2779198899 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1894019ab0 con 0x7f18a40b5ae0 2023-10-18T12:21:11.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.424+0000 7f188b7fe700 1 -- 172.21.15.114:0/2779198899 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189401e070 con 0x7f18a40b5ae0 2023-10-18T12:21:11.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.424+0000 7f18a88d5700 1 -- 172.21.15.114:0/2779198899 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18a41f5fd0 con 0x7f18a40b5ae0 2023-10-18T12:21:11.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.424+0000 7f188b7fe700 1 -- 172.21.15.114:0/2779198899 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1894019e50 con 0x7f18a40b5ae0 2023-10-18T12:21:11.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.424+0000 7f18a88d5700 1 -- 172.21.15.114:0/2779198899 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18a41f6590 con 0x7f18a40b5ae0 2023-10-18T12:21:11.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.428+0000 7f18a88d5700 1 -- 172.21.15.114:0/2779198899 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18a415db90 con 0x7f18a40b5ae0 2023-10-18T12:21:11.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.428+0000 7f188b7fe700 1 -- 172.21.15.114:0/2779198899 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f189401a420 con 0x7f18a40b5ae0 2023-10-18T12:21:11.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.428+0000 7f188b7fe700 1 --2- 172.21.15.114:0/2779198899 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f18900656f0 0x7f1890067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:11.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.428+0000 7f188b7fe700 1 -- 172.21.15.114:0/2779198899 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f1894083c40 con 0x7f18a40b5ae0 2023-10-18T12:21:11.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.428+0000 7f18a259c700 1 --2- 172.21.15.114:0/2779198899 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f18900656f0 0x7f1890067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:11.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.432+0000 7f18a259c700 1 --2- 172.21.15.114:0/2779198899 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f18900656f0 0x7f1890067bb0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f18a40d0710 tx=0x7f1898009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:11.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.436+0000 7f188b7fe700 1 -- 172.21.15.114:0/2779198899 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f18a415db90 con 0x7f18a40b5ae0 2023-10-18T12:21:11.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.616+0000 7f18a88d5700 1 -- 172.21.15.114:0/2779198899 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f18a415db90 con 0x7f18a40b5ae0 2023-10-18T12:21:11.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.616+0000 7f188b7fe700 1 -- 172.21.15.114:0/2779198899 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v38) v1 ==== 84+0+126 (secure 0 0 0) 0x7f18a415db90 con 0x7f18a40b5ae0 2023-10-18T12:21:11.623 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:21:11.623 INFO:teuthology.orchestra.run.smithi114.stdout:[ 2023-10-18T12:21:11.623 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T12:21:11.623 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 1, 2023-10-18T12:21:11.623 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": ".mgr" 2023-10-18T12:21:11.624 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2023-10-18T12:21:11.624 INFO:teuthology.orchestra.run.smithi114.stdout: { 2023-10-18T12:21:11.624 INFO:teuthology.orchestra.run.smithi114.stdout: "poolnum": 2, 2023-10-18T12:21:11.624 INFO:teuthology.orchestra.run.smithi114.stdout: "poolname": "rbd" 2023-10-18T12:21:11.624 INFO:teuthology.orchestra.run.smithi114.stdout: } 2023-10-18T12:21:11.625 INFO:teuthology.orchestra.run.smithi114.stdout:] 2023-10-18T12:21:11.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.620+0000 7f18a88d5700 1 -- 172.21.15.114:0/2779198899 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f18900656f0 msgr2=0x7f1890067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:11.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.620+0000 7f18a88d5700 1 --2- 172.21.15.114:0/2779198899 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f18900656f0 0x7f1890067bb0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f18a40d0710 tx=0x7f1898009040 comp rx=0 tx=0).stop 2023-10-18T12:21:11.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.620+0000 7f18a88d5700 1 -- 172.21.15.114:0/2779198899 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18a40b5ae0 msgr2=0x7f18a414dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:11.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.620+0000 7f18a88d5700 1 --2- 172.21.15.114:0/2779198899 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18a40b5ae0 0x7f18a414dd20 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1894000c00 tx=0x7f1894004770 comp rx=0 tx=0).stop 2023-10-18T12:21:11.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.620+0000 7f18a88d5700 1 -- 172.21.15.114:0/2779198899 shutdown_connections 2023-10-18T12:21:11.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.620+0000 7f18a88d5700 1 --2- 172.21.15.114:0/2779198899 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f18900656f0 0x7f1890067bb0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:11.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.620+0000 7f18a88d5700 1 --2- 172.21.15.114:0/2779198899 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f18a40d2e00 0x7f18a40cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:11.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.620+0000 7f18a88d5700 1 --2- 172.21.15.114:0/2779198899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18a4160710 0x7f18a40cff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:11.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.620+0000 7f18a88d5700 1 --2- 172.21.15.114:0/2779198899 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18a40b5ae0 0x7f18a414dd20 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:11.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.620+0000 7f18a88d5700 1 -- 172.21.15.114:0/2779198899 >> 172.21.15.114:0/2779198899 conn(0x7f18a4069f20 msgr2=0x7f18a415b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:11.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.620+0000 7f18a88d5700 1 -- 172.21.15.114:0/2779198899 shutdown_connections 2023-10-18T12:21:11.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.620+0000 7f18a88d5700 1 -- 172.21.15.114:0/2779198899 wait complete. 2023-10-18T12:21:11.648 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-18T12:21:11.649 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-18T12:21:11.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.824+0000 7f0fd8c4d700 1 Processor -- start 2023-10-18T12:21:11.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.824+0000 7f0fd8c4d700 1 -- start start 2023-10-18T12:21:11.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.828+0000 7f0fd8c4d700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f0fd415cba0 0x7f0fd40b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:11.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.828+0000 7f0fd8c4d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0fd40ab8e0 0x7f0fd40b09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:11.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.828+0000 7f0fd8c4d700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fd40b1ea0 con 0x7f0fd4070460 2023-10-18T12:21:11.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.828+0000 7f0fd8c4d700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fd40b0f30 con 0x7f0fd415cba0 2023-10-18T12:21:11.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.828+0000 7f0fd8c4d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd40b2180 con 0x7f0fd40ab8e0 2023-10-18T12:21:11.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.828+0000 7f0fd2d9d700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f0fd4070460 0x7f0fd41608c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:45992/0 (socket says 172.21.15.114:45992) 2023-10-18T12:21:11.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.828+0000 7f0fd2d9d700 1 -- 172.21.15.114:0/2645392451 learned_addr learned my addr 172.21.15.114:0/2645392451 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:21:11.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.828+0000 7f0fd259c700 1 --2- 172.21.15.114:0/2645392451 >> v2:172.21.15.172:3300/0 conn(0x7f0fd415cba0 0x7f0fd40b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:11.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.828+0000 7f0fd1d9b700 1 --2- 172.21.15.114:0/2645392451 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0fd40ab8e0 0x7f0fd40b09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:11.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.828+0000 7f0fd159a700 1 -- 172.21.15.114:0/2645392451 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1560177363 0 0) 0x7f0fd40b1ea0 con 0x7f0fd4070460 2023-10-18T12:21:11.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.828+0000 7f0fd159a700 1 -- 172.21.15.114:0/2645392451 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fbc0035d0 con 0x7f0fd4070460 2023-10-18T12:21:11.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.828+0000 7f0fd259c700 1 -- 172.21.15.114:0/2645392451 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0fd40ab8e0 msgr2=0x7f0fd40b09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:11.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.828+0000 7f0fd259c700 1 --2- 172.21.15.114:0/2645392451 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0fd40ab8e0 0x7f0fd40b09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:11.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.828+0000 7f0fd259c700 1 -- 172.21.15.114:0/2645392451 >> v1:172.21.15.114:6789/0 conn(0x7f0fd4070460 legacy=0x7f0fd41608c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:11.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.828+0000 7f0fd259c700 1 -- 172.21.15.114:0/2645392451 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd40b2460 con 0x7f0fd415cba0 2023-10-18T12:21:11.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.828+0000 7f0fd1d9b700 1 --2- 172.21.15.114:0/2645392451 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0fd40ab8e0 0x7f0fd40b09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:21:11.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.828+0000 7f0fd259c700 1 --2- 172.21.15.114:0/2645392451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0fd415cba0 0x7f0fd40b1870 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4009850 tx=0x7f0fc4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2ff8011fc680698 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:11.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.828+0000 7f0fd159a700 1 -- 172.21.15.114:0/2645392451 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc4011830 con 0x7f0fd415cba0 2023-10-18T12:21:11.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.828+0000 7f0fd159a700 1 -- 172.21.15.114:0/2645392451 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc4011990 con 0x7f0fd415cba0 2023-10-18T12:21:11.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.828+0000 7f0fd159a700 1 -- 172.21.15.114:0/2645392451 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc4011d40 con 0x7f0fd415cba0 2023-10-18T12:21:11.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.832+0000 7f0fd8c4d700 1 -- 172.21.15.114:0/2645392451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0fd415cba0 msgr2=0x7f0fd40b1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:11.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.832+0000 7f0fd8c4d700 1 --2- 172.21.15.114:0/2645392451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0fd415cba0 0x7f0fd40b1870 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4009850 tx=0x7f0fc4009b60 comp rx=0 tx=0).stop 2023-10-18T12:21:11.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.832+0000 7f0fd8c4d700 1 -- 172.21.15.114:0/2645392451 shutdown_connections 2023-10-18T12:21:11.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.832+0000 7f0fd8c4d700 1 --2- 172.21.15.114:0/2645392451 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0fd40ab8e0 0x7f0fd40b09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:11.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.832+0000 7f0fd8c4d700 1 --2- 172.21.15.114:0/2645392451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0fd415cba0 0x7f0fd40b1870 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:11.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.832+0000 7f0fd8c4d700 1 -- 172.21.15.114:0/2645392451 >> 172.21.15.114:0/2645392451 conn(0x7f0fd406a3c0 msgr2=0x7f0fd40ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:11.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.832+0000 7f0fd8c4d700 1 -- 172.21.15.114:0/2645392451 shutdown_connections 2023-10-18T12:21:11.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.832+0000 7f0fd8c4d700 1 -- 172.21.15.114:0/2645392451 wait complete. 2023-10-18T12:21:11.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.836+0000 7f0fd8c4d700 1 Processor -- start 2023-10-18T12:21:11.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.836+0000 7f0fd8c4d700 1 -- start start 2023-10-18T12:21:11.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.836+0000 7f0fd8c4d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0fd4070460 0x7f0fd41f30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:11.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.836+0000 7f0fd8c4d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fd40ab8e0 0x7f0fd40cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:11.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.836+0000 7f0fd8c4d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0fd415cba0 0x7f0fd40cde50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:11.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.836+0000 7f0fd8c4d700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd40cd3f0 con 0x7f0fd40ab8e0 2023-10-18T12:21:11.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.836+0000 7f0fd8c4d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd41f3620 con 0x7f0fd415cba0 2023-10-18T12:21:11.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.836+0000 7f0fd8c4d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd40cc910 con 0x7f0fd4070460 2023-10-18T12:21:11.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.836+0000 7f0fd1d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fd40ab8e0 0x7f0fd40cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:11.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.836+0000 7f0fd1d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fd40ab8e0 0x7f0fd40cc3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36718/0 (socket says 172.21.15.114:36718) 2023-10-18T12:21:11.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.836+0000 7f0fd1d9b700 1 -- 172.21.15.114:0/1533540477 learned_addr learned my addr 172.21.15.114:0/1533540477 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:11.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.836+0000 7f0fd2d9d700 1 --2- 172.21.15.114:0/1533540477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0fd415cba0 0x7f0fd40cde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:11.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.836+0000 7f0fd259c700 1 --2- 172.21.15.114:0/1533540477 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0fd4070460 0x7f0fd41f30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:11.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.836+0000 7f0fd1d9b700 1 -- 172.21.15.114:0/1533540477 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0fd4070460 msgr2=0x7f0fd41f30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:11.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.836+0000 7f0fd1d9b700 1 --2- 172.21.15.114:0/1533540477 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0fd4070460 0x7f0fd41f30e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:11.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.836+0000 7f0fd1d9b700 1 -- 172.21.15.114:0/1533540477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0fd415cba0 msgr2=0x7f0fd40cde50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:11.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.836+0000 7f0fd1d9b700 1 --2- 172.21.15.114:0/1533540477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0fd415cba0 0x7f0fd40cde50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:11.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.836+0000 7f0fd1d9b700 1 -- 172.21.15.114:0/1533540477 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc80094b0 con 0x7f0fd40ab8e0 2023-10-18T12:21:11.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.836+0000 7f0fd1d9b700 1 --2- 172.21.15.114:0/1533540477 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fd40ab8e0 0x7f0fd40cc3d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f0fc800ebe0 tx=0x7f0fc8009e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:11.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.836+0000 7f0fc2ffd700 1 -- 172.21.15.114:0/1533540477 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc800c8b0 con 0x7f0fd40ab8e0 2023-10-18T12:21:11.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.836+0000 7f0fc2ffd700 1 -- 172.21.15.114:0/1533540477 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc800ca10 con 0x7f0fd40ab8e0 2023-10-18T12:21:11.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.836+0000 7f0fd8c4d700 1 -- 172.21.15.114:0/1533540477 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fc40094b0 con 0x7f0fd40ab8e0 2023-10-18T12:21:11.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.840+0000 7f0fc2ffd700 1 -- 172.21.15.114:0/1533540477 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc800cdc0 con 0x7f0fd40ab8e0 2023-10-18T12:21:11.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.840+0000 7f0fd8c4d700 1 -- 172.21.15.114:0/1533540477 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fd40ccb50 con 0x7f0fd40ab8e0 2023-10-18T12:21:11.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.840+0000 7f0fd8c4d700 1 -- 172.21.15.114:0/1533540477 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fd4073f00 con 0x7f0fd40ab8e0 2023-10-18T12:21:11.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.840+0000 7f0fc2ffd700 1 -- 172.21.15.114:0/1533540477 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f0fc8013470 con 0x7f0fd40ab8e0 2023-10-18T12:21:11.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.844+0000 7f0fc2ffd700 1 --2- 172.21.15.114:0/1533540477 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0fb4065720 0x7f0fb4067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:11.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.844+0000 7f0fc2ffd700 1 -- 172.21.15.114:0/1533540477 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f0fc80829e0 con 0x7f0fd40ab8e0 2023-10-18T12:21:11.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.844+0000 7f0fd259c700 1 --2- 172.21.15.114:0/1533540477 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0fb4065720 0x7f0fb4067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:11.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.844+0000 7f0fd259c700 1 --2- 172.21.15.114:0/1533540477 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0fb4065720 0x7f0fb4067be0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4014040 tx=0x7f0fc4008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:11.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:11.852+0000 7f0fc2ffd700 1 -- 172.21.15.114:0/1533540477 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f0fc80506b0 con 0x7f0fd40ab8e0 2023-10-18T12:21:12.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.036+0000 7f0fd8c4d700 1 -- 172.21.15.114:0/1533540477 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f0fd40b2ee0 con 0x7f0fd40ab8e0 2023-10-18T12:21:12.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.668+0000 7f0fc2ffd700 1 -- 172.21.15.114:0/1533540477 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v39) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0fc80170b0 con 0x7f0fd40ab8e0 2023-10-18T12:21:12.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.672+0000 7f0fd8c4d700 1 -- 172.21.15.114:0/1533540477 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0fb4065720 msgr2=0x7f0fb4067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:12.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.672+0000 7f0fd8c4d700 1 --2- 172.21.15.114:0/1533540477 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0fb4065720 0x7f0fb4067be0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4014040 tx=0x7f0fc4008030 comp rx=0 tx=0).stop 2023-10-18T12:21:12.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.672+0000 7f0fd8c4d700 1 -- 172.21.15.114:0/1533540477 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fd40ab8e0 msgr2=0x7f0fd40cc3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:12.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.672+0000 7f0fd8c4d700 1 --2- 172.21.15.114:0/1533540477 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fd40ab8e0 0x7f0fd40cc3d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f0fc800ebe0 tx=0x7f0fc8009e70 comp rx=0 tx=0).stop 2023-10-18T12:21:12.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.672+0000 7f0fd8c4d700 1 -- 172.21.15.114:0/1533540477 shutdown_connections 2023-10-18T12:21:12.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.672+0000 7f0fd8c4d700 1 --2- 172.21.15.114:0/1533540477 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0fb4065720 0x7f0fb4067be0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:12.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.672+0000 7f0fd8c4d700 1 --2- 172.21.15.114:0/1533540477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0fd415cba0 0x7f0fd40cde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:12.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.672+0000 7f0fd8c4d700 1 --2- 172.21.15.114:0/1533540477 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fd40ab8e0 0x7f0fd40cc3d0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:12.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.672+0000 7f0fd8c4d700 1 --2- 172.21.15.114:0/1533540477 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0fd4070460 0x7f0fd41f30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:12.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.672+0000 7f0fd8c4d700 1 -- 172.21.15.114:0/1533540477 >> 172.21.15.114:0/1533540477 conn(0x7f0fd406a3c0 msgr2=0x7f0fd40abff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:12.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.672+0000 7f0fd8c4d700 1 -- 172.21.15.114:0/1533540477 shutdown_connections 2023-10-18T12:21:12.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.672+0000 7f0fd8c4d700 1 -- 172.21.15.114:0/1533540477 wait complete. 2023-10-18T12:21:12.682 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' created 2023-10-18T12:21:12.703 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-18T12:21:12.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.880+0000 7f43d686b700 1 Processor -- start 2023-10-18T12:21:12.886 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.880+0000 7f43d686b700 1 -- start start 2023-10-18T12:21:12.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.884+0000 7f43d686b700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f43d00cb500 0x7f43d00b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:12.888 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.884+0000 7f43d686b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f43d00b2720 0x7f43d006fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:12.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.884+0000 7f43d686b700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d00b16d0 con 0x7f43d0160e50 2023-10-18T12:21:12.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.884+0000 7f43d686b700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43d00b1ee0 con 0x7f43d00cb500 2023-10-18T12:21:12.889 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.884+0000 7f43d686b700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43d00b2bb0 con 0x7f43d00b2720 2023-10-18T12:21:12.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.884+0000 7f43d5068700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f43d00cb500 0x7f43d00b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:12.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.884+0000 7f43d5068700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f43d00cb500 0x7f43d00b21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36734/0 (socket says 172.21.15.114:36734) 2023-10-18T12:21:12.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.884+0000 7f43d5068700 1 -- 172.21.15.114:0/804538382 learned_addr learned my addr 172.21.15.114:0/804538382 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:12.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.884+0000 7f43d606a700 1 --2- 172.21.15.114:0/804538382 >> v2:172.21.15.172:3300/0 conn(0x7f43d00b2720 0x7f43d006fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:12.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.884+0000 7f43d5068700 1 -- 172.21.15.114:0/804538382 >> v2:172.21.15.172:3300/0 conn(0x7f43d00b2720 msgr2=0x7f43d006fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:12.891 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.884+0000 7f43d5068700 1 --2- 172.21.15.114:0/804538382 >> v2:172.21.15.172:3300/0 conn(0x7f43d00b2720 0x7f43d006fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:12.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.884+0000 7f43d5068700 1 -- 172.21.15.114:0/804538382 >> v1:172.21.15.172:6789/0 conn(0x7f43d0160e50 legacy=0x7f43d006e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:12.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.884+0000 7f43d5068700 1 -- 172.21.15.114:0/804538382 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d006eaf0 con 0x7f43d00cb500 2023-10-18T12:21:12.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.884+0000 7f43d5068700 1 --2- 172.21.15.114:0/804538382 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43d00cb500 0x7f43d00b21e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f43c0009910 tx=0x7f43c0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75be54526e2c585e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:12.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.884+0000 7f43d4867700 1 -- 172.21.15.114:0/804538382 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c0011830 con 0x7f43d00cb500 2023-10-18T12:21:12.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.884+0000 7f43d4867700 1 -- 172.21.15.114:0/804538382 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c0011990 con 0x7f43d00cb500 2023-10-18T12:21:12.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.884+0000 7f43d4867700 1 -- 172.21.15.114:0/804538382 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c0011d40 con 0x7f43d00cb500 2023-10-18T12:21:12.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.888+0000 7f43d686b700 1 -- 172.21.15.114:0/804538382 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43d00cb500 msgr2=0x7f43d00b21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:12.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.888+0000 7f43d686b700 1 --2- 172.21.15.114:0/804538382 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43d00cb500 0x7f43d00b21e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f43c0009910 tx=0x7f43c0009c20 comp rx=0 tx=0).stop 2023-10-18T12:21:12.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.888+0000 7f43d686b700 1 -- 172.21.15.114:0/804538382 shutdown_connections 2023-10-18T12:21:12.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.888+0000 7f43d686b700 1 --2- 172.21.15.114:0/804538382 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43d00cb500 0x7f43d00b21e0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:12.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.888+0000 7f43d686b700 1 --2- 172.21.15.114:0/804538382 >> v2:172.21.15.172:3300/0 conn(0x7f43d00b2720 0x7f43d006fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:12.894 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.888+0000 7f43d686b700 1 -- 172.21.15.114:0/804538382 >> 172.21.15.114:0/804538382 conn(0x7f43d00b0bf0 msgr2=0x7f43d00ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:12.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.888+0000 7f43d686b700 1 -- 172.21.15.114:0/804538382 shutdown_connections 2023-10-18T12:21:12.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.888+0000 7f43d686b700 1 -- 172.21.15.114:0/804538382 wait complete. 2023-10-18T12:21:12.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.892+0000 7f43d686b700 1 Processor -- start 2023-10-18T12:21:12.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.892+0000 7f43d686b700 1 -- start start 2023-10-18T12:21:12.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.892+0000 7f43d686b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43d00b2720 0x7f43d0156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:12.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.892+0000 7f43d686b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43d00cb500 0x7f43d01598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:12.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.892+0000 7f43d686b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43d0160e50 0x7f43d00cce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:12.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.892+0000 7f43d686b700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d01f9bc0 con 0x7f43d00b2720 2023-10-18T12:21:12.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.892+0000 7f43d686b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d01fa420 con 0x7f43d0160e50 2023-10-18T12:21:12.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.892+0000 7f43d686b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d015a3b0 con 0x7f43d00cb500 2023-10-18T12:21:12.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.892+0000 7f43d5869700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43d00b2720 0x7f43d0156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:12.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.892+0000 7f43d5869700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43d00b2720 0x7f43d0156990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36736/0 (socket says 172.21.15.114:36736) 2023-10-18T12:21:12.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.892+0000 7f43d5869700 1 -- 172.21.15.114:0/3234884135 learned_addr learned my addr 172.21.15.114:0/3234884135 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:12.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.892+0000 7f43d606a700 1 --2- 172.21.15.114:0/3234884135 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43d0160e50 0x7f43d00cce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:12.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.892+0000 7f43d5068700 1 --2- 172.21.15.114:0/3234884135 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43d00cb500 0x7f43d01598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:12.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.892+0000 7f43d5869700 1 -- 172.21.15.114:0/3234884135 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43d00cb500 msgr2=0x7f43d01598f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:12.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.892+0000 7f43d5869700 1 --2- 172.21.15.114:0/3234884135 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43d00cb500 0x7f43d01598f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:12.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.892+0000 7f43d5869700 1 -- 172.21.15.114:0/3234884135 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43d0160e50 msgr2=0x7f43d00cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:12.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.892+0000 7f43d5869700 1 --2- 172.21.15.114:0/3234884135 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43d0160e50 0x7f43d00cce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:12.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.892+0000 7f43d5869700 1 -- 172.21.15.114:0/3234884135 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c0009570 con 0x7f43d00b2720 2023-10-18T12:21:12.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.892+0000 7f43d606a700 1 --2- 172.21.15.114:0/3234884135 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43d0160e50 0x7f43d00cce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:21:12.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.892+0000 7f43d5869700 1 --2- 172.21.15.114:0/3234884135 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43d00b2720 0x7f43d0156990 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f43cc00c530 tx=0x7f43cc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:12.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.896+0000 7f43c67fc700 1 -- 172.21.15.114:0/3234884135 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc0052d0 con 0x7f43d00b2720 2023-10-18T12:21:12.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.896+0000 7f43c67fc700 1 -- 172.21.15.114:0/3234884135 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43cc005430 con 0x7f43d00b2720 2023-10-18T12:21:12.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.896+0000 7f43d686b700 1 -- 172.21.15.114:0/3234884135 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43d01f9dd0 con 0x7f43d00b2720 2023-10-18T12:21:12.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.896+0000 7f43c67fc700 1 -- 172.21.15.114:0/3234884135 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc0055a0 con 0x7f43d00b2720 2023-10-18T12:21:12.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.896+0000 7f43d686b700 1 -- 172.21.15.114:0/3234884135 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d0156ed0 con 0x7f43d00b2720 2023-10-18T12:21:12.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.896+0000 7f43d686b700 1 -- 172.21.15.114:0/3234884135 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43d0157060 con 0x7f43d00b2720 2023-10-18T12:21:12.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.896+0000 7f43c67fc700 1 -- 172.21.15.114:0/3234884135 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f43cc0038e0 con 0x7f43d00b2720 2023-10-18T12:21:12.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.900+0000 7f43c67fc700 1 --2- 172.21.15.114:0/3234884135 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f43b40656f0 0x7f43b4067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:12.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.900+0000 7f43c67fc700 1 -- 172.21.15.114:0/3234884135 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5900+0+0 (secure 0 0 0) 0x7f43cc082180 con 0x7f43d00b2720 2023-10-18T12:21:12.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.900+0000 7f43d5068700 1 --2- 172.21.15.114:0/3234884135 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f43b40656f0 0x7f43b4067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:12.906 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.900+0000 7f43d5068700 1 --2- 172.21.15.114:0/3234884135 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f43b40656f0 0x7f43b4067bb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f43c0009910 tx=0x7f43c0008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:12.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:12.904+0000 7f43c67fc700 1 -- 172.21.15.114:0/3234884135 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f43cc04fce0 con 0x7f43d00b2720 2023-10-18T12:21:13.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.084+0000 7f43d686b700 1 -- 172.21.15.114:0/3234884135 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f43d004e910 con 0x7f43d00b2720 2023-10-18T12:21:13.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.688+0000 7f43c67fc700 1 -- 172.21.15.114:0/3234884135 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v40) v1 ==== 170+0+0 (secure 0 0 0) 0x7f43cc053300 con 0x7f43d00b2720 2023-10-18T12:21:13.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.696+0000 7f43d686b700 1 -- 172.21.15.114:0/3234884135 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f43b40656f0 msgr2=0x7f43b4067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:13.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.696+0000 7f43d686b700 1 --2- 172.21.15.114:0/3234884135 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f43b40656f0 0x7f43b4067bb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f43c0009910 tx=0x7f43c0008030 comp rx=0 tx=0).stop 2023-10-18T12:21:13.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.696+0000 7f43d686b700 1 -- 172.21.15.114:0/3234884135 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43d00b2720 msgr2=0x7f43d0156990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:13.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.696+0000 7f43d686b700 1 --2- 172.21.15.114:0/3234884135 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43d00b2720 0x7f43d0156990 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f43cc00c530 tx=0x7f43cc00c8f0 comp rx=0 tx=0).stop 2023-10-18T12:21:13.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.696+0000 7f43d686b700 1 -- 172.21.15.114:0/3234884135 shutdown_connections 2023-10-18T12:21:13.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.696+0000 7f43d686b700 1 --2- 172.21.15.114:0/3234884135 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f43b40656f0 0x7f43b4067bb0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:13.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.696+0000 7f43d686b700 1 --2- 172.21.15.114:0/3234884135 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43d00cb500 0x7f43d01598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:13.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.696+0000 7f43d686b700 1 --2- 172.21.15.114:0/3234884135 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f43d0160e50 0x7f43d00cce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:13.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.696+0000 7f43d686b700 1 --2- 172.21.15.114:0/3234884135 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43d00b2720 0x7f43d0156990 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:13.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.696+0000 7f43d686b700 1 -- 172.21.15.114:0/3234884135 >> 172.21.15.114:0/3234884135 conn(0x7f43d00b0bf0 msgr2=0x7f43d015d640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:13.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.700+0000 7f43d686b700 1 -- 172.21.15.114:0/3234884135 shutdown_connections 2023-10-18T12:21:13.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.700+0000 7f43d686b700 1 -- 172.21.15.114:0/3234884135 wait complete. 2023-10-18T12:21:13.713 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' created 2023-10-18T12:21:13.733 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-18T12:21:13.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.900+0000 7f38216eb700 1 Processor -- start 2023-10-18T12:21:13.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.900+0000 7f38216eb700 1 -- start start 2023-10-18T12:21:13.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.904+0000 7f38216eb700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f381c0b3d40 0x7f381c0cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:13.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.904+0000 7f38216eb700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f381c164a20 0x7f381c0c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:13.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.904+0000 7f38216eb700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f381c0ca200 con 0x7f381c06ce20 2023-10-18T12:21:13.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.904+0000 7f38216eb700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f381c06e2d0 con 0x7f381c0b3d40 2023-10-18T12:21:13.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.904+0000 7f38216eb700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f381c0ca4c0 con 0x7f381c164a20 2023-10-18T12:21:13.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.904+0000 7f381b7fe700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f381c164a20 0x7f381c0c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:13.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.904+0000 7f381bfff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f381c0b3d40 0x7f381c0cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:13.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.904+0000 7f3820eea700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f381c06ce20 0x7f381c06f970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.114:49442/0 (socket says 172.21.15.114:49442) 2023-10-18T12:21:13.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.904+0000 7f3820eea700 1 -- 172.21.15.114:0/3392863442 learned_addr learned my addr 172.21.15.114:0/3392863442 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:21:13.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.904+0000 7f381affd700 1 -- 172.21.15.114:0/3392863442 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1786847775 0 0) 0x7f381c0ca200 con 0x7f381c06ce20 2023-10-18T12:21:13.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.904+0000 7f381affd700 1 -- 172.21.15.114:0/3392863442 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38040035d0 con 0x7f381c06ce20 2023-10-18T12:21:13.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.904+0000 7f381bfff700 1 -- 172.21.15.114:0/3392863442 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f381c164a20 msgr2=0x7f381c0c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:13.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.904+0000 7f381bfff700 1 --2- 172.21.15.114:0/3392863442 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f381c164a20 0x7f381c0c9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:13.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.904+0000 7f381bfff700 1 -- 172.21.15.114:0/3392863442 >> v1:172.21.15.172:6789/0 conn(0x7f381c06ce20 legacy=0x7f381c06f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:13.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.904+0000 7f381bfff700 1 -- 172.21.15.114:0/3392863442 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f381c0ca7a0 con 0x7f381c0b3d40 2023-10-18T12:21:13.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.904+0000 7f381b7fe700 1 --2- 172.21.15.114:0/3392863442 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f381c164a20 0x7f381c0c9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:21:13.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.904+0000 7f381bfff700 1 --2- 172.21.15.114:0/3392863442 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f381c0b3d40 0x7f381c0cc190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f380c009850 tx=0x7f380c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9807e85ffe34b33d server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:13.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.908+0000 7f381affd700 1 -- 172.21.15.114:0/3392863442 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380c011830 con 0x7f381c0b3d40 2023-10-18T12:21:13.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.908+0000 7f381affd700 1 -- 172.21.15.114:0/3392863442 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f380c011990 con 0x7f381c0b3d40 2023-10-18T12:21:13.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.908+0000 7f381affd700 1 -- 172.21.15.114:0/3392863442 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380c011d40 con 0x7f381c0b3d40 2023-10-18T12:21:13.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.908+0000 7f38216eb700 1 -- 172.21.15.114:0/3392863442 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f381c0b3d40 msgr2=0x7f381c0cc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:13.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.908+0000 7f38216eb700 1 --2- 172.21.15.114:0/3392863442 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f381c0b3d40 0x7f381c0cc190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f380c009850 tx=0x7f380c009b60 comp rx=0 tx=0).stop 2023-10-18T12:21:13.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.908+0000 7f38216eb700 1 -- 172.21.15.114:0/3392863442 shutdown_connections 2023-10-18T12:21:13.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.908+0000 7f38216eb700 1 --2- 172.21.15.114:0/3392863442 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f381c164a20 0x7f381c0c9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:13.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.908+0000 7f38216eb700 1 --2- 172.21.15.114:0/3392863442 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f381c0b3d40 0x7f381c0cc190 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:13.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.908+0000 7f38216eb700 1 -- 172.21.15.114:0/3392863442 >> 172.21.15.114:0/3392863442 conn(0x7f381c0ce5c0 msgr2=0x7f381c0ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:13.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.908+0000 7f38216eb700 1 -- 172.21.15.114:0/3392863442 shutdown_connections 2023-10-18T12:21:13.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.908+0000 7f38216eb700 1 -- 172.21.15.114:0/3392863442 wait complete. 2023-10-18T12:21:13.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.912+0000 7f38216eb700 1 Processor -- start 2023-10-18T12:21:13.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.912+0000 7f38216eb700 1 -- start start 2023-10-18T12:21:13.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.912+0000 7f38216eb700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f381c06ce20 0x7f381c163c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:13.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.912+0000 7f38216eb700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f381c0b3d40 0x7f381c15e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:13.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.912+0000 7f38216eb700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f381c164a20 0x7f381c15ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:13.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.912+0000 7f38216eb700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381c0cd6d0 con 0x7f381c0b3d40 2023-10-18T12:21:13.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.912+0000 7f38216eb700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381c0cd9b0 con 0x7f381c164a20 2023-10-18T12:21:13.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.912+0000 7f38216eb700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f381c0cdc90 con 0x7f381c06ce20 2023-10-18T12:21:13.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.912+0000 7f381b7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f381c0b3d40 0x7f381c15e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:13.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.912+0000 7f381b7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f381c0b3d40 0x7f381c15e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36752/0 (socket says 172.21.15.114:36752) 2023-10-18T12:21:13.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.916+0000 7f381b7fe700 1 -- 172.21.15.114:0/357500793 learned_addr learned my addr 172.21.15.114:0/357500793 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:13.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.916+0000 7f381bfff700 1 --2- 172.21.15.114:0/357500793 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f381c06ce20 0x7f381c163c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:13.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.916+0000 7f3820eea700 1 --2- 172.21.15.114:0/357500793 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f381c164a20 0x7f381c15ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:13.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.916+0000 7f381b7fe700 1 -- 172.21.15.114:0/357500793 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f381c06ce20 msgr2=0x7f381c163c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:13.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.916+0000 7f381b7fe700 1 --2- 172.21.15.114:0/357500793 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f381c06ce20 0x7f381c163c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:13.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.916+0000 7f381b7fe700 1 -- 172.21.15.114:0/357500793 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f381c164a20 msgr2=0x7f381c15ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:13.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.916+0000 7f381b7fe700 1 --2- 172.21.15.114:0/357500793 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f381c164a20 0x7f381c15ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:13.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.916+0000 7f381b7fe700 1 -- 172.21.15.114:0/357500793 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38100094b0 con 0x7f381c0b3d40 2023-10-18T12:21:13.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.916+0000 7f381b7fe700 1 --2- 172.21.15.114:0/357500793 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f381c0b3d40 0x7f381c15e730 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f381000ebe0 tx=0x7f381000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:13.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.916+0000 7f3818ff9700 1 -- 172.21.15.114:0/357500793 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381000c850 con 0x7f381c0b3d40 2023-10-18T12:21:13.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.916+0000 7f3818ff9700 1 -- 172.21.15.114:0/357500793 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381000c9b0 con 0x7f381c0b3d40 2023-10-18T12:21:13.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.916+0000 7f3818ff9700 1 -- 172.21.15.114:0/357500793 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381000cd40 con 0x7f381c0b3d40 2023-10-18T12:21:13.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.916+0000 7f38216eb700 1 -- 172.21.15.114:0/357500793 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f380c0094b0 con 0x7f381c0b3d40 2023-10-18T12:21:13.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.916+0000 7f38216eb700 1 -- 172.21.15.114:0/357500793 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f381c157b90 con 0x7f381c0b3d40 2023-10-18T12:21:13.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.920+0000 7f38216eb700 1 -- 172.21.15.114:0/357500793 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f381c1465f0 con 0x7f381c0b3d40 2023-10-18T12:21:13.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.920+0000 7f3818ff9700 1 -- 172.21.15.114:0/357500793 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f3810013470 con 0x7f381c0b3d40 2023-10-18T12:21:13.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.920+0000 7f3818ff9700 1 --2- 172.21.15.114:0/357500793 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f38080656f0 0x7f3808067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:13.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.920+0000 7f3818ff9700 1 -- 172.21.15.114:0/357500793 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6282+0+0 (secure 0 0 0) 0x7f3810082f10 con 0x7f381c0b3d40 2023-10-18T12:21:13.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.920+0000 7f381bfff700 1 --2- 172.21.15.114:0/357500793 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f38080656f0 0x7f3808067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:13.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.924+0000 7f381bfff700 1 --2- 172.21.15.114:0/357500793 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f38080656f0 0x7f3808067bb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f380c0090b0 tx=0x7f380c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:13.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:13.928+0000 7f3818ff9700 1 -- 172.21.15.114:0/357500793 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f38100508e0 con 0x7f381c0b3d40 2023-10-18T12:21:14.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.152+0000 7f38216eb700 1 -- 172.21.15.114:0/357500793 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f381c06d9f0 con 0x7f381c0b3d40 2023-10-18T12:21:14.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.720+0000 7f3818ff9700 1 -- 172.21.15.114:0/357500793 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f381000cea0 con 0x7f381c0b3d40 2023-10-18T12:21:14.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.728+0000 7f38216eb700 1 -- 172.21.15.114:0/357500793 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f38080656f0 msgr2=0x7f3808067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:14.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.728+0000 7f38216eb700 1 --2- 172.21.15.114:0/357500793 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f38080656f0 0x7f3808067bb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f380c0090b0 tx=0x7f380c008030 comp rx=0 tx=0).stop 2023-10-18T12:21:14.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.728+0000 7f38216eb700 1 -- 172.21.15.114:0/357500793 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f381c0b3d40 msgr2=0x7f381c15e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:14.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.728+0000 7f38216eb700 1 --2- 172.21.15.114:0/357500793 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f381c0b3d40 0x7f381c15e730 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f381000ebe0 tx=0x7f381000eef0 comp rx=0 tx=0).stop 2023-10-18T12:21:14.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.728+0000 7f38216eb700 1 -- 172.21.15.114:0/357500793 shutdown_connections 2023-10-18T12:21:14.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.728+0000 7f38216eb700 1 --2- 172.21.15.114:0/357500793 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f38080656f0 0x7f3808067bb0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:14.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.728+0000 7f38216eb700 1 --2- 172.21.15.114:0/357500793 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f381c164a20 0x7f381c15ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:14.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.728+0000 7f38216eb700 1 --2- 172.21.15.114:0/357500793 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f381c0b3d40 0x7f381c15e730 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:14.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.728+0000 7f38216eb700 1 --2- 172.21.15.114:0/357500793 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f381c06ce20 0x7f381c163c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:14.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.728+0000 7f38216eb700 1 -- 172.21.15.114:0/357500793 >> 172.21.15.114:0/357500793 conn(0x7f381c0ce5c0 msgr2=0x7f381c070860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:14.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.728+0000 7f38216eb700 1 -- 172.21.15.114:0/357500793 shutdown_connections 2023-10-18T12:21:14.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.728+0000 7f38216eb700 1 -- 172.21.15.114:0/357500793 wait complete. 2023-10-18T12:21:14.738 INFO:teuthology.orchestra.run.smithi114.stderr:new fs with metadata pool 6 and data pool 7 2023-10-18T12:21:14.755 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T12:21:14.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.920+0000 7f5b14f2b700 1 Processor -- start 2023-10-18T12:21:14.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.920+0000 7f5b14f2b700 1 -- start start 2023-10-18T12:21:14.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.924+0000 7f5b14f2b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5b10155420 0x7f5b100cb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:14.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.924+0000 7f5b14f2b700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5b1015bf00 0x7f5b100cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:14.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.924+0000 7f5b14f2b700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b100cbc80 con 0x7f5b100b0f90 2023-10-18T12:21:14.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.924+0000 7f5b14f2b700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b10155800 con 0x7f5b1015bf00 2023-10-18T12:21:14.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.924+0000 7f5b14f2b700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b100cb9a0 con 0x7f5b10155420 2023-10-18T12:21:14.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.924+0000 7f5b05d9b700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5b1015bf00 0x7f5b100cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:14.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.924+0000 7f5b05d9b700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5b1015bf00 0x7f5b100cdc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36754/0 (socket says 172.21.15.114:36754) 2023-10-18T12:21:14.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.924+0000 7f5b05d9b700 1 -- 172.21.15.114:0/4192532458 learned_addr learned my addr 172.21.15.114:0/4192532458 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:14.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.924+0000 7f5b0e59c700 1 --2- 172.21.15.114:0/4192532458 >> v2:172.21.15.172:3300/0 conn(0x7f5b10155420 0x7f5b100cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:14.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.924+0000 7f5b05d9b700 1 -- 172.21.15.114:0/4192532458 >> v2:172.21.15.172:3300/0 conn(0x7f5b10155420 msgr2=0x7f5b100cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:14.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.924+0000 7f5b05d9b700 1 --2- 172.21.15.114:0/4192532458 >> v2:172.21.15.172:3300/0 conn(0x7f5b10155420 0x7f5b100cb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:14.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.924+0000 7f5b05d9b700 1 -- 172.21.15.114:0/4192532458 >> v1:172.21.15.172:6789/0 conn(0x7f5b100b0f90 legacy=0x7f5b100cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:14.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.924+0000 7f5b05d9b700 1 -- 172.21.15.114:0/4192532458 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b1015b420 con 0x7f5b1015bf00 2023-10-18T12:21:14.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.924+0000 7f5b0e59c700 1 --2- 172.21.15.114:0/4192532458 >> v2:172.21.15.172:3300/0 conn(0x7f5b10155420 0x7f5b100cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:21:14.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.924+0000 7f5b05d9b700 1 --2- 172.21.15.114:0/4192532458 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b1015bf00 0x7f5b100cdc10 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f5b1006acf0 tx=0x7f5af8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd3e9d843ef2a39 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:14.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.924+0000 7f5b0dd9b700 1 -- 172.21.15.114:0/4192532458 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af800b8a0 con 0x7f5b1015bf00 2023-10-18T12:21:14.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.924+0000 7f5b0dd9b700 1 -- 172.21.15.114:0/4192532458 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af800ba00 con 0x7f5b1015bf00 2023-10-18T12:21:14.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.924+0000 7f5b0dd9b700 1 -- 172.21.15.114:0/4192532458 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af800bd70 con 0x7f5b1015bf00 2023-10-18T12:21:14.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.928+0000 7f5b14f2b700 1 -- 172.21.15.114:0/4192532458 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b1015bf00 msgr2=0x7f5b100cdc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:14.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.928+0000 7f5b14f2b700 1 --2- 172.21.15.114:0/4192532458 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b1015bf00 0x7f5b100cdc10 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f5b1006acf0 tx=0x7f5af8009bf0 comp rx=0 tx=0).stop 2023-10-18T12:21:14.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.928+0000 7f5b14f2b700 1 -- 172.21.15.114:0/4192532458 shutdown_connections 2023-10-18T12:21:14.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.928+0000 7f5b14f2b700 1 --2- 172.21.15.114:0/4192532458 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b1015bf00 0x7f5b100cdc10 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:14.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.928+0000 7f5b14f2b700 1 --2- 172.21.15.114:0/4192532458 >> v2:172.21.15.172:3300/0 conn(0x7f5b10155420 0x7f5b100cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:14.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.928+0000 7f5b14f2b700 1 -- 172.21.15.114:0/4192532458 >> 172.21.15.114:0/4192532458 conn(0x7f5b1006a340 msgr2=0x7f5b100b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:14.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.928+0000 7f5b14f2b700 1 -- 172.21.15.114:0/4192532458 shutdown_connections 2023-10-18T12:21:14.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.928+0000 7f5b14f2b700 1 -- 172.21.15.114:0/4192532458 wait complete. 2023-10-18T12:21:14.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.932+0000 7f5b14f2b700 1 Processor -- start 2023-10-18T12:21:14.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.932+0000 7f5b14f2b700 1 -- start start 2023-10-18T12:21:14.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.932+0000 7f5b14f2b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5b100b0f90 0x7f5b101f0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:14.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.932+0000 7f5b14f2b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b10155420 0x7f5b10139fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:14.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.932+0000 7f5b14f2b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b1015bf00 0x7f5b101429e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:14.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.932+0000 7f5b14f2b700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1013ce10 con 0x7f5b1015bf00 2023-10-18T12:21:14.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.932+0000 7f5b14f2b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1013dd20 con 0x7f5b10155420 2023-10-18T12:21:14.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.932+0000 7f5b14f2b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b101f0fa0 con 0x7f5b100b0f90 2023-10-18T12:21:14.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.932+0000 7f5b0ed9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b1015bf00 0x7f5b101429e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:14.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.932+0000 7f5b0e59c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5b100b0f90 0x7f5b101f0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:14.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.932+0000 7f5b0ed9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b1015bf00 0x7f5b101429e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36770/0 (socket says 172.21.15.114:36770) 2023-10-18T12:21:14.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.932+0000 7f5b0ed9d700 1 -- 172.21.15.114:0/1541470903 learned_addr learned my addr 172.21.15.114:0/1541470903 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:14.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.932+0000 7f5b05d9b700 1 --2- 172.21.15.114:0/1541470903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b10155420 0x7f5b10139fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:14.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.932+0000 7f5b0e59c700 1 -- 172.21.15.114:0/1541470903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b10155420 msgr2=0x7f5b10139fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:14.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.932+0000 7f5b0e59c700 1 --2- 172.21.15.114:0/1541470903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b10155420 0x7f5b10139fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:14.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.932+0000 7f5b0e59c700 1 -- 172.21.15.114:0/1541470903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b1015bf00 msgr2=0x7f5b101429e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:14.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.932+0000 7f5b0e59c700 1 --2- 172.21.15.114:0/1541470903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b1015bf00 0x7f5b101429e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:14.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.932+0000 7f5b0e59c700 1 -- 172.21.15.114:0/1541470903 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af8009570 con 0x7f5b100b0f90 2023-10-18T12:21:14.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.932+0000 7f5b0ed9d700 1 --2- 172.21.15.114:0/1541470903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b1015bf00 0x7f5b101429e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:21:14.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.936+0000 7f5b0e59c700 1 --2- 172.21.15.114:0/1541470903 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5b100b0f90 0x7f5b101f0a60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5b0000cea0 tx=0x7f5b0000ced0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:14.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.936+0000 7f5b077fe700 1 -- 172.21.15.114:0/1541470903 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0000ad40 con 0x7f5b100b0f90 2023-10-18T12:21:14.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.936+0000 7f5b077fe700 1 -- 172.21.15.114:0/1541470903 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b00015440 con 0x7f5b100b0f90 2023-10-18T12:21:14.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.936+0000 7f5b14f2b700 1 -- 172.21.15.114:0/1541470903 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b1013a500 con 0x7f5b100b0f90 2023-10-18T12:21:14.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.936+0000 7f5b077fe700 1 -- 172.21.15.114:0/1541470903 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0000aea0 con 0x7f5b100b0f90 2023-10-18T12:21:14.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.936+0000 7f5b14f2b700 1 -- 172.21.15.114:0/1541470903 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b1013c570 con 0x7f5b100b0f90 2023-10-18T12:21:14.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.936+0000 7f5b14f2b700 1 -- 172.21.15.114:0/1541470903 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b1013fa90 con 0x7f5b100b0f90 2023-10-18T12:21:14.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.940+0000 7f5b077fe700 1 -- 172.21.15.114:0/1541470903 <== mon.2 v2:172.21.15.172:3301/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f5b000157d0 con 0x7f5b100b0f90 2023-10-18T12:21:14.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.940+0000 7f5b077fe700 1 --2- 172.21.15.114:0/1541470903 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5af0065720 0x7f5af0067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:14.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.940+0000 7f5b077fe700 1 -- 172.21.15.114:0/1541470903 <== mon.2 v2:172.21.15.172:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f5b00083070 con 0x7f5b100b0f90 2023-10-18T12:21:14.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.940+0000 7f5b05d9b700 1 --2- 172.21.15.114:0/1541470903 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5af0065720 0x7f5af0067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:14.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.944+0000 7f5b05d9b700 1 --2- 172.21.15.114:0/1541470903 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5af0065720 0x7f5af0067be0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5af8006f80 tx=0x7f5af801d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:14.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:14.948+0000 7f5b077fe700 1 -- 172.21.15.114:0/1541470903 <== mon.2 v2:172.21.15.172:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f5b000b3d40 con 0x7f5b100b0f90 2023-10-18T12:21:15.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.128+0000 7f5b14f2b700 1 -- 172.21.15.114:0/1541470903 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b10072e60 con 0x7f5b100b0f90 2023-10-18T12:21:15.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.132+0000 7f5b077fe700 1 -- 172.21.15.114:0/1541470903 <== mon.2 v2:172.21.15.172:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+18537 (secure 0 0 0) 0x7f5b00050950 con 0x7f5b100b0f90 2023-10-18T12:21:15.138 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:21:15.139 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":41,"fsid":"240ea340-5d3d-4f52-a4bc-af075aca3deb","created":"2023-10-18T12:19:12.512994+0000","modified":"2023-10-18T12:21:14.158120+0000","last_up_change":"2023-10-18T12:19:25.286009+0000","last_in_change":"2023-10-18T12:19:15.850693+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T12:19:27.040638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-18T12:19:32.358094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-18T12:21:12.105324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-18T12:21:13.154105+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c3578978-1a03-4857-b9d2-34a5da3d7731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6817","nonce":1506287862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6820","nonce":1506287862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6830","nonce":1506287862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6825","nonce":1506287862}]},"public_addr":"172.21.15.114:6817/1506287862","cluster_addr":"172.21.15.114:6820/1506287862","heartbeat_back_addr":"172.21.15.114:6830/1506287862","heartbeat_front_addr":"172.21.15.114:6825/1506287862","state":["exists","up"]},{"osd":1,"uuid":"43eb26a6-e2b3-4670-9559-bd053b5140d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6801","nonce":3302727047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6803","nonce":3302727047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6807","nonce":3302727047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6805","nonce":3302727047}]},"public_addr":"172.21.15.114:6801/3302727047","cluster_addr":"172.21.15.114:6803/3302727047","heartbeat_back_addr":"172.21.15.114:6807/3302727047","heartbeat_front_addr":"172.21.15.114:6805/3302727047","state":["exists","up"]},{"osd":2,"uuid":"f3d4dbd5-521c-4dd2-b687-5768cc7d0938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6809","nonce":2699151351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6811","nonce":2699151351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6815","nonce":2699151351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6813","nonce":2699151351}]},"public_addr":"172.21.15.114:6809/2699151351","cluster_addr":"172.21.15.114:6811/2699151351","heartbeat_back_addr":"172.21.15.114:6815/2699151351","heartbeat_front_addr":"172.21.15.114:6813/2699151351","state":["exists","up"]},{"osd":3,"uuid":"823e5802-92b7-4f0d-b32d-a5748993f1b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6821","nonce":1361608073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6824","nonce":1361608073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6829","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6831","nonce":1361608073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6827","nonce":1361608073}]},"public_addr":"172.21.15.114:6821/1361608073","cluster_addr":"172.21.15.114:6824/1361608073","heartbeat_back_addr":"172.21.15.114:6831/1361608073","heartbeat_front_addr":"172.21.15.114:6827/1361608073","state":["exists","up"]},{"osd":4,"uuid":"e47fb93e-13b4-44a4-b084-8c4384ceb41e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6801","nonce":930839681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6803","nonce":930839681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6807","nonce":930839681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6805","nonce":930839681}]},"public_addr":"172.21.15.172:6801/930839681","cluster_addr":"172.21.15.172:6803/930839681","heartbeat_back_addr":"172.21.15.172:6807/930839681","heartbeat_front_addr":"172.21.15.172:6805/930839681","state":["exists","up"]},{"osd":5,"uuid":"7561a973-f479-45a0-af40-f324728d622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6814","nonce":571761850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6818","nonce":571761850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6824","nonce":571761850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6821","nonce":571761850}]},"public_addr":"172.21.15.172:6814/571761850","cluster_addr":"172.21.15.172:6818/571761850","heartbeat_back_addr":"172.21.15.172:6824/571761850","heartbeat_front_addr":"172.21.15.172:6821/571761850","state":["exists","up"]},{"osd":6,"uuid":"51753f4b-7f06-4f1c-9ec7-6e18a66eb980","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6825","nonce":1680398853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6827","nonce":1680398853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6831","nonce":1680398853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6829","nonce":1680398853}]},"public_addr":"172.21.15.172:6825/1680398853","cluster_addr":"172.21.15.172:6827/1680398853","heartbeat_back_addr":"172.21.15.172:6831/1680398853","heartbeat_front_addr":"172.21.15.172:6829/1680398853","state":["exists","up"]},{"osd":7,"uuid":"4d8b1e15-143d-4d17-9074-59d92f0f9af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6809","nonce":349710101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6811","nonce":349710101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6819","nonce":349710101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6815","nonce":349710101}]},"public_addr":"172.21.15.172:6809/349710101","cluster_addr":"172.21.15.172:6811/349710101","heartbeat_back_addr":"172.21.15.172:6819/349710101","heartbeat_front_addr":"172.21.15.172:6815/349710101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.889460+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.475494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.911473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.648596+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.609994+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.636248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.854589+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.885826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T12:21:15.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.136+0000 7f5b14f2b700 1 -- 172.21.15.114:0/1541470903 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5af0065720 msgr2=0x7f5af0067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:15.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.136+0000 7f5b14f2b700 1 --2- 172.21.15.114:0/1541470903 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5af0065720 0x7f5af0067be0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5af8006f80 tx=0x7f5af801d040 comp rx=0 tx=0).stop 2023-10-18T12:21:15.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.136+0000 7f5b14f2b700 1 -- 172.21.15.114:0/1541470903 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5b100b0f90 msgr2=0x7f5b101f0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:15.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.136+0000 7f5b14f2b700 1 --2- 172.21.15.114:0/1541470903 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5b100b0f90 0x7f5b101f0a60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5b0000cea0 tx=0x7f5b0000ced0 comp rx=0 tx=0).stop 2023-10-18T12:21:15.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.136+0000 7f5b14f2b700 1 -- 172.21.15.114:0/1541470903 shutdown_connections 2023-10-18T12:21:15.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.136+0000 7f5b14f2b700 1 --2- 172.21.15.114:0/1541470903 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5af0065720 0x7f5af0067be0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:15.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.136+0000 7f5b14f2b700 1 --2- 172.21.15.114:0/1541470903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5b1015bf00 0x7f5b101429e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:15.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.136+0000 7f5b14f2b700 1 --2- 172.21.15.114:0/1541470903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b10155420 0x7f5b10139fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:15.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.136+0000 7f5b14f2b700 1 --2- 172.21.15.114:0/1541470903 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5b100b0f90 0x7f5b101f0a60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:15.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.136+0000 7f5b14f2b700 1 -- 172.21.15.114:0/1541470903 >> 172.21.15.114:0/1541470903 conn(0x7f5b1006a340 msgr2=0x7f5b100cdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:15.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.136+0000 7f5b14f2b700 1 -- 172.21.15.114:0/1541470903 shutdown_connections 2023-10-18T12:21:15.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.136+0000 7f5b14f2b700 1 -- 172.21.15.114:0/1541470903 wait complete. 2023-10-18T12:21:15.163 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T12:21:15.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.324+0000 7f034359e700 1 Processor -- start 2023-10-18T12:21:15.332 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.324+0000 7f034359e700 1 -- start start 2023-10-18T12:21:15.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.328+0000 7f034359e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f034406d090 0x7f03440b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:15.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.328+0000 7f034359e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f034406d470 0x7f0344070a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:15.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.328+0000 7f034359e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0344070f50 0x7f034415a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:15.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.328+0000 7f034359e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f034415f4f0 con 0x7f0344070f50 2023-10-18T12:21:15.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.328+0000 7f034359e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f034415e990 con 0x7f034406d090 2023-10-18T12:21:15.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.328+0000 7f034359e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f034415ec50 con 0x7f034406d470 2023-10-18T12:21:15.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.328+0000 7f0342d9d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0344070f50 0x7f034415a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:15.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.328+0000 7f0342d9d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f0344070f50 0x7f034415a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39226/0 (socket says 172.21.15.114:39226) 2023-10-18T12:21:15.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.328+0000 7f0342d9d700 1 -- 172.21.15.114:0/4149000743 learned_addr learned my addr 172.21.15.114:0/4149000743 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:15.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.328+0000 7f034259c700 1 --2- 172.21.15.114:0/4149000743 >> v2:172.21.15.172:3300/0 conn(0x7f034406d090 0x7f03440b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:15.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.328+0000 7f0339d9b700 1 --2- 172.21.15.114:0/4149000743 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f034406d470 0x7f0344070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:15.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.328+0000 7f0342d9d700 1 -- 172.21.15.114:0/4149000743 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f034406d470 msgr2=0x7f0344070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:15.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.328+0000 7f0342d9d700 1 --2- 172.21.15.114:0/4149000743 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f034406d470 0x7f0344070a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:15.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.328+0000 7f0342d9d700 1 -- 172.21.15.114:0/4149000743 >> v2:172.21.15.172:3300/0 conn(0x7f034406d090 msgr2=0x7f03440b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:15.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.328+0000 7f0342d9d700 1 --2- 172.21.15.114:0/4149000743 >> v2:172.21.15.172:3300/0 conn(0x7f034406d090 0x7f03440b2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:15.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.328+0000 7f0342d9d700 1 -- 172.21.15.114:0/4149000743 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f034415ef30 con 0x7f0344070f50 2023-10-18T12:21:15.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.328+0000 7f034259c700 1 --2- 172.21.15.114:0/4149000743 >> v2:172.21.15.172:3300/0 conn(0x7f034406d090 0x7f03440b2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:21:15.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.328+0000 7f0342d9d700 1 --2- 172.21.15.114:0/4149000743 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0344070f50 0x7f034415a410 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f03440cf440 tx=0x7f033c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=928ed206f2c4ace6 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:15.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.328+0000 7f0341d9b700 1 -- 172.21.15.114:0/4149000743 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c00b8a0 con 0x7f0344070f50 2023-10-18T12:21:15.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.332+0000 7f0341d9b700 1 -- 172.21.15.114:0/4149000743 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033c00ba00 con 0x7f0344070f50 2023-10-18T12:21:15.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.332+0000 7f0341d9b700 1 -- 172.21.15.114:0/4149000743 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c00bd90 con 0x7f0344070f50 2023-10-18T12:21:15.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.332+0000 7f034359e700 1 -- 172.21.15.114:0/4149000743 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0344070f50 msgr2=0x7f034415a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:15.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.332+0000 7f034359e700 1 --2- 172.21.15.114:0/4149000743 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0344070f50 0x7f034415a410 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f03440cf440 tx=0x7f033c009bf0 comp rx=0 tx=0).stop 2023-10-18T12:21:15.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.332+0000 7f034359e700 1 -- 172.21.15.114:0/4149000743 shutdown_connections 2023-10-18T12:21:15.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.332+0000 7f034359e700 1 --2- 172.21.15.114:0/4149000743 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0344070f50 0x7f034415a410 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:15.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.332+0000 7f034359e700 1 --2- 172.21.15.114:0/4149000743 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f034406d470 0x7f0344070a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:15.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.332+0000 7f034359e700 1 --2- 172.21.15.114:0/4149000743 >> v2:172.21.15.172:3300/0 conn(0x7f034406d090 0x7f03440b2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:15.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.332+0000 7f034359e700 1 -- 172.21.15.114:0/4149000743 >> 172.21.15.114:0/4149000743 conn(0x7f03440ce5c0 msgr2=0x7f03440ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:15.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.332+0000 7f034359e700 1 -- 172.21.15.114:0/4149000743 shutdown_connections 2023-10-18T12:21:15.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.332+0000 7f034359e700 1 -- 172.21.15.114:0/4149000743 wait complete. 2023-10-18T12:21:15.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.336+0000 7f034359e700 1 Processor -- start 2023-10-18T12:21:15.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.336+0000 7f034359e700 1 -- start start 2023-10-18T12:21:15.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.336+0000 7f034359e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f034406d090 0x7f03440cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:15.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.336+0000 7f034359e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f034406d470 0x7f03440c5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:15.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.336+0000 7f034359e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0344070f50 0x7f03440cced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:15.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.336+0000 7f034359e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03440c5bd0 con 0x7f034406d470 2023-10-18T12:21:15.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.336+0000 7f034359e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03440cd410 con 0x7f0344070f50 2023-10-18T12:21:15.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.336+0000 7f034359e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03440c7560 con 0x7f034406d090 2023-10-18T12:21:15.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.336+0000 7f0339d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f034406d470 0x7f03440c5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:15.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.336+0000 7f0339d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f034406d470 0x7f03440c5690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39232/0 (socket says 172.21.15.114:39232) 2023-10-18T12:21:15.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.336+0000 7f0339d9b700 1 -- 172.21.15.114:0/2388564664 learned_addr learned my addr 172.21.15.114:0/2388564664 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:15.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.336+0000 7f0342d9d700 1 --2- 172.21.15.114:0/2388564664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0344070f50 0x7f03440cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:15.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.336+0000 7f034259c700 1 --2- 172.21.15.114:0/2388564664 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f034406d090 0x7f03440cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:15.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.336+0000 7f0339d9b700 1 -- 172.21.15.114:0/2388564664 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f034406d090 msgr2=0x7f03440cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:15.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.336+0000 7f0339d9b700 1 --2- 172.21.15.114:0/2388564664 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f034406d090 0x7f03440cdab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:15.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.336+0000 7f0339d9b700 1 -- 172.21.15.114:0/2388564664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0344070f50 msgr2=0x7f03440cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:15.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.336+0000 7f0339d9b700 1 --2- 172.21.15.114:0/2388564664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0344070f50 0x7f03440cced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:15.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.336+0000 7f0339d9b700 1 -- 172.21.15.114:0/2388564664 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f033c009570 con 0x7f034406d470 2023-10-18T12:21:15.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.336+0000 7f034259c700 1 --2- 172.21.15.114:0/2388564664 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f034406d090 0x7f03440cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:21:15.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.336+0000 7f0339d9b700 1 --2- 172.21.15.114:0/2388564664 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f034406d470 0x7f03440c5690 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f032c00e760 tx=0x7f032c00ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:15.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.336+0000 7f033b7fe700 1 -- 172.21.15.114:0/2388564664 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032c013610 con 0x7f034406d470 2023-10-18T12:21:15.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.336+0000 7f033b7fe700 1 -- 172.21.15.114:0/2388564664 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f032c013770 con 0x7f034406d470 2023-10-18T12:21:15.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.336+0000 7f033b7fe700 1 -- 172.21.15.114:0/2388564664 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032c013ae0 con 0x7f034406d470 2023-10-18T12:21:15.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.336+0000 7f034359e700 1 -- 172.21.15.114:0/2388564664 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03440c7840 con 0x7f034406d470 2023-10-18T12:21:15.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.336+0000 7f034359e700 1 -- 172.21.15.114:0/2388564664 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03440c7e00 con 0x7f034406d470 2023-10-18T12:21:15.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.340+0000 7f034359e700 1 -- 172.21.15.114:0/2388564664 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0344072e60 con 0x7f034406d470 2023-10-18T12:21:15.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.340+0000 7f033b7fe700 1 -- 172.21.15.114:0/2388564664 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f032c013c40 con 0x7f034406d470 2023-10-18T12:21:15.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.344+0000 7f033b7fe700 1 --2- 172.21.15.114:0/2388564664 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0324065720 0x7f0324067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:15.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.344+0000 7f033b7fe700 1 -- 172.21.15.114:0/2388564664 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f032c082b90 con 0x7f034406d470 2023-10-18T12:21:15.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.344+0000 7f034259c700 1 --2- 172.21.15.114:0/2388564664 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0324065720 0x7f0324067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:15.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.344+0000 7f034259c700 1 --2- 172.21.15.114:0/2388564664 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0324065720 0x7f0324067be0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0334009bc0 tx=0x7f0334003a60 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:15.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.348+0000 7f033b7fe700 1 -- 172.21.15.114:0/2388564664 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f032c053f10 con 0x7f034406d470 2023-10-18T12:21:15.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.524+0000 7f034359e700 1 -- 172.21.15.114:0/2388564664 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f034406e030 con 0x7f034406d470 2023-10-18T12:21:15.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.528+0000 7f033b7fe700 1 -- 172.21.15.114:0/2388564664 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+18537 (secure 0 0 0) 0x7f032c021020 con 0x7f034406d470 2023-10-18T12:21:15.534 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:21:15.534 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":41,"fsid":"240ea340-5d3d-4f52-a4bc-af075aca3deb","created":"2023-10-18T12:19:12.512994+0000","modified":"2023-10-18T12:21:14.158120+0000","last_up_change":"2023-10-18T12:19:25.286009+0000","last_in_change":"2023-10-18T12:19:15.850693+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T12:19:27.040638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-18T12:19:32.358094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-18T12:21:12.105324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-18T12:21:13.154105+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c3578978-1a03-4857-b9d2-34a5da3d7731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6817","nonce":1506287862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6820","nonce":1506287862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6830","nonce":1506287862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6825","nonce":1506287862}]},"public_addr":"172.21.15.114:6817/1506287862","cluster_addr":"172.21.15.114:6820/1506287862","heartbeat_back_addr":"172.21.15.114:6830/1506287862","heartbeat_front_addr":"172.21.15.114:6825/1506287862","state":["exists","up"]},{"osd":1,"uuid":"43eb26a6-e2b3-4670-9559-bd053b5140d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6801","nonce":3302727047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6803","nonce":3302727047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6807","nonce":3302727047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6805","nonce":3302727047}]},"public_addr":"172.21.15.114:6801/3302727047","cluster_addr":"172.21.15.114:6803/3302727047","heartbeat_back_addr":"172.21.15.114:6807/3302727047","heartbeat_front_addr":"172.21.15.114:6805/3302727047","state":["exists","up"]},{"osd":2,"uuid":"f3d4dbd5-521c-4dd2-b687-5768cc7d0938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6809","nonce":2699151351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6811","nonce":2699151351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6815","nonce":2699151351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6813","nonce":2699151351}]},"public_addr":"172.21.15.114:6809/2699151351","cluster_addr":"172.21.15.114:6811/2699151351","heartbeat_back_addr":"172.21.15.114:6815/2699151351","heartbeat_front_addr":"172.21.15.114:6813/2699151351","state":["exists","up"]},{"osd":3,"uuid":"823e5802-92b7-4f0d-b32d-a5748993f1b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6821","nonce":1361608073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6824","nonce":1361608073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6829","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6831","nonce":1361608073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6827","nonce":1361608073}]},"public_addr":"172.21.15.114:6821/1361608073","cluster_addr":"172.21.15.114:6824/1361608073","heartbeat_back_addr":"172.21.15.114:6831/1361608073","heartbeat_front_addr":"172.21.15.114:6827/1361608073","state":["exists","up"]},{"osd":4,"uuid":"e47fb93e-13b4-44a4-b084-8c4384ceb41e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6801","nonce":930839681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6803","nonce":930839681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6807","nonce":930839681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6805","nonce":930839681}]},"public_addr":"172.21.15.172:6801/930839681","cluster_addr":"172.21.15.172:6803/930839681","heartbeat_back_addr":"172.21.15.172:6807/930839681","heartbeat_front_addr":"172.21.15.172:6805/930839681","state":["exists","up"]},{"osd":5,"uuid":"7561a973-f479-45a0-af40-f324728d622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6814","nonce":571761850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6818","nonce":571761850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6824","nonce":571761850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6821","nonce":571761850}]},"public_addr":"172.21.15.172:6814/571761850","cluster_addr":"172.21.15.172:6818/571761850","heartbeat_back_addr":"172.21.15.172:6824/571761850","heartbeat_front_addr":"172.21.15.172:6821/571761850","state":["exists","up"]},{"osd":6,"uuid":"51753f4b-7f06-4f1c-9ec7-6e18a66eb980","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6825","nonce":1680398853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6827","nonce":1680398853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6831","nonce":1680398853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6829","nonce":1680398853}]},"public_addr":"172.21.15.172:6825/1680398853","cluster_addr":"172.21.15.172:6827/1680398853","heartbeat_back_addr":"172.21.15.172:6831/1680398853","heartbeat_front_addr":"172.21.15.172:6829/1680398853","state":["exists","up"]},{"osd":7,"uuid":"4d8b1e15-143d-4d17-9074-59d92f0f9af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6809","nonce":349710101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6811","nonce":349710101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6819","nonce":349710101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6815","nonce":349710101}]},"public_addr":"172.21.15.172:6809/349710101","cluster_addr":"172.21.15.172:6811/349710101","heartbeat_back_addr":"172.21.15.172:6819/349710101","heartbeat_front_addr":"172.21.15.172:6815/349710101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.889460+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.475494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.911473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.648596+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.609994+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.636248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.854589+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.885826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T12:21:15.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.528+0000 7f034359e700 1 -- 172.21.15.114:0/2388564664 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0324065720 msgr2=0x7f0324067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:15.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.528+0000 7f034359e700 1 --2- 172.21.15.114:0/2388564664 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0324065720 0x7f0324067be0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0334009bc0 tx=0x7f0334003a60 comp rx=0 tx=0).stop 2023-10-18T12:21:15.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.528+0000 7f034359e700 1 -- 172.21.15.114:0/2388564664 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f034406d470 msgr2=0x7f03440c5690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:15.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.528+0000 7f034359e700 1 --2- 172.21.15.114:0/2388564664 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f034406d470 0x7f03440c5690 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f032c00e760 tx=0x7f032c00ea70 comp rx=0 tx=0).stop 2023-10-18T12:21:15.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.528+0000 7f034359e700 1 -- 172.21.15.114:0/2388564664 shutdown_connections 2023-10-18T12:21:15.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.528+0000 7f034359e700 1 --2- 172.21.15.114:0/2388564664 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0324065720 0x7f0324067be0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:15.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.528+0000 7f034359e700 1 --2- 172.21.15.114:0/2388564664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0344070f50 0x7f03440cced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:15.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.528+0000 7f034359e700 1 --2- 172.21.15.114:0/2388564664 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f034406d470 0x7f03440c5690 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:15.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.528+0000 7f034359e700 1 --2- 172.21.15.114:0/2388564664 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f034406d090 0x7f03440cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:15.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.528+0000 7f034359e700 1 -- 172.21.15.114:0/2388564664 >> 172.21.15.114:0/2388564664 conn(0x7f03440ce5c0 msgr2=0x7f03440c9840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:15.537 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.528+0000 7f034359e700 1 -- 172.21.15.114:0/2388564664 shutdown_connections 2023-10-18T12:21:15.538 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.532+0000 7f034359e700 1 -- 172.21.15.114:0/2388564664 wait complete. 2023-10-18T12:21:15.560 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-18T12:21:15.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.724+0000 7f59cf59e700 1 Processor -- start 2023-10-18T12:21:15.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.724+0000 7f59cf59e700 1 -- start start 2023-10-18T12:21:15.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.724+0000 7f59cf59e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f59d015a410 0x7f59d015a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:15.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.728+0000 7f59cf59e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59d0071120 con 0x7f59d006d470 2023-10-18T12:21:15.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.728+0000 7f59cf59e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59d015e990 con 0x7f59d006d090 2023-10-18T12:21:15.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.728+0000 7f59cf59e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d015f4f0 con 0x7f59d015a410 2023-10-18T12:21:15.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.728+0000 7f59cdd9b700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f59d006d470 0x7f59d0070a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51860/0 (socket says 172.21.15.114:51860) 2023-10-18T12:21:15.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.728+0000 7f59cdd9b700 1 -- 172.21.15.114:0/3032882639 learned_addr learned my addr 172.21.15.114:0/3032882639 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:21:15.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.728+0000 7f59ced9d700 1 --2- 172.21.15.114:0/3032882639 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f59d015a410 0x7f59d015a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:15.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.728+0000 7f59cd59a700 1 -- 172.21.15.114:0/3032882639 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 618059285 0 0) 0x7f59d0071120 con 0x7f59d006d470 2023-10-18T12:21:15.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.728+0000 7f59cd59a700 1 -- 172.21.15.114:0/3032882639 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59b80035d0 con 0x7f59d006d470 2023-10-18T12:21:15.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.728+0000 7f59cd59a700 1 -- 172.21.15.114:0/3032882639 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3412448338 0 0) 0x7f59d015e990 con 0x7f59d006d090 2023-10-18T12:21:15.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.728+0000 7f59ced9d700 1 -- 172.21.15.114:0/3032882639 >> v1:172.21.15.172:6789/0 conn(0x7f59d006d090 legacy=0x7f59d00b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:15.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.728+0000 7f59ced9d700 1 -- 172.21.15.114:0/3032882639 >> v1:172.21.15.114:6789/0 conn(0x7f59d006d470 legacy=0x7f59d0070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:15.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.728+0000 7f59ced9d700 1 -- 172.21.15.114:0/3032882639 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d015ec50 con 0x7f59d015a410 2023-10-18T12:21:15.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.728+0000 7f59ced9d700 1 --2- 172.21.15.114:0/3032882639 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f59d015a410 0x7f59d015a8c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f59c8009dc0 tx=0x7f59c800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b73dc94a95e0182f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:15.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.728+0000 7f59cd59a700 1 -- 172.21.15.114:0/3032882639 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c800e070 con 0x7f59d015a410 2023-10-18T12:21:15.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.728+0000 7f59cd59a700 1 -- 172.21.15.114:0/3032882639 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c8003a40 con 0x7f59d015a410 2023-10-18T12:21:15.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.728+0000 7f59cd59a700 1 -- 172.21.15.114:0/3032882639 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c4001670 con 0x7f59d015a410 2023-10-18T12:21:15.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.728+0000 7f59cf59e700 1 -- 172.21.15.114:0/3032882639 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f59d015a410 msgr2=0x7f59d015a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:15.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.728+0000 7f59cf59e700 1 --2- 172.21.15.114:0/3032882639 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f59d015a410 0x7f59d015a8c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f59c8009dc0 tx=0x7f59c800b330 comp rx=0 tx=0).stop 2023-10-18T12:21:15.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.732+0000 7f59cf59e700 1 -- 172.21.15.114:0/3032882639 shutdown_connections 2023-10-18T12:21:15.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.732+0000 7f59cf59e700 1 --2- 172.21.15.114:0/3032882639 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f59d015a410 0x7f59d015a8c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:15.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.732+0000 7f59cf59e700 1 -- 172.21.15.114:0/3032882639 >> 172.21.15.114:0/3032882639 conn(0x7f59d00ce5c0 msgr2=0x7f59d00ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:15.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.732+0000 7f59cf59e700 1 -- 172.21.15.114:0/3032882639 shutdown_connections 2023-10-18T12:21:15.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.732+0000 7f59cf59e700 1 -- 172.21.15.114:0/3032882639 wait complete. 2023-10-18T12:21:15.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.732+0000 7f59cf59e700 1 Processor -- start 2023-10-18T12:21:15.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.732+0000 7f59cf59e700 1 -- start start 2023-10-18T12:21:15.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.736+0000 7f59cf59e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59d006d090 0x7f59d00cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:15.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.736+0000 7f59cf59e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f59d006d470 0x7f59d014c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:15.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.736+0000 7f59cf59e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59d015a410 0x7f59d0159120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:15.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.736+0000 7f59cf59e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d00cceb0 con 0x7f59d015a410 2023-10-18T12:21:15.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.736+0000 7f59cf59e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d00cc230 con 0x7f59d006d090 2023-10-18T12:21:15.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.736+0000 7f59cf59e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d00cc510 con 0x7f59d006d470 2023-10-18T12:21:15.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.736+0000 7f59ced9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59d015a410 0x7f59d0159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:15.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.736+0000 7f59ced9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59d015a410 0x7f59d0159120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39240/0 (socket says 172.21.15.114:39240) 2023-10-18T12:21:15.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.736+0000 7f59ced9d700 1 -- 172.21.15.114:0/1286120150 learned_addr learned my addr 172.21.15.114:0/1286120150 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:15.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.736+0000 7f59ce59c700 1 --2- 172.21.15.114:0/1286120150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59d006d090 0x7f59d00cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:15.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.736+0000 7f59cdd9b700 1 --2- 172.21.15.114:0/1286120150 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f59d006d470 0x7f59d014c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:15.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.736+0000 7f59ced9d700 1 -- 172.21.15.114:0/1286120150 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f59d006d470 msgr2=0x7f59d014c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:15.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.736+0000 7f59ced9d700 1 --2- 172.21.15.114:0/1286120150 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f59d006d470 0x7f59d014c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:15.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.736+0000 7f59ced9d700 1 -- 172.21.15.114:0/1286120150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59d006d090 msgr2=0x7f59d00cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:15.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.736+0000 7f59ced9d700 1 --2- 172.21.15.114:0/1286120150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59d006d090 0x7f59d00cd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:15.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.736+0000 7f59ced9d700 1 -- 172.21.15.114:0/1286120150 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c8009a70 con 0x7f59d015a410 2023-10-18T12:21:15.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.736+0000 7f59ced9d700 1 --2- 172.21.15.114:0/1286120150 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59d015a410 0x7f59d0159120 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f59c8015040 tx=0x7f59c8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:15.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.736+0000 7f59beffd700 1 -- 172.21.15.114:0/1286120150 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c80045c0 con 0x7f59d015a410 2023-10-18T12:21:15.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.736+0000 7f59beffd700 1 -- 172.21.15.114:0/1286120150 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c8004760 con 0x7f59d015a410 2023-10-18T12:21:15.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.736+0000 7f59beffd700 1 -- 172.21.15.114:0/1286120150 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c8009410 con 0x7f59d015a410 2023-10-18T12:21:15.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.736+0000 7f59cf59e700 1 -- 172.21.15.114:0/1286120150 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59d00cc7f0 con 0x7f59d015a410 2023-10-18T12:21:15.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.736+0000 7f59cf59e700 1 -- 172.21.15.114:0/1286120150 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59d014c670 con 0x7f59d015a410 2023-10-18T12:21:15.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.740+0000 7f59cf59e700 1 -- 172.21.15.114:0/1286120150 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59d00ccff0 con 0x7f59d015a410 2023-10-18T12:21:15.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.740+0000 7f59beffd700 1 -- 172.21.15.114:0/1286120150 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f59c8012450 con 0x7f59d015a410 2023-10-18T12:21:15.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.740+0000 7f59beffd700 1 --2- 172.21.15.114:0/1286120150 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f59b0065720 0x7f59b0067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:15.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.740+0000 7f59beffd700 1 -- 172.21.15.114:0/1286120150 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f59c8084710 con 0x7f59d015a410 2023-10-18T12:21:15.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.740+0000 7f59ce59c700 1 --2- 172.21.15.114:0/1286120150 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f59b0065720 0x7f59b0067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:15.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.744+0000 7f59ce59c700 1 --2- 172.21.15.114:0/1286120150 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f59b0065720 0x7f59b0067be0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f59c0007fd0 tx=0x7f59c0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:15.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:15.748+0000 7f59beffd700 1 -- 172.21.15.114:0/1286120150 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f59d00ccff0 con 0x7f59d015a410 2023-10-18T12:21:16.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.040+0000 7f59cf59e700 1 -- 172.21.15.114:0/1286120150 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f59d00ccff0 con 0x7f59d015a410 2023-10-18T12:21:16.620 INFO:tasks.ceph.mds.a.smithi114.stderr:2023-10-18T12:21:16.616+0000 7fc6ee32b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-18T12:21:16.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.728+0000 7f59beffd700 1 -- 172.21.15.114:0/1286120150 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7f59d00ccff0 con 0x7f59d015a410 2023-10-18T12:21:16.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.732+0000 7f59cf59e700 1 -- 172.21.15.114:0/1286120150 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f59b0065720 msgr2=0x7f59b0067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:16.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.732+0000 7f59cf59e700 1 --2- 172.21.15.114:0/1286120150 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f59b0065720 0x7f59b0067be0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f59c0007fd0 tx=0x7f59c0009040 comp rx=0 tx=0).stop 2023-10-18T12:21:16.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.732+0000 7f59cf59e700 1 -- 172.21.15.114:0/1286120150 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59d015a410 msgr2=0x7f59d0159120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:16.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.732+0000 7f59cf59e700 1 --2- 172.21.15.114:0/1286120150 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59d015a410 0x7f59d0159120 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f59c8015040 tx=0x7f59c8004af0 comp rx=0 tx=0).stop 2023-10-18T12:21:16.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.736+0000 7f59cf59e700 1 -- 172.21.15.114:0/1286120150 shutdown_connections 2023-10-18T12:21:16.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.736+0000 7f59cf59e700 1 --2- 172.21.15.114:0/1286120150 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f59b0065720 0x7f59b0067be0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:16.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.736+0000 7f59cf59e700 1 --2- 172.21.15.114:0/1286120150 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f59d006d470 0x7f59d014c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:16.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.736+0000 7f59cf59e700 1 --2- 172.21.15.114:0/1286120150 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f59d015a410 0x7f59d0159120 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:16.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.736+0000 7f59cf59e700 1 --2- 172.21.15.114:0/1286120150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59d006d090 0x7f59d00cd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:16.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.736+0000 7f59cf59e700 1 -- 172.21.15.114:0/1286120150 >> 172.21.15.114:0/1286120150 conn(0x7f59d00ce5c0 msgr2=0x7f59d00c9520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:16.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.736+0000 7f59cf59e700 1 -- 172.21.15.114:0/1286120150 shutdown_connections 2023-10-18T12:21:16.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.736+0000 7f59cf59e700 1 -- 172.21.15.114:0/1286120150 wait complete. 2023-10-18T12:21:16.764 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-18T12:21:16.764 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-18T12:21:16.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.948+0000 7fc7e3fff700 1 Processor -- start 2023-10-18T12:21:16.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.948+0000 7fc7e3fff700 1 -- start start 2023-10-18T12:21:16.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.952+0000 7fc7e3fff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc7e40d3530 0x7fc7e406fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:16.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.952+0000 7fc7e3fff700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e40b6e40 con 0x7fc7e40d23e0 2023-10-18T12:21:16.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.952+0000 7fc7e3fff700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e40b7120 con 0x7fc7e415dcf0 2023-10-18T12:21:16.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.952+0000 7fc7e3fff700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7e415e160 con 0x7fc7e40d3530 2023-10-18T12:21:16.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.952+0000 7fc7e2ffd700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc7e40d23e0 0x7fc7e40b65f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51862/0 (socket says 172.21.15.114:51862) 2023-10-18T12:21:16.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.952+0000 7fc7e2ffd700 1 -- 172.21.15.114:0/382410169 learned_addr learned my addr 172.21.15.114:0/382410169 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:21:16.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.952+0000 7fc7e37fe700 1 --2- 172.21.15.114:0/382410169 >> v2:172.21.15.172:3300/0 conn(0x7fc7e40d3530 0x7fc7e406fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:16.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.952+0000 7fc7e1ffb700 1 -- 172.21.15.114:0/382410169 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1905009749 0 0) 0x7fc7e40b6e40 con 0x7fc7e40d23e0 2023-10-18T12:21:16.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.952+0000 7fc7e1ffb700 1 -- 172.21.15.114:0/382410169 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7cc0035d0 con 0x7fc7e40d23e0 2023-10-18T12:21:16.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.952+0000 7fc7e37fe700 1 -- 172.21.15.114:0/382410169 >> v1:172.21.15.172:6789/0 conn(0x7fc7e415dcf0 legacy=0x7fc7e40d2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:16.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.952+0000 7fc7e37fe700 1 -- 172.21.15.114:0/382410169 >> v1:172.21.15.114:6789/0 conn(0x7fc7e40d23e0 legacy=0x7fc7e40b65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:16.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.952+0000 7fc7e37fe700 1 -- 172.21.15.114:0/382410169 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e415d4f0 con 0x7fc7e40d3530 2023-10-18T12:21:16.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.956+0000 7fc7e37fe700 1 --2- 172.21.15.114:0/382410169 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7e40d3530 0x7fc7e406fef0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc009d90 tx=0x7fc7dc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c44e3c6b478b91c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:16.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.956+0000 7fc7e1ffb700 1 -- 172.21.15.114:0/382410169 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc00e070 con 0x7fc7e40d3530 2023-10-18T12:21:16.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.956+0000 7fc7e1ffb700 1 -- 172.21.15.114:0/382410169 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7dc00bb20 con 0x7fc7e40d3530 2023-10-18T12:21:16.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.956+0000 7fc7e1ffb700 1 -- 172.21.15.114:0/382410169 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc00be90 con 0x7fc7e40d3530 2023-10-18T12:21:16.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.956+0000 7fc7e3fff700 1 -- 172.21.15.114:0/382410169 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7e40d3530 msgr2=0x7fc7e406fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:16.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.956+0000 7fc7e3fff700 1 --2- 172.21.15.114:0/382410169 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7e40d3530 0x7fc7e406fef0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc009d90 tx=0x7fc7dc00b330 comp rx=0 tx=0).stop 2023-10-18T12:21:16.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.956+0000 7fc7e3fff700 1 -- 172.21.15.114:0/382410169 shutdown_connections 2023-10-18T12:21:16.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.956+0000 7fc7e3fff700 1 --2- 172.21.15.114:0/382410169 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7e40d3530 0x7fc7e406fef0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:16.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.956+0000 7fc7e3fff700 1 -- 172.21.15.114:0/382410169 >> 172.21.15.114:0/382410169 conn(0x7fc7e4069f20 msgr2=0x7fc7e406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:16.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.956+0000 7fc7e3fff700 1 -- 172.21.15.114:0/382410169 shutdown_connections 2023-10-18T12:21:16.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.956+0000 7fc7e3fff700 1 -- 172.21.15.114:0/382410169 wait complete. 2023-10-18T12:21:16.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.960+0000 7fc7e3fff700 1 Processor -- start 2023-10-18T12:21:16.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.960+0000 7fc7e3fff700 1 -- start start 2023-10-18T12:21:16.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.960+0000 7fc7e3fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7e40d23e0 0x7fc7e41573b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:16.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.960+0000 7fc7e3fff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7e40d3530 0x7fc7e40ae580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:16.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.960+0000 7fc7e3fff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc7e415dcf0 0x7fc7e40d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:16.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.960+0000 7fc7e3fff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e40b4480 con 0x7fc7e40d23e0 2023-10-18T12:21:16.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.960+0000 7fc7e3fff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e40b3890 con 0x7fc7e40d3530 2023-10-18T12:21:16.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.960+0000 7fc7e3fff700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e40b3ae0 con 0x7fc7e415dcf0 2023-10-18T12:21:16.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.960+0000 7fc7e2ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7e40d23e0 0x7fc7e41573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:16.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.960+0000 7fc7e2ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7e40d23e0 0x7fc7e41573b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39256/0 (socket says 172.21.15.114:39256) 2023-10-18T12:21:16.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.960+0000 7fc7e2ffd700 1 -- 172.21.15.114:0/959262614 learned_addr learned my addr 172.21.15.114:0/959262614 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:16.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.960+0000 7fc7e27fc700 1 --2- 172.21.15.114:0/959262614 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7e40d3530 0x7fc7e40ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:16.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.960+0000 7fc7e37fe700 1 --2- 172.21.15.114:0/959262614 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc7e415dcf0 0x7fc7e40d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:16.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.960+0000 7fc7e2ffd700 1 -- 172.21.15.114:0/959262614 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc7e415dcf0 msgr2=0x7fc7e40d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:16.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.960+0000 7fc7e2ffd700 1 --2- 172.21.15.114:0/959262614 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc7e415dcf0 0x7fc7e40d0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:16.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.960+0000 7fc7e2ffd700 1 -- 172.21.15.114:0/959262614 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7e40d3530 msgr2=0x7fc7e40ae580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:16.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.960+0000 7fc7e2ffd700 1 --2- 172.21.15.114:0/959262614 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7e40d3530 0x7fc7e40ae580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:16.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.960+0000 7fc7e2ffd700 1 -- 172.21.15.114:0/959262614 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7dc009a70 con 0x7fc7e40d23e0 2023-10-18T12:21:16.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.964+0000 7fc7e2ffd700 1 --2- 172.21.15.114:0/959262614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7e40d23e0 0x7fc7e41573b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc7d400c700 tx=0x7fc7d400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:16.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.964+0000 7fc7cbfff700 1 -- 172.21.15.114:0/959262614 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d4005d90 con 0x7fc7e40d23e0 2023-10-18T12:21:16.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.964+0000 7fc7cbfff700 1 -- 172.21.15.114:0/959262614 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d40070d0 con 0x7fc7e40d23e0 2023-10-18T12:21:16.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.964+0000 7fc7e3fff700 1 -- 172.21.15.114:0/959262614 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7e40b3dc0 con 0x7fc7e40d23e0 2023-10-18T12:21:16.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.964+0000 7fc7cbfff700 1 -- 172.21.15.114:0/959262614 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d4007480 con 0x7fc7e40d23e0 2023-10-18T12:21:16.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.964+0000 7fc7e3fff700 1 -- 172.21.15.114:0/959262614 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7e41578f0 con 0x7fc7e40d23e0 2023-10-18T12:21:16.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.964+0000 7fc7e3fff700 1 -- 172.21.15.114:0/959262614 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7e404e910 con 0x7fc7e40d23e0 2023-10-18T12:21:16.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.968+0000 7fc7cbfff700 1 -- 172.21.15.114:0/959262614 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fc7d40075e0 con 0x7fc7e40d23e0 2023-10-18T12:21:16.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.968+0000 7fc7cbfff700 1 --2- 172.21.15.114:0/959262614 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc7d00656f0 0x7fc7d0067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:16.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.968+0000 7fc7cbfff700 1 -- 172.21.15.114:0/959262614 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc7d4082480 con 0x7fc7e40d23e0 2023-10-18T12:21:16.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.968+0000 7fc7e27fc700 1 --2- 172.21.15.114:0/959262614 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc7d00656f0 0x7fc7d0067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:16.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.972+0000 7fc7e27fc700 1 --2- 172.21.15.114:0/959262614 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc7d00656f0 0x7fc7d0067bb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc7e40702d0 tx=0x7fc7d8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:16.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:16.972+0000 7fc7cbfff700 1 -- 172.21.15.114:0/959262614 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fc7d404fce0 con 0x7fc7e40d23e0 2023-10-18T12:21:17.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.196+0000 7fc7e3fff700 1 -- 172.21.15.114:0/959262614 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc7e406d450 con 0x7fc7e40d23e0 2023-10-18T12:21:17.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.740+0000 7fc7cbfff700 1 -- 172.21.15.114:0/959262614 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc7d4053300 con 0x7fc7e40d23e0 2023-10-18T12:21:17.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.744+0000 7fc7e3fff700 1 -- 172.21.15.114:0/959262614 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc7d00656f0 msgr2=0x7fc7d0067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:17.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.744+0000 7fc7e3fff700 1 --2- 172.21.15.114:0/959262614 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc7d00656f0 0x7fc7d0067bb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc7e40702d0 tx=0x7fc7d8009040 comp rx=0 tx=0).stop 2023-10-18T12:21:17.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.744+0000 7fc7e3fff700 1 -- 172.21.15.114:0/959262614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7e40d23e0 msgr2=0x7fc7e41573b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:17.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.744+0000 7fc7e3fff700 1 --2- 172.21.15.114:0/959262614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7e40d23e0 0x7fc7e41573b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc7d400c700 tx=0x7fc7d400ca10 comp rx=0 tx=0).stop 2023-10-18T12:21:17.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.744+0000 7fc7e3fff700 1 -- 172.21.15.114:0/959262614 shutdown_connections 2023-10-18T12:21:17.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.744+0000 7fc7e3fff700 1 --2- 172.21.15.114:0/959262614 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc7d00656f0 0x7fc7d0067bb0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:17.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.744+0000 7fc7e3fff700 1 --2- 172.21.15.114:0/959262614 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc7e415dcf0 0x7fc7e40d0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:17.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.744+0000 7fc7e3fff700 1 --2- 172.21.15.114:0/959262614 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7e40d3530 0x7fc7e40ae580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:17.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.744+0000 7fc7e3fff700 1 --2- 172.21.15.114:0/959262614 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7e40d23e0 0x7fc7e41573b0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:17.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.744+0000 7fc7e3fff700 1 -- 172.21.15.114:0/959262614 >> 172.21.15.114:0/959262614 conn(0x7fc7e4069f20 msgr2=0x7fc7e40cecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:17.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.744+0000 7fc7e3fff700 1 -- 172.21.15.114:0/959262614 shutdown_connections 2023-10-18T12:21:17.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.744+0000 7fc7e3fff700 1 -- 172.21.15.114:0/959262614 wait complete. 2023-10-18T12:21:17.772 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-18T12:21:17.773 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T12:21:17.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.948+0000 7f4daa861700 1 Processor -- start 2023-10-18T12:21:17.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.948+0000 7f4daa861700 1 -- start start 2023-10-18T12:21:17.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.952+0000 7f4daa861700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4da40b3d40 0x7f4da40cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:17.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.952+0000 7f4daa861700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4da4164a20 0x7f4da40c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:17.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.952+0000 7f4daa861700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4da406ce20 0x7f4da406d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:17.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.952+0000 7f4daa861700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4da406e2d0 con 0x7f4da4164a20 2023-10-18T12:21:17.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.952+0000 7f4daa861700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4da406d7d0 con 0x7f4da40b3d40 2023-10-18T12:21:17.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.952+0000 7f4daa861700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da40ca200 con 0x7f4da406ce20 2023-10-18T12:21:17.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.952+0000 7f4da905e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4da4164a20 0x7f4da40c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:17.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.952+0000 7f4da905e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4da4164a20 0x7f4da40c9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39270/0 (socket says 172.21.15.114:39270) 2023-10-18T12:21:17.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.952+0000 7f4da905e700 1 -- 172.21.15.114:0/4123617223 learned_addr learned my addr 172.21.15.114:0/4123617223 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:17.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.952+0000 7f4daa060700 1 --2- 172.21.15.114:0/4123617223 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4da406ce20 0x7f4da406d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:17.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.952+0000 7f4da985f700 1 --2- 172.21.15.114:0/4123617223 >> v2:172.21.15.172:3300/0 conn(0x7f4da40b3d40 0x7f4da40cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:17.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.952+0000 7f4da905e700 1 -- 172.21.15.114:0/4123617223 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4da406ce20 msgr2=0x7f4da406d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:17.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.952+0000 7f4da905e700 1 --2- 172.21.15.114:0/4123617223 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4da406ce20 0x7f4da406d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:17.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.952+0000 7f4da905e700 1 -- 172.21.15.114:0/4123617223 >> v2:172.21.15.172:3300/0 conn(0x7f4da40b3d40 msgr2=0x7f4da40cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:17.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.952+0000 7f4da905e700 1 --2- 172.21.15.114:0/4123617223 >> v2:172.21.15.172:3300/0 conn(0x7f4da40b3d40 0x7f4da40cc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:17.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.952+0000 7f4da905e700 1 -- 172.21.15.114:0/4123617223 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da40ca4c0 con 0x7f4da4164a20 2023-10-18T12:21:17.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.952+0000 7f4da985f700 1 --2- 172.21.15.114:0/4123617223 >> v2:172.21.15.172:3300/0 conn(0x7f4da40b3d40 0x7f4da40cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:21:17.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.952+0000 7f4daa060700 1 --2- 172.21.15.114:0/4123617223 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4da406ce20 0x7f4da406d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:21:17.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.952+0000 7f4da905e700 1 --2- 172.21.15.114:0/4123617223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4da4164a20 0x7f4da40c9cc0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f4da406e760 tx=0x7f4d94009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef48c50567de8bac server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:17.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.952+0000 7f4da885d700 1 -- 172.21.15.114:0/4123617223 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9400b8a0 con 0x7f4da4164a20 2023-10-18T12:21:17.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.952+0000 7f4da885d700 1 -- 172.21.15.114:0/4123617223 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d9400ba00 con 0x7f4da4164a20 2023-10-18T12:21:17.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.952+0000 7f4da885d700 1 -- 172.21.15.114:0/4123617223 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9400bd90 con 0x7f4da4164a20 2023-10-18T12:21:17.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.952+0000 7f4daa861700 1 -- 172.21.15.114:0/4123617223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4da4164a20 msgr2=0x7f4da40c9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:17.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.952+0000 7f4daa861700 1 --2- 172.21.15.114:0/4123617223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4da4164a20 0x7f4da40c9cc0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f4da406e760 tx=0x7f4d94009bf0 comp rx=0 tx=0).stop 2023-10-18T12:21:17.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.956+0000 7f4daa861700 1 -- 172.21.15.114:0/4123617223 shutdown_connections 2023-10-18T12:21:17.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.956+0000 7f4daa861700 1 --2- 172.21.15.114:0/4123617223 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4da406ce20 0x7f4da406d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:17.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.956+0000 7f4daa861700 1 --2- 172.21.15.114:0/4123617223 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4da4164a20 0x7f4da40c9cc0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:17.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.956+0000 7f4daa861700 1 --2- 172.21.15.114:0/4123617223 >> v2:172.21.15.172:3300/0 conn(0x7f4da40b3d40 0x7f4da40cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:17.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.956+0000 7f4daa861700 1 -- 172.21.15.114:0/4123617223 >> 172.21.15.114:0/4123617223 conn(0x7f4da40ce5c0 msgr2=0x7f4da40ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:17.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.956+0000 7f4daa861700 1 -- 172.21.15.114:0/4123617223 shutdown_connections 2023-10-18T12:21:17.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.956+0000 7f4daa861700 1 -- 172.21.15.114:0/4123617223 wait complete. 2023-10-18T12:21:17.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.956+0000 7f4daa861700 1 Processor -- start 2023-10-18T12:21:17.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.956+0000 7f4daa861700 1 -- start start 2023-10-18T12:21:17.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.960+0000 7f4daa861700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4da406ce20 0x7f4da4151a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:17.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.960+0000 7f4daa861700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4da40b3d40 0x7f4da41f8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:17.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.960+0000 7f4daa861700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4da4164a20 0x7f4da415b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:17.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.960+0000 7f4daa861700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da4161930 con 0x7f4da406ce20 2023-10-18T12:21:17.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.960+0000 7f4daa861700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da4161b80 con 0x7f4da4164a20 2023-10-18T12:21:17.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.960+0000 7f4daa861700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da4161e60 con 0x7f4da40b3d40 2023-10-18T12:21:17.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.960+0000 7f4da985f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4da406ce20 0x7f4da4151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:17.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.960+0000 7f4da985f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4da406ce20 0x7f4da4151a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39276/0 (socket says 172.21.15.114:39276) 2023-10-18T12:21:17.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.960+0000 7f4da985f700 1 -- 172.21.15.114:0/673408545 learned_addr learned my addr 172.21.15.114:0/673408545 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:17.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.960+0000 7f4daa060700 1 --2- 172.21.15.114:0/673408545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4da4164a20 0x7f4da415b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:17.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.960+0000 7f4da905e700 1 --2- 172.21.15.114:0/673408545 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4da40b3d40 0x7f4da41f8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:17.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.960+0000 7f4da985f700 1 -- 172.21.15.114:0/673408545 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4da40b3d40 msgr2=0x7f4da41f8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:17.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.960+0000 7f4da985f700 1 --2- 172.21.15.114:0/673408545 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4da40b3d40 0x7f4da41f8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:17.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.960+0000 7f4da985f700 1 -- 172.21.15.114:0/673408545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4da4164a20 msgr2=0x7f4da415b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:17.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.960+0000 7f4da985f700 1 --2- 172.21.15.114:0/673408545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4da4164a20 0x7f4da415b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:17.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.960+0000 7f4da985f700 1 -- 172.21.15.114:0/673408545 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d94009570 con 0x7f4da406ce20 2023-10-18T12:21:17.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.960+0000 7f4daa060700 1 --2- 172.21.15.114:0/673408545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4da4164a20 0x7f4da415b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:21:17.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.960+0000 7f4da985f700 1 --2- 172.21.15.114:0/673408545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4da406ce20 0x7f4da4151a30 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f4da000e760 tx=0x7f4da000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:17.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.960+0000 7f4d9a7fc700 1 -- 172.21.15.114:0/673408545 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da0004230 con 0x7f4da406ce20 2023-10-18T12:21:17.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.960+0000 7f4d9a7fc700 1 -- 172.21.15.114:0/673408545 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da00043b0 con 0x7f4da406ce20 2023-10-18T12:21:17.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.960+0000 7f4daa861700 1 -- 172.21.15.114:0/673408545 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4da4162140 con 0x7f4da406ce20 2023-10-18T12:21:17.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.960+0000 7f4d9a7fc700 1 -- 172.21.15.114:0/673408545 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da00036c0 con 0x7f4da406ce20 2023-10-18T12:21:17.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.960+0000 7f4daa861700 1 -- 172.21.15.114:0/673408545 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4da41f86a0 con 0x7f4da406ce20 2023-10-18T12:21:17.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.964+0000 7f4daa861700 1 -- 172.21.15.114:0/673408545 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4da4072e60 con 0x7f4da406ce20 2023-10-18T12:21:17.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.964+0000 7f4d9a7fc700 1 -- 172.21.15.114:0/673408545 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f4da0003820 con 0x7f4da406ce20 2023-10-18T12:21:17.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.964+0000 7f4d9a7fc700 1 --2- 172.21.15.114:0/673408545 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4d880656f0 0x7f4d88067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:17.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.964+0000 7f4d9a7fc700 1 -- 172.21.15.114:0/673408545 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4da0082980 con 0x7f4da406ce20 2023-10-18T12:21:17.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.968+0000 7f4da905e700 1 --2- 172.21.15.114:0/673408545 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4d880656f0 0x7f4d88067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:17.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.968+0000 7f4da905e700 1 --2- 172.21.15.114:0/673408545 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4d880656f0 0x7f4d88067bb0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4d94000c00 tx=0x7f4d94008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:17.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:17.972+0000 7f4d9a7fc700 1 -- 172.21.15.114:0/673408545 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f4da0050390 con 0x7f4da406ce20 2023-10-18T12:21:18.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.200+0000 7f4daa861700 1 -- 172.21.15.114:0/673408545 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4da40cdce0 con 0x7f4da406ce20 2023-10-18T12:21:18.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.200+0000 7f4d9a7fc700 1 -- 172.21.15.114:0/673408545 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4887 (secure 0 0 0) 0x7f4da0020090 con 0x7f4da406ce20 2023-10-18T12:21:18.206 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:21:18.207 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2034957068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2034957068},{"type":"v1","addr":"172.21.15.172:6836","nonce":2034957068}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5039,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4215710360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4215710360},{"type":"v1","addr":"172.21.15.172:6837","nonce":4215710360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2387835210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2387835210},{"type":"v1","addr":"172.21.15.114:6833","nonce":2387835210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T12:21:14.159069+0000","modified":"2023-10-18T12:21:17.730177+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.114:6835/1284474820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1284474820},{"type":"v1","addr":"172.21.15.114:6835","nonce":1284474820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-18T12:21:18.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.204+0000 7f4daa861700 1 -- 172.21.15.114:0/673408545 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4d880656f0 msgr2=0x7f4d88067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:18.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.204+0000 7f4daa861700 1 --2- 172.21.15.114:0/673408545 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4d880656f0 0x7f4d88067bb0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4d94000c00 tx=0x7f4d94008030 comp rx=0 tx=0).stop 2023-10-18T12:21:18.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.204+0000 7f4daa861700 1 -- 172.21.15.114:0/673408545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4da406ce20 msgr2=0x7f4da4151a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:18.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.204+0000 7f4daa861700 1 --2- 172.21.15.114:0/673408545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4da406ce20 0x7f4da4151a30 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f4da000e760 tx=0x7f4da000eb20 comp rx=0 tx=0).stop 2023-10-18T12:21:18.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.204+0000 7f4daa861700 1 -- 172.21.15.114:0/673408545 shutdown_connections 2023-10-18T12:21:18.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.204+0000 7f4daa861700 1 --2- 172.21.15.114:0/673408545 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4d880656f0 0x7f4d88067bb0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:18.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.204+0000 7f4daa861700 1 --2- 172.21.15.114:0/673408545 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4da40b3d40 0x7f4da41f8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:18.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.204+0000 7f4daa861700 1 --2- 172.21.15.114:0/673408545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4da4164a20 0x7f4da415b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:18.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.204+0000 7f4daa861700 1 --2- 172.21.15.114:0/673408545 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4da406ce20 0x7f4da4151a30 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:18.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.204+0000 7f4daa861700 1 -- 172.21.15.114:0/673408545 >> 172.21.15.114:0/673408545 conn(0x7f4da40ce5c0 msgr2=0x7f4da4164ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:18.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.204+0000 7f4daa861700 1 -- 172.21.15.114:0/673408545 shutdown_connections 2023-10-18T12:21:18.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.204+0000 7f4daa861700 1 -- 172.21.15.114:0/673408545 wait complete. 2023-10-18T12:21:18.212 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 18 2023-10-18T12:21:18.233 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T12:21:18.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.404+0000 7fdd0f1bb700 1 Processor -- start 2023-10-18T12:21:18.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.404+0000 7fdd0f1bb700 1 -- start start 2023-10-18T12:21:18.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.408+0000 7fdd0f1bb700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdd080cdd90 0x7fdd080cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:18.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.408+0000 7fdd0f1bb700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdd0806d060 0x7fdd0806d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:18.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.408+0000 7fdd0f1bb700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fdd080b3c00 0x7fdd080b4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:18.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.408+0000 7fdd0f1bb700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd080b45d0 con 0x7fdd080cdd90 2023-10-18T12:21:18.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.408+0000 7fdd0f1bb700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd0815e000 con 0x7fdd080b3c00 2023-10-18T12:21:18.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.408+0000 7fdd0f1bb700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd080ce170 con 0x7fdd0806d060 2023-10-18T12:21:18.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.408+0000 7fdd0e1b9700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdd080cdd90 0x7fdd080cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:18.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.408+0000 7fdd0e1b9700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdd080cdd90 0x7fdd080cc190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39284/0 (socket says 172.21.15.114:39284) 2023-10-18T12:21:18.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.408+0000 7fdd0e1b9700 1 -- 172.21.15.114:0/1753933735 learned_addr learned my addr 172.21.15.114:0/1753933735 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:18.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.408+0000 7fdd0d9b8700 1 --2- 172.21.15.114:0/1753933735 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdd0806d060 0x7fdd0806d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:18.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.408+0000 7fdd0e9ba700 1 --2- 172.21.15.114:0/1753933735 >> v2:172.21.15.172:3300/0 conn(0x7fdd080b3c00 0x7fdd080b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:18.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.408+0000 7fdd0e1b9700 1 -- 172.21.15.114:0/1753933735 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdd0806d060 msgr2=0x7fdd0806d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:18.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.408+0000 7fdd0e1b9700 1 --2- 172.21.15.114:0/1753933735 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdd0806d060 0x7fdd0806d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:18.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.408+0000 7fdd0e1b9700 1 -- 172.21.15.114:0/1753933735 >> v2:172.21.15.172:3300/0 conn(0x7fdd080b3c00 msgr2=0x7fdd080b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:18.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.408+0000 7fdd0e1b9700 1 --2- 172.21.15.114:0/1753933735 >> v2:172.21.15.172:3300/0 conn(0x7fdd080b3c00 0x7fdd080b4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:18.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.408+0000 7fdd0e1b9700 1 -- 172.21.15.114:0/1753933735 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd0815d3f0 con 0x7fdd080cdd90 2023-10-18T12:21:18.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.408+0000 7fdd0e9ba700 1 --2- 172.21.15.114:0/1753933735 >> v2:172.21.15.172:3300/0 conn(0x7fdd080b3c00 0x7fdd080b4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:21:18.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.408+0000 7fdd0e1b9700 1 --2- 172.21.15.114:0/1753933735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd080cdd90 0x7fdd080cc190 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fdd08066e40 tx=0x7fdd04009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e44ff286e85d8af server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:18.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.408+0000 7fdd0d1b7700 1 -- 172.21.15.114:0/1753933735 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0400b8a0 con 0x7fdd080cdd90 2023-10-18T12:21:18.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.408+0000 7fdd0d1b7700 1 -- 172.21.15.114:0/1753933735 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd0400ba00 con 0x7fdd080cdd90 2023-10-18T12:21:18.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.408+0000 7fdd0d1b7700 1 -- 172.21.15.114:0/1753933735 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0400bd90 con 0x7fdd080cdd90 2023-10-18T12:21:18.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.408+0000 7fdd0f1bb700 1 -- 172.21.15.114:0/1753933735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd080cdd90 msgr2=0x7fdd080cc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:18.418 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.408+0000 7fdd0f1bb700 1 --2- 172.21.15.114:0/1753933735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd080cdd90 0x7fdd080cc190 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fdd08066e40 tx=0x7fdd04009bf0 comp rx=0 tx=0).stop 2023-10-18T12:21:18.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.408+0000 7fdd0f1bb700 1 -- 172.21.15.114:0/1753933735 shutdown_connections 2023-10-18T12:21:18.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.408+0000 7fdd0f1bb700 1 --2- 172.21.15.114:0/1753933735 >> v2:172.21.15.172:3300/0 conn(0x7fdd080b3c00 0x7fdd080b4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:18.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.408+0000 7fdd0f1bb700 1 --2- 172.21.15.114:0/1753933735 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdd0806d060 0x7fdd0806d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:18.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.408+0000 7fdd0f1bb700 1 --2- 172.21.15.114:0/1753933735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd080cdd90 0x7fdd080cc190 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:18.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.408+0000 7fdd0f1bb700 1 -- 172.21.15.114:0/1753933735 >> 172.21.15.114:0/1753933735 conn(0x7fdd080ce5c0 msgr2=0x7fdd080ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:18.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.412+0000 7fdd0f1bb700 1 -- 172.21.15.114:0/1753933735 shutdown_connections 2023-10-18T12:21:18.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.412+0000 7fdd0f1bb700 1 -- 172.21.15.114:0/1753933735 wait complete. 2023-10-18T12:21:18.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.412+0000 7fdd0f1bb700 1 Processor -- start 2023-10-18T12:21:18.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.412+0000 7fdd0f1bb700 1 -- start start 2023-10-18T12:21:18.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.416+0000 7fdd0f1bb700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd0806d060 0x7fdd0814dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:18.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.416+0000 7fdd0f1bb700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdd080b3c00 0x7fdd080ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:18.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.416+0000 7fdd0f1bb700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd080cdd90 0x7fdd080ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:18.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.416+0000 7fdd0f1bb700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd080ab9f0 con 0x7fdd0806d060 2023-10-18T12:21:18.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.416+0000 7fdd0f1bb700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0814e4f0 con 0x7fdd080cdd90 2023-10-18T12:21:18.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.416+0000 7fdd0f1bb700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd080c6710 con 0x7fdd080b3c00 2023-10-18T12:21:18.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.416+0000 7fdd0e1b9700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd0806d060 0x7fdd0814dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:18.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.416+0000 7fdd0e1b9700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd0806d060 0x7fdd0814dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39300/0 (socket says 172.21.15.114:39300) 2023-10-18T12:21:18.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.416+0000 7fdd0e1b9700 1 -- 172.21.15.114:0/144290419 learned_addr learned my addr 172.21.15.114:0/144290419 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:18.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.416+0000 7fdd0e9ba700 1 --2- 172.21.15.114:0/144290419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd080cdd90 0x7fdd080ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:18.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.416+0000 7fdd0d9b8700 1 --2- 172.21.15.114:0/144290419 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdd080b3c00 0x7fdd080ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:18.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.416+0000 7fdd0e1b9700 1 -- 172.21.15.114:0/144290419 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdd080b3c00 msgr2=0x7fdd080ca0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:18.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.416+0000 7fdd0e1b9700 1 --2- 172.21.15.114:0/144290419 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdd080b3c00 0x7fdd080ca0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:18.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.416+0000 7fdd0e1b9700 1 -- 172.21.15.114:0/144290419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd080cdd90 msgr2=0x7fdd080ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:18.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.416+0000 7fdd0e1b9700 1 --2- 172.21.15.114:0/144290419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd080cdd90 0x7fdd080ca5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:18.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.416+0000 7fdd0e1b9700 1 -- 172.21.15.114:0/144290419 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd04009570 con 0x7fdd0806d060 2023-10-18T12:21:18.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.416+0000 7fdd0e9ba700 1 --2- 172.21.15.114:0/144290419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd080cdd90 0x7fdd080ca5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:21:18.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.416+0000 7fdd0e1b9700 1 --2- 172.21.15.114:0/144290419 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd0806d060 0x7fdd0814dfb0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fdd04000c00 tx=0x7fdd04004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:18.425 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.416+0000 7fdcfeffd700 1 -- 172.21.15.114:0/144290419 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd040038c0 con 0x7fdd0806d060 2023-10-18T12:21:18.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.416+0000 7fdcfeffd700 1 -- 172.21.15.114:0/144290419 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd0401e070 con 0x7fdd0806d060 2023-10-18T12:21:18.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.416+0000 7fdd0f1bb700 1 -- 172.21.15.114:0/144290419 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd080c69f0 con 0x7fdd0806d060 2023-10-18T12:21:18.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.416+0000 7fdcfeffd700 1 -- 172.21.15.114:0/144290419 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd04003c80 con 0x7fdd0806d060 2023-10-18T12:21:18.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.416+0000 7fdd0f1bb700 1 -- 172.21.15.114:0/144290419 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd080c6fb0 con 0x7fdd0806d060 2023-10-18T12:21:18.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.420+0000 7fdd0f1bb700 1 -- 172.21.15.114:0/144290419 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd08072e60 con 0x7fdd0806d060 2023-10-18T12:21:18.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.420+0000 7fdcfeffd700 1 -- 172.21.15.114:0/144290419 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fdd04011420 con 0x7fdd0806d060 2023-10-18T12:21:18.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.420+0000 7fdcfeffd700 1 --2- 172.21.15.114:0/144290419 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdcec0656f0 0x7fdcec067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:18.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.420+0000 7fdcfeffd700 1 -- 172.21.15.114:0/144290419 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fdd04020070 con 0x7fdd0806d060 2023-10-18T12:21:18.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.420+0000 7fdd0d9b8700 1 --2- 172.21.15.114:0/144290419 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdcec0656f0 0x7fdcec067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:18.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.424+0000 7fdd0d9b8700 1 --2- 172.21.15.114:0/144290419 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdcec0656f0 0x7fdcec067bb0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdd0815b440 tx=0x7fdcf8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:18.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.424+0000 7fdcfeffd700 1 -- 172.21.15.114:0/144290419 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fdd040520e0 con 0x7fdd0806d060 2023-10-18T12:21:18.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.600+0000 7fdd0f1bb700 1 -- 172.21.15.114:0/144290419 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd081f2310 con 0x7fdd0806d060 2023-10-18T12:21:18.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.604+0000 7fdcfeffd700 1 -- 172.21.15.114:0/144290419 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18524 (secure 0 0 0) 0x7fdd04055700 con 0x7fdd0806d060 2023-10-18T12:21:18.610 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:21:18.610 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":42,"fsid":"240ea340-5d3d-4f52-a4bc-af075aca3deb","created":"2023-10-18T12:19:12.512994+0000","modified":"2023-10-18T12:21:15.700112+0000","last_up_change":"2023-10-18T12:19:25.286009+0000","last_in_change":"2023-10-18T12:19:15.850693+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T12:19:27.040638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-18T12:19:32.358094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-18T12:21:12.105324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-18T12:21:13.154105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c3578978-1a03-4857-b9d2-34a5da3d7731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6817","nonce":1506287862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6820","nonce":1506287862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6830","nonce":1506287862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":1506287862},{"type":"v1","addr":"172.21.15.114:6825","nonce":1506287862}]},"public_addr":"172.21.15.114:6817/1506287862","cluster_addr":"172.21.15.114:6820/1506287862","heartbeat_back_addr":"172.21.15.114:6830/1506287862","heartbeat_front_addr":"172.21.15.114:6825/1506287862","state":["exists","up"]},{"osd":1,"uuid":"43eb26a6-e2b3-4670-9559-bd053b5140d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6801","nonce":3302727047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6803","nonce":3302727047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6807","nonce":3302727047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6805","nonce":3302727047}]},"public_addr":"172.21.15.114:6801/3302727047","cluster_addr":"172.21.15.114:6803/3302727047","heartbeat_back_addr":"172.21.15.114:6807/3302727047","heartbeat_front_addr":"172.21.15.114:6805/3302727047","state":["exists","up"]},{"osd":2,"uuid":"f3d4dbd5-521c-4dd2-b687-5768cc7d0938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6809","nonce":2699151351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6811","nonce":2699151351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6815","nonce":2699151351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6813","nonce":2699151351}]},"public_addr":"172.21.15.114:6809/2699151351","cluster_addr":"172.21.15.114:6811/2699151351","heartbeat_back_addr":"172.21.15.114:6815/2699151351","heartbeat_front_addr":"172.21.15.114:6813/2699151351","state":["exists","up"]},{"osd":3,"uuid":"823e5802-92b7-4f0d-b32d-a5748993f1b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6821","nonce":1361608073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6824","nonce":1361608073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6829","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6831","nonce":1361608073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6827","nonce":1361608073}]},"public_addr":"172.21.15.114:6821/1361608073","cluster_addr":"172.21.15.114:6824/1361608073","heartbeat_back_addr":"172.21.15.114:6831/1361608073","heartbeat_front_addr":"172.21.15.114:6827/1361608073","state":["exists","up"]},{"osd":4,"uuid":"e47fb93e-13b4-44a4-b084-8c4384ceb41e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6801","nonce":930839681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6803","nonce":930839681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6807","nonce":930839681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6805","nonce":930839681}]},"public_addr":"172.21.15.172:6801/930839681","cluster_addr":"172.21.15.172:6803/930839681","heartbeat_back_addr":"172.21.15.172:6807/930839681","heartbeat_front_addr":"172.21.15.172:6805/930839681","state":["exists","up"]},{"osd":5,"uuid":"7561a973-f479-45a0-af40-f324728d622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6814","nonce":571761850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6818","nonce":571761850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6824","nonce":571761850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6821","nonce":571761850}]},"public_addr":"172.21.15.172:6814/571761850","cluster_addr":"172.21.15.172:6818/571761850","heartbeat_back_addr":"172.21.15.172:6824/571761850","heartbeat_front_addr":"172.21.15.172:6821/571761850","state":["exists","up"]},{"osd":6,"uuid":"51753f4b-7f06-4f1c-9ec7-6e18a66eb980","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6825","nonce":1680398853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6827","nonce":1680398853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6831","nonce":1680398853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6829","nonce":1680398853}]},"public_addr":"172.21.15.172:6825/1680398853","cluster_addr":"172.21.15.172:6827/1680398853","heartbeat_back_addr":"172.21.15.172:6831/1680398853","heartbeat_front_addr":"172.21.15.172:6829/1680398853","state":["exists","up"]},{"osd":7,"uuid":"4d8b1e15-143d-4d17-9074-59d92f0f9af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6809","nonce":349710101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6811","nonce":349710101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6819","nonce":349710101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6815","nonce":349710101}]},"public_addr":"172.21.15.172:6809/349710101","cluster_addr":"172.21.15.172:6811/349710101","heartbeat_back_addr":"172.21.15.172:6819/349710101","heartbeat_front_addr":"172.21.15.172:6815/349710101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.889460+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.475494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.911473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.648596+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.609994+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.636248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.854589+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.885826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T12:21:18.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.608+0000 7fdd0f1bb700 1 -- 172.21.15.114:0/144290419 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdcec0656f0 msgr2=0x7fdcec067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:18.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.608+0000 7fdd0f1bb700 1 --2- 172.21.15.114:0/144290419 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdcec0656f0 0x7fdcec067bb0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdd0815b440 tx=0x7fdcf8008040 comp rx=0 tx=0).stop 2023-10-18T12:21:18.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.608+0000 7fdd0f1bb700 1 -- 172.21.15.114:0/144290419 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd0806d060 msgr2=0x7fdd0814dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:18.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.608+0000 7fdd0f1bb700 1 --2- 172.21.15.114:0/144290419 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd0806d060 0x7fdd0814dfb0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fdd04000c00 tx=0x7fdd04004770 comp rx=0 tx=0).stop 2023-10-18T12:21:18.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.608+0000 7fdd0f1bb700 1 -- 172.21.15.114:0/144290419 shutdown_connections 2023-10-18T12:21:18.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.608+0000 7fdd0f1bb700 1 --2- 172.21.15.114:0/144290419 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdcec0656f0 0x7fdcec067bb0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:18.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.608+0000 7fdd0f1bb700 1 --2- 172.21.15.114:0/144290419 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdd080b3c00 0x7fdd080ca0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:18.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.608+0000 7fdd0f1bb700 1 --2- 172.21.15.114:0/144290419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdd080cdd90 0x7fdd080ca5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:18.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.608+0000 7fdd0f1bb700 1 --2- 172.21.15.114:0/144290419 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdd0806d060 0x7fdd0814dfb0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:18.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.608+0000 7fdd0f1bb700 1 -- 172.21.15.114:0/144290419 >> 172.21.15.114:0/144290419 conn(0x7fdd080ce5c0 msgr2=0x7fdd080cb580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:18.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.608+0000 7fdd0f1bb700 1 -- 172.21.15.114:0/144290419 shutdown_connections 2023-10-18T12:21:18.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.608+0000 7fdd0f1bb700 1 -- 172.21.15.114:0/144290419 wait complete. 2023-10-18T12:21:18.634 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-18T12:21:18.635 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-18T12:21:18.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.804+0000 7f2ee8156700 1 Processor -- start 2023-10-18T12:21:18.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.808+0000 7f2ee8156700 1 -- start start 2023-10-18T12:21:18.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.808+0000 7f2ee8156700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2ee015ee50 0x7f2ee00cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:18.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.808+0000 7f2ee8156700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f2ee00cb640 0x7f2ee006f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:18.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.808+0000 7f2ee8156700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ee006f450 con 0x7f2ee006e8a0 2023-10-18T12:21:18.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.808+0000 7f2ee8156700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ee006d4e0 con 0x7f2ee015ee50 2023-10-18T12:21:18.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.808+0000 7f2ee8156700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ee0162780 con 0x7f2ee00cb640 2023-10-18T12:21:18.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.808+0000 7f2ee5ef2700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2ee015ee50 0x7f2ee00cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:18.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.808+0000 7f2ee5ef2700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2ee015ee50 0x7f2ee00cc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39308/0 (socket says 172.21.15.114:39308) 2023-10-18T12:21:18.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.808+0000 7f2ee5ef2700 1 -- 172.21.15.114:0/2614698189 learned_addr learned my addr 172.21.15.114:0/2614698189 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:18.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.808+0000 7f2ee66f3700 1 --2- 172.21.15.114:0/2614698189 >> v2:172.21.15.172:3300/0 conn(0x7f2ee00cb640 0x7f2ee006f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:18.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.808+0000 7f2ee5ef2700 1 -- 172.21.15.114:0/2614698189 >> v2:172.21.15.172:3300/0 conn(0x7f2ee00cb640 msgr2=0x7f2ee006f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:18.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.808+0000 7f2ee5ef2700 1 --2- 172.21.15.114:0/2614698189 >> v2:172.21.15.172:3300/0 conn(0x7f2ee00cb640 0x7f2ee006f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:18.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.808+0000 7f2ee5ef2700 1 -- 172.21.15.114:0/2614698189 >> v1:172.21.15.172:6789/0 conn(0x7f2ee006e8a0 legacy=0x7f2ee00caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:18.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.812+0000 7f2ee5ef2700 1 -- 172.21.15.114:0/2614698189 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee00ccbc0 con 0x7f2ee015ee50 2023-10-18T12:21:18.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.812+0000 7f2ee5ef2700 1 --2- 172.21.15.114:0/2614698189 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ee015ee50 0x7f2ee00cc680 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0164c90 tx=0x7f2edc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39624135ddc6bd2 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:18.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.812+0000 7f2ee4ef0700 1 -- 172.21.15.114:0/2614698189 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2edc011830 con 0x7f2ee015ee50 2023-10-18T12:21:18.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.812+0000 7f2ee4ef0700 1 -- 172.21.15.114:0/2614698189 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2edc011990 con 0x7f2ee015ee50 2023-10-18T12:21:18.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.812+0000 7f2ee4ef0700 1 -- 172.21.15.114:0/2614698189 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2edc011d40 con 0x7f2ee015ee50 2023-10-18T12:21:18.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.812+0000 7f2ee8156700 1 -- 172.21.15.114:0/2614698189 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ee015ee50 msgr2=0x7f2ee00cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:18.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.812+0000 7f2ee8156700 1 --2- 172.21.15.114:0/2614698189 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ee015ee50 0x7f2ee00cc680 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2ee0164c90 tx=0x7f2edc009c20 comp rx=0 tx=0).stop 2023-10-18T12:21:18.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.812+0000 7f2ee8156700 1 -- 172.21.15.114:0/2614698189 shutdown_connections 2023-10-18T12:21:18.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.812+0000 7f2ee8156700 1 --2- 172.21.15.114:0/2614698189 >> v2:172.21.15.172:3300/0 conn(0x7f2ee00cb640 0x7f2ee006f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:18.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.812+0000 7f2ee8156700 1 --2- 172.21.15.114:0/2614698189 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ee015ee50 0x7f2ee00cc680 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:18.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.812+0000 7f2ee8156700 1 -- 172.21.15.114:0/2614698189 >> 172.21.15.114:0/2614698189 conn(0x7f2ee006a340 msgr2=0x7f2ee00b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:18.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.812+0000 7f2ee8156700 1 -- 172.21.15.114:0/2614698189 shutdown_connections 2023-10-18T12:21:18.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.812+0000 7f2ee8156700 1 -- 172.21.15.114:0/2614698189 wait complete. 2023-10-18T12:21:18.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.816+0000 7f2ee8156700 1 Processor -- start 2023-10-18T12:21:18.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.816+0000 7f2ee8156700 1 -- start start 2023-10-18T12:21:18.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.816+0000 7f2ee8156700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ee006e8a0 0x7f2ee01f6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:18.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.816+0000 7f2ee8156700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ee00cb640 0x7f2ee0159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:18.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.816+0000 7f2ee8156700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ee015ee50 0x7f2ee015a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:18.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.816+0000 7f2ee8156700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee015e070 con 0x7f2ee015ee50 2023-10-18T12:21:18.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.816+0000 7f2ee8156700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee015d3f0 con 0x7f2ee006e8a0 2023-10-18T12:21:18.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.816+0000 7f2ee8156700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee015d6d0 con 0x7f2ee00cb640 2023-10-18T12:21:18.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.816+0000 7f2ee66f3700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ee015ee50 0x7f2ee015a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:18.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.816+0000 7f2ee66f3700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ee015ee50 0x7f2ee015a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39312/0 (socket says 172.21.15.114:39312) 2023-10-18T12:21:18.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.816+0000 7f2ee66f3700 1 -- 172.21.15.114:0/543050582 learned_addr learned my addr 172.21.15.114:0/543050582 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:18.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.816+0000 7f2ee5ef2700 1 --2- 172.21.15.114:0/543050582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ee006e8a0 0x7f2ee01f6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:18.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.816+0000 7f2ee56f1700 1 --2- 172.21.15.114:0/543050582 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ee00cb640 0x7f2ee0159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:18.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.816+0000 7f2ee66f3700 1 -- 172.21.15.114:0/543050582 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ee00cb640 msgr2=0x7f2ee0159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:18.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.816+0000 7f2ee66f3700 1 --2- 172.21.15.114:0/543050582 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ee00cb640 0x7f2ee0159ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:18.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.816+0000 7f2ee66f3700 1 -- 172.21.15.114:0/543050582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ee006e8a0 msgr2=0x7f2ee01f6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:18.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.816+0000 7f2ee66f3700 1 --2- 172.21.15.114:0/543050582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ee006e8a0 0x7f2ee01f6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:18.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.816+0000 7f2ee66f3700 1 -- 172.21.15.114:0/543050582 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2edc009570 con 0x7f2ee015ee50 2023-10-18T12:21:18.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.816+0000 7f2ee66f3700 1 --2- 172.21.15.114:0/543050582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ee015ee50 0x7f2ee015a220 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2ed800efc0 tx=0x7f2ed800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:18.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.820+0000 7f2ed67fc700 1 -- 172.21.15.114:0/543050582 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed8009ea0 con 0x7f2ee015ee50 2023-10-18T12:21:18.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.820+0000 7f2ed67fc700 1 -- 172.21.15.114:0/543050582 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed800f040 con 0x7f2ee015ee50 2023-10-18T12:21:18.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.820+0000 7f2ee8156700 1 -- 172.21.15.114:0/543050582 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ee015d9b0 con 0x7f2ee015ee50 2023-10-18T12:21:18.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.820+0000 7f2ed67fc700 1 -- 172.21.15.114:0/543050582 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed800ced0 con 0x7f2ee015ee50 2023-10-18T12:21:18.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.820+0000 7f2ee8156700 1 -- 172.21.15.114:0/543050582 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ee01f6570 con 0x7f2ee015ee50 2023-10-18T12:21:18.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.820+0000 7f2ee8156700 1 -- 172.21.15.114:0/543050582 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ee015b310 con 0x7f2ee015ee50 2023-10-18T12:21:18.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.824+0000 7f2ed67fc700 1 -- 172.21.15.114:0/543050582 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f2ed8014480 con 0x7f2ee015ee50 2023-10-18T12:21:18.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.824+0000 7f2ed67fc700 1 --2- 172.21.15.114:0/543050582 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2ec40656f0 0x7f2ec4067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:18.830 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.824+0000 7f2ed67fc700 1 -- 172.21.15.114:0/543050582 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2ed8083950 con 0x7f2ee015ee50 2023-10-18T12:21:18.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.824+0000 7f2ee5ef2700 1 --2- 172.21.15.114:0/543050582 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2ec40656f0 0x7f2ec4067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:18.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.824+0000 7f2ee5ef2700 1 --2- 172.21.15.114:0/543050582 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2ec40656f0 0x7f2ec4067bb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2edc014040 tx=0x7f2edc008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:18.835 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:18.828+0000 7f2ed67fc700 1 -- 172.21.15.114:0/543050582 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f2ee015b310 con 0x7f2ee015ee50 2023-10-18T12:21:19.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.004+0000 7f2ee8156700 1 -- 172.21.15.114:0/543050582 --> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2ee015d840 con 0x7f2ec40656f0 2023-10-18T12:21:19.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.024+0000 7f2ed67fc700 1 -- 172.21.15.114:0/543050582 <== mgr.4108 v2:172.21.15.172:6832/461408666 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308694 (secure 0 0 0) 0x7f2ee015d840 con 0x7f2ec40656f0 2023-10-18T12:21:19.034 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:21:19.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.028+0000 7f2ee8156700 1 -- 172.21.15.114:0/543050582 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2ec40656f0 msgr2=0x7f2ec4067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:19.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.028+0000 7f2ee8156700 1 --2- 172.21.15.114:0/543050582 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2ec40656f0 0x7f2ec4067bb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2edc014040 tx=0x7f2edc008030 comp rx=0 tx=0).stop 2023-10-18T12:21:19.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.028+0000 7f2ee8156700 1 -- 172.21.15.114:0/543050582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ee015ee50 msgr2=0x7f2ee015a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:19.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.028+0000 7f2ee8156700 1 --2- 172.21.15.114:0/543050582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ee015ee50 0x7f2ee015a220 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2ed800efc0 tx=0x7f2ed800c3a0 comp rx=0 tx=0).stop 2023-10-18T12:21:19.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.028+0000 7f2ee8156700 1 -- 172.21.15.114:0/543050582 shutdown_connections 2023-10-18T12:21:19.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.028+0000 7f2ee8156700 1 --2- 172.21.15.114:0/543050582 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2ec40656f0 0x7f2ec4067bb0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:19.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.028+0000 7f2ee8156700 1 --2- 172.21.15.114:0/543050582 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2ee00cb640 0x7f2ee0159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:19.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.028+0000 7f2ee8156700 1 --2- 172.21.15.114:0/543050582 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2ee015ee50 0x7f2ee015a220 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:19.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.028+0000 7f2ee8156700 1 --2- 172.21.15.114:0/543050582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ee006e8a0 0x7f2ee01f6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:19.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.028+0000 7f2ee8156700 1 -- 172.21.15.114:0/543050582 >> 172.21.15.114:0/543050582 conn(0x7f2ee006a340 msgr2=0x7f2ee00ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:19.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.032+0000 7f2ee8156700 1 -- 172.21.15.114:0/543050582 shutdown_connections 2023-10-18T12:21:19.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.032+0000 7f2ee8156700 1 -- 172.21.15.114:0/543050582 wait complete. 2023-10-18T12:21:19.039 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2023-10-18T12:21:19.057 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2023-10-18T12:21:18.990817+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":124,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221168,"kb_used_data":4984,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754753552,"statfs":{"total":773094113280,"available":772867637248,"internally_reserved":0,"allocated":5103616,"data_stored":2897336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001860"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.794179+0000","last_change":"2023-10-18T12:21:14.711625+0000","last_active":"2023-10-18T12:21:15.794179+0000","last_peered":"2023-10-18T12:21:15.794179+0000","last_clean":"2023-10-18T12:21:15.794179+0000","last_became_active":"2023-10-18T12:21:14.711325+0000","last_became_peered":"2023-10-18T12:21:14.711325+0000","last_unstale":"2023-10-18T12:21:15.794179+0000","last_undegraded":"2023-10-18T12:21:15.794179+0000","last_fullsized":"2023-10-18T12:21:15.794179+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:02:59.905455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.712997+0000","last_change":"2023-10-18T12:21:14.726072+0000","last_active":"2023-10-18T12:21:15.712997+0000","last_peered":"2023-10-18T12:21:15.712997+0000","last_clean":"2023-10-18T12:21:15.712997+0000","last_became_active":"2023-10-18T12:21:14.725813+0000","last_became_peered":"2023-10-18T12:21:14.725813+0000","last_unstale":"2023-10-18T12:21:15.712997+0000","last_undegraded":"2023-10-18T12:21:15.712997+0000","last_fullsized":"2023-10-18T12:21:15.712997+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:53:55.574132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.792769+0000","last_change":"2023-10-18T12:21:14.715764+0000","last_active":"2023-10-18T12:21:15.792769+0000","last_peered":"2023-10-18T12:21:15.792769+0000","last_clean":"2023-10-18T12:21:15.792769+0000","last_became_active":"2023-10-18T12:21:14.715495+0000","last_became_peered":"2023-10-18T12:21:14.715495+0000","last_unstale":"2023-10-18T12:21:15.792769+0000","last_undegraded":"2023-10-18T12:21:15.792769+0000","last_fullsized":"2023-10-18T12:21:15.792769+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:52:58.795948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.791690+0000","last_change":"2023-10-18T12:21:14.711792+0000","last_active":"2023-10-18T12:21:15.791690+0000","last_peered":"2023-10-18T12:21:15.791690+0000","last_clean":"2023-10-18T12:21:15.791690+0000","last_became_active":"2023-10-18T12:21:14.711514+0000","last_became_peered":"2023-10-18T12:21:14.711514+0000","last_unstale":"2023-10-18T12:21:15.791690+0000","last_undegraded":"2023-10-18T12:21:15.791690+0000","last_fullsized":"2023-10-18T12:21:15.791690+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:36:05.211321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.712321+0000","last_change":"2023-10-18T12:21:14.716899+0000","last_active":"2023-10-18T12:21:15.712321+0000","last_peered":"2023-10-18T12:21:15.712321+0000","last_clean":"2023-10-18T12:21:15.712321+0000","last_became_active":"2023-10-18T12:21:14.716639+0000","last_became_peered":"2023-10-18T12:21:14.716639+0000","last_unstale":"2023-10-18T12:21:15.712321+0000","last_undegraded":"2023-10-18T12:21:15.712321+0000","last_fullsized":"2023-10-18T12:21:15.712321+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:12:05.216829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.793841+0000","last_change":"2023-10-18T12:21:14.717011+0000","last_active":"2023-10-18T12:21:15.793841+0000","last_peered":"2023-10-18T12:21:15.793841+0000","last_clean":"2023-10-18T12:21:15.793841+0000","last_became_active":"2023-10-18T12:21:14.716778+0000","last_became_peered":"2023-10-18T12:21:14.716778+0000","last_unstale":"2023-10-18T12:21:15.793841+0000","last_undegraded":"2023-10-18T12:21:15.793841+0000","last_fullsized":"2023-10-18T12:21:15.793841+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:14:15.865730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.793522+0000","last_change":"2023-10-18T12:21:14.699582+0000","last_active":"2023-10-18T12:21:15.793522+0000","last_peered":"2023-10-18T12:21:15.793522+0000","last_clean":"2023-10-18T12:21:15.793522+0000","last_became_active":"2023-10-18T12:21:14.698065+0000","last_became_peered":"2023-10-18T12:21:14.698065+0000","last_unstale":"2023-10-18T12:21:15.793522+0000","last_undegraded":"2023-10-18T12:21:15.793522+0000","last_fullsized":"2023-10-18T12:21:15.793522+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:18:40.614445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.790585+0000","last_change":"2023-10-18T12:21:14.713127+0000","last_active":"2023-10-18T12:21:15.790585+0000","last_peered":"2023-10-18T12:21:15.790585+0000","last_clean":"2023-10-18T12:21:15.790585+0000","last_became_active":"2023-10-18T12:21:14.712858+0000","last_became_peered":"2023-10-18T12:21:14.712858+0000","last_unstale":"2023-10-18T12:21:15.790585+0000","last_undegraded":"2023-10-18T12:21:15.790585+0000","last_fullsized":"2023-10-18T12:21:15.790585+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:24:44.316310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.792710+0000","last_change":"2023-10-18T12:21:14.707068+0000","last_active":"2023-10-18T12:21:15.792710+0000","last_peered":"2023-10-18T12:21:15.792710+0000","last_clean":"2023-10-18T12:21:15.792710+0000","last_became_active":"2023-10-18T12:21:14.706807+0000","last_became_peered":"2023-10-18T12:21:14.706807+0000","last_unstale":"2023-10-18T12:21:15.792710+0000","last_undegraded":"2023-10-18T12:21:15.792710+0000","last_fullsized":"2023-10-18T12:21:15.792710+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:09:31.520396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.792831+0000","last_change":"2023-10-18T12:21:14.714899+0000","last_active":"2023-10-18T12:21:15.792831+0000","last_peered":"2023-10-18T12:21:15.792831+0000","last_clean":"2023-10-18T12:21:15.792831+0000","last_became_active":"2023-10-18T12:21:14.713092+0000","last_became_peered":"2023-10-18T12:21:14.713092+0000","last_unstale":"2023-10-18T12:21:15.792831+0000","last_undegraded":"2023-10-18T12:21:15.792831+0000","last_fullsized":"2023-10-18T12:21:15.792831+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:14:15.865730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.792558+0000","last_change":"2023-10-18T12:21:14.708224+0000","last_active":"2023-10-18T12:21:15.792558+0000","last_peered":"2023-10-18T12:21:15.792558+0000","last_clean":"2023-10-18T12:21:15.792558+0000","last_became_active":"2023-10-18T12:21:14.707942+0000","last_became_peered":"2023-10-18T12:21:14.707942+0000","last_unstale":"2023-10-18T12:21:15.792558+0000","last_undegraded":"2023-10-18T12:21:15.792558+0000","last_fullsized":"2023-10-18T12:21:15.792558+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:32:21.526596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.712551+0000","last_change":"2023-10-18T12:21:14.707771+0000","last_active":"2023-10-18T12:21:15.712551+0000","last_peered":"2023-10-18T12:21:15.712551+0000","last_clean":"2023-10-18T12:21:15.712551+0000","last_became_active":"2023-10-18T12:21:14.707054+0000","last_became_peered":"2023-10-18T12:21:14.707054+0000","last_unstale":"2023-10-18T12:21:15.712551+0000","last_undegraded":"2023-10-18T12:21:15.712551+0000","last_fullsized":"2023-10-18T12:21:15.712551+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:59:24.614145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.708175+0000","last_change":"2023-10-18T12:21:14.717459+0000","last_active":"2023-10-18T12:21:15.708175+0000","last_peered":"2023-10-18T12:21:15.708175+0000","last_clean":"2023-10-18T12:21:15.708175+0000","last_became_active":"2023-10-18T12:21:14.717186+0000","last_became_peered":"2023-10-18T12:21:14.717186+0000","last_unstale":"2023-10-18T12:21:15.708175+0000","last_undegraded":"2023-10-18T12:21:15.708175+0000","last_fullsized":"2023-10-18T12:21:15.708175+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:10:15.213138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.790824+0000","last_change":"2023-10-18T12:21:14.712005+0000","last_active":"2023-10-18T12:21:15.790824+0000","last_peered":"2023-10-18T12:21:15.790824+0000","last_clean":"2023-10-18T12:21:15.790824+0000","last_became_active":"2023-10-18T12:21:14.707594+0000","last_became_peered":"2023-10-18T12:21:14.707594+0000","last_unstale":"2023-10-18T12:21:15.790824+0000","last_undegraded":"2023-10-18T12:21:15.790824+0000","last_fullsized":"2023-10-18T12:21:15.790824+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:41:08.305349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.793173+0000","last_change":"2023-10-18T12:21:14.714008+0000","last_active":"2023-10-18T12:21:15.793173+0000","last_peered":"2023-10-18T12:21:15.793173+0000","last_clean":"2023-10-18T12:21:15.793173+0000","last_became_active":"2023-10-18T12:21:14.713688+0000","last_became_peered":"2023-10-18T12:21:14.713688+0000","last_unstale":"2023-10-18T12:21:15.793173+0000","last_undegraded":"2023-10-18T12:21:15.793173+0000","last_fullsized":"2023-10-18T12:21:15.793173+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:33:08.260645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.711985+0000","last_change":"2023-10-18T12:21:14.710294+0000","last_active":"2023-10-18T12:21:15.711985+0000","last_peered":"2023-10-18T12:21:15.711985+0000","last_clean":"2023-10-18T12:21:15.711985+0000","last_became_active":"2023-10-18T12:21:14.709998+0000","last_became_peered":"2023-10-18T12:21:14.709998+0000","last_unstale":"2023-10-18T12:21:15.711985+0000","last_undegraded":"2023-10-18T12:21:15.711985+0000","last_fullsized":"2023-10-18T12:21:15.711985+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:10:42.451120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.793505+0000","last_change":"2023-10-18T12:21:14.714166+0000","last_active":"2023-10-18T12:21:15.793505+0000","last_peered":"2023-10-18T12:21:15.793505+0000","last_clean":"2023-10-18T12:21:15.793505+0000","last_became_active":"2023-10-18T12:21:14.712787+0000","last_became_peered":"2023-10-18T12:21:14.712787+0000","last_unstale":"2023-10-18T12:21:15.793505+0000","last_undegraded":"2023-10-18T12:21:15.793505+0000","last_fullsized":"2023-10-18T12:21:15.793505+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:11:17.646077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.792018+0000","last_change":"2023-10-18T12:21:14.730802+0000","last_active":"2023-10-18T12:21:15.792018+0000","last_peered":"2023-10-18T12:21:15.792018+0000","last_clean":"2023-10-18T12:21:15.792018+0000","last_became_active":"2023-10-18T12:21:14.730477+0000","last_became_peered":"2023-10-18T12:21:14.730477+0000","last_unstale":"2023-10-18T12:21:15.792018+0000","last_undegraded":"2023-10-18T12:21:15.792018+0000","last_fullsized":"2023-10-18T12:21:15.792018+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:07:11.434836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.713956+0000","last_change":"2023-10-18T12:21:14.709244+0000","last_active":"2023-10-18T12:21:15.713956+0000","last_peered":"2023-10-18T12:21:15.713956+0000","last_clean":"2023-10-18T12:21:15.713956+0000","last_became_active":"2023-10-18T12:21:14.708968+0000","last_became_peered":"2023-10-18T12:21:14.708968+0000","last_unstale":"2023-10-18T12:21:15.713956+0000","last_undegraded":"2023-10-18T12:21:15.713956+0000","last_fullsized":"2023-10-18T12:21:15.713956+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:23:33.386168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.708403+0000","last_change":"2023-10-18T12:21:14.716990+0000","last_active":"2023-10-18T12:21:15.708403+0000","last_peered":"2023-10-18T12:21:15.708403+0000","last_clean":"2023-10-18T12:21:15.708403+0000","last_became_active":"2023-10-18T12:21:14.716745+0000","last_became_peered":"2023-10-18T12:21:14.716745+0000","last_unstale":"2023-10-18T12:21:15.708403+0000","last_undegraded":"2023-10-18T12:21:15.708403+0000","last_fullsized":"2023-10-18T12:21:15.708403+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:58:05.170854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.793476+0000","last_change":"2023-10-18T12:21:14.712987+0000","last_active":"2023-10-18T12:21:15.793476+0000","last_peered":"2023-10-18T12:21:15.793476+0000","last_clean":"2023-10-18T12:21:15.793476+0000","last_became_active":"2023-10-18T12:21:14.712710+0000","last_became_peered":"2023-10-18T12:21:14.712710+0000","last_unstale":"2023-10-18T12:21:15.793476+0000","last_undegraded":"2023-10-18T12:21:15.793476+0000","last_fullsized":"2023-10-18T12:21:15.793476+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:18:45.099541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.791384+0000","last_change":"2023-10-18T12:21:14.704679+0000","last_active":"2023-10-18T12:21:15.791384+0000","last_peered":"2023-10-18T12:21:15.791384+0000","last_clean":"2023-10-18T12:21:15.791384+0000","last_became_active":"2023-10-18T12:21:14.704444+0000","last_became_peered":"2023-10-18T12:21:14.704444+0000","last_unstale":"2023-10-18T12:21:15.791384+0000","last_undegraded":"2023-10-18T12:21:15.791384+0000","last_fullsized":"2023-10-18T12:21:15.791384+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:59:52.010102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.712439+0000","last_change":"2023-10-18T12:21:14.703034+0000","last_active":"2023-10-18T12:21:15.712439+0000","last_peered":"2023-10-18T12:21:15.712439+0000","last_clean":"2023-10-18T12:21:15.712439+0000","last_became_active":"2023-10-18T12:21:14.702704+0000","last_became_peered":"2023-10-18T12:21:14.702704+0000","last_unstale":"2023-10-18T12:21:15.712439+0000","last_undegraded":"2023-10-18T12:21:15.712439+0000","last_fullsized":"2023-10-18T12:21:15.712439+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:38:12.273279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.712175+0000","last_change":"2023-10-18T12:21:14.698897+0000","last_active":"2023-10-18T12:21:15.712175+0000","last_peered":"2023-10-18T12:21:15.712175+0000","last_clean":"2023-10-18T12:21:15.712175+0000","last_became_active":"2023-10-18T12:21:14.698553+0000","last_became_peered":"2023-10-18T12:21:14.698553+0000","last_unstale":"2023-10-18T12:21:15.712175+0000","last_undegraded":"2023-10-18T12:21:15.712175+0000","last_fullsized":"2023-10-18T12:21:15.712175+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:06:01.340883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.713398+0000","last_change":"2023-10-18T12:21:14.699554+0000","last_active":"2023-10-18T12:21:15.713398+0000","last_peered":"2023-10-18T12:21:15.713398+0000","last_clean":"2023-10-18T12:21:15.713398+0000","last_became_active":"2023-10-18T12:21:14.699215+0000","last_became_peered":"2023-10-18T12:21:14.699215+0000","last_unstale":"2023-10-18T12:21:15.713398+0000","last_undegraded":"2023-10-18T12:21:15.713398+0000","last_fullsized":"2023-10-18T12:21:15.713398+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:35:47.570739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.708573+0000","last_change":"2023-10-18T12:21:14.717903+0000","last_active":"2023-10-18T12:21:15.708573+0000","last_peered":"2023-10-18T12:21:15.708573+0000","last_clean":"2023-10-18T12:21:15.708573+0000","last_became_active":"2023-10-18T12:21:14.717633+0000","last_became_peered":"2023-10-18T12:21:14.717633+0000","last_unstale":"2023-10-18T12:21:15.708573+0000","last_undegraded":"2023-10-18T12:21:15.708573+0000","last_fullsized":"2023-10-18T12:21:15.708573+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:23:33.386168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.792699+0000","last_change":"2023-10-18T12:21:14.713795+0000","last_active":"2023-10-18T12:21:15.792699+0000","last_peered":"2023-10-18T12:21:15.792699+0000","last_clean":"2023-10-18T12:21:15.792699+0000","last_became_active":"2023-10-18T12:21:14.713029+0000","last_became_peered":"2023-10-18T12:21:14.713029+0000","last_unstale":"2023-10-18T12:21:15.792699+0000","last_undegraded":"2023-10-18T12:21:15.792699+0000","last_fullsized":"2023-10-18T12:21:15.792699+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:49:11.514362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.712710+0000","last_change":"2023-10-18T12:21:14.708007+0000","last_active":"2023-10-18T12:21:15.712710+0000","last_peered":"2023-10-18T12:21:15.712710+0000","last_clean":"2023-10-18T12:21:15.712710+0000","last_became_active":"2023-10-18T12:21:14.707508+0000","last_became_peered":"2023-10-18T12:21:14.707508+0000","last_unstale":"2023-10-18T12:21:15.712710+0000","last_undegraded":"2023-10-18T12:21:15.712710+0000","last_fullsized":"2023-10-18T12:21:15.712710+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:37:44.775289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.713232+0000","last_change":"2023-10-18T12:21:14.707532+0000","last_active":"2023-10-18T12:21:15.713232+0000","last_peered":"2023-10-18T12:21:15.713232+0000","last_clean":"2023-10-18T12:21:15.713232+0000","last_became_active":"2023-10-18T12:21:14.707206+0000","last_became_peered":"2023-10-18T12:21:14.707206+0000","last_unstale":"2023-10-18T12:21:15.713232+0000","last_undegraded":"2023-10-18T12:21:15.713232+0000","last_fullsized":"2023-10-18T12:21:15.713232+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:54:21.593930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.791831+0000","last_change":"2023-10-18T12:21:14.716831+0000","last_active":"2023-10-18T12:21:15.791831+0000","last_peered":"2023-10-18T12:21:15.791831+0000","last_clean":"2023-10-18T12:21:15.791831+0000","last_became_active":"2023-10-18T12:21:14.716557+0000","last_became_peered":"2023-10-18T12:21:14.716557+0000","last_unstale":"2023-10-18T12:21:15.791831+0000","last_undegraded":"2023-10-18T12:21:15.791831+0000","last_fullsized":"2023-10-18T12:21:15.791831+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:35:15.543811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.792904+0000","last_change":"2023-10-18T12:21:14.712168+0000","last_active":"2023-10-18T12:21:15.792904+0000","last_peered":"2023-10-18T12:21:15.792904+0000","last_clean":"2023-10-18T12:21:15.792904+0000","last_became_active":"2023-10-18T12:21:14.711896+0000","last_became_peered":"2023-10-18T12:21:14.711896+0000","last_unstale":"2023-10-18T12:21:15.792904+0000","last_undegraded":"2023-10-18T12:21:15.792904+0000","last_fullsized":"2023-10-18T12:21:15.792904+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:41:08.305349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.708474+0000","last_change":"2023-10-18T12:21:14.706987+0000","last_active":"2023-10-18T12:21:15.708474+0000","last_peered":"2023-10-18T12:21:15.708474+0000","last_clean":"2023-10-18T12:21:15.708474+0000","last_became_active":"2023-10-18T12:21:14.706530+0000","last_became_peered":"2023-10-18T12:21:14.706530+0000","last_unstale":"2023-10-18T12:21:15.708474+0000","last_undegraded":"2023-10-18T12:21:15.708474+0000","last_fullsized":"2023-10-18T12:21:15.708474+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:45:41.585698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.794192+0000","last_change":"2023-10-18T12:21:14.716552+0000","last_active":"2023-10-18T12:21:15.794192+0000","last_peered":"2023-10-18T12:21:15.794192+0000","last_clean":"2023-10-18T12:21:15.794192+0000","last_became_active":"2023-10-18T12:21:14.712473+0000","last_became_peered":"2023-10-18T12:21:14.712473+0000","last_unstale":"2023-10-18T12:21:15.794192+0000","last_undegraded":"2023-10-18T12:21:15.794192+0000","last_fullsized":"2023-10-18T12:21:15.794192+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:09:11.793777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"41'4","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.794333+0000","last_change":"2023-10-18T12:21:13.722747+0000","last_active":"2023-10-18T12:21:15.794333+0000","last_peered":"2023-10-18T12:21:15.794333+0000","last_clean":"2023-10-18T12:21:15.794333+0000","last_became_active":"2023-10-18T12:21:13.722468+0000","last_became_peered":"2023-10-18T12:21:13.722468+0000","last_unstale":"2023-10-18T12:21:15.794333+0000","last_undegraded":"2023-10-18T12:21:15.794333+0000","last_fullsized":"2023-10-18T12:21:15.794333+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:57:28.264324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.713506+0000","last_change":"2023-10-18T12:21:14.713063+0000","last_active":"2023-10-18T12:21:15.713506+0000","last_peered":"2023-10-18T12:21:15.713506+0000","last_clean":"2023-10-18T12:21:15.713506+0000","last_became_active":"2023-10-18T12:21:14.712768+0000","last_became_peered":"2023-10-18T12:21:14.712768+0000","last_unstale":"2023-10-18T12:21:15.713506+0000","last_undegraded":"2023-10-18T12:21:15.713506+0000","last_fullsized":"2023-10-18T12:21:15.713506+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:10:15.213138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.793204+0000","last_change":"2023-10-18T12:21:13.719651+0000","last_active":"2023-10-18T12:21:15.793204+0000","last_peered":"2023-10-18T12:21:15.793204+0000","last_clean":"2023-10-18T12:21:15.793204+0000","last_became_active":"2023-10-18T12:21:13.719343+0000","last_became_peered":"2023-10-18T12:21:13.719343+0000","last_unstale":"2023-10-18T12:21:15.793204+0000","last_undegraded":"2023-10-18T12:21:15.793204+0000","last_fullsized":"2023-10-18T12:21:15.793204+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:38:21.669610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.712958+0000","last_change":"2023-10-18T12:21:14.719609+0000","last_active":"2023-10-18T12:21:15.712958+0000","last_peered":"2023-10-18T12:21:15.712958+0000","last_clean":"2023-10-18T12:21:15.712958+0000","last_became_active":"2023-10-18T12:21:14.719279+0000","last_became_peered":"2023-10-18T12:21:14.719279+0000","last_unstale":"2023-10-18T12:21:15.712958+0000","last_undegraded":"2023-10-18T12:21:15.712958+0000","last_fullsized":"2023-10-18T12:21:15.712958+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:58:17.629532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.794298+0000","last_change":"2023-10-18T12:21:13.710549+0000","last_active":"2023-10-18T12:21:15.794298+0000","last_peered":"2023-10-18T12:21:15.794298+0000","last_clean":"2023-10-18T12:21:15.794298+0000","last_became_active":"2023-10-18T12:21:13.710283+0000","last_became_peered":"2023-10-18T12:21:13.710283+0000","last_unstale":"2023-10-18T12:21:15.794298+0000","last_undegraded":"2023-10-18T12:21:15.794298+0000","last_fullsized":"2023-10-18T12:21:15.794298+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:50:15.684641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.794192+0000","last_change":"2023-10-18T12:21:14.704497+0000","last_active":"2023-10-18T12:21:15.794192+0000","last_peered":"2023-10-18T12:21:15.794192+0000","last_clean":"2023-10-18T12:21:15.794192+0000","last_became_active":"2023-10-18T12:21:14.704206+0000","last_became_peered":"2023-10-18T12:21:14.704206+0000","last_unstale":"2023-10-18T12:21:15.794192+0000","last_undegraded":"2023-10-18T12:21:15.794192+0000","last_fullsized":"2023-10-18T12:21:15.794192+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:41:08.305349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.793589+0000","last_change":"2023-10-18T12:21:13.711499+0000","last_active":"2023-10-18T12:21:15.793589+0000","last_peered":"2023-10-18T12:21:15.793589+0000","last_clean":"2023-10-18T12:21:15.793589+0000","last_became_active":"2023-10-18T12:21:13.711215+0000","last_became_peered":"2023-10-18T12:21:13.711215+0000","last_unstale":"2023-10-18T12:21:15.793589+0000","last_undegraded":"2023-10-18T12:21:15.793589+0000","last_fullsized":"2023-10-18T12:21:15.793589+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:45:56.656581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.792128+0000","last_change":"2023-10-18T12:21:14.714614+0000","last_active":"2023-10-18T12:21:15.792128+0000","last_peered":"2023-10-18T12:21:15.792128+0000","last_clean":"2023-10-18T12:21:15.792128+0000","last_became_active":"2023-10-18T12:21:14.714297+0000","last_became_peered":"2023-10-18T12:21:14.714297+0000","last_unstale":"2023-10-18T12:21:15.792128+0000","last_undegraded":"2023-10-18T12:21:15.792128+0000","last_fullsized":"2023-10-18T12:21:15.792128+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:23:24.350887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.793548+0000","last_change":"2023-10-18T12:21:13.703003+0000","last_active":"2023-10-18T12:21:15.793548+0000","last_peered":"2023-10-18T12:21:15.793548+0000","last_clean":"2023-10-18T12:21:15.793548+0000","last_became_active":"2023-10-18T12:21:13.702683+0000","last_became_peered":"2023-10-18T12:21:13.702683+0000","last_unstale":"2023-10-18T12:21:15.793548+0000","last_undegraded":"2023-10-18T12:21:15.793548+0000","last_fullsized":"2023-10-18T12:21:15.793548+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:36:04.194581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.791476+0000","last_change":"2023-10-18T12:21:14.710812+0000","last_active":"2023-10-18T12:21:15.791476+0000","last_peered":"2023-10-18T12:21:15.791476+0000","last_clean":"2023-10-18T12:21:15.791476+0000","last_became_active":"2023-10-18T12:21:14.710529+0000","last_became_peered":"2023-10-18T12:21:14.710529+0000","last_unstale":"2023-10-18T12:21:15.791476+0000","last_undegraded":"2023-10-18T12:21:15.791476+0000","last_fullsized":"2023-10-18T12:21:15.791476+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:18:45.099541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.792435+0000","last_change":"2023-10-18T12:21:13.711064+0000","last_active":"2023-10-18T12:21:15.792435+0000","last_peered":"2023-10-18T12:21:15.792435+0000","last_clean":"2023-10-18T12:21:15.792435+0000","last_became_active":"2023-10-18T12:21:13.710838+0000","last_became_peered":"2023-10-18T12:21:13.710838+0000","last_unstale":"2023-10-18T12:21:15.792435+0000","last_undegraded":"2023-10-18T12:21:15.792435+0000","last_fullsized":"2023-10-18T12:21:15.792435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:40:02.271172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.790703+0000","last_change":"2023-10-18T12:21:14.701670+0000","last_active":"2023-10-18T12:21:15.790703+0000","last_peered":"2023-10-18T12:21:15.790703+0000","last_clean":"2023-10-18T12:21:15.790703+0000","last_became_active":"2023-10-18T12:21:14.701381+0000","last_became_peered":"2023-10-18T12:21:14.701381+0000","last_unstale":"2023-10-18T12:21:15.790703+0000","last_undegraded":"2023-10-18T12:21:15.790703+0000","last_fullsized":"2023-10-18T12:21:15.790703+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:23:09.048069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.711804+0000","last_change":"2023-10-18T12:21:13.717228+0000","last_active":"2023-10-18T12:21:15.711804+0000","last_peered":"2023-10-18T12:21:15.711804+0000","last_clean":"2023-10-18T12:21:15.711804+0000","last_became_active":"2023-10-18T12:21:13.716740+0000","last_became_peered":"2023-10-18T12:21:13.716740+0000","last_unstale":"2023-10-18T12:21:15.711804+0000","last_undegraded":"2023-10-18T12:21:15.711804+0000","last_fullsized":"2023-10-18T12:21:15.711804+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:09:30.503656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.712152+0000","last_change":"2023-10-18T12:21:14.702754+0000","last_active":"2023-10-18T12:21:15.712152+0000","last_peered":"2023-10-18T12:21:15.712152+0000","last_clean":"2023-10-18T12:21:15.712152+0000","last_became_active":"2023-10-18T12:21:14.702400+0000","last_became_peered":"2023-10-18T12:21:14.702400+0000","last_unstale":"2023-10-18T12:21:15.712152+0000","last_undegraded":"2023-10-18T12:21:15.712152+0000","last_fullsized":"2023-10-18T12:21:15.712152+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:20:46.875279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.790818+0000","last_change":"2023-10-18T12:21:13.719042+0000","last_active":"2023-10-18T12:21:15.790818+0000","last_peered":"2023-10-18T12:21:15.790818+0000","last_clean":"2023-10-18T12:21:15.790818+0000","last_became_active":"2023-10-18T12:21:13.718736+0000","last_became_peered":"2023-10-18T12:21:13.718736+0000","last_unstale":"2023-10-18T12:21:15.790818+0000","last_undegraded":"2023-10-18T12:21:15.790818+0000","last_fullsized":"2023-10-18T12:21:15.790818+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:09:10.777038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.792352+0000","last_change":"2023-10-18T12:21:14.726231+0000","last_active":"2023-10-18T12:21:15.792352+0000","last_peered":"2023-10-18T12:21:15.792352+0000","last_clean":"2023-10-18T12:21:15.792352+0000","last_became_active":"2023-10-18T12:21:14.725956+0000","last_became_peered":"2023-10-18T12:21:14.725956+0000","last_unstale":"2023-10-18T12:21:15.792352+0000","last_undegraded":"2023-10-18T12:21:15.792352+0000","last_fullsized":"2023-10-18T12:21:15.792352+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:08:52.304755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.794117+0000","last_change":"2023-10-18T12:21:13.712963+0000","last_active":"2023-10-18T12:21:15.794117+0000","last_peered":"2023-10-18T12:21:15.794117+0000","last_clean":"2023-10-18T12:21:15.794117+0000","last_became_active":"2023-10-18T12:21:13.712614+0000","last_became_peered":"2023-10-18T12:21:13.712614+0000","last_unstale":"2023-10-18T12:21:15.794117+0000","last_undegraded":"2023-10-18T12:21:15.794117+0000","last_fullsized":"2023-10-18T12:21:15.794117+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:04:24.463949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.794242+0000","last_change":"2023-10-18T12:21:14.710001+0000","last_active":"2023-10-18T12:21:15.794242+0000","last_peered":"2023-10-18T12:21:15.794242+0000","last_clean":"2023-10-18T12:21:15.794242+0000","last_became_active":"2023-10-18T12:21:14.709695+0000","last_became_peered":"2023-10-18T12:21:14.709695+0000","last_unstale":"2023-10-18T12:21:15.794242+0000","last_undegraded":"2023-10-18T12:21:15.794242+0000","last_fullsized":"2023-10-18T12:21:15.794242+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:09:22.477529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.793041+0000","last_change":"2023-10-18T12:21:13.716847+0000","last_active":"2023-10-18T12:21:15.793041+0000","last_peered":"2023-10-18T12:21:15.793041+0000","last_clean":"2023-10-18T12:21:15.793041+0000","last_became_active":"2023-10-18T12:21:13.716534+0000","last_became_peered":"2023-10-18T12:21:13.716534+0000","last_unstale":"2023-10-18T12:21:15.793041+0000","last_undegraded":"2023-10-18T12:21:15.793041+0000","last_fullsized":"2023-10-18T12:21:15.793041+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:57:28.264324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.793805+0000","last_change":"2023-10-18T12:21:14.721226+0000","last_active":"2023-10-18T12:21:15.793805+0000","last_peered":"2023-10-18T12:21:15.793805+0000","last_clean":"2023-10-18T12:21:15.793805+0000","last_became_active":"2023-10-18T12:21:14.720945+0000","last_became_peered":"2023-10-18T12:21:14.720945+0000","last_unstale":"2023-10-18T12:21:15.793805+0000","last_undegraded":"2023-10-18T12:21:15.793805+0000","last_fullsized":"2023-10-18T12:21:15.793805+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:26:37.012525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"41'3","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.793970+0000","last_change":"2023-10-18T12:21:13.714197+0000","last_active":"2023-10-18T12:21:15.793970+0000","last_peered":"2023-10-18T12:21:15.793970+0000","last_clean":"2023-10-18T12:21:15.793970+0000","last_became_active":"2023-10-18T12:21:13.713911+0000","last_became_peered":"2023-10-18T12:21:13.713911+0000","last_unstale":"2023-10-18T12:21:15.793970+0000","last_undegraded":"2023-10-18T12:21:15.793970+0000","last_fullsized":"2023-10-18T12:21:15.793970+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:59:28.242859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.793596+0000","last_change":"2023-10-18T12:21:14.707335+0000","last_active":"2023-10-18T12:21:15.793596+0000","last_peered":"2023-10-18T12:21:15.793596+0000","last_clean":"2023-10-18T12:21:15.793596+0000","last_became_active":"2023-10-18T12:21:14.700661+0000","last_became_peered":"2023-10-18T12:21:14.700661+0000","last_unstale":"2023-10-18T12:21:15.793596+0000","last_undegraded":"2023-10-18T12:21:15.793596+0000","last_fullsized":"2023-10-18T12:21:15.793596+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:23.701187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"41'6","reported_seq":19,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.708459+0000","last_change":"2023-10-18T12:21:13.711744+0000","last_active":"2023-10-18T12:21:15.708459+0000","last_peered":"2023-10-18T12:21:15.708459+0000","last_clean":"2023-10-18T12:21:15.708459+0000","last_became_active":"2023-10-18T12:21:13.711425+0000","last_became_peered":"2023-10-18T12:21:13.711425+0000","last_unstale":"2023-10-18T12:21:15.708459+0000","last_undegraded":"2023-10-18T12:21:15.708459+0000","last_fullsized":"2023-10-18T12:21:15.708459+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:47:37.583153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.713170+0000","last_change":"2023-10-18T12:21:14.710452+0000","last_active":"2023-10-18T12:21:15.713170+0000","last_peered":"2023-10-18T12:21:15.713170+0000","last_clean":"2023-10-18T12:21:15.713170+0000","last_became_active":"2023-10-18T12:21:14.709653+0000","last_became_peered":"2023-10-18T12:21:14.709653+0000","last_unstale":"2023-10-18T12:21:15.713170+0000","last_undegraded":"2023-10-18T12:21:15.713170+0000","last_fullsized":"2023-10-18T12:21:15.713170+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:11:43.048930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.793801+0000","last_change":"2023-10-18T12:21:13.717949+0000","last_active":"2023-10-18T12:21:15.793801+0000","last_peered":"2023-10-18T12:21:15.793801+0000","last_clean":"2023-10-18T12:21:15.793801+0000","last_became_active":"2023-10-18T12:21:13.717210+0000","last_became_peered":"2023-10-18T12:21:13.717210+0000","last_unstale":"2023-10-18T12:21:15.793801+0000","last_undegraded":"2023-10-18T12:21:15.793801+0000","last_fullsized":"2023-10-18T12:21:15.793801+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:13:21.388682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.791705+0000","last_change":"2023-10-18T12:21:14.714366+0000","last_active":"2023-10-18T12:21:15.791705+0000","last_peered":"2023-10-18T12:21:15.791705+0000","last_clean":"2023-10-18T12:21:15.791705+0000","last_became_active":"2023-10-18T12:21:14.714039+0000","last_became_peered":"2023-10-18T12:21:14.714039+0000","last_unstale":"2023-10-18T12:21:15.791705+0000","last_undegraded":"2023-10-18T12:21:15.791705+0000","last_fullsized":"2023-10-18T12:21:15.791705+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:13:22.405422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.793274+0000","last_change":"2023-10-18T12:21:13.708296+0000","last_active":"2023-10-18T12:21:15.793274+0000","last_peered":"2023-10-18T12:21:15.793274+0000","last_clean":"2023-10-18T12:21:15.793274+0000","last_became_active":"2023-10-18T12:21:13.708012+0000","last_became_peered":"2023-10-18T12:21:13.708012+0000","last_unstale":"2023-10-18T12:21:15.793274+0000","last_undegraded":"2023-10-18T12:21:15.793274+0000","last_fullsized":"2023-10-18T12:21:15.793274+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:20:45.240198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.791945+0000","last_change":"2023-10-18T12:21:14.708891+0000","last_active":"2023-10-18T12:21:15.791945+0000","last_peered":"2023-10-18T12:21:15.791945+0000","last_clean":"2023-10-18T12:21:15.791945+0000","last_became_active":"2023-10-18T12:21:14.707139+0000","last_became_peered":"2023-10-18T12:21:14.707139+0000","last_unstale":"2023-10-18T12:21:15.791945+0000","last_undegraded":"2023-10-18T12:21:15.791945+0000","last_fullsized":"2023-10-18T12:21:15.791945+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:09:11.793777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.793153+0000","last_change":"2023-10-18T12:21:13.718771+0000","last_active":"2023-10-18T12:21:15.793153+0000","last_peered":"2023-10-18T12:21:15.793153+0000","last_clean":"2023-10-18T12:21:15.793153+0000","last_became_active":"2023-10-18T12:21:13.716214+0000","last_became_peered":"2023-10-18T12:21:13.716214+0000","last_unstale":"2023-10-18T12:21:15.793153+0000","last_undegraded":"2023-10-18T12:21:15.793153+0000","last_fullsized":"2023-10-18T12:21:15.793153+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:50:15.684641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.793219+0000","last_change":"2023-10-18T12:21:14.706251+0000","last_active":"2023-10-18T12:21:15.793219+0000","last_peered":"2023-10-18T12:21:15.793219+0000","last_clean":"2023-10-18T12:21:15.793219+0000","last_became_active":"2023-10-18T12:21:14.705958+0000","last_became_peered":"2023-10-18T12:21:14.705958+0000","last_unstale":"2023-10-18T12:21:15.793219+0000","last_undegraded":"2023-10-18T12:21:15.793219+0000","last_fullsized":"2023-10-18T12:21:15.793219+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:07:51.246337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"41'8","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.790998+0000","last_change":"2023-10-18T12:21:13.716060+0000","last_active":"2023-10-18T12:21:15.790998+0000","last_peered":"2023-10-18T12:21:15.790998+0000","last_clean":"2023-10-18T12:21:15.790998+0000","last_became_active":"2023-10-18T12:21:13.715753+0000","last_became_peered":"2023-10-18T12:21:13.715753+0000","last_unstale":"2023-10-18T12:21:15.790998+0000","last_undegraded":"2023-10-18T12:21:15.790998+0000","last_fullsized":"2023-10-18T12:21:15.790998+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:50:15.684641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.708533+0000","last_change":"2023-10-18T12:21:14.714964+0000","last_active":"2023-10-18T12:21:15.708533+0000","last_peered":"2023-10-18T12:21:15.708533+0000","last_clean":"2023-10-18T12:21:15.708533+0000","last_became_active":"2023-10-18T12:21:14.714729+0000","last_became_peered":"2023-10-18T12:21:14.714729+0000","last_unstale":"2023-10-18T12:21:15.708533+0000","last_undegraded":"2023-10-18T12:21:15.708533+0000","last_fullsized":"2023-10-18T12:21:15.708533+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:41:48.801523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.708670+0000","last_change":"2023-10-18T12:21:13.709563+0000","last_active":"2023-10-18T12:21:15.708670+0000","last_peered":"2023-10-18T12:21:15.708670+0000","last_clean":"2023-10-18T12:21:15.708670+0000","last_became_active":"2023-10-18T12:21:13.709298+0000","last_became_peered":"2023-10-18T12:21:13.709298+0000","last_unstale":"2023-10-18T12:21:15.708670+0000","last_undegraded":"2023-10-18T12:21:15.708670+0000","last_fullsized":"2023-10-18T12:21:15.708670+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:22:33.398543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.792922+0000","last_change":"2023-10-18T12:21:14.716556+0000","last_active":"2023-10-18T12:21:15.792922+0000","last_peered":"2023-10-18T12:21:15.792922+0000","last_clean":"2023-10-18T12:21:15.792922+0000","last_became_active":"2023-10-18T12:21:14.716301+0000","last_became_peered":"2023-10-18T12:21:14.716301+0000","last_unstale":"2023-10-18T12:21:15.792922+0000","last_undegraded":"2023-10-18T12:21:15.792922+0000","last_fullsized":"2023-10-18T12:21:15.792922+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:27:52.176270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.793224+0000","last_change":"2023-10-18T12:21:13.709445+0000","last_active":"2023-10-18T12:21:15.793224+0000","last_peered":"2023-10-18T12:21:15.793224+0000","last_clean":"2023-10-18T12:21:15.793224+0000","last_became_active":"2023-10-18T12:21:13.708550+0000","last_became_peered":"2023-10-18T12:21:13.708550+0000","last_unstale":"2023-10-18T12:21:15.793224+0000","last_undegraded":"2023-10-18T12:21:15.793224+0000","last_fullsized":"2023-10-18T12:21:15.793224+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:21:38.442219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.713752+0000","last_change":"2023-10-18T12:21:14.720095+0000","last_active":"2023-10-18T12:21:15.713752+0000","last_peered":"2023-10-18T12:21:15.713752+0000","last_clean":"2023-10-18T12:21:15.713752+0000","last_became_active":"2023-10-18T12:21:14.719774+0000","last_became_peered":"2023-10-18T12:21:14.719774+0000","last_unstale":"2023-10-18T12:21:15.713752+0000","last_undegraded":"2023-10-18T12:21:15.713752+0000","last_fullsized":"2023-10-18T12:21:15.713752+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:45:41.585698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.712850+0000","last_change":"2023-10-18T12:21:13.717034+0000","last_active":"2023-10-18T12:21:15.712850+0000","last_peered":"2023-10-18T12:21:15.712850+0000","last_clean":"2023-10-18T12:21:15.712850+0000","last_became_active":"2023-10-18T12:21:13.716260+0000","last_became_peered":"2023-10-18T12:21:13.716260+0000","last_unstale":"2023-10-18T12:21:15.712850+0000","last_undegraded":"2023-10-18T12:21:15.712850+0000","last_fullsized":"2023-10-18T12:21:15.712850+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:48:10.359080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.713652+0000","last_change":"2023-10-18T12:21:14.707803+0000","last_active":"2023-10-18T12:21:15.713652+0000","last_peered":"2023-10-18T12:21:15.713652+0000","last_clean":"2023-10-18T12:21:15.713652+0000","last_became_active":"2023-10-18T12:21:14.707542+0000","last_became_peered":"2023-10-18T12:21:14.707542+0000","last_unstale":"2023-10-18T12:21:15.713652+0000","last_undegraded":"2023-10-18T12:21:15.713652+0000","last_fullsized":"2023-10-18T12:21:15.713652+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:58:05.170854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.794501+0000","last_change":"2023-10-18T12:21:13.714580+0000","last_active":"2023-10-18T12:21:15.794501+0000","last_peered":"2023-10-18T12:21:15.794501+0000","last_clean":"2023-10-18T12:21:15.794501+0000","last_became_active":"2023-10-18T12:21:13.714309+0000","last_became_peered":"2023-10-18T12:21:13.714309+0000","last_unstale":"2023-10-18T12:21:15.794501+0000","last_undegraded":"2023-10-18T12:21:15.794501+0000","last_fullsized":"2023-10-18T12:21:15.794501+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:59:23.597405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.794119+0000","last_change":"2023-10-18T12:21:14.715432+0000","last_active":"2023-10-18T12:21:15.794119+0000","last_peered":"2023-10-18T12:21:15.794119+0000","last_clean":"2023-10-18T12:21:15.794119+0000","last_became_active":"2023-10-18T12:21:14.715213+0000","last_became_peered":"2023-10-18T12:21:14.715213+0000","last_unstale":"2023-10-18T12:21:15.794119+0000","last_undegraded":"2023-10-18T12:21:15.794119+0000","last_fullsized":"2023-10-18T12:21:15.794119+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:12:05.216829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.793796+0000","last_change":"2023-10-18T12:21:13.703485+0000","last_active":"2023-10-18T12:21:15.793796+0000","last_peered":"2023-10-18T12:21:15.793796+0000","last_clean":"2023-10-18T12:21:15.793796+0000","last_became_active":"2023-10-18T12:21:13.702672+0000","last_became_peered":"2023-10-18T12:21:13.702672+0000","last_unstale":"2023-10-18T12:21:15.793796+0000","last_undegraded":"2023-10-18T12:21:15.793796+0000","last_fullsized":"2023-10-18T12:21:15.793796+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:09:30.503656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.791515+0000","last_change":"2023-10-18T12:21:14.710347+0000","last_active":"2023-10-18T12:21:15.791515+0000","last_peered":"2023-10-18T12:21:15.791515+0000","last_clean":"2023-10-18T12:21:15.791515+0000","last_became_active":"2023-10-18T12:21:14.710063+0000","last_became_peered":"2023-10-18T12:21:14.710063+0000","last_unstale":"2023-10-18T12:21:15.791515+0000","last_undegraded":"2023-10-18T12:21:15.791515+0000","last_fullsized":"2023-10-18T12:21:15.791515+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:05:50.458001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.712136+0000","last_change":"2023-10-18T12:21:13.719310+0000","last_active":"2023-10-18T12:21:15.712136+0000","last_peered":"2023-10-18T12:21:15.712136+0000","last_clean":"2023-10-18T12:21:15.712136+0000","last_became_active":"2023-10-18T12:21:13.719050+0000","last_became_peered":"2023-10-18T12:21:13.719050+0000","last_unstale":"2023-10-18T12:21:15.712136+0000","last_undegraded":"2023-10-18T12:21:15.712136+0000","last_fullsized":"2023-10-18T12:21:15.712136+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:14:14.848990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.708090+0000","last_change":"2023-10-18T12:21:14.713852+0000","last_active":"2023-10-18T12:21:15.708090+0000","last_peered":"2023-10-18T12:21:15.708090+0000","last_clean":"2023-10-18T12:21:15.708090+0000","last_became_active":"2023-10-18T12:21:14.713488+0000","last_became_peered":"2023-10-18T12:21:14.713488+0000","last_unstale":"2023-10-18T12:21:15.708090+0000","last_undegraded":"2023-10-18T12:21:15.708090+0000","last_fullsized":"2023-10-18T12:21:15.708090+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:35:47.570739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.790508+0000","last_change":"2023-10-18T12:21:13.716351+0000","last_active":"2023-10-18T12:21:15.790508+0000","last_peered":"2023-10-18T12:21:15.790508+0000","last_clean":"2023-10-18T12:21:15.790508+0000","last_became_active":"2023-10-18T12:21:13.716009+0000","last_became_peered":"2023-10-18T12:21:13.716009+0000","last_unstale":"2023-10-18T12:21:15.790508+0000","last_undegraded":"2023-10-18T12:21:15.790508+0000","last_fullsized":"2023-10-18T12:21:15.790508+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:05:49.441261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.790467+0000","last_change":"2023-10-18T12:21:14.708309+0000","last_active":"2023-10-18T12:21:15.790467+0000","last_peered":"2023-10-18T12:21:15.790467+0000","last_clean":"2023-10-18T12:21:15.790467+0000","last_became_active":"2023-10-18T12:21:14.708045+0000","last_became_peered":"2023-10-18T12:21:14.708045+0000","last_unstale":"2023-10-18T12:21:15.790467+0000","last_undegraded":"2023-10-18T12:21:15.790467+0000","last_fullsized":"2023-10-18T12:21:15.790467+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:20:29.310044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.791697+0000","last_change":"2023-10-18T12:21:13.711075+0000","last_active":"2023-10-18T12:21:15.791697+0000","last_peered":"2023-10-18T12:21:15.791697+0000","last_clean":"2023-10-18T12:21:15.791697+0000","last_became_active":"2023-10-18T12:21:13.710821+0000","last_became_peered":"2023-10-18T12:21:13.710821+0000","last_unstale":"2023-10-18T12:21:15.791697+0000","last_undegraded":"2023-10-18T12:21:15.791697+0000","last_fullsized":"2023-10-18T12:21:15.791697+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:58:16.612792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.794035+0000","last_change":"2023-10-18T12:21:14.715857+0000","last_active":"2023-10-18T12:21:15.794035+0000","last_peered":"2023-10-18T12:21:15.794035+0000","last_clean":"2023-10-18T12:21:15.794035+0000","last_became_active":"2023-10-18T12:21:14.715646+0000","last_became_peered":"2023-10-18T12:21:14.715646+0000","last_unstale":"2023-10-18T12:21:15.794035+0000","last_undegraded":"2023-10-18T12:21:15.794035+0000","last_fullsized":"2023-10-18T12:21:15.794035+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:27:52.176270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.793965+0000","last_change":"2023-10-18T12:21:13.716478+0000","last_active":"2023-10-18T12:21:15.793965+0000","last_peered":"2023-10-18T12:21:15.793965+0000","last_clean":"2023-10-18T12:21:15.793965+0000","last_became_active":"2023-10-18T12:21:13.716170+0000","last_became_peered":"2023-10-18T12:21:13.716170+0000","last_unstale":"2023-10-18T12:21:15.793965+0000","last_undegraded":"2023-10-18T12:21:15.793965+0000","last_fullsized":"2023-10-18T12:21:15.793965+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:05:38.324058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.713719+0000","last_change":"2023-10-18T12:19:33.531672+0000","last_active":"2023-10-18T12:21:15.713719+0000","last_peered":"2023-10-18T12:21:15.713719+0000","last_clean":"2023-10-18T12:21:15.713719+0000","last_became_active":"2023-10-18T12:19:33.530907+0000","last_became_peered":"2023-10-18T12:19:33.530907+0000","last_unstale":"2023-10-18T12:21:15.713719+0000","last_undegraded":"2023-10-18T12:21:15.713719+0000","last_fullsized":"2023-10-18T12:21:15.713719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:40:07.626026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.793407+0000","last_change":"2023-10-18T12:21:14.710107+0000","last_active":"2023-10-18T12:21:15.793407+0000","last_peered":"2023-10-18T12:21:15.793407+0000","last_clean":"2023-10-18T12:21:15.793407+0000","last_became_active":"2023-10-18T12:21:14.709854+0000","last_became_peered":"2023-10-18T12:21:14.709854+0000","last_unstale":"2023-10-18T12:21:15.793407+0000","last_undegraded":"2023-10-18T12:21:15.793407+0000","last_fullsized":"2023-10-18T12:21:15.793407+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:59:52.010102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.792651+0000","last_change":"2023-10-18T12:21:13.713083+0000","last_active":"2023-10-18T12:21:15.792651+0000","last_peered":"2023-10-18T12:21:15.792651+0000","last_clean":"2023-10-18T12:21:15.792651+0000","last_became_active":"2023-10-18T12:21:13.712819+0000","last_became_peered":"2023-10-18T12:21:13.712819+0000","last_unstale":"2023-10-18T12:21:15.792651+0000","last_undegraded":"2023-10-18T12:21:15.792651+0000","last_fullsized":"2023-10-18T12:21:15.792651+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:23:26.731434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.794318+0000","last_change":"2023-10-18T12:19:33.529329+0000","last_active":"2023-10-18T12:21:15.794318+0000","last_peered":"2023-10-18T12:21:15.794318+0000","last_clean":"2023-10-18T12:21:15.794318+0000","last_became_active":"2023-10-18T12:19:33.528930+0000","last_became_peered":"2023-10-18T12:19:33.528930+0000","last_unstale":"2023-10-18T12:21:15.794318+0000","last_undegraded":"2023-10-18T12:21:15.794318+0000","last_fullsized":"2023-10-18T12:21:15.794318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:31:27.085147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.711666+0000","last_change":"2023-10-18T12:21:14.710912+0000","last_active":"2023-10-18T12:21:15.711666+0000","last_peered":"2023-10-18T12:21:15.711666+0000","last_clean":"2023-10-18T12:21:15.711666+0000","last_became_active":"2023-10-18T12:21:14.710617+0000","last_became_peered":"2023-10-18T12:21:14.710617+0000","last_unstale":"2023-10-18T12:21:15.711666+0000","last_undegraded":"2023-10-18T12:21:15.711666+0000","last_fullsized":"2023-10-18T12:21:15.711666+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:32:21.526596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.791369+0000","last_change":"2023-10-18T12:21:13.717072+0000","last_active":"2023-10-18T12:21:15.791369+0000","last_peered":"2023-10-18T12:21:15.791369+0000","last_clean":"2023-10-18T12:21:15.791369+0000","last_became_active":"2023-10-18T12:21:13.716720+0000","last_became_peered":"2023-10-18T12:21:13.716720+0000","last_unstale":"2023-10-18T12:21:15.791369+0000","last_undegraded":"2023-10-18T12:21:15.791369+0000","last_fullsized":"2023-10-18T12:21:15.791369+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:20:28.293304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.794080+0000","last_change":"2023-10-18T12:19:33.703565+0000","last_active":"2023-10-18T12:21:15.794080+0000","last_peered":"2023-10-18T12:21:15.794080+0000","last_clean":"2023-10-18T12:21:15.794080+0000","last_became_active":"2023-10-18T12:19:33.703276+0000","last_became_peered":"2023-10-18T12:19:33.703276+0000","last_unstale":"2023-10-18T12:21:15.794080+0000","last_undegraded":"2023-10-18T12:21:15.794080+0000","last_fullsized":"2023-10-18T12:21:15.794080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:19:43.178687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.792054+0000","last_change":"2023-10-18T12:21:14.718693+0000","last_active":"2023-10-18T12:21:15.792054+0000","last_peered":"2023-10-18T12:21:15.792054+0000","last_clean":"2023-10-18T12:21:15.792054+0000","last_became_active":"2023-10-18T12:21:14.718393+0000","last_became_peered":"2023-10-18T12:21:14.718393+0000","last_unstale":"2023-10-18T12:21:15.792054+0000","last_undegraded":"2023-10-18T12:21:15.792054+0000","last_fullsized":"2023-10-18T12:21:15.792054+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:24:39.208983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.791015+0000","last_change":"2023-10-18T12:21:13.715068+0000","last_active":"2023-10-18T12:21:15.791015+0000","last_peered":"2023-10-18T12:21:15.791015+0000","last_clean":"2023-10-18T12:21:15.791015+0000","last_became_active":"2023-10-18T12:21:13.714662+0000","last_became_peered":"2023-10-18T12:21:13.714662+0000","last_unstale":"2023-10-18T12:21:15.791015+0000","last_undegraded":"2023-10-18T12:21:15.791015+0000","last_fullsized":"2023-10-18T12:21:15.791015+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:33:07.243905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.791974+0000","last_change":"2023-10-18T12:19:33.703109+0000","last_active":"2023-10-18T12:21:15.791974+0000","last_peered":"2023-10-18T12:21:15.791974+0000","last_clean":"2023-10-18T12:21:15.791974+0000","last_became_active":"2023-10-18T12:19:33.702456+0000","last_became_peered":"2023-10-18T12:19:33.702456+0000","last_unstale":"2023-10-18T12:21:15.791974+0000","last_undegraded":"2023-10-18T12:21:15.791974+0000","last_fullsized":"2023-10-18T12:21:15.791974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:21:27.872572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.713673+0000","last_change":"2023-10-18T12:21:14.711788+0000","last_active":"2023-10-18T12:21:15.713673+0000","last_peered":"2023-10-18T12:21:15.713673+0000","last_clean":"2023-10-18T12:21:15.713673+0000","last_became_active":"2023-10-18T12:21:14.709751+0000","last_became_peered":"2023-10-18T12:21:14.709751+0000","last_unstale":"2023-10-18T12:21:15.713673+0000","last_undegraded":"2023-10-18T12:21:15.713673+0000","last_fullsized":"2023-10-18T12:21:15.713673+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:47:38.599893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.793807+0000","last_change":"2023-10-18T12:21:13.704226+0000","last_active":"2023-10-18T12:21:15.793807+0000","last_peered":"2023-10-18T12:21:15.793807+0000","last_clean":"2023-10-18T12:21:15.793807+0000","last_became_active":"2023-10-18T12:21:13.703989+0000","last_became_peered":"2023-10-18T12:21:13.703989+0000","last_unstale":"2023-10-18T12:21:15.793807+0000","last_undegraded":"2023-10-18T12:21:15.793807+0000","last_fullsized":"2023-10-18T12:21:15.793807+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:32:20.509856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.712248+0000","last_change":"2023-10-18T12:19:33.533449+0000","last_active":"2023-10-18T12:21:15.712248+0000","last_peered":"2023-10-18T12:21:15.712248+0000","last_clean":"2023-10-18T12:21:15.712248+0000","last_became_active":"2023-10-18T12:19:33.533051+0000","last_became_peered":"2023-10-18T12:19:33.533051+0000","last_unstale":"2023-10-18T12:21:15.712248+0000","last_undegraded":"2023-10-18T12:21:15.712248+0000","last_fullsized":"2023-10-18T12:21:15.712248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:26:11.000772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.792302+0000","last_change":"2023-10-18T12:21:14.709961+0000","last_active":"2023-10-18T12:21:15.792302+0000","last_peered":"2023-10-18T12:21:15.792302+0000","last_clean":"2023-10-18T12:21:15.792302+0000","last_became_active":"2023-10-18T12:21:14.709679+0000","last_became_peered":"2023-10-18T12:21:14.709679+0000","last_unstale":"2023-10-18T12:21:15.792302+0000","last_undegraded":"2023-10-18T12:21:15.792302+0000","last_fullsized":"2023-10-18T12:21:15.792302+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:26:37.012525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.794184+0000","last_change":"2023-10-18T12:21:13.714139+0000","last_active":"2023-10-18T12:21:15.794184+0000","last_peered":"2023-10-18T12:21:15.794184+0000","last_clean":"2023-10-18T12:21:15.794184+0000","last_became_active":"2023-10-18T12:21:13.713849+0000","last_became_peered":"2023-10-18T12:21:13.713849+0000","last_unstale":"2023-10-18T12:21:15.794184+0000","last_undegraded":"2023-10-18T12:21:15.794184+0000","last_fullsized":"2023-10-18T12:21:15.794184+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:07:33.701694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.707799+0000","last_change":"2023-10-18T12:19:33.530766+0000","last_active":"2023-10-18T12:21:15.707799+0000","last_peered":"2023-10-18T12:21:15.707799+0000","last_clean":"2023-10-18T12:21:15.707799+0000","last_became_active":"2023-10-18T12:19:33.530346+0000","last_became_peered":"2023-10-18T12:19:33.530346+0000","last_unstale":"2023-10-18T12:21:15.707799+0000","last_undegraded":"2023-10-18T12:21:15.707799+0000","last_fullsized":"2023-10-18T12:21:15.707799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:52:40.418433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.793913+0000","last_change":"2023-10-18T12:21:14.702121+0000","last_active":"2023-10-18T12:21:15.793913+0000","last_peered":"2023-10-18T12:21:15.793913+0000","last_clean":"2023-10-18T12:21:15.793913+0000","last_became_active":"2023-10-18T12:21:14.700994+0000","last_became_peered":"2023-10-18T12:21:14.700994+0000","last_unstale":"2023-10-18T12:21:15.793913+0000","last_undegraded":"2023-10-18T12:21:15.793913+0000","last_fullsized":"2023-10-18T12:21:15.793913+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:36:47.566617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.792008+0000","last_change":"2023-10-18T12:21:13.708658+0000","last_active":"2023-10-18T12:21:15.792008+0000","last_peered":"2023-10-18T12:21:15.792008+0000","last_clean":"2023-10-18T12:21:15.792008+0000","last_became_active":"2023-10-18T12:21:13.708336+0000","last_became_peered":"2023-10-18T12:21:13.708336+0000","last_unstale":"2023-10-18T12:21:15.792008+0000","last_undegraded":"2023-10-18T12:21:15.792008+0000","last_fullsized":"2023-10-18T12:21:15.792008+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:24:43.299570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.791434+0000","last_change":"2023-10-18T12:19:33.528538+0000","last_active":"2023-10-18T12:21:15.791434+0000","last_peered":"2023-10-18T12:21:15.791434+0000","last_clean":"2023-10-18T12:21:15.791434+0000","last_became_active":"2023-10-18T12:19:33.528214+0000","last_became_peered":"2023-10-18T12:19:33.528214+0000","last_unstale":"2023-10-18T12:21:15.791434+0000","last_undegraded":"2023-10-18T12:21:15.791434+0000","last_fullsized":"2023-10-18T12:21:15.791434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:46:30.200322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.793043+0000","last_change":"2023-10-18T12:21:14.715096+0000","last_active":"2023-10-18T12:21:15.793043+0000","last_peered":"2023-10-18T12:21:15.793043+0000","last_clean":"2023-10-18T12:21:15.793043+0000","last_became_active":"2023-10-18T12:21:14.714779+0000","last_became_peered":"2023-10-18T12:21:14.714779+0000","last_unstale":"2023-10-18T12:21:15.793043+0000","last_undegraded":"2023-10-18T12:21:15.793043+0000","last_fullsized":"2023-10-18T12:21:15.793043+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:12:05.216829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.713020+0000","last_change":"2023-10-18T12:21:13.715330+0000","last_active":"2023-10-18T12:21:15.713020+0000","last_peered":"2023-10-18T12:21:15.713020+0000","last_clean":"2023-10-18T12:21:15.713020+0000","last_became_active":"2023-10-18T12:21:13.715077+0000","last_became_peered":"2023-10-18T12:21:13.715077+0000","last_unstale":"2023-10-18T12:21:15.713020+0000","last_undegraded":"2023-10-18T12:21:15.713020+0000","last_fullsized":"2023-10-18T12:21:15.713020+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:07:50.229597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.712356+0000","last_change":"2023-10-18T12:19:33.531214+0000","last_active":"2023-10-18T12:21:15.712356+0000","last_peered":"2023-10-18T12:21:15.712356+0000","last_clean":"2023-10-18T12:21:15.712356+0000","last_became_active":"2023-10-18T12:19:33.530795+0000","last_became_peered":"2023-10-18T12:19:33.530795+0000","last_unstale":"2023-10-18T12:21:15.712356+0000","last_undegraded":"2023-10-18T12:21:15.712356+0000","last_fullsized":"2023-10-18T12:21:15.712356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:55:48.105566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":207,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.791682+0000","last_change":"2023-10-18T12:19:28.825371+0000","last_active":"2023-10-18T12:21:15.791682+0000","last_peered":"2023-10-18T12:21:15.791682+0000","last_clean":"2023-10-18T12:21:15.791682+0000","last_became_active":"2023-10-18T12:19:28.822484+0000","last_became_peered":"2023-10-18T12:19:28.822484+0000","last_unstale":"2023-10-18T12:21:15.791682+0000","last_undegraded":"2023-10-18T12:21:15.791682+0000","last_fullsized":"2023-10-18T12:21:15.791682+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:27.318899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:27.318899+0000","last_clean_scrub_stamp":"2023-10-18T12:19:27.318899+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:52:09.222599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28088,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343752,"statfs":{"total":96636764160,"available":96608002048,"internally_reserved":0,"allocated":1085440,"data_stored":807917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:20:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":2.8660000000000001,"5min":2.8660000000000001,"15min":2.8660000000000001},"last":1.306},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.2160000000000002,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":1.014}]},{"osd":1,"last update":"Wed Oct 18 12:20:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.0990000000000002,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":0.93799999999999994}]},{"osd":2,"last update":"Wed Oct 18 12:20:27 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.272,"15min":1.272},"min":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.28,"5min":1.28,"15min":1.28},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.2149999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":1.2629999999999999}]},{"osd":3,"last update":"Wed Oct 18 12:20:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.5129999999999999},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":2.9940000000000002,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":1.4710000000000001}]},{"osd":4,"last update":"Wed Oct 18 12:20:27 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":2.3719999999999999,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":1.24}]},{"osd":5,"last update":"Wed Oct 18 12:20:27 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.873,"5min":0.873,"15min":0.873},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.2},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"max":{"1min":2.3300000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":1.55}]},{"osd":6,"last update":"Wed Oct 18 12:20:27 2023","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"min":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"max":{"1min":3.7709999999999999,"5min":3.7709999999999999,"15min":3.7709999999999999},"last":1.6200000000000001},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.9690000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":1.3759999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":495616,"data_stored":218131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:20:25 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":1.369}]},{"osd":1,"last update":"Wed Oct 18 12:20:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.4370000000000001}]},{"osd":2,"last update":"Wed Oct 18 12:20:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.048}]},{"osd":3,"last update":"Wed Oct 18 12:20:25 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.609},{"interface":"front","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":1.25}]},{"osd":4,"last update":"Wed Oct 18 12:20:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":1.399},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.175}]},{"osd":5,"last update":"Wed Oct 18 12:20:25 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":1.105},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":1.145}]},{"osd":7,"last update":"Wed Oct 18 12:20:25 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.8580000000000001},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":1.099,"5min":1.099,"15min":1.099},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":1.4850000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":491520,"data_stored":217529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:20:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.823}]},{"osd":1,"last update":"Wed Oct 18 12:20:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":1.5449999999999999}]},{"osd":2,"last update":"Wed Oct 18 12:20:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":1.8859999999999999},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.6480000000000001,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":0.997}]},{"osd":3,"last update":"Wed Oct 18 12:20:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":2.2749999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":2.6219999999999999,"5min":2.6219999999999999,"15min":2.6219999999999999},"last":1.71}]},{"osd":4,"last update":"Wed Oct 18 12:20:28 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":2.5190000000000001,"5min":2.5190000000000001,"15min":2.5190000000000001},"last":1.069},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":2.4489999999999998,"5min":2.4489999999999998,"15min":2.4489999999999998},"last":1.657}]},{"osd":6,"last update":"Wed Oct 18 12:20:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":2.3479999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.9830000000000001},{"interface":"front","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.621,"5min":2.621,"15min":2.621},"last":1.4690000000000001}]},{"osd":7,"last update":"Wed Oct 18 12:20:28 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.496,"15min":1.496},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.581,"5min":2.581,"15min":2.581},"last":1.76},{"interface":"front","average":{"1min":1.569,"5min":1.569,"15min":1.569},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.673,"5min":2.673,"15min":2.673},"last":1.9430000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":499712,"data_stored":219071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:20:27 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.913,"5min":1.913,"15min":1.913},"last":1.573}]},{"osd":1,"last update":"Wed Oct 18 12:20:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.8169999999999999,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":0.69899999999999995}]},{"osd":2,"last update":"Wed Oct 18 12:20:27 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.159}]},{"osd":3,"last update":"Wed Oct 18 12:20:27 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.208,"15min":1.208},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.0779999999999998,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":2.734,"5min":2.734,"15min":2.734},"last":1.528}]},{"osd":5,"last update":"Wed Oct 18 12:20:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":1.419},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":1.331}]},{"osd":6,"last update":"Wed Oct 18 12:20:27 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.7}]},{"osd":7,"last update":"Wed Oct 18 12:20:27 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.349,"15min":1.349},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.9850000000000001,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":1.613},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"min":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"max":{"1min":2.645,"5min":2.645,"15min":2.645},"last":1.657}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":487424,"data_stored":211124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:20:29 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":3.8490000000000002,"5min":3.8490000000000002,"15min":3.8490000000000002},"last":1.3360000000000001},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.2229999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.79500000000000004}]},{"osd":1,"last update":"Wed Oct 18 12:20:29 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":2.4529999999999998,"5min":2.4529999999999998,"15min":2.4529999999999998},"last":0.82699999999999996},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.593,"5min":2.593,"15min":2.593},"last":1.26}]},{"osd":2,"last update":"Wed Oct 18 12:20:29 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":2.9319999999999999,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":0.629},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":3.9359999999999999,"5min":3.9359999999999999,"15min":3.9359999999999999},"last":1.1379999999999999}]},{"osd":4,"last update":"Wed Oct 18 12:20:29 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.345,"15min":1.345},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":3.8919999999999999,"5min":3.8919999999999999,"15min":3.8919999999999999},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":3.7000000000000002,"5min":3.7000000000000002,"15min":3.7000000000000002},"last":1.097}]},{"osd":5,"last update":"Wed Oct 18 12:20:29 2023","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"min":{"1min":1.071,"5min":1.071,"15min":1.071},"max":{"1min":3.125,"5min":3.125,"15min":3.125},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.508,"5min":1.508,"15min":1.508},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":3.972,"5min":3.972,"15min":3.972},"last":1.4750000000000001}]},{"osd":6,"last update":"Wed Oct 18 12:20:29 2023","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.494,"15min":1.494},"min":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"max":{"1min":4.2480000000000002,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.504,"5min":1.504,"15min":1.504},"min":{"1min":1.004,"5min":1.004,"15min":1.004},"max":{"1min":3.4060000000000001,"5min":3.4060000000000001,"15min":3.4060000000000001},"last":1.3680000000000001}]},{"osd":7,"last update":"Wed Oct 18 12:20:29 2023","interfaces":[{"interface":"back","average":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"min":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"max":{"1min":4.0720000000000001,"5min":4.0720000000000001,"15min":4.0720000000000001},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"min":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"max":{"1min":3.9940000000000002,"5min":3.9940000000000002,"15min":3.9940000000000002},"last":1.1220000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":491520,"data_stored":212120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:20:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":1.208}]},{"osd":1,"last update":"Wed Oct 18 12:20:28 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":1.1140000000000001},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.81899999999999995}]},{"osd":3,"last update":"Wed Oct 18 12:20:28 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":1.339},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":2.1110000000000002,"5min":2.1110000000000002,"15min":2.1110000000000002},"last":1.0600000000000001}]},{"osd":4,"last update":"Wed Oct 18 12:20:28 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":3.1579999999999999,"5min":3.1579999999999999,"15min":3.1579999999999999},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":1.7849999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.026}]},{"osd":5,"last update":"Wed Oct 18 12:20:28 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.371,"15min":1.371},"min":{"1min":1.02,"5min":1.02,"15min":1.02},"max":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.419,"5min":1.419,"15min":1.419},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.8700000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":1.5049999999999999}]},{"osd":6,"last update":"Wed Oct 18 12:20:28 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":3.2149999999999999,"5min":3.2149999999999999,"15min":3.2149999999999999},"last":1.3939999999999999}]},{"osd":7,"last update":"Wed Oct 18 12:20:28 2023","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":2.246,"5min":2.246,"15min":2.246},"last":1.556},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":2.976,"5min":2.976,"15min":2.976},"last":1.4259999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":479232,"data_stored":210556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:20:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":1.05},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":1.155}]},{"osd":2,"last update":"Wed Oct 18 12:20:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":4.2690000000000001,"5min":4.2690000000000001,"15min":4.2690000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.375}]},{"osd":3,"last update":"Wed Oct 18 12:20:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":1.181},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":0.53400000000000003}]},{"osd":4,"last update":"Wed Oct 18 12:20:29 2023","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.423,"15min":1.423},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":5.524,"5min":5.524,"15min":5.524},"last":1.111},{"interface":"front","average":{"1min":1.526,"5min":1.526,"15min":1.526},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":4.5860000000000003,"5min":4.5860000000000003,"15min":4.5860000000000003},"last":0.84799999999999998}]},{"osd":5,"last update":"Wed Oct 18 12:20:29 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.464,"15min":1.464},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":4.4199999999999999,"5min":4.4199999999999999,"15min":4.4199999999999999},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.284}]},{"osd":6,"last update":"Wed Oct 18 12:20:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":2.6179999999999999,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":4.3140000000000001,"5min":4.3140000000000001,"15min":4.3140000000000001},"last":0.90300000000000002}]},{"osd":7,"last update":"Wed Oct 18 12:20:29 2023","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":2.5110000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"min":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"max":{"1min":2.339,"5min":2.339,"15min":2.339},"last":0.871}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1073152,"data_stored":800888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 18 12:20:28 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.54700000000000004}]},{"osd":2,"last update":"Wed Oct 18 12:20:28 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":1.0509999999999999}]},{"osd":3,"last update":"Wed Oct 18 12:20:28 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.77200000000000002}]},{"osd":4,"last update":"Wed Oct 18 12:20:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":1.179},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":1.1339999999999999}]},{"osd":5,"last update":"Wed Oct 18 12:20:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.726,"5min":2.726,"15min":2.726},"last":1},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.5619999999999998,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":1.099}]},{"osd":6,"last update":"Wed Oct 18 12:20:28 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":2.4990000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.216},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"min":{"1min":1.028,"5min":1.028,"15min":1.028},"max":{"1min":2.847,"5min":2.847,"15min":2.847},"last":1.3120000000000001}]},{"osd":7,"last update":"Wed Oct 18 12:20:28 2023","interfaces":[{"interface":"back","average":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"min":{"1min":1.071,"5min":1.071,"15min":1.071},"max":{"1min":3.1930000000000001,"5min":3.1930000000000001,"15min":3.1930000000000001},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":2.3900000000000001,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":1.264}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-18T12:21:19.064 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-18T12:21:19.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.276+0000 7f5192b4d700 1 Processor -- start 2023-10-18T12:21:19.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.276+0000 7f5192b4d700 1 -- start start 2023-10-18T12:21:19.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.280+0000 7f5192b4d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f518c15ae30 0x7f518c0cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:19.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.280+0000 7f5192b4d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f518c0b2400 0x7f518c0b28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:19.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.280+0000 7f5192b4d700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f518c06f660 con 0x7f518c0b3a10 2023-10-18T12:21:19.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.280+0000 7f5192b4d700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f518c0b2df0 con 0x7f518c15ae30 2023-10-18T12:21:19.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.280+0000 7f5192b4d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f518c15b210 con 0x7f518c0b2400 2023-10-18T12:21:19.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.280+0000 7f51908e9700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f518c15ae30 0x7f518c0cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:19.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.280+0000 7f51908e9700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f518c15ae30 0x7f518c0cbc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39328/0 (socket says 172.21.15.114:39328) 2023-10-18T12:21:19.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.280+0000 7f51908e9700 1 -- 172.21.15.114:0/493636174 learned_addr learned my addr 172.21.15.114:0/493636174 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:19.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.280+0000 7f51910ea700 1 --2- 172.21.15.114:0/493636174 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f518c0b2400 0x7f518c0b28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:19.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.284+0000 7f51908e9700 1 -- 172.21.15.114:0/493636174 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f518c0b2400 msgr2=0x7f518c0b28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:19.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.284+0000 7f51908e9700 1 --2- 172.21.15.114:0/493636174 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f518c0b2400 0x7f518c0b28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:19.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.284+0000 7f51908e9700 1 -- 172.21.15.114:0/493636174 >> v1:172.21.15.172:6789/0 conn(0x7f518c0b3a10 legacy=0x7f518c0cffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:19.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.284+0000 7f51908e9700 1 -- 172.21.15.114:0/493636174 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f518c06f940 con 0x7f518c15ae30 2023-10-18T12:21:19.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.284+0000 7f51908e9700 1 --2- 172.21.15.114:0/493636174 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f518c15ae30 0x7f518c0cbc80 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f5180009910 tx=0x7f5180009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f212996f7deac3b server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:19.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.284+0000 7f518b7fe700 1 -- 172.21.15.114:0/493636174 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5180011830 con 0x7f518c15ae30 2023-10-18T12:21:19.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.284+0000 7f518b7fe700 1 -- 172.21.15.114:0/493636174 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5180011990 con 0x7f518c15ae30 2023-10-18T12:21:19.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.284+0000 7f518b7fe700 1 -- 172.21.15.114:0/493636174 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5180011d40 con 0x7f518c15ae30 2023-10-18T12:21:19.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.284+0000 7f5192b4d700 1 -- 172.21.15.114:0/493636174 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f518c15ae30 msgr2=0x7f518c0cbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:19.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.284+0000 7f5192b4d700 1 --2- 172.21.15.114:0/493636174 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f518c15ae30 0x7f518c0cbc80 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f5180009910 tx=0x7f5180009c20 comp rx=0 tx=0).stop 2023-10-18T12:21:19.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.284+0000 7f5192b4d700 1 -- 172.21.15.114:0/493636174 shutdown_connections 2023-10-18T12:21:19.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.284+0000 7f5192b4d700 1 --2- 172.21.15.114:0/493636174 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f518c0b2400 0x7f518c0b28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:19.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.284+0000 7f5192b4d700 1 --2- 172.21.15.114:0/493636174 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f518c15ae30 0x7f518c0cbc80 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:19.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.284+0000 7f5192b4d700 1 -- 172.21.15.114:0/493636174 >> 172.21.15.114:0/493636174 conn(0x7f518c0cd400 msgr2=0x7f518c0cd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:19.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.284+0000 7f5192b4d700 1 -- 172.21.15.114:0/493636174 shutdown_connections 2023-10-18T12:21:19.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.284+0000 7f5192b4d700 1 -- 172.21.15.114:0/493636174 wait complete. 2023-10-18T12:21:19.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.288+0000 7f5192b4d700 1 Processor -- start 2023-10-18T12:21:19.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.288+0000 7f5192b4d700 1 -- start start 2023-10-18T12:21:19.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.292+0000 7f5192b4d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f518c0b2400 0x7f518c1598a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:19.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.292+0000 7f5192b4d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f518c0b3a10 0x7f518c0c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:19.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.292+0000 7f5192b4d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f518c15ae30 0x7f518c14a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:19.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.292+0000 7f5192b4d700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f518c15c0a0 con 0x7f518c0b3a10 2023-10-18T12:21:19.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.292+0000 7f5192b4d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f518c15b490 con 0x7f518c0b2400 2023-10-18T12:21:19.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.292+0000 7f5192b4d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f518c15b770 con 0x7f518c15ae30 2023-10-18T12:21:19.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.292+0000 7f518bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f518c0b3a10 0x7f518c0c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:19.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.292+0000 7f518bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f518c0b3a10 0x7f518c0c7a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39334/0 (socket says 172.21.15.114:39334) 2023-10-18T12:21:19.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.292+0000 7f518bfff700 1 -- 172.21.15.114:0/1077919936 learned_addr learned my addr 172.21.15.114:0/1077919936 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:19.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.292+0000 7f51910ea700 1 --2- 172.21.15.114:0/1077919936 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f518c15ae30 0x7f518c14a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:19.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.292+0000 7f51908e9700 1 --2- 172.21.15.114:0/1077919936 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f518c0b2400 0x7f518c1598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:19.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.292+0000 7f518bfff700 1 -- 172.21.15.114:0/1077919936 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f518c15ae30 msgr2=0x7f518c14a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:19.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.292+0000 7f518bfff700 1 --2- 172.21.15.114:0/1077919936 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f518c15ae30 0x7f518c14a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:19.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.292+0000 7f518bfff700 1 -- 172.21.15.114:0/1077919936 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f518c0b2400 msgr2=0x7f518c1598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:19.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.292+0000 7f518bfff700 1 --2- 172.21.15.114:0/1077919936 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f518c0b2400 0x7f518c1598a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:19.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.292+0000 7f518bfff700 1 -- 172.21.15.114:0/1077919936 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5180009570 con 0x7f518c0b3a10 2023-10-18T12:21:19.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.292+0000 7f518bfff700 1 --2- 172.21.15.114:0/1077919936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f518c0b3a10 0x7f518c0c7a50 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f517800c4d0 tx=0x7f517800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:19.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.292+0000 7f51897fa700 1 -- 172.21.15.114:0/1077919936 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51780052d0 con 0x7f518c0b3a10 2023-10-18T12:21:19.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.292+0000 7f51897fa700 1 -- 172.21.15.114:0/1077919936 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5178005430 con 0x7f518c0b3a10 2023-10-18T12:21:19.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.292+0000 7f51897fa700 1 -- 172.21.15.114:0/1077919936 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51780055a0 con 0x7f518c0b3a10 2023-10-18T12:21:19.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.292+0000 7f5192b4d700 1 -- 172.21.15.114:0/1077919936 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f518c15ba50 con 0x7f518c0b3a10 2023-10-18T12:21:19.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.292+0000 7f5192b4d700 1 -- 172.21.15.114:0/1077919936 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f518c157260 con 0x7f518c0b3a10 2023-10-18T12:21:19.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.296+0000 7f5192b4d700 1 -- 172.21.15.114:0/1077919936 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f518c072e60 con 0x7f518c0b3a10 2023-10-18T12:21:19.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.296+0000 7f51897fa700 1 -- 172.21.15.114:0/1077919936 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f51780038c0 con 0x7f518c0b3a10 2023-10-18T12:21:19.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.296+0000 7f51897fa700 1 --2- 172.21.15.114:0/1077919936 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5170065720 0x7f5170067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:19.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.296+0000 7f51897fa700 1 -- 172.21.15.114:0/1077919936 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f5178082310 con 0x7f518c0b3a10 2023-10-18T12:21:19.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.300+0000 7f51908e9700 1 --2- 172.21.15.114:0/1077919936 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5170065720 0x7f5170067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:19.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.300+0000 7f51908e9700 1 --2- 172.21.15.114:0/1077919936 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5170065720 0x7f5170067be0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5180014040 tx=0x7f5180008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:19.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.304+0000 7f51897fa700 1 -- 172.21.15.114:0/1077919936 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f517804fd20 con 0x7f518c0b3a10 2023-10-18T12:21:19.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.472+0000 7f5192b4d700 1 -- 172.21.15.114:0/1077919936 --> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f518c06ff00 con 0x7f5170065720 2023-10-18T12:21:19.495 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.488+0000 7f51897fa700 1 -- 172.21.15.114:0/1077919936 <== mgr.4108 v2:172.21.15.172:6832/461408666 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+308694 (secure 0 0 0) 0x7f5180011b00 con 0x7f5170065720 2023-10-18T12:21:19.501 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:21:19.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.496+0000 7f5192b4d700 1 -- 172.21.15.114:0/1077919936 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5170065720 msgr2=0x7f5170067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:19.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.496+0000 7f5192b4d700 1 --2- 172.21.15.114:0/1077919936 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5170065720 0x7f5170067be0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5180014040 tx=0x7f5180008030 comp rx=0 tx=0).stop 2023-10-18T12:21:19.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.496+0000 7f5192b4d700 1 -- 172.21.15.114:0/1077919936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f518c0b3a10 msgr2=0x7f518c0c7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:19.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.496+0000 7f5192b4d700 1 --2- 172.21.15.114:0/1077919936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f518c0b3a10 0x7f518c0c7a50 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f517800c4d0 tx=0x7f517800c890 comp rx=0 tx=0).stop 2023-10-18T12:21:19.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.496+0000 7f5192b4d700 1 -- 172.21.15.114:0/1077919936 shutdown_connections 2023-10-18T12:21:19.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.496+0000 7f5192b4d700 1 --2- 172.21.15.114:0/1077919936 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5170065720 0x7f5170067be0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:19.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.496+0000 7f5192b4d700 1 --2- 172.21.15.114:0/1077919936 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f518c15ae30 0x7f518c14a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:19.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.496+0000 7f5192b4d700 1 --2- 172.21.15.114:0/1077919936 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f518c0b3a10 0x7f518c0c7a50 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:19.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.496+0000 7f5192b4d700 1 --2- 172.21.15.114:0/1077919936 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f518c0b2400 0x7f518c1598a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:19.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.496+0000 7f5192b4d700 1 -- 172.21.15.114:0/1077919936 >> 172.21.15.114:0/1077919936 conn(0x7f518c0cd400 msgr2=0x7f518c158e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:19.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.496+0000 7f5192b4d700 1 -- 172.21.15.114:0/1077919936 shutdown_connections 2023-10-18T12:21:19.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.496+0000 7f5192b4d700 1 -- 172.21.15.114:0/1077919936 wait complete. 2023-10-18T12:21:19.507 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2023-10-18T12:21:19.525 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2023-10-18T12:21:18.990817+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":124,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221168,"kb_used_data":4984,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754753552,"statfs":{"total":773094113280,"available":772867637248,"internally_reserved":0,"allocated":5103616,"data_stored":2897336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001860"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.794179+0000","last_change":"2023-10-18T12:21:14.711625+0000","last_active":"2023-10-18T12:21:15.794179+0000","last_peered":"2023-10-18T12:21:15.794179+0000","last_clean":"2023-10-18T12:21:15.794179+0000","last_became_active":"2023-10-18T12:21:14.711325+0000","last_became_peered":"2023-10-18T12:21:14.711325+0000","last_unstale":"2023-10-18T12:21:15.794179+0000","last_undegraded":"2023-10-18T12:21:15.794179+0000","last_fullsized":"2023-10-18T12:21:15.794179+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:02:59.905455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.712997+0000","last_change":"2023-10-18T12:21:14.726072+0000","last_active":"2023-10-18T12:21:15.712997+0000","last_peered":"2023-10-18T12:21:15.712997+0000","last_clean":"2023-10-18T12:21:15.712997+0000","last_became_active":"2023-10-18T12:21:14.725813+0000","last_became_peered":"2023-10-18T12:21:14.725813+0000","last_unstale":"2023-10-18T12:21:15.712997+0000","last_undegraded":"2023-10-18T12:21:15.712997+0000","last_fullsized":"2023-10-18T12:21:15.712997+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:53:55.574132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.792769+0000","last_change":"2023-10-18T12:21:14.715764+0000","last_active":"2023-10-18T12:21:15.792769+0000","last_peered":"2023-10-18T12:21:15.792769+0000","last_clean":"2023-10-18T12:21:15.792769+0000","last_became_active":"2023-10-18T12:21:14.715495+0000","last_became_peered":"2023-10-18T12:21:14.715495+0000","last_unstale":"2023-10-18T12:21:15.792769+0000","last_undegraded":"2023-10-18T12:21:15.792769+0000","last_fullsized":"2023-10-18T12:21:15.792769+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:52:58.795948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.791690+0000","last_change":"2023-10-18T12:21:14.711792+0000","last_active":"2023-10-18T12:21:15.791690+0000","last_peered":"2023-10-18T12:21:15.791690+0000","last_clean":"2023-10-18T12:21:15.791690+0000","last_became_active":"2023-10-18T12:21:14.711514+0000","last_became_peered":"2023-10-18T12:21:14.711514+0000","last_unstale":"2023-10-18T12:21:15.791690+0000","last_undegraded":"2023-10-18T12:21:15.791690+0000","last_fullsized":"2023-10-18T12:21:15.791690+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:36:05.211321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.712321+0000","last_change":"2023-10-18T12:21:14.716899+0000","last_active":"2023-10-18T12:21:15.712321+0000","last_peered":"2023-10-18T12:21:15.712321+0000","last_clean":"2023-10-18T12:21:15.712321+0000","last_became_active":"2023-10-18T12:21:14.716639+0000","last_became_peered":"2023-10-18T12:21:14.716639+0000","last_unstale":"2023-10-18T12:21:15.712321+0000","last_undegraded":"2023-10-18T12:21:15.712321+0000","last_fullsized":"2023-10-18T12:21:15.712321+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:12:05.216829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.793841+0000","last_change":"2023-10-18T12:21:14.717011+0000","last_active":"2023-10-18T12:21:15.793841+0000","last_peered":"2023-10-18T12:21:15.793841+0000","last_clean":"2023-10-18T12:21:15.793841+0000","last_became_active":"2023-10-18T12:21:14.716778+0000","last_became_peered":"2023-10-18T12:21:14.716778+0000","last_unstale":"2023-10-18T12:21:15.793841+0000","last_undegraded":"2023-10-18T12:21:15.793841+0000","last_fullsized":"2023-10-18T12:21:15.793841+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:14:15.865730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.793522+0000","last_change":"2023-10-18T12:21:14.699582+0000","last_active":"2023-10-18T12:21:15.793522+0000","last_peered":"2023-10-18T12:21:15.793522+0000","last_clean":"2023-10-18T12:21:15.793522+0000","last_became_active":"2023-10-18T12:21:14.698065+0000","last_became_peered":"2023-10-18T12:21:14.698065+0000","last_unstale":"2023-10-18T12:21:15.793522+0000","last_undegraded":"2023-10-18T12:21:15.793522+0000","last_fullsized":"2023-10-18T12:21:15.793522+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:18:40.614445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.790585+0000","last_change":"2023-10-18T12:21:14.713127+0000","last_active":"2023-10-18T12:21:15.790585+0000","last_peered":"2023-10-18T12:21:15.790585+0000","last_clean":"2023-10-18T12:21:15.790585+0000","last_became_active":"2023-10-18T12:21:14.712858+0000","last_became_peered":"2023-10-18T12:21:14.712858+0000","last_unstale":"2023-10-18T12:21:15.790585+0000","last_undegraded":"2023-10-18T12:21:15.790585+0000","last_fullsized":"2023-10-18T12:21:15.790585+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:24:44.316310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.792710+0000","last_change":"2023-10-18T12:21:14.707068+0000","last_active":"2023-10-18T12:21:15.792710+0000","last_peered":"2023-10-18T12:21:15.792710+0000","last_clean":"2023-10-18T12:21:15.792710+0000","last_became_active":"2023-10-18T12:21:14.706807+0000","last_became_peered":"2023-10-18T12:21:14.706807+0000","last_unstale":"2023-10-18T12:21:15.792710+0000","last_undegraded":"2023-10-18T12:21:15.792710+0000","last_fullsized":"2023-10-18T12:21:15.792710+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:09:31.520396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.792831+0000","last_change":"2023-10-18T12:21:14.714899+0000","last_active":"2023-10-18T12:21:15.792831+0000","last_peered":"2023-10-18T12:21:15.792831+0000","last_clean":"2023-10-18T12:21:15.792831+0000","last_became_active":"2023-10-18T12:21:14.713092+0000","last_became_peered":"2023-10-18T12:21:14.713092+0000","last_unstale":"2023-10-18T12:21:15.792831+0000","last_undegraded":"2023-10-18T12:21:15.792831+0000","last_fullsized":"2023-10-18T12:21:15.792831+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:14:15.865730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.792558+0000","last_change":"2023-10-18T12:21:14.708224+0000","last_active":"2023-10-18T12:21:15.792558+0000","last_peered":"2023-10-18T12:21:15.792558+0000","last_clean":"2023-10-18T12:21:15.792558+0000","last_became_active":"2023-10-18T12:21:14.707942+0000","last_became_peered":"2023-10-18T12:21:14.707942+0000","last_unstale":"2023-10-18T12:21:15.792558+0000","last_undegraded":"2023-10-18T12:21:15.792558+0000","last_fullsized":"2023-10-18T12:21:15.792558+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:32:21.526596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.712551+0000","last_change":"2023-10-18T12:21:14.707771+0000","last_active":"2023-10-18T12:21:15.712551+0000","last_peered":"2023-10-18T12:21:15.712551+0000","last_clean":"2023-10-18T12:21:15.712551+0000","last_became_active":"2023-10-18T12:21:14.707054+0000","last_became_peered":"2023-10-18T12:21:14.707054+0000","last_unstale":"2023-10-18T12:21:15.712551+0000","last_undegraded":"2023-10-18T12:21:15.712551+0000","last_fullsized":"2023-10-18T12:21:15.712551+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:59:24.614145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.708175+0000","last_change":"2023-10-18T12:21:14.717459+0000","last_active":"2023-10-18T12:21:15.708175+0000","last_peered":"2023-10-18T12:21:15.708175+0000","last_clean":"2023-10-18T12:21:15.708175+0000","last_became_active":"2023-10-18T12:21:14.717186+0000","last_became_peered":"2023-10-18T12:21:14.717186+0000","last_unstale":"2023-10-18T12:21:15.708175+0000","last_undegraded":"2023-10-18T12:21:15.708175+0000","last_fullsized":"2023-10-18T12:21:15.708175+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:10:15.213138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.790824+0000","last_change":"2023-10-18T12:21:14.712005+0000","last_active":"2023-10-18T12:21:15.790824+0000","last_peered":"2023-10-18T12:21:15.790824+0000","last_clean":"2023-10-18T12:21:15.790824+0000","last_became_active":"2023-10-18T12:21:14.707594+0000","last_became_peered":"2023-10-18T12:21:14.707594+0000","last_unstale":"2023-10-18T12:21:15.790824+0000","last_undegraded":"2023-10-18T12:21:15.790824+0000","last_fullsized":"2023-10-18T12:21:15.790824+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:41:08.305349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.793173+0000","last_change":"2023-10-18T12:21:14.714008+0000","last_active":"2023-10-18T12:21:15.793173+0000","last_peered":"2023-10-18T12:21:15.793173+0000","last_clean":"2023-10-18T12:21:15.793173+0000","last_became_active":"2023-10-18T12:21:14.713688+0000","last_became_peered":"2023-10-18T12:21:14.713688+0000","last_unstale":"2023-10-18T12:21:15.793173+0000","last_undegraded":"2023-10-18T12:21:15.793173+0000","last_fullsized":"2023-10-18T12:21:15.793173+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:33:08.260645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.711985+0000","last_change":"2023-10-18T12:21:14.710294+0000","last_active":"2023-10-18T12:21:15.711985+0000","last_peered":"2023-10-18T12:21:15.711985+0000","last_clean":"2023-10-18T12:21:15.711985+0000","last_became_active":"2023-10-18T12:21:14.709998+0000","last_became_peered":"2023-10-18T12:21:14.709998+0000","last_unstale":"2023-10-18T12:21:15.711985+0000","last_undegraded":"2023-10-18T12:21:15.711985+0000","last_fullsized":"2023-10-18T12:21:15.711985+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:10:42.451120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.793505+0000","last_change":"2023-10-18T12:21:14.714166+0000","last_active":"2023-10-18T12:21:15.793505+0000","last_peered":"2023-10-18T12:21:15.793505+0000","last_clean":"2023-10-18T12:21:15.793505+0000","last_became_active":"2023-10-18T12:21:14.712787+0000","last_became_peered":"2023-10-18T12:21:14.712787+0000","last_unstale":"2023-10-18T12:21:15.793505+0000","last_undegraded":"2023-10-18T12:21:15.793505+0000","last_fullsized":"2023-10-18T12:21:15.793505+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:11:17.646077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.792018+0000","last_change":"2023-10-18T12:21:14.730802+0000","last_active":"2023-10-18T12:21:15.792018+0000","last_peered":"2023-10-18T12:21:15.792018+0000","last_clean":"2023-10-18T12:21:15.792018+0000","last_became_active":"2023-10-18T12:21:14.730477+0000","last_became_peered":"2023-10-18T12:21:14.730477+0000","last_unstale":"2023-10-18T12:21:15.792018+0000","last_undegraded":"2023-10-18T12:21:15.792018+0000","last_fullsized":"2023-10-18T12:21:15.792018+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:07:11.434836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.713956+0000","last_change":"2023-10-18T12:21:14.709244+0000","last_active":"2023-10-18T12:21:15.713956+0000","last_peered":"2023-10-18T12:21:15.713956+0000","last_clean":"2023-10-18T12:21:15.713956+0000","last_became_active":"2023-10-18T12:21:14.708968+0000","last_became_peered":"2023-10-18T12:21:14.708968+0000","last_unstale":"2023-10-18T12:21:15.713956+0000","last_undegraded":"2023-10-18T12:21:15.713956+0000","last_fullsized":"2023-10-18T12:21:15.713956+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:23:33.386168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.708403+0000","last_change":"2023-10-18T12:21:14.716990+0000","last_active":"2023-10-18T12:21:15.708403+0000","last_peered":"2023-10-18T12:21:15.708403+0000","last_clean":"2023-10-18T12:21:15.708403+0000","last_became_active":"2023-10-18T12:21:14.716745+0000","last_became_peered":"2023-10-18T12:21:14.716745+0000","last_unstale":"2023-10-18T12:21:15.708403+0000","last_undegraded":"2023-10-18T12:21:15.708403+0000","last_fullsized":"2023-10-18T12:21:15.708403+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:58:05.170854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.793476+0000","last_change":"2023-10-18T12:21:14.712987+0000","last_active":"2023-10-18T12:21:15.793476+0000","last_peered":"2023-10-18T12:21:15.793476+0000","last_clean":"2023-10-18T12:21:15.793476+0000","last_became_active":"2023-10-18T12:21:14.712710+0000","last_became_peered":"2023-10-18T12:21:14.712710+0000","last_unstale":"2023-10-18T12:21:15.793476+0000","last_undegraded":"2023-10-18T12:21:15.793476+0000","last_fullsized":"2023-10-18T12:21:15.793476+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:18:45.099541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.791384+0000","last_change":"2023-10-18T12:21:14.704679+0000","last_active":"2023-10-18T12:21:15.791384+0000","last_peered":"2023-10-18T12:21:15.791384+0000","last_clean":"2023-10-18T12:21:15.791384+0000","last_became_active":"2023-10-18T12:21:14.704444+0000","last_became_peered":"2023-10-18T12:21:14.704444+0000","last_unstale":"2023-10-18T12:21:15.791384+0000","last_undegraded":"2023-10-18T12:21:15.791384+0000","last_fullsized":"2023-10-18T12:21:15.791384+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:59:52.010102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.712439+0000","last_change":"2023-10-18T12:21:14.703034+0000","last_active":"2023-10-18T12:21:15.712439+0000","last_peered":"2023-10-18T12:21:15.712439+0000","last_clean":"2023-10-18T12:21:15.712439+0000","last_became_active":"2023-10-18T12:21:14.702704+0000","last_became_peered":"2023-10-18T12:21:14.702704+0000","last_unstale":"2023-10-18T12:21:15.712439+0000","last_undegraded":"2023-10-18T12:21:15.712439+0000","last_fullsized":"2023-10-18T12:21:15.712439+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:38:12.273279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.712175+0000","last_change":"2023-10-18T12:21:14.698897+0000","last_active":"2023-10-18T12:21:15.712175+0000","last_peered":"2023-10-18T12:21:15.712175+0000","last_clean":"2023-10-18T12:21:15.712175+0000","last_became_active":"2023-10-18T12:21:14.698553+0000","last_became_peered":"2023-10-18T12:21:14.698553+0000","last_unstale":"2023-10-18T12:21:15.712175+0000","last_undegraded":"2023-10-18T12:21:15.712175+0000","last_fullsized":"2023-10-18T12:21:15.712175+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:06:01.340883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.713398+0000","last_change":"2023-10-18T12:21:14.699554+0000","last_active":"2023-10-18T12:21:15.713398+0000","last_peered":"2023-10-18T12:21:15.713398+0000","last_clean":"2023-10-18T12:21:15.713398+0000","last_became_active":"2023-10-18T12:21:14.699215+0000","last_became_peered":"2023-10-18T12:21:14.699215+0000","last_unstale":"2023-10-18T12:21:15.713398+0000","last_undegraded":"2023-10-18T12:21:15.713398+0000","last_fullsized":"2023-10-18T12:21:15.713398+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:35:47.570739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.708573+0000","last_change":"2023-10-18T12:21:14.717903+0000","last_active":"2023-10-18T12:21:15.708573+0000","last_peered":"2023-10-18T12:21:15.708573+0000","last_clean":"2023-10-18T12:21:15.708573+0000","last_became_active":"2023-10-18T12:21:14.717633+0000","last_became_peered":"2023-10-18T12:21:14.717633+0000","last_unstale":"2023-10-18T12:21:15.708573+0000","last_undegraded":"2023-10-18T12:21:15.708573+0000","last_fullsized":"2023-10-18T12:21:15.708573+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:23:33.386168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.792699+0000","last_change":"2023-10-18T12:21:14.713795+0000","last_active":"2023-10-18T12:21:15.792699+0000","last_peered":"2023-10-18T12:21:15.792699+0000","last_clean":"2023-10-18T12:21:15.792699+0000","last_became_active":"2023-10-18T12:21:14.713029+0000","last_became_peered":"2023-10-18T12:21:14.713029+0000","last_unstale":"2023-10-18T12:21:15.792699+0000","last_undegraded":"2023-10-18T12:21:15.792699+0000","last_fullsized":"2023-10-18T12:21:15.792699+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:49:11.514362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.712710+0000","last_change":"2023-10-18T12:21:14.708007+0000","last_active":"2023-10-18T12:21:15.712710+0000","last_peered":"2023-10-18T12:21:15.712710+0000","last_clean":"2023-10-18T12:21:15.712710+0000","last_became_active":"2023-10-18T12:21:14.707508+0000","last_became_peered":"2023-10-18T12:21:14.707508+0000","last_unstale":"2023-10-18T12:21:15.712710+0000","last_undegraded":"2023-10-18T12:21:15.712710+0000","last_fullsized":"2023-10-18T12:21:15.712710+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:37:44.775289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.713232+0000","last_change":"2023-10-18T12:21:14.707532+0000","last_active":"2023-10-18T12:21:15.713232+0000","last_peered":"2023-10-18T12:21:15.713232+0000","last_clean":"2023-10-18T12:21:15.713232+0000","last_became_active":"2023-10-18T12:21:14.707206+0000","last_became_peered":"2023-10-18T12:21:14.707206+0000","last_unstale":"2023-10-18T12:21:15.713232+0000","last_undegraded":"2023-10-18T12:21:15.713232+0000","last_fullsized":"2023-10-18T12:21:15.713232+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:54:21.593930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.791831+0000","last_change":"2023-10-18T12:21:14.716831+0000","last_active":"2023-10-18T12:21:15.791831+0000","last_peered":"2023-10-18T12:21:15.791831+0000","last_clean":"2023-10-18T12:21:15.791831+0000","last_became_active":"2023-10-18T12:21:14.716557+0000","last_became_peered":"2023-10-18T12:21:14.716557+0000","last_unstale":"2023-10-18T12:21:15.791831+0000","last_undegraded":"2023-10-18T12:21:15.791831+0000","last_fullsized":"2023-10-18T12:21:15.791831+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:35:15.543811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.792904+0000","last_change":"2023-10-18T12:21:14.712168+0000","last_active":"2023-10-18T12:21:15.792904+0000","last_peered":"2023-10-18T12:21:15.792904+0000","last_clean":"2023-10-18T12:21:15.792904+0000","last_became_active":"2023-10-18T12:21:14.711896+0000","last_became_peered":"2023-10-18T12:21:14.711896+0000","last_unstale":"2023-10-18T12:21:15.792904+0000","last_undegraded":"2023-10-18T12:21:15.792904+0000","last_fullsized":"2023-10-18T12:21:15.792904+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:41:08.305349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.708474+0000","last_change":"2023-10-18T12:21:14.706987+0000","last_active":"2023-10-18T12:21:15.708474+0000","last_peered":"2023-10-18T12:21:15.708474+0000","last_clean":"2023-10-18T12:21:15.708474+0000","last_became_active":"2023-10-18T12:21:14.706530+0000","last_became_peered":"2023-10-18T12:21:14.706530+0000","last_unstale":"2023-10-18T12:21:15.708474+0000","last_undegraded":"2023-10-18T12:21:15.708474+0000","last_fullsized":"2023-10-18T12:21:15.708474+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:45:41.585698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.794192+0000","last_change":"2023-10-18T12:21:14.716552+0000","last_active":"2023-10-18T12:21:15.794192+0000","last_peered":"2023-10-18T12:21:15.794192+0000","last_clean":"2023-10-18T12:21:15.794192+0000","last_became_active":"2023-10-18T12:21:14.712473+0000","last_became_peered":"2023-10-18T12:21:14.712473+0000","last_unstale":"2023-10-18T12:21:15.794192+0000","last_undegraded":"2023-10-18T12:21:15.794192+0000","last_fullsized":"2023-10-18T12:21:15.794192+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:09:11.793777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"41'4","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.794333+0000","last_change":"2023-10-18T12:21:13.722747+0000","last_active":"2023-10-18T12:21:15.794333+0000","last_peered":"2023-10-18T12:21:15.794333+0000","last_clean":"2023-10-18T12:21:15.794333+0000","last_became_active":"2023-10-18T12:21:13.722468+0000","last_became_peered":"2023-10-18T12:21:13.722468+0000","last_unstale":"2023-10-18T12:21:15.794333+0000","last_undegraded":"2023-10-18T12:21:15.794333+0000","last_fullsized":"2023-10-18T12:21:15.794333+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:57:28.264324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.713506+0000","last_change":"2023-10-18T12:21:14.713063+0000","last_active":"2023-10-18T12:21:15.713506+0000","last_peered":"2023-10-18T12:21:15.713506+0000","last_clean":"2023-10-18T12:21:15.713506+0000","last_became_active":"2023-10-18T12:21:14.712768+0000","last_became_peered":"2023-10-18T12:21:14.712768+0000","last_unstale":"2023-10-18T12:21:15.713506+0000","last_undegraded":"2023-10-18T12:21:15.713506+0000","last_fullsized":"2023-10-18T12:21:15.713506+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:10:15.213138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.793204+0000","last_change":"2023-10-18T12:21:13.719651+0000","last_active":"2023-10-18T12:21:15.793204+0000","last_peered":"2023-10-18T12:21:15.793204+0000","last_clean":"2023-10-18T12:21:15.793204+0000","last_became_active":"2023-10-18T12:21:13.719343+0000","last_became_peered":"2023-10-18T12:21:13.719343+0000","last_unstale":"2023-10-18T12:21:15.793204+0000","last_undegraded":"2023-10-18T12:21:15.793204+0000","last_fullsized":"2023-10-18T12:21:15.793204+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:38:21.669610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.712958+0000","last_change":"2023-10-18T12:21:14.719609+0000","last_active":"2023-10-18T12:21:15.712958+0000","last_peered":"2023-10-18T12:21:15.712958+0000","last_clean":"2023-10-18T12:21:15.712958+0000","last_became_active":"2023-10-18T12:21:14.719279+0000","last_became_peered":"2023-10-18T12:21:14.719279+0000","last_unstale":"2023-10-18T12:21:15.712958+0000","last_undegraded":"2023-10-18T12:21:15.712958+0000","last_fullsized":"2023-10-18T12:21:15.712958+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:58:17.629532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.794298+0000","last_change":"2023-10-18T12:21:13.710549+0000","last_active":"2023-10-18T12:21:15.794298+0000","last_peered":"2023-10-18T12:21:15.794298+0000","last_clean":"2023-10-18T12:21:15.794298+0000","last_became_active":"2023-10-18T12:21:13.710283+0000","last_became_peered":"2023-10-18T12:21:13.710283+0000","last_unstale":"2023-10-18T12:21:15.794298+0000","last_undegraded":"2023-10-18T12:21:15.794298+0000","last_fullsized":"2023-10-18T12:21:15.794298+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:50:15.684641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.794192+0000","last_change":"2023-10-18T12:21:14.704497+0000","last_active":"2023-10-18T12:21:15.794192+0000","last_peered":"2023-10-18T12:21:15.794192+0000","last_clean":"2023-10-18T12:21:15.794192+0000","last_became_active":"2023-10-18T12:21:14.704206+0000","last_became_peered":"2023-10-18T12:21:14.704206+0000","last_unstale":"2023-10-18T12:21:15.794192+0000","last_undegraded":"2023-10-18T12:21:15.794192+0000","last_fullsized":"2023-10-18T12:21:15.794192+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:41:08.305349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.793589+0000","last_change":"2023-10-18T12:21:13.711499+0000","last_active":"2023-10-18T12:21:15.793589+0000","last_peered":"2023-10-18T12:21:15.793589+0000","last_clean":"2023-10-18T12:21:15.793589+0000","last_became_active":"2023-10-18T12:21:13.711215+0000","last_became_peered":"2023-10-18T12:21:13.711215+0000","last_unstale":"2023-10-18T12:21:15.793589+0000","last_undegraded":"2023-10-18T12:21:15.793589+0000","last_fullsized":"2023-10-18T12:21:15.793589+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:45:56.656581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.792128+0000","last_change":"2023-10-18T12:21:14.714614+0000","last_active":"2023-10-18T12:21:15.792128+0000","last_peered":"2023-10-18T12:21:15.792128+0000","last_clean":"2023-10-18T12:21:15.792128+0000","last_became_active":"2023-10-18T12:21:14.714297+0000","last_became_peered":"2023-10-18T12:21:14.714297+0000","last_unstale":"2023-10-18T12:21:15.792128+0000","last_undegraded":"2023-10-18T12:21:15.792128+0000","last_fullsized":"2023-10-18T12:21:15.792128+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:23:24.350887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.793548+0000","last_change":"2023-10-18T12:21:13.703003+0000","last_active":"2023-10-18T12:21:15.793548+0000","last_peered":"2023-10-18T12:21:15.793548+0000","last_clean":"2023-10-18T12:21:15.793548+0000","last_became_active":"2023-10-18T12:21:13.702683+0000","last_became_peered":"2023-10-18T12:21:13.702683+0000","last_unstale":"2023-10-18T12:21:15.793548+0000","last_undegraded":"2023-10-18T12:21:15.793548+0000","last_fullsized":"2023-10-18T12:21:15.793548+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:36:04.194581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.791476+0000","last_change":"2023-10-18T12:21:14.710812+0000","last_active":"2023-10-18T12:21:15.791476+0000","last_peered":"2023-10-18T12:21:15.791476+0000","last_clean":"2023-10-18T12:21:15.791476+0000","last_became_active":"2023-10-18T12:21:14.710529+0000","last_became_peered":"2023-10-18T12:21:14.710529+0000","last_unstale":"2023-10-18T12:21:15.791476+0000","last_undegraded":"2023-10-18T12:21:15.791476+0000","last_fullsized":"2023-10-18T12:21:15.791476+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:18:45.099541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.792435+0000","last_change":"2023-10-18T12:21:13.711064+0000","last_active":"2023-10-18T12:21:15.792435+0000","last_peered":"2023-10-18T12:21:15.792435+0000","last_clean":"2023-10-18T12:21:15.792435+0000","last_became_active":"2023-10-18T12:21:13.710838+0000","last_became_peered":"2023-10-18T12:21:13.710838+0000","last_unstale":"2023-10-18T12:21:15.792435+0000","last_undegraded":"2023-10-18T12:21:15.792435+0000","last_fullsized":"2023-10-18T12:21:15.792435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:40:02.271172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.790703+0000","last_change":"2023-10-18T12:21:14.701670+0000","last_active":"2023-10-18T12:21:15.790703+0000","last_peered":"2023-10-18T12:21:15.790703+0000","last_clean":"2023-10-18T12:21:15.790703+0000","last_became_active":"2023-10-18T12:21:14.701381+0000","last_became_peered":"2023-10-18T12:21:14.701381+0000","last_unstale":"2023-10-18T12:21:15.790703+0000","last_undegraded":"2023-10-18T12:21:15.790703+0000","last_fullsized":"2023-10-18T12:21:15.790703+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:23:09.048069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.711804+0000","last_change":"2023-10-18T12:21:13.717228+0000","last_active":"2023-10-18T12:21:15.711804+0000","last_peered":"2023-10-18T12:21:15.711804+0000","last_clean":"2023-10-18T12:21:15.711804+0000","last_became_active":"2023-10-18T12:21:13.716740+0000","last_became_peered":"2023-10-18T12:21:13.716740+0000","last_unstale":"2023-10-18T12:21:15.711804+0000","last_undegraded":"2023-10-18T12:21:15.711804+0000","last_fullsized":"2023-10-18T12:21:15.711804+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:09:30.503656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.712152+0000","last_change":"2023-10-18T12:21:14.702754+0000","last_active":"2023-10-18T12:21:15.712152+0000","last_peered":"2023-10-18T12:21:15.712152+0000","last_clean":"2023-10-18T12:21:15.712152+0000","last_became_active":"2023-10-18T12:21:14.702400+0000","last_became_peered":"2023-10-18T12:21:14.702400+0000","last_unstale":"2023-10-18T12:21:15.712152+0000","last_undegraded":"2023-10-18T12:21:15.712152+0000","last_fullsized":"2023-10-18T12:21:15.712152+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:20:46.875279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.790818+0000","last_change":"2023-10-18T12:21:13.719042+0000","last_active":"2023-10-18T12:21:15.790818+0000","last_peered":"2023-10-18T12:21:15.790818+0000","last_clean":"2023-10-18T12:21:15.790818+0000","last_became_active":"2023-10-18T12:21:13.718736+0000","last_became_peered":"2023-10-18T12:21:13.718736+0000","last_unstale":"2023-10-18T12:21:15.790818+0000","last_undegraded":"2023-10-18T12:21:15.790818+0000","last_fullsized":"2023-10-18T12:21:15.790818+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:09:10.777038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.792352+0000","last_change":"2023-10-18T12:21:14.726231+0000","last_active":"2023-10-18T12:21:15.792352+0000","last_peered":"2023-10-18T12:21:15.792352+0000","last_clean":"2023-10-18T12:21:15.792352+0000","last_became_active":"2023-10-18T12:21:14.725956+0000","last_became_peered":"2023-10-18T12:21:14.725956+0000","last_unstale":"2023-10-18T12:21:15.792352+0000","last_undegraded":"2023-10-18T12:21:15.792352+0000","last_fullsized":"2023-10-18T12:21:15.792352+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:08:52.304755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.794117+0000","last_change":"2023-10-18T12:21:13.712963+0000","last_active":"2023-10-18T12:21:15.794117+0000","last_peered":"2023-10-18T12:21:15.794117+0000","last_clean":"2023-10-18T12:21:15.794117+0000","last_became_active":"2023-10-18T12:21:13.712614+0000","last_became_peered":"2023-10-18T12:21:13.712614+0000","last_unstale":"2023-10-18T12:21:15.794117+0000","last_undegraded":"2023-10-18T12:21:15.794117+0000","last_fullsized":"2023-10-18T12:21:15.794117+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:04:24.463949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.794242+0000","last_change":"2023-10-18T12:21:14.710001+0000","last_active":"2023-10-18T12:21:15.794242+0000","last_peered":"2023-10-18T12:21:15.794242+0000","last_clean":"2023-10-18T12:21:15.794242+0000","last_became_active":"2023-10-18T12:21:14.709695+0000","last_became_peered":"2023-10-18T12:21:14.709695+0000","last_unstale":"2023-10-18T12:21:15.794242+0000","last_undegraded":"2023-10-18T12:21:15.794242+0000","last_fullsized":"2023-10-18T12:21:15.794242+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T00:09:22.477529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.793041+0000","last_change":"2023-10-18T12:21:13.716847+0000","last_active":"2023-10-18T12:21:15.793041+0000","last_peered":"2023-10-18T12:21:15.793041+0000","last_clean":"2023-10-18T12:21:15.793041+0000","last_became_active":"2023-10-18T12:21:13.716534+0000","last_became_peered":"2023-10-18T12:21:13.716534+0000","last_unstale":"2023-10-18T12:21:15.793041+0000","last_undegraded":"2023-10-18T12:21:15.793041+0000","last_fullsized":"2023-10-18T12:21:15.793041+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:57:28.264324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.793805+0000","last_change":"2023-10-18T12:21:14.721226+0000","last_active":"2023-10-18T12:21:15.793805+0000","last_peered":"2023-10-18T12:21:15.793805+0000","last_clean":"2023-10-18T12:21:15.793805+0000","last_became_active":"2023-10-18T12:21:14.720945+0000","last_became_peered":"2023-10-18T12:21:14.720945+0000","last_unstale":"2023-10-18T12:21:15.793805+0000","last_undegraded":"2023-10-18T12:21:15.793805+0000","last_fullsized":"2023-10-18T12:21:15.793805+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:26:37.012525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"41'3","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.793970+0000","last_change":"2023-10-18T12:21:13.714197+0000","last_active":"2023-10-18T12:21:15.793970+0000","last_peered":"2023-10-18T12:21:15.793970+0000","last_clean":"2023-10-18T12:21:15.793970+0000","last_became_active":"2023-10-18T12:21:13.713911+0000","last_became_peered":"2023-10-18T12:21:13.713911+0000","last_unstale":"2023-10-18T12:21:15.793970+0000","last_undegraded":"2023-10-18T12:21:15.793970+0000","last_fullsized":"2023-10-18T12:21:15.793970+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:59:28.242859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.793596+0000","last_change":"2023-10-18T12:21:14.707335+0000","last_active":"2023-10-18T12:21:15.793596+0000","last_peered":"2023-10-18T12:21:15.793596+0000","last_clean":"2023-10-18T12:21:15.793596+0000","last_became_active":"2023-10-18T12:21:14.700661+0000","last_became_peered":"2023-10-18T12:21:14.700661+0000","last_unstale":"2023-10-18T12:21:15.793596+0000","last_undegraded":"2023-10-18T12:21:15.793596+0000","last_fullsized":"2023-10-18T12:21:15.793596+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:06:23.701187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"41'6","reported_seq":19,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.708459+0000","last_change":"2023-10-18T12:21:13.711744+0000","last_active":"2023-10-18T12:21:15.708459+0000","last_peered":"2023-10-18T12:21:15.708459+0000","last_clean":"2023-10-18T12:21:15.708459+0000","last_became_active":"2023-10-18T12:21:13.711425+0000","last_became_peered":"2023-10-18T12:21:13.711425+0000","last_unstale":"2023-10-18T12:21:15.708459+0000","last_undegraded":"2023-10-18T12:21:15.708459+0000","last_fullsized":"2023-10-18T12:21:15.708459+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:47:37.583153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.713170+0000","last_change":"2023-10-18T12:21:14.710452+0000","last_active":"2023-10-18T12:21:15.713170+0000","last_peered":"2023-10-18T12:21:15.713170+0000","last_clean":"2023-10-18T12:21:15.713170+0000","last_became_active":"2023-10-18T12:21:14.709653+0000","last_became_peered":"2023-10-18T12:21:14.709653+0000","last_unstale":"2023-10-18T12:21:15.713170+0000","last_undegraded":"2023-10-18T12:21:15.713170+0000","last_fullsized":"2023-10-18T12:21:15.713170+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:11:43.048930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.793801+0000","last_change":"2023-10-18T12:21:13.717949+0000","last_active":"2023-10-18T12:21:15.793801+0000","last_peered":"2023-10-18T12:21:15.793801+0000","last_clean":"2023-10-18T12:21:15.793801+0000","last_became_active":"2023-10-18T12:21:13.717210+0000","last_became_peered":"2023-10-18T12:21:13.717210+0000","last_unstale":"2023-10-18T12:21:15.793801+0000","last_undegraded":"2023-10-18T12:21:15.793801+0000","last_fullsized":"2023-10-18T12:21:15.793801+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:13:21.388682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.791705+0000","last_change":"2023-10-18T12:21:14.714366+0000","last_active":"2023-10-18T12:21:15.791705+0000","last_peered":"2023-10-18T12:21:15.791705+0000","last_clean":"2023-10-18T12:21:15.791705+0000","last_became_active":"2023-10-18T12:21:14.714039+0000","last_became_peered":"2023-10-18T12:21:14.714039+0000","last_unstale":"2023-10-18T12:21:15.791705+0000","last_undegraded":"2023-10-18T12:21:15.791705+0000","last_fullsized":"2023-10-18T12:21:15.791705+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:13:22.405422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.793274+0000","last_change":"2023-10-18T12:21:13.708296+0000","last_active":"2023-10-18T12:21:15.793274+0000","last_peered":"2023-10-18T12:21:15.793274+0000","last_clean":"2023-10-18T12:21:15.793274+0000","last_became_active":"2023-10-18T12:21:13.708012+0000","last_became_peered":"2023-10-18T12:21:13.708012+0000","last_unstale":"2023-10-18T12:21:15.793274+0000","last_undegraded":"2023-10-18T12:21:15.793274+0000","last_fullsized":"2023-10-18T12:21:15.793274+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:20:45.240198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.791945+0000","last_change":"2023-10-18T12:21:14.708891+0000","last_active":"2023-10-18T12:21:15.791945+0000","last_peered":"2023-10-18T12:21:15.791945+0000","last_clean":"2023-10-18T12:21:15.791945+0000","last_became_active":"2023-10-18T12:21:14.707139+0000","last_became_peered":"2023-10-18T12:21:14.707139+0000","last_unstale":"2023-10-18T12:21:15.791945+0000","last_undegraded":"2023-10-18T12:21:15.791945+0000","last_fullsized":"2023-10-18T12:21:15.791945+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:09:11.793777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.793153+0000","last_change":"2023-10-18T12:21:13.718771+0000","last_active":"2023-10-18T12:21:15.793153+0000","last_peered":"2023-10-18T12:21:15.793153+0000","last_clean":"2023-10-18T12:21:15.793153+0000","last_became_active":"2023-10-18T12:21:13.716214+0000","last_became_peered":"2023-10-18T12:21:13.716214+0000","last_unstale":"2023-10-18T12:21:15.793153+0000","last_undegraded":"2023-10-18T12:21:15.793153+0000","last_fullsized":"2023-10-18T12:21:15.793153+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:50:15.684641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.793219+0000","last_change":"2023-10-18T12:21:14.706251+0000","last_active":"2023-10-18T12:21:15.793219+0000","last_peered":"2023-10-18T12:21:15.793219+0000","last_clean":"2023-10-18T12:21:15.793219+0000","last_became_active":"2023-10-18T12:21:14.705958+0000","last_became_peered":"2023-10-18T12:21:14.705958+0000","last_unstale":"2023-10-18T12:21:15.793219+0000","last_undegraded":"2023-10-18T12:21:15.793219+0000","last_fullsized":"2023-10-18T12:21:15.793219+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:07:51.246337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"41'8","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.790998+0000","last_change":"2023-10-18T12:21:13.716060+0000","last_active":"2023-10-18T12:21:15.790998+0000","last_peered":"2023-10-18T12:21:15.790998+0000","last_clean":"2023-10-18T12:21:15.790998+0000","last_became_active":"2023-10-18T12:21:13.715753+0000","last_became_peered":"2023-10-18T12:21:13.715753+0000","last_unstale":"2023-10-18T12:21:15.790998+0000","last_undegraded":"2023-10-18T12:21:15.790998+0000","last_fullsized":"2023-10-18T12:21:15.790998+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:50:15.684641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.708533+0000","last_change":"2023-10-18T12:21:14.714964+0000","last_active":"2023-10-18T12:21:15.708533+0000","last_peered":"2023-10-18T12:21:15.708533+0000","last_clean":"2023-10-18T12:21:15.708533+0000","last_became_active":"2023-10-18T12:21:14.714729+0000","last_became_peered":"2023-10-18T12:21:14.714729+0000","last_unstale":"2023-10-18T12:21:15.708533+0000","last_undegraded":"2023-10-18T12:21:15.708533+0000","last_fullsized":"2023-10-18T12:21:15.708533+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:41:48.801523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.708670+0000","last_change":"2023-10-18T12:21:13.709563+0000","last_active":"2023-10-18T12:21:15.708670+0000","last_peered":"2023-10-18T12:21:15.708670+0000","last_clean":"2023-10-18T12:21:15.708670+0000","last_became_active":"2023-10-18T12:21:13.709298+0000","last_became_peered":"2023-10-18T12:21:13.709298+0000","last_unstale":"2023-10-18T12:21:15.708670+0000","last_undegraded":"2023-10-18T12:21:15.708670+0000","last_fullsized":"2023-10-18T12:21:15.708670+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:22:33.398543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.792922+0000","last_change":"2023-10-18T12:21:14.716556+0000","last_active":"2023-10-18T12:21:15.792922+0000","last_peered":"2023-10-18T12:21:15.792922+0000","last_clean":"2023-10-18T12:21:15.792922+0000","last_became_active":"2023-10-18T12:21:14.716301+0000","last_became_peered":"2023-10-18T12:21:14.716301+0000","last_unstale":"2023-10-18T12:21:15.792922+0000","last_undegraded":"2023-10-18T12:21:15.792922+0000","last_fullsized":"2023-10-18T12:21:15.792922+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:27:52.176270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.793224+0000","last_change":"2023-10-18T12:21:13.709445+0000","last_active":"2023-10-18T12:21:15.793224+0000","last_peered":"2023-10-18T12:21:15.793224+0000","last_clean":"2023-10-18T12:21:15.793224+0000","last_became_active":"2023-10-18T12:21:13.708550+0000","last_became_peered":"2023-10-18T12:21:13.708550+0000","last_unstale":"2023-10-18T12:21:15.793224+0000","last_undegraded":"2023-10-18T12:21:15.793224+0000","last_fullsized":"2023-10-18T12:21:15.793224+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:21:38.442219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.713752+0000","last_change":"2023-10-18T12:21:14.720095+0000","last_active":"2023-10-18T12:21:15.713752+0000","last_peered":"2023-10-18T12:21:15.713752+0000","last_clean":"2023-10-18T12:21:15.713752+0000","last_became_active":"2023-10-18T12:21:14.719774+0000","last_became_peered":"2023-10-18T12:21:14.719774+0000","last_unstale":"2023-10-18T12:21:15.713752+0000","last_undegraded":"2023-10-18T12:21:15.713752+0000","last_fullsized":"2023-10-18T12:21:15.713752+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:45:41.585698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.712850+0000","last_change":"2023-10-18T12:21:13.717034+0000","last_active":"2023-10-18T12:21:15.712850+0000","last_peered":"2023-10-18T12:21:15.712850+0000","last_clean":"2023-10-18T12:21:15.712850+0000","last_became_active":"2023-10-18T12:21:13.716260+0000","last_became_peered":"2023-10-18T12:21:13.716260+0000","last_unstale":"2023-10-18T12:21:15.712850+0000","last_undegraded":"2023-10-18T12:21:15.712850+0000","last_fullsized":"2023-10-18T12:21:15.712850+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:48:10.359080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.713652+0000","last_change":"2023-10-18T12:21:14.707803+0000","last_active":"2023-10-18T12:21:15.713652+0000","last_peered":"2023-10-18T12:21:15.713652+0000","last_clean":"2023-10-18T12:21:15.713652+0000","last_became_active":"2023-10-18T12:21:14.707542+0000","last_became_peered":"2023-10-18T12:21:14.707542+0000","last_unstale":"2023-10-18T12:21:15.713652+0000","last_undegraded":"2023-10-18T12:21:15.713652+0000","last_fullsized":"2023-10-18T12:21:15.713652+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:58:05.170854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.794501+0000","last_change":"2023-10-18T12:21:13.714580+0000","last_active":"2023-10-18T12:21:15.794501+0000","last_peered":"2023-10-18T12:21:15.794501+0000","last_clean":"2023-10-18T12:21:15.794501+0000","last_became_active":"2023-10-18T12:21:13.714309+0000","last_became_peered":"2023-10-18T12:21:13.714309+0000","last_unstale":"2023-10-18T12:21:15.794501+0000","last_undegraded":"2023-10-18T12:21:15.794501+0000","last_fullsized":"2023-10-18T12:21:15.794501+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:59:23.597405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.794119+0000","last_change":"2023-10-18T12:21:14.715432+0000","last_active":"2023-10-18T12:21:15.794119+0000","last_peered":"2023-10-18T12:21:15.794119+0000","last_clean":"2023-10-18T12:21:15.794119+0000","last_became_active":"2023-10-18T12:21:14.715213+0000","last_became_peered":"2023-10-18T12:21:14.715213+0000","last_unstale":"2023-10-18T12:21:15.794119+0000","last_undegraded":"2023-10-18T12:21:15.794119+0000","last_fullsized":"2023-10-18T12:21:15.794119+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:12:05.216829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.793796+0000","last_change":"2023-10-18T12:21:13.703485+0000","last_active":"2023-10-18T12:21:15.793796+0000","last_peered":"2023-10-18T12:21:15.793796+0000","last_clean":"2023-10-18T12:21:15.793796+0000","last_became_active":"2023-10-18T12:21:13.702672+0000","last_became_peered":"2023-10-18T12:21:13.702672+0000","last_unstale":"2023-10-18T12:21:15.793796+0000","last_undegraded":"2023-10-18T12:21:15.793796+0000","last_fullsized":"2023-10-18T12:21:15.793796+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:09:30.503656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.791515+0000","last_change":"2023-10-18T12:21:14.710347+0000","last_active":"2023-10-18T12:21:15.791515+0000","last_peered":"2023-10-18T12:21:15.791515+0000","last_clean":"2023-10-18T12:21:15.791515+0000","last_became_active":"2023-10-18T12:21:14.710063+0000","last_became_peered":"2023-10-18T12:21:14.710063+0000","last_unstale":"2023-10-18T12:21:15.791515+0000","last_undegraded":"2023-10-18T12:21:15.791515+0000","last_fullsized":"2023-10-18T12:21:15.791515+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:05:50.458001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.712136+0000","last_change":"2023-10-18T12:21:13.719310+0000","last_active":"2023-10-18T12:21:15.712136+0000","last_peered":"2023-10-18T12:21:15.712136+0000","last_clean":"2023-10-18T12:21:15.712136+0000","last_became_active":"2023-10-18T12:21:13.719050+0000","last_became_peered":"2023-10-18T12:21:13.719050+0000","last_unstale":"2023-10-18T12:21:15.712136+0000","last_undegraded":"2023-10-18T12:21:15.712136+0000","last_fullsized":"2023-10-18T12:21:15.712136+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:14:14.848990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.708090+0000","last_change":"2023-10-18T12:21:14.713852+0000","last_active":"2023-10-18T12:21:15.708090+0000","last_peered":"2023-10-18T12:21:15.708090+0000","last_clean":"2023-10-18T12:21:15.708090+0000","last_became_active":"2023-10-18T12:21:14.713488+0000","last_became_peered":"2023-10-18T12:21:14.713488+0000","last_unstale":"2023-10-18T12:21:15.708090+0000","last_undegraded":"2023-10-18T12:21:15.708090+0000","last_fullsized":"2023-10-18T12:21:15.708090+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:35:47.570739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.790508+0000","last_change":"2023-10-18T12:21:13.716351+0000","last_active":"2023-10-18T12:21:15.790508+0000","last_peered":"2023-10-18T12:21:15.790508+0000","last_clean":"2023-10-18T12:21:15.790508+0000","last_became_active":"2023-10-18T12:21:13.716009+0000","last_became_peered":"2023-10-18T12:21:13.716009+0000","last_unstale":"2023-10-18T12:21:15.790508+0000","last_undegraded":"2023-10-18T12:21:15.790508+0000","last_fullsized":"2023-10-18T12:21:15.790508+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:05:49.441261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.790467+0000","last_change":"2023-10-18T12:21:14.708309+0000","last_active":"2023-10-18T12:21:15.790467+0000","last_peered":"2023-10-18T12:21:15.790467+0000","last_clean":"2023-10-18T12:21:15.790467+0000","last_became_active":"2023-10-18T12:21:14.708045+0000","last_became_peered":"2023-10-18T12:21:14.708045+0000","last_unstale":"2023-10-18T12:21:15.790467+0000","last_undegraded":"2023-10-18T12:21:15.790467+0000","last_fullsized":"2023-10-18T12:21:15.790467+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:20:29.310044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.791697+0000","last_change":"2023-10-18T12:21:13.711075+0000","last_active":"2023-10-18T12:21:15.791697+0000","last_peered":"2023-10-18T12:21:15.791697+0000","last_clean":"2023-10-18T12:21:15.791697+0000","last_became_active":"2023-10-18T12:21:13.710821+0000","last_became_peered":"2023-10-18T12:21:13.710821+0000","last_unstale":"2023-10-18T12:21:15.791697+0000","last_undegraded":"2023-10-18T12:21:15.791697+0000","last_fullsized":"2023-10-18T12:21:15.791697+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:58:16.612792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.794035+0000","last_change":"2023-10-18T12:21:14.715857+0000","last_active":"2023-10-18T12:21:15.794035+0000","last_peered":"2023-10-18T12:21:15.794035+0000","last_clean":"2023-10-18T12:21:15.794035+0000","last_became_active":"2023-10-18T12:21:14.715646+0000","last_became_peered":"2023-10-18T12:21:14.715646+0000","last_unstale":"2023-10-18T12:21:15.794035+0000","last_undegraded":"2023-10-18T12:21:15.794035+0000","last_fullsized":"2023-10-18T12:21:15.794035+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:27:52.176270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.793965+0000","last_change":"2023-10-18T12:21:13.716478+0000","last_active":"2023-10-18T12:21:15.793965+0000","last_peered":"2023-10-18T12:21:15.793965+0000","last_clean":"2023-10-18T12:21:15.793965+0000","last_became_active":"2023-10-18T12:21:13.716170+0000","last_became_peered":"2023-10-18T12:21:13.716170+0000","last_unstale":"2023-10-18T12:21:15.793965+0000","last_undegraded":"2023-10-18T12:21:15.793965+0000","last_fullsized":"2023-10-18T12:21:15.793965+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:05:38.324058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.713719+0000","last_change":"2023-10-18T12:19:33.531672+0000","last_active":"2023-10-18T12:21:15.713719+0000","last_peered":"2023-10-18T12:21:15.713719+0000","last_clean":"2023-10-18T12:21:15.713719+0000","last_became_active":"2023-10-18T12:19:33.530907+0000","last_became_peered":"2023-10-18T12:19:33.530907+0000","last_unstale":"2023-10-18T12:21:15.713719+0000","last_undegraded":"2023-10-18T12:21:15.713719+0000","last_fullsized":"2023-10-18T12:21:15.713719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:40:07.626026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.793407+0000","last_change":"2023-10-18T12:21:14.710107+0000","last_active":"2023-10-18T12:21:15.793407+0000","last_peered":"2023-10-18T12:21:15.793407+0000","last_clean":"2023-10-18T12:21:15.793407+0000","last_became_active":"2023-10-18T12:21:14.709854+0000","last_became_peered":"2023-10-18T12:21:14.709854+0000","last_unstale":"2023-10-18T12:21:15.793407+0000","last_undegraded":"2023-10-18T12:21:15.793407+0000","last_fullsized":"2023-10-18T12:21:15.793407+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:59:52.010102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.792651+0000","last_change":"2023-10-18T12:21:13.713083+0000","last_active":"2023-10-18T12:21:15.792651+0000","last_peered":"2023-10-18T12:21:15.792651+0000","last_clean":"2023-10-18T12:21:15.792651+0000","last_became_active":"2023-10-18T12:21:13.712819+0000","last_became_peered":"2023-10-18T12:21:13.712819+0000","last_unstale":"2023-10-18T12:21:15.792651+0000","last_undegraded":"2023-10-18T12:21:15.792651+0000","last_fullsized":"2023-10-18T12:21:15.792651+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:23:26.731434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.794318+0000","last_change":"2023-10-18T12:19:33.529329+0000","last_active":"2023-10-18T12:21:15.794318+0000","last_peered":"2023-10-18T12:21:15.794318+0000","last_clean":"2023-10-18T12:21:15.794318+0000","last_became_active":"2023-10-18T12:19:33.528930+0000","last_became_peered":"2023-10-18T12:19:33.528930+0000","last_unstale":"2023-10-18T12:21:15.794318+0000","last_undegraded":"2023-10-18T12:21:15.794318+0000","last_fullsized":"2023-10-18T12:21:15.794318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:31:27.085147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.711666+0000","last_change":"2023-10-18T12:21:14.710912+0000","last_active":"2023-10-18T12:21:15.711666+0000","last_peered":"2023-10-18T12:21:15.711666+0000","last_clean":"2023-10-18T12:21:15.711666+0000","last_became_active":"2023-10-18T12:21:14.710617+0000","last_became_peered":"2023-10-18T12:21:14.710617+0000","last_unstale":"2023-10-18T12:21:15.711666+0000","last_undegraded":"2023-10-18T12:21:15.711666+0000","last_fullsized":"2023-10-18T12:21:15.711666+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:32:21.526596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.791369+0000","last_change":"2023-10-18T12:21:13.717072+0000","last_active":"2023-10-18T12:21:15.791369+0000","last_peered":"2023-10-18T12:21:15.791369+0000","last_clean":"2023-10-18T12:21:15.791369+0000","last_became_active":"2023-10-18T12:21:13.716720+0000","last_became_peered":"2023-10-18T12:21:13.716720+0000","last_unstale":"2023-10-18T12:21:15.791369+0000","last_undegraded":"2023-10-18T12:21:15.791369+0000","last_fullsized":"2023-10-18T12:21:15.791369+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:20:28.293304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.794080+0000","last_change":"2023-10-18T12:19:33.703565+0000","last_active":"2023-10-18T12:21:15.794080+0000","last_peered":"2023-10-18T12:21:15.794080+0000","last_clean":"2023-10-18T12:21:15.794080+0000","last_became_active":"2023-10-18T12:19:33.703276+0000","last_became_peered":"2023-10-18T12:19:33.703276+0000","last_unstale":"2023-10-18T12:21:15.794080+0000","last_undegraded":"2023-10-18T12:21:15.794080+0000","last_fullsized":"2023-10-18T12:21:15.794080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:19:43.178687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.792054+0000","last_change":"2023-10-18T12:21:14.718693+0000","last_active":"2023-10-18T12:21:15.792054+0000","last_peered":"2023-10-18T12:21:15.792054+0000","last_clean":"2023-10-18T12:21:15.792054+0000","last_became_active":"2023-10-18T12:21:14.718393+0000","last_became_peered":"2023-10-18T12:21:14.718393+0000","last_unstale":"2023-10-18T12:21:15.792054+0000","last_undegraded":"2023-10-18T12:21:15.792054+0000","last_fullsized":"2023-10-18T12:21:15.792054+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:24:39.208983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.791015+0000","last_change":"2023-10-18T12:21:13.715068+0000","last_active":"2023-10-18T12:21:15.791015+0000","last_peered":"2023-10-18T12:21:15.791015+0000","last_clean":"2023-10-18T12:21:15.791015+0000","last_became_active":"2023-10-18T12:21:13.714662+0000","last_became_peered":"2023-10-18T12:21:13.714662+0000","last_unstale":"2023-10-18T12:21:15.791015+0000","last_undegraded":"2023-10-18T12:21:15.791015+0000","last_fullsized":"2023-10-18T12:21:15.791015+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:33:07.243905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.791974+0000","last_change":"2023-10-18T12:19:33.703109+0000","last_active":"2023-10-18T12:21:15.791974+0000","last_peered":"2023-10-18T12:21:15.791974+0000","last_clean":"2023-10-18T12:21:15.791974+0000","last_became_active":"2023-10-18T12:19:33.702456+0000","last_became_peered":"2023-10-18T12:19:33.702456+0000","last_unstale":"2023-10-18T12:21:15.791974+0000","last_undegraded":"2023-10-18T12:21:15.791974+0000","last_fullsized":"2023-10-18T12:21:15.791974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:21:27.872572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.713673+0000","last_change":"2023-10-18T12:21:14.711788+0000","last_active":"2023-10-18T12:21:15.713673+0000","last_peered":"2023-10-18T12:21:15.713673+0000","last_clean":"2023-10-18T12:21:15.713673+0000","last_became_active":"2023-10-18T12:21:14.709751+0000","last_became_peered":"2023-10-18T12:21:14.709751+0000","last_unstale":"2023-10-18T12:21:15.713673+0000","last_undegraded":"2023-10-18T12:21:15.713673+0000","last_fullsized":"2023-10-18T12:21:15.713673+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:47:38.599893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.793807+0000","last_change":"2023-10-18T12:21:13.704226+0000","last_active":"2023-10-18T12:21:15.793807+0000","last_peered":"2023-10-18T12:21:15.793807+0000","last_clean":"2023-10-18T12:21:15.793807+0000","last_became_active":"2023-10-18T12:21:13.703989+0000","last_became_peered":"2023-10-18T12:21:13.703989+0000","last_unstale":"2023-10-18T12:21:15.793807+0000","last_undegraded":"2023-10-18T12:21:15.793807+0000","last_fullsized":"2023-10-18T12:21:15.793807+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:32:20.509856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.712248+0000","last_change":"2023-10-18T12:19:33.533449+0000","last_active":"2023-10-18T12:21:15.712248+0000","last_peered":"2023-10-18T12:21:15.712248+0000","last_clean":"2023-10-18T12:21:15.712248+0000","last_became_active":"2023-10-18T12:19:33.533051+0000","last_became_peered":"2023-10-18T12:19:33.533051+0000","last_unstale":"2023-10-18T12:21:15.712248+0000","last_undegraded":"2023-10-18T12:21:15.712248+0000","last_fullsized":"2023-10-18T12:21:15.712248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:26:11.000772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.792302+0000","last_change":"2023-10-18T12:21:14.709961+0000","last_active":"2023-10-18T12:21:15.792302+0000","last_peered":"2023-10-18T12:21:15.792302+0000","last_clean":"2023-10-18T12:21:15.792302+0000","last_became_active":"2023-10-18T12:21:14.709679+0000","last_became_peered":"2023-10-18T12:21:14.709679+0000","last_unstale":"2023-10-18T12:21:15.792302+0000","last_undegraded":"2023-10-18T12:21:15.792302+0000","last_fullsized":"2023-10-18T12:21:15.792302+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T23:26:37.012525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.794184+0000","last_change":"2023-10-18T12:21:13.714139+0000","last_active":"2023-10-18T12:21:15.794184+0000","last_peered":"2023-10-18T12:21:15.794184+0000","last_clean":"2023-10-18T12:21:15.794184+0000","last_became_active":"2023-10-18T12:21:13.713849+0000","last_became_peered":"2023-10-18T12:21:13.713849+0000","last_unstale":"2023-10-18T12:21:15.794184+0000","last_undegraded":"2023-10-18T12:21:15.794184+0000","last_fullsized":"2023-10-18T12:21:15.794184+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:07:33.701694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.707799+0000","last_change":"2023-10-18T12:19:33.530766+0000","last_active":"2023-10-18T12:21:15.707799+0000","last_peered":"2023-10-18T12:21:15.707799+0000","last_clean":"2023-10-18T12:21:15.707799+0000","last_became_active":"2023-10-18T12:19:33.530346+0000","last_became_peered":"2023-10-18T12:19:33.530346+0000","last_unstale":"2023-10-18T12:21:15.707799+0000","last_undegraded":"2023-10-18T12:21:15.707799+0000","last_fullsized":"2023-10-18T12:21:15.707799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:52:40.418433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.793913+0000","last_change":"2023-10-18T12:21:14.702121+0000","last_active":"2023-10-18T12:21:15.793913+0000","last_peered":"2023-10-18T12:21:15.793913+0000","last_clean":"2023-10-18T12:21:15.793913+0000","last_became_active":"2023-10-18T12:21:14.700994+0000","last_became_peered":"2023-10-18T12:21:14.700994+0000","last_unstale":"2023-10-18T12:21:15.793913+0000","last_undegraded":"2023-10-18T12:21:15.793913+0000","last_fullsized":"2023-10-18T12:21:15.793913+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:36:47.566617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.792008+0000","last_change":"2023-10-18T12:21:13.708658+0000","last_active":"2023-10-18T12:21:15.792008+0000","last_peered":"2023-10-18T12:21:15.792008+0000","last_clean":"2023-10-18T12:21:15.792008+0000","last_became_active":"2023-10-18T12:21:13.708336+0000","last_became_peered":"2023-10-18T12:21:13.708336+0000","last_unstale":"2023-10-18T12:21:15.792008+0000","last_undegraded":"2023-10-18T12:21:15.792008+0000","last_fullsized":"2023-10-18T12:21:15.792008+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:24:43.299570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.791434+0000","last_change":"2023-10-18T12:19:33.528538+0000","last_active":"2023-10-18T12:21:15.791434+0000","last_peered":"2023-10-18T12:21:15.791434+0000","last_clean":"2023-10-18T12:21:15.791434+0000","last_became_active":"2023-10-18T12:19:33.528214+0000","last_became_peered":"2023-10-18T12:19:33.528214+0000","last_unstale":"2023-10-18T12:21:15.791434+0000","last_undegraded":"2023-10-18T12:21:15.791434+0000","last_fullsized":"2023-10-18T12:21:15.791434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:46:30.200322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.793043+0000","last_change":"2023-10-18T12:21:14.715096+0000","last_active":"2023-10-18T12:21:15.793043+0000","last_peered":"2023-10-18T12:21:15.793043+0000","last_clean":"2023-10-18T12:21:15.793043+0000","last_became_active":"2023-10-18T12:21:14.714779+0000","last_became_peered":"2023-10-18T12:21:14.714779+0000","last_unstale":"2023-10-18T12:21:15.793043+0000","last_undegraded":"2023-10-18T12:21:15.793043+0000","last_fullsized":"2023-10-18T12:21:15.793043+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:13.670433+0000","last_clean_scrub_stamp":"2023-10-18T12:21:13.670433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T18:12:05.216829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.713020+0000","last_change":"2023-10-18T12:21:13.715330+0000","last_active":"2023-10-18T12:21:15.713020+0000","last_peered":"2023-10-18T12:21:15.713020+0000","last_clean":"2023-10-18T12:21:15.713020+0000","last_became_active":"2023-10-18T12:21:13.715077+0000","last_became_peered":"2023-10-18T12:21:13.715077+0000","last_unstale":"2023-10-18T12:21:15.713020+0000","last_undegraded":"2023-10-18T12:21:15.713020+0000","last_fullsized":"2023-10-18T12:21:15.713020+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:21:12.653693+0000","last_clean_scrub_stamp":"2023-10-18T12:21:12.653693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:07:50.229597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.712356+0000","last_change":"2023-10-18T12:19:33.531214+0000","last_active":"2023-10-18T12:21:15.712356+0000","last_peered":"2023-10-18T12:21:15.712356+0000","last_clean":"2023-10-18T12:21:15.712356+0000","last_became_active":"2023-10-18T12:19:33.530795+0000","last_became_peered":"2023-10-18T12:19:33.530795+0000","last_unstale":"2023-10-18T12:21:15.712356+0000","last_undegraded":"2023-10-18T12:21:15.712356+0000","last_fullsized":"2023-10-18T12:21:15.712356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:55:48.105566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":207,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-10-18T12:21:15.791682+0000","last_change":"2023-10-18T12:19:28.825371+0000","last_active":"2023-10-18T12:21:15.791682+0000","last_peered":"2023-10-18T12:21:15.791682+0000","last_clean":"2023-10-18T12:21:15.791682+0000","last_became_active":"2023-10-18T12:19:28.822484+0000","last_became_peered":"2023-10-18T12:19:28.822484+0000","last_unstale":"2023-10-18T12:21:15.791682+0000","last_undegraded":"2023-10-18T12:21:15.791682+0000","last_fullsized":"2023-10-18T12:21:15.791682+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:27.318899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:27.318899+0000","last_clean_scrub_stamp":"2023-10-18T12:19:27.318899+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:52:09.222599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28088,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343752,"statfs":{"total":96636764160,"available":96608002048,"internally_reserved":0,"allocated":1085440,"data_stored":807917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:20:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":2.8660000000000001,"5min":2.8660000000000001,"15min":2.8660000000000001},"last":1.306},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.2160000000000002,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":1.014}]},{"osd":1,"last update":"Wed Oct 18 12:20:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.0990000000000002,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":2.323,"5min":2.323,"15min":2.323},"last":0.93799999999999994}]},{"osd":2,"last update":"Wed Oct 18 12:20:27 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.272,"15min":1.272},"min":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.28,"5min":1.28,"15min":1.28},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.2149999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":1.2629999999999999}]},{"osd":3,"last update":"Wed Oct 18 12:20:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.5129999999999999},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":2.9940000000000002,"5min":2.9940000000000002,"15min":2.9940000000000002},"last":1.4710000000000001}]},{"osd":4,"last update":"Wed Oct 18 12:20:27 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":2.3719999999999999,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":1.24}]},{"osd":5,"last update":"Wed Oct 18 12:20:27 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.873,"5min":0.873,"15min":0.873},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.2},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"max":{"1min":2.3300000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":1.55}]},{"osd":6,"last update":"Wed Oct 18 12:20:27 2023","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"min":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"max":{"1min":3.7709999999999999,"5min":3.7709999999999999,"15min":3.7709999999999999},"last":1.6200000000000001},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"max":{"1min":1.9690000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":1.3759999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":495616,"data_stored":218131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:20:25 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":1.369}]},{"osd":1,"last update":"Wed Oct 18 12:20:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.4370000000000001}]},{"osd":2,"last update":"Wed Oct 18 12:20:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.048}]},{"osd":3,"last update":"Wed Oct 18 12:20:25 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":1.609},{"interface":"front","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":1.25}]},{"osd":4,"last update":"Wed Oct 18 12:20:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":1.399},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.175}]},{"osd":5,"last update":"Wed Oct 18 12:20:25 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.302,"15min":1.302},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":1.105},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":1.145}]},{"osd":7,"last update":"Wed Oct 18 12:20:25 2023","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.8580000000000001},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":1.099,"5min":1.099,"15min":1.099},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":1.4850000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":491520,"data_stored":217529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:20:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":1.823}]},{"osd":1,"last update":"Wed Oct 18 12:20:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":1.5449999999999999}]},{"osd":2,"last update":"Wed Oct 18 12:20:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":1.8859999999999999},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.6480000000000001,"5min":2.6480000000000001,"15min":2.6480000000000001},"last":0.997}]},{"osd":3,"last update":"Wed Oct 18 12:20:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":2.2749999999999999,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":2.6219999999999999,"5min":2.6219999999999999,"15min":2.6219999999999999},"last":1.71}]},{"osd":4,"last update":"Wed Oct 18 12:20:28 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":2.5190000000000001,"5min":2.5190000000000001,"15min":2.5190000000000001},"last":1.069},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":2.4489999999999998,"5min":2.4489999999999998,"15min":2.4489999999999998},"last":1.657}]},{"osd":6,"last update":"Wed Oct 18 12:20:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":2.3479999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.9830000000000001},{"interface":"front","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.621,"5min":2.621,"15min":2.621},"last":1.4690000000000001}]},{"osd":7,"last update":"Wed Oct 18 12:20:28 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.496,"15min":1.496},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":2.581,"5min":2.581,"15min":2.581},"last":1.76},{"interface":"front","average":{"1min":1.569,"5min":1.569,"15min":1.569},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.673,"5min":2.673,"15min":2.673},"last":1.9430000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":499712,"data_stored":219071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:20:27 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.014,"15min":1.014},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.913,"5min":1.913,"15min":1.913},"last":1.573}]},{"osd":1,"last update":"Wed Oct 18 12:20:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.8169999999999999,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.113,"5min":1.113,"15min":1.113},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":0.69899999999999995}]},{"osd":2,"last update":"Wed Oct 18 12:20:27 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.782,"5min":1.782,"15min":1.782},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":1.159}]},{"osd":3,"last update":"Wed Oct 18 12:20:27 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.208,"15min":1.208},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":2.0779999999999998,"5min":2.0779999999999998,"15min":2.0779999999999998},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":2.734,"5min":2.734,"15min":2.734},"last":1.528}]},{"osd":5,"last update":"Wed Oct 18 12:20:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":1.419},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":1.331}]},{"osd":6,"last update":"Wed Oct 18 12:20:27 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":1.7}]},{"osd":7,"last update":"Wed Oct 18 12:20:27 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.349,"15min":1.349},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.9850000000000001,"5min":1.9850000000000001,"15min":1.9850000000000001},"last":1.613},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"min":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"max":{"1min":2.645,"5min":2.645,"15min":2.645},"last":1.657}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":487424,"data_stored":211124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:20:29 2023","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":3.8490000000000002,"5min":3.8490000000000002,"15min":3.8490000000000002},"last":1.3360000000000001},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.2229999999999999,"5min":2.2229999999999999,"15min":2.2229999999999999},"last":0.79500000000000004}]},{"osd":1,"last update":"Wed Oct 18 12:20:29 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":2.4529999999999998,"5min":2.4529999999999998,"15min":2.4529999999999998},"last":0.82699999999999996},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.593,"5min":2.593,"15min":2.593},"last":1.26}]},{"osd":2,"last update":"Wed Oct 18 12:20:29 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":2.9319999999999999,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":0.629},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":3.9359999999999999,"5min":3.9359999999999999,"15min":3.9359999999999999},"last":1.1379999999999999}]},{"osd":4,"last update":"Wed Oct 18 12:20:29 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.345,"15min":1.345},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":3.8919999999999999,"5min":3.8919999999999999,"15min":3.8919999999999999},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":3.7000000000000002,"5min":3.7000000000000002,"15min":3.7000000000000002},"last":1.097}]},{"osd":5,"last update":"Wed Oct 18 12:20:29 2023","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"min":{"1min":1.071,"5min":1.071,"15min":1.071},"max":{"1min":3.125,"5min":3.125,"15min":3.125},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.508,"5min":1.508,"15min":1.508},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":3.972,"5min":3.972,"15min":3.972},"last":1.4750000000000001}]},{"osd":6,"last update":"Wed Oct 18 12:20:29 2023","interfaces":[{"interface":"back","average":{"1min":1.494,"5min":1.494,"15min":1.494},"min":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"max":{"1min":4.2480000000000002,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.504,"5min":1.504,"15min":1.504},"min":{"1min":1.004,"5min":1.004,"15min":1.004},"max":{"1min":3.4060000000000001,"5min":3.4060000000000001,"15min":3.4060000000000001},"last":1.3680000000000001}]},{"osd":7,"last update":"Wed Oct 18 12:20:29 2023","interfaces":[{"interface":"back","average":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"min":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"max":{"1min":4.0720000000000001,"5min":4.0720000000000001,"15min":4.0720000000000001},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"min":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"max":{"1min":3.9940000000000002,"5min":3.9940000000000002,"15min":3.9940000000000002},"last":1.1220000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":491520,"data_stored":212120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:20:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":1.208}]},{"osd":1,"last update":"Wed Oct 18 12:20:28 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":1.1140000000000001},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.81899999999999995}]},{"osd":3,"last update":"Wed Oct 18 12:20:28 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":1.339},{"interface":"front","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":2.1110000000000002,"5min":2.1110000000000002,"15min":2.1110000000000002},"last":1.0600000000000001}]},{"osd":4,"last update":"Wed Oct 18 12:20:28 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":3.1579999999999999,"5min":3.1579999999999999,"15min":3.1579999999999999},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"max":{"1min":1.7849999999999999,"5min":1.7849999999999999,"15min":1.7849999999999999},"last":1.026}]},{"osd":5,"last update":"Wed Oct 18 12:20:28 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.371,"15min":1.371},"min":{"1min":1.02,"5min":1.02,"15min":1.02},"max":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.419,"5min":1.419,"15min":1.419},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.8700000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":1.5049999999999999}]},{"osd":6,"last update":"Wed Oct 18 12:20:28 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":3.2149999999999999,"5min":3.2149999999999999,"15min":3.2149999999999999},"last":1.3939999999999999}]},{"osd":7,"last update":"Wed Oct 18 12:20:28 2023","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":2.246,"5min":2.246,"15min":2.246},"last":1.556},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":2.976,"5min":2.976,"15min":2.976},"last":1.4259999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":479232,"data_stored":210556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:20:29 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":1.05},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":1.155}]},{"osd":2,"last update":"Wed Oct 18 12:20:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":4.2690000000000001,"5min":4.2690000000000001,"15min":4.2690000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.375}]},{"osd":3,"last update":"Wed Oct 18 12:20:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":1.181},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":0.53400000000000003}]},{"osd":4,"last update":"Wed Oct 18 12:20:29 2023","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.423,"15min":1.423},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":5.524,"5min":5.524,"15min":5.524},"last":1.111},{"interface":"front","average":{"1min":1.526,"5min":1.526,"15min":1.526},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":4.5860000000000003,"5min":4.5860000000000003,"15min":4.5860000000000003},"last":0.84799999999999998}]},{"osd":5,"last update":"Wed Oct 18 12:20:29 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.464,"15min":1.464},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":4.4199999999999999,"5min":4.4199999999999999,"15min":4.4199999999999999},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.284}]},{"osd":6,"last update":"Wed Oct 18 12:20:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":2.6179999999999999,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":4.3140000000000001,"5min":4.3140000000000001,"15min":4.3140000000000001},"last":0.90300000000000002}]},{"osd":7,"last update":"Wed Oct 18 12:20:29 2023","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":2.5110000000000001,"5min":2.5110000000000001,"15min":2.5110000000000001},"last":1.4730000000000001},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"min":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"max":{"1min":2.339,"5min":2.339,"15min":2.339},"last":0.871}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28068,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343772,"statfs":{"total":96636764160,"available":96608022528,"internally_reserved":0,"allocated":1073152,"data_stored":800888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 18 12:20:28 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.54700000000000004}]},{"osd":2,"last update":"Wed Oct 18 12:20:28 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":1.0509999999999999}]},{"osd":3,"last update":"Wed Oct 18 12:20:28 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.466,"5min":1.466,"15min":1.466},"last":0.77200000000000002}]},{"osd":4,"last update":"Wed Oct 18 12:20:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":1.179},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":1.1339999999999999}]},{"osd":5,"last update":"Wed Oct 18 12:20:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":2.726,"5min":2.726,"15min":2.726},"last":1},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.5619999999999998,"5min":2.5619999999999998,"15min":2.5619999999999998},"last":1.099}]},{"osd":6,"last update":"Wed Oct 18 12:20:28 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":2.4990000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.216},{"interface":"front","average":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"min":{"1min":1.028,"5min":1.028,"15min":1.028},"max":{"1min":2.847,"5min":2.847,"15min":2.847},"last":1.3120000000000001}]},{"osd":7,"last update":"Wed Oct 18 12:20:28 2023","interfaces":[{"interface":"back","average":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"min":{"1min":1.071,"5min":1.071,"15min":1.071},"max":{"1min":3.1930000000000001,"5min":3.1930000000000001,"15min":3.1930000000000001},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":2.3900000000000001,"5min":2.3900000000000001,"15min":2.3900000000000001},"last":1.264}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-18T12:21:19.531 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-18T12:21:19.532 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-18T12:21:19.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.756+0000 7f9eccbaa700 1 Processor -- start 2023-10-18T12:21:19.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.756+0000 7f9eccbaa700 1 -- start start 2023-10-18T12:21:19.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.756+0000 7f9eccbaa700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f9ec80cae50 0x7f9ec806d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:19.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.756+0000 7f9eccbaa700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9ec8159e70 0x7f9ec806d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:19.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.756+0000 7f9eccbaa700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec80add20 con 0x7f9ec80cdb10 2023-10-18T12:21:19.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.756+0000 7f9eccbaa700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ec80cd930 con 0x7f9ec8159e70 2023-10-18T12:21:19.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.756+0000 7f9eccbaa700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ec8070cf0 con 0x7f9ec80cae50 2023-10-18T12:21:19.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.756+0000 7f9ec6d9d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9ec8159e70 0x7f9ec806d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:19.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.756+0000 7f9ec659c700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f9ec80cdb10 0x7f9ec80cdef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.114:46324/0 (socket says 172.21.15.114:46324) 2023-10-18T12:21:19.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.756+0000 7f9ec659c700 1 -- 172.21.15.114:0/2350088424 learned_addr learned my addr 172.21.15.114:0/2350088424 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:21:19.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.760+0000 7f9ec5d9b700 1 --2- 172.21.15.114:0/2350088424 >> v2:172.21.15.172:3300/0 conn(0x7f9ec80cae50 0x7f9ec806d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:19.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.760+0000 7f9ec559a700 1 -- 172.21.15.114:0/2350088424 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1758798081 0 0) 0x7f9ec80add20 con 0x7f9ec80cdb10 2023-10-18T12:21:19.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.760+0000 7f9ec559a700 1 -- 172.21.15.114:0/2350088424 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9eb00035d0 con 0x7f9ec80cdb10 2023-10-18T12:21:19.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.760+0000 7f9ec6d9d700 1 -- 172.21.15.114:0/2350088424 >> v2:172.21.15.172:3300/0 conn(0x7f9ec80cae50 msgr2=0x7f9ec806d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:19.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.760+0000 7f9ec6d9d700 1 --2- 172.21.15.114:0/2350088424 >> v2:172.21.15.172:3300/0 conn(0x7f9ec80cae50 0x7f9ec806d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:19.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.760+0000 7f9ec6d9d700 1 -- 172.21.15.114:0/2350088424 >> v1:172.21.15.172:6789/0 conn(0x7f9ec80cdb10 legacy=0x7f9ec80cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:19.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.760+0000 7f9ec6d9d700 1 -- 172.21.15.114:0/2350088424 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec80cd400 con 0x7f9ec8159e70 2023-10-18T12:21:19.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.760+0000 7f9ec6d9d700 1 --2- 172.21.15.114:0/2350088424 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ec8159e70 0x7f9ec806d860 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f9ec806f270 tx=0x7f9ec000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1726eaa99b54eae5 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:19.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.760+0000 7f9ec559a700 1 -- 172.21.15.114:0/2350088424 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec000e070 con 0x7f9ec8159e70 2023-10-18T12:21:19.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.760+0000 7f9ec559a700 1 -- 172.21.15.114:0/2350088424 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec000bb20 con 0x7f9ec8159e70 2023-10-18T12:21:19.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.760+0000 7f9ec559a700 1 -- 172.21.15.114:0/2350088424 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec0012430 con 0x7f9ec8159e70 2023-10-18T12:21:19.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.760+0000 7f9eccbaa700 1 -- 172.21.15.114:0/2350088424 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ec8159e70 msgr2=0x7f9ec806d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:19.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.760+0000 7f9eccbaa700 1 --2- 172.21.15.114:0/2350088424 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ec8159e70 0x7f9ec806d860 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f9ec806f270 tx=0x7f9ec000b330 comp rx=0 tx=0).stop 2023-10-18T12:21:19.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.764+0000 7f9eccbaa700 1 -- 172.21.15.114:0/2350088424 shutdown_connections 2023-10-18T12:21:19.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.764+0000 7f9eccbaa700 1 --2- 172.21.15.114:0/2350088424 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ec8159e70 0x7f9ec806d860 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:19.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.764+0000 7f9eccbaa700 1 --2- 172.21.15.114:0/2350088424 >> v2:172.21.15.172:3300/0 conn(0x7f9ec80cae50 0x7f9ec806d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:19.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.764+0000 7f9eccbaa700 1 -- 172.21.15.114:0/2350088424 >> 172.21.15.114:0/2350088424 conn(0x7f9ec80ce820 msgr2=0x7f9ec80cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:19.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.764+0000 7f9eccbaa700 1 -- 172.21.15.114:0/2350088424 shutdown_connections 2023-10-18T12:21:19.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.764+0000 7f9eccbaa700 1 -- 172.21.15.114:0/2350088424 wait complete. 2023-10-18T12:21:19.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.764+0000 7f9eccbaa700 1 Processor -- start 2023-10-18T12:21:19.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.764+0000 7f9eccbaa700 1 -- start start 2023-10-18T12:21:19.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.768+0000 7f9eccbaa700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9ec80cae50 0x7f9ec814d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:19.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.768+0000 7f9eccbaa700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ec80cdb10 0x7f9ec80ae420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:19.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.768+0000 7f9eccbaa700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ec8159e70 0x7f9ec80aef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:19.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.768+0000 7f9eccbaa700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec814fad0 con 0x7f9ec8159e70 2023-10-18T12:21:19.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.768+0000 7f9eccbaa700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec815cce0 con 0x7f9ec80cdb10 2023-10-18T12:21:19.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.768+0000 7f9eccbaa700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec80c5200 con 0x7f9ec80cae50 2023-10-18T12:21:19.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.768+0000 7f9ec6d9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ec8159e70 0x7f9ec80aef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:19.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.768+0000 7f9ec6d9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ec8159e70 0x7f9ec80aef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39340/0 (socket says 172.21.15.114:39340) 2023-10-18T12:21:19.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.768+0000 7f9ec6d9d700 1 -- 172.21.15.114:0/3203356946 learned_addr learned my addr 172.21.15.114:0/3203356946 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:19.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.768+0000 7f9ec659c700 1 --2- 172.21.15.114:0/3203356946 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9ec80cae50 0x7f9ec814d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:19.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.768+0000 7f9ec5d9b700 1 --2- 172.21.15.114:0/3203356946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ec80cdb10 0x7f9ec80ae420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:19.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.768+0000 7f9ec6d9d700 1 -- 172.21.15.114:0/3203356946 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9ec80cae50 msgr2=0x7f9ec814d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:19.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.768+0000 7f9ec6d9d700 1 --2- 172.21.15.114:0/3203356946 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9ec80cae50 0x7f9ec814d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:19.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.768+0000 7f9ec6d9d700 1 -- 172.21.15.114:0/3203356946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ec80cdb10 msgr2=0x7f9ec80ae420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:19.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.768+0000 7f9ec6d9d700 1 --2- 172.21.15.114:0/3203356946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ec80cdb10 0x7f9ec80ae420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:19.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.768+0000 7f9ec6d9d700 1 -- 172.21.15.114:0/3203356946 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec0009a70 con 0x7f9ec8159e70 2023-10-18T12:21:19.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.768+0000 7f9ec6d9d700 1 --2- 172.21.15.114:0/3203356946 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ec8159e70 0x7f9ec80aef70 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0014040 tx=0x7f9ec0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:19.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.768+0000 7f9eb6ffd700 1 -- 172.21.15.114:0/3203356946 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec0012430 con 0x7f9ec8159e70 2023-10-18T12:21:19.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.768+0000 7f9eb6ffd700 1 -- 172.21.15.114:0/3203356946 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec0020070 con 0x7f9ec8159e70 2023-10-18T12:21:19.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.768+0000 7f9eccbaa700 1 -- 172.21.15.114:0/3203356946 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec80c4f20 con 0x7f9ec8159e70 2023-10-18T12:21:19.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.768+0000 7f9eb6ffd700 1 -- 172.21.15.114:0/3203356946 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec0004040 con 0x7f9ec8159e70 2023-10-18T12:21:19.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.768+0000 7f9eccbaa700 1 -- 172.21.15.114:0/3203356946 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec815c970 con 0x7f9ec8159e70 2023-10-18T12:21:19.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.768+0000 7f9eccbaa700 1 -- 172.21.15.114:0/3203356946 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ec815c4f0 con 0x7f9ec8159e70 2023-10-18T12:21:19.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.772+0000 7f9eb6ffd700 1 -- 172.21.15.114:0/3203356946 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f9ec00041a0 con 0x7f9ec8159e70 2023-10-18T12:21:19.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.772+0000 7f9eb6ffd700 1 --2- 172.21.15.114:0/3203356946 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9ea80656f0 0x7f9ea8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:19.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.772+0000 7f9eb6ffd700 1 -- 172.21.15.114:0/3203356946 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f9ec0022070 con 0x7f9ec8159e70 2023-10-18T12:21:19.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.772+0000 7f9ec659c700 1 --2- 172.21.15.114:0/3203356946 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9ea80656f0 0x7f9ea8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:19.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.772+0000 7f9ec659c700 1 --2- 172.21.15.114:0/3203356946 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9ea80656f0 0x7f9ea8067bb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8007fd0 tx=0x7f9eb8007de0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:19.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:19.776+0000 7f9eb6ffd700 1 -- 172.21.15.114:0/3203356946 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f9ec815c4f0 con 0x7f9ec8159e70 2023-10-18T12:21:20.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.024+0000 7f9eccbaa700 1 -- 172.21.15.114:0/3203356946 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f9ec815ce90 con 0x7f9ec8159e70 2023-10-18T12:21:20.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.032+0000 7f9eb6ffd700 1 -- 172.21.15.114:0/3203356946 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7f9ec815ce90 con 0x7f9ec8159e70 2023-10-18T12:21:20.038 INFO:teuthology.orchestra.run.smithi114.stdout:[client.0] 2023-10-18T12:21:20.038 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQAbzS9l47iuKBAAvzsyy0FyscOq8i4BEhLnMQ== 2023-10-18T12:21:20.038 INFO:teuthology.orchestra.run.smithi114.stdout: caps mds = "allow" 2023-10-18T12:21:20.038 INFO:teuthology.orchestra.run.smithi114.stdout: caps mon = "allow r" 2023-10-18T12:21:20.039 INFO:teuthology.orchestra.run.smithi114.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-10-18T12:21:20.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.036+0000 7f9eccbaa700 1 -- 172.21.15.114:0/3203356946 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9ea80656f0 msgr2=0x7f9ea8067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:20.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.036+0000 7f9eccbaa700 1 --2- 172.21.15.114:0/3203356946 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9ea80656f0 0x7f9ea8067bb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8007fd0 tx=0x7f9eb8007de0 comp rx=0 tx=0).stop 2023-10-18T12:21:20.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.036+0000 7f9eccbaa700 1 -- 172.21.15.114:0/3203356946 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ec8159e70 msgr2=0x7f9ec80aef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:20.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.036+0000 7f9eccbaa700 1 --2- 172.21.15.114:0/3203356946 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ec8159e70 0x7f9ec80aef70 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0014040 tx=0x7f9ec0004af0 comp rx=0 tx=0).stop 2023-10-18T12:21:20.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.036+0000 7f9eccbaa700 1 -- 172.21.15.114:0/3203356946 shutdown_connections 2023-10-18T12:21:20.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.036+0000 7f9eccbaa700 1 --2- 172.21.15.114:0/3203356946 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9ea80656f0 0x7f9ea8067bb0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:20.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.036+0000 7f9eccbaa700 1 --2- 172.21.15.114:0/3203356946 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ec8159e70 0x7f9ec80aef70 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:20.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.036+0000 7f9eccbaa700 1 --2- 172.21.15.114:0/3203356946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ec80cdb10 0x7f9ec80ae420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:20.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.036+0000 7f9eccbaa700 1 --2- 172.21.15.114:0/3203356946 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9ec80cae50 0x7f9ec814d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:20.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.036+0000 7f9eccbaa700 1 -- 172.21.15.114:0/3203356946 >> 172.21.15.114:0/3203356946 conn(0x7f9ec80ce820 msgr2=0x7f9ec80cdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:20.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.036+0000 7f9eccbaa700 1 -- 172.21.15.114:0/3203356946 shutdown_connections 2023-10-18T12:21:20.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.036+0000 7f9eccbaa700 1 -- 172.21.15.114:0/3203356946 wait complete. 2023-10-18T12:21:20.044 INFO:teuthology.orchestra.run.smithi114.stderr:updated caps for client.0 2023-10-18T12:21:20.060 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T12:21:20.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.224+0000 7f33115bb700 1 Processor -- start 2023-10-18T12:21:20.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.224+0000 7f33115bb700 1 -- start start 2023-10-18T12:21:20.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.228+0000 7f33115bb700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f330c159750 0x7f330c070560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:20.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.228+0000 7f33115bb700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f330c0b14f0 con 0x7f330c0ce040 2023-10-18T12:21:20.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.228+0000 7f33115bb700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f330c15d590 con 0x7f330c070aa0 2023-10-18T12:21:20.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.228+0000 7f33115bb700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f330c0c9aa0 con 0x7f330c159750 2023-10-18T12:21:20.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.228+0000 7f3310dba700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f330c0ce040 0x7f330c06cf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51864/0 (socket says 172.21.15.114:51864) 2023-10-18T12:21:20.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.228+0000 7f3310dba700 1 -- 172.21.15.114:0/1816826296 learned_addr learned my addr 172.21.15.114:0/1816826296 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:21:20.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.228+0000 7f330bfff700 1 --2- 172.21.15.114:0/1816826296 >> v2:172.21.15.172:3300/0 conn(0x7f330c159750 0x7f330c070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:20.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.232+0000 7f330bfff700 1 -- 172.21.15.114:0/1816826296 >> v1:172.21.15.172:6789/0 conn(0x7f330c070aa0 legacy=0x7f330c0cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:20.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.232+0000 7f330bfff700 1 -- 172.21.15.114:0/1816826296 >> v1:172.21.15.114:6789/0 conn(0x7f330c0ce040 legacy=0x7f330c06cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:20.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.232+0000 7f330bfff700 1 -- 172.21.15.114:0/1816826296 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f330c15d870 con 0x7f330c159750 2023-10-18T12:21:20.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.232+0000 7f330bfff700 1 --2- 172.21.15.114:0/1816826296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f330c159750 0x7f330c070560 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f32fc009850 tx=0x7f32fc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3c26c9b93ca50bd server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:20.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.232+0000 7f330affd700 1 -- 172.21.15.114:0/1816826296 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32fc011830 con 0x7f330c159750 2023-10-18T12:21:20.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.232+0000 7f330affd700 1 -- 172.21.15.114:0/1816826296 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32fc011990 con 0x7f330c159750 2023-10-18T12:21:20.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.232+0000 7f330affd700 1 -- 172.21.15.114:0/1816826296 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32fc011d20 con 0x7f330c159750 2023-10-18T12:21:20.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.232+0000 7f33115bb700 1 -- 172.21.15.114:0/1816826296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f330c159750 msgr2=0x7f330c070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:20.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.232+0000 7f33115bb700 1 --2- 172.21.15.114:0/1816826296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f330c159750 0x7f330c070560 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f32fc009850 tx=0x7f32fc009b60 comp rx=0 tx=0).stop 2023-10-18T12:21:20.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.232+0000 7f33115bb700 1 -- 172.21.15.114:0/1816826296 shutdown_connections 2023-10-18T12:21:20.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.232+0000 7f33115bb700 1 --2- 172.21.15.114:0/1816826296 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f330c159750 0x7f330c070560 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:20.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.232+0000 7f33115bb700 1 -- 172.21.15.114:0/1816826296 >> 172.21.15.114:0/1816826296 conn(0x7f330c0ce5c0 msgr2=0x7f330c0ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:20.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.232+0000 7f33115bb700 1 -- 172.21.15.114:0/1816826296 shutdown_connections 2023-10-18T12:21:20.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.232+0000 7f33115bb700 1 -- 172.21.15.114:0/1816826296 wait complete. 2023-10-18T12:21:20.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.236+0000 7f33115bb700 1 Processor -- start 2023-10-18T12:21:20.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.236+0000 7f33115bb700 1 -- start start 2023-10-18T12:21:20.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.236+0000 7f33115bb700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f330c070aa0 0x7f330c1587b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:20.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.236+0000 7f33115bb700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f330c0ce040 0x7f330c153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:20.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.236+0000 7f33115bb700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f330c159750 0x7f330c1543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:20.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.236+0000 7f33115bb700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330c0c6130 con 0x7f330c070aa0 2023-10-18T12:21:20.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.236+0000 7f33115bb700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330c158cf0 con 0x7f330c159750 2023-10-18T12:21:20.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.236+0000 7f33115bb700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f330c1f7ba0 con 0x7f330c0ce040 2023-10-18T12:21:20.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.236+0000 7f330bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f330c070aa0 0x7f330c1587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:20.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.236+0000 7f330bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f330c070aa0 0x7f330c1587b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39348/0 (socket says 172.21.15.114:39348) 2023-10-18T12:21:20.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.236+0000 7f330bfff700 1 -- 172.21.15.114:0/393020212 learned_addr learned my addr 172.21.15.114:0/393020212 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:20.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.236+0000 7f330b7fe700 1 --2- 172.21.15.114:0/393020212 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f330c0ce040 0x7f330c153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:20.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.236+0000 7f3310dba700 1 --2- 172.21.15.114:0/393020212 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f330c159750 0x7f330c1543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:20.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.236+0000 7f330bfff700 1 -- 172.21.15.114:0/393020212 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f330c0ce040 msgr2=0x7f330c153ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:20.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.236+0000 7f330bfff700 1 --2- 172.21.15.114:0/393020212 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f330c0ce040 0x7f330c153ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:20.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.236+0000 7f330bfff700 1 -- 172.21.15.114:0/393020212 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f330c159750 msgr2=0x7f330c1543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:20.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.236+0000 7f330bfff700 1 --2- 172.21.15.114:0/393020212 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f330c159750 0x7f330c1543e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:20.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.236+0000 7f330bfff700 1 -- 172.21.15.114:0/393020212 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32fc0094b0 con 0x7f330c070aa0 2023-10-18T12:21:20.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.236+0000 7f3310dba700 1 --2- 172.21.15.114:0/393020212 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f330c159750 0x7f330c1543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:21:20.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.240+0000 7f330bfff700 1 --2- 172.21.15.114:0/393020212 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f330c070aa0 0x7f330c1587b0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f32fc009fd0 tx=0x7f32fc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:20.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.240+0000 7f3308ff9700 1 -- 172.21.15.114:0/393020212 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32fc004590 con 0x7f330c070aa0 2023-10-18T12:21:20.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.240+0000 7f3308ff9700 1 -- 172.21.15.114:0/393020212 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32fc01e070 con 0x7f330c070aa0 2023-10-18T12:21:20.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.240+0000 7f3308ff9700 1 -- 172.21.15.114:0/393020212 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32fc003900 con 0x7f330c070aa0 2023-10-18T12:21:20.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.240+0000 7f33115bb700 1 -- 172.21.15.114:0/393020212 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f330c0c8480 con 0x7f330c070aa0 2023-10-18T12:21:20.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.240+0000 7f33115bb700 1 -- 172.21.15.114:0/393020212 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f330c1f70c0 con 0x7f330c070aa0 2023-10-18T12:21:20.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.240+0000 7f33115bb700 1 -- 172.21.15.114:0/393020212 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f330c06e060 con 0x7f330c070aa0 2023-10-18T12:21:20.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.244+0000 7f3308ff9700 1 -- 172.21.15.114:0/393020212 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f32fc003a60 con 0x7f330c070aa0 2023-10-18T12:21:20.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.244+0000 7f3308ff9700 1 --2- 172.21.15.114:0/393020212 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f32f80656f0 0x7f32f8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:20.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.244+0000 7f3308ff9700 1 -- 172.21.15.114:0/393020212 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f32fc084150 con 0x7f330c070aa0 2023-10-18T12:21:20.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.244+0000 7f330b7fe700 1 --2- 172.21.15.114:0/393020212 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f32f80656f0 0x7f32f8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:20.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.244+0000 7f330b7fe700 1 --2- 172.21.15.114:0/393020212 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f32f80656f0 0x7f32f8067bb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f330c14e4a0 tx=0x7f3300009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:20.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.248+0000 7f3308ff9700 1 -- 172.21.15.114:0/393020212 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f32fc051a00 con 0x7f330c070aa0 2023-10-18T12:21:20.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.476+0000 7f33115bb700 1 -- 172.21.15.114:0/393020212 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f330c072e60 con 0x7f330c070aa0 2023-10-18T12:21:20.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.480+0000 7f3308ff9700 1 -- 172.21.15.114:0/393020212 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4887 (secure 0 0 0) 0x7f32fc055020 con 0x7f330c070aa0 2023-10-18T12:21:20.484 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:21:20.485 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2034957068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2034957068},{"type":"v1","addr":"172.21.15.172:6836","nonce":2034957068}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5039,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4215710360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4215710360},{"type":"v1","addr":"172.21.15.172:6837","nonce":4215710360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2387835210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2387835210},{"type":"v1","addr":"172.21.15.114:6833","nonce":2387835210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T12:21:14.159069+0000","modified":"2023-10-18T12:21:17.730177+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.114:6835/1284474820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1284474820},{"type":"v1","addr":"172.21.15.114:6835","nonce":1284474820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-18T12:21:20.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.480+0000 7f33115bb700 1 -- 172.21.15.114:0/393020212 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f32f80656f0 msgr2=0x7f32f8067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:20.488 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.480+0000 7f33115bb700 1 --2- 172.21.15.114:0/393020212 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f32f80656f0 0x7f32f8067bb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f330c14e4a0 tx=0x7f3300009040 comp rx=0 tx=0).stop 2023-10-18T12:21:20.488 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.480+0000 7f33115bb700 1 -- 172.21.15.114:0/393020212 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f330c070aa0 msgr2=0x7f330c1587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:20.488 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.480+0000 7f33115bb700 1 --2- 172.21.15.114:0/393020212 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f330c070aa0 0x7f330c1587b0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f32fc009fd0 tx=0x7f32fc004770 comp rx=0 tx=0).stop 2023-10-18T12:21:20.488 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.480+0000 7f33115bb700 1 -- 172.21.15.114:0/393020212 shutdown_connections 2023-10-18T12:21:20.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.480+0000 7f33115bb700 1 --2- 172.21.15.114:0/393020212 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f32f80656f0 0x7f32f8067bb0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:20.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.480+0000 7f33115bb700 1 --2- 172.21.15.114:0/393020212 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f330c0ce040 0x7f330c153ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:20.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.480+0000 7f33115bb700 1 --2- 172.21.15.114:0/393020212 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f330c159750 0x7f330c1543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:20.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.480+0000 7f33115bb700 1 --2- 172.21.15.114:0/393020212 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f330c070aa0 0x7f330c1587b0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:20.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.480+0000 7f33115bb700 1 -- 172.21.15.114:0/393020212 >> 172.21.15.114:0/393020212 conn(0x7f330c0ce5c0 msgr2=0x7f330c06f450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:20.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.480+0000 7f33115bb700 1 -- 172.21.15.114:0/393020212 shutdown_connections 2023-10-18T12:21:20.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:20.480+0000 7f33115bb700 1 -- 172.21.15.114:0/393020212 wait complete. 2023-10-18T12:21:20.490 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 18 2023-10-18T12:21:20.911 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-18T12:21:14.159069+0000', 'modified': '2023-10-18T12:21:17.730177+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5544}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5544': {'gid': 5544, 'name': 'a', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.114:6835/1284474820', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.114:6834', 'nonce': 1284474820}, {'type': 'v1', 'addr': '172.21.15.114:6835', 'nonce': 1284474820}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-18T12:21:20.912 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-18T12:21:20.912 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-18T12:21:21.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.088+0000 7fa0be825700 1 Processor -- start 2023-10-18T12:21:21.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.088+0000 7fa0be825700 1 -- start start 2023-10-18T12:21:21.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.092+0000 7fa0be825700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa0b8160e50 0x7fa0b806e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:21.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.092+0000 7fa0be825700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa0b80b28f0 0x7fa0b806fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:21.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.092+0000 7fa0be825700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0b80b16d0 con 0x7fa0b80cb500 2023-10-18T12:21:21.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.092+0000 7fa0be825700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0b80b1ee0 con 0x7fa0b80b28f0 2023-10-18T12:21:21.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.092+0000 7fa0be825700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b80ae0f0 con 0x7fa0b8160e50 2023-10-18T12:21:21.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.092+0000 7fa0bd022700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa0b80cb500 0x7fa0b80b21e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51874/0 (socket says 172.21.15.114:51874) 2023-10-18T12:21:21.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.092+0000 7fa0bd022700 1 -- 172.21.15.114:0/644531843 learned_addr learned my addr 172.21.15.114:0/644531843 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:21:21.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.092+0000 7fa0bd823700 1 --2- 172.21.15.114:0/644531843 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa0b8160e50 0x7fa0b806e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:21.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.092+0000 7fa0be024700 1 --2- 172.21.15.114:0/644531843 >> v2:172.21.15.172:3300/0 conn(0x7fa0b80b28f0 0x7fa0b806fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:21.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.092+0000 7fa0bc821700 1 -- 172.21.15.114:0/644531843 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3325577103 0 0) 0x7fa0b80b16d0 con 0x7fa0b80cb500 2023-10-18T12:21:21.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.092+0000 7fa0bc821700 1 -- 172.21.15.114:0/644531843 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0a40035d0 con 0x7fa0b80cb500 2023-10-18T12:21:21.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.092+0000 7fa0bd823700 1 -- 172.21.15.114:0/644531843 >> v2:172.21.15.172:3300/0 conn(0x7fa0b80b28f0 msgr2=0x7fa0b806fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:21.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.092+0000 7fa0bd823700 1 --2- 172.21.15.114:0/644531843 >> v2:172.21.15.172:3300/0 conn(0x7fa0b80b28f0 0x7fa0b806fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:21.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.092+0000 7fa0bc821700 1 -- 172.21.15.114:0/644531843 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3878644129 0 0) 0x7fa0a40035d0 con 0x7fa0b80cb500 2023-10-18T12:21:21.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.092+0000 7fa0bd823700 1 -- 172.21.15.114:0/644531843 >> v1:172.21.15.114:6789/0 conn(0x7fa0b80cb500 legacy=0x7fa0b80b21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:21.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.092+0000 7fa0bd823700 1 -- 172.21.15.114:0/644531843 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b80b1920 con 0x7fa0b8160e50 2023-10-18T12:21:21.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.092+0000 7fa0bd823700 1 --2- 172.21.15.114:0/644531843 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa0b8160e50 0x7fa0b806e3e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4009850 tx=0x7fa0b4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59e38763ea0eb1b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:21.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.092+0000 7fa0bc821700 1 -- 172.21.15.114:0/644531843 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b4011830 con 0x7fa0b8160e50 2023-10-18T12:21:21.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.092+0000 7fa0bc821700 1 -- 172.21.15.114:0/644531843 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b4011990 con 0x7fa0b8160e50 2023-10-18T12:21:21.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.092+0000 7fa0bc821700 1 -- 172.21.15.114:0/644531843 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b4011d40 con 0x7fa0b8160e50 2023-10-18T12:21:21.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.096+0000 7fa0be825700 1 -- 172.21.15.114:0/644531843 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa0b8160e50 msgr2=0x7fa0b806e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:21.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.096+0000 7fa0be825700 1 --2- 172.21.15.114:0/644531843 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa0b8160e50 0x7fa0b806e3e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4009850 tx=0x7fa0b4009b60 comp rx=0 tx=0).stop 2023-10-18T12:21:21.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.096+0000 7fa0be825700 1 -- 172.21.15.114:0/644531843 shutdown_connections 2023-10-18T12:21:21.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.096+0000 7fa0be825700 1 --2- 172.21.15.114:0/644531843 >> v2:172.21.15.172:3300/0 conn(0x7fa0b80b28f0 0x7fa0b806fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:21.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.096+0000 7fa0be825700 1 --2- 172.21.15.114:0/644531843 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa0b8160e50 0x7fa0b806e3e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:21.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.096+0000 7fa0be825700 1 -- 172.21.15.114:0/644531843 >> 172.21.15.114:0/644531843 conn(0x7fa0b80b0bf0 msgr2=0x7fa0b80ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:21.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.096+0000 7fa0be825700 1 -- 172.21.15.114:0/644531843 shutdown_connections 2023-10-18T12:21:21.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.096+0000 7fa0be825700 1 -- 172.21.15.114:0/644531843 wait complete. 2023-10-18T12:21:21.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.096+0000 7fa0be825700 1 Processor -- start 2023-10-18T12:21:21.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.096+0000 7fa0be825700 1 -- start start 2023-10-18T12:21:21.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.100+0000 7fa0be825700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa0b80b28f0 0x7fa0b80cd490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:21.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.100+0000 7fa0be825700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0b80cb500 0x7fa0b815ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:21.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.100+0000 7fa0be825700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0b8160e50 0x7fa0b815ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:21.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.100+0000 7fa0be825700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b80a98d0 con 0x7fa0b80cb500 2023-10-18T12:21:21.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.100+0000 7fa0be825700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b80cd9d0 con 0x7fa0b8160e50 2023-10-18T12:21:21.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.100+0000 7fa0be825700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b806e9f0 con 0x7fa0b80b28f0 2023-10-18T12:21:21.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.100+0000 7fa0bd022700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0b80cb500 0x7fa0b815ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:21.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.100+0000 7fa0bd022700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0b80cb500 0x7fa0b815ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39350/0 (socket says 172.21.15.114:39350) 2023-10-18T12:21:21.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.100+0000 7fa0bd022700 1 -- 172.21.15.114:0/2875309566 learned_addr learned my addr 172.21.15.114:0/2875309566 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:21.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.100+0000 7fa0bd823700 1 --2- 172.21.15.114:0/2875309566 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa0b80b28f0 0x7fa0b80cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:21.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.100+0000 7fa0be024700 1 --2- 172.21.15.114:0/2875309566 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0b8160e50 0x7fa0b815ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:21.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.100+0000 7fa0bd022700 1 -- 172.21.15.114:0/2875309566 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa0b80b28f0 msgr2=0x7fa0b80cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:21.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.100+0000 7fa0bd022700 1 --2- 172.21.15.114:0/2875309566 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa0b80b28f0 0x7fa0b80cd490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:21.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.100+0000 7fa0bd022700 1 -- 172.21.15.114:0/2875309566 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0b8160e50 msgr2=0x7fa0b815ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:21.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.100+0000 7fa0bd022700 1 --2- 172.21.15.114:0/2875309566 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0b8160e50 0x7fa0b815ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:21.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.100+0000 7fa0bd022700 1 -- 172.21.15.114:0/2875309566 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b40094b0 con 0x7fa0b80cb500 2023-10-18T12:21:21.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.100+0000 7fa0bd022700 1 --2- 172.21.15.114:0/2875309566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0b80cb500 0x7fa0b815ba70 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa0a800c780 tx=0x7fa0a800cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:21.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.100+0000 7fa0ae7fc700 1 -- 172.21.15.114:0/2875309566 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a8005d90 con 0x7fa0b80cb500 2023-10-18T12:21:21.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.100+0000 7fa0ae7fc700 1 -- 172.21.15.114:0/2875309566 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a80070d0 con 0x7fa0b80cb500 2023-10-18T12:21:21.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.100+0000 7fa0ae7fc700 1 -- 172.21.15.114:0/2875309566 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a8007460 con 0x7fa0b80cb500 2023-10-18T12:21:21.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.100+0000 7fa0be825700 1 -- 172.21.15.114:0/2875309566 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0b80a92c0 con 0x7fa0b80cb500 2023-10-18T12:21:21.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.100+0000 7fa0be825700 1 -- 172.21.15.114:0/2875309566 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0b806e710 con 0x7fa0b80cb500 2023-10-18T12:21:21.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.104+0000 7fa0ae7fc700 1 -- 172.21.15.114:0/2875309566 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fa0a80075c0 con 0x7fa0b80cb500 2023-10-18T12:21:21.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.108+0000 7fa0ae7fc700 1 --2- 172.21.15.114:0/2875309566 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa09c0656f0 0x7fa09c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:21.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.108+0000 7fa0ae7fc700 1 -- 172.21.15.114:0/2875309566 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fa0a80825f0 con 0x7fa0b80cb500 2023-10-18T12:21:21.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.108+0000 7fa0bd823700 1 --2- 172.21.15.114:0/2875309566 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa09c0656f0 0x7fa09c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:21.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.108+0000 7fa0c2d2a740 1 Processor -- start 2023-10-18T12:21:21.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.108+0000 7fa0c2d2a740 1 -- start start 2023-10-18T12:21:21.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.108+0000 7fa0bd823700 1 --2- 172.21.15.114:0/2875309566 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa09c0656f0 0x7fa09c067bb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa0b40090b0 tx=0x7fa0b401c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:21.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.108+0000 7fa0c2d2a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x1d7f4a0 0x1d7f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:21.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.108+0000 7fa0c2d2a740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1da8ad0 0x1da8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:21.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.108+0000 7fa0c2d2a740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x1dc5d30 0x1dc6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:21.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.108+0000 7fa0c2d2a740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x1cf1f90 con 0x1da8ad0 2023-10-18T12:21:21.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.108+0000 7fa0c2d2a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x1cef680 con 0x1d7f4a0 2023-10-18T12:21:21.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.108+0000 7fa0c2d2a740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ceaf70 con 0x1dc5d30 2023-10-18T12:21:21.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.108+0000 7fa0bd022700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1da8ad0 0x1da8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:21.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.108+0000 7fa0bd022700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1da8ad0 0x1da8eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39362/0 (socket says 172.21.15.114:39362) 2023-10-18T12:21:21.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.108+0000 7fa0bd022700 1 -- 172.21.15.114:0/2471723299 learned_addr learned my addr 172.21.15.114:0/2471723299 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:21.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.108+0000 7fa0be024700 1 --2- 172.21.15.114:0/2471723299 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x1dc5d30 0x1dc6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:21.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.108+0000 7fa0bd823700 1 --2- 172.21.15.114:0/2471723299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x1d7f4a0 0x1d7f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:21.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.108+0000 7fa0bd022700 1 -- 172.21.15.114:0/2471723299 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x1dc5d30 msgr2=0x1dc6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:21.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.108+0000 7fa0bd022700 1 --2- 172.21.15.114:0/2471723299 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x1dc5d30 0x1dc6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:21.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.108+0000 7fa0bd022700 1 -- 172.21.15.114:0/2471723299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x1d7f4a0 msgr2=0x1d7f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:21.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.108+0000 7fa0bd022700 1 --2- 172.21.15.114:0/2471723299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x1d7f4a0 0x1d7f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:21.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.108+0000 7fa0bd022700 1 -- 172.21.15.114:0/2471723299 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1d101a0 con 0x1da8ad0 2023-10-18T12:21:21.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.108+0000 7fa0bd823700 1 --2- 172.21.15.114:0/2471723299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x1d7f4a0 0x1d7f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:21:21.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.112+0000 7fa0bd022700 1 --2- 172.21.15.114:0/2471723299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1da8ad0 0x1da8eb0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8053b70 tx=0x7fa0a8053610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8501265608f56ad5 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:21.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.112+0000 7fa09b7fe700 1 -- 172.21.15.114:0/2471723299 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a80579a0 con 0x1da8ad0 2023-10-18T12:21:21.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.112+0000 7fa09b7fe700 1 -- 172.21.15.114:0/2471723299 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a805b8f0 con 0x1da8ad0 2023-10-18T12:21:21.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.112+0000 7fa09b7fe700 1 -- 172.21.15.114:0/2471723299 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a805b460 con 0x1da8ad0 2023-10-18T12:21:21.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.112+0000 7fa0c2d2a740 1 -- 172.21.15.114:0/2471723299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1da8ad0 msgr2=0x1da8eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:21.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.112+0000 7fa0c2d2a740 1 --2- 172.21.15.114:0/2471723299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1da8ad0 0x1da8eb0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8053b70 tx=0x7fa0a8053610 comp rx=0 tx=0).stop 2023-10-18T12:21:21.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.112+0000 7fa0c2d2a740 1 -- 172.21.15.114:0/2471723299 shutdown_connections 2023-10-18T12:21:21.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.112+0000 7fa0c2d2a740 1 --2- 172.21.15.114:0/2471723299 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x1dc5d30 0x1dc6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:21.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.112+0000 7fa0c2d2a740 1 --2- 172.21.15.114:0/2471723299 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1da8ad0 0x1da8eb0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:21.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.112+0000 7fa0c2d2a740 1 --2- 172.21.15.114:0/2471723299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x1d7f4a0 0x1d7f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:21.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.112+0000 7fa0c2d2a740 1 -- 172.21.15.114:0/2471723299 >> 172.21.15.114:0/2471723299 conn(0x1b11550 msgr2=0x1dabd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:21.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.112+0000 7fa0c2d2a740 1 -- 172.21.15.114:0/2471723299 shutdown_connections 2023-10-18T12:21:21.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.112+0000 7fa0c2d2a740 1 -- 172.21.15.114:0/2471723299 wait complete. 2023-10-18T12:21:21.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.112+0000 7fa0c2d2a740 1 -- start start 2023-10-18T12:21:21.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.112+0000 7fa0c2d2a740 1 Processor -- start 2023-10-18T12:21:21.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.116+0000 7fa0c2d2a740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x1d7f4a0 0x1dad310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:21.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.116+0000 7fa0c2d2a740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1da8ad0 0x1d83630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:21.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.116+0000 7fa0c2d2a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x1dc5d30 0x1d823c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:21.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.116+0000 7fa0c2d2a740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x1cabb00 con 0x1da8ad0 2023-10-18T12:21:21.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.116+0000 7fa0c2d2a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x1caa470 con 0x1dc5d30 2023-10-18T12:21:21.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.116+0000 7fa0c2d2a740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b95b20 con 0x1d7f4a0 2023-10-18T12:21:21.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.116+0000 7fa0c2d2a740 10 client.0 _ll_register_callbacks cb 0x1ce4810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T12:21:21.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.116+0000 7fa0bd022700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1da8ad0 0x1d83630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:21.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.116+0000 7fa0bd022700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1da8ad0 0x1d83630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39376/0 (socket says 172.21.15.114:39376) 2023-10-18T12:21:21.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.116+0000 7fa0bd022700 1 -- 172.21.15.114:0/872322693 learned_addr learned my addr 172.21.15.114:0/872322693 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:21.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.116+0000 7fa0bd823700 1 --2- 172.21.15.114:0/872322693 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x1d7f4a0 0x1dad310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:21.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.116+0000 7fa0be024700 1 --2- 172.21.15.114:0/872322693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x1dc5d30 0x1d823c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:21.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.116+0000 7fa0bd022700 1 -- 172.21.15.114:0/872322693 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x1d7f4a0 msgr2=0x1dad310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:21.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.116+0000 7fa0bd022700 1 --2- 172.21.15.114:0/872322693 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x1d7f4a0 0x1dad310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:21.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.116+0000 7fa0bd022700 1 -- 172.21.15.114:0/872322693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x1dc5d30 msgr2=0x1d823c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:21.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.116+0000 7fa0bd022700 1 --2- 172.21.15.114:0/872322693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x1dc5d30 0x1d823c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:21.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.116+0000 7fa0bd022700 1 -- 172.21.15.114:0/872322693 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0b806e710 con 0x1da8ad0 2023-10-18T12:21:21.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.116+0000 7fa0bd022700 1 --2- 172.21.15.114:0/872322693 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1da8ad0 0x1d83630 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa0a800cfd0 tx=0x7fa0a801e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30c68cb2336476c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:21.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.116+0000 7fa098ff9700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T12:21:21.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.116+0000 7fa098ff9700 1 -- 172.21.15.114:0/872322693 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a806e070 con 0x1da8ad0 2023-10-18T12:21:21.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.116+0000 7fa098ff9700 1 -- 172.21.15.114:0/872322693 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(44..44 src has 1..44) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fa0a805b460 con 0x1da8ad0 2023-10-18T12:21:21.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.116+0000 7fa0c2d2a740 1 -- 172.21.15.114:0/872322693 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1ce3f50 con 0x1da8ad0 2023-10-18T12:21:21.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.120+0000 7fa098ff9700 1 -- 172.21.15.114:0/872322693 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa0a805b620 con 0x1da8ad0 2023-10-18T12:21:21.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.120+0000 7fa0c2d2a740 10 client.5709 fetch_fsmap learned FSMap version 18 2023-10-18T12:21:21.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.120+0000 7fa0c2d2a740 1 -- 172.21.15.114:0/872322693 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x1b5c9e0 con 0x1da8ad0 2023-10-18T12:21:21.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.120+0000 7fa098ff9700 1 -- 172.21.15.114:0/872322693 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1ce3f50 con 0x1da8ad0 2023-10-18T12:21:21.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.120+0000 7fa098ff9700 1 -- 172.21.15.114:0/872322693 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 18) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa0a8071020 con 0x1da8ad0 2023-10-18T12:21:21.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.120+0000 7fa0c2d2a740 10 client.5709 fetch_fsmap finished waiting for FSMap version 18 2023-10-18T12:21:21.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.120+0000 7fa0c2d2a740 10 client.5709 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-18T12:21:21.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.120+0000 7fa0c2d2a740 20 client.5709 populate_metadata read hostname 'smithi114' 2023-10-18T12:21:21.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.120+0000 7fa0c2d2a740 1 --2- 172.21.15.114:0/872322693 >> [v2:172.21.15.114:6834/1284474820,v1:172.21.15.114:6835/1284474820] conn(0x1d82900 0x1dd34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:21.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.120+0000 7fa0c2d2a740 4 client.5709 mds_command: new command op to 5544 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-18T12:21:21.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.120+0000 7fa0c2d2a740 1 -- 172.21.15.114:0/872322693 --> [v2:172.21.15.114:6834/1284474820,v1:172.21.15.114:6835/1284474820] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1ce3c70 con 0x1d82900 2023-10-18T12:21:21.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.120+0000 7fa0bd823700 1 --2- 172.21.15.114:0/872322693 >> [v2:172.21.15.114:6834/1284474820,v1:172.21.15.114:6835/1284474820] conn(0x1d82900 0x1dd34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:21.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.120+0000 7fa0bd823700 1 --2- 172.21.15.114:0/872322693 >> [v2:172.21.15.114:6834/1284474820,v1:172.21.15.114:6835/1284474820] conn(0x1d82900 0x1dd34a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ec6a43ceb790ea1 server_cookie=d83a01912f9556d8 in_seq=0 out_seq=0 2023-10-18T12:21:21.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.120+0000 7fa098ff9700 10 client.5709 ms_handle_connect on v2:172.21.15.114:6834/1284474820 2023-10-18T12:21:21.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.120+0000 7fa098ff9700 1 -- 172.21.15.114:0/872322693 <== mds.0 v2:172.21.15.114:6834/1284474820 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x1ce3c70 con 0x1d82900 2023-10-18T12:21:21.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.120+0000 7fa098ff9700 10 client.5709 handle_command_reply: tid=0 2023-10-18T12:21:21.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.120+0000 7fa0c2d2a740 1 client.5709 shutdown 2023-10-18T12:21:21.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.120+0000 7fa0c2d2a740 1 -- 172.21.15.114:0/872322693 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1da8ad0 msgr2=0x1d83630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:21.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.120+0000 7fa0c2d2a740 1 --2- 172.21.15.114:0/872322693 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1da8ad0 0x1d83630 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa0a800cfd0 tx=0x7fa0a801e070 comp rx=0 tx=0).stop 2023-10-18T12:21:21.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.124+0000 7fa0c2d2a740 1 -- 172.21.15.114:0/872322693 shutdown_connections 2023-10-18T12:21:21.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.124+0000 7fa0c2d2a740 1 --2- 172.21.15.114:0/872322693 >> [v2:172.21.15.114:6834/1284474820,v1:172.21.15.114:6835/1284474820] conn(0x1d82900 0x1dd34a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:21.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.124+0000 7fa0c2d2a740 1 --2- 172.21.15.114:0/872322693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x1dc5d30 0x1d823c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:21.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.124+0000 7fa0c2d2a740 1 --2- 172.21.15.114:0/872322693 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1da8ad0 0x1d83630 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:21.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.124+0000 7fa0c2d2a740 1 --2- 172.21.15.114:0/872322693 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x1d7f4a0 0x1dad310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:21.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.124+0000 7fa0c2d2a740 1 -- 172.21.15.114:0/872322693 >> 172.21.15.114:0/872322693 conn(0x1b11550 msgr2=0x1d7e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:21.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.124+0000 7fa098ff9700 0 client.5709 ms_handle_reset on v2:172.21.15.114:6834/1284474820 2023-10-18T12:21:21.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.124+0000 7fa0c2d2a740 1 -- 172.21.15.114:0/872322693 shutdown_connections 2023-10-18T12:21:21.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.124+0000 7fa0c2d2a740 1 -- 172.21.15.114:0/872322693 wait complete. 2023-10-18T12:21:21.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.124+0000 7fa0c2d2a740 20 client.5709 trim_cache size 0 max 16384 2023-10-18T12:21:21.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.140+0000 7fa0c2d2a740 1 Processor -- start 2023-10-18T12:21:21.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.140+0000 7fa0c2d2a740 1 -- start start 2023-10-18T12:21:21.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.144+0000 7fa0c2d2a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x1d7f4a0 0x1d80880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:21.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.144+0000 7fa0c2d2a740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1da8ad0 0x1dabed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:21.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.144+0000 7fa0c2d2a740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x1dc5d30 0x1dac410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:21.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.144+0000 7fa0c2d2a740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x1cedad0 con 0x1da8ad0 2023-10-18T12:21:21.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.144+0000 7fa0c2d2a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ce68e0 con 0x1d7f4a0 2023-10-18T12:21:21.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.144+0000 7fa0c2d2a740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c8f330 con 0x1dc5d30 2023-10-18T12:21:21.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.144+0000 7fa0bd022700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1da8ad0 0x1dabed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:21.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.144+0000 7fa0bd022700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1da8ad0 0x1dabed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39390/0 (socket says 172.21.15.114:39390) 2023-10-18T12:21:21.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.144+0000 7fa0bd022700 1 -- 172.21.15.114:0/2329913207 learned_addr learned my addr 172.21.15.114:0/2329913207 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:21.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.144+0000 7fa0bd823700 1 --2- 172.21.15.114:0/2329913207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x1d7f4a0 0x1d80880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:21.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.144+0000 7fa0bd022700 1 -- 172.21.15.114:0/2329913207 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x1dc5d30 msgr2=0x1dac410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:21.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.144+0000 7fa0be024700 1 --2- 172.21.15.114:0/2329913207 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x1dc5d30 0x1dac410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:21.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.144+0000 7fa0bd022700 1 --2- 172.21.15.114:0/2329913207 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x1dc5d30 0x1dac410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:21.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.144+0000 7fa0bd022700 1 -- 172.21.15.114:0/2329913207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x1d7f4a0 msgr2=0x1d80880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:21.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.144+0000 7fa0bd022700 1 --2- 172.21.15.114:0/2329913207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x1d7f4a0 0x1d80880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:21.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.144+0000 7fa0bd022700 1 -- 172.21.15.114:0/2329913207 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b815f510 con 0x1da8ad0 2023-10-18T12:21:21.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.144+0000 7fa0be024700 1 --2- 172.21.15.114:0/2329913207 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x1dc5d30 0x1dac410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:21:21.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.144+0000 7fa0bd022700 1 --2- 172.21.15.114:0/2329913207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1da8ad0 0x1dabed0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa0a80538e0 tx=0x7fa0a807c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2e34ace0500e21 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:21.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.144+0000 7fa09bfff700 1 -- 172.21.15.114:0/2329913207 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a806e040 con 0x1da8ad0 2023-10-18T12:21:21.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.144+0000 7fa09bfff700 1 -- 172.21.15.114:0/2329913207 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a807e070 con 0x1da8ad0 2023-10-18T12:21:21.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.144+0000 7fa09bfff700 1 -- 172.21.15.114:0/2329913207 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a8054b80 con 0x1da8ad0 2023-10-18T12:21:21.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.144+0000 7fa0c2d2a740 1 -- 172.21.15.114:0/2329913207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1da8ad0 msgr2=0x1dabed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:21.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.144+0000 7fa0c2d2a740 1 --2- 172.21.15.114:0/2329913207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1da8ad0 0x1dabed0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa0a80538e0 tx=0x7fa0a807c070 comp rx=0 tx=0).stop 2023-10-18T12:21:21.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.144+0000 7fa0c2d2a740 1 -- 172.21.15.114:0/2329913207 shutdown_connections 2023-10-18T12:21:21.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.144+0000 7fa0c2d2a740 1 --2- 172.21.15.114:0/2329913207 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x1dc5d30 0x1dac410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:21.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.144+0000 7fa0c2d2a740 1 --2- 172.21.15.114:0/2329913207 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1da8ad0 0x1dabed0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:21.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.144+0000 7fa0c2d2a740 1 --2- 172.21.15.114:0/2329913207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x1d7f4a0 0x1d80880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:21.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.144+0000 7fa0c2d2a740 1 -- 172.21.15.114:0/2329913207 >> 172.21.15.114:0/2329913207 conn(0x1b11550 msgr2=0x1d80170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:21.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.148+0000 7fa0c2d2a740 1 -- 172.21.15.114:0/2329913207 shutdown_connections 2023-10-18T12:21:21.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.148+0000 7fa0c2d2a740 1 -- 172.21.15.114:0/2329913207 wait complete. 2023-10-18T12:21:21.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.148+0000 7fa0c2d2a740 1 -- start start 2023-10-18T12:21:21.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.148+0000 7fa0c2d2a740 1 Processor -- start 2023-10-18T12:21:21.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.148+0000 7fa0c2d2a740 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x1d7f4a0 0x1dac310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:21.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.148+0000 7fa0c2d2a740 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x1da8ad0 0x1de1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:21.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.148+0000 7fa0c2d2a740 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1dc5d30 0x1de24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:21.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.148+0000 7fa0c2d2a740 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x1cb8d50 con 0x1dc5d30 2023-10-18T12:21:21.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.148+0000 7fa0c2d2a740 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ce8370 con 0x1d7f4a0 2023-10-18T12:21:21.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.148+0000 7fa0c2d2a740 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x1cabb00 con 0x1da8ad0 2023-10-18T12:21:21.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.152+0000 7fa0c2d2a740 10 client.0 _ll_register_callbacks cb 0x1c97120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-18T12:21:21.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.152+0000 7fa0be024700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1dc5d30 0x1de24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:21.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.152+0000 7fa0be024700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1dc5d30 0x1de24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39394/0 (socket says 172.21.15.114:39394) 2023-10-18T12:21:21.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.152+0000 7fa0be024700 1 -- 172.21.15.114:0/4140490670 learned_addr learned my addr 172.21.15.114:0/4140490670 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:21.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.152+0000 7fa0bd022700 1 --2- 172.21.15.114:0/4140490670 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x1da8ad0 0x1de1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:21.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.152+0000 7fa0bd823700 1 --2- 172.21.15.114:0/4140490670 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x1d7f4a0 0x1dac310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:21.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.152+0000 7fa0be024700 1 -- 172.21.15.114:0/4140490670 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x1da8ad0 msgr2=0x1de1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:21.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.152+0000 7fa0be024700 1 --2- 172.21.15.114:0/4140490670 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x1da8ad0 0x1de1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:21.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.152+0000 7fa0be024700 1 -- 172.21.15.114:0/4140490670 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x1d7f4a0 msgr2=0x1dac310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:21.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.152+0000 7fa0be024700 1 --2- 172.21.15.114:0/4140490670 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x1d7f4a0 0x1dac310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:21.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.152+0000 7fa0be024700 1 -- 172.21.15.114:0/4140490670 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1b5c9e0 con 0x1dc5d30 2023-10-18T12:21:21.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.152+0000 7fa0be024700 1 --2- 172.21.15.114:0/4140490670 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1dc5d30 0x1de24b0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0017dc0 tx=0x7fa0b00155b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f047769c065de5b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:21.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.152+0000 7fa098ff9700 10 client.0 ms_handle_connect on v2:172.21.15.114:3300/0 2023-10-18T12:21:21.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.152+0000 7fa098ff9700 1 -- 172.21.15.114:0/4140490670 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b000e040 con 0x1dc5d30 2023-10-18T12:21:21.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.152+0000 7fa098ff9700 1 -- 172.21.15.114:0/4140490670 <== mon.0 v2:172.21.15.114:3300/0 2 ==== osd_map(44..44 src has 1..44) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fa0b0024d80 con 0x1dc5d30 2023-10-18T12:21:21.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.152+0000 7fa0c2d2a740 1 -- 172.21.15.114:0/4140490670 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa0a805b8f0 con 0x1dc5d30 2023-10-18T12:21:21.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.152+0000 7fa098ff9700 1 -- 172.21.15.114:0/4140490670 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa0b0015d50 con 0x1dc5d30 2023-10-18T12:21:21.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.152+0000 7fa0c2d2a740 10 client.5715 fetch_fsmap learned FSMap version 18 2023-10-18T12:21:21.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.152+0000 7fa0c2d2a740 1 -- 172.21.15.114:0/4140490670 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x1caf250 con 0x1dc5d30 2023-10-18T12:21:21.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.152+0000 7fa098ff9700 1 -- 172.21.15.114:0/4140490670 <== mon.0 v2:172.21.15.114:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a805b8f0 con 0x1dc5d30 2023-10-18T12:21:21.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.152+0000 7fa098ff9700 1 -- 172.21.15.114:0/4140490670 <== mon.0 v2:172.21.15.114:3300/0 5 ==== fsmap(e 18) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa0b0019430 con 0x1dc5d30 2023-10-18T12:21:21.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.152+0000 7fa0c2d2a740 10 client.5715 fetch_fsmap finished waiting for FSMap version 18 2023-10-18T12:21:21.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.152+0000 7fa0c2d2a740 10 client.5715 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-18T12:21:21.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.152+0000 7fa0c2d2a740 20 client.5715 populate_metadata read hostname 'smithi114' 2023-10-18T12:21:21.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.152+0000 7fa0c2d2a740 1 --2- 172.21.15.114:0/4140490670 >> [v2:172.21.15.114:6834/1284474820,v1:172.21.15.114:6835/1284474820] conn(0x1e2b180 0x1e2b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:21.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.152+0000 7fa0c2d2a740 4 client.5715 mds_command: new command op to 5544 tid=0[{"prefix": "status"}] 2023-10-18T12:21:21.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.152+0000 7fa0c2d2a740 1 -- 172.21.15.114:0/4140490670 --> [v2:172.21.15.114:6834/1284474820,v1:172.21.15.114:6835/1284474820] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1b684e0 con 0x1e2b180 2023-10-18T12:21:21.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.152+0000 7fa0bd823700 1 --2- 172.21.15.114:0/4140490670 >> [v2:172.21.15.114:6834/1284474820,v1:172.21.15.114:6835/1284474820] conn(0x1e2b180 0x1e2b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:21.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.152+0000 7fa0bd823700 1 --2- 172.21.15.114:0/4140490670 >> [v2:172.21.15.114:6834/1284474820,v1:172.21.15.114:6835/1284474820] conn(0x1e2b180 0x1e2b560 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42b9eca76dd92850 server_cookie=3833beadb988e53f in_seq=0 out_seq=0 2023-10-18T12:21:21.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.152+0000 7fa098ff9700 10 client.5715 ms_handle_connect on v2:172.21.15.114:6834/1284474820 2023-10-18T12:21:21.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.156+0000 7fa098ff9700 1 -- 172.21.15.114:0/4140490670 <== mds.0 v2:172.21.15.114:6834/1284474820 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x1b684e0 con 0x1e2b180 2023-10-18T12:21:21.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.156+0000 7fa098ff9700 10 client.5715 handle_command_reply: tid=0 2023-10-18T12:21:21.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.156+0000 7fa0c2d2a740 1 client.5715 shutdown 2023-10-18T12:21:21.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.156+0000 7fa0c2d2a740 1 -- 172.21.15.114:0/4140490670 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1dc5d30 msgr2=0x1de24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:21.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.156+0000 7fa0c2d2a740 1 --2- 172.21.15.114:0/4140490670 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1dc5d30 0x1de24b0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0017dc0 tx=0x7fa0b00155b0 comp rx=0 tx=0).stop 2023-10-18T12:21:21.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.156+0000 7fa0c2d2a740 1 -- 172.21.15.114:0/4140490670 shutdown_connections 2023-10-18T12:21:21.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.156+0000 7fa0c2d2a740 1 --2- 172.21.15.114:0/4140490670 >> [v2:172.21.15.114:6834/1284474820,v1:172.21.15.114:6835/1284474820] conn(0x1e2b180 0x1e2b560 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:21.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.156+0000 7fa0c2d2a740 1 --2- 172.21.15.114:0/4140490670 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x1da8ad0 0x1de1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:21.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.156+0000 7fa098ff9700 0 client.5715 ms_handle_reset on v2:172.21.15.114:6834/1284474820 2023-10-18T12:21:21.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.156+0000 7fa0c2d2a740 1 --2- 172.21.15.114:0/4140490670 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x1dc5d30 0x1de24b0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:21.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.156+0000 7fa0c2d2a740 1 --2- 172.21.15.114:0/4140490670 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x1d7f4a0 0x1dac310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:21.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.156+0000 7fa0c2d2a740 1 -- 172.21.15.114:0/4140490670 >> 172.21.15.114:0/4140490670 conn(0x1b11550 msgr2=0x1dd92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:21.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.156+0000 7fa0c2d2a740 1 -- 172.21.15.114:0/4140490670 shutdown_connections 2023-10-18T12:21:21.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.156+0000 7fa0c2d2a740 1 -- 172.21.15.114:0/4140490670 wait complete. 2023-10-18T12:21:21.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.156+0000 7fa0c2d2a740 20 client.5715 trim_cache size 0 max 16384 2023-10-18T12:21:21.170 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T12:21:21.170 INFO:teuthology.orchestra.run.smithi114.stdout: "cluster_fsid": "240ea340-5d3d-4f52-a4bc-af075aca3deb", 2023-10-18T12:21:21.170 INFO:teuthology.orchestra.run.smithi114.stdout: "whoami": 0, 2023-10-18T12:21:21.171 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 5544, 2023-10-18T12:21:21.171 INFO:teuthology.orchestra.run.smithi114.stdout: "want_state": "up:active", 2023-10-18T12:21:21.171 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "up:active", 2023-10-18T12:21:21.171 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs", 2023-10-18T12:21:21.171 INFO:teuthology.orchestra.run.smithi114.stdout: "rank_uptime": 6.4526457600000002, 2023-10-18T12:21:21.171 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 18, 2023-10-18T12:21:21.172 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch": 44, 2023-10-18T12:21:21.172 INFO:teuthology.orchestra.run.smithi114.stdout: "osdmap_epoch_barrier": 42, 2023-10-18T12:21:21.172 INFO:teuthology.orchestra.run.smithi114.stdout: "uptime": 16.354703675 2023-10-18T12:21:21.172 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T12:21:21.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.156+0000 7fa0be825700 1 -- 172.21.15.114:0/2875309566 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa09c0656f0 msgr2=0x7fa09c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:21.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.156+0000 7fa0be825700 1 --2- 172.21.15.114:0/2875309566 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa09c0656f0 0x7fa09c067bb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa0b40090b0 tx=0x7fa0b401c040 comp rx=0 tx=0).stop 2023-10-18T12:21:21.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.156+0000 7fa0be825700 1 -- 172.21.15.114:0/2875309566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0b80cb500 msgr2=0x7fa0b815ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:21.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.156+0000 7fa0be825700 1 --2- 172.21.15.114:0/2875309566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0b80cb500 0x7fa0b815ba70 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa0a800c780 tx=0x7fa0a800cb40 comp rx=0 tx=0).stop 2023-10-18T12:21:21.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.156+0000 7fa0be825700 1 -- 172.21.15.114:0/2875309566 shutdown_connections 2023-10-18T12:21:21.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.156+0000 7fa0be825700 1 --2- 172.21.15.114:0/2875309566 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa09c0656f0 0x7fa09c067bb0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:21.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.156+0000 7fa0be825700 1 --2- 172.21.15.114:0/2875309566 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0b8160e50 0x7fa0b815ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:21.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.156+0000 7fa0be825700 1 --2- 172.21.15.114:0/2875309566 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0b80cb500 0x7fa0b815ba70 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:21.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.156+0000 7fa0be825700 1 --2- 172.21.15.114:0/2875309566 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa0b80b28f0 0x7fa0b80cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:21.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.156+0000 7fa0be825700 1 -- 172.21.15.114:0/2875309566 >> 172.21.15.114:0/2875309566 conn(0x7fa0b80b0bf0 msgr2=0x7fa0b80ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:21.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.156+0000 7fa0be825700 1 -- 172.21.15.114:0/2875309566 shutdown_connections 2023-10-18T12:21:21.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.156+0000 7fa0be825700 1 -- 172.21.15.114:0/2875309566 wait complete. 2023-10-18T12:21:21.185 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-18T12:21:21.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.364+0000 7fcca1e8e700 1 Processor -- start 2023-10-18T12:21:21.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.368+0000 7fcca1e8e700 1 -- start start 2023-10-18T12:21:21.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.368+0000 7fcca1e8e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc9c070c70 0x7fcc9c0cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:21.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.368+0000 7fcca1e8e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcc9c0cde70 0x7fcc9c06cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:21.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.368+0000 7fcca1e8e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc9c0b14f0 con 0x7fcc9c159750 2023-10-18T12:21:21.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.368+0000 7fcca1e8e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc9c0c9aa0 con 0x7fcc9c0cde70 2023-10-18T12:21:21.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.368+0000 7fcca1e8e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9c15d590 con 0x7fcc9c070c70 2023-10-18T12:21:21.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.368+0000 7fcca168d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcc9c0cde70 0x7fcc9c06cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:21.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.368+0000 7fcca168d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcc9c0cde70 0x7fcc9c06cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39398/0 (socket says 172.21.15.114:39398) 2023-10-18T12:21:21.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.368+0000 7fcca168d700 1 -- 172.21.15.114:0/2166405570 learned_addr learned my addr 172.21.15.114:0/2166405570 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:21.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.368+0000 7fcc9bfff700 1 --2- 172.21.15.114:0/2166405570 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc9c070c70 0x7fcc9c0cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:21.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.368+0000 7fcca168d700 1 -- 172.21.15.114:0/2166405570 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc9c070c70 msgr2=0x7fcc9c0cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:21.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.368+0000 7fcca168d700 1 --2- 172.21.15.114:0/2166405570 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc9c070c70 0x7fcc9c0cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:21.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.368+0000 7fcca168d700 1 -- 172.21.15.114:0/2166405570 >> v1:172.21.15.114:6789/0 conn(0x7fcc9c159750 legacy=0x7fcc9c070560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:21.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.368+0000 7fcca168d700 1 -- 172.21.15.114:0/2166405570 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc9c15d870 con 0x7fcc9c0cde70 2023-10-18T12:21:21.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.372+0000 7fcca168d700 1 --2- 172.21.15.114:0/2166405570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc9c0cde70 0x7fcc9c06cf20 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fcc94009e50 tx=0x7fcc9400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1340352febc74546 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:21.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.372+0000 7fcc9b7fe700 1 -- 172.21.15.114:0/2166405570 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9400e070 con 0x7fcc9c0cde70 2023-10-18T12:21:21.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.372+0000 7fcc9b7fe700 1 -- 172.21.15.114:0/2166405570 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9400b910 con 0x7fcc9c0cde70 2023-10-18T12:21:21.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.372+0000 7fcc9b7fe700 1 -- 172.21.15.114:0/2166405570 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9400bcc0 con 0x7fcc9c0cde70 2023-10-18T12:21:21.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.372+0000 7fcca1e8e700 1 -- 172.21.15.114:0/2166405570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc9c0cde70 msgr2=0x7fcc9c06cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:21.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.372+0000 7fcca1e8e700 1 --2- 172.21.15.114:0/2166405570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc9c0cde70 0x7fcc9c06cf20 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fcc94009e50 tx=0x7fcc9400b330 comp rx=0 tx=0).stop 2023-10-18T12:21:21.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.372+0000 7fcca1e8e700 1 -- 172.21.15.114:0/2166405570 shutdown_connections 2023-10-18T12:21:21.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.372+0000 7fcca1e8e700 1 --2- 172.21.15.114:0/2166405570 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc9c0cde70 0x7fcc9c06cf20 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:21.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.372+0000 7fcca1e8e700 1 --2- 172.21.15.114:0/2166405570 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc9c070c70 0x7fcc9c0cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:21.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.372+0000 7fcca1e8e700 1 -- 172.21.15.114:0/2166405570 >> 172.21.15.114:0/2166405570 conn(0x7fcc9c0ce5c0 msgr2=0x7fcc9c0ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:21.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.372+0000 7fcca1e8e700 1 -- 172.21.15.114:0/2166405570 shutdown_connections 2023-10-18T12:21:21.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.372+0000 7fcca1e8e700 1 -- 172.21.15.114:0/2166405570 wait complete. 2023-10-18T12:21:21.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.376+0000 7fcca1e8e700 1 Processor -- start 2023-10-18T12:21:21.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.376+0000 7fcca1e8e700 1 -- start start 2023-10-18T12:21:21.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.376+0000 7fcca1e8e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc9c070c70 0x7fcc9c0b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:21.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.376+0000 7fcca1e8e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc9c0cde70 0x7fcc9c1585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:21.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.376+0000 7fcca1e8e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc9c159750 0x7fcc9c14de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:21.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.376+0000 7fcca1e8e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9c14ecf0 con 0x7fcc9c0cde70 2023-10-18T12:21:21.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.376+0000 7fcca1e8e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9c14ea10 con 0x7fcc9c159750 2023-10-18T12:21:21.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.376+0000 7fcca1e8e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9c1545a0 con 0x7fcc9c070c70 2023-10-18T12:21:21.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.376+0000 7fcc9bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc9c0cde70 0x7fcc9c1585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:21.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.376+0000 7fcc9bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc9c0cde70 0x7fcc9c1585c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39408/0 (socket says 172.21.15.114:39408) 2023-10-18T12:21:21.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.376+0000 7fcc9bfff700 1 -- 172.21.15.114:0/2558367443 learned_addr learned my addr 172.21.15.114:0/2558367443 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:21.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.376+0000 7fcca0e8c700 1 --2- 172.21.15.114:0/2558367443 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc9c070c70 0x7fcc9c0b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:21.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.376+0000 7fcca168d700 1 --2- 172.21.15.114:0/2558367443 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc9c159750 0x7fcc9c14de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:21.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.376+0000 7fcc9bfff700 1 -- 172.21.15.114:0/2558367443 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc9c070c70 msgr2=0x7fcc9c0b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:21.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.376+0000 7fcc9bfff700 1 --2- 172.21.15.114:0/2558367443 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc9c070c70 0x7fcc9c0b16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:21.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.376+0000 7fcc9bfff700 1 -- 172.21.15.114:0/2558367443 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc9c159750 msgr2=0x7fcc9c14de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:21.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.376+0000 7fcc9bfff700 1 --2- 172.21.15.114:0/2558367443 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc9c159750 0x7fcc9c14de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:21.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.376+0000 7fcc9bfff700 1 -- 172.21.15.114:0/2558367443 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc94009b30 con 0x7fcc9c0cde70 2023-10-18T12:21:21.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.380+0000 7fcca0e8c700 1 --2- 172.21.15.114:0/2558367443 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc9c070c70 0x7fcc9c0b16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:21:21.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.380+0000 7fcc9bfff700 1 --2- 172.21.15.114:0/2558367443 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc9c0cde70 0x7fcc9c1585c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fcc8800e9d0 tx=0x7fcc8800ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:21.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.380+0000 7fcc997fa700 1 -- 172.21.15.114:0/2558367443 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc88009720 con 0x7fcc9c0cde70 2023-10-18T12:21:21.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.380+0000 7fcc997fa700 1 -- 172.21.15.114:0/2558367443 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc8800c850 con 0x7fcc9c0cde70 2023-10-18T12:21:21.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.380+0000 7fcca1e8e700 1 -- 172.21.15.114:0/2558367443 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc9c154880 con 0x7fcc9c0cde70 2023-10-18T12:21:21.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.380+0000 7fcc997fa700 1 -- 172.21.15.114:0/2558367443 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8800cbc0 con 0x7fcc9c0cde70 2023-10-18T12:21:21.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.380+0000 7fcca1e8e700 1 -- 172.21.15.114:0/2558367443 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc9c0c4b80 con 0x7fcc9c0cde70 2023-10-18T12:21:21.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.380+0000 7fcca1e8e700 1 -- 172.21.15.114:0/2558367443 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc9c072e60 con 0x7fcc9c0cde70 2023-10-18T12:21:21.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.384+0000 7fcc997fa700 1 -- 172.21.15.114:0/2558367443 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fcc8800cd20 con 0x7fcc9c0cde70 2023-10-18T12:21:21.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.384+0000 7fcc997fa700 1 --2- 172.21.15.114:0/2558367443 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fcc80065720 0x7fcc80067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:21.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.384+0000 7fcc997fa700 1 -- 172.21.15.114:0/2558367443 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fcc88083060 con 0x7fcc9c0cde70 2023-10-18T12:21:21.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.384+0000 7fcca0e8c700 1 --2- 172.21.15.114:0/2558367443 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fcc80065720 0x7fcc80067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:21.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.384+0000 7fcca0e8c700 1 --2- 172.21.15.114:0/2558367443 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fcc80065720 0x7fcc80067be0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcc90000f60 tx=0x7fcc90009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:21.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.388+0000 7fcc997fa700 1 -- 172.21.15.114:0/2558367443 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fcc880b3d40 con 0x7fcc9c0cde70 2023-10-18T12:21:21.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.764+0000 7fcca1e8e700 1 -- 172.21.15.114:0/2558367443 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcc9c14b9d0 con 0x7fcc9c0cde70 2023-10-18T12:21:21.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.764+0000 7fcc997fa700 1 -- 172.21.15.114:0/2558367443 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+73 (secure 0 0 0) 0x7fcc88054420 con 0x7fcc9c0cde70 2023-10-18T12:21:21.769 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-18T12:21:21.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.768+0000 7fcca1e8e700 1 -- 172.21.15.114:0/2558367443 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fcc80065720 msgr2=0x7fcc80067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:21.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.768+0000 7fcca1e8e700 1 --2- 172.21.15.114:0/2558367443 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fcc80065720 0x7fcc80067be0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcc90000f60 tx=0x7fcc90009040 comp rx=0 tx=0).stop 2023-10-18T12:21:21.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.768+0000 7fcca1e8e700 1 -- 172.21.15.114:0/2558367443 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc9c0cde70 msgr2=0x7fcc9c1585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:21.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.768+0000 7fcca1e8e700 1 --2- 172.21.15.114:0/2558367443 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc9c0cde70 0x7fcc9c1585c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fcc8800e9d0 tx=0x7fcc8800ed90 comp rx=0 tx=0).stop 2023-10-18T12:21:21.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.768+0000 7fcca1e8e700 1 -- 172.21.15.114:0/2558367443 shutdown_connections 2023-10-18T12:21:21.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.768+0000 7fcca1e8e700 1 --2- 172.21.15.114:0/2558367443 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fcc80065720 0x7fcc80067be0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:21.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.768+0000 7fcca1e8e700 1 --2- 172.21.15.114:0/2558367443 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc9c159750 0x7fcc9c14de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:21.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.768+0000 7fcca1e8e700 1 --2- 172.21.15.114:0/2558367443 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc9c0cde70 0x7fcc9c1585c0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:21.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.768+0000 7fcca1e8e700 1 --2- 172.21.15.114:0/2558367443 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc9c070c70 0x7fcc9c0b16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:21.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.768+0000 7fcca1e8e700 1 -- 172.21.15.114:0/2558367443 >> 172.21.15.114:0/2558367443 conn(0x7fcc9c0ce5c0 msgr2=0x7fcc9c14c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:21.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.768+0000 7fcca1e8e700 1 -- 172.21.15.114:0/2558367443 shutdown_connections 2023-10-18T12:21:21.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:21.768+0000 7fcca1e8e700 1 -- 172.21.15.114:0/2558367443 wait complete. 2023-10-18T12:21:21.799 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-18T12:21:21.799 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-18T12:21:21.799 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2023-10-18T12:21:21.800 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-18T12:21:21.800 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-18T12:21:21.800 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-18T12:21:21.801 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-18T12:21:21.801 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-18T12:21:21.801 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-18T12:21:21.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:21:21.802 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2023-10-18T12:21:21.822 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-18T12:21:21.823 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-18T12:21:21.823 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2023-10-18T12:21:21.823 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:21:21.824 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2023-10-18T12:21:21.824 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:21:21.824 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-18T12:21:21.824 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2023-10-18T12:21:21.824 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2023-10-18T12:21:21.825 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-18T12:21:21.825 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2023-10-18T12:21:21.825 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2023-10-18T12:21:21.825 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-18T12:21:21.825 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2023-10-18T12:21:21.826 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-18T12:21:21.826 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2023-10-18T12:21:21.826 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-18T12:21:21.826 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42270sec preferred_lft 42270sec 2023-10-18T12:21:21.826 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2023-10-18T12:21:21.827 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:21:21.827 INFO:teuthology.orchestra.run.smithi114.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-18T12:21:21.827 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 02:42:85:ed:49:1d brd ff:ff:ff:ff:ff:ff 2023-10-18T12:21:21.827 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-18T12:21:21.827 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:21:21.828 INFO:teuthology.orchestra.run.smithi114.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-18T12:21:21.828 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 5a:38:e4:bb:88:05 brd ff:ff:ff:ff:ff:ff 2023-10-18T12:21:21.828 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-18T12:21:21.828 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:21:21.828 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::5024:e8ff:fe3e:7146/64 scope link 2023-10-18T12:21:21.829 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:21:21.829 INFO:teuthology.orchestra.run.smithi114.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-18T12:21:21.829 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 5a:38:e4:bb:88:05 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-18T12:21:21.829 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::5838:e4ff:febb:8805/64 scope link 2023-10-18T12:21:21.829 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:21:21.830 INFO:teuthology.orchestra.run.smithi114.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-18T12:21:21.830 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether b2:9f:84:96:f1:b4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-18T12:21:21.830 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::b09f:84ff:fe96:f1b4/64 scope link 2023-10-18T12:21:21.830 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:21:21.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:21:21.831 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-18T12:21:21.899 INFO:teuthology.orchestra.run.smithi114.stdout:1 2023-10-18T12:21:21.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:21:21.903 DEBUG:teuthology.orchestra.run.smithi114:> route 2023-10-18T12:21:21.967 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2023-10-18T12:21:21.967 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-18T12:21:21.968 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-18T12:21:21.968 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-18T12:21:21.968 INFO:teuthology.orchestra.run.smithi114.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-18T12:21:21.968 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-10-18T12:21:21.968 INFO:teuthology.orchestra.run.smithi114.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-18T12:21:21.969 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-18T12:21:21.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:21:21.970 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-10-18T12:21:21.971 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-10-18T12:21:21.971 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-18T12:21:21.971 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-18T12:21:21.972 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-18T12:21:21.972 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-10-18T12:21:22.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:21:22.096 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2023-10-18T12:21:22.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-18T12:21:22.115 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-18T12:21:22.115 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-18T12:21:22.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:21:22.116 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2023-10-18T12:21:22.196 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-18T12:21:22.197 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-18T12:21:22.263 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-18T12:21:22.263 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-18T12:21:22.263 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-18T12:21:22.320 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-18T12:21:22.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:21:22.321 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-18T12:21:22.458 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-18T12:21:22.458 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-18T12:21:22.458 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2023-10-18T12:21:22.485 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-18T12:21:22.485 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-18T12:21:22.485 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2023-10-18T12:21:22.486 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.172:3300,172.21.15.172:3301" 2023-10-18T12:21:22.486 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-18T12:21:22.508 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-18T12:21:22.508 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-18T12:21:22.508 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2023-10-18T12:21:22.509 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.172:3300,172.21.15.172:3301" 2023-10-18T12:21:22.509 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-18T12:21:22.509 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.172:6789,172.21.15.172:6790" 2023-10-18T12:21:22.509 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.172:6789,172.21.15.172:6790:/ 2023-10-18T12:21:22.509 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=240ea340-5d3d-4f52-a4bc-af075aca3deb" will pass to kernel 2023-10-18T12:21:22.516 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-18T12:21:22.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:21:22.517 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-18T12:21:22.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:21:22.552 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-18T12:21:22.642 INFO:teuthology.orchestra.run.smithi114.stdout:client5521 2023-10-18T12:21:22.642 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:21:22.643 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-18T12:21:22.700 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-18T12:21:22.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.912+0000 7fb0dfa4d700 1 Processor -- start 2023-10-18T12:21:22.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.912+0000 7fb0dfa4d700 1 -- start start 2023-10-18T12:21:22.922 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.916+0000 7fb0dfa4d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb0d806e8a0 0x7fb0d80caf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:22.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.916+0000 7fb0dfa4d700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0d806f450 con 0x7fb0d80cb470 2023-10-18T12:21:22.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.916+0000 7fb0dfa4d700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0d80cb8a0 con 0x7fb0d815ee50 2023-10-18T12:21:22.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.916+0000 7fb0dfa4d700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0d806d4e0 con 0x7fb0d806e8a0 2023-10-18T12:21:22.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.916+0000 7fb0dcfe8700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb0d806e8a0 0x7fb0d80caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:22.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.916+0000 7fb0dcfe8700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb0d806e8a0 0x7fb0d80caf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39424/0 (socket says 172.21.15.114:39424) 2023-10-18T12:21:22.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.916+0000 7fb0dcfe8700 1 -- 172.21.15.114:0/2901940311 learned_addr learned my addr 172.21.15.114:0/2901940311 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:22.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.920+0000 7fb0dcfe8700 1 -- 172.21.15.114:0/2901940311 >> v1:172.21.15.172:6789/0 conn(0x7fb0d815ee50 legacy=0x7fb0d80cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:22.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.920+0000 7fb0dcfe8700 1 -- 172.21.15.114:0/2901940311 >> v1:172.21.15.114:6789/0 conn(0x7fb0d80cb470 legacy=0x7fb0d806f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:22.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.920+0000 7fb0dcfe8700 1 -- 172.21.15.114:0/2901940311 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d81624a0 con 0x7fb0d806e8a0 2023-10-18T12:21:22.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.920+0000 7fb0dcfe8700 1 --2- 172.21.15.114:0/2901940311 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0d806e8a0 0x7fb0d80caf30 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8009910 tx=0x7fb0c8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=715fb65fbfff944a server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:22.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.920+0000 7fb0cffff700 1 -- 172.21.15.114:0/2901940311 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c800ba60 con 0x7fb0d806e8a0 2023-10-18T12:21:22.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.920+0000 7fb0cffff700 1 -- 172.21.15.114:0/2901940311 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c800bbc0 con 0x7fb0d806e8a0 2023-10-18T12:21:22.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.920+0000 7fb0cffff700 1 -- 172.21.15.114:0/2901940311 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c8009e60 con 0x7fb0d806e8a0 2023-10-18T12:21:22.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.920+0000 7fb0dfa4d700 1 -- 172.21.15.114:0/2901940311 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0d806e8a0 msgr2=0x7fb0d80caf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:22.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.920+0000 7fb0dfa4d700 1 --2- 172.21.15.114:0/2901940311 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0d806e8a0 0x7fb0d80caf30 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8009910 tx=0x7fb0c8009c20 comp rx=0 tx=0).stop 2023-10-18T12:21:22.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.920+0000 7fb0dfa4d700 1 -- 172.21.15.114:0/2901940311 shutdown_connections 2023-10-18T12:21:22.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.920+0000 7fb0dfa4d700 1 --2- 172.21.15.114:0/2901940311 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0d806e8a0 0x7fb0d80caf30 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:22.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.920+0000 7fb0dfa4d700 1 -- 172.21.15.114:0/2901940311 >> 172.21.15.114:0/2901940311 conn(0x7fb0d806a340 msgr2=0x7fb0d80b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:22.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.920+0000 7fb0dfa4d700 1 -- 172.21.15.114:0/2901940311 shutdown_connections 2023-10-18T12:21:22.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.920+0000 7fb0dfa4d700 1 -- 172.21.15.114:0/2901940311 wait complete. 2023-10-18T12:21:22.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.924+0000 7fb0dfa4d700 1 Processor -- start 2023-10-18T12:21:22.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.924+0000 7fb0dfa4d700 1 -- start start 2023-10-18T12:21:22.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.924+0000 7fb0dfa4d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0d806e8a0 0x7fb0d81f60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:22.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.924+0000 7fb0dfa4d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0d80cb470 0x7fb0d8163730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:22.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.924+0000 7fb0dfa4d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb0d815ee50 0x7fb0d8163c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:22.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.924+0000 7fb0dfa4d700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d815dbb0 con 0x7fb0d80cb470 2023-10-18T12:21:22.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.924+0000 7fb0dfa4d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d815de90 con 0x7fb0d806e8a0 2023-10-18T12:21:22.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.924+0000 7fb0dfa4d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d815e170 con 0x7fb0d815ee50 2023-10-18T12:21:22.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.924+0000 7fb0dcfe8700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0d80cb470 0x7fb0d8163730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:22.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.924+0000 7fb0dcfe8700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0d80cb470 0x7fb0d8163730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39438/0 (socket says 172.21.15.114:39438) 2023-10-18T12:21:22.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.924+0000 7fb0dcfe8700 1 -- 172.21.15.114:0/1420536033 learned_addr learned my addr 172.21.15.114:0/1420536033 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:22.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.924+0000 7fb0dd7e9700 1 --2- 172.21.15.114:0/1420536033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0d806e8a0 0x7fb0d81f60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:22.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.924+0000 7fb0ddfea700 1 --2- 172.21.15.114:0/1420536033 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb0d815ee50 0x7fb0d8163c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:22.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.924+0000 7fb0dcfe8700 1 -- 172.21.15.114:0/1420536033 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb0d815ee50 msgr2=0x7fb0d8163c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:22.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.924+0000 7fb0dcfe8700 1 --2- 172.21.15.114:0/1420536033 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb0d815ee50 0x7fb0d8163c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:22.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.924+0000 7fb0dcfe8700 1 -- 172.21.15.114:0/1420536033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0d806e8a0 msgr2=0x7fb0d81f60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:22.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.924+0000 7fb0dcfe8700 1 --2- 172.21.15.114:0/1420536033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0d806e8a0 0x7fb0d81f60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:22.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.924+0000 7fb0dcfe8700 1 -- 172.21.15.114:0/1420536033 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c8009570 con 0x7fb0d80cb470 2023-10-18T12:21:22.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.924+0000 7fb0dd7e9700 1 --2- 172.21.15.114:0/1420536033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0d806e8a0 0x7fb0d81f60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:21:22.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.924+0000 7fb0ddfea700 1 --2- 172.21.15.114:0/1420536033 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb0d815ee50 0x7fb0d8163c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:21:22.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.924+0000 7fb0dcfe8700 1 --2- 172.21.15.114:0/1420536033 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0d80cb470 0x7fb0d8163730 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8014040 tx=0x7fb0c8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:22.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.928+0000 7fb0cdffb700 1 -- 172.21.15.114:0/1420536033 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c80036c0 con 0x7fb0d80cb470 2023-10-18T12:21:22.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.928+0000 7fb0cdffb700 1 -- 172.21.15.114:0/1420536033 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c801f070 con 0x7fb0d80cb470 2023-10-18T12:21:22.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.928+0000 7fb0cdffb700 1 -- 172.21.15.114:0/1420536033 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c8003a80 con 0x7fb0d80cb470 2023-10-18T12:21:22.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.928+0000 7fb0dfa4d700 1 -- 172.21.15.114:0/1420536033 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0d815e450 con 0x7fb0d80cb470 2023-10-18T12:21:22.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.928+0000 7fb0dfa4d700 1 -- 172.21.15.114:0/1420536033 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0d81f67e0 con 0x7fb0d80cb470 2023-10-18T12:21:22.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.928+0000 7fb0dfa4d700 1 -- 172.21.15.114:0/1420536033 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0d8072e60 con 0x7fb0d80cb470 2023-10-18T12:21:22.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.932+0000 7fb0cdffb700 1 -- 172.21.15.114:0/1420536033 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fb0c8003be0 con 0x7fb0d80cb470 2023-10-18T12:21:22.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.932+0000 7fb0cdffb700 1 --2- 172.21.15.114:0/1420536033 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb0bc0656f0 0x7fb0bc067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:22.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.932+0000 7fb0cdffb700 1 -- 172.21.15.114:0/1420536033 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fb0c8021070 con 0x7fb0d80cb470 2023-10-18T12:21:22.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.932+0000 7fb0dd7e9700 1 --2- 172.21.15.114:0/1420536033 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb0bc0656f0 0x7fb0bc067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:22.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.936+0000 7fb0dd7e9700 1 --2- 172.21.15.114:0/1420536033 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb0bc0656f0 0x7fb0bc067bb0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4001720 tx=0x7fb0d4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:22.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:22.936+0000 7fb0cdffb700 1 -- 172.21.15.114:0/1420536033 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fb0c80522e0 con 0x7fb0d80cb470 2023-10-18T12:21:23.242 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:23.235+0000 7fb0dfa4d700 1 -- 172.21.15.114:0/1420536033 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb0d80b1160 con 0x7fb0d80cb470 2023-10-18T12:21:23.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:23.235+0000 7fb0cdffb700 1 -- 172.21.15.114:0/1420536033 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb0c8055900 con 0x7fb0d80cb470 2023-10-18T12:21:23.244 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-18T12:21:23.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:23.239+0000 7fb0dfa4d700 1 -- 172.21.15.114:0/1420536033 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb0bc0656f0 msgr2=0x7fb0bc067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:23.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:23.239+0000 7fb0dfa4d700 1 --2- 172.21.15.114:0/1420536033 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb0bc0656f0 0x7fb0bc067bb0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4001720 tx=0x7fb0d4009040 comp rx=0 tx=0).stop 2023-10-18T12:21:23.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:23.239+0000 7fb0dfa4d700 1 -- 172.21.15.114:0/1420536033 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0d80cb470 msgr2=0x7fb0d8163730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:23.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:23.239+0000 7fb0dfa4d700 1 --2- 172.21.15.114:0/1420536033 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0d80cb470 0x7fb0d8163730 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8014040 tx=0x7fb0c8004770 comp rx=0 tx=0).stop 2023-10-18T12:21:23.247 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:23.239+0000 7fb0dfa4d700 1 -- 172.21.15.114:0/1420536033 shutdown_connections 2023-10-18T12:21:23.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:23.239+0000 7fb0dfa4d700 1 --2- 172.21.15.114:0/1420536033 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb0bc0656f0 0x7fb0bc067bb0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:23.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:23.239+0000 7fb0dfa4d700 1 --2- 172.21.15.114:0/1420536033 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb0d815ee50 0x7fb0d8163c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:23.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:23.239+0000 7fb0dfa4d700 1 --2- 172.21.15.114:0/1420536033 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0d80cb470 0x7fb0d8163730 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:23.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:23.239+0000 7fb0dfa4d700 1 --2- 172.21.15.114:0/1420536033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0d806e8a0 0x7fb0d81f60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:23.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:23.239+0000 7fb0dfa4d700 1 -- 172.21.15.114:0/1420536033 >> 172.21.15.114:0/1420536033 conn(0x7fb0d806a340 msgr2=0x7fb0d8160c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:23.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:23.239+0000 7fb0dfa4d700 1 -- 172.21.15.114:0/1420536033 shutdown_connections 2023-10-18T12:21:23.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:23.239+0000 7fb0dfa4d700 1 -- 172.21.15.114:0/1420536033 wait complete. 2023-10-18T12:21:23.268 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-18T12:21:23.268 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-18T12:21:23.268 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi172.front.sepia.ceph.com 2023-10-18T12:21:23.269 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-18T12:21:23.269 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-18T12:21:23.269 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-18T12:21:23.270 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-18T12:21:23.270 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-18T12:21:23.270 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-18T12:21:23.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:21:23.271 DEBUG:teuthology.orchestra.run.smithi172:> ip addr 2023-10-18T12:21:23.290 INFO:teuthology.orchestra.run.smithi172.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-18T12:21:23.290 INFO:teuthology.orchestra.run.smithi172.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-18T12:21:23.290 INFO:teuthology.orchestra.run.smithi172.stdout: inet 127.0.0.1/8 scope host lo 2023-10-18T12:21:23.291 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:21:23.291 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 ::1/128 scope host 2023-10-18T12:21:23.291 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:21:23.291 INFO:teuthology.orchestra.run.smithi172.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-18T12:21:23.291 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2c brd ff:ff:ff:ff:ff:ff 2023-10-18T12:21:23.292 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f0 2023-10-18T12:21:23.292 INFO:teuthology.orchestra.run.smithi172.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-18T12:21:23.292 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:d9:17:2d brd ff:ff:ff:ff:ff:ff 2023-10-18T12:21:23.292 INFO:teuthology.orchestra.run.smithi172.stdout: altname enp7s0f1 2023-10-18T12:21:23.292 INFO:teuthology.orchestra.run.smithi172.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-18T12:21:23.293 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:90 brd ff:ff:ff:ff:ff:ff 2023-10-18T12:21:23.293 INFO:teuthology.orchestra.run.smithi172.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-18T12:21:23.293 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 0c:c4:7a:88:7f:91 brd ff:ff:ff:ff:ff:ff 2023-10-18T12:21:23.293 INFO:teuthology.orchestra.run.smithi172.stdout: inet 172.21.15.172/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-18T12:21:23.293 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft 42303sec preferred_lft 42303sec 2023-10-18T12:21:23.293 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::ec4:7aff:fe88:7f91/64 scope link 2023-10-18T12:21:23.294 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:21:23.294 INFO:teuthology.orchestra.run.smithi172.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-18T12:21:23.294 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 02:42:7e:42:a3:79 brd ff:ff:ff:ff:ff:ff 2023-10-18T12:21:23.294 INFO:teuthology.orchestra.run.smithi172.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-18T12:21:23.294 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:21:23.294 INFO:teuthology.orchestra.run.smithi172.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-18T12:21:23.295 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 3e:d2:94:94:36:e0 brd ff:ff:ff:ff:ff:ff 2023-10-18T12:21:23.295 INFO:teuthology.orchestra.run.smithi172.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-18T12:21:23.295 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:21:23.295 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::78dc:e9ff:fe72:37d5/64 scope link 2023-10-18T12:21:23.295 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:21:23.296 INFO:teuthology.orchestra.run.smithi172.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-18T12:21:23.296 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 3e:d2:94:94:36:e0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-18T12:21:23.296 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::3cd2:94ff:fe94:36e0/64 scope link 2023-10-18T12:21:23.296 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:21:23.296 INFO:teuthology.orchestra.run.smithi172.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-18T12:21:23.296 INFO:teuthology.orchestra.run.smithi172.stdout: link/ether 82:b2:ba:c5:2c:5e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-18T12:21:23.297 INFO:teuthology.orchestra.run.smithi172.stdout: inet6 fe80::80b2:baff:fec5:2c5e/64 scope link 2023-10-18T12:21:23.297 INFO:teuthology.orchestra.run.smithi172.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:21:23.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:21:23.298 DEBUG:teuthology.orchestra.run.smithi172:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-18T12:21:23.375 INFO:teuthology.orchestra.run.smithi172.stdout:1 2023-10-18T12:21:23.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:21:23.378 DEBUG:teuthology.orchestra.run.smithi172:> route 2023-10-18T12:21:23.436 INFO:teuthology.orchestra.run.smithi172.stdout:Kernel IP routing table 2023-10-18T12:21:23.436 INFO:teuthology.orchestra.run.smithi172.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-18T12:21:23.436 INFO:teuthology.orchestra.run.smithi172.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-18T12:21:23.436 INFO:teuthology.orchestra.run.smithi172.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-18T12:21:23.436 INFO:teuthology.orchestra.run.smithi172.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-18T12:21:23.437 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-10-18T12:21:23.437 INFO:teuthology.orchestra.run.smithi172.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-18T12:21:23.438 INFO:teuthology.orchestra.run.smithi172.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-18T12:21:23.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:21:23.439 DEBUG:teuthology.orchestra.run.smithi172:> (cd / && exec bash -c ' 2023-10-18T12:21:23.439 DEBUG:teuthology.orchestra.run.smithi172:> set -e 2023-10-18T12:21:23.440 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-18T12:21:23.440 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-18T12:21:23.440 DEBUG:teuthology.orchestra.run.smithi172:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-18T12:21:23.441 DEBUG:teuthology.orchestra.run.smithi172:> ') 2023-10-18T12:21:23.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:21:23.569 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2023-10-18T12:21:23.586 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-18T12:21:23.587 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-18T12:21:23.587 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-18T12:21:23.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:21:23.588 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link set brx.0 up 2023-10-18T12:21:23.665 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-18T12:21:23.665 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-18T12:21:23.727 INFO:teuthology.orchestra.run.smithi172.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-18T12:21:23.728 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-18T12:21:23.728 DEBUG:teuthology.orchestra.run.smithi172:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-18T12:21:23.784 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-18T12:21:23.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:21:23.785 DEBUG:teuthology.orchestra.run.smithi172:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-18T12:21:23.924 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-18T12:21:23.924 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-18T12:21:23.924 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2023-10-18T12:21:23.959 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-18T12:21:23.959 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-18T12:21:23.960 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2023-10-18T12:21:23.960 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.172:3300,172.21.15.172:3301" 2023-10-18T12:21:23.960 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-18T12:21:23.978 INFO:teuthology.orchestra.run.smithi172.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-18T12:21:23.978 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-18T12:21:23.978 INFO:teuthology.orchestra.run.smithi172.stdout:invalid new device string format 2023-10-18T12:21:23.978 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.172:3300,172.21.15.172:3301" 2023-10-18T12:21:23.979 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-18T12:21:23.979 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.172:6789,172.21.15.172:6790" 2023-10-18T12:21:23.979 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.172:6789,172.21.15.172:6790:/ 2023-10-18T12:21:23.979 INFO:teuthology.orchestra.run.smithi172.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=240ea340-5d3d-4f52-a4bc-af075aca3deb" will pass to kernel 2023-10-18T12:21:23.987 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-18T12:21:23.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:21:23.988 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-18T12:21:24.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:21:24.023 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-18T12:21:24.091 INFO:teuthology.orchestra.run.smithi172.stdout:client5162 2023-10-18T12:21:24.091 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T12:21:24.091 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-18T12:21:24.151 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T12:21:24.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.327+0000 7f00a5a45700 1 Processor -- start 2023-10-18T12:21:24.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.327+0000 7f00a5a45700 1 -- start start 2023-10-18T12:21:24.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.331+0000 7f00a5a45700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f00a01610a0 0x7f00a00cdb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:24.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.331+0000 7f00a5a45700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f00a00ce050 0x7f00a00ca900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:24.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.331+0000 7f00a5a45700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00a006fcc0 con 0x7f00a00cc900 2023-10-18T12:21:24.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.331+0000 7f00a5a45700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00a00c3210 con 0x7f00a00ce050 2023-10-18T12:21:24.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.331+0000 7f00a5a45700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00a006ff00 con 0x7f00a01610a0 2023-10-18T12:21:24.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.331+0000 7f009effd700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f00a00cc900 0x7f00a00ccce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51908/0 (socket says 172.21.15.114:51908) 2023-10-18T12:21:24.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.331+0000 7f009effd700 1 -- 172.21.15.114:0/795674669 learned_addr learned my addr 172.21.15.114:0/795674669 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:21:24.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.331+0000 7f009ffff700 1 --2- 172.21.15.114:0/795674669 >> v2:172.21.15.172:3300/0 conn(0x7f00a00ce050 0x7f00a00ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:24.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.331+0000 7f009e7fc700 1 -- 172.21.15.114:0/795674669 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1632838413 0 0) 0x7f0090001490 con 0x7f00a00cc900 2023-10-18T12:21:24.339 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.331+0000 7f009e7fc700 1 -- 172.21.15.114:0/795674669 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f008c0035d0 con 0x7f00a00cc900 2023-10-18T12:21:24.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.331+0000 7f00967fc700 1 --2- 172.21.15.114:0/795674669 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f00a01610a0 0x7f00a00cdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:24.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.331+0000 7f009e7fc700 1 -- 172.21.15.114:0/795674669 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2258139798 0 0) 0x7f008c0035d0 con 0x7f00a00cc900 2023-10-18T12:21:24.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.331+0000 7f009e7fc700 1 -- 172.21.15.114:0/795674669 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f00a01610a0 msgr2=0x7f00a00cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:24.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.331+0000 7f009e7fc700 1 --2- 172.21.15.114:0/795674669 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f00a01610a0 0x7f00a00cdb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:24.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.331+0000 7f009e7fc700 1 -- 172.21.15.114:0/795674669 >> v2:172.21.15.172:3300/0 conn(0x7f00a00ce050 msgr2=0x7f00a00ca900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:24.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.331+0000 7f009e7fc700 1 --2- 172.21.15.114:0/795674669 >> v2:172.21.15.172:3300/0 conn(0x7f00a00ce050 0x7f00a00ca900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:24.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.331+0000 7f009e7fc700 1 -- 172.21.15.114:0/795674669 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a0070a10 con 0x7f00a00cc900 2023-10-18T12:21:24.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.331+0000 7f009e7fc700 1 -- 172.21.15.114:0/795674669 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3368469509 0 0) 0x7f0090001b80 con 0x7f00a00cc900 2023-10-18T12:21:24.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.331+0000 7f009e7fc700 1 -- 172.21.15.114:0/795674669 >> v1:172.21.15.114:6789/0 conn(0x7f00a00cc900 legacy=0x7f00a00ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:24.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.331+0000 7f009e7fc700 1 --2- 172.21.15.114:0/795674669 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f008c003a20 0x7f008c003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:24.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.331+0000 7f009e7fc700 1 --2- 172.21.15.114:0/795674669 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f008c004870 0x7f008c004cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:24.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.331+0000 7f009e7fc700 1 --2- 172.21.15.114:0/795674669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f008c0051f0 0x7f008c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:24.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.331+0000 7f009e7fc700 1 -- 172.21.15.114:0/795674669 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a00c3210 con 0x7f008c003a20 2023-10-18T12:21:24.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.331+0000 7f009e7fc700 1 -- 172.21.15.114:0/795674669 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a006ff00 con 0x7f008c0051f0 2023-10-18T12:21:24.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.331+0000 7f009e7fc700 1 -- 172.21.15.114:0/795674669 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f008c00c070 con 0x7f008c004870 2023-10-18T12:21:24.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.331+0000 7f009effd700 1 --2- 172.21.15.114:0/795674669 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f008c003a20 0x7f008c003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:24.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.331+0000 7f009ffff700 1 --2- 172.21.15.114:0/795674669 >> v2:172.21.15.172:3300/0 conn(0x7f00a00ce050 0x7f00a00ca900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:21:24.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.331+0000 7f00967fc700 1 --2- 172.21.15.114:0/795674669 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f008c004870 0x7f008c004cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:24.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.331+0000 7f009effd700 1 -- 172.21.15.114:0/795674669 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f008c004870 msgr2=0x7f008c004cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:24.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.331+0000 7f009effd700 1 --2- 172.21.15.114:0/795674669 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f008c004870 0x7f008c004cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:24.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.331+0000 7f009effd700 1 -- 172.21.15.114:0/795674669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f008c0051f0 msgr2=0x7f008c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:24.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.331+0000 7f009effd700 1 --2- 172.21.15.114:0/795674669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f008c0051f0 0x7f008c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:24.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.331+0000 7f009effd700 1 -- 172.21.15.114:0/795674669 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f008c0035d0 con 0x7f008c003a20 2023-10-18T12:21:24.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.331+0000 7f009effd700 1 --2- 172.21.15.114:0/795674669 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f008c003a20 0x7f008c003e40 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f009000a770 tx=0x7f008c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9efed9c95f1f7f61 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:24.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.331+0000 7f009e7fc700 1 -- 172.21.15.114:0/795674669 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009000a3d0 con 0x7f008c003a20 2023-10-18T12:21:24.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.331+0000 7f009e7fc700 1 -- 172.21.15.114:0/795674669 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00900072d0 con 0x7f008c003a20 2023-10-18T12:21:24.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.331+0000 7f009e7fc700 1 -- 172.21.15.114:0/795674669 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0090007680 con 0x7f008c003a20 2023-10-18T12:21:24.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.335+0000 7f00a5a45700 1 -- 172.21.15.114:0/795674669 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f008c003a20 msgr2=0x7f008c003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:24.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.335+0000 7f00a5a45700 1 --2- 172.21.15.114:0/795674669 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f008c003a20 0x7f008c003e40 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f009000a770 tx=0x7f008c0058a0 comp rx=0 tx=0).stop 2023-10-18T12:21:24.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.335+0000 7f009ffff700 1 -- 172.21.15.114:0/795674669 reap_dead start 2023-10-18T12:21:24.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.335+0000 7f00a5a45700 1 -- 172.21.15.114:0/795674669 shutdown_connections 2023-10-18T12:21:24.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.335+0000 7f00a5a45700 1 -- 172.21.15.114:0/795674669 >> 172.21.15.114:0/795674669 conn(0x7f00a00b1a50 msgr2=0x7f00a00b1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:24.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.335+0000 7f00a5a45700 1 -- 172.21.15.114:0/795674669 shutdown_connections 2023-10-18T12:21:24.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.335+0000 7f00a5a45700 1 -- 172.21.15.114:0/795674669 wait complete. 2023-10-18T12:21:24.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.335+0000 7f00a5a45700 1 Processor -- start 2023-10-18T12:21:24.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.335+0000 7f00a5a45700 1 -- start start 2023-10-18T12:21:24.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.339+0000 7f00a5a45700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f008c003a20 0x7f00a00c6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:24.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.339+0000 7f00a5a45700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00a00c3a70 0x7f00a015e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:24.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.339+0000 7f00a5a45700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00a006b0c0 0x7f00a006b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:24.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.339+0000 7f00a5a45700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a006ba80 con 0x7f00a00c3a70 2023-10-18T12:21:24.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.339+0000 7f00a5a45700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a00bf7b0 con 0x7f00a006b0c0 2023-10-18T12:21:24.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.339+0000 7f00a5a45700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00a00c4210 con 0x7f008c003a20 2023-10-18T12:21:24.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.339+0000 7f00967fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00a00c3a70 0x7f00a015e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:24.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.339+0000 7f00967fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00a00c3a70 0x7f00a015e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39456/0 (socket says 172.21.15.114:39456) 2023-10-18T12:21:24.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.339+0000 7f00967fc700 1 -- 172.21.15.114:0/1786112652 learned_addr learned my addr 172.21.15.114:0/1786112652 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:24.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.339+0000 7f009effd700 1 --2- 172.21.15.114:0/1786112652 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f008c003a20 0x7f00a00c6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:24.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.339+0000 7f009ffff700 1 --2- 172.21.15.114:0/1786112652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00a006b0c0 0x7f00a006b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:24.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.339+0000 7f00967fc700 1 -- 172.21.15.114:0/1786112652 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f008c003a20 msgr2=0x7f00a00c6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:24.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.339+0000 7f00967fc700 1 --2- 172.21.15.114:0/1786112652 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f008c003a20 0x7f00a00c6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:24.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.339+0000 7f00967fc700 1 -- 172.21.15.114:0/1786112652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00a006b0c0 msgr2=0x7f00a006b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:24.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.339+0000 7f00967fc700 1 --2- 172.21.15.114:0/1786112652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00a006b0c0 0x7f00a006b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:24.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.339+0000 7f00967fc700 1 -- 172.21.15.114:0/1786112652 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a00c44f0 con 0x7f00a00c3a70 2023-10-18T12:21:24.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.339+0000 7f00967fc700 1 --2- 172.21.15.114:0/1786112652 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00a00c3a70 0x7f00a015e450 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f00880108c0 tx=0x7f0088010bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:24.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.339+0000 7f009cff9700 1 -- 172.21.15.114:0/1786112652 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0088015880 con 0x7f00a00c3a70 2023-10-18T12:21:24.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.339+0000 7f009cff9700 1 -- 172.21.15.114:0/1786112652 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f008800c050 con 0x7f00a00c3a70 2023-10-18T12:21:24.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.339+0000 7f009cff9700 1 -- 172.21.15.114:0/1786112652 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0088015c20 con 0x7f00a00c3a70 2023-10-18T12:21:24.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.339+0000 7f00a5a45700 1 -- 172.21.15.114:0/1786112652 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00a00c47d0 con 0x7f00a00c3a70 2023-10-18T12:21:24.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.339+0000 7f00a5a45700 1 -- 172.21.15.114:0/1786112652 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00a00c3ef0 con 0x7f00a00c3a70 2023-10-18T12:21:24.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.343+0000 7f00a5a45700 1 -- 172.21.15.114:0/1786112652 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00a0072e60 con 0x7f00a00c3a70 2023-10-18T12:21:24.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.343+0000 7f009cff9700 1 -- 172.21.15.114:0/1786112652 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f0088016420 con 0x7f00a00c3a70 2023-10-18T12:21:24.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.343+0000 7f009cff9700 1 --2- 172.21.15.114:0/1786112652 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0080065720 0x7f0080067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:24.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.343+0000 7f009cff9700 1 -- 172.21.15.114:0/1786112652 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f0088083560 con 0x7f00a00c3a70 2023-10-18T12:21:24.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.343+0000 7f009effd700 1 --2- 172.21.15.114:0/1786112652 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0080065720 0x7f0080067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:24.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.347+0000 7f009effd700 1 --2- 172.21.15.114:0/1786112652 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0080065720 0x7f0080067be0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0090016040 tx=0x7f0090009070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:24.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.351+0000 7f009cff9700 1 -- 172.21.15.114:0/1786112652 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f0088050f30 con 0x7f00a00c3a70 2023-10-18T12:21:24.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.563+0000 7f00a5a45700 1 -- 172.21.15.114:0/1786112652 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f00a00bf8f0 con 0x7f00a00c3a70 2023-10-18T12:21:24.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.563+0000 7f009cff9700 1 -- 172.21.15.114:0/1786112652 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4887 (secure 0 0 0) 0x7f0088054550 con 0x7f00a00c3a70 2023-10-18T12:21:24.570 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:21:24.570 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2034957068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2034957068},{"type":"v1","addr":"172.21.15.172:6836","nonce":2034957068}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5039,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4215710360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4215710360},{"type":"v1","addr":"172.21.15.172:6837","nonce":4215710360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2387835210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2387835210},{"type":"v1","addr":"172.21.15.114:6833","nonce":2387835210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T12:21:14.159069+0000","modified":"2023-10-18T12:21:17.730177+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.114:6835/1284474820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1284474820},{"type":"v1","addr":"172.21.15.114:6835","nonce":1284474820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-18T12:21:24.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.567+0000 7f00a5a45700 1 -- 172.21.15.114:0/1786112652 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0080065720 msgr2=0x7f0080067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:24.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.567+0000 7f00a5a45700 1 --2- 172.21.15.114:0/1786112652 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0080065720 0x7f0080067be0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0090016040 tx=0x7f0090009070 comp rx=0 tx=0).stop 2023-10-18T12:21:24.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.567+0000 7f00a5a45700 1 -- 172.21.15.114:0/1786112652 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00a00c3a70 msgr2=0x7f00a015e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:24.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.567+0000 7f00a5a45700 1 --2- 172.21.15.114:0/1786112652 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00a00c3a70 0x7f00a015e450 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f00880108c0 tx=0x7f0088010bd0 comp rx=0 tx=0).stop 2023-10-18T12:21:24.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.567+0000 7f00a5a45700 1 -- 172.21.15.114:0/1786112652 shutdown_connections 2023-10-18T12:21:24.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.567+0000 7f00a5a45700 1 --2- 172.21.15.114:0/1786112652 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f0080065720 0x7f0080067be0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:24.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.567+0000 7f00a5a45700 1 --2- 172.21.15.114:0/1786112652 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00a006b0c0 0x7f00a006b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:24.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.567+0000 7f00a5a45700 1 --2- 172.21.15.114:0/1786112652 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00a00c3a70 0x7f00a015e450 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:24.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.567+0000 7f00a5a45700 1 --2- 172.21.15.114:0/1786112652 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f008c003a20 0x7f00a00c6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:24.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.567+0000 7f00a5a45700 1 -- 172.21.15.114:0/1786112652 >> 172.21.15.114:0/1786112652 conn(0x7f00a00b1a50 msgr2=0x7f00a00af590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:24.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.567+0000 7f00a5a45700 1 -- 172.21.15.114:0/1786112652 shutdown_connections 2023-10-18T12:21:24.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.567+0000 7f00a5a45700 1 -- 172.21.15.114:0/1786112652 wait complete. 2023-10-18T12:21:24.576 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 18 2023-10-18T12:21:24.595 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_defer_session_stale false 2023-10-18T12:21:24.775 INFO:teuthology.orchestra.run.smithi114.stdout:{"success":"mds_defer_session_stale = 'false' (not observed, change may require restart) "} 2023-10-18T12:21:24.776 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_defer_session_stale = 'false' (not observed, change may require restart) " } 2023-10-18T12:21:24.776 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds defer_client_eviction_on_laggy_osds true 2023-10-18T12:21:24.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.943+0000 7fd59ce35700 1 Processor -- start 2023-10-18T12:21:24.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.943+0000 7fd59ce35700 1 -- start start 2023-10-18T12:21:24.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.947+0000 7fd59ce35700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd5980ce950 0x7fd5980cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:24.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.947+0000 7fd59ce35700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5980c56b0 con 0x7fd5980c52d0 2023-10-18T12:21:24.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.947+0000 7fd59ce35700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd59806bbc0 con 0x7fd5980705d0 2023-10-18T12:21:24.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.947+0000 7fd59ce35700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd598159df0 con 0x7fd5980ce950 2023-10-18T12:21:24.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.947+0000 7fd5977fe700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd5980c52d0 0x7fd5980ca9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51916/0 (socket says 172.21.15.114:51916) 2023-10-18T12:21:24.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.947+0000 7fd5977fe700 1 -- 172.21.15.114:0/3536512332 learned_addr learned my addr 172.21.15.114:0/3536512332 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:21:24.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.951+0000 7fd597fff700 1 --2- 172.21.15.114:0/3536512332 >> v2:172.21.15.172:3300/0 conn(0x7fd5980ce950 0x7fd5980cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:24.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.951+0000 7fd5967fc700 1 -- 172.21.15.114:0/3536512332 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3245404139 0 0) 0x7fd5980c56b0 con 0x7fd5980c52d0 2023-10-18T12:21:24.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.951+0000 7fd5967fc700 1 -- 172.21.15.114:0/3536512332 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5800057e0 con 0x7fd5980c52d0 2023-10-18T12:21:24.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.951+0000 7fd5967fc700 1 -- 172.21.15.114:0/3536512332 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3794065226 0 0) 0x7fd59806bbc0 con 0x7fd5980705d0 2023-10-18T12:21:24.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.951+0000 7fd5967fc700 1 -- 172.21.15.114:0/3536512332 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5980c56b0 con 0x7fd5980705d0 2023-10-18T12:21:24.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.951+0000 7fd5967fc700 1 -- 172.21.15.114:0/3536512332 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3569024103 0 0) 0x7fd5800057e0 con 0x7fd5980c52d0 2023-10-18T12:21:24.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.951+0000 7fd5967fc700 1 -- 172.21.15.114:0/3536512332 >> v2:172.21.15.172:3300/0 conn(0x7fd5980ce950 msgr2=0x7fd5980cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:24.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.951+0000 7fd5967fc700 1 --2- 172.21.15.114:0/3536512332 >> v2:172.21.15.172:3300/0 conn(0x7fd5980ce950 0x7fd5980cd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:24.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.951+0000 7fd5967fc700 1 -- 172.21.15.114:0/3536512332 >> v1:172.21.15.172:6789/0 conn(0x7fd5980705d0 legacy=0x7fd5980cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:24.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.951+0000 7fd5967fc700 1 -- 172.21.15.114:0/3536512332 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd598159fe0 con 0x7fd5980c52d0 2023-10-18T12:21:24.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.951+0000 7fd5967fc700 1 -- 172.21.15.114:0/3536512332 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3368469509 0 0) 0x7fd588001670 con 0x7fd5980c52d0 2023-10-18T12:21:24.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.951+0000 7fd5967fc700 1 -- 172.21.15.114:0/3536512332 >> v1:172.21.15.114:6789/0 conn(0x7fd5980c52d0 legacy=0x7fd5980ca9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:24.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.951+0000 7fd5967fc700 1 --2- 172.21.15.114:0/3536512332 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd580006ee0 0x7fd5800072e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:24.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.951+0000 7fd5967fc700 1 --2- 172.21.15.114:0/3536512332 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd580005a20 0x7fd580005ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:24.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.951+0000 7fd5967fc700 1 --2- 172.21.15.114:0/3536512332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5800064a0 0x7fd58000dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:24.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.951+0000 7fd5967fc700 1 -- 172.21.15.114:0/3536512332 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58000e3e0 con 0x7fd580005a20 2023-10-18T12:21:24.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.951+0000 7fd5967fc700 1 -- 172.21.15.114:0/3536512332 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58000e550 con 0x7fd5800064a0 2023-10-18T12:21:24.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.951+0000 7fd5967fc700 1 -- 172.21.15.114:0/3536512332 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd58000e710 con 0x7fd580006ee0 2023-10-18T12:21:24.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.951+0000 7fd596ffd700 1 --2- 172.21.15.114:0/3536512332 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd580005a20 0x7fd580005ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:24.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.951+0000 7fd5977fe700 1 --2- 172.21.15.114:0/3536512332 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd580006ee0 0x7fd5800072e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:24.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.951+0000 7fd597fff700 1 --2- 172.21.15.114:0/3536512332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5800064a0 0x7fd58000dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:24.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.951+0000 7fd596ffd700 1 -- 172.21.15.114:0/3536512332 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd580006ee0 msgr2=0x7fd5800072e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:24.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.951+0000 7fd596ffd700 1 --2- 172.21.15.114:0/3536512332 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd580006ee0 0x7fd5800072e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:24.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.951+0000 7fd596ffd700 1 -- 172.21.15.114:0/3536512332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5800064a0 msgr2=0x7fd58000dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:24.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.951+0000 7fd596ffd700 1 --2- 172.21.15.114:0/3536512332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5800064a0 0x7fd58000dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:24.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.951+0000 7fd596ffd700 1 -- 172.21.15.114:0/3536512332 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5800057e0 con 0x7fd580005a20 2023-10-18T12:21:24.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.951+0000 7fd597fff700 1 --2- 172.21.15.114:0/3536512332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5800064a0 0x7fd58000dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:21:24.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.951+0000 7fd597fff700 1 -- 172.21.15.114:0/3536512332 reap_dead start 2023-10-18T12:21:24.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.951+0000 7fd596ffd700 1 --2- 172.21.15.114:0/3536512332 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd580005a20 0x7fd580005ea0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fd59815e3a0 tx=0x7fd580007ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1519c372c876af8a server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:24.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.951+0000 7fd5967fc700 1 -- 172.21.15.114:0/3536512332 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58c001450 con 0x7fd580005a20 2023-10-18T12:21:24.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.951+0000 7fd5967fc700 1 -- 172.21.15.114:0/3536512332 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd58c006aa0 con 0x7fd580005a20 2023-10-18T12:21:24.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.951+0000 7fd5967fc700 1 -- 172.21.15.114:0/3536512332 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58c006e50 con 0x7fd580005a20 2023-10-18T12:21:24.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.955+0000 7fd59ce35700 1 -- 172.21.15.114:0/3536512332 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd580005a20 msgr2=0x7fd580005ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:24.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.955+0000 7fd59ce35700 1 --2- 172.21.15.114:0/3536512332 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd580005a20 0x7fd580005ea0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fd59815e3a0 tx=0x7fd580007ab0 comp rx=0 tx=0).stop 2023-10-18T12:21:24.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.955+0000 7fd59ce35700 1 -- 172.21.15.114:0/3536512332 shutdown_connections 2023-10-18T12:21:24.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.955+0000 7fd59ce35700 1 --2- 172.21.15.114:0/3536512332 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd580005a20 0x7fd580005ea0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:24.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.955+0000 7fd59ce35700 1 -- 172.21.15.114:0/3536512332 >> 172.21.15.114:0/3536512332 conn(0x7fd5980cb920 msgr2=0x7fd5980cbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:24.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.955+0000 7fd59ce35700 1 -- 172.21.15.114:0/3536512332 shutdown_connections 2023-10-18T12:21:24.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.955+0000 7fd59ce35700 1 -- 172.21.15.114:0/3536512332 wait complete. 2023-10-18T12:21:24.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.959+0000 7fd59ce35700 1 Processor -- start 2023-10-18T12:21:24.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.959+0000 7fd59ce35700 1 -- start start 2023-10-18T12:21:24.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.959+0000 7fd59ce35700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd580005a20 0x7fd598150140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:24.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.959+0000 7fd59ce35700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5980c74b0 0x7fd59806f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:24.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.959+0000 7fd59ce35700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5980b2280 0x7fd59814c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:24.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.959+0000 7fd59ce35700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5981f1480 con 0x7fd5980c74b0 2023-10-18T12:21:24.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.959+0000 7fd59ce35700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59814e910 con 0x7fd580005a20 2023-10-18T12:21:24.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.959+0000 7fd59ce35700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5980c7990 con 0x7fd5980b2280 2023-10-18T12:21:24.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.959+0000 7fd596ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5980c74b0 0x7fd59806f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:24.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.959+0000 7fd596ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5980c74b0 0x7fd59806f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39464/0 (socket says 172.21.15.114:39464) 2023-10-18T12:21:24.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.959+0000 7fd596ffd700 1 -- 172.21.15.114:0/3770787526 learned_addr learned my addr 172.21.15.114:0/3770787526 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:24.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.959+0000 7fd5977fe700 1 --2- 172.21.15.114:0/3770787526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd580005a20 0x7fd598150140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:24.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.959+0000 7fd597fff700 1 --2- 172.21.15.114:0/3770787526 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5980b2280 0x7fd59814c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:24.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.959+0000 7fd596ffd700 1 -- 172.21.15.114:0/3770787526 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5980b2280 msgr2=0x7fd59814c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:24.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.959+0000 7fd596ffd700 1 --2- 172.21.15.114:0/3770787526 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5980b2280 0x7fd59814c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:24.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.959+0000 7fd596ffd700 1 -- 172.21.15.114:0/3770787526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd580005a20 msgr2=0x7fd598150140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:24.973 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.959+0000 7fd596ffd700 1 --2- 172.21.15.114:0/3770787526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd580005a20 0x7fd598150140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:24.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.959+0000 7fd596ffd700 1 -- 172.21.15.114:0/3770787526 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5980c7c70 con 0x7fd5980c74b0 2023-10-18T12:21:24.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.959+0000 7fd597fff700 1 --2- 172.21.15.114:0/3770787526 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5980b2280 0x7fd59814c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:21:24.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.959+0000 7fd596ffd700 1 --2- 172.21.15.114:0/3770787526 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5980c74b0 0x7fd59806f6c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fd58000e520 tx=0x7fd58c0012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:24.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.963+0000 7fd57ffff700 1 -- 172.21.15.114:0/3770787526 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58c0054d0 con 0x7fd5980c74b0 2023-10-18T12:21:24.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.963+0000 7fd57ffff700 1 -- 172.21.15.114:0/3770787526 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd58c001d60 con 0x7fd5980c74b0 2023-10-18T12:21:24.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.963+0000 7fd57ffff700 1 -- 172.21.15.114:0/3770787526 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58c007250 con 0x7fd5980c74b0 2023-10-18T12:21:24.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.963+0000 7fd59ce35700 1 -- 172.21.15.114:0/3770787526 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5980c7f50 con 0x7fd5980c74b0 2023-10-18T12:21:24.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.963+0000 7fd59ce35700 1 -- 172.21.15.114:0/3770787526 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd59806fc00 con 0x7fd5980c74b0 2023-10-18T12:21:24.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.963+0000 7fd59ce35700 1 -- 172.21.15.114:0/3770787526 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5981f1630 con 0x7fd5980c74b0 2023-10-18T12:21:24.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.967+0000 7fd57ffff700 1 -- 172.21.15.114:0/3770787526 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fd58c0073b0 con 0x7fd5980c74b0 2023-10-18T12:21:24.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.967+0000 7fd57ffff700 1 --2- 172.21.15.114:0/3770787526 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd584065770 0x7fd584067c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:24.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.967+0000 7fd57ffff700 1 -- 172.21.15.114:0/3770787526 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fd58c083bb0 con 0x7fd5980c74b0 2023-10-18T12:21:24.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.967+0000 7fd5977fe700 1 --2- 172.21.15.114:0/3770787526 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd584065770 0x7fd584067c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:24.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.967+0000 7fd5977fe700 1 --2- 172.21.15.114:0/3770787526 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd584065770 0x7fd584067c30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd588000c00 tx=0x7fd588009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:24.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:24.975+0000 7fd57ffff700 1 -- 172.21.15.114:0/3770787526 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fd5981f1630 con 0x7fd5980c74b0 2023-10-18T12:21:25.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.215+0000 7fd59ce35700 1 -- 172.21.15.114:0/3770787526 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=defer_client_eviction_on_laggy_osds}] v 0) v1 -- 0x7fd5981f1480 con 0x7fd5980c74b0 2023-10-18T12:21:25.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.227+0000 7fd57ffff700 1 -- 172.21.15.114:0/3770787526 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=defer_client_eviction_on_laggy_osds}]=0 v11)=0 v11) v1 ==== 136+0+0 (secure 0 0 0) 0x7fd58c0170c0 con 0x7fd5980c74b0 2023-10-18T12:21:25.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.231+0000 7fd59ce35700 1 -- 172.21.15.114:0/3770787526 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd584065770 msgr2=0x7fd584067c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:25.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.231+0000 7fd59ce35700 1 --2- 172.21.15.114:0/3770787526 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd584065770 0x7fd584067c30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd588000c00 tx=0x7fd588009040 comp rx=0 tx=0).stop 2023-10-18T12:21:25.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.231+0000 7fd59ce35700 1 -- 172.21.15.114:0/3770787526 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5980c74b0 msgr2=0x7fd59806f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:25.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.231+0000 7fd59ce35700 1 --2- 172.21.15.114:0/3770787526 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5980c74b0 0x7fd59806f6c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fd58000e520 tx=0x7fd58c0012d0 comp rx=0 tx=0).stop 2023-10-18T12:21:25.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.231+0000 7fd59ce35700 1 -- 172.21.15.114:0/3770787526 shutdown_connections 2023-10-18T12:21:25.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.231+0000 7fd59ce35700 1 --2- 172.21.15.114:0/3770787526 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd584065770 0x7fd584067c30 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:25.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.231+0000 7fd59ce35700 1 --2- 172.21.15.114:0/3770787526 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd5980b2280 0x7fd59814c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:25.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.231+0000 7fd59ce35700 1 --2- 172.21.15.114:0/3770787526 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd5980c74b0 0x7fd59806f6c0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:25.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.231+0000 7fd59ce35700 1 --2- 172.21.15.114:0/3770787526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd580005a20 0x7fd598150140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:25.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.231+0000 7fd59ce35700 1 -- 172.21.15.114:0/3770787526 >> 172.21.15.114:0/3770787526 conn(0x7fd5980cb920 msgr2=0x7fd5980cbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:25.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.231+0000 7fd59ce35700 1 -- 172.21.15.114:0/3770787526 shutdown_connections 2023-10-18T12:21:25.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.231+0000 7fd59ce35700 1 -- 172.21.15.114:0/3770787526 wait complete. 2023-10-18T12:21:25.261 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds defer_client_eviction_on_laggy_osds 2023-10-18T12:21:25.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.435+0000 7f4dc0741700 1 Processor -- start 2023-10-18T12:21:25.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.435+0000 7f4dc0741700 1 -- start start 2023-10-18T12:21:25.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.435+0000 7f4dc0741700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4db80b2b40 0x7f4db80cf220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:25.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.435+0000 7f4dc0741700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4db815cdd0 0x7f4db8160830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:25.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.439+0000 7f4dc0741700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4db8161580 con 0x7f4db815c9f0 2023-10-18T12:21:25.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.439+0000 7f4dc0741700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4db80ce740 con 0x7f4db815cdd0 2023-10-18T12:21:25.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.439+0000 7f4dc0741700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4db80cea20 con 0x7f4db80b2b40 2023-10-18T12:21:25.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.439+0000 7f4dbecde700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4db815cdd0 0x7f4db8160830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:25.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.439+0000 7f4dbe4dd700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f4db815c9f0 0x7f4db80b2430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.114:59598/0 (socket says 172.21.15.114:59598) 2023-10-18T12:21:25.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.439+0000 7f4dbe4dd700 1 -- 172.21.15.114:0/541584103 learned_addr learned my addr 172.21.15.114:0/541584103 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:21:25.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.439+0000 7f4dbdcdc700 1 --2- 172.21.15.114:0/541584103 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4db80b2b40 0x7f4db80cf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:25.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.439+0000 7f4dbecde700 1 -- 172.21.15.114:0/541584103 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4db80b2b40 msgr2=0x7f4db80cf220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:25.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.439+0000 7f4dbecde700 1 --2- 172.21.15.114:0/541584103 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4db80b2b40 0x7f4db80cf220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:25.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.439+0000 7f4dbecde700 1 -- 172.21.15.114:0/541584103 >> v1:172.21.15.172:6789/0 conn(0x7f4db815c9f0 legacy=0x7f4db80b2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:25.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.439+0000 7f4dbecde700 1 -- 172.21.15.114:0/541584103 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db80ced00 con 0x7f4db815cdd0 2023-10-18T12:21:25.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.439+0000 7f4dbecde700 1 --2- 172.21.15.114:0/541584103 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4db815cdd0 0x7f4db8160830 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f4db0009d90 tx=0x7f4db000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=211d2cbd80548c8b server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:25.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.439+0000 7f4dbd4db700 1 -- 172.21.15.114:0/541584103 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db000e070 con 0x7f4db815cdd0 2023-10-18T12:21:25.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.443+0000 7f4dbd4db700 1 -- 172.21.15.114:0/541584103 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db000bbd0 con 0x7f4db815cdd0 2023-10-18T12:21:25.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.443+0000 7f4dbd4db700 1 -- 172.21.15.114:0/541584103 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db0012430 con 0x7f4db815cdd0 2023-10-18T12:21:25.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.443+0000 7f4dc0741700 1 -- 172.21.15.114:0/541584103 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4db815cdd0 msgr2=0x7f4db8160830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:25.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.443+0000 7f4dc0741700 1 --2- 172.21.15.114:0/541584103 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4db815cdd0 0x7f4db8160830 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f4db0009d90 tx=0x7f4db000b330 comp rx=0 tx=0).stop 2023-10-18T12:21:25.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.443+0000 7f4dc0741700 1 -- 172.21.15.114:0/541584103 shutdown_connections 2023-10-18T12:21:25.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.443+0000 7f4dc0741700 1 --2- 172.21.15.114:0/541584103 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4db815cdd0 0x7f4db8160830 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:25.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.443+0000 7f4dc0741700 1 --2- 172.21.15.114:0/541584103 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4db80b2b40 0x7f4db80cf220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:25.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.443+0000 7f4dc0741700 1 -- 172.21.15.114:0/541584103 >> 172.21.15.114:0/541584103 conn(0x7f4db80cd430 msgr2=0x7f4db80cd840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:25.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.443+0000 7f4dc0741700 1 -- 172.21.15.114:0/541584103 shutdown_connections 2023-10-18T12:21:25.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.443+0000 7f4dc0741700 1 -- 172.21.15.114:0/541584103 wait complete. 2023-10-18T12:21:25.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.443+0000 7f4dc0741700 1 Processor -- start 2023-10-18T12:21:25.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.443+0000 7f4dc0741700 1 -- start start 2023-10-18T12:21:25.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.447+0000 7f4dc0741700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4db80b2b40 0x7f4db81501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:25.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.447+0000 7f4dc0741700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4db815c9f0 0x7f4db80b1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:25.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.447+0000 7f4dc0741700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4db815cdd0 0x7f4db80b23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:25.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.447+0000 7f4dc0741700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db815d380 con 0x7f4db80b2b40 2023-10-18T12:21:25.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.447+0000 7f4dc0741700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db815d660 con 0x7f4db815cdd0 2023-10-18T12:21:25.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.447+0000 7f4dc0741700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4db815d940 con 0x7f4db815c9f0 2023-10-18T12:21:25.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.447+0000 7f4dbe4dd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4db80b2b40 0x7f4db81501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:25.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.447+0000 7f4dbe4dd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4db80b2b40 0x7f4db81501d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48694/0 (socket says 172.21.15.114:48694) 2023-10-18T12:21:25.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.447+0000 7f4dbe4dd700 1 -- 172.21.15.114:0/3266790990 learned_addr learned my addr 172.21.15.114:0/3266790990 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:25.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.447+0000 7f4dbdcdc700 1 --2- 172.21.15.114:0/3266790990 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4db815c9f0 0x7f4db80b1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:25.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.447+0000 7f4dbecde700 1 --2- 172.21.15.114:0/3266790990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4db815cdd0 0x7f4db80b23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:25.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.447+0000 7f4dbe4dd700 1 -- 172.21.15.114:0/3266790990 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4db815c9f0 msgr2=0x7f4db80b1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:25.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.447+0000 7f4dbe4dd700 1 --2- 172.21.15.114:0/3266790990 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4db815c9f0 0x7f4db80b1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:25.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.447+0000 7f4dbe4dd700 1 -- 172.21.15.114:0/3266790990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4db815cdd0 msgr2=0x7f4db80b23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:25.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.447+0000 7f4dbe4dd700 1 --2- 172.21.15.114:0/3266790990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4db815cdd0 0x7f4db80b23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:25.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.447+0000 7f4dbe4dd700 1 -- 172.21.15.114:0/3266790990 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db0009a70 con 0x7f4db80b2b40 2023-10-18T12:21:25.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.447+0000 7f4dbecde700 1 --2- 172.21.15.114:0/3266790990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4db815cdd0 0x7f4db80b23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:21:25.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.447+0000 7f4dbe4dd700 1 --2- 172.21.15.114:0/3266790990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4db80b2b40 0x7f4db81501d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f4db400c700 tx=0x7f4db400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:25.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.447+0000 7f4daeffd700 1 -- 172.21.15.114:0/3266790990 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4005d90 con 0x7f4db80b2b40 2023-10-18T12:21:25.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.447+0000 7f4daeffd700 1 -- 172.21.15.114:0/3266790990 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db40070d0 con 0x7f4db80b2b40 2023-10-18T12:21:25.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.447+0000 7f4daeffd700 1 -- 172.21.15.114:0/3266790990 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4007440 con 0x7f4db80b2b40 2023-10-18T12:21:25.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.447+0000 7f4dc0741700 1 -- 172.21.15.114:0/3266790990 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4db815dc20 con 0x7f4db80b2b40 2023-10-18T12:21:25.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.447+0000 7f4dc0741700 1 -- 172.21.15.114:0/3266790990 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4db8150710 con 0x7f4db80b2b40 2023-10-18T12:21:25.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.451+0000 7f4dc0741700 1 -- 172.21.15.114:0/3266790990 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4db81508a0 con 0x7f4db80b2b40 2023-10-18T12:21:25.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.451+0000 7f4daeffd700 1 -- 172.21.15.114:0/3266790990 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f4db40075a0 con 0x7f4db80b2b40 2023-10-18T12:21:25.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.451+0000 7f4daeffd700 1 --2- 172.21.15.114:0/3266790990 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4d9c0656f0 0x7f4d9c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:25.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.451+0000 7f4daeffd700 1 -- 172.21.15.114:0/3266790990 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f4db4082360 con 0x7f4db80b2b40 2023-10-18T12:21:25.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.451+0000 7f4dbdcdc700 1 --2- 172.21.15.114:0/3266790990 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4d9c0656f0 0x7f4d9c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:25.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.455+0000 7f4dbdcdc700 1 --2- 172.21.15.114:0/3266790990 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4d9c0656f0 0x7f4d9c067bb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4db806be40 tx=0x7f4da8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:25.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.459+0000 7f4daeffd700 1 -- 172.21.15.114:0/3266790990 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f4db404fcb0 con 0x7f4db80b2b40 2023-10-18T12:21:25.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.795+0000 7f4dc0741700 1 -- 172.21.15.114:0/3266790990 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "defer_client_eviction_on_laggy_osds"} v 0) v1 -- 0x7f4db8072e60 con 0x7f4db80b2b40 2023-10-18T12:21:25.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.795+0000 7f4daeffd700 1 -- 172.21.15.114:0/3266790990 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "defer_client_eviction_on_laggy_osds"}]=0 v11) v1 ==== 118+0+5 (secure 0 0 0) 0x7f4db40532d0 con 0x7f4db80b2b40 2023-10-18T12:21:25.803 INFO:teuthology.orchestra.run.smithi114.stdout:true 2023-10-18T12:21:25.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.799+0000 7f4dc0741700 1 -- 172.21.15.114:0/3266790990 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4d9c0656f0 msgr2=0x7f4d9c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:25.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.799+0000 7f4dc0741700 1 --2- 172.21.15.114:0/3266790990 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4d9c0656f0 0x7f4d9c067bb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4db806be40 tx=0x7f4da8008040 comp rx=0 tx=0).stop 2023-10-18T12:21:25.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.799+0000 7f4dc0741700 1 -- 172.21.15.114:0/3266790990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4db80b2b40 msgr2=0x7f4db81501d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:25.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.799+0000 7f4dc0741700 1 --2- 172.21.15.114:0/3266790990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4db80b2b40 0x7f4db81501d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f4db400c700 tx=0x7f4db400ca10 comp rx=0 tx=0).stop 2023-10-18T12:21:25.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.799+0000 7f4dc0741700 1 -- 172.21.15.114:0/3266790990 shutdown_connections 2023-10-18T12:21:25.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.799+0000 7f4dc0741700 1 --2- 172.21.15.114:0/3266790990 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4d9c0656f0 0x7f4d9c067bb0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:25.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.799+0000 7f4dc0741700 1 --2- 172.21.15.114:0/3266790990 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4db815c9f0 0x7f4db80b1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:25.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.799+0000 7f4dc0741700 1 --2- 172.21.15.114:0/3266790990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4db815cdd0 0x7f4db80b23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:25.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.799+0000 7f4dc0741700 1 --2- 172.21.15.114:0/3266790990 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4db80b2b40 0x7f4db81501d0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:25.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.799+0000 7f4dc0741700 1 -- 172.21.15.114:0/3266790990 >> 172.21.15.114:0/3266790990 conn(0x7f4db80cd430 msgr2=0x7f4db806f450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:25.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.799+0000 7f4dc0741700 1 -- 172.21.15.114:0/3266790990 shutdown_connections 2023-10-18T12:21:25.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.799+0000 7f4dc0741700 1 -- 172.21.15.114:0/3266790990 wait complete. 2023-10-18T12:21:25.830 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2023-10-18T12:21:26.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.999+0000 7f82ad4a7700 1 Processor -- start 2023-10-18T12:21:26.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:25.999+0000 7f82ad4a7700 1 -- start start 2023-10-18T12:21:26.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.003+0000 7f82ad4a7700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f82a80adc00 0x7f82a806ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:26.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.003+0000 7f82ad4a7700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f82a80cda60 0x7f82a815aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:26.010 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.003+0000 7f82ad4a7700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82a80ccd30 con 0x7f82a806d800 2023-10-18T12:21:26.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.003+0000 7f82ad4a7700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82a815aff0 con 0x7f82a80adc00 2023-10-18T12:21:26.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.003+0000 7f82ad4a7700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a806d520 con 0x7f82a80cda60 2023-10-18T12:21:26.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.003+0000 7f829ffff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f82a80cda60 0x7f82a815aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:26.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.003+0000 7f82a6ffd700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f82a80adc00 0x7f82a806ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:26.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.003+0000 7f829ffff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f82a80cda60 0x7f82a815aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.114:35864/0 (socket says 172.21.15.114:35864) 2023-10-18T12:21:26.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.003+0000 7f82a6ffd700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f82a80adc00 0x7f82a806ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:44322/0 (socket says 172.21.15.114:44322) 2023-10-18T12:21:26.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.003+0000 7f829ffff700 1 -- 172.21.15.114:0/387171498 learned_addr learned my addr 172.21.15.114:0/387171498 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:26.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.003+0000 7f82a77fe700 1 --1- 172.21.15.114:0/387171498 >> v1:172.21.15.172:6789/0 conn(0x7f82a806d800 0x7f82a806dc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.114:59610/0 (socket says 172.21.15.114:59610) 2023-10-18T12:21:26.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.003+0000 7f829ffff700 1 -- 172.21.15.114:0/387171498 >> v2:172.21.15.172:3300/0 conn(0x7f82a80adc00 msgr2=0x7f82a806ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:21:26.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.003+0000 7f829ffff700 1 --2- 172.21.15.114:0/387171498 >> v2:172.21.15.172:3300/0 conn(0x7f82a80adc00 0x7f82a806ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:26.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.003+0000 7f82a67fc700 1 -- 172.21.15.114:0/387171498 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 247919647 0 0) 0x7f82a80ccd30 con 0x7f82a806d800 2023-10-18T12:21:26.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.003+0000 7f829ffff700 1 -- 172.21.15.114:0/387171498 >> v1:172.21.15.172:6789/0 conn(0x7f82a806d800 legacy=0x7f82a806dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:26.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.003+0000 7f829ffff700 1 -- 172.21.15.114:0/387171498 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a80ccf80 con 0x7f82a80cda60 2023-10-18T12:21:26.014 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.007+0000 7f829ffff700 1 --2- 172.21.15.114:0/387171498 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f82a80cda60 0x7f82a815aab0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8290009910 tx=0x7f8290009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f14e559dd6786354 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:26.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.007+0000 7f82a67fc700 1 -- 172.21.15.114:0/387171498 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829000f8a0 con 0x7f82a80cda60 2023-10-18T12:21:26.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.007+0000 7f82a67fc700 1 -- 172.21.15.114:0/387171498 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f829000fa00 con 0x7f82a80cda60 2023-10-18T12:21:26.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.007+0000 7f82a67fc700 1 -- 172.21.15.114:0/387171498 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829000fdb0 con 0x7f82a80cda60 2023-10-18T12:21:26.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.007+0000 7f82ad4a7700 1 -- 172.21.15.114:0/387171498 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f82a80cda60 msgr2=0x7f82a815aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:26.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.007+0000 7f82ad4a7700 1 --2- 172.21.15.114:0/387171498 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f82a80cda60 0x7f82a815aab0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8290009910 tx=0x7f8290009c20 comp rx=0 tx=0).stop 2023-10-18T12:21:26.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.007+0000 7f82ad4a7700 1 -- 172.21.15.114:0/387171498 shutdown_connections 2023-10-18T12:21:26.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.007+0000 7f82ad4a7700 1 --2- 172.21.15.114:0/387171498 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f82a80cda60 0x7f82a815aab0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:26.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.007+0000 7f82ad4a7700 1 --2- 172.21.15.114:0/387171498 >> v2:172.21.15.172:3300/0 conn(0x7f82a80adc00 0x7f82a806ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:26.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.007+0000 7f82ad4a7700 1 -- 172.21.15.114:0/387171498 >> 172.21.15.114:0/387171498 conn(0x7f82a806a340 msgr2=0x7f82a80b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:26.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.007+0000 7f82ad4a7700 1 -- 172.21.15.114:0/387171498 shutdown_connections 2023-10-18T12:21:26.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.007+0000 7f82ad4a7700 1 -- 172.21.15.114:0/387171498 wait complete. 2023-10-18T12:21:26.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.007+0000 7f82ad4a7700 1 Processor -- start 2023-10-18T12:21:26.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.011+0000 7f82ad4a7700 1 -- start start 2023-10-18T12:21:26.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.011+0000 7f82ad4a7700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f82a806d800 0x7f82a814d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:26.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.011+0000 7f82ad4a7700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82a80adc00 0x7f82a814cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:26.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.011+0000 7f82ad4a7700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82a80cda60 0x7f82a8153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:26.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.011+0000 7f82ad4a7700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a813ee50 con 0x7f82a80cda60 2023-10-18T12:21:26.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.011+0000 7f82ad4a7700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a814ae40 con 0x7f82a80adc00 2023-10-18T12:21:26.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.011+0000 7f82ad4a7700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a814b400 con 0x7f82a806d800 2023-10-18T12:21:26.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.011+0000 7f82a77fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82a80cda60 0x7f82a8153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:26.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.011+0000 7f829ffff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82a80adc00 0x7f82a814cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:26.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.011+0000 7f82a77fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82a80cda60 0x7f82a8153550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48708/0 (socket says 172.21.15.114:48708) 2023-10-18T12:21:26.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.011+0000 7f829ffff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82a80adc00 0x7f82a814cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:44326/0 (socket says 172.21.15.114:44326) 2023-10-18T12:21:26.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.011+0000 7f82a77fe700 1 -- 172.21.15.114:0/705784950 learned_addr learned my addr 172.21.15.114:0/705784950 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:21:26.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.011+0000 7f82a6ffd700 1 --2- 172.21.15.114:0/705784950 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f82a806d800 0x7f82a814d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:26.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.011+0000 7f82a77fe700 1 -- 172.21.15.114:0/705784950 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f82a806d800 msgr2=0x7f82a814d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:26.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.011+0000 7f82a77fe700 1 --2- 172.21.15.114:0/705784950 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f82a806d800 0x7f82a814d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:26.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.011+0000 7f82a77fe700 1 -- 172.21.15.114:0/705784950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82a80adc00 msgr2=0x7f82a814cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:26.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.011+0000 7f82a77fe700 1 --2- 172.21.15.114:0/705784950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82a80adc00 0x7f82a814cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:26.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.011+0000 7f82a77fe700 1 -- 172.21.15.114:0/705784950 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8290009570 con 0x7f82a80cda60 2023-10-18T12:21:26.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.011+0000 7f82a77fe700 1 --2- 172.21.15.114:0/705784950 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82a80cda60 0x7f82a8153550 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f82a000cb90 tx=0x7f82a000cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:26.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.011+0000 7f829f7fe700 1 -- 172.21.15.114:0/705784950 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a000aa60 con 0x7f82a80cda60 2023-10-18T12:21:26.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.011+0000 7f829f7fe700 1 -- 172.21.15.114:0/705784950 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a000abc0 con 0x7f82a80cda60 2023-10-18T12:21:26.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.011+0000 7f82ad4a7700 1 -- 172.21.15.114:0/705784950 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82a814cff0 con 0x7f82a80cda60 2023-10-18T12:21:26.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.011+0000 7f829f7fe700 1 -- 172.21.15.114:0/705784950 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a00070d0 con 0x7f82a80cda60 2023-10-18T12:21:26.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.011+0000 7f82ad4a7700 1 -- 172.21.15.114:0/705784950 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82a81f22d0 con 0x7f82a80cda60 2023-10-18T12:21:26.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.015+0000 7f82ad4a7700 1 -- 172.21.15.114:0/705784950 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82a814b590 con 0x7f82a80cda60 2023-10-18T12:21:26.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.015+0000 7f829f7fe700 1 -- 172.21.15.114:0/705784950 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f82a0007230 con 0x7f82a80cda60 2023-10-18T12:21:26.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.019+0000 7f829f7fe700 1 --2- 172.21.15.114:0/705784950 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8288065720 0x7f8288067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:21:26.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.019+0000 7f829f7fe700 1 -- 172.21.15.114:0/705784950 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f82a0082a20 con 0x7f82a80cda60 2023-10-18T12:21:26.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.019+0000 7f82a6ffd700 1 --2- 172.21.15.114:0/705784950 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8288065720 0x7f8288067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:21:26.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.019+0000 7f82a6ffd700 1 --2- 172.21.15.114:0/705784950 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8288065720 0x7f8288067be0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8298009b50 tx=0x7f8298009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:21:26.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.023+0000 7f829f7fe700 1 -- 172.21.15.114:0/705784950 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f82a00502d0 con 0x7f82a80cda60 2023-10-18T12:21:26.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.207+0000 7f82ad4a7700 1 -- 172.21.15.114:0/705784950 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7f82a8072e60 con 0x7f82a80cda60 2023-10-18T12:21:26.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.207+0000 7f829f7fe700 1 -- 172.21.15.114:0/705784950 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v44) v1 ==== 56+0+3510 (secure 0 0 0) 0x7f82a0018dd0 con 0x7f82a80cda60 2023-10-18T12:21:26.215 INFO:teuthology.orchestra.run.smithi114.stdout:epoch 44 2023-10-18T12:21:26.216 INFO:teuthology.orchestra.run.smithi114.stdout:fsid 240ea340-5d3d-4f52-a4bc-af075aca3deb 2023-10-18T12:21:26.216 INFO:teuthology.orchestra.run.smithi114.stdout:created 2023-10-18T12:19:12.512994+0000 2023-10-18T12:21:26.216 INFO:teuthology.orchestra.run.smithi114.stdout:modified 2023-10-18T12:21:20.757932+0000 2023-10-18T12:21:26.216 INFO:teuthology.orchestra.run.smithi114.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-10-18T12:21:26.216 INFO:teuthology.orchestra.run.smithi114.stdout:crush_version 5 2023-10-18T12:21:26.217 INFO:teuthology.orchestra.run.smithi114.stdout:full_ratio 0.95 2023-10-18T12:21:26.217 INFO:teuthology.orchestra.run.smithi114.stdout:backfillfull_ratio 0.9 2023-10-18T12:21:26.217 INFO:teuthology.orchestra.run.smithi114.stdout:nearfull_ratio 0.85 2023-10-18T12:21:26.217 INFO:teuthology.orchestra.run.smithi114.stdout:require_min_compat_client luminous 2023-10-18T12:21:26.217 INFO:teuthology.orchestra.run.smithi114.stdout:min_compat_client luminous 2023-10-18T12:21:26.218 INFO:teuthology.orchestra.run.smithi114.stdout:require_osd_release reef 2023-10-18T12:21:26.218 INFO:teuthology.orchestra.run.smithi114.stdout:stretch_mode_enabled false 2023-10-18T12:21:26.218 INFO:teuthology.orchestra.run.smithi114.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 17 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 8.00 2023-10-18T12:21:26.218 INFO:teuthology.orchestra.run.smithi114.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 20 flags hashpspool stripe_width 0 application rbd read_balance_score 1.99 2023-10-18T12:21:26.218 INFO:teuthology.orchestra.run.smithi114.stdout:pool 6 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 41 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.75 2023-10-18T12:21:26.219 INFO:teuthology.orchestra.run.smithi114.stdout:pool 7 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 42 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.63 2023-10-18T12:21:26.219 INFO:teuthology.orchestra.run.smithi114.stdout:max_osd 8 2023-10-18T12:21:26.219 INFO:teuthology.orchestra.run.smithi114.stdout:osd.0 up in weight 1 up_from 13 up_thru 40 down_at 0 last_clean_interval [0,0) [v2:172.21.15.114:6816/1506287862,v1:172.21.15.114:6817/1506287862] [v2:172.21.15.114:6818/1506287862,v1:172.21.15.114:6820/1506287862] exists,up c3578978-1a03-4857-b9d2-34a5da3d7731 2023-10-18T12:21:26.219 INFO:teuthology.orchestra.run.smithi114.stdout:osd.1 up in weight 1 up_from 13 up_thru 40 down_at 0 last_clean_interval [0,0) [v2:172.21.15.114:6800/3302727047,v1:172.21.15.114:6801/3302727047] [v2:172.21.15.114:6802/3302727047,v1:172.21.15.114:6803/3302727047] exists,up 43eb26a6-e2b3-4670-9559-bd053b5140d5 2023-10-18T12:21:26.219 INFO:teuthology.orchestra.run.smithi114.stdout:osd.2 up in weight 1 up_from 13 up_thru 40 down_at 0 last_clean_interval [0,0) [v2:172.21.15.114:6808/2699151351,v1:172.21.15.114:6809/2699151351] [v2:172.21.15.114:6810/2699151351,v1:172.21.15.114:6811/2699151351] exists,up f3d4dbd5-521c-4dd2-b687-5768cc7d0938 2023-10-18T12:21:26.219 INFO:teuthology.orchestra.run.smithi114.stdout:osd.3 up in weight 1 up_from 13 up_thru 40 down_at 0 last_clean_interval [0,0) [v2:172.21.15.114:6819/1361608073,v1:172.21.15.114:6821/1361608073] [v2:172.21.15.114:6822/1361608073,v1:172.21.15.114:6824/1361608073] exists,up 823e5802-92b7-4f0d-b32d-a5748993f1b8 2023-10-18T12:21:26.220 INFO:teuthology.orchestra.run.smithi114.stdout:osd.4 up in weight 1 up_from 13 up_thru 40 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6800/930839681,v1:172.21.15.172:6801/930839681] [v2:172.21.15.172:6802/930839681,v1:172.21.15.172:6803/930839681] exists,up e47fb93e-13b4-44a4-b084-8c4384ceb41e 2023-10-18T12:21:26.220 INFO:teuthology.orchestra.run.smithi114.stdout:osd.5 up in weight 1 up_from 13 up_thru 43 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6812/571761850,v1:172.21.15.172:6814/571761850] [v2:172.21.15.172:6816/571761850,v1:172.21.15.172:6818/571761850] exists,up 7561a973-f479-45a0-af40-f324728d622e 2023-10-18T12:21:26.220 INFO:teuthology.orchestra.run.smithi114.stdout:osd.6 up in weight 1 up_from 13 up_thru 43 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6823/1680398853,v1:172.21.15.172:6825/1680398853] [v2:172.21.15.172:6826/1680398853,v1:172.21.15.172:6827/1680398853] exists,up 51753f4b-7f06-4f1c-9ec7-6e18a66eb980 2023-10-18T12:21:26.220 INFO:teuthology.orchestra.run.smithi114.stdout:osd.7 up in weight 1 up_from 13 up_thru 40 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6808/349710101,v1:172.21.15.172:6809/349710101] [v2:172.21.15.172:6810/349710101,v1:172.21.15.172:6811/349710101] exists,up 4d8b1e15-143d-4d17-9074-59d92f0f9af8 2023-10-18T12:21:26.220 INFO:teuthology.orchestra.run.smithi114.stdout:pg_upmap_items 7.2d [0,4] 2023-10-18T12:21:26.221 INFO:teuthology.orchestra.run.smithi114.stdout:pg_upmap_items 7.35 [0,5] 2023-10-18T12:21:26.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.211+0000 7f82ad4a7700 1 -- 172.21.15.114:0/705784950 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8288065720 msgr2=0x7f8288067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:26.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.211+0000 7f82ad4a7700 1 --2- 172.21.15.114:0/705784950 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8288065720 0x7f8288067be0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8298009b50 tx=0x7f8298009240 comp rx=0 tx=0).stop 2023-10-18T12:21:26.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.211+0000 7f82ad4a7700 1 -- 172.21.15.114:0/705784950 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82a80cda60 msgr2=0x7f82a8153550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:21:26.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.211+0000 7f82ad4a7700 1 --2- 172.21.15.114:0/705784950 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82a80cda60 0x7f82a8153550 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f82a000cb90 tx=0x7f82a000cea0 comp rx=0 tx=0).stop 2023-10-18T12:21:26.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.211+0000 7f82ad4a7700 1 -- 172.21.15.114:0/705784950 shutdown_connections 2023-10-18T12:21:26.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.211+0000 7f82ad4a7700 1 --2- 172.21.15.114:0/705784950 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8288065720 0x7f8288067be0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:26.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.211+0000 7f82ad4a7700 1 --2- 172.21.15.114:0/705784950 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f82a80cda60 0x7f82a8153550 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:26.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.211+0000 7f82ad4a7700 1 --2- 172.21.15.114:0/705784950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82a80adc00 0x7f82a814cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:26.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.211+0000 7f82ad4a7700 1 --2- 172.21.15.114:0/705784950 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f82a806d800 0x7f82a814d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:21:26.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.211+0000 7f82ad4a7700 1 -- 172.21.15.114:0/705784950 >> 172.21.15.114:0/705784950 conn(0x7f82a806a340 msgr2=0x7f82a80cb200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:21:26.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.211+0000 7f82ad4a7700 1 -- 172.21.15.114:0/705784950 shutdown_connections 2023-10-18T12:21:26.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:21:26.211+0000 7f82ad4a7700 1 -- 172.21.15.114:0/705784950 wait complete. 2023-10-18T12:21:26.243 INFO:tasks.cephfs.filesystem.ceph_manager:['osd.0 up in weight 1 up_from 13 up_thru 40 down_at 0 last_clean_interval [0,0) [v2:172.21.15.114:6816/1506287862,v1:172.21.15.114:6817/1506287862] [v2:172.21.15.114:6818/1506287862,v1:172.21.15.114:6820/1506287862] exists,up c3578978-1a03-4857-b9d2-34a5da3d7731', 'osd.1 up in weight 1 up_from 13 up_thru 40 down_at 0 last_clean_interval [0,0) [v2:172.21.15.114:6800/3302727047,v1:172.21.15.114:6801/3302727047] [v2:172.21.15.114:6802/3302727047,v1:172.21.15.114:6803/3302727047] exists,up 43eb26a6-e2b3-4670-9559-bd053b5140d5', 'osd.2 up in weight 1 up_from 13 up_thru 40 down_at 0 last_clean_interval [0,0) [v2:172.21.15.114:6808/2699151351,v1:172.21.15.114:6809/2699151351] [v2:172.21.15.114:6810/2699151351,v1:172.21.15.114:6811/2699151351] exists,up f3d4dbd5-521c-4dd2-b687-5768cc7d0938', 'osd.3 up in weight 1 up_from 13 up_thru 40 down_at 0 last_clean_interval [0,0) [v2:172.21.15.114:6819/1361608073,v1:172.21.15.114:6821/1361608073] [v2:172.21.15.114:6822/1361608073,v1:172.21.15.114:6824/1361608073] exists,up 823e5802-92b7-4f0d-b32d-a5748993f1b8', 'osd.4 up in weight 1 up_from 13 up_thru 40 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6800/930839681,v1:172.21.15.172:6801/930839681] [v2:172.21.15.172:6802/930839681,v1:172.21.15.172:6803/930839681] exists,up e47fb93e-13b4-44a4-b084-8c4384ceb41e', 'osd.5 up in weight 1 up_from 13 up_thru 43 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6812/571761850,v1:172.21.15.172:6814/571761850] [v2:172.21.15.172:6816/571761850,v1:172.21.15.172:6818/571761850] exists,up 7561a973-f479-45a0-af40-f324728d622e', 'osd.6 up in weight 1 up_from 13 up_thru 43 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6823/1680398853,v1:172.21.15.172:6825/1680398853] [v2:172.21.15.172:6826/1680398853,v1:172.21.15.172:6827/1680398853] exists,up 51753f4b-7f06-4f1c-9ec7-6e18a66eb980', 'osd.7 up in weight 1 up_from 13 up_thru 40 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6808/349710101,v1:172.21.15.172:6809/349710101] [v2:172.21.15.172:6810/349710101,v1:172.21.15.172:6811/349710101] exists,up 4d8b1e15-143d-4d17-9074-59d92f0f9af8'] 2023-10-18T12:21:26.244 INFO:tasks.ceph.osd.0:Sent signal 19 2023-10-18T12:21:32.254 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:21:32.262 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:21:47.027 INFO:tasks.ceph.osd.1.smithi114.stderr:2023-10-18T12:21:47.019+0000 7f7a565f3700 -1 osd.1 44 heartbeat_check: no reply from 172.21.15.114:6823 osd.0 since back 2023-10-18T12:21:25.017621+0000 front 2023-10-18T12:21:25.017781+0000 (oldest deadline 2023-10-18T12:21:46.717822+0000) 2023-10-18T12:21:48.006 INFO:tasks.ceph.osd.7.smithi172.stderr:2023-10-18T12:21:48.001+0000 7f56f93f3700 -1 osd.7 44 heartbeat_check: no reply from 172.21.15.114:6823 osd.0 since back 2023-10-18T12:21:24.216919+0000 front 2023-10-18T12:21:24.217182+0000 (oldest deadline 2023-10-18T12:21:47.116736+0000) 2023-10-18T12:21:48.040 INFO:tasks.ceph.osd.1.smithi114.stderr:2023-10-18T12:21:48.035+0000 7f7a565f3700 -1 osd.1 44 heartbeat_check: no reply from 172.21.15.114:6823 osd.0 since back 2023-10-18T12:21:25.017621+0000 front 2023-10-18T12:21:25.017781+0000 (oldest deadline 2023-10-18T12:21:46.717822+0000) 2023-10-18T12:21:48.989 INFO:tasks.ceph.osd.7.smithi172.stderr:2023-10-18T12:21:48.981+0000 7f56f93f3700 -1 osd.7 44 heartbeat_check: no reply from 172.21.15.114:6823 osd.0 since back 2023-10-18T12:21:24.216919+0000 front 2023-10-18T12:21:24.217182+0000 (oldest deadline 2023-10-18T12:21:47.116736+0000) 2023-10-18T12:21:49.072 INFO:tasks.ceph.osd.1.smithi114.stderr:2023-10-18T12:21:49.067+0000 7f7a565f3700 -1 osd.1 44 heartbeat_check: no reply from 172.21.15.114:6823 osd.0 since back 2023-10-18T12:21:25.017621+0000 front 2023-10-18T12:21:25.017781+0000 (oldest deadline 2023-10-18T12:21:46.717822+0000) 2023-10-18T12:21:49.672 INFO:tasks.ceph.osd.6.smithi172.stderr:2023-10-18T12:21:49.665+0000 7f33ae3f3700 -1 osd.6 44 heartbeat_check: no reply from 172.21.15.114:6823 osd.0 since back 2023-10-18T12:21:24.291408+0000 front 2023-10-18T12:21:24.291052+0000 (oldest deadline 2023-10-18T12:21:48.991030+0000) 2023-10-18T12:21:49.994 INFO:tasks.ceph.osd.7.smithi172.stderr:2023-10-18T12:21:49.989+0000 7f56f93f3700 -1 osd.7 44 heartbeat_check: no reply from 172.21.15.114:6823 osd.0 since back 2023-10-18T12:21:24.216919+0000 front 2023-10-18T12:21:24.217182+0000 (oldest deadline 2023-10-18T12:21:47.116736+0000) 2023-10-18T12:21:50.121 INFO:tasks.ceph.osd.1.smithi114.stderr:2023-10-18T12:21:50.115+0000 7f7a565f3700 -1 osd.1 44 heartbeat_check: no reply from 172.21.15.114:6823 osd.0 since back 2023-10-18T12:21:25.017621+0000 front 2023-10-18T12:21:25.017781+0000 (oldest deadline 2023-10-18T12:21:46.717822+0000) 2023-10-18T12:21:50.611 INFO:tasks.ceph.osd.3.smithi114.stderr:2023-10-18T12:21:50.603+0000 7f955d5f3700 -1 osd.3 44 heartbeat_check: no reply from 172.21.15.114:6823 osd.0 since back 2023-10-18T12:21:24.530495+0000 front 2023-10-18T12:21:24.530351+0000 (oldest deadline 2023-10-18T12:21:50.430569+0000) 2023-10-18T12:22:02.341 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:22:02.349 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:22:32.440 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:22:32.448 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:23:02.509 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:23:02.517 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:23:26.245 INFO:tasks.ceph.osd.0:Sent signal 18 2023-10-18T12:23:26.246 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:23:26.247 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-18T12:23:26.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:23:26.263 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-18T12:23:26.337 INFO:teuthology.orchestra.run.smithi114.stdout:client5521 2023-10-18T12:23:26.337 INFO:tasks.cephfs.mount:Killing connection on ubuntu@smithi114.front.sepia.ceph.com... 2023-10-18T12:23:26.338 INFO:tasks.cephfs.mount:Suspending the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-18T12:23:26.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:23:26.338 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 down 2023-10-18T12:23:26.425 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T12:23:26.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.641+0000 7f94ecbaf700 1 Processor -- start 2023-10-18T12:23:26.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.641+0000 7f94ecbaf700 1 -- start start 2023-10-18T12:23:26.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.641+0000 7f94ecbaf700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f94e80b1df0 0x7f94e80d13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:23:26.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.641+0000 7f94ecbaf700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e815d060 con 0x7f94e80d30e0 2023-10-18T12:23:26.648 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.641+0000 7f94ecbaf700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e806d830 con 0x7f94e815cc80 2023-10-18T12:23:26.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.641+0000 7f94ecbaf700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94e806dd60 con 0x7f94e80b1df0 2023-10-18T12:23:26.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.641+0000 7f94e6ffd700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f94e80d30e0 0x7f94e8160730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:38376/0 (socket says 172.21.15.114:38376) 2023-10-18T12:23:26.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.645+0000 7f94e6ffd700 1 -- 172.21.15.114:0/3454307485 learned_addr learned my addr 172.21.15.114:0/3454307485 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:23:26.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.645+0000 7f94e7fff700 1 --2- 172.21.15.114:0/3454307485 >> v2:172.21.15.172:3300/0 conn(0x7f94e80b1df0 0x7f94e80d13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:23:26.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.645+0000 7f94e67fc700 1 -- 172.21.15.114:0/3454307485 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2033182197 0 0) 0x7f94e815d060 con 0x7f94e80d30e0 2023-10-18T12:23:26.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.645+0000 7f94e67fc700 1 -- 172.21.15.114:0/3454307485 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94d00035d0 con 0x7f94e80d30e0 2023-10-18T12:23:26.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.645+0000 7f94e67fc700 1 -- 172.21.15.114:0/3454307485 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 658301407 0 0) 0x7f94e806d830 con 0x7f94e815cc80 2023-10-18T12:23:26.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.645+0000 7f94e67fc700 1 -- 172.21.15.114:0/3454307485 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94e815d060 con 0x7f94e815cc80 2023-10-18T12:23:26.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.645+0000 7f94e7fff700 1 -- 172.21.15.114:0/3454307485 >> v1:172.21.15.172:6789/0 conn(0x7f94e815cc80 legacy=0x7f94e80d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:23:26.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.645+0000 7f94e7fff700 1 -- 172.21.15.114:0/3454307485 >> v1:172.21.15.114:6789/0 conn(0x7f94e80d30e0 legacy=0x7f94e8160730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:23:26.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.645+0000 7f94e7fff700 1 -- 172.21.15.114:0/3454307485 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e806da80 con 0x7f94e80b1df0 2023-10-18T12:23:26.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.645+0000 7f94e7fff700 1 --2- 172.21.15.114:0/3454307485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94e80b1df0 0x7f94e80d13c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f94e0009d90 tx=0x7f94e000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=894d7f69589be7bb server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:23:26.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.645+0000 7f94e67fc700 1 -- 172.21.15.114:0/3454307485 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e000e070 con 0x7f94e80b1df0 2023-10-18T12:23:26.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.645+0000 7f94e67fc700 1 -- 172.21.15.114:0/3454307485 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e000bb20 con 0x7f94e80b1df0 2023-10-18T12:23:26.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.645+0000 7f94e67fc700 1 -- 172.21.15.114:0/3454307485 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e0012430 con 0x7f94e80b1df0 2023-10-18T12:23:26.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.645+0000 7f94ecbaf700 1 -- 172.21.15.114:0/3454307485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94e80b1df0 msgr2=0x7f94e80d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:23:26.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.645+0000 7f94ecbaf700 1 --2- 172.21.15.114:0/3454307485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94e80b1df0 0x7f94e80d13c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f94e0009d90 tx=0x7f94e000b330 comp rx=0 tx=0).stop 2023-10-18T12:23:26.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.645+0000 7f94ecbaf700 1 -- 172.21.15.114:0/3454307485 shutdown_connections 2023-10-18T12:23:26.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.645+0000 7f94ecbaf700 1 --2- 172.21.15.114:0/3454307485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94e80b1df0 0x7f94e80d13c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:23:26.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.645+0000 7f94ecbaf700 1 -- 172.21.15.114:0/3454307485 >> 172.21.15.114:0/3454307485 conn(0x7f94e80cf530 msgr2=0x7f94e80cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:23:26.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.645+0000 7f94ecbaf700 1 -- 172.21.15.114:0/3454307485 shutdown_connections 2023-10-18T12:23:26.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.645+0000 7f94ecbaf700 1 -- 172.21.15.114:0/3454307485 wait complete. 2023-10-18T12:23:26.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.649+0000 7f94ecbaf700 1 Processor -- start 2023-10-18T12:23:26.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.649+0000 7f94ecbaf700 1 -- start start 2023-10-18T12:23:26.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.649+0000 7f94ecbaf700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94e80b1df0 0x7f94e814b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:23:26.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.649+0000 7f94ecbaf700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f94e80d30e0 0x7f94e81f29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:23:26.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.649+0000 7f94ecbaf700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94e815cc80 0x7f94e815b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:23:26.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.649+0000 7f94ecbaf700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e80b4810 con 0x7f94e80b1df0 2023-10-18T12:23:26.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.649+0000 7f94ecbaf700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e814baf0 con 0x7f94e815cc80 2023-10-18T12:23:26.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.649+0000 7f94ecbaf700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e80b17c0 con 0x7f94e80d30e0 2023-10-18T12:23:26.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.649+0000 7f94e77fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94e80b1df0 0x7f94e814b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:23:26.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.649+0000 7f94e77fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94e80b1df0 0x7f94e814b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35872/0 (socket says 172.21.15.114:35872) 2023-10-18T12:23:26.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.649+0000 7f94e77fe700 1 -- 172.21.15.114:0/2070431105 learned_addr learned my addr 172.21.15.114:0/2070431105 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:23:26.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.649+0000 7f94e7fff700 1 --2- 172.21.15.114:0/2070431105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94e815cc80 0x7f94e815b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:23:26.660 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.653+0000 7f94e6ffd700 1 --2- 172.21.15.114:0/2070431105 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f94e80d30e0 0x7f94e81f29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:23:26.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.653+0000 7f94e77fe700 1 -- 172.21.15.114:0/2070431105 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f94e80d30e0 msgr2=0x7f94e81f29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:23:26.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.653+0000 7f94e77fe700 1 --2- 172.21.15.114:0/2070431105 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f94e80d30e0 0x7f94e81f29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:23:26.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.653+0000 7f94e77fe700 1 -- 172.21.15.114:0/2070431105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94e815cc80 msgr2=0x7f94e815b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:23:26.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.653+0000 7f94e77fe700 1 --2- 172.21.15.114:0/2070431105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94e815cc80 0x7f94e815b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:23:26.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.653+0000 7f94e77fe700 1 -- 172.21.15.114:0/2070431105 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e0009a70 con 0x7f94e80b1df0 2023-10-18T12:23:26.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.653+0000 7f94e77fe700 1 --2- 172.21.15.114:0/2070431105 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94e80b1df0 0x7f94e814b0d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f94d800c500 tx=0x7f94d800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:23:26.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.653+0000 7f94cffff700 1 -- 172.21.15.114:0/2070431105 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d80052d0 con 0x7f94e80b1df0 2023-10-18T12:23:26.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.653+0000 7f94cffff700 1 -- 172.21.15.114:0/2070431105 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d800ce90 con 0x7f94e80b1df0 2023-10-18T12:23:26.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.653+0000 7f94ecbaf700 1 -- 172.21.15.114:0/2070431105 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e81f2ee0 con 0x7f94e80b1df0 2023-10-18T12:23:26.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.653+0000 7f94cffff700 1 -- 172.21.15.114:0/2070431105 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d80036f0 con 0x7f94e80b1df0 2023-10-18T12:23:26.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.653+0000 7f94ecbaf700 1 -- 172.21.15.114:0/2070431105 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e80b3e70 con 0x7f94e80b1df0 2023-10-18T12:23:26.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.653+0000 7f94ecbaf700 1 -- 172.21.15.114:0/2070431105 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94e80709d0 con 0x7f94e80b1df0 2023-10-18T12:23:26.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.657+0000 7f94cffff700 1 -- 172.21.15.114:0/2070431105 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f94d8003850 con 0x7f94e80b1df0 2023-10-18T12:23:26.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.657+0000 7f94cffff700 1 --2- 172.21.15.114:0/2070431105 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f94d40656f0 0x7f94d4067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:23:26.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.657+0000 7f94cffff700 1 -- 172.21.15.114:0/2070431105 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f94d8082410 con 0x7f94e80b1df0 2023-10-18T12:23:26.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.657+0000 7f94e6ffd700 1 --2- 172.21.15.114:0/2070431105 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f94d40656f0 0x7f94d4067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:23:26.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.661+0000 7f94e6ffd700 1 --2- 172.21.15.114:0/2070431105 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f94d40656f0 0x7f94d4067bb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f94e806cf90 tx=0x7f94dc007de0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:23:26.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.665+0000 7f94cffff700 1 -- 172.21.15.114:0/2070431105 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f94d804fc30 con 0x7f94e80b1df0 2023-10-18T12:23:26.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.893+0000 7f94ecbaf700 1 -- 172.21.15.114:0/2070431105 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f94e8072e60 con 0x7f94e80b1df0 2023-10-18T12:23:26.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.897+0000 7f94cffff700 1 -- 172.21.15.114:0/2070431105 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4887 (secure 0 0 0) 0x7f94d8053250 con 0x7f94e80b1df0 2023-10-18T12:23:26.901 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:23:26.901 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2034957068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2034957068},{"type":"v1","addr":"172.21.15.172:6836","nonce":2034957068}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5039,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4215710360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4215710360},{"type":"v1","addr":"172.21.15.172:6837","nonce":4215710360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2387835210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2387835210},{"type":"v1","addr":"172.21.15.114:6833","nonce":2387835210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T12:21:14.159069+0000","modified":"2023-10-18T12:21:17.730177+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.114:6835/1284474820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1284474820},{"type":"v1","addr":"172.21.15.114:6835","nonce":1284474820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-18T12:23:26.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.897+0000 7f94ecbaf700 1 -- 172.21.15.114:0/2070431105 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f94d40656f0 msgr2=0x7f94d4067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:23:26.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.897+0000 7f94ecbaf700 1 --2- 172.21.15.114:0/2070431105 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f94d40656f0 0x7f94d4067bb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f94e806cf90 tx=0x7f94dc007de0 comp rx=0 tx=0).stop 2023-10-18T12:23:26.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.897+0000 7f94ecbaf700 1 -- 172.21.15.114:0/2070431105 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94e80b1df0 msgr2=0x7f94e814b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:23:26.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.897+0000 7f94ecbaf700 1 --2- 172.21.15.114:0/2070431105 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94e80b1df0 0x7f94e814b0d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f94d800c500 tx=0x7f94d800c810 comp rx=0 tx=0).stop 2023-10-18T12:23:26.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.897+0000 7f94ecbaf700 1 -- 172.21.15.114:0/2070431105 shutdown_connections 2023-10-18T12:23:26.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.897+0000 7f94ecbaf700 1 --2- 172.21.15.114:0/2070431105 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f94d40656f0 0x7f94d4067bb0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:23:26.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.897+0000 7f94ecbaf700 1 --2- 172.21.15.114:0/2070431105 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f94e80d30e0 0x7f94e81f29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:23:26.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.897+0000 7f94ecbaf700 1 --2- 172.21.15.114:0/2070431105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94e815cc80 0x7f94e815b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:23:26.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.897+0000 7f94ecbaf700 1 --2- 172.21.15.114:0/2070431105 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f94e80b1df0 0x7f94e814b0d0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:23:26.905 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.897+0000 7f94ecbaf700 1 -- 172.21.15.114:0/2070431105 >> 172.21.15.114:0/2070431105 conn(0x7f94e80cf530 msgr2=0x7f94e815d810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:23:26.906 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.897+0000 7f94ecbaf700 1 -- 172.21.15.114:0/2070431105 shutdown_connections 2023-10-18T12:23:26.906 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:26.901+0000 7f94ecbaf700 1 -- 172.21.15.114:0/2070431105 wait complete. 2023-10-18T12:23:26.907 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 18 2023-10-18T12:23:26.926 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-10-18T12:23:27.110 INFO:teuthology.orchestra.run.smithi114.stdout:[{"id":5162,"entity":{"name":{"type":"client","num":5162},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":989916161}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":123.125077499,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.75241285778343003,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":3,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5162 v1:192.168.0.1:0/989916161","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi172","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}},{"id":5521,"entity":{"name":{"type":"client","num":5521},"addr":{"type":"v1","addr":"172.21.15.114:0","nonce":1817588655}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":8,"uptime":124.597042328,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.74986520757618169,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":25,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5521 v1:172.21.15.114:0/1817588655","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi114","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}}] 2023-10-18T12:23:27.111 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "1", "hostname": "smithi172", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 989916161, "type": "v1" }, "name": { "num": 5162, "type": "client" } }, "id": 5162, "inst": "client.5162 v1:192.168.0.1:0/989916161", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 3, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.75241285778343 }, "state": "open", "uptime": 123.125077499 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "0", "hostname": "smithi114", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.114:0", "nonce": 1817588655, "type": "v1" }, "name": { "num": 5521, "type": "client" } }, "id": 5521, "inst": "client.5521 v1:172.21.15.114:0/1817588655", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 25, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 8, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.7498652075761817 }, "state": "open", "uptime": 124.597042328 } ] 2023-10-18T12:23:27.111 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T12:23:27.274 INFO:tasks.ceph.osd.0.smithi114.stderr:2023-10-18T12:23:27.269+0000 7f0144ff0700 -1 osd.0 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T12:23:27.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.289+0000 7fc0d9dd2700 1 Processor -- start 2023-10-18T12:23:27.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.293+0000 7fc0d9dd2700 1 -- start start 2023-10-18T12:23:27.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.293+0000 7fc0d9dd2700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc0d40d2e00 0x7fc0d40b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:23:27.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.293+0000 7fc0d9dd2700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc0d40b5ae0 0x7fc0d406db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:23:27.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.293+0000 7fc0d9dd2700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0d415d0d0 con 0x7fc0d4160710 2023-10-18T12:23:27.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.293+0000 7fc0d9dd2700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0d415df90 con 0x7fc0d40b5ae0 2023-10-18T12:23:27.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.293+0000 7fc0d9dd2700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0d406f0f0 con 0x7fc0d40d2e00 2023-10-18T12:23:27.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.297+0000 7fc0d95d1700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc0d40b5ae0 0x7fc0d406db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:23:27.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.297+0000 7fc0d95d1700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc0d40b5ae0 0x7fc0d406db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35886/0 (socket says 172.21.15.114:35886) 2023-10-18T12:23:27.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.297+0000 7fc0d95d1700 1 -- 172.21.15.114:0/1516417837 learned_addr learned my addr 172.21.15.114:0/1516417837 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:23:27.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.297+0000 7fc0d8dd0700 1 --2- 172.21.15.114:0/1516417837 >> v2:172.21.15.172:3300/0 conn(0x7fc0d40d2e00 0x7fc0d40b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:23:27.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.297+0000 7fc0d95d1700 1 -- 172.21.15.114:0/1516417837 >> v2:172.21.15.172:3300/0 conn(0x7fc0d40d2e00 msgr2=0x7fc0d40b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:23:27.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.297+0000 7fc0d95d1700 1 --2- 172.21.15.114:0/1516417837 >> v2:172.21.15.172:3300/0 conn(0x7fc0d40d2e00 0x7fc0d40b6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:23:27.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.297+0000 7fc0d95d1700 1 -- 172.21.15.114:0/1516417837 >> v1:172.21.15.172:6789/0 conn(0x7fc0d4160710 legacy=0x7fc0d40d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:23:27.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.297+0000 7fc0d95d1700 1 -- 172.21.15.114:0/1516417837 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d415d310 con 0x7fc0d40b5ae0 2023-10-18T12:23:27.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.297+0000 7fc0d95d1700 1 --2- 172.21.15.114:0/1516417837 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0d40b5ae0 0x7fc0d406db60 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4070660 tx=0x7fc0cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10908fdf436947c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:23:27.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.297+0000 7fc0d37fe700 1 -- 172.21.15.114:0/1516417837 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc00e070 con 0x7fc0d40b5ae0 2023-10-18T12:23:27.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.297+0000 7fc0d37fe700 1 -- 172.21.15.114:0/1516417837 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0cc00b9c0 con 0x7fc0d40b5ae0 2023-10-18T12:23:27.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.297+0000 7fc0d37fe700 1 -- 172.21.15.114:0/1516417837 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc00bd70 con 0x7fc0d40b5ae0 2023-10-18T12:23:27.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.297+0000 7fc0d9dd2700 1 -- 172.21.15.114:0/1516417837 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0d40b5ae0 msgr2=0x7fc0d406db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:23:27.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.297+0000 7fc0d9dd2700 1 --2- 172.21.15.114:0/1516417837 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0d40b5ae0 0x7fc0d406db60 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4070660 tx=0x7fc0cc00b330 comp rx=0 tx=0).stop 2023-10-18T12:23:27.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.297+0000 7fc0d9dd2700 1 -- 172.21.15.114:0/1516417837 shutdown_connections 2023-10-18T12:23:27.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.297+0000 7fc0d9dd2700 1 --2- 172.21.15.114:0/1516417837 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0d40b5ae0 0x7fc0d406db60 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:23:27.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.297+0000 7fc0d9dd2700 1 --2- 172.21.15.114:0/1516417837 >> v2:172.21.15.172:3300/0 conn(0x7fc0d40d2e00 0x7fc0d40b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:23:27.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.297+0000 7fc0d9dd2700 1 -- 172.21.15.114:0/1516417837 >> 172.21.15.114:0/1516417837 conn(0x7fc0d4069f20 msgr2=0x7fc0d406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:23:27.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.297+0000 7fc0d9dd2700 1 -- 172.21.15.114:0/1516417837 shutdown_connections 2023-10-18T12:23:27.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.297+0000 7fc0d9dd2700 1 -- 172.21.15.114:0/1516417837 wait complete. 2023-10-18T12:23:27.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.301+0000 7fc0d9dd2700 1 Processor -- start 2023-10-18T12:23:27.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.301+0000 7fc0d9dd2700 1 -- start start 2023-10-18T12:23:27.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.301+0000 7fc0d9dd2700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0d40b5ae0 0x7fc0d415f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:23:27.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.301+0000 7fc0d9dd2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc0d40d2e00 0x7fc0d415ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:23:27.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.301+0000 7fc0d9dd2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0d4160710 0x7fc0d406f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:23:27.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.301+0000 7fc0d9dd2700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d41548d0 con 0x7fc0d40b5ae0 2023-10-18T12:23:27.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.301+0000 7fc0d9dd2700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d41f24c0 con 0x7fc0d4160710 2023-10-18T12:23:27.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.301+0000 7fc0d9dd2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d41f2780 con 0x7fc0d40d2e00 2023-10-18T12:23:27.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.301+0000 7fc0d8dd0700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0d40b5ae0 0x7fc0d415f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:23:27.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.301+0000 7fc0d3fff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc0d40d2e00 0x7fc0d415ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:23:27.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.301+0000 7fc0d8dd0700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0d40b5ae0 0x7fc0d415f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35892/0 (socket says 172.21.15.114:35892) 2023-10-18T12:23:27.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.301+0000 7fc0d8dd0700 1 -- 172.21.15.114:0/2294322028 learned_addr learned my addr 172.21.15.114:0/2294322028 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:23:27.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.301+0000 7fc0d95d1700 1 --2- 172.21.15.114:0/2294322028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0d4160710 0x7fc0d406f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:23:27.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.305+0000 7fc0d3fff700 1 -- 172.21.15.114:0/2294322028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0d4160710 msgr2=0x7fc0d406f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:23:27.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.305+0000 7fc0d3fff700 1 --2- 172.21.15.114:0/2294322028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0d4160710 0x7fc0d406f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:23:27.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.305+0000 7fc0d3fff700 1 -- 172.21.15.114:0/2294322028 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0d40b5ae0 msgr2=0x7fc0d415f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:23:27.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.305+0000 7fc0d3fff700 1 --2- 172.21.15.114:0/2294322028 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0d40b5ae0 0x7fc0d415f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:23:27.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.305+0000 7fc0d3fff700 1 -- 172.21.15.114:0/2294322028 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0cc009b30 con 0x7fc0d40d2e00 2023-10-18T12:23:27.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.305+0000 7fc0d3fff700 1 --2- 172.21.15.114:0/2294322028 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc0d40d2e00 0x7fc0d415ff80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc0d40b7340 tx=0x7fc0c000c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:23:27.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.305+0000 7fc0d17fa700 1 -- 172.21.15.114:0/2294322028 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c00052d0 con 0x7fc0d40d2e00 2023-10-18T12:23:27.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.305+0000 7fc0d17fa700 1 -- 172.21.15.114:0/2294322028 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0c0005430 con 0x7fc0d40d2e00 2023-10-18T12:23:27.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.305+0000 7fc0d9dd2700 1 -- 172.21.15.114:0/2294322028 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0d41f2a60 con 0x7fc0d40d2e00 2023-10-18T12:23:27.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.305+0000 7fc0d17fa700 1 -- 172.21.15.114:0/2294322028 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c00055a0 con 0x7fc0d40d2e00 2023-10-18T12:23:27.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.305+0000 7fc0d9dd2700 1 -- 172.21.15.114:0/2294322028 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0d41f3020 con 0x7fc0d40d2e00 2023-10-18T12:23:27.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.305+0000 7fc0d9dd2700 1 -- 172.21.15.114:0/2294322028 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0d41f3240 con 0x7fc0d40d2e00 2023-10-18T12:23:27.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.309+0000 7fc0d17fa700 1 -- 172.21.15.114:0/2294322028 <== mon.2 v2:172.21.15.172:3301/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fc0c00038e0 con 0x7fc0d40d2e00 2023-10-18T12:23:27.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.309+0000 7fc0d17fa700 1 --2- 172.21.15.114:0/2294322028 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc0b8065740 0x7fc0b8067c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:23:27.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.309+0000 7fc0d17fa700 1 -- 172.21.15.114:0/2294322028 <== mon.2 v2:172.21.15.172:3301/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fc0c00820d0 con 0x7fc0d40d2e00 2023-10-18T12:23:27.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.309+0000 7fc0d8dd0700 1 --2- 172.21.15.114:0/2294322028 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc0b8065740 0x7fc0b8067c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:23:27.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.313+0000 7fc0d8dd0700 1 --2- 172.21.15.114:0/2294322028 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc0b8065740 0x7fc0b8067c00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4153b20 tx=0x7fc0c8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:23:27.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.317+0000 7fc0d17fa700 1 -- 172.21.15.114:0/2294322028 <== mon.2 v2:172.21.15.172:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fc0c004f9f0 con 0x7fc0d40d2e00 2023-10-18T12:23:27.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.545+0000 7fc0d9dd2700 1 -- 172.21.15.114:0/2294322028 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc0d415d0d0 con 0x7fc0d40d2e00 2023-10-18T12:23:27.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.549+0000 7fc0d17fa700 1 -- 172.21.15.114:0/2294322028 <== mon.2 v2:172.21.15.172:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4887 (secure 0 0 0) 0x7fc0d415d0d0 con 0x7fc0d40d2e00 2023-10-18T12:23:27.554 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:23:27.554 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2034957068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2034957068},{"type":"v1","addr":"172.21.15.172:6836","nonce":2034957068}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5039,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4215710360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4215710360},{"type":"v1","addr":"172.21.15.172:6837","nonce":4215710360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2387835210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2387835210},{"type":"v1","addr":"172.21.15.114:6833","nonce":2387835210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T12:21:14.159069+0000","modified":"2023-10-18T12:21:17.730177+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.114:6835/1284474820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1284474820},{"type":"v1","addr":"172.21.15.114:6835","nonce":1284474820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-18T12:23:27.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.553+0000 7fc0d9dd2700 1 -- 172.21.15.114:0/2294322028 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc0b8065740 msgr2=0x7fc0b8067c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:23:27.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.553+0000 7fc0d9dd2700 1 --2- 172.21.15.114:0/2294322028 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc0b8065740 0x7fc0b8067c00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4153b20 tx=0x7fc0c8008040 comp rx=0 tx=0).stop 2023-10-18T12:23:27.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.553+0000 7fc0d9dd2700 1 -- 172.21.15.114:0/2294322028 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc0d40d2e00 msgr2=0x7fc0d415ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:23:27.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.553+0000 7fc0d9dd2700 1 --2- 172.21.15.114:0/2294322028 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc0d40d2e00 0x7fc0d415ff80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc0d40b7340 tx=0x7fc0c000c760 comp rx=0 tx=0).stop 2023-10-18T12:23:27.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.553+0000 7fc0d9dd2700 1 -- 172.21.15.114:0/2294322028 shutdown_connections 2023-10-18T12:23:27.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.553+0000 7fc0d9dd2700 1 --2- 172.21.15.114:0/2294322028 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc0b8065740 0x7fc0b8067c00 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:23:27.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.553+0000 7fc0d9dd2700 1 --2- 172.21.15.114:0/2294322028 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc0d40d2e00 0x7fc0d415ff80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:23:27.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.553+0000 7fc0d9dd2700 1 --2- 172.21.15.114:0/2294322028 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0d4160710 0x7fc0d406f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:23:27.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.553+0000 7fc0d9dd2700 1 --2- 172.21.15.114:0/2294322028 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc0d40b5ae0 0x7fc0d415f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:23:27.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.553+0000 7fc0d9dd2700 1 -- 172.21.15.114:0/2294322028 >> 172.21.15.114:0/2294322028 conn(0x7fc0d4069f20 msgr2=0x7fc0d40b2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:23:27.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.553+0000 7fc0d9dd2700 1 -- 172.21.15.114:0/2294322028 shutdown_connections 2023-10-18T12:23:27.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:23:27.553+0000 7fc0d9dd2700 1 -- 172.21.15.114:0/2294322028 wait complete. 2023-10-18T12:23:27.560 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 18 2023-10-18T12:23:32.597 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:23:32.606 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:24:02.704 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:24:02.713 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:24:32.776 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:24:32.784 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:24:57.580 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T12:24:57.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.750+0000 7fc85f411700 1 Processor -- start 2023-10-18T12:24:57.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.750+0000 7fc85f411700 1 -- start start 2023-10-18T12:24:57.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.754+0000 7fc85f411700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc85815ee50 0x7fc8580cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:24:57.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.754+0000 7fc85f411700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc85806e8a0 0x7fc8580caf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:24:57.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.754+0000 7fc85f411700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc85806f450 con 0x7fc8580cb470 2023-10-18T12:24:57.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.754+0000 7fc85f411700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc85806d4e0 con 0x7fc85806e8a0 2023-10-18T12:24:57.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.754+0000 7fc85f411700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc858162780 con 0x7fc85815ee50 2023-10-18T12:24:57.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.754+0000 7fc85c9ac700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc85806e8a0 0x7fc8580caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:24:57.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.754+0000 7fc85c9ac700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc85806e8a0 0x7fc8580caf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54322/0 (socket says 172.21.15.114:54322) 2023-10-18T12:24:57.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.754+0000 7fc85c9ac700 1 -- 172.21.15.114:0/1853304305 learned_addr learned my addr 172.21.15.114:0/1853304305 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:24:57.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.754+0000 7fc85d1ad700 1 --2- 172.21.15.114:0/1853304305 >> v2:172.21.15.172:3300/0 conn(0x7fc85815ee50 0x7fc8580cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:24:57.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.754+0000 7fc85c9ac700 1 -- 172.21.15.114:0/1853304305 >> v2:172.21.15.172:3300/0 conn(0x7fc85815ee50 msgr2=0x7fc8580cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:24:57.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.754+0000 7fc85c9ac700 1 --2- 172.21.15.114:0/1853304305 >> v2:172.21.15.172:3300/0 conn(0x7fc85815ee50 0x7fc8580cc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:24:57.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.754+0000 7fc85c9ac700 1 -- 172.21.15.114:0/1853304305 >> v1:172.21.15.172:6789/0 conn(0x7fc8580cb470 legacy=0x7fc85806f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:24:57.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.754+0000 7fc85c9ac700 1 -- 172.21.15.114:0/1853304305 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8580cb8a0 con 0x7fc85806e8a0 2023-10-18T12:24:57.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.754+0000 7fc85c9ac700 1 --2- 172.21.15.114:0/1853304305 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc85806e8a0 0x7fc8580caf30 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fc85806b360 tx=0x7fc848009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4bc0bbe58615bae server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:24:57.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.758+0000 7fc84ffff700 1 -- 172.21.15.114:0/1853304305 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84800b8a0 con 0x7fc85806e8a0 2023-10-18T12:24:57.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.758+0000 7fc84ffff700 1 -- 172.21.15.114:0/1853304305 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc84800ba00 con 0x7fc85806e8a0 2023-10-18T12:24:57.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.758+0000 7fc84ffff700 1 -- 172.21.15.114:0/1853304305 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84800bd90 con 0x7fc85806e8a0 2023-10-18T12:24:57.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.758+0000 7fc85f411700 1 -- 172.21.15.114:0/1853304305 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc85806e8a0 msgr2=0x7fc8580caf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:24:57.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.758+0000 7fc85f411700 1 --2- 172.21.15.114:0/1853304305 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc85806e8a0 0x7fc8580caf30 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fc85806b360 tx=0x7fc848009bf0 comp rx=0 tx=0).stop 2023-10-18T12:24:57.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.758+0000 7fc85f411700 1 -- 172.21.15.114:0/1853304305 shutdown_connections 2023-10-18T12:24:57.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.758+0000 7fc85f411700 1 --2- 172.21.15.114:0/1853304305 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc85806e8a0 0x7fc8580caf30 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:24:57.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.758+0000 7fc85f411700 1 --2- 172.21.15.114:0/1853304305 >> v2:172.21.15.172:3300/0 conn(0x7fc85815ee50 0x7fc8580cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:24:57.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.758+0000 7fc85f411700 1 -- 172.21.15.114:0/1853304305 >> 172.21.15.114:0/1853304305 conn(0x7fc85806a340 msgr2=0x7fc8580b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:24:57.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.758+0000 7fc85f411700 1 -- 172.21.15.114:0/1853304305 shutdown_connections 2023-10-18T12:24:57.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.758+0000 7fc85f411700 1 -- 172.21.15.114:0/1853304305 wait complete. 2023-10-18T12:24:57.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.758+0000 7fc85f411700 1 Processor -- start 2023-10-18T12:24:57.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.762+0000 7fc85f411700 1 -- start start 2023-10-18T12:24:57.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.762+0000 7fc85f411700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc85806e8a0 0x7fc8580acf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:24:57.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.762+0000 7fc85f411700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8580cb470 0x7fc8580aed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:24:57.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.762+0000 7fc85f411700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc85815ee50 0x7fc85814d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:24:57.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.762+0000 7fc85f411700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8581611c0 con 0x7fc85815ee50 2023-10-18T12:24:57.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.762+0000 7fc85f411700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8580ad470 con 0x7fc8580cb470 2023-10-18T12:24:57.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.762+0000 7fc85f411700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc858154570 con 0x7fc85806e8a0 2023-10-18T12:24:57.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.762+0000 7fc85d9ae700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc85815ee50 0x7fc85814d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:24:57.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.762+0000 7fc85d9ae700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc85815ee50 0x7fc85814d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54326/0 (socket says 172.21.15.114:54326) 2023-10-18T12:24:57.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.762+0000 7fc85d9ae700 1 -- 172.21.15.114:0/2037777113 learned_addr learned my addr 172.21.15.114:0/2037777113 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:24:57.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.762+0000 7fc85d1ad700 1 --2- 172.21.15.114:0/2037777113 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc85806e8a0 0x7fc8580acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:24:57.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.762+0000 7fc85c9ac700 1 --2- 172.21.15.114:0/2037777113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8580cb470 0x7fc8580aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:24:57.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.762+0000 7fc85d9ae700 1 -- 172.21.15.114:0/2037777113 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc85806e8a0 msgr2=0x7fc8580acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:24:57.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.762+0000 7fc85d9ae700 1 --2- 172.21.15.114:0/2037777113 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc85806e8a0 0x7fc8580acf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:24:57.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.762+0000 7fc85d9ae700 1 -- 172.21.15.114:0/2037777113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8580cb470 msgr2=0x7fc8580aed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:24:57.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.762+0000 7fc85d9ae700 1 --2- 172.21.15.114:0/2037777113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8580cb470 0x7fc8580aed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:24:57.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.762+0000 7fc85d9ae700 1 -- 172.21.15.114:0/2037777113 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc848009570 con 0x7fc85815ee50 2023-10-18T12:24:57.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.762+0000 7fc85d1ad700 1 --2- 172.21.15.114:0/2037777113 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc85806e8a0 0x7fc8580acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:24:57.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.762+0000 7fc85c9ac700 1 --2- 172.21.15.114:0/2037777113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8580cb470 0x7fc8580aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:24:57.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.762+0000 7fc85d9ae700 1 --2- 172.21.15.114:0/2037777113 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc85815ee50 0x7fc85814d580 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc85000cba0 tx=0x7fc85000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:24:57.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.762+0000 7fc84dffb700 1 -- 172.21.15.114:0/2037777113 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc850003c20 con 0x7fc85815ee50 2023-10-18T12:24:57.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.762+0000 7fc84dffb700 1 -- 172.21.15.114:0/2037777113 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc850003d80 con 0x7fc85815ee50 2023-10-18T12:24:57.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.762+0000 7fc84dffb700 1 -- 172.21.15.114:0/2037777113 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85000abc0 con 0x7fc85815ee50 2023-10-18T12:24:57.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.762+0000 7fc85f411700 1 -- 172.21.15.114:0/2037777113 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc858160920 con 0x7fc85815ee50 2023-10-18T12:24:57.777 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.762+0000 7fc85f411700 1 -- 172.21.15.114:0/2037777113 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc858160ee0 con 0x7fc85815ee50 2023-10-18T12:24:57.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.766+0000 7fc85f411700 1 -- 172.21.15.114:0/2037777113 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc858072e60 con 0x7fc85815ee50 2023-10-18T12:24:57.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.766+0000 7fc84dffb700 1 -- 172.21.15.114:0/2037777113 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fc85000ad20 con 0x7fc85815ee50 2023-10-18T12:24:57.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.766+0000 7fc84dffb700 1 --2- 172.21.15.114:0/2037777113 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc83c0656f0 0x7fc83c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:24:57.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.766+0000 7fc84dffb700 1 -- 172.21.15.114:0/2037777113 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fc850082fc0 con 0x7fc85815ee50 2023-10-18T12:24:57.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.766+0000 7fc85d1ad700 1 --2- 172.21.15.114:0/2037777113 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc83c0656f0 0x7fc83c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:24:57.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.770+0000 7fc85d1ad700 1 --2- 172.21.15.114:0/2037777113 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc83c0656f0 0x7fc83c067bb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc854009a10 tx=0x7fc854008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:24:57.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.774+0000 7fc84dffb700 1 -- 172.21.15.114:0/2037777113 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fc8500b3d40 con 0x7fc85815ee50 2023-10-18T12:24:57.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.982+0000 7fc85f411700 1 -- 172.21.15.114:0/2037777113 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8580b1160 con 0x7fc85815ee50 2023-10-18T12:24:57.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.982+0000 7fc84dffb700 1 -- 172.21.15.114:0/2037777113 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4887 (secure 0 0 0) 0x7fc850050990 con 0x7fc85815ee50 2023-10-18T12:24:57.991 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:24:57.992 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2034957068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2034957068},{"type":"v1","addr":"172.21.15.172:6836","nonce":2034957068}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5039,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4215710360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4215710360},{"type":"v1","addr":"172.21.15.172:6837","nonce":4215710360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2387835210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2387835210},{"type":"v1","addr":"172.21.15.114:6833","nonce":2387835210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T12:21:14.159069+0000","modified":"2023-10-18T12:21:17.730177+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.114:6835/1284474820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1284474820},{"type":"v1","addr":"172.21.15.114:6835","nonce":1284474820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-18T12:24:57.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.986+0000 7fc85f411700 1 -- 172.21.15.114:0/2037777113 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc83c0656f0 msgr2=0x7fc83c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:24:57.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.986+0000 7fc85f411700 1 --2- 172.21.15.114:0/2037777113 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc83c0656f0 0x7fc83c067bb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc854009a10 tx=0x7fc854008040 comp rx=0 tx=0).stop 2023-10-18T12:24:57.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.986+0000 7fc85f411700 1 -- 172.21.15.114:0/2037777113 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc85815ee50 msgr2=0x7fc85814d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:24:57.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.986+0000 7fc85f411700 1 --2- 172.21.15.114:0/2037777113 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc85815ee50 0x7fc85814d580 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc85000cba0 tx=0x7fc85000cf60 comp rx=0 tx=0).stop 2023-10-18T12:24:57.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.986+0000 7fc85f411700 1 -- 172.21.15.114:0/2037777113 shutdown_connections 2023-10-18T12:24:57.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.986+0000 7fc85f411700 1 --2- 172.21.15.114:0/2037777113 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc83c0656f0 0x7fc83c067bb0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:24:57.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.986+0000 7fc85f411700 1 --2- 172.21.15.114:0/2037777113 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc85815ee50 0x7fc85814d580 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:24:57.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.986+0000 7fc85f411700 1 --2- 172.21.15.114:0/2037777113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc8580cb470 0x7fc8580aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:24:57.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.986+0000 7fc85f411700 1 --2- 172.21.15.114:0/2037777113 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc85806e8a0 0x7fc8580acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:24:57.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.986+0000 7fc85f411700 1 -- 172.21.15.114:0/2037777113 >> 172.21.15.114:0/2037777113 conn(0x7fc85806a340 msgr2=0x7fc8580afb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:24:57.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.986+0000 7fc85f411700 1 -- 172.21.15.114:0/2037777113 shutdown_connections 2023-10-18T12:24:57.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:57.986+0000 7fc85f411700 1 -- 172.21.15.114:0/2037777113 wait complete. 2023-10-18T12:24:57.997 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 18 2023-10-18T12:24:58.014 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-10-18T12:24:58.198 INFO:teuthology.orchestra.run.smithi114.stdout:[{"id":5162,"entity":{"name":{"type":"client","num":5162},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":989916161}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":214.21093425500001,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.60961777981452736,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":3,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5162 v1:192.168.0.1:0/989916161","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi172","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}},{"id":5521,"entity":{"name":{"type":"client","num":5521},"addr":{"type":"v1","addr":"172.21.15.114:0","nonce":1817588655}},"state":"stale","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":215.68289908400001,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.6075536299970159,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":25,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5521 v1:172.21.15.114:0/1817588655","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi114","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}}] 2023-10-18T12:24:58.199 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "1", "hostname": "smithi172", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 989916161, "type": "v1" }, "name": { "num": 5162, "type": "client" } }, "id": 5162, "inst": "client.5162 v1:192.168.0.1:0/989916161", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 3, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.6096177798145274 }, "state": "open", "uptime": 214.210934255 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "0", "hostname": "smithi114", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.114:0", "nonce": 1817588655, "type": "v1" }, "name": { "num": 5521, "type": "client" } }, "id": 5521, "inst": "client.5521 v1:172.21.15.114:0/1817588655", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 25, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.6075536299970159 }, "state": "stale", "uptime": 215.682899084 } ] 2023-10-18T12:24:58.200 DEBUG:teuthology.orchestra.run.smithi114:> sudo daemon-helper kill ceph --cluster ceph -w 2023-10-18T12:24:58.207 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T12:24:58.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.362+0000 7f914289e700 1 Processor -- start 2023-10-18T12:24:58.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.366+0000 7f914289e700 1 -- start start 2023-10-18T12:24:58.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.366+0000 7f914289e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f913c0ce320 0x7f913c0cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:24:58.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.366+0000 7f914289e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f913c0cbc80 con 0x7f913c155420 2023-10-18T12:24:58.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.366+0000 7f914289e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f913c0cb9a0 con 0x7f913c15bf00 2023-10-18T12:24:58.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.366+0000 7f914289e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f913c155800 con 0x7f913c0ce320 2023-10-18T12:24:58.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.366+0000 7f913bfff700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f913c155420 0x7f913c0cb150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44498/0 (socket says 172.21.15.114:44498) 2023-10-18T12:24:58.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.366+0000 7f913bfff700 1 -- 172.21.15.114:0/2156498856 learned_addr learned my addr 172.21.15.114:0/2156498856 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:24:58.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.366+0000 7f9140e3b700 1 --2- 172.21.15.114:0/2156498856 >> v2:172.21.15.172:3300/0 conn(0x7f913c0ce320 0x7f913c0cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:24:58.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.366+0000 7f913b7fe700 1 -- 172.21.15.114:0/2156498856 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3998803542 0 0) 0x7f913c0cbc80 con 0x7f913c155420 2023-10-18T12:24:58.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.366+0000 7f913b7fe700 1 -- 172.21.15.114:0/2156498856 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91280035d0 con 0x7f913c155420 2023-10-18T12:24:58.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.366+0000 7f913b7fe700 1 -- 172.21.15.114:0/2156498856 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1674496397 0 0) 0x7f913c0cb9a0 con 0x7f913c15bf00 2023-10-18T12:24:58.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.366+0000 7f913b7fe700 1 -- 172.21.15.114:0/2156498856 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f913c0cbc80 con 0x7f913c15bf00 2023-10-18T12:24:58.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.366+0000 7f913b7fe700 1 -- 172.21.15.114:0/2156498856 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1782125770 0 0) 0x7f91280035d0 con 0x7f913c155420 2023-10-18T12:24:58.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.366+0000 7f913b7fe700 1 -- 172.21.15.114:0/2156498856 >> v2:172.21.15.172:3300/0 conn(0x7f913c0ce320 msgr2=0x7f913c0cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:24:58.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.366+0000 7f913b7fe700 1 --2- 172.21.15.114:0/2156498856 >> v2:172.21.15.172:3300/0 conn(0x7f913c0ce320 0x7f913c0cc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:24:58.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.366+0000 7f913b7fe700 1 -- 172.21.15.114:0/2156498856 >> v1:172.21.15.172:6789/0 conn(0x7f913c15bf00 legacy=0x7f913c0cdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:24:58.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.366+0000 7f913b7fe700 1 -- 172.21.15.114:0/2156498856 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f913c15b420 con 0x7f913c155420 2023-10-18T12:24:58.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.366+0000 7f913b7fe700 1 -- 172.21.15.114:0/2156498856 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3368469509 0 0) 0x7f912c001670 con 0x7f913c155420 2023-10-18T12:24:58.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.366+0000 7f913b7fe700 1 -- 172.21.15.114:0/2156498856 >> v1:172.21.15.114:6789/0 conn(0x7f913c155420 legacy=0x7f913c0cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:24:58.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.370+0000 7f913b7fe700 1 --2- 172.21.15.114:0/2156498856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9128003bb0 0x7f9128003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:24:58.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.370+0000 7f913b7fe700 1 --2- 172.21.15.114:0/2156498856 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9128004870 0x7f9128004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:24:58.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.370+0000 7f913b7fe700 1 --2- 172.21.15.114:0/2156498856 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9128005230 0x7f912800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:24:58.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.370+0000 7f913b7fe700 1 -- 172.21.15.114:0/2156498856 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913c155800 con 0x7f9128004870 2023-10-18T12:24:58.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.370+0000 7f913b7fe700 1 -- 172.21.15.114:0/2156498856 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f912800c130 con 0x7f9128003bb0 2023-10-18T12:24:58.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.370+0000 7f913b7fe700 1 -- 172.21.15.114:0/2156498856 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f912800c2f0 con 0x7f9128005230 2023-10-18T12:24:58.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.370+0000 7f9133fff700 1 --2- 172.21.15.114:0/2156498856 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9128004870 0x7f9128004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:24:58.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.370+0000 7f9133fff700 1 -- 172.21.15.114:0/2156498856 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9128005230 msgr2=0x7f912800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:24:58.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.370+0000 7f9133fff700 1 --2- 172.21.15.114:0/2156498856 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9128005230 0x7f912800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:24:58.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.370+0000 7f9133fff700 1 -- 172.21.15.114:0/2156498856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9128003bb0 msgr2=0x7f9128003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:24:58.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.370+0000 7f9133fff700 1 --2- 172.21.15.114:0/2156498856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9128003bb0 0x7f9128003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:24:58.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.370+0000 7f9133fff700 1 -- 172.21.15.114:0/2156498856 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91280035d0 con 0x7f9128004870 2023-10-18T12:24:58.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.370+0000 7f9140e3b700 1 -- 172.21.15.114:0/2156498856 reap_dead start 2023-10-18T12:24:58.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.370+0000 7f9133fff700 1 --2- 172.21.15.114:0/2156498856 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9128004870 0x7f9128004cf0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f9124001960 tx=0x7f91280058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=762011398e172888 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:24:58.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.370+0000 7f913b7fe700 1 -- 172.21.15.114:0/2156498856 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9124001450 con 0x7f9128004870 2023-10-18T12:24:58.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.370+0000 7f913b7fe700 1 -- 172.21.15.114:0/2156498856 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91240052f0 con 0x7f9128004870 2023-10-18T12:24:58.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.370+0000 7f913b7fe700 1 -- 172.21.15.114:0/2156498856 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9124001d30 con 0x7f9128004870 2023-10-18T12:24:58.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.370+0000 7f914289e700 1 -- 172.21.15.114:0/2156498856 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9128004870 msgr2=0x7f9128004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:24:58.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.370+0000 7f914289e700 1 --2- 172.21.15.114:0/2156498856 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9128004870 0x7f9128004cf0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f9124001960 tx=0x7f91280058a0 comp rx=0 tx=0).stop 2023-10-18T12:24:58.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.370+0000 7f914289e700 1 -- 172.21.15.114:0/2156498856 shutdown_connections 2023-10-18T12:24:58.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.370+0000 7f914289e700 1 --2- 172.21.15.114:0/2156498856 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9128004870 0x7f9128004cf0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:24:58.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.370+0000 7f914289e700 1 -- 172.21.15.114:0/2156498856 >> 172.21.15.114:0/2156498856 conn(0x7f913c06a340 msgr2=0x7f913c0b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:24:58.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.370+0000 7f914289e700 1 -- 172.21.15.114:0/2156498856 shutdown_connections 2023-10-18T12:24:58.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.370+0000 7f914289e700 1 -- 172.21.15.114:0/2156498856 wait complete. 2023-10-18T12:24:58.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.374+0000 7f914289e700 1 Processor -- start 2023-10-18T12:24:58.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.374+0000 7f914289e700 1 -- start start 2023-10-18T12:24:58.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.378+0000 7f914289e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9128004870 0x7f913c1efa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:24:58.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.378+0000 7f914289e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f913c0a8860 0x7f913c0a8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:24:58.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.378+0000 7f914289e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f913c0a7690 0x7f913c0a7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:24:58.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.378+0000 7f914289e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913c0a9220 con 0x7f913c0a8860 2023-10-18T12:24:58.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.378+0000 7f914289e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913c0a86a0 con 0x7f913c0a7690 2023-10-18T12:24:58.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.378+0000 7f914289e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f913c1335d0 con 0x7f9128004870 2023-10-18T12:24:58.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.378+0000 7f9133fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f913c0a8860 0x7f913c0a8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:24:58.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.378+0000 7f9133fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f913c0a8860 0x7f913c0a8ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54350/0 (socket says 172.21.15.114:54350) 2023-10-18T12:24:58.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.378+0000 7f9133fff700 1 -- 172.21.15.114:0/3859070860 learned_addr learned my addr 172.21.15.114:0/3859070860 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:24:58.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.378+0000 7f9140e3b700 1 --2- 172.21.15.114:0/3859070860 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f913c0a7690 0x7f913c0a7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:24:58.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.378+0000 7f913bfff700 1 --2- 172.21.15.114:0/3859070860 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9128004870 0x7f913c1efa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:24:58.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.378+0000 7f9133fff700 1 -- 172.21.15.114:0/3859070860 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9128004870 msgr2=0x7f913c1efa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:24:58.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.378+0000 7f9133fff700 1 --2- 172.21.15.114:0/3859070860 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9128004870 0x7f913c1efa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:24:58.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.378+0000 7f9133fff700 1 -- 172.21.15.114:0/3859070860 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f913c0a7690 msgr2=0x7f913c0a7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:24:58.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.378+0000 7f9133fff700 1 --2- 172.21.15.114:0/3859070860 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f913c0a7690 0x7f913c0a7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:24:58.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.378+0000 7f9133fff700 1 -- 172.21.15.114:0/3859070860 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f913c0a83c0 con 0x7f913c0a8860 2023-10-18T12:24:58.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.378+0000 7f9140e3b700 1 --2- 172.21.15.114:0/3859070860 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f913c0a7690 0x7f913c0a7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:24:58.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.378+0000 7f9133fff700 1 --2- 172.21.15.114:0/3859070860 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f913c0a8860 0x7f913c0a8ce0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f9124005690 tx=0x7f91240012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:24:58.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.378+0000 7f91397fa700 1 -- 172.21.15.114:0/3859070860 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9124006c90 con 0x7f913c0a8860 2023-10-18T12:24:58.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.378+0000 7f91397fa700 1 -- 172.21.15.114:0/3859070860 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9124006df0 con 0x7f913c0a8860 2023-10-18T12:24:58.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.378+0000 7f914289e700 1 -- 172.21.15.114:0/3859070860 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f913c132f80 con 0x7f913c0a8860 2023-10-18T12:24:58.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.378+0000 7f91397fa700 1 -- 172.21.15.114:0/3859070860 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9124007240 con 0x7f913c0a8860 2023-10-18T12:24:58.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.378+0000 7f914289e700 1 -- 172.21.15.114:0/3859070860 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f913c0aa890 con 0x7f913c0a8860 2023-10-18T12:24:58.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.382+0000 7f914289e700 1 -- 172.21.15.114:0/3859070860 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f913c132de0 con 0x7f913c0a8860 2023-10-18T12:24:58.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.382+0000 7f91397fa700 1 -- 172.21.15.114:0/3859070860 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f91240073a0 con 0x7f913c0a8860 2023-10-18T12:24:58.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.382+0000 7f91397fa700 1 --2- 172.21.15.114:0/3859070860 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f911c0656f0 0x7f911c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:24:58.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.382+0000 7f91397fa700 1 -- 172.21.15.114:0/3859070860 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f9124083e30 con 0x7f913c0a8860 2023-10-18T12:24:58.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.382+0000 7f913bfff700 1 --2- 172.21.15.114:0/3859070860 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f911c0656f0 0x7f911c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:24:58.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.386+0000 7f913bfff700 1 --2- 172.21.15.114:0/3859070860 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f911c0656f0 0x7f911c067bb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f913c04f300 tx=0x7f912c001990 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:24:58.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.390+0000 7f91397fa700 1 -- 172.21.15.114:0/3859070860 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f913c132de0 con 0x7f913c0a8860 2023-10-18T12:24:58.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.398+0000 7f7fbc225700 1 Processor -- start 2023-10-18T12:24:58.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.398+0000 7f7fbc225700 1 -- start start 2023-10-18T12:24:58.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.398+0000 7f7fbc225700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7fb415b9e0 0x7f7fb4161820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:24:58.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.398+0000 7f7fbc225700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7fb4161d60 0x7f7fb40cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:24:58.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.398+0000 7f7fbc225700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb406d680 con 0x7f7fb415b600 2023-10-18T12:24:58.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.398+0000 7f7fbc225700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fb406d100 con 0x7f7fb415b9e0 2023-10-18T12:24:58.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.398+0000 7f7fbc225700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb4162350 con 0x7f7fb4161d60 2023-10-18T12:24:58.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.398+0000 7f7fb97c0700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f7fb415b9e0 0x7f7fb4161820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:24:58.409 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.402+0000 7f7fba7c2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7fb4161d60 0x7f7fb40cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:24:58.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.398+0000 7f7fb9fc1700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f7fb415b600 0x7f7fb406db10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44510/0 (socket says 172.21.15.114:44510) 2023-10-18T12:24:58.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.402+0000 7f7fb9fc1700 1 -- 172.21.15.114:0/826264233 learned_addr learned my addr 172.21.15.114:0/826264233 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:24:58.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.402+0000 7f7fba7c2700 1 -- 172.21.15.114:0/826264233 >> v2:172.21.15.114:3300/0 conn(0x7f7fb415b9e0 msgr2=0x7f7fb4161820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:24:58.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.402+0000 7f7fba7c2700 1 --2- 172.21.15.114:0/826264233 >> v2:172.21.15.114:3300/0 conn(0x7f7fb415b9e0 0x7f7fb4161820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:24:58.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.402+0000 7f7fba7c2700 1 -- 172.21.15.114:0/826264233 >> v1:172.21.15.114:6789/0 conn(0x7f7fb415b600 legacy=0x7f7fb406db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:24:58.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.402+0000 7f7fba7c2700 1 -- 172.21.15.114:0/826264233 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb4162630 con 0x7f7fb4161d60 2023-10-18T12:24:58.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.402+0000 7f7fba7c2700 1 --2- 172.21.15.114:0/826264233 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7fb4161d60 0x7f7fb40cb350 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7fac009d90 tx=0x7f7fac00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90a9174057c91a13 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:24:58.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.402+0000 7f7fb8fbf700 1 -- 172.21.15.114:0/826264233 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac00e070 con 0x7f7fb4161d60 2023-10-18T12:24:58.412 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.402+0000 7f7fb8fbf700 1 -- 172.21.15.114:0/826264233 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fac00bb20 con 0x7f7fb4161d60 2023-10-18T12:24:58.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.402+0000 7f7fb8fbf700 1 -- 172.21.15.114:0/826264233 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac012430 con 0x7f7fb4161d60 2023-10-18T12:24:58.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.402+0000 7f7fbc225700 1 -- 172.21.15.114:0/826264233 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7fb4161d60 msgr2=0x7f7fb40cb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:24:58.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.402+0000 7f7fbc225700 1 --2- 172.21.15.114:0/826264233 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7fb4161d60 0x7f7fb40cb350 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7fac009d90 tx=0x7f7fac00b330 comp rx=0 tx=0).stop 2023-10-18T12:24:58.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.402+0000 7f7fbc225700 1 -- 172.21.15.114:0/826264233 shutdown_connections 2023-10-18T12:24:58.413 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.402+0000 7f7fbc225700 1 --2- 172.21.15.114:0/826264233 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7fb4161d60 0x7f7fb40cb350 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:24:58.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.402+0000 7f7fbc225700 1 --2- 172.21.15.114:0/826264233 >> v2:172.21.15.114:3300/0 conn(0x7f7fb415b9e0 0x7f7fb4161820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:24:58.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.402+0000 7f7fbc225700 1 -- 172.21.15.114:0/826264233 >> 172.21.15.114:0/826264233 conn(0x7f7fb40b0650 msgr2=0x7f7fb40b0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:24:58.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.402+0000 7f7fbc225700 1 -- 172.21.15.114:0/826264233 shutdown_connections 2023-10-18T12:24:58.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.402+0000 7f7fbc225700 1 -- 172.21.15.114:0/826264233 wait complete. 2023-10-18T12:24:58.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.406+0000 7f7fbc225700 1 Processor -- start 2023-10-18T12:24:58.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.406+0000 7f7fbc225700 1 -- start start 2023-10-18T12:24:58.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.406+0000 7f7fbc225700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7fb415b600 0x7f7fb415e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:24:58.416 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.406+0000 7f7fbc225700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fb415b9e0 0x7f7fb415f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:24:58.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.406+0000 7f7fbc225700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fb4161d60 0x7f7fb41569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:24:58.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.406+0000 7f7fbc225700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb415fab0 con 0x7f7fb4161d60 2023-10-18T12:24:58.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.406+0000 7f7fbc225700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb415fd90 con 0x7f7fb415b9e0 2023-10-18T12:24:58.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.406+0000 7f7fbc225700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb4160070 con 0x7f7fb415b600 2023-10-18T12:24:58.417 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.410+0000 7f7fba7c2700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fb4161d60 0x7f7fb41569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:24:58.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.410+0000 7f7fba7c2700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fb4161d60 0x7f7fb41569d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:54364/0 (socket says 172.21.15.114:54364) 2023-10-18T12:24:58.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.410+0000 7f7fba7c2700 1 -- 172.21.15.114:0/988320372 learned_addr learned my addr 172.21.15.114:0/988320372 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:24:58.419 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.410+0000 7f7fb97c0700 1 --2- 172.21.15.114:0/988320372 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fb415b9e0 0x7f7fb415f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:24:58.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.410+0000 7f7fb9fc1700 1 --2- 172.21.15.114:0/988320372 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7fb415b600 0x7f7fb415e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:24:58.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.410+0000 7f7fba7c2700 1 -- 172.21.15.114:0/988320372 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7fb415b600 msgr2=0x7f7fb415e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:24:58.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.410+0000 7f7fba7c2700 1 --2- 172.21.15.114:0/988320372 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7fb415b600 0x7f7fb415e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:24:58.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.410+0000 7f7fba7c2700 1 -- 172.21.15.114:0/988320372 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fb415b9e0 msgr2=0x7f7fb415f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:24:58.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.410+0000 7f7fba7c2700 1 --2- 172.21.15.114:0/988320372 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fb415b9e0 0x7f7fb415f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:24:58.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.410+0000 7f7fba7c2700 1 -- 172.21.15.114:0/988320372 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fac009a70 con 0x7f7fb4161d60 2023-10-18T12:24:58.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.410+0000 7f7fba7c2700 1 --2- 172.21.15.114:0/988320372 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fb4161d60 0x7f7fb41569d0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f7fac014040 tx=0x7f7fac004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:24:58.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.410+0000 7f7faa7fc700 1 -- 172.21.15.114:0/988320372 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac012430 con 0x7f7fb4161d60 2023-10-18T12:24:58.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.410+0000 7f7faa7fc700 1 -- 172.21.15.114:0/988320372 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fac020070 con 0x7f7fb4161d60 2023-10-18T12:24:58.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.410+0000 7f7faa7fc700 1 -- 172.21.15.114:0/988320372 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac004280 con 0x7f7fb4161d60 2023-10-18T12:24:58.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.410+0000 7f7fbc225700 1 -- 172.21.15.114:0/988320372 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fb4160350 con 0x7f7fb4161d60 2023-10-18T12:24:58.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.410+0000 7f7fbc225700 1 -- 172.21.15.114:0/988320372 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fb415cbb0 con 0x7f7fb4161d60 2023-10-18T12:24:58.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.410+0000 7f7fbc225700 1 -- 172.21.15.114:0/988320372 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f7fb4073f00 con 0x7f7fb4161d60 2023-10-18T12:24:58.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.414+0000 7f7faa7fc700 1 -- 172.21.15.114:0/988320372 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f7fac0043e0 con 0x7f7fb4161d60 2023-10-18T12:24:58.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.414+0000 7f7faa7fc700 1 --2- 172.21.15.114:0/988320372 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7f98065720 0x7f7f98067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:24:58.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.414+0000 7f7faa7fc700 1 -- 172.21.15.114:0/988320372 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f7fac022070 con 0x7f7fb4161d60 2023-10-18T12:24:58.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.414+0000 7f7faa7fc700 1 -- 172.21.15.114:0/988320372 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+447 (secure 0 0 0) 0x7f7fac085550 con 0x7f7fb4161d60 2023-10-18T12:24:58.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.414+0000 7f7fb9fc1700 1 --2- 172.21.15.114:0/988320372 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7f98065720 0x7f7f98067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:24:58.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.414+0000 7f7fbc225700 1 -- 172.21.15.114:0/988320372 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7f7fb406e760 con 0x7f7fb4161d60 2023-10-18T12:24:58.424 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.414+0000 7f7fb9fc1700 1 --2- 172.21.15.114:0/988320372 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7f98065720 0x7f7f98067be0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0005930 tx=0x7f7fb0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:24:58.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.626+0000 7f914289e700 1 -- 172.21.15.114:0/3859070860 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f913c132de0 con 0x7f913c0a8860 2023-10-18T12:24:58.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.626+0000 7f91397fa700 1 -- 172.21.15.114:0/3859070860 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4887 (secure 0 0 0) 0x7f913c132de0 con 0x7f913c0a8860 2023-10-18T12:24:58.635 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:24:58.635 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2034957068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2034957068},{"type":"v1","addr":"172.21.15.172:6836","nonce":2034957068}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5039,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4215710360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4215710360},{"type":"v1","addr":"172.21.15.172:6837","nonce":4215710360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2387835210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2387835210},{"type":"v1","addr":"172.21.15.114:6833","nonce":2387835210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T12:21:14.159069+0000","modified":"2023-10-18T12:21:17.730177+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.114:6835/1284474820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1284474820},{"type":"v1","addr":"172.21.15.114:6835","nonce":1284474820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-18T12:24:58.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.630+0000 7f914289e700 1 -- 172.21.15.114:0/3859070860 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f911c0656f0 msgr2=0x7f911c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:24:58.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.630+0000 7f914289e700 1 --2- 172.21.15.114:0/3859070860 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f911c0656f0 0x7f911c067bb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f913c04f300 tx=0x7f912c001990 comp rx=0 tx=0).stop 2023-10-18T12:24:58.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.630+0000 7f914289e700 1 -- 172.21.15.114:0/3859070860 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f913c0a8860 msgr2=0x7f913c0a8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:24:58.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.630+0000 7f914289e700 1 --2- 172.21.15.114:0/3859070860 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f913c0a8860 0x7f913c0a8ce0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f9124005690 tx=0x7f91240012d0 comp rx=0 tx=0).stop 2023-10-18T12:24:58.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.630+0000 7f914289e700 1 -- 172.21.15.114:0/3859070860 shutdown_connections 2023-10-18T12:24:58.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.630+0000 7f914289e700 1 --2- 172.21.15.114:0/3859070860 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f911c0656f0 0x7f911c067bb0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:24:58.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.630+0000 7f914289e700 1 --2- 172.21.15.114:0/3859070860 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f913c0a7690 0x7f913c0a7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:24:58.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.630+0000 7f914289e700 1 --2- 172.21.15.114:0/3859070860 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f913c0a8860 0x7f913c0a8ce0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:24:58.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.630+0000 7f914289e700 1 --2- 172.21.15.114:0/3859070860 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9128004870 0x7f913c1efa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:24:58.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.630+0000 7f914289e700 1 -- 172.21.15.114:0/3859070860 >> 172.21.15.114:0/3859070860 conn(0x7f913c06a340 msgr2=0x7f913c15ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:24:58.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.630+0000 7f914289e700 1 -- 172.21.15.114:0/3859070860 shutdown_connections 2023-10-18T12:24:58.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:24:58.630+0000 7f914289e700 1 -- 172.21.15.114:0/3859070860 wait complete. 2023-10-18T12:24:58.640 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 18 2023-10-18T12:24:58.662 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-10-18T12:24:58.848 INFO:teuthology.orchestra.run.smithi114.stdout:[{"id":5162,"entity":{"name":{"type":"client","num":5162},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":989916161}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":214.85891905099999,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.60870014017475138,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":3,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5162 v1:192.168.0.1:0/989916161","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi172","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}},{"id":5521,"entity":{"name":{"type":"client","num":5521},"addr":{"type":"v1","addr":"172.21.15.114:0","nonce":1817588655}},"state":"stale","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":216.33488378499999,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.60663909746099853,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":25,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5521 v1:172.21.15.114:0/1817588655","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi114","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}}] 2023-10-18T12:24:58.848 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "1", "hostname": "smithi172", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 989916161, "type": "v1" }, "name": { "num": 5162, "type": "client" } }, "id": 5162, "inst": "client.5162 v1:192.168.0.1:0/989916161", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 3, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.6087001401747514 }, "state": "open", "uptime": 214.858919051 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "0", "hostname": "smithi114", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.114:0", "nonce": 1817588655, "type": "v1" }, "name": { "num": 5521, "type": "client" } }, "id": 5521, "inst": "client.5521 v1:172.21.15.114:0/1817588655", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 25, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.6066390974609985 }, "state": "stale", "uptime": 216.334883785 } ] 2023-10-18T12:24:58.949 DEBUG:tasks.ceph_test_case:No log hits yet, waiting... 2023-10-18T12:25:02.854 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:25:02.861 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:25:32.951 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:25:32.960 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:25:58.978 ERROR:tasks.ceph_test_case:Log output: 2023-10-18T12:25:58.979 DEBUG:tasks.cephfs.test_client_recovery:Expected log message found: '1 client(s) laggy due to laggy OSDs', retrying 2023-10-18T12:26:03.036 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:26:03.044 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:26:03.980 DEBUG:teuthology.orchestra.run.smithi114:> sudo daemon-helper kill ceph --cluster ceph -w 2023-10-18T12:26:03.988 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T12:26:04.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.161+0000 7f91f283e700 1 Processor -- start 2023-10-18T12:26:04.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.161+0000 7f91f283e700 1 -- start start 2023-10-18T12:26:04.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.161+0000 7f91f283e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f91ec15cc80 0x7f91ec0c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:26:04.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.161+0000 7f91f283e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f91ec0ca3f0 0x7f91ec160820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:26:04.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.161+0000 7f91f283e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91ec06fe90 con 0x7f91ec160d60 2023-10-18T12:26:04.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.161+0000 7f91f283e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91ec161830 con 0x7f91ec0ca3f0 2023-10-18T12:26:04.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.161+0000 7f91f283e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91ec161270 con 0x7f91ec15cc80 2023-10-18T12:26:04.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.161+0000 7f91f0ddb700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f91ec160d60 0x7f91ec070930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:35356/0 (socket says 172.21.15.114:35356) 2023-10-18T12:26:04.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.161+0000 7f91f0ddb700 1 -- 172.21.15.114:0/3438858457 learned_addr learned my addr 172.21.15.114:0/3438858457 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:26:04.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.161+0000 7f91e37fe700 1 --2- 172.21.15.114:0/3438858457 >> v2:172.21.15.114:3300/0 conn(0x7f91ec0ca3f0 0x7f91ec160820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:26:04.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.161+0000 7f91ebfff700 1 --2- 172.21.15.114:0/3438858457 >> v2:172.21.15.172:3300/0 conn(0x7f91ec15cc80 0x7f91ec0c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:26:04.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.161+0000 7f91eb7fe700 1 -- 172.21.15.114:0/3438858457 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2547808703 0 0) 0x7f91ec06fe90 con 0x7f91ec160d60 2023-10-18T12:26:04.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.161+0000 7f91eb7fe700 1 -- 172.21.15.114:0/3438858457 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91d80035d0 con 0x7f91ec160d60 2023-10-18T12:26:04.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.161+0000 7f91e37fe700 1 -- 172.21.15.114:0/3438858457 >> v2:172.21.15.172:3300/0 conn(0x7f91ec15cc80 msgr2=0x7f91ec0c9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:26:04.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.161+0000 7f91e37fe700 1 --2- 172.21.15.114:0/3438858457 >> v2:172.21.15.172:3300/0 conn(0x7f91ec15cc80 0x7f91ec0c9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:26:04.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.161+0000 7f91e37fe700 1 -- 172.21.15.114:0/3438858457 >> v1:172.21.15.114:6789/0 conn(0x7f91ec160d60 legacy=0x7f91ec070930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:26:04.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.161+0000 7f91e37fe700 1 -- 172.21.15.114:0/3438858457 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ec161550 con 0x7f91ec0ca3f0 2023-10-18T12:26:04.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.161+0000 7f91e37fe700 1 --2- 172.21.15.114:0/3438858457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91ec0ca3f0 0x7f91ec160820 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f91ec0b2220 tx=0x7f91d4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9688f9b59b984f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:26:04.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.165+0000 7f91eb7fe700 1 -- 172.21.15.114:0/3438858457 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d4011830 con 0x7f91ec0ca3f0 2023-10-18T12:26:04.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.165+0000 7f91eb7fe700 1 -- 172.21.15.114:0/3438858457 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d4011990 con 0x7f91ec0ca3f0 2023-10-18T12:26:04.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.165+0000 7f91eb7fe700 1 -- 172.21.15.114:0/3438858457 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d4011d00 con 0x7f91ec0ca3f0 2023-10-18T12:26:04.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.165+0000 7f91f283e700 1 -- 172.21.15.114:0/3438858457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91ec0ca3f0 msgr2=0x7f91ec160820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:26:04.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.165+0000 7f91f283e700 1 --2- 172.21.15.114:0/3438858457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91ec0ca3f0 0x7f91ec160820 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f91ec0b2220 tx=0x7f91d4009b30 comp rx=0 tx=0).stop 2023-10-18T12:26:04.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.165+0000 7f91f283e700 1 -- 172.21.15.114:0/3438858457 shutdown_connections 2023-10-18T12:26:04.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.165+0000 7f91f283e700 1 --2- 172.21.15.114:0/3438858457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91ec0ca3f0 0x7f91ec160820 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:26:04.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.165+0000 7f91f283e700 1 --2- 172.21.15.114:0/3438858457 >> v2:172.21.15.172:3300/0 conn(0x7f91ec15cc80 0x7f91ec0c9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:26:04.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.165+0000 7f91f283e700 1 -- 172.21.15.114:0/3438858457 >> 172.21.15.114:0/3438858457 conn(0x7f91ec0b1350 msgr2=0x7f91ec0b1760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:26:04.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.165+0000 7f91f283e700 1 -- 172.21.15.114:0/3438858457 shutdown_connections 2023-10-18T12:26:04.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.165+0000 7f91f283e700 1 -- 172.21.15.114:0/3438858457 wait complete. 2023-10-18T12:26:04.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.165+0000 7f91f283e700 1 Processor -- start 2023-10-18T12:26:04.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.165+0000 7f91f283e700 1 -- start start 2023-10-18T12:26:04.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.169+0000 7f91f283e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91ec0ca3f0 0x7f91ec150f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:26:04.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.169+0000 7f91f283e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91ec15cc80 0x7f91ec0c6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:26:04.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.169+0000 7f91f283e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91ec160d60 0x7f91ec0b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:26:04.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.169+0000 7f91f283e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ec1f6c50 con 0x7f91ec0ca3f0 2023-10-18T12:26:04.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.169+0000 7f91f283e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ec0c9ab0 con 0x7f91ec160d60 2023-10-18T12:26:04.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.169+0000 7f91f283e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91ec0b29c0 con 0x7f91ec15cc80 2023-10-18T12:26:04.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.169+0000 7f91ebfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91ec0ca3f0 0x7f91ec150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:26:04.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.169+0000 7f91ebfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91ec0ca3f0 0x7f91ec150f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56922/0 (socket says 172.21.15.114:56922) 2023-10-18T12:26:04.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.169+0000 7f91ebfff700 1 -- 172.21.15.114:0/2877106772 learned_addr learned my addr 172.21.15.114:0/2877106772 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:26:04.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.169+0000 7f91f0ddb700 1 --2- 172.21.15.114:0/2877106772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91ec160d60 0x7f91ec0b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:26:04.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.169+0000 7f91ebfff700 1 -- 172.21.15.114:0/2877106772 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91ec15cc80 msgr2=0x7f91ec0c6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:26:04.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.169+0000 7f91e37fe700 1 --2- 172.21.15.114:0/2877106772 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91ec15cc80 0x7f91ec0c6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:26:04.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.169+0000 7f91ebfff700 1 --2- 172.21.15.114:0/2877106772 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91ec15cc80 0x7f91ec0c6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:26:04.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.169+0000 7f91ebfff700 1 -- 172.21.15.114:0/2877106772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91ec160d60 msgr2=0x7f91ec0b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:26:04.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.169+0000 7f91ebfff700 1 --2- 172.21.15.114:0/2877106772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91ec160d60 0x7f91ec0b2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:26:04.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.169+0000 7f91ebfff700 1 -- 172.21.15.114:0/2877106772 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d40094b0 con 0x7f91ec0ca3f0 2023-10-18T12:26:04.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.169+0000 7f91f0ddb700 1 --2- 172.21.15.114:0/2877106772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91ec160d60 0x7f91ec0b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:26:04.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.169+0000 7f91ebfff700 1 --2- 172.21.15.114:0/2877106772 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91ec0ca3f0 0x7f91ec150f30 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f91dc007ef0 tx=0x7f91dc00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:26:04.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.169+0000 7f91e97fa700 1 -- 172.21.15.114:0/2877106772 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91dc00ee10 con 0x7f91ec0ca3f0 2023-10-18T12:26:04.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.169+0000 7f91e97fa700 1 -- 172.21.15.114:0/2877106772 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91dc014420 con 0x7f91ec0ca3f0 2023-10-18T12:26:04.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.169+0000 7f91e97fa700 1 -- 172.21.15.114:0/2877106772 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91dc0147d0 con 0x7f91ec0ca3f0 2023-10-18T12:26:04.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.169+0000 7f91f283e700 1 -- 172.21.15.114:0/2877106772 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91ec0c9580 con 0x7f91ec0ca3f0 2023-10-18T12:26:04.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.169+0000 7f91f283e700 1 -- 172.21.15.114:0/2877106772 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91ec0b5090 con 0x7f91ec0ca3f0 2023-10-18T12:26:04.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.173+0000 7f91f283e700 1 -- 172.21.15.114:0/2877106772 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91ec070110 con 0x7f91ec0ca3f0 2023-10-18T12:26:04.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.173+0000 7f91e97fa700 1 -- 172.21.15.114:0/2877106772 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f91dc014930 con 0x7f91ec0ca3f0 2023-10-18T12:26:04.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.173+0000 7f91e97fa700 1 --2- 172.21.15.114:0/2877106772 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f91cc0656f0 0x7f91cc067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:26:04.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.173+0000 7f91e97fa700 1 -- 172.21.15.114:0/2877106772 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f91dc083650 con 0x7f91ec0ca3f0 2023-10-18T12:26:04.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.173+0000 7f91e37fe700 1 --2- 172.21.15.114:0/2877106772 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f91cc0656f0 0x7f91cc067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:26:04.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.173+0000 7f91e37fe700 1 --2- 172.21.15.114:0/2877106772 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f91cc0656f0 0x7f91cc067bb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f91ec1f5cf0 tx=0x7f91d4008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:26:04.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.177+0000 7f91e97fa700 1 -- 172.21.15.114:0/2877106772 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f91ec070110 con 0x7f91ec0ca3f0 2023-10-18T12:26:04.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.189+0000 7f00cb1cb700 1 Processor -- start 2023-10-18T12:26:04.193 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.189+0000 7f00cb1cb700 1 -- start start 2023-10-18T12:26:04.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.189+0000 7f00cb1cb700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f00c415ce90 0x7f00c4070a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:26:04.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.189+0000 7f00cb1cb700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f00c41610b0 0x7f00c406a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:26:04.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.189+0000 7f00cb1cb700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00c415d270 con 0x7f00c406f450 2023-10-18T12:26:04.195 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.189+0000 7f00cb1cb700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00c4161770 con 0x7f00c415ce90 2023-10-18T12:26:04.196 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.189+0000 7f00cb1cb700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00c406f9a0 con 0x7f00c41610b0 2023-10-18T12:26:04.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.189+0000 7f00c8f67700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f00c415ce90 0x7f00c4070a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:26:04.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.189+0000 7f00c8f67700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f00c415ce90 0x7f00c4070a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56936/0 (socket says 172.21.15.114:56936) 2023-10-18T12:26:04.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.189+0000 7f00c8f67700 1 -- 172.21.15.114:0/2920635254 learned_addr learned my addr 172.21.15.114:0/2920635254 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:26:04.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.189+0000 7f00c9768700 1 --2- 172.21.15.114:0/2920635254 >> v2:172.21.15.172:3300/0 conn(0x7f00c41610b0 0x7f00c406a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:26:04.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.189+0000 7f00c8f67700 1 -- 172.21.15.114:0/2920635254 >> v2:172.21.15.172:3300/0 conn(0x7f00c41610b0 msgr2=0x7f00c406a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:26:04.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.189+0000 7f00c8f67700 1 --2- 172.21.15.114:0/2920635254 >> v2:172.21.15.172:3300/0 conn(0x7f00c41610b0 0x7f00c406a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:26:04.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.189+0000 7f00c8f67700 1 -- 172.21.15.114:0/2920635254 >> v1:172.21.15.172:6789/0 conn(0x7f00c406f450 legacy=0x7f00c41609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:26:04.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.189+0000 7f00c8f67700 1 -- 172.21.15.114:0/2920635254 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c406fc80 con 0x7f00c415ce90 2023-10-18T12:26:04.198 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.193+0000 7f00c8f67700 1 --2- 172.21.15.114:0/2920635254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00c415ce90 0x7f00c4070a40 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f00c406eee0 tx=0x7f00b8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69b11dc72f71252e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:26:04.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.193+0000 7f00c37fe700 1 -- 172.21.15.114:0/2920635254 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b8011830 con 0x7f00c415ce90 2023-10-18T12:26:04.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.193+0000 7f00c37fe700 1 -- 172.21.15.114:0/2920635254 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b8011990 con 0x7f00c415ce90 2023-10-18T12:26:04.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.193+0000 7f00c37fe700 1 -- 172.21.15.114:0/2920635254 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b8011d20 con 0x7f00c415ce90 2023-10-18T12:26:04.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.193+0000 7f00cb1cb700 1 -- 172.21.15.114:0/2920635254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00c415ce90 msgr2=0x7f00c4070a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:26:04.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.193+0000 7f00cb1cb700 1 --2- 172.21.15.114:0/2920635254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00c415ce90 0x7f00c4070a40 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f00c406eee0 tx=0x7f00b8009bf0 comp rx=0 tx=0).stop 2023-10-18T12:26:04.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.193+0000 7f00cb1cb700 1 -- 172.21.15.114:0/2920635254 shutdown_connections 2023-10-18T12:26:04.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.193+0000 7f00cb1cb700 1 --2- 172.21.15.114:0/2920635254 >> v2:172.21.15.172:3300/0 conn(0x7f00c41610b0 0x7f00c406a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:26:04.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.193+0000 7f00cb1cb700 1 --2- 172.21.15.114:0/2920635254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00c415ce90 0x7f00c4070a40 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:26:04.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.193+0000 7f00cb1cb700 1 -- 172.21.15.114:0/2920635254 >> 172.21.15.114:0/2920635254 conn(0x7f00c40d0a80 msgr2=0x7f00c40d0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:26:04.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.193+0000 7f00cb1cb700 1 -- 172.21.15.114:0/2920635254 shutdown_connections 2023-10-18T12:26:04.201 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.193+0000 7f00cb1cb700 1 -- 172.21.15.114:0/2920635254 wait complete. 2023-10-18T12:26:04.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.197+0000 7f00cb1cb700 1 Processor -- start 2023-10-18T12:26:04.202 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.197+0000 7f00cb1cb700 1 -- start start 2023-10-18T12:26:04.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.197+0000 7f00cb1cb700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00c406f450 0x7f00c40c7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:26:04.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.197+0000 7f00cb1cb700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f00c415ce90 0x7f00c4157280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:26:04.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.197+0000 7f00cb1cb700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00c41610b0 0x7f00c40b5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:26:04.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.197+0000 7f00cb1cb700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c40b36a0 con 0x7f00c406f450 2023-10-18T12:26:04.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.197+0000 7f00cb1cb700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c40b6880 con 0x7f00c41610b0 2023-10-18T12:26:04.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.197+0000 7f00cb1cb700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c40b38b0 con 0x7f00c415ce90 2023-10-18T12:26:04.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.197+0000 7f00c8f67700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00c406f450 0x7f00c40c7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:26:04.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.197+0000 7f00c8f67700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00c406f450 0x7f00c40c7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56946/0 (socket says 172.21.15.114:56946) 2023-10-18T12:26:04.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.197+0000 7f00c8f67700 1 -- 172.21.15.114:0/3964312249 learned_addr learned my addr 172.21.15.114:0/3964312249 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:26:04.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.201+0000 7f00c3fff700 1 --2- 172.21.15.114:0/3964312249 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f00c415ce90 0x7f00c4157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:26:04.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.201+0000 7f00c9768700 1 --2- 172.21.15.114:0/3964312249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00c41610b0 0x7f00c40b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:26:04.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.201+0000 7f00c8f67700 1 -- 172.21.15.114:0/3964312249 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f00c415ce90 msgr2=0x7f00c4157280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:26:04.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.201+0000 7f00c8f67700 1 --2- 172.21.15.114:0/3964312249 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f00c415ce90 0x7f00c4157280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:26:04.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.201+0000 7f00c8f67700 1 -- 172.21.15.114:0/3964312249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00c41610b0 msgr2=0x7f00c40b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:26:04.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.201+0000 7f00c8f67700 1 --2- 172.21.15.114:0/3964312249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00c41610b0 0x7f00c40b5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:26:04.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.201+0000 7f00c8f67700 1 -- 172.21.15.114:0/3964312249 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b8009570 con 0x7f00c406f450 2023-10-18T12:26:04.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.201+0000 7f00c3fff700 1 --2- 172.21.15.114:0/3964312249 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f00c415ce90 0x7f00c4157280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:26:04.209 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.201+0000 7f00c9768700 1 --2- 172.21.15.114:0/3964312249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00c41610b0 0x7f00c40b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:26:04.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.201+0000 7f00c8f67700 1 --2- 172.21.15.114:0/3964312249 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f00c406f450 0x7f00c40c7030 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f00b8000c00 tx=0x7f00b8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:26:04.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.201+0000 7f00c17fa700 1 -- 172.21.15.114:0/3964312249 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b8004610 con 0x7f00c406f450 2023-10-18T12:26:04.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.201+0000 7f00c17fa700 1 -- 172.21.15.114:0/3964312249 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b801e070 con 0x7f00c406f450 2023-10-18T12:26:04.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.201+0000 7f00cb1cb700 1 -- 172.21.15.114:0/3964312249 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00c40b3b90 con 0x7f00c406f450 2023-10-18T12:26:04.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.201+0000 7f00c17fa700 1 -- 172.21.15.114:0/3964312249 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b80038e0 con 0x7f00c406f450 2023-10-18T12:26:04.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.201+0000 7f00cb1cb700 1 -- 172.21.15.114:0/3964312249 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00c40b6360 con 0x7f00c406f450 2023-10-18T12:26:04.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.201+0000 7f00cb1cb700 1 -- 172.21.15.114:0/3964312249 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f00c40c5b20 con 0x7f00c406f450 2023-10-18T12:26:04.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.205+0000 7f00c17fa700 1 -- 172.21.15.114:0/3964312249 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f00b8003a40 con 0x7f00c406f450 2023-10-18T12:26:04.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.205+0000 7f00c17fa700 1 --2- 172.21.15.114:0/3964312249 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f00a80656f0 0x7f00a8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:26:04.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.205+0000 7f00c17fa700 1 -- 172.21.15.114:0/3964312249 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f00b8083b20 con 0x7f00c406f450 2023-10-18T12:26:04.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.205+0000 7f00c17fa700 1 -- 172.21.15.114:0/3964312249 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+446 (secure 0 0 0) 0x7f00b8088220 con 0x7f00c406f450 2023-10-18T12:26:04.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.205+0000 7f00c3fff700 1 --2- 172.21.15.114:0/3964312249 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f00a80656f0 0x7f00a8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:26:04.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.205+0000 7f00cb1cb700 1 -- 172.21.15.114:0/3964312249 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7f00c4069f10 con 0x7f00c406f450 2023-10-18T12:26:04.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.205+0000 7f00c3fff700 1 --2- 172.21.15.114:0/3964312249 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f00a80656f0 0x7f00a8067bb0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f00c4158660 tx=0x7f00b0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:26:04.414 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.409+0000 7f91f283e700 1 -- 172.21.15.114:0/2877106772 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f91ec070110 con 0x7f91ec0ca3f0 2023-10-18T12:26:04.415 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.409+0000 7f91e97fa700 1 -- 172.21.15.114:0/2877106772 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4887 (secure 0 0 0) 0x7f91ec070110 con 0x7f91ec0ca3f0 2023-10-18T12:26:04.415 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:26:04.416 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2034957068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2034957068},{"type":"v1","addr":"172.21.15.172:6836","nonce":2034957068}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5039,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4215710360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4215710360},{"type":"v1","addr":"172.21.15.172:6837","nonce":4215710360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2387835210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2387835210},{"type":"v1","addr":"172.21.15.114:6833","nonce":2387835210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T12:21:14.159069+0000","modified":"2023-10-18T12:21:17.730177+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.114:6835/1284474820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1284474820},{"type":"v1","addr":"172.21.15.114:6835","nonce":1284474820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-18T12:26:04.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.413+0000 7f91f283e700 1 -- 172.21.15.114:0/2877106772 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f91cc0656f0 msgr2=0x7f91cc067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:26:04.420 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.413+0000 7f91f283e700 1 --2- 172.21.15.114:0/2877106772 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f91cc0656f0 0x7f91cc067bb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f91ec1f5cf0 tx=0x7f91d4008030 comp rx=0 tx=0).stop 2023-10-18T12:26:04.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.413+0000 7f91f283e700 1 -- 172.21.15.114:0/2877106772 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91ec0ca3f0 msgr2=0x7f91ec150f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:26:04.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.413+0000 7f91f283e700 1 --2- 172.21.15.114:0/2877106772 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91ec0ca3f0 0x7f91ec150f30 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f91dc007ef0 tx=0x7f91dc00e3c0 comp rx=0 tx=0).stop 2023-10-18T12:26:04.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.413+0000 7f91f283e700 1 -- 172.21.15.114:0/2877106772 shutdown_connections 2023-10-18T12:26:04.421 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.413+0000 7f91f283e700 1 --2- 172.21.15.114:0/2877106772 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f91cc0656f0 0x7f91cc067bb0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:26:04.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.413+0000 7f91f283e700 1 --2- 172.21.15.114:0/2877106772 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91ec15cc80 0x7f91ec0c6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:26:04.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.413+0000 7f91f283e700 1 --2- 172.21.15.114:0/2877106772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91ec160d60 0x7f91ec0b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:26:04.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.413+0000 7f91f283e700 1 --2- 172.21.15.114:0/2877106772 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91ec0ca3f0 0x7f91ec150f30 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:26:04.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.413+0000 7f91f283e700 1 -- 172.21.15.114:0/2877106772 >> 172.21.15.114:0/2877106772 conn(0x7f91ec0b1350 msgr2=0x7f91ec0cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:26:04.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.417+0000 7f91f283e700 1 -- 172.21.15.114:0/2877106772 shutdown_connections 2023-10-18T12:26:04.423 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:26:04.417+0000 7f91f283e700 1 -- 172.21.15.114:0/2877106772 wait complete. 2023-10-18T12:26:04.424 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 18 2023-10-18T12:26:04.444 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-10-18T12:26:04.630 INFO:teuthology.orchestra.run.smithi114.stdout:[{"id":5162,"entity":{"name":{"type":"client","num":5162},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":989916161}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":280.64537800400001,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.52287164452574331,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":3,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5162 v1:192.168.0.1:0/989916161","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi172","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}},{"id":5521,"entity":{"name":{"type":"client","num":5521},"addr":{"type":"v1","addr":"172.21.15.114:0","nonce":1817588655}},"state":"stale","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":282.11734283300001,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.52110121484772698,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":25,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5521 v1:172.21.15.114:0/1817588655","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi114","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}}] 2023-10-18T12:26:04.631 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "1", "hostname": "smithi172", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 989916161, "type": "v1" }, "name": { "num": 5162, "type": "client" } }, "id": 5162, "inst": "client.5162 v1:192.168.0.1:0/989916161", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 3, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.5228716445257433 }, "state": "open", "uptime": 280.645378004 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "0", "hostname": "smithi114", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.114:0", "nonce": 1817588655, "type": "v1" }, "name": { "num": 5521, "type": "client" } }, "id": 5521, "inst": "client.5521 v1:172.21.15.114:0/1817588655", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 25, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.521101214847727 }, "state": "stale", "uptime": 282.117342833 } ] 2023-10-18T12:26:04.732 DEBUG:tasks.ceph_test_case:No log hits yet, waiting... 2023-10-18T12:26:33.135 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:26:33.143 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:27:03.399 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:27:03.407 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:27:04.760 ERROR:tasks.ceph_test_case:Log output: 2023-10-18T12:27:04.761 DEBUG:tasks.cephfs.test_client_recovery:Expected log message found: '1 client(s) laggy due to laggy OSDs', retrying 2023-10-18T12:27:09.762 DEBUG:teuthology.orchestra.run.smithi114:> sudo daemon-helper kill ceph --cluster ceph -w 2023-10-18T12:27:09.770 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T12:27:09.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.931+0000 7fd8d7c97700 1 Processor -- start 2023-10-18T12:27:09.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.931+0000 7fd8d7c97700 1 -- start start 2023-10-18T12:27:09.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.931+0000 7fd8d7c97700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd8d0155420 0x7fd8d00cb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:27:09.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.931+0000 7fd8d7c97700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd8d015bf00 0x7fd8d00cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:27:09.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.931+0000 7fd8d7c97700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8d00cbc80 con 0x7fd8d00b0f90 2023-10-18T12:27:09.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.931+0000 7fd8d7c97700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8d0155800 con 0x7fd8d015bf00 2023-10-18T12:27:09.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.931+0000 7fd8d7c97700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d00cb9a0 con 0x7fd8d0155420 2023-10-18T12:27:09.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.935+0000 7fd8d6234700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd8d00b0f90 0x7fd8d00cc680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44816/0 (socket says 172.21.15.114:44816) 2023-10-18T12:27:09.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.935+0000 7fd8d6234700 1 -- 172.21.15.114:0/1337042540 learned_addr learned my addr 172.21.15.114:0/1337042540 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:27:09.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.935+0000 7fd8d5a33700 1 --2- 172.21.15.114:0/1337042540 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd8d0155420 0x7fd8d00cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:27:09.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.935+0000 7fd8d5232700 1 --2- 172.21.15.114:0/1337042540 >> v2:172.21.15.172:3300/0 conn(0x7fd8d015bf00 0x7fd8d00cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:27:09.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.935+0000 7fd8d4a31700 1 -- 172.21.15.114:0/1337042540 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3049296754 0 0) 0x7fd8d00cbc80 con 0x7fd8d00b0f90 2023-10-18T12:27:09.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.935+0000 7fd8d4a31700 1 -- 172.21.15.114:0/1337042540 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8bc0035d0 con 0x7fd8d00b0f90 2023-10-18T12:27:09.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.935+0000 7fd8d4a31700 1 -- 172.21.15.114:0/1337042540 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2746139019 0 0) 0x7fd8bc0035d0 con 0x7fd8d00b0f90 2023-10-18T12:27:09.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.935+0000 7fd8d5a33700 1 -- 172.21.15.114:0/1337042540 >> v2:172.21.15.172:3300/0 conn(0x7fd8d015bf00 msgr2=0x7fd8d00cdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:27:09.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.935+0000 7fd8d5a33700 1 --2- 172.21.15.114:0/1337042540 >> v2:172.21.15.172:3300/0 conn(0x7fd8d015bf00 0x7fd8d00cdc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:27:09.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.935+0000 7fd8d5a33700 1 -- 172.21.15.114:0/1337042540 >> v1:172.21.15.114:6789/0 conn(0x7fd8d00b0f90 legacy=0x7fd8d00cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:27:09.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.935+0000 7fd8d5a33700 1 -- 172.21.15.114:0/1337042540 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d015b420 con 0x7fd8d0155420 2023-10-18T12:27:09.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.935+0000 7fd8d5a33700 1 --2- 172.21.15.114:0/1337042540 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd8d0155420 0x7fd8d00cb150 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc009850 tx=0x7fd8cc009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1baa22ab0eebe475 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:27:09.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.935+0000 7fd8d4a31700 1 -- 172.21.15.114:0/1337042540 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c80019f0 con 0x7fd8d0155420 2023-10-18T12:27:09.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.935+0000 7fd8d4a31700 1 -- 172.21.15.114:0/1337042540 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8cc004030 con 0x7fd8d0155420 2023-10-18T12:27:09.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.935+0000 7fd8d4a31700 1 -- 172.21.15.114:0/1337042540 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc0043a0 con 0x7fd8d0155420 2023-10-18T12:27:09.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.935+0000 7fd8d7c97700 1 -- 172.21.15.114:0/1337042540 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd8d0155420 msgr2=0x7fd8d00cb150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:27:09.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.935+0000 7fd8d7c97700 1 --2- 172.21.15.114:0/1337042540 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd8d0155420 0x7fd8d00cb150 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc009850 tx=0x7fd8cc009b60 comp rx=0 tx=0).stop 2023-10-18T12:27:09.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.935+0000 7fd8d7c97700 1 -- 172.21.15.114:0/1337042540 shutdown_connections 2023-10-18T12:27:09.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.935+0000 7fd8d7c97700 1 --2- 172.21.15.114:0/1337042540 >> v2:172.21.15.172:3300/0 conn(0x7fd8d015bf00 0x7fd8d00cdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:27:09.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.935+0000 7fd8d7c97700 1 --2- 172.21.15.114:0/1337042540 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd8d0155420 0x7fd8d00cb150 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:27:09.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.935+0000 7fd8d7c97700 1 -- 172.21.15.114:0/1337042540 >> 172.21.15.114:0/1337042540 conn(0x7fd8d006a340 msgr2=0x7fd8d00b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:27:09.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.935+0000 7fd8d7c97700 1 -- 172.21.15.114:0/1337042540 shutdown_connections 2023-10-18T12:27:09.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.935+0000 7fd8d7c97700 1 -- 172.21.15.114:0/1337042540 wait complete. 2023-10-18T12:27:09.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.939+0000 7fd8d7c97700 1 Processor -- start 2023-10-18T12:27:09.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.939+0000 7fd8d7c97700 1 -- start start 2023-10-18T12:27:09.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.943+0000 7fd8d7c97700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8d00b0f90 0x7fd8d013a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:27:09.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.943+0000 7fd8d7c97700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8d0155420 0x7fd8d01f03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:27:09.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.943+0000 7fd8d7c97700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd8d015bf00 0x7fd8d0159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:27:09.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.943+0000 7fd8d7c97700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d01f13d0 con 0x7fd8d0155420 2023-10-18T12:27:09.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.943+0000 7fd8d7c97700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d01f0e10 con 0x7fd8d00b0f90 2023-10-18T12:27:09.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.943+0000 7fd8d7c97700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d01f10f0 con 0x7fd8d015bf00 2023-10-18T12:27:09.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.943+0000 7fd8d5232700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8d0155420 0x7fd8d01f03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:27:09.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.943+0000 7fd8d5a33700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8d00b0f90 0x7fd8d013a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:27:09.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.943+0000 7fd8d5232700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8d0155420 0x7fd8d01f03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51876/0 (socket says 172.21.15.114:51876) 2023-10-18T12:27:09.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.943+0000 7fd8d6234700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd8d015bf00 0x7fd8d0159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:27:09.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.943+0000 7fd8d5232700 1 -- 172.21.15.114:0/3584391547 learned_addr learned my addr 172.21.15.114:0/3584391547 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:27:09.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.943+0000 7fd8d5a33700 1 -- 172.21.15.114:0/3584391547 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd8d015bf00 msgr2=0x7fd8d0159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:27:09.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.943+0000 7fd8d5a33700 1 --2- 172.21.15.114:0/3584391547 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd8d015bf00 0x7fd8d0159ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:27:09.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.943+0000 7fd8d5a33700 1 -- 172.21.15.114:0/3584391547 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8d0155420 msgr2=0x7fd8d01f03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:27:09.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.943+0000 7fd8d5a33700 1 --2- 172.21.15.114:0/3584391547 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8d0155420 0x7fd8d01f03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:27:09.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.943+0000 7fd8d5a33700 1 -- 172.21.15.114:0/3584391547 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8cc0094b0 con 0x7fd8d00b0f90 2023-10-18T12:27:09.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.943+0000 7fd8d5a33700 1 --2- 172.21.15.114:0/3584391547 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8d00b0f90 0x7fd8d013a880 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc015000 tx=0x7fd8cc004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:27:09.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.943+0000 7fd8c27fc700 1 -- 172.21.15.114:0/3584391547 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc003ac0 con 0x7fd8d00b0f90 2023-10-18T12:27:09.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.943+0000 7fd8c27fc700 1 -- 172.21.15.114:0/3584391547 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8cc01f070 con 0x7fd8d00b0f90 2023-10-18T12:27:09.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.943+0000 7fd8d7c97700 1 -- 172.21.15.114:0/3584391547 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8d013b220 con 0x7fd8d00b0f90 2023-10-18T12:27:09.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.943+0000 7fd8c27fc700 1 -- 172.21.15.114:0/3584391547 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc003e80 con 0x7fd8d00b0f90 2023-10-18T12:27:09.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.943+0000 7fd8d7c97700 1 -- 172.21.15.114:0/3584391547 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8d013adc0 con 0x7fd8d00b0f90 2023-10-18T12:27:09.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.947+0000 7fd8d7c97700 1 -- 172.21.15.114:0/3584391547 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8d013b740 con 0x7fd8d00b0f90 2023-10-18T12:27:09.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.947+0000 7fd8c27fc700 1 -- 172.21.15.114:0/3584391547 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fd8cc021030 con 0x7fd8d00b0f90 2023-10-18T12:27:09.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.947+0000 7fd8c27fc700 1 --2- 172.21.15.114:0/3584391547 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd8b40656f0 0x7fd8b4067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:27:09.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.947+0000 7fd8c27fc700 1 -- 172.21.15.114:0/3584391547 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fd8cc0840c0 con 0x7fd8d00b0f90 2023-10-18T12:27:09.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.951+0000 7fd8d5232700 1 --2- 172.21.15.114:0/3584391547 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd8b40656f0 0x7fd8b4067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:27:09.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.951+0000 7fd8d5232700 1 --2- 172.21.15.114:0/3584391547 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd8b40656f0 0x7fd8b4067bb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd8d013e620 tx=0x7fd8c4009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:27:09.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.959+0000 7fd8c27fc700 1 -- 172.21.15.114:0/3584391547 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fd8cc0519f0 con 0x7fd8d00b0f90 2023-10-18T12:27:09.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.959+0000 7f8a12adf700 1 Processor -- start 2023-10-18T12:27:09.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.959+0000 7f8a12adf700 1 -- start start 2023-10-18T12:27:09.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.963+0000 7f8a12adf700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8a0c0b24c0 0x7f8a0c0cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:27:09.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.963+0000 7f8a12adf700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8a0c0cfcc0 0x7f8a0c0cd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:27:09.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.963+0000 7f8a12adf700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a0c0d00d0 con 0x7f8a0c160240 2023-10-18T12:27:09.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.963+0000 7f8a12adf700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a0c0d1b10 con 0x7f8a0c0cfcc0 2023-10-18T12:27:09.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.963+0000 7f8a12adf700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a0c0d0a70 con 0x7f8a0c0b24c0 2023-10-18T12:27:09.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.963+0000 7f8a122de700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8a0c0cfcc0 0x7f8a0c0cd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:27:09.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.963+0000 7f8a11add700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f8a0c160240 0x7f8a0c1612c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:44828/0 (socket says 172.21.15.114:44828) 2023-10-18T12:27:09.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.963+0000 7f8a11add700 1 -- 172.21.15.114:0/3112117322 learned_addr learned my addr 172.21.15.114:0/3112117322 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:27:09.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.963+0000 7f8a112dc700 1 --2- 172.21.15.114:0/3112117322 >> v2:172.21.15.172:3300/0 conn(0x7f8a0c0b24c0 0x7f8a0c0cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:27:09.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.963+0000 7f8a122de700 1 -- 172.21.15.114:0/3112117322 >> v2:172.21.15.172:3300/0 conn(0x7f8a0c0b24c0 msgr2=0x7f8a0c0cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:27:09.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.963+0000 7f8a122de700 1 --2- 172.21.15.114:0/3112117322 >> v2:172.21.15.172:3300/0 conn(0x7f8a0c0b24c0 0x7f8a0c0cf780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:27:09.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.963+0000 7f8a122de700 1 -- 172.21.15.114:0/3112117322 >> v1:172.21.15.114:6789/0 conn(0x7f8a0c160240 legacy=0x7f8a0c1612c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:27:09.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.963+0000 7f8a122de700 1 -- 172.21.15.114:0/3112117322 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a0c0d0d50 con 0x7f8a0c0cfcc0 2023-10-18T12:27:09.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.963+0000 7f8a122de700 1 --2- 172.21.15.114:0/3112117322 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a0c0cfcc0 0x7f8a0c0cd6d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c06d020 tx=0x7f8a04009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fc7fb2785568101 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:27:09.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.963+0000 7f8a10adb700 1 -- 172.21.15.114:0/3112117322 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a04011830 con 0x7f8a0c0cfcc0 2023-10-18T12:27:09.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.963+0000 7f8a10adb700 1 -- 172.21.15.114:0/3112117322 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a04011990 con 0x7f8a0c0cfcc0 2023-10-18T12:27:09.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.963+0000 7f8a10adb700 1 -- 172.21.15.114:0/3112117322 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a04011d20 con 0x7f8a0c0cfcc0 2023-10-18T12:27:09.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.963+0000 7f8a12adf700 1 -- 172.21.15.114:0/3112117322 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a0c0cfcc0 msgr2=0x7f8a0c0cd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:27:09.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.963+0000 7f8a12adf700 1 --2- 172.21.15.114:0/3112117322 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a0c0cfcc0 0x7f8a0c0cd6d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c06d020 tx=0x7f8a04009b30 comp rx=0 tx=0).stop 2023-10-18T12:27:09.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.963+0000 7f8a12adf700 1 -- 172.21.15.114:0/3112117322 shutdown_connections 2023-10-18T12:27:09.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.963+0000 7f8a12adf700 1 --2- 172.21.15.114:0/3112117322 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a0c0cfcc0 0x7f8a0c0cd6d0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:27:09.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.963+0000 7f8a12adf700 1 --2- 172.21.15.114:0/3112117322 >> v2:172.21.15.172:3300/0 conn(0x7f8a0c0b24c0 0x7f8a0c0cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:27:09.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.963+0000 7f8a12adf700 1 -- 172.21.15.114:0/3112117322 >> 172.21.15.114:0/3112117322 conn(0x7f8a0c0b4a60 msgr2=0x7f8a0c0b4e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:27:09.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.963+0000 7f8a12adf700 1 -- 172.21.15.114:0/3112117322 shutdown_connections 2023-10-18T12:27:09.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.967+0000 7f8a12adf700 1 -- 172.21.15.114:0/3112117322 wait complete. 2023-10-18T12:27:09.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.967+0000 7f8a12adf700 1 Processor -- start 2023-10-18T12:27:09.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.967+0000 7f8a12adf700 1 -- start start 2023-10-18T12:27:09.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.967+0000 7f8a12adf700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a0c0b24c0 0x7f8a0c1586c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:27:09.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.967+0000 7f8a12adf700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a0c0cfcc0 0x7f8a0c15a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:27:09.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.967+0000 7f8a12adf700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8a0c160240 0x7f8a0c15a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:27:09.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.967+0000 7f8a12adf700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c0cca30 con 0x7f8a0c0cfcc0 2023-10-18T12:27:09.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.967+0000 7f8a12adf700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c15ae20 con 0x7f8a0c0b24c0 2023-10-18T12:27:09.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.967+0000 7f8a12adf700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c15b100 con 0x7f8a0c160240 2023-10-18T12:27:09.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.967+0000 7f8a112dc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a0c0cfcc0 0x7f8a0c15a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:27:09.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.967+0000 7f8a112dc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a0c0cfcc0 0x7f8a0c15a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:51900/0 (socket says 172.21.15.114:51900) 2023-10-18T12:27:09.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.967+0000 7f8a112dc700 1 -- 172.21.15.114:0/1570433546 learned_addr learned my addr 172.21.15.114:0/1570433546 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:27:09.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.967+0000 7f8a11add700 1 --2- 172.21.15.114:0/1570433546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a0c0b24c0 0x7f8a0c1586c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:27:09.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.967+0000 7f8a122de700 1 --2- 172.21.15.114:0/1570433546 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8a0c160240 0x7f8a0c15a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:27:09.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.967+0000 7f8a112dc700 1 -- 172.21.15.114:0/1570433546 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8a0c160240 msgr2=0x7f8a0c15a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:27:09.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.971+0000 7f8a112dc700 1 --2- 172.21.15.114:0/1570433546 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8a0c160240 0x7f8a0c15a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:27:09.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.971+0000 7f8a112dc700 1 -- 172.21.15.114:0/1570433546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a0c0b24c0 msgr2=0x7f8a0c1586c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:27:09.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.971+0000 7f8a112dc700 1 --2- 172.21.15.114:0/1570433546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a0c0b24c0 0x7f8a0c1586c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:27:09.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.971+0000 7f8a112dc700 1 -- 172.21.15.114:0/1570433546 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a040094b0 con 0x7f8a0c0cfcc0 2023-10-18T12:27:09.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.971+0000 7f8a11add700 1 --2- 172.21.15.114:0/1570433546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a0c0b24c0 0x7f8a0c1586c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:27:09.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.971+0000 7f8a112dc700 1 --2- 172.21.15.114:0/1570433546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a0c0cfcc0 0x7f8a0c15a2b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f89fc00e840 tx=0x7f89fc00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:27:09.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.971+0000 7f8a027fc700 1 -- 172.21.15.114:0/1570433546 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc0095a0 con 0x7f8a0c0cfcc0 2023-10-18T12:27:09.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.971+0000 7f8a027fc700 1 -- 172.21.15.114:0/1570433546 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89fc00c690 con 0x7f8a0c0cfcc0 2023-10-18T12:27:09.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.971+0000 7f8a027fc700 1 -- 172.21.15.114:0/1570433546 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc00ca00 con 0x7f8a0c0cfcc0 2023-10-18T12:27:09.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.971+0000 7f8a12adf700 1 -- 172.21.15.114:0/1570433546 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a0c0b5b50 con 0x7f8a0c0cfcc0 2023-10-18T12:27:09.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.971+0000 7f8a12adf700 1 -- 172.21.15.114:0/1570433546 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a0c0b6110 con 0x7f8a0c0cfcc0 2023-10-18T12:27:09.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.971+0000 7f8a12adf700 1 -- 172.21.15.114:0/1570433546 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f8a0c072e60 con 0x7f8a0c0cfcc0 2023-10-18T12:27:09.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.975+0000 7f8a027fc700 1 -- 172.21.15.114:0/1570433546 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f89fc00cb60 con 0x7f8a0c0cfcc0 2023-10-18T12:27:09.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.975+0000 7f8a027fc700 1 --2- 172.21.15.114:0/1570433546 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f89f00656f0 0x7f89f0067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:27:09.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.975+0000 7f8a027fc700 1 -- 172.21.15.114:0/1570433546 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f89fc082f60 con 0x7f8a0c0cfcc0 2023-10-18T12:27:09.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.975+0000 7f8a027fc700 1 -- 172.21.15.114:0/1570433546 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+446 (secure 0 0 0) 0x7f89fc0854c0 con 0x7f8a0c0cfcc0 2023-10-18T12:27:09.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.975+0000 7f8a12adf700 1 -- 172.21.15.114:0/1570433546 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7f8a0c06e490 con 0x7f8a0c0cfcc0 2023-10-18T12:27:09.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.975+0000 7f8a11add700 1 --2- 172.21.15.114:0/1570433546 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f89f00656f0 0x7f89f0067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:27:09.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:09.975+0000 7f8a11add700 1 --2- 172.21.15.114:0/1570433546 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f89f00656f0 0x7f89f0067bb0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8a08005cb0 tx=0x7f8a08009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:27:10.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:10.191+0000 7fd8d7c97700 1 -- 172.21.15.114:0/3584391547 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8d00b1470 con 0x7fd8d00b0f90 2023-10-18T12:27:10.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:10.191+0000 7fd8c27fc700 1 -- 172.21.15.114:0/3584391547 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4887 (secure 0 0 0) 0x7fd8cc055010 con 0x7fd8d00b0f90 2023-10-18T12:27:10.201 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:27:10.201 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2034957068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2034957068},{"type":"v1","addr":"172.21.15.172:6836","nonce":2034957068}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5039,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4215710360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4215710360},{"type":"v1","addr":"172.21.15.172:6837","nonce":4215710360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2387835210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2387835210},{"type":"v1","addr":"172.21.15.114:6833","nonce":2387835210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T12:21:14.159069+0000","modified":"2023-10-18T12:21:17.730177+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.114:6835/1284474820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1284474820},{"type":"v1","addr":"172.21.15.114:6835","nonce":1284474820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-18T12:27:10.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:10.199+0000 7fd8d7c97700 1 -- 172.21.15.114:0/3584391547 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd8b40656f0 msgr2=0x7fd8b4067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:27:10.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:10.199+0000 7fd8d7c97700 1 --2- 172.21.15.114:0/3584391547 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd8b40656f0 0x7fd8b4067bb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd8d013e620 tx=0x7fd8c4009240 comp rx=0 tx=0).stop 2023-10-18T12:27:10.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:10.199+0000 7fd8d7c97700 1 -- 172.21.15.114:0/3584391547 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8d00b0f90 msgr2=0x7fd8d013a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:27:10.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:10.199+0000 7fd8d7c97700 1 --2- 172.21.15.114:0/3584391547 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8d00b0f90 0x7fd8d013a880 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc015000 tx=0x7fd8cc004770 comp rx=0 tx=0).stop 2023-10-18T12:27:10.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:10.199+0000 7fd8d7c97700 1 -- 172.21.15.114:0/3584391547 shutdown_connections 2023-10-18T12:27:10.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:10.199+0000 7fd8d7c97700 1 --2- 172.21.15.114:0/3584391547 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd8b40656f0 0x7fd8b4067bb0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:27:10.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:10.199+0000 7fd8d7c97700 1 --2- 172.21.15.114:0/3584391547 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd8d015bf00 0x7fd8d0159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:27:10.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:10.199+0000 7fd8d7c97700 1 --2- 172.21.15.114:0/3584391547 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8d0155420 0x7fd8d01f03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:27:10.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:10.199+0000 7fd8d7c97700 1 --2- 172.21.15.114:0/3584391547 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd8d00b0f90 0x7fd8d013a880 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:27:10.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:10.199+0000 7fd8d7c97700 1 -- 172.21.15.114:0/3584391547 >> 172.21.15.114:0/3584391547 conn(0x7fd8d006a340 msgr2=0x7fd8d0144220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:27:10.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:10.199+0000 7fd8d7c97700 1 -- 172.21.15.114:0/3584391547 shutdown_connections 2023-10-18T12:27:10.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:27:10.199+0000 7fd8d7c97700 1 -- 172.21.15.114:0/3584391547 wait complete. 2023-10-18T12:27:10.209 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 18 2023-10-18T12:27:10.229 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-10-18T12:27:10.416 INFO:teuthology.orchestra.run.smithi114.stdout:[{"id":5162,"entity":{"name":{"type":"client","num":5162},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":989916161}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":346.42784130799998,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.44914521275147623,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":3,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5162 v1:192.168.0.1:0/989916161","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi172","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}},{"id":5521,"entity":{"name":{"type":"client","num":5521},"addr":{"type":"v1","addr":"172.21.15.114:0","nonce":1817588655}},"state":"stale","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":347.89980613699998,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.44762028202756465,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":25,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5521 v1:172.21.15.114:0/1817588655","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi114","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}}] 2023-10-18T12:27:10.417 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "1", "hostname": "smithi172", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 989916161, "type": "v1" }, "name": { "num": 5162, "type": "client" } }, "id": 5162, "inst": "client.5162 v1:192.168.0.1:0/989916161", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 3, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.44914521275147623 }, "state": "open", "uptime": 346.427841308 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "0", "hostname": "smithi114", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.114:0", "nonce": 1817588655, "type": "v1" }, "name": { "num": 5521, "type": "client" } }, "id": 5521, "inst": "client.5521 v1:172.21.15.114:0/1817588655", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 25, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.44762028202756465 }, "state": "stale", "uptime": 347.899806137 } ] 2023-10-18T12:27:10.518 DEBUG:tasks.ceph_test_case:No log hits yet, waiting... 2023-10-18T12:27:33.486 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:27:33.494 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:28:03.571 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:28:03.579 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:28:10.542 ERROR:tasks.ceph_test_case:Log output: 2023-10-18T12:28:10.543 DEBUG:tasks.cephfs.test_client_recovery:Expected log message found: '1 client(s) laggy due to laggy OSDs', retrying 2023-10-18T12:28:15.544 DEBUG:teuthology.orchestra.run.smithi114:> sudo daemon-helper kill ceph --cluster ceph -w 2023-10-18T12:28:15.552 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T12:28:15.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.718+0000 7ff353011700 1 Processor -- start 2023-10-18T12:28:15.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.718+0000 7ff353011700 1 -- start start 2023-10-18T12:28:15.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.722+0000 7ff353011700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff34c15da30 0x7ff34c0cb190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:28:15.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.722+0000 7ff353011700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff34c0cbb20 con 0x7ff34c0cb6d0 2023-10-18T12:28:15.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.722+0000 7ff353011700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff34c1597a0 con 0x7ff34c1593c0 2023-10-18T12:28:15.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.722+0000 7ff353011700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c15d610 con 0x7ff34c15da30 2023-10-18T12:28:15.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.722+0000 7ff3515ae700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff34c0cb6d0 0x7ff34c0b1880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:38732/0 (socket says 172.21.15.114:38732) 2023-10-18T12:28:15.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.722+0000 7ff3515ae700 1 -- 172.21.15.114:0/2819820568 learned_addr learned my addr 172.21.15.114:0/2819820568 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:28:15.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.722+0000 7ff343fff700 1 --2- 172.21.15.114:0/2819820568 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff34c15da30 0x7ff34c0cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:28:15.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.722+0000 7ff3437fe700 1 -- 172.21.15.114:0/2819820568 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1039433781 0 0) 0x7ff344001490 con 0x7ff34c0cb6d0 2023-10-18T12:28:15.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.722+0000 7ff3437fe700 1 -- 172.21.15.114:0/2819820568 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3340035d0 con 0x7ff34c0cb6d0 2023-10-18T12:28:15.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.722+0000 7ff3437fe700 1 -- 172.21.15.114:0/2819820568 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3029512635 0 0) 0x7ff34c1597a0 con 0x7ff34c1593c0 2023-10-18T12:28:15.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.722+0000 7ff3437fe700 1 -- 172.21.15.114:0/2819820568 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff344001490 con 0x7ff34c1593c0 2023-10-18T12:28:15.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.722+0000 7ff3437fe700 1 -- 172.21.15.114:0/2819820568 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3658607008 0 0) 0x7ff3340035d0 con 0x7ff34c0cb6d0 2023-10-18T12:28:15.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.722+0000 7ff343fff700 1 -- 172.21.15.114:0/2819820568 >> v1:172.21.15.172:6789/0 conn(0x7ff34c1593c0 legacy=0x7ff34c06ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:28:15.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.722+0000 7ff343fff700 1 -- 172.21.15.114:0/2819820568 >> v1:172.21.15.114:6789/0 conn(0x7ff34c0cb6d0 legacy=0x7ff34c0b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:28:15.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.722+0000 7ff343fff700 1 -- 172.21.15.114:0/2819820568 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff34c06d920 con 0x7ff34c15da30 2023-10-18T12:28:15.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.722+0000 7ff343fff700 1 --2- 172.21.15.114:0/2819820568 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff34c15da30 0x7ff34c0cb190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff33c009880 tx=0x7ff33c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68c394d5ddb43b91 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:28:15.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.722+0000 7ff3437fe700 1 -- 172.21.15.114:0/2819820568 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff344001b80 con 0x7ff34c15da30 2023-10-18T12:28:15.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.722+0000 7ff3437fe700 1 -- 172.21.15.114:0/2819820568 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff33c004030 con 0x7ff34c15da30 2023-10-18T12:28:15.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.722+0000 7ff3437fe700 1 -- 172.21.15.114:0/2819820568 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33c0043c0 con 0x7ff34c15da30 2023-10-18T12:28:15.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.726+0000 7ff353011700 1 -- 172.21.15.114:0/2819820568 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff34c15da30 msgr2=0x7ff34c0cb190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:28:15.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.726+0000 7ff353011700 1 --2- 172.21.15.114:0/2819820568 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff34c15da30 0x7ff34c0cb190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff33c009880 tx=0x7ff33c009b90 comp rx=0 tx=0).stop 2023-10-18T12:28:15.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.726+0000 7ff353011700 1 -- 172.21.15.114:0/2819820568 shutdown_connections 2023-10-18T12:28:15.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.726+0000 7ff353011700 1 --2- 172.21.15.114:0/2819820568 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff34c15da30 0x7ff34c0cb190 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:28:15.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.726+0000 7ff353011700 1 -- 172.21.15.114:0/2819820568 >> 172.21.15.114:0/2819820568 conn(0x7ff34c06a340 msgr2=0x7ff34c0b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:28:15.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.726+0000 7ff353011700 1 -- 172.21.15.114:0/2819820568 shutdown_connections 2023-10-18T12:28:15.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.726+0000 7ff353011700 1 -- 172.21.15.114:0/2819820568 wait complete. 2023-10-18T12:28:15.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.726+0000 7ff353011700 1 Processor -- start 2023-10-18T12:28:15.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.730+0000 7ff353011700 1 -- start start 2023-10-18T12:28:15.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.730+0000 7ff353011700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff34c0cb6d0 0x7ff34c0b0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:28:15.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.730+0000 7ff353011700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff34c1593c0 0x7ff34c1394b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:28:15.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.730+0000 7ff353011700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff34c15da30 0x7ff34c150460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:28:15.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.730+0000 7ff353011700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c0ae290 con 0x7ff34c0cb6d0 2023-10-18T12:28:15.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.730+0000 7ff353011700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c15a6b0 con 0x7ff34c1593c0 2023-10-18T12:28:15.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.730+0000 7ff353011700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c15af50 con 0x7ff34c15da30 2023-10-18T12:28:15.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.730+0000 7ff350dad700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff34c0cb6d0 0x7ff34c0b0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:28:15.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.730+0000 7ff350dad700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff34c0cb6d0 0x7ff34c0b0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33166/0 (socket says 172.21.15.114:33166) 2023-10-18T12:28:15.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.730+0000 7ff350dad700 1 -- 172.21.15.114:0/605597262 learned_addr learned my addr 172.21.15.114:0/605597262 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:28:15.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.730+0000 7ff343fff700 1 --2- 172.21.15.114:0/605597262 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff34c1593c0 0x7ff34c1394b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:28:15.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.730+0000 7ff3515ae700 1 --2- 172.21.15.114:0/605597262 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff34c15da30 0x7ff34c150460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:28:15.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.730+0000 7ff350dad700 1 -- 172.21.15.114:0/605597262 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff34c15da30 msgr2=0x7ff34c150460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:28:15.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.730+0000 7ff350dad700 1 --2- 172.21.15.114:0/605597262 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff34c15da30 0x7ff34c150460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:28:15.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.730+0000 7ff350dad700 1 -- 172.21.15.114:0/605597262 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff34c1593c0 msgr2=0x7ff34c1394b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:28:15.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.730+0000 7ff350dad700 1 --2- 172.21.15.114:0/605597262 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff34c1593c0 0x7ff34c1394b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:28:15.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.730+0000 7ff350dad700 1 -- 172.21.15.114:0/605597262 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff33c0094b0 con 0x7ff34c0cb6d0 2023-10-18T12:28:15.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.730+0000 7ff350dad700 1 --2- 172.21.15.114:0/605597262 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff34c0cb6d0 0x7ff34c0b0e40 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ff34800c760 tx=0x7ff34800cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:28:15.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.730+0000 7ff3417fa700 1 -- 172.21.15.114:0/605597262 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3480052d0 con 0x7ff34c0cb6d0 2023-10-18T12:28:15.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.730+0000 7ff3417fa700 1 -- 172.21.15.114:0/605597262 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff348005430 con 0x7ff34c0cb6d0 2023-10-18T12:28:15.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.730+0000 7ff353011700 1 -- 172.21.15.114:0/605597262 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff34c1399f0 con 0x7ff34c0cb6d0 2023-10-18T12:28:15.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.730+0000 7ff3417fa700 1 -- 172.21.15.114:0/605597262 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3480055a0 con 0x7ff34c0cb6d0 2023-10-18T12:28:15.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.730+0000 7ff353011700 1 -- 172.21.15.114:0/605597262 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff34c15a900 con 0x7ff34c0cb6d0 2023-10-18T12:28:15.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.734+0000 7ff353011700 1 -- 172.21.15.114:0/605597262 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff34c072e60 con 0x7ff34c0cb6d0 2023-10-18T12:28:15.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.734+0000 7ff3417fa700 1 -- 172.21.15.114:0/605597262 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff3480038e0 con 0x7ff34c0cb6d0 2023-10-18T12:28:15.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.734+0000 7ff3417fa700 1 --2- 172.21.15.114:0/605597262 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff338065720 0x7ff338067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:28:15.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.734+0000 7ff3417fa700 1 -- 172.21.15.114:0/605597262 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6440+0+0 (secure 0 0 0) 0x7ff3480825a0 con 0x7ff34c0cb6d0 2023-10-18T12:28:15.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.738+0000 7ff343fff700 1 --2- 172.21.15.114:0/605597262 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff338065720 0x7ff338067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:28:15.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.738+0000 7ff343fff700 1 --2- 172.21.15.114:0/605597262 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff338065720 0x7ff338067be0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff33c0090b0 tx=0x7ff33c010000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:28:15.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.746+0000 7ff3417fa700 1 -- 172.21.15.114:0/605597262 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7ff34804fdb0 con 0x7ff34c0cb6d0 2023-10-18T12:28:15.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.774+0000 7f8a63fae700 1 Processor -- start 2023-10-18T12:28:15.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.774+0000 7f8a63fae700 1 -- start start 2023-10-18T12:28:15.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.774+0000 7f8a63fae700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8a5c15b9e0 0x7f8a5c161820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:28:15.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.774+0000 7f8a63fae700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a5c06d680 con 0x7f8a5c161d60 2023-10-18T12:28:15.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.774+0000 7f8a63fae700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a5c162350 con 0x7f8a5c15b600 2023-10-18T12:28:15.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.774+0000 7f8a63fae700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a5c162170 con 0x7f8a5c15b9e0 2023-10-18T12:28:15.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.774+0000 7f8a61549700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8a5c15b9e0 0x7f8a5c161820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:28:15.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.778+0000 7f8a6254b700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f8a5c161d60 0x7f8a5c0cb350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:38748/0 (socket says 172.21.15.114:38748) 2023-10-18T12:28:15.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.778+0000 7f8a6254b700 1 -- 172.21.15.114:0/1685801459 learned_addr learned my addr 172.21.15.114:0/1685801459 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:28:15.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.778+0000 7f8a61549700 1 -- 172.21.15.114:0/1685801459 >> v1:172.21.15.172:6789/0 conn(0x7f8a5c15b600 legacy=0x7f8a5c06db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:28:15.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.778+0000 7f8a61549700 1 -- 172.21.15.114:0/1685801459 >> v1:172.21.15.114:6789/0 conn(0x7f8a5c161d60 legacy=0x7f8a5c0cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:28:15.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.778+0000 7f8a61549700 1 -- 172.21.15.114:0/1685801459 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a5c162630 con 0x7f8a5c15b9e0 2023-10-18T12:28:15.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.778+0000 7f8a61549700 1 --2- 172.21.15.114:0/1685801459 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a5c15b9e0 0x7f8a5c161820 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c009850 tx=0x7f8a4c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1f1d22f2e77924d server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:28:15.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.778+0000 7f8a60d48700 1 -- 172.21.15.114:0/1685801459 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c011830 con 0x7f8a5c15b9e0 2023-10-18T12:28:15.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.778+0000 7f8a60d48700 1 -- 172.21.15.114:0/1685801459 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a4c011990 con 0x7f8a5c15b9e0 2023-10-18T12:28:15.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.778+0000 7f8a60d48700 1 -- 172.21.15.114:0/1685801459 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c011d20 con 0x7f8a5c15b9e0 2023-10-18T12:28:15.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.778+0000 7f8a63fae700 1 -- 172.21.15.114:0/1685801459 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a5c15b9e0 msgr2=0x7f8a5c161820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:28:15.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.778+0000 7f8a63fae700 1 --2- 172.21.15.114:0/1685801459 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a5c15b9e0 0x7f8a5c161820 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c009850 tx=0x7f8a4c009b60 comp rx=0 tx=0).stop 2023-10-18T12:28:15.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.778+0000 7f8a63fae700 1 -- 172.21.15.114:0/1685801459 shutdown_connections 2023-10-18T12:28:15.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.778+0000 7f8a63fae700 1 --2- 172.21.15.114:0/1685801459 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a5c15b9e0 0x7f8a5c161820 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:28:15.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.778+0000 7f8a63fae700 1 -- 172.21.15.114:0/1685801459 >> 172.21.15.114:0/1685801459 conn(0x7f8a5c0b0650 msgr2=0x7f8a5c0b0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:28:15.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.778+0000 7f8a63fae700 1 -- 172.21.15.114:0/1685801459 shutdown_connections 2023-10-18T12:28:15.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.778+0000 7f8a63fae700 1 -- 172.21.15.114:0/1685801459 wait complete. 2023-10-18T12:28:15.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.782+0000 7f8a63fae700 1 Processor -- start 2023-10-18T12:28:15.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.782+0000 7f8a63fae700 1 -- start start 2023-10-18T12:28:15.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.782+0000 7f8a63fae700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8a5c15b600 0x7f8a5c1592a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:28:15.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.782+0000 7f8a63fae700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a5c15b9e0 0x7f8a5c149c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:28:15.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.782+0000 7f8a63fae700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a5c161d60 0x7f8a5c0b3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:28:15.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.782+0000 7f8a63fae700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5c157e30 con 0x7f8a5c15b9e0 2023-10-18T12:28:15.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.782+0000 7f8a63fae700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5c0b3b80 con 0x7f8a5c161d60 2023-10-18T12:28:15.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.782+0000 7f8a63fae700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5c156510 con 0x7f8a5c15b600 2023-10-18T12:28:15.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.782+0000 7f8a61549700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a5c15b9e0 0x7f8a5c149c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:28:15.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.782+0000 7f8a61549700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a5c15b9e0 0x7f8a5c149c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33186/0 (socket says 172.21.15.114:33186) 2023-10-18T12:28:15.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.782+0000 7f8a61549700 1 -- 172.21.15.114:0/2829816795 learned_addr learned my addr 172.21.15.114:0/2829816795 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:28:15.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.782+0000 7f8a61d4a700 1 --2- 172.21.15.114:0/2829816795 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8a5c15b600 0x7f8a5c1592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:28:15.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.782+0000 7f8a6254b700 1 --2- 172.21.15.114:0/2829816795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a5c161d60 0x7f8a5c0b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:28:15.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.782+0000 7f8a61549700 1 -- 172.21.15.114:0/2829816795 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8a5c15b600 msgr2=0x7f8a5c1592a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:28:15.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.782+0000 7f8a61549700 1 --2- 172.21.15.114:0/2829816795 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8a5c15b600 0x7f8a5c1592a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:28:15.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.782+0000 7f8a61549700 1 -- 172.21.15.114:0/2829816795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a5c161d60 msgr2=0x7f8a5c0b3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:28:15.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.782+0000 7f8a61549700 1 --2- 172.21.15.114:0/2829816795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8a5c161d60 0x7f8a5c0b3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:28:15.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.782+0000 7f8a61549700 1 -- 172.21.15.114:0/2829816795 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a4c0094b0 con 0x7f8a5c15b9e0 2023-10-18T12:28:15.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.782+0000 7f8a61549700 1 --2- 172.21.15.114:0/2829816795 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a5c15b9e0 0x7f8a5c149c80 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c06b2e0 tx=0x7f8a4c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:28:15.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.782+0000 7f8a527fc700 1 -- 172.21.15.114:0/2829816795 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c0036c0 con 0x7f8a5c15b9e0 2023-10-18T12:28:15.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.782+0000 7f8a527fc700 1 -- 172.21.15.114:0/2829816795 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a4c003820 con 0x7f8a5c15b9e0 2023-10-18T12:28:15.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.786+0000 7f8a63fae700 1 -- 172.21.15.114:0/2829816795 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a5c1567f0 con 0x7f8a5c15b9e0 2023-10-18T12:28:15.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.786+0000 7f8a527fc700 1 -- 172.21.15.114:0/2829816795 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c003bd0 con 0x7f8a5c15b9e0 2023-10-18T12:28:15.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.786+0000 7f8a63fae700 1 -- 172.21.15.114:0/2829816795 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a5c1561c0 con 0x7f8a5c15b9e0 2023-10-18T12:28:15.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.786+0000 7f8a63fae700 1 -- 172.21.15.114:0/2829816795 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f8a5c161690 con 0x7f8a5c15b9e0 2023-10-18T12:28:15.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.786+0000 7f8a527fc700 1 -- 172.21.15.114:0/2829816795 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f8a4c003d30 con 0x7f8a5c15b9e0 2023-10-18T12:28:15.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.790+0000 7f8a527fc700 1 --2- 172.21.15.114:0/2829816795 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8a400656f0 0x7f8a40067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:28:15.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.790+0000 7f8a527fc700 1 -- 172.21.15.114:0/2829816795 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f8a4c021030 con 0x7f8a5c15b9e0 2023-10-18T12:28:15.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.790+0000 7f8a527fc700 1 -- 172.21.15.114:0/2829816795 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+446 (secure 0 0 0) 0x7f8a4c08b070 con 0x7f8a5c15b9e0 2023-10-18T12:28:15.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.790+0000 7f8a61d4a700 1 --2- 172.21.15.114:0/2829816795 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8a400656f0 0x7f8a40067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:28:15.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.790+0000 7f8a63fae700 1 -- 172.21.15.114:0/2829816795 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7f8a5c073f00 con 0x7f8a5c15b9e0 2023-10-18T12:28:15.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.790+0000 7f8a61d4a700 1 --2- 172.21.15.114:0/2829816795 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8a400656f0 0x7f8a40067bb0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8a58000f60 tx=0x7f8a58009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:28:15.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.978+0000 7ff353011700 1 -- 172.21.15.114:0/605597262 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff34c06dbe0 con 0x7ff34c0cb6d0 2023-10-18T12:28:15.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.978+0000 7ff3417fa700 1 -- 172.21.15.114:0/605597262 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4887 (secure 0 0 0) 0x7ff3480533d0 con 0x7ff34c0cb6d0 2023-10-18T12:28:15.982 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:28:15.983 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2034957068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2034957068},{"type":"v1","addr":"172.21.15.172:6836","nonce":2034957068}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5039,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4215710360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4215710360},{"type":"v1","addr":"172.21.15.172:6837","nonce":4215710360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2387835210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2387835210},{"type":"v1","addr":"172.21.15.114:6833","nonce":2387835210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T12:21:14.159069+0000","modified":"2023-10-18T12:21:17.730177+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.114:6835/1284474820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1284474820},{"type":"v1","addr":"172.21.15.114:6835","nonce":1284474820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-18T12:28:15.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.978+0000 7ff353011700 1 -- 172.21.15.114:0/605597262 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff338065720 msgr2=0x7ff338067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:28:15.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.978+0000 7ff353011700 1 --2- 172.21.15.114:0/605597262 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff338065720 0x7ff338067be0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff33c0090b0 tx=0x7ff33c010000 comp rx=0 tx=0).stop 2023-10-18T12:28:15.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.978+0000 7ff353011700 1 -- 172.21.15.114:0/605597262 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff34c0cb6d0 msgr2=0x7ff34c0b0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:28:15.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.978+0000 7ff353011700 1 --2- 172.21.15.114:0/605597262 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff34c0cb6d0 0x7ff34c0b0e40 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ff34800c760 tx=0x7ff34800cb20 comp rx=0 tx=0).stop 2023-10-18T12:28:15.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.978+0000 7ff353011700 1 -- 172.21.15.114:0/605597262 shutdown_connections 2023-10-18T12:28:15.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.978+0000 7ff353011700 1 --2- 172.21.15.114:0/605597262 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff338065720 0x7ff338067be0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:28:15.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.978+0000 7ff353011700 1 --2- 172.21.15.114:0/605597262 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff34c15da30 0x7ff34c150460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:28:15.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.978+0000 7ff353011700 1 --2- 172.21.15.114:0/605597262 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff34c1593c0 0x7ff34c1394b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:28:15.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.978+0000 7ff353011700 1 --2- 172.21.15.114:0/605597262 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff34c0cb6d0 0x7ff34c0b0e40 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:28:15.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.978+0000 7ff353011700 1 -- 172.21.15.114:0/605597262 >> 172.21.15.114:0/605597262 conn(0x7ff34c06a340 msgr2=0x7ff34c06f450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:28:15.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.982+0000 7ff353011700 1 -- 172.21.15.114:0/605597262 shutdown_connections 2023-10-18T12:28:15.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:15.982+0000 7ff353011700 1 -- 172.21.15.114:0/605597262 wait complete. 2023-10-18T12:28:15.987 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 18 2023-10-18T12:28:16.005 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-10-18T12:28:16.204 INFO:teuthology.orchestra.run.smithi114.stdout:[{"id":5162,"entity":{"name":{"type":"client","num":5162},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":989916161}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":412.21830774599999,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.38580728948466153,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":3,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5162 v1:192.168.0.1:0/989916161","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi172","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}},{"id":5521,"entity":{"name":{"type":"client","num":5521},"addr":{"type":"v1","addr":"172.21.15.114:0","nonce":1817588655}},"state":"stale","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":413.69027257499999,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.38450095611881557,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":25,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5521 v1:172.21.15.114:0/1817588655","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi114","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}}] 2023-10-18T12:28:16.205 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "1", "hostname": "smithi172", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 989916161, "type": "v1" }, "name": { "num": 5162, "type": "client" } }, "id": 5162, "inst": "client.5162 v1:192.168.0.1:0/989916161", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 3, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.38580728948466153 }, "state": "open", "uptime": 412.218307746 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "0", "hostname": "smithi114", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.114:0", "nonce": 1817588655, "type": "v1" }, "name": { "num": 5521, "type": "client" } }, "id": 5521, "inst": "client.5521 v1:172.21.15.114:0/1817588655", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 25, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.3845009561188156 }, "state": "stale", "uptime": 413.690272575 } ] 2023-10-18T12:28:16.307 DEBUG:tasks.ceph_test_case:No log hits yet, waiting... 2023-10-18T12:28:19.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:28:19.738+0000 7f8a527fc700 1 -- 172.21.15.114:0/2829816795 <== mon.0 v2:172.21.15.114:3300/0 7 ==== log(1 entries from seq 438 at 2023-10-18T12:28:19.685612+0000) v1 ==== 246+0+0 (secure 0 0 0) 0x7f8a4c0564a0 con 0x7f8a5c15b9e0 2023-10-18T12:28:19.745 INFO:teuthology.orchestra.run.smithi114.stdout: cluster: 2023-10-18T12:28:19.746 INFO:teuthology.orchestra.run.smithi114.stdout: id: 240ea340-5d3d-4f52-a4bc-af075aca3deb 2023-10-18T12:28:19.746 INFO:teuthology.orchestra.run.smithi114.stdout: health: HEALTH_OK 2023-10-18T12:28:19.746 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:28:19.746 INFO:teuthology.orchestra.run.smithi114.stdout: services: 2023-10-18T12:28:19.746 INFO:teuthology.orchestra.run.smithi114.stdout: mon: 3 daemons, quorum a,b,c (age 9m) 2023-10-18T12:28:19.747 INFO:teuthology.orchestra.run.smithi114.stdout: mgr: x(active, since 8m), standbys: y 2023-10-18T12:28:19.747 INFO:teuthology.orchestra.run.smithi114.stdout: mds: 1/1 daemons up, 3 standby 2023-10-18T12:28:19.747 INFO:teuthology.orchestra.run.smithi114.stdout: osd: 8 osds: 8 up (since 4m), 8 in (since 8m) 2023-10-18T12:28:19.747 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:28:19.747 INFO:teuthology.orchestra.run.smithi114.stdout: data: 2023-10-18T12:28:19.747 INFO:teuthology.orchestra.run.smithi114.stdout: volumes: 1/1 healthy 2023-10-18T12:28:19.748 INFO:teuthology.orchestra.run.smithi114.stdout: pools: 4 pools, 105 pgs 2023-10-18T12:28:19.748 INFO:teuthology.orchestra.run.smithi114.stdout: objects: 24 objects, 580 KiB 2023-10-18T12:28:19.748 INFO:teuthology.orchestra.run.smithi114.stdout: usage: 217 MiB used, 720 GiB / 720 GiB avail 2023-10-18T12:28:19.748 INFO:teuthology.orchestra.run.smithi114.stdout: pgs: 105 active+clean 2023-10-18T12:28:19.748 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:28:19.749 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:28:19.749 INFO:teuthology.orchestra.run.smithi114.stdout:2023-10-18T12:28:19.685612+0000 mon.a [WRN] Health check failed: 1 client(s) laggy due to laggy OSDs (MDS_CLIENTS_LAGGY) 2023-10-18T12:28:33.654 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:28:33.662 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:29:03.750 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:29:03.759 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:29:16.336 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mon mon_osd_laggy_weight 2023-10-18T12:29:16.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.564+0000 7eff6f59e700 1 Processor -- start 2023-10-18T12:29:16.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.564+0000 7eff6f59e700 1 -- start start 2023-10-18T12:29:16.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.568+0000 7eff6f59e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7eff7014aaa0 0x7eff70070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:29:16.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.568+0000 7eff6f59e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7eff700b1d70 0x7eff700709a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:29:16.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.568+0000 7eff6f59e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff700b25e0 con 0x7eff700b38b0 2023-10-18T12:29:16.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.568+0000 7eff6f59e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff700b10c0 con 0x7eff7014aaa0 2023-10-18T12:29:16.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.568+0000 7eff6f59e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff700b2300 con 0x7eff700b1d70 2023-10-18T12:29:16.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.568+0000 7eff67fff700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7eff700b38b0 0x7eff700b1660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:43516/0 (socket says 172.21.15.114:43516) 2023-10-18T12:29:16.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.568+0000 7eff67fff700 1 -- 172.21.15.114:0/2957615668 learned_addr learned my addr 172.21.15.114:0/2957615668 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:29:16.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.568+0000 7eff6e59c700 1 --2- 172.21.15.114:0/2957615668 >> v2:172.21.15.172:3300/0 conn(0x7eff7014aaa0 0x7eff70070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:29:16.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.568+0000 7eff6ed9d700 1 --2- 172.21.15.114:0/2957615668 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7eff700b1d70 0x7eff700709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:29:16.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.568+0000 7eff6dd9b700 1 -- 172.21.15.114:0/2957615668 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2728733483 0 0) 0x7eff700b25e0 con 0x7eff700b38b0 2023-10-18T12:29:16.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.568+0000 7eff6dd9b700 1 -- 172.21.15.114:0/2957615668 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff5c0035d0 con 0x7eff700b38b0 2023-10-18T12:29:16.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.568+0000 7eff6dd9b700 1 -- 172.21.15.114:0/2957615668 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4205134727 0 0) 0x7eff5c0035d0 con 0x7eff700b38b0 2023-10-18T12:29:16.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.568+0000 7eff6dd9b700 1 -- 172.21.15.114:0/2957615668 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7eff700b1d70 msgr2=0x7eff700709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:29:16.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.568+0000 7eff6dd9b700 1 --2- 172.21.15.114:0/2957615668 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7eff700b1d70 0x7eff700709a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:16.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.568+0000 7eff6dd9b700 1 -- 172.21.15.114:0/2957615668 >> v2:172.21.15.172:3300/0 conn(0x7eff7014aaa0 msgr2=0x7eff70070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:29:16.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.568+0000 7eff6dd9b700 1 --2- 172.21.15.114:0/2957615668 >> v2:172.21.15.172:3300/0 conn(0x7eff7014aaa0 0x7eff70070460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:16.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.568+0000 7eff6dd9b700 1 -- 172.21.15.114:0/2957615668 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff700b2dd0 con 0x7eff700b38b0 2023-10-18T12:29:16.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.568+0000 7eff6dd9b700 1 -- 172.21.15.114:0/2957615668 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3368469509 0 0) 0x7eff58001670 con 0x7eff700b38b0 2023-10-18T12:29:16.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.568+0000 7eff6dd9b700 1 -- 172.21.15.114:0/2957615668 >> v1:172.21.15.114:6789/0 conn(0x7eff700b38b0 legacy=0x7eff700b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:29:16.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.568+0000 7eff6dd9b700 1 --2- 172.21.15.114:0/2957615668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff5c003a20 0x7eff5c003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:29:16.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.568+0000 7eff6dd9b700 1 --2- 172.21.15.114:0/2957615668 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff5c004870 0x7eff5c004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:29:16.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.568+0000 7eff6dd9b700 1 --2- 172.21.15.114:0/2957615668 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7eff700b1d70 0x7eff5c005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:29:16.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.568+0000 7eff6dd9b700 1 -- 172.21.15.114:0/2957615668 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff700b10c0 con 0x7eff5c004870 2023-10-18T12:29:16.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.568+0000 7eff6dd9b700 1 -- 172.21.15.114:0/2957615668 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff700b2300 con 0x7eff5c003a20 2023-10-18T12:29:16.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.568+0000 7eff6dd9b700 1 -- 172.21.15.114:0/2957615668 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff5c00ba30 con 0x7eff700b1d70 2023-10-18T12:29:16.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.568+0000 7eff67fff700 1 --2- 172.21.15.114:0/2957615668 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff5c004870 0x7eff5c004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:29:16.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.568+0000 7eff6e59c700 1 --2- 172.21.15.114:0/2957615668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff5c003a20 0x7eff5c003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:29:16.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.568+0000 7eff67fff700 1 -- 172.21.15.114:0/2957615668 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7eff700b1d70 msgr2=0x7eff5c005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:29:16.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.568+0000 7eff67fff700 1 --2- 172.21.15.114:0/2957615668 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7eff700b1d70 0x7eff5c005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:16.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.568+0000 7eff67fff700 1 -- 172.21.15.114:0/2957615668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff5c003a20 msgr2=0x7eff5c003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:29:16.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.568+0000 7eff67fff700 1 --2- 172.21.15.114:0/2957615668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff5c003a20 0x7eff5c003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:16.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.568+0000 7eff67fff700 1 -- 172.21.15.114:0/2957615668 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff5c0035d0 con 0x7eff5c004870 2023-10-18T12:29:16.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.568+0000 7eff6e59c700 1 --2- 172.21.15.114:0/2957615668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff5c003a20 0x7eff5c003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:29:16.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.568+0000 7eff67fff700 1 --2- 172.21.15.114:0/2957615668 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff5c004870 0x7eff5c004cf0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7eff5800c320 tx=0x7eff5c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=288f48e18bb72296 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:29:16.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.568+0000 7eff6dd9b700 1 -- 172.21.15.114:0/2957615668 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5800ce60 con 0x7eff5c004870 2023-10-18T12:29:16.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.568+0000 7eff6dd9b700 1 -- 172.21.15.114:0/2957615668 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff58005980 con 0x7eff5c004870 2023-10-18T12:29:16.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.568+0000 7eff6dd9b700 1 -- 172.21.15.114:0/2957615668 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff58005d10 con 0x7eff5c004870 2023-10-18T12:29:16.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.572+0000 7eff6f59e700 1 -- 172.21.15.114:0/2957615668 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff5c004870 msgr2=0x7eff5c004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:29:16.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.572+0000 7eff6f59e700 1 --2- 172.21.15.114:0/2957615668 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff5c004870 0x7eff5c004cf0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7eff5800c320 tx=0x7eff5c0058a0 comp rx=0 tx=0).stop 2023-10-18T12:29:16.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.572+0000 7eff6ed9d700 1 -- 172.21.15.114:0/2957615668 reap_dead start 2023-10-18T12:29:16.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.572+0000 7eff6f59e700 1 -- 172.21.15.114:0/2957615668 shutdown_connections 2023-10-18T12:29:16.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.572+0000 7eff6f59e700 1 -- 172.21.15.114:0/2957615668 >> 172.21.15.114:0/2957615668 conn(0x7eff7006a600 msgr2=0x7eff700ce630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:29:16.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.572+0000 7eff6f59e700 1 -- 172.21.15.114:0/2957615668 shutdown_connections 2023-10-18T12:29:16.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.572+0000 7eff6f59e700 1 -- 172.21.15.114:0/2957615668 wait complete. 2023-10-18T12:29:16.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.572+0000 7eff6f59e700 1 Processor -- start 2023-10-18T12:29:16.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.572+0000 7eff6f59e700 1 -- start start 2023-10-18T12:29:16.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.576+0000 7eff6f59e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff5c004870 0x7eff7013f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:29:16.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.576+0000 7eff6f59e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7eff7015d050 0x7eff7015d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:29:16.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.576+0000 7eff6f59e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff7015faa0 0x7eff7015ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:29:16.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.576+0000 7eff6f59e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff7015c600 con 0x7eff7015faa0 2023-10-18T12:29:16.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.576+0000 7eff6f59e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff70160460 con 0x7eff5c004870 2023-10-18T12:29:16.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.576+0000 7eff6f59e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff7015ca20 con 0x7eff7015d050 2023-10-18T12:29:16.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.576+0000 7eff6ed9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff7015faa0 0x7eff7015ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:29:16.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.576+0000 7eff6ed9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff7015faa0 0x7eff7015ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56886/0 (socket says 172.21.15.114:56886) 2023-10-18T12:29:16.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.576+0000 7eff6ed9d700 1 -- 172.21.15.114:0/2810124395 learned_addr learned my addr 172.21.15.114:0/2810124395 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:29:16.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.576+0000 7eff67fff700 1 --2- 172.21.15.114:0/2810124395 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7eff7015d050 0x7eff7015d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:29:16.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.576+0000 7eff6e59c700 1 --2- 172.21.15.114:0/2810124395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff5c004870 0x7eff7013f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:29:16.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.576+0000 7eff6ed9d700 1 -- 172.21.15.114:0/2810124395 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7eff7015d050 msgr2=0x7eff7015d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:29:16.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.576+0000 7eff6ed9d700 1 --2- 172.21.15.114:0/2810124395 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7eff7015d050 0x7eff7015d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:16.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.576+0000 7eff6ed9d700 1 -- 172.21.15.114:0/2810124395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff5c004870 msgr2=0x7eff7013f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:29:16.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.576+0000 7eff6ed9d700 1 --2- 172.21.15.114:0/2810124395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff5c004870 0x7eff7013f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:16.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.576+0000 7eff6ed9d700 1 -- 172.21.15.114:0/2810124395 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff7013fd10 con 0x7eff7015faa0 2023-10-18T12:29:16.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.576+0000 7eff6ed9d700 1 --2- 172.21.15.114:0/2810124395 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff7015faa0 0x7eff7015ff20 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7eff7006b300 tx=0x7eff68009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:29:16.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.576+0000 7eff66ffd700 1 -- 172.21.15.114:0/2810124395 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff68010040 con 0x7eff7015faa0 2023-10-18T12:29:16.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.576+0000 7eff66ffd700 1 -- 172.21.15.114:0/2810124395 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff6800b9c0 con 0x7eff7015faa0 2023-10-18T12:29:16.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.576+0000 7eff6f59e700 1 -- 172.21.15.114:0/2810124395 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff7015b980 con 0x7eff7015faa0 2023-10-18T12:29:16.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.576+0000 7eff66ffd700 1 -- 172.21.15.114:0/2810124395 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff68009b10 con 0x7eff7015faa0 2023-10-18T12:29:16.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.576+0000 7eff6f59e700 1 -- 172.21.15.114:0/2810124395 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff7015bf40 con 0x7eff7015faa0 2023-10-18T12:29:16.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.580+0000 7eff6f59e700 1 -- 172.21.15.114:0/2810124395 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff7015c740 con 0x7eff7015faa0 2023-10-18T12:29:16.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.580+0000 7eff66ffd700 1 -- 172.21.15.114:0/2810124395 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7eff6801e410 con 0x7eff7015faa0 2023-10-18T12:29:16.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.580+0000 7eff66ffd700 1 --2- 172.21.15.114:0/2810124395 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7eff500656f0 0x7eff50067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:29:16.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.584+0000 7eff66ffd700 1 -- 172.21.15.114:0/2810124395 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6440+0+0 (secure 0 0 0) 0x7eff68082ef0 con 0x7eff7015faa0 2023-10-18T12:29:16.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.584+0000 7eff6e59c700 1 --2- 172.21.15.114:0/2810124395 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7eff500656f0 0x7eff50067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:29:16.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.584+0000 7eff6e59c700 1 --2- 172.21.15.114:0/2810124395 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7eff500656f0 0x7eff50067bb0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7eff60009b50 tx=0x7eff60008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:29:16.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.588+0000 7eff66ffd700 1 -- 172.21.15.114:0/2810124395 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7eff7015c740 con 0x7eff7015faa0 2023-10-18T12:29:16.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.884+0000 7eff6f59e700 1 -- 172.21.15.114:0/2810124395 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "config get", "who": "mon", "key": "mon_osd_laggy_weight"} v 0) v1 -- 0x7eff7015c740 con 0x7eff7015faa0 2023-10-18T12:29:16.893 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.884+0000 7eff66ffd700 1 -- 172.21.15.114:0/2810124395 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mon", "key": "mon_osd_laggy_weight"}]=0 v11) v1 ==== 103+0+9 (secure 0 0 0) 0x7eff7015c740 con 0x7eff7015faa0 2023-10-18T12:29:16.893 INFO:teuthology.orchestra.run.smithi114.stdout:0.300000 2023-10-18T12:29:16.897 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.892+0000 7eff6f59e700 1 -- 172.21.15.114:0/2810124395 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7eff500656f0 msgr2=0x7eff50067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:29:16.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.892+0000 7eff6f59e700 1 --2- 172.21.15.114:0/2810124395 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7eff500656f0 0x7eff50067bb0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7eff60009b50 tx=0x7eff60008040 comp rx=0 tx=0).stop 2023-10-18T12:29:16.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.892+0000 7eff6f59e700 1 -- 172.21.15.114:0/2810124395 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff7015faa0 msgr2=0x7eff7015ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:29:16.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.892+0000 7eff6f59e700 1 --2- 172.21.15.114:0/2810124395 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff7015faa0 0x7eff7015ff20 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7eff7006b300 tx=0x7eff68009f50 comp rx=0 tx=0).stop 2023-10-18T12:29:16.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.892+0000 7eff6f59e700 1 -- 172.21.15.114:0/2810124395 shutdown_connections 2023-10-18T12:29:16.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.892+0000 7eff6f59e700 1 --2- 172.21.15.114:0/2810124395 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7eff500656f0 0x7eff50067bb0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:16.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.892+0000 7eff6f59e700 1 --2- 172.21.15.114:0/2810124395 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7eff7015d050 0x7eff7015d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:16.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.892+0000 7eff6f59e700 1 --2- 172.21.15.114:0/2810124395 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7eff7015faa0 0x7eff7015ff20 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:16.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.892+0000 7eff6f59e700 1 --2- 172.21.15.114:0/2810124395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff5c004870 0x7eff7013f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:16.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.892+0000 7eff6f59e700 1 -- 172.21.15.114:0/2810124395 >> 172.21.15.114:0/2810124395 conn(0x7eff7006a600 msgr2=0x7eff70163d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:29:16.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.892+0000 7eff6f59e700 1 -- 172.21.15.114:0/2810124395 shutdown_connections 2023-10-18T12:29:16.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:16.892+0000 7eff6f59e700 1 -- 172.21.15.114:0/2810124395 wait complete. 2023-10-18T12:29:16.919 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_osd_laggy_weight 1 2023-10-18T12:29:17.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.100+0000 7ff1c05c1700 1 Processor -- start 2023-10-18T12:29:17.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.100+0000 7ff1c05c1700 1 -- start start 2023-10-18T12:29:17.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.100+0000 7ff1c05c1700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff1b815ce30 0x7ff1b8160a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:29:17.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.100+0000 7ff1c05c1700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff1b806f450 0x7ff1b8160f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:29:17.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.100+0000 7ff1c05c1700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff1b80caa10 0x7ff1b8161490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:29:17.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.100+0000 7ff1c05c1700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1b80ca840 con 0x7ff1b806f450 2023-10-18T12:29:17.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.100+0000 7ff1c05c1700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1b80ca560 con 0x7ff1b80caa10 2023-10-18T12:29:17.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.100+0000 7ff1c05c1700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b80ccf30 con 0x7ff1b815ce30 2023-10-18T12:29:17.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.104+0000 7ff1bdb5c700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff1b806f450 0x7ff1b8160f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:29:17.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.104+0000 7ff1bdb5c700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff1b806f450 0x7ff1b8160f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56888/0 (socket says 172.21.15.114:56888) 2023-10-18T12:29:17.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.104+0000 7ff1bdb5c700 1 -- 172.21.15.114:0/2252662497 learned_addr learned my addr 172.21.15.114:0/2252662497 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:29:17.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.104+0000 7ff1beb5e700 1 --2- 172.21.15.114:0/2252662497 >> v2:172.21.15.172:3300/0 conn(0x7ff1b80caa10 0x7ff1b8161490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:29:17.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.104+0000 7ff1be35d700 1 --2- 172.21.15.114:0/2252662497 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff1b815ce30 0x7ff1b8160a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:29:17.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.104+0000 7ff1bdb5c700 1 -- 172.21.15.114:0/2252662497 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff1b815ce30 msgr2=0x7ff1b8160a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:29:17.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.104+0000 7ff1bdb5c700 1 --2- 172.21.15.114:0/2252662497 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff1b815ce30 0x7ff1b8160a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:17.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.104+0000 7ff1bdb5c700 1 -- 172.21.15.114:0/2252662497 >> v2:172.21.15.172:3300/0 conn(0x7ff1b80caa10 msgr2=0x7ff1b8161490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:29:17.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.104+0000 7ff1bdb5c700 1 --2- 172.21.15.114:0/2252662497 >> v2:172.21.15.172:3300/0 conn(0x7ff1b80caa10 0x7ff1b8161490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:17.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.104+0000 7ff1bdb5c700 1 -- 172.21.15.114:0/2252662497 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b80cd210 con 0x7ff1b806f450 2023-10-18T12:29:17.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.104+0000 7ff1beb5e700 1 --2- 172.21.15.114:0/2252662497 >> v2:172.21.15.172:3300/0 conn(0x7ff1b80caa10 0x7ff1b8161490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:29:17.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.104+0000 7ff1bdb5c700 1 --2- 172.21.15.114:0/2252662497 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1b806f450 0x7ff1b8160f50 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ff1b80b1450 tx=0x7ff1a8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd3a9f1d72618a71 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:29:17.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.104+0000 7ff1bd35b700 1 -- 172.21.15.114:0/2252662497 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a800b8a0 con 0x7ff1b806f450 2023-10-18T12:29:17.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.104+0000 7ff1bd35b700 1 -- 172.21.15.114:0/2252662497 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a800ba00 con 0x7ff1b806f450 2023-10-18T12:29:17.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.104+0000 7ff1bd35b700 1 -- 172.21.15.114:0/2252662497 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a800bd90 con 0x7ff1b806f450 2023-10-18T12:29:17.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.104+0000 7ff1c05c1700 1 -- 172.21.15.114:0/2252662497 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1b806f450 msgr2=0x7ff1b8160f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:29:17.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.104+0000 7ff1c05c1700 1 --2- 172.21.15.114:0/2252662497 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1b806f450 0x7ff1b8160f50 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ff1b80b1450 tx=0x7ff1a8009bf0 comp rx=0 tx=0).stop 2023-10-18T12:29:17.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.108+0000 7ff1c05c1700 1 -- 172.21.15.114:0/2252662497 shutdown_connections 2023-10-18T12:29:17.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.108+0000 7ff1c05c1700 1 --2- 172.21.15.114:0/2252662497 >> v2:172.21.15.172:3300/0 conn(0x7ff1b80caa10 0x7ff1b8161490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:17.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.108+0000 7ff1c05c1700 1 --2- 172.21.15.114:0/2252662497 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1b806f450 0x7ff1b8160f50 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:17.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.108+0000 7ff1c05c1700 1 --2- 172.21.15.114:0/2252662497 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff1b815ce30 0x7ff1b8160a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:17.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.108+0000 7ff1c05c1700 1 -- 172.21.15.114:0/2252662497 >> 172.21.15.114:0/2252662497 conn(0x7ff1b80ce820 msgr2=0x7ff1b80cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:29:17.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.108+0000 7ff1c05c1700 1 -- 172.21.15.114:0/2252662497 shutdown_connections 2023-10-18T12:29:17.116 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.108+0000 7ff1c05c1700 1 -- 172.21.15.114:0/2252662497 wait complete. 2023-10-18T12:29:17.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.112+0000 7ff1c05c1700 1 Processor -- start 2023-10-18T12:29:17.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.112+0000 7ff1c05c1700 1 -- start start 2023-10-18T12:29:17.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.112+0000 7ff1c05c1700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1b806f450 0x7ff1b81f5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:29:17.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.112+0000 7ff1c05c1700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff1b80caa10 0x7ff1b8161170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:29:17.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.112+0000 7ff1c05c1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1b815ce30 0x7ff1b815f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:29:17.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.112+0000 7ff1c05c1700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b81f6af0 con 0x7ff1b815ce30 2023-10-18T12:29:17.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.112+0000 7ff1c05c1700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b81f6250 con 0x7ff1b806f450 2023-10-18T12:29:17.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.112+0000 7ff1c05c1700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b81f6530 con 0x7ff1b80caa10 2023-10-18T12:29:17.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.112+0000 7ff1beb5e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1b815ce30 0x7ff1b815f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:29:17.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.112+0000 7ff1beb5e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1b815ce30 0x7ff1b815f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56902/0 (socket says 172.21.15.114:56902) 2023-10-18T12:29:17.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.112+0000 7ff1beb5e700 1 -- 172.21.15.114:0/1091508481 learned_addr learned my addr 172.21.15.114:0/1091508481 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:29:17.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.112+0000 7ff1be35d700 1 --2- 172.21.15.114:0/1091508481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1b806f450 0x7ff1b81f5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:29:17.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.112+0000 7ff1bdb5c700 1 --2- 172.21.15.114:0/1091508481 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff1b80caa10 0x7ff1b8161170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:29:17.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.112+0000 7ff1beb5e700 1 -- 172.21.15.114:0/1091508481 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff1b80caa10 msgr2=0x7ff1b8161170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:29:17.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.112+0000 7ff1beb5e700 1 --2- 172.21.15.114:0/1091508481 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff1b80caa10 0x7ff1b8161170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:17.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.112+0000 7ff1beb5e700 1 -- 172.21.15.114:0/1091508481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1b806f450 msgr2=0x7ff1b81f5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:29:17.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.112+0000 7ff1beb5e700 1 --2- 172.21.15.114:0/1091508481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1b806f450 0x7ff1b81f5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:17.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.112+0000 7ff1beb5e700 1 -- 172.21.15.114:0/1091508481 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a8009570 con 0x7ff1b815ce30 2023-10-18T12:29:17.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.112+0000 7ff1be35d700 1 --2- 172.21.15.114:0/1091508481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1b806f450 0x7ff1b81f5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:29:17.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.112+0000 7ff1bdb5c700 1 --2- 172.21.15.114:0/1091508481 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff1b80caa10 0x7ff1b8161170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:29:17.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.112+0000 7ff1beb5e700 1 --2- 172.21.15.114:0/1091508481 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1b815ce30 0x7ff1b815f750 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff1b0007e10 tx=0x7ff1b000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:29:17.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.112+0000 7ff1aeffd700 1 -- 172.21.15.114:0/1091508481 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b000de90 con 0x7ff1b815ce30 2023-10-18T12:29:17.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.112+0000 7ff1aeffd700 1 -- 172.21.15.114:0/1091508481 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1b000f040 con 0x7ff1b815ce30 2023-10-18T12:29:17.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.112+0000 7ff1aeffd700 1 -- 172.21.15.114:0/1091508481 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1b0003c80 con 0x7ff1b815ce30 2023-10-18T12:29:17.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.112+0000 7ff1c05c1700 1 -- 172.21.15.114:0/1091508481 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1b81f6810 con 0x7ff1b815ce30 2023-10-18T12:29:17.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.116+0000 7ff1c05c1700 1 -- 172.21.15.114:0/1091508481 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1b815fc90 con 0x7ff1b815ce30 2023-10-18T12:29:17.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.116+0000 7ff1c05c1700 1 -- 172.21.15.114:0/1091508481 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1b8072e60 con 0x7ff1b815ce30 2023-10-18T12:29:17.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.116+0000 7ff1aeffd700 1 -- 172.21.15.114:0/1091508481 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff1b0004030 con 0x7ff1b815ce30 2023-10-18T12:29:17.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.120+0000 7ff1aeffd700 1 --2- 172.21.15.114:0/1091508481 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff19c0656f0 0x7ff19c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:29:17.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.120+0000 7ff1aeffd700 1 -- 172.21.15.114:0/1091508481 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6440+0+0 (secure 0 0 0) 0x7ff1b00830f0 con 0x7ff1b815ce30 2023-10-18T12:29:17.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.120+0000 7ff1be35d700 1 --2- 172.21.15.114:0/1091508481 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff19c0656f0 0x7ff19c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:29:17.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.120+0000 7ff1be35d700 1 --2- 172.21.15.114:0/1091508481 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff19c0656f0 0x7ff19c067bb0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4007a70 tx=0x7ff1b4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:29:17.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.124+0000 7ff1aeffd700 1 -- 172.21.15.114:0/1091508481 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7ff1b0050a20 con 0x7ff1b815ce30 2023-10-18T12:29:17.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.356+0000 7ff1c05c1700 1 -- 172.21.15.114:0/1091508481 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_osd_laggy_weight}] v 0) v1 -- 0x7ff1b806d0f0 con 0x7ff1b815ce30 2023-10-18T12:29:17.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.368+0000 7ff1aeffd700 1 -- 172.21.15.114:0/1091508481 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_osd_laggy_weight}]=0 v12)=0 v12) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff1b0054040 con 0x7ff1b815ce30 2023-10-18T12:29:17.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.372+0000 7ff1c05c1700 1 -- 172.21.15.114:0/1091508481 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff19c0656f0 msgr2=0x7ff19c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:29:17.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.372+0000 7ff1c05c1700 1 --2- 172.21.15.114:0/1091508481 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff19c0656f0 0x7ff19c067bb0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4007a70 tx=0x7ff1b4008040 comp rx=0 tx=0).stop 2023-10-18T12:29:17.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.372+0000 7ff1c05c1700 1 -- 172.21.15.114:0/1091508481 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1b815ce30 msgr2=0x7ff1b815f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:29:17.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.372+0000 7ff1c05c1700 1 --2- 172.21.15.114:0/1091508481 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1b815ce30 0x7ff1b815f750 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff1b0007e10 tx=0x7ff1b000d3b0 comp rx=0 tx=0).stop 2023-10-18T12:29:17.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.372+0000 7ff1c05c1700 1 -- 172.21.15.114:0/1091508481 shutdown_connections 2023-10-18T12:29:17.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.372+0000 7ff1c05c1700 1 --2- 172.21.15.114:0/1091508481 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff19c0656f0 0x7ff19c067bb0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:17.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.372+0000 7ff1c05c1700 1 --2- 172.21.15.114:0/1091508481 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff1b80caa10 0x7ff1b8161170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:17.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.372+0000 7ff1c05c1700 1 --2- 172.21.15.114:0/1091508481 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff1b815ce30 0x7ff1b815f750 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:17.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.372+0000 7ff1c05c1700 1 --2- 172.21.15.114:0/1091508481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1b806f450 0x7ff1b81f5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:17.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.372+0000 7ff1c05c1700 1 -- 172.21.15.114:0/1091508481 >> 172.21.15.114:0/1091508481 conn(0x7ff1b80ce820 msgr2=0x7ff1b80c4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:29:17.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.372+0000 7ff1c05c1700 1 -- 172.21.15.114:0/1091508481 shutdown_connections 2023-10-18T12:29:17.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:17.372+0000 7ff1c05c1700 1 -- 172.21.15.114:0/1091508481 wait complete. 2023-10-18T12:29:17.402 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-18T12:29:17.403 INFO:tasks.ceph.osd.0:Stopping old one... 2023-10-18T12:29:17.403 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-18T12:29:17.404 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T12:29:22.040 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-10-18T12:29:23.505 INFO:tasks.ceph.osd.0:Stopped 2023-10-18T12:29:23.506 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-18T12:29:23.513 INFO:tasks.ceph.osd.0:Started 2023-10-18T12:29:23.514 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-18T12:29:23.667 INFO:teuthology.orchestra.run.smithi114.stderr:no valid command found; 10 closest matches: 2023-10-18T12:29:23.667 INFO:teuthology.orchestra.run.smithi114.stderr:0 2023-10-18T12:29:23.667 INFO:teuthology.orchestra.run.smithi114.stderr:1 2023-10-18T12:29:23.667 INFO:teuthology.orchestra.run.smithi114.stderr:2 2023-10-18T12:29:23.668 INFO:teuthology.orchestra.run.smithi114.stderr:abort 2023-10-18T12:29:23.668 INFO:teuthology.orchestra.run.smithi114.stderr:assert 2023-10-18T12:29:23.668 INFO:teuthology.orchestra.run.smithi114.stderr:config diff 2023-10-18T12:29:23.668 INFO:teuthology.orchestra.run.smithi114.stderr:config diff get 2023-10-18T12:29:23.668 INFO:teuthology.orchestra.run.smithi114.stderr:config get 2023-10-18T12:29:23.669 INFO:teuthology.orchestra.run.smithi114.stderr:config help [] 2023-10-18T12:29:23.669 INFO:teuthology.orchestra.run.smithi114.stderr:config set ... 2023-10-18T12:29:23.669 INFO:teuthology.orchestra.run.smithi114.stderr:admin_socket: invalid command 2023-10-18T12:29:23.673 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-10-18T12:29:23.674 INFO:tasks.cephfs.filesystem.ceph_manager:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2023-10-18T12:29:24.177 INFO:tasks.ceph.osd.0.smithi114.stderr:2023-10-18T12:29:24.168+0000 7f1dfaf8a700 -1 Falling back to public interface 2023-10-18T12:29:28.497 INFO:tasks.ceph.osd.0.smithi114.stderr:2023-10-18T12:29:28.488+0000 7f1dfaf8a700 -1 osd.0 49 log_to_monitors true 2023-10-18T12:29:28.672 INFO:tasks.ceph.osd.0.smithi114.stderr:2023-10-18T12:29:28.664+0000 7f1dee7f0700 -1 osd.0 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-18T12:29:28.675 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-10-18T12:29:28.752 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-10-18T12:29:28.838 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T12:29:28.838 INFO:teuthology.orchestra.run.smithi114.stdout: "ops": [], 2023-10-18T12:29:28.839 INFO:teuthology.orchestra.run.smithi114.stdout: "num_ops": 0 2023-10-18T12:29:28.839 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T12:29:28.854 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_osd_laggy_weight 0.300000 2023-10-18T12:29:29.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.048+0000 7fac3e308700 1 Processor -- start 2023-10-18T12:29:29.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.048+0000 7fac3e308700 1 -- start start 2023-10-18T12:29:29.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.048+0000 7fac3e308700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac380d2610 0x7fac3806e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:29:29.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.048+0000 7fac3e308700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fac380d36b0 0x7fac3815d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:29:29.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.048+0000 7fac3e308700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac380d29f0 con 0x7fac3815e7d0 2023-10-18T12:29:29.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.048+0000 7fac3e308700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac380b64b0 con 0x7fac380d36b0 2023-10-18T12:29:29.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.048+0000 7fac3e308700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac380b6750 con 0x7fac380d2610 2023-10-18T12:29:29.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.048+0000 7fac2f7fe700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fac3815e7d0 0x7fac380d2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49328/0 (socket says 172.21.15.114:49328) 2023-10-18T12:29:29.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.048+0000 7fac2f7fe700 1 -- 172.21.15.114:0/1819605871 learned_addr learned my addr 172.21.15.114:0/1819605871 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:29:29.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.052+0000 7fac37fff700 1 --2- 172.21.15.114:0/1819605871 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac380d2610 0x7fac3806e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:29:29.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.052+0000 7fac3c8a5700 1 --2- 172.21.15.114:0/1819605871 >> v2:172.21.15.172:3300/0 conn(0x7fac380d36b0 0x7fac3815d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:29:29.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.052+0000 7fac377fe700 1 -- 172.21.15.114:0/1819605871 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 28648722 0 0) 0x7fac380d29f0 con 0x7fac3815e7d0 2023-10-18T12:29:29.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.052+0000 7fac377fe700 1 -- 172.21.15.114:0/1819605871 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac240035d0 con 0x7fac3815e7d0 2023-10-18T12:29:29.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.052+0000 7fac377fe700 1 -- 172.21.15.114:0/1819605871 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2090136908 0 0) 0x7fac240035d0 con 0x7fac3815e7d0 2023-10-18T12:29:29.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.052+0000 7fac377fe700 1 -- 172.21.15.114:0/1819605871 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac380d2610 msgr2=0x7fac3806e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:29:29.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.052+0000 7fac377fe700 1 --2- 172.21.15.114:0/1819605871 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac380d2610 0x7fac3806e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:29.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.052+0000 7fac377fe700 1 -- 172.21.15.114:0/1819605871 >> v2:172.21.15.172:3300/0 conn(0x7fac380d36b0 msgr2=0x7fac3815d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:29:29.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.052+0000 7fac377fe700 1 --2- 172.21.15.114:0/1819605871 >> v2:172.21.15.172:3300/0 conn(0x7fac380d36b0 0x7fac3815d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:29.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.052+0000 7fac377fe700 1 -- 172.21.15.114:0/1819605871 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac380b6a30 con 0x7fac3815e7d0 2023-10-18T12:29:29.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.052+0000 7fac377fe700 1 -- 172.21.15.114:0/1819605871 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3368469509 0 0) 0x7fac20001670 con 0x7fac3815e7d0 2023-10-18T12:29:29.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.052+0000 7fac377fe700 1 -- 172.21.15.114:0/1819605871 >> v1:172.21.15.114:6789/0 conn(0x7fac3815e7d0 legacy=0x7fac380d2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:29:29.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.052+0000 7fac377fe700 1 --2- 172.21.15.114:0/1819605871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac24003a90 0x7fac24003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:29:29.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.052+0000 7fac377fe700 1 --2- 172.21.15.114:0/1819605871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac24004870 0x7fac24004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:29:29.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.052+0000 7fac377fe700 1 --2- 172.21.15.114:0/1819605871 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac380d2610 0x7fac24005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:29:29.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.052+0000 7fac377fe700 1 -- 172.21.15.114:0/1819605871 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac380b64b0 con 0x7fac24004870 2023-10-18T12:29:29.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.052+0000 7fac377fe700 1 -- 172.21.15.114:0/1819605871 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac380b6750 con 0x7fac24003a90 2023-10-18T12:29:29.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.052+0000 7fac377fe700 1 -- 172.21.15.114:0/1819605871 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac2400ba30 con 0x7fac380d2610 2023-10-18T12:29:29.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.052+0000 7fac2f7fe700 1 --2- 172.21.15.114:0/1819605871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac24004870 0x7fac24004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:29:29.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.052+0000 7fac37fff700 1 --2- 172.21.15.114:0/1819605871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac24003a90 0x7fac24003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:29:29.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.052+0000 7fac3c8a5700 1 --2- 172.21.15.114:0/1819605871 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac380d2610 0x7fac24005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:29:29.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.052+0000 7fac2f7fe700 1 -- 172.21.15.114:0/1819605871 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac380d2610 msgr2=0x7fac24005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:29:29.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.052+0000 7fac2f7fe700 1 --2- 172.21.15.114:0/1819605871 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac380d2610 0x7fac24005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:29.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.052+0000 7fac2f7fe700 1 -- 172.21.15.114:0/1819605871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac24003a90 msgr2=0x7fac24003eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:29:29.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.052+0000 7fac2f7fe700 1 --2- 172.21.15.114:0/1819605871 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac24003a90 0x7fac24003eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:29.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.052+0000 7fac2f7fe700 1 -- 172.21.15.114:0/1819605871 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac240035d0 con 0x7fac24004870 2023-10-18T12:29:29.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.052+0000 7fac2f7fe700 1 --2- 172.21.15.114:0/1819605871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac24004870 0x7fac24004cf0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fac2000c320 tx=0x7fac240058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a98fda97a0737169 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:29:29.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.052+0000 7fac377fe700 1 -- 172.21.15.114:0/1819605871 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2000ce20 con 0x7fac24004870 2023-10-18T12:29:29.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.052+0000 7fac377fe700 1 -- 172.21.15.114:0/1819605871 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac20005980 con 0x7fac24004870 2023-10-18T12:29:29.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.052+0000 7fac377fe700 1 -- 172.21.15.114:0/1819605871 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac20005d30 con 0x7fac24004870 2023-10-18T12:29:29.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.056+0000 7fac3e308700 1 -- 172.21.15.114:0/1819605871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac24004870 msgr2=0x7fac24004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:29:29.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.056+0000 7fac3e308700 1 --2- 172.21.15.114:0/1819605871 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac24004870 0x7fac24004cf0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fac2000c320 tx=0x7fac240058a0 comp rx=0 tx=0).stop 2023-10-18T12:29:29.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.056+0000 7fac3c8a5700 1 -- 172.21.15.114:0/1819605871 reap_dead start 2023-10-18T12:29:29.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.056+0000 7fac3e308700 1 -- 172.21.15.114:0/1819605871 shutdown_connections 2023-10-18T12:29:29.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.056+0000 7fac3e308700 1 -- 172.21.15.114:0/1819605871 >> 172.21.15.114:0/1819605871 conn(0x7fac38069f20 msgr2=0x7fac3806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:29:29.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.056+0000 7fac3e308700 1 -- 172.21.15.114:0/1819605871 shutdown_connections 2023-10-18T12:29:29.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.056+0000 7fac3e308700 1 -- 172.21.15.114:0/1819605871 wait complete. 2023-10-18T12:29:29.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.056+0000 7fac3e308700 1 Processor -- start 2023-10-18T12:29:29.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.056+0000 7fac3e308700 1 -- start start 2023-10-18T12:29:29.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.060+0000 7fac3e308700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac24004870 0x7fac380b3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:29:29.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.060+0000 7fac3e308700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac381f5f90 0x7fac380d12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:29:29.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.060+0000 7fac3e308700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac381531f0 0x7fac381f2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:29:29.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.060+0000 7fac3e308700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac381f6550 con 0x7fac381531f0 2023-10-18T12:29:29.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.060+0000 7fac3e308700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac381f6830 con 0x7fac381f5f90 2023-10-18T12:29:29.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.060+0000 7fac3e308700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac381f6b10 con 0x7fac24004870 2023-10-18T12:29:29.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.060+0000 7fac3c8a5700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac381531f0 0x7fac381f2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:29:29.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.060+0000 7fac3c8a5700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac381531f0 0x7fac381f2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37616/0 (socket says 172.21.15.114:37616) 2023-10-18T12:29:29.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.060+0000 7fac3c8a5700 1 -- 172.21.15.114:0/1962195386 learned_addr learned my addr 172.21.15.114:0/1962195386 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:29:29.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.060+0000 7fac2f7fe700 1 --2- 172.21.15.114:0/1962195386 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac381f5f90 0x7fac380d12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:29:29.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.060+0000 7fac37fff700 1 --2- 172.21.15.114:0/1962195386 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac24004870 0x7fac380b3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:29:29.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.060+0000 7fac3c8a5700 1 -- 172.21.15.114:0/1962195386 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac24004870 msgr2=0x7fac380b3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:29:29.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.060+0000 7fac3c8a5700 1 --2- 172.21.15.114:0/1962195386 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac24004870 0x7fac380b3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:29.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.060+0000 7fac3c8a5700 1 -- 172.21.15.114:0/1962195386 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac381f5f90 msgr2=0x7fac380d12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:29:29.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.060+0000 7fac3c8a5700 1 --2- 172.21.15.114:0/1962195386 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac381f5f90 0x7fac380d12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:29.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.060+0000 7fac3c8a5700 1 -- 172.21.15.114:0/1962195386 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac381f6df0 con 0x7fac381531f0 2023-10-18T12:29:29.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.060+0000 7fac3c8a5700 1 --2- 172.21.15.114:0/1962195386 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac381531f0 0x7fac381f2ff0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fac380d3b60 tx=0x7fac30011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:29:29.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.060+0000 7fac357fa700 1 -- 172.21.15.114:0/1962195386 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3000e040 con 0x7fac381531f0 2023-10-18T12:29:29.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.060+0000 7fac357fa700 1 -- 172.21.15.114:0/1962195386 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac3000f040 con 0x7fac381531f0 2023-10-18T12:29:29.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.060+0000 7fac357fa700 1 -- 172.21.15.114:0/1962195386 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3000fc40 con 0x7fac381531f0 2023-10-18T12:29:29.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.060+0000 7fac3e308700 1 -- 172.21.15.114:0/1962195386 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac381f2ad0 con 0x7fac381531f0 2023-10-18T12:29:29.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.060+0000 7fac3e308700 1 -- 172.21.15.114:0/1962195386 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac380d17f0 con 0x7fac381531f0 2023-10-18T12:29:29.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.064+0000 7fac3e308700 1 -- 172.21.15.114:0/1962195386 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac38072e60 con 0x7fac381531f0 2023-10-18T12:29:29.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.064+0000 7fac357fa700 1 -- 172.21.15.114:0/1962195386 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fac30022460 con 0x7fac381531f0 2023-10-18T12:29:29.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.064+0000 7fac357fa700 1 --2- 172.21.15.114:0/1962195386 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fac180656f0 0x7fac18067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:29:29.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.068+0000 7fac357fa700 1 -- 172.21.15.114:0/1962195386 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 7063+0+0 (secure 0 0 0) 0x7fac30083790 con 0x7fac381531f0 2023-10-18T12:29:29.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.068+0000 7fac37fff700 1 --2- 172.21.15.114:0/1962195386 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fac180656f0 0x7fac18067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:29:29.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.068+0000 7fac37fff700 1 --2- 172.21.15.114:0/1962195386 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fac180656f0 0x7fac18067bb0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fac28009b10 tx=0x7fac28009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:29:29.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.072+0000 7fac357fa700 1 -- 172.21.15.114:0/1962195386 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fac30054850 con 0x7fac381531f0 2023-10-18T12:29:29.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.248+0000 7fac3e308700 1 -- 172.21.15.114:0/1962195386 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_osd_laggy_weight}] v 0) v1 -- 0x7fac380b72a0 con 0x7fac381531f0 2023-10-18T12:29:29.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.260+0000 7fac357fa700 1 -- 172.21.15.114:0/1962195386 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_osd_laggy_weight}]=0 v13)=0 v13) v1 ==== 125+0+0 (secure 0 0 0) 0x7fac300543e0 con 0x7fac381531f0 2023-10-18T12:29:29.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.264+0000 7fac3e308700 1 -- 172.21.15.114:0/1962195386 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fac180656f0 msgr2=0x7fac18067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:29:29.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.264+0000 7fac3e308700 1 --2- 172.21.15.114:0/1962195386 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fac180656f0 0x7fac18067bb0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fac28009b10 tx=0x7fac28009240 comp rx=0 tx=0).stop 2023-10-18T12:29:29.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.264+0000 7fac3e308700 1 -- 172.21.15.114:0/1962195386 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac381531f0 msgr2=0x7fac381f2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:29:29.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.264+0000 7fac3e308700 1 --2- 172.21.15.114:0/1962195386 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac381531f0 0x7fac381f2ff0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fac380d3b60 tx=0x7fac30011ed0 comp rx=0 tx=0).stop 2023-10-18T12:29:29.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.264+0000 7fac3e308700 1 -- 172.21.15.114:0/1962195386 shutdown_connections 2023-10-18T12:29:29.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.264+0000 7fac3e308700 1 --2- 172.21.15.114:0/1962195386 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fac180656f0 0x7fac18067bb0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:29.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.264+0000 7fac3e308700 1 --2- 172.21.15.114:0/1962195386 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac381531f0 0x7fac381f2ff0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:29.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.264+0000 7fac3e308700 1 --2- 172.21.15.114:0/1962195386 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac381f5f90 0x7fac380d12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:29.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.264+0000 7fac3e308700 1 --2- 172.21.15.114:0/1962195386 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fac24004870 0x7fac380b3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:29.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.264+0000 7fac3e308700 1 -- 172.21.15.114:0/1962195386 >> 172.21.15.114:0/1962195386 conn(0x7fac38069f20 msgr2=0x7fac380b47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:29:29.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.264+0000 7fac3e308700 1 -- 172.21.15.114:0/1962195386 shutdown_connections 2023-10-18T12:29:29.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.264+0000 7fac3e308700 1 -- 172.21.15.114:0/1962195386 wait complete. 2023-10-18T12:29:29.295 DEBUG:teuthology.orchestra.run.smithi114:> sudo daemon-helper kill ceph --cluster ceph -w 2023-10-18T12:29:29.302 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T12:29:29.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.456+0000 7f2018f48700 1 Processor -- start 2023-10-18T12:29:29.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.460+0000 7f2018f48700 1 -- start start 2023-10-18T12:29:29.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.460+0000 7f2018f48700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f201406e6d0 0x7f2014071ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:29:29.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.460+0000 7f2018f48700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f20140cd320 0x7f2014070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:29:29.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.460+0000 7f2018f48700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20140c9da0 con 0x7f20140ced50 2023-10-18T12:29:29.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.460+0000 7f2018f48700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2014161540 con 0x7f201406e6d0 2023-10-18T12:29:29.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.460+0000 7f2018f48700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2014071030 con 0x7f20140cd320 2023-10-18T12:29:29.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.460+0000 7f200affd700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f201406e6d0 0x7f2014071ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:29:29.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.460+0000 7f20137fe700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f20140ced50 0x7f201406dfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:49330/0 (socket says 172.21.15.114:49330) 2023-10-18T12:29:29.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.460+0000 7f20137fe700 1 -- 172.21.15.114:0/2352607360 learned_addr learned my addr 172.21.15.114:0/2352607360 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:29:29.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.460+0000 7f2013fff700 1 --2- 172.21.15.114:0/2352607360 >> v2:172.21.15.172:3300/0 conn(0x7f20140cd320 0x7f2014070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:29:29.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.464+0000 7f200affd700 1 -- 172.21.15.114:0/2352607360 >> v2:172.21.15.172:3300/0 conn(0x7f20140cd320 msgr2=0x7f2014070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:29:29.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.464+0000 7f200affd700 1 --2- 172.21.15.114:0/2352607360 >> v2:172.21.15.172:3300/0 conn(0x7f20140cd320 0x7f2014070af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:29.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.464+0000 7f200affd700 1 -- 172.21.15.114:0/2352607360 >> v1:172.21.15.114:6789/0 conn(0x7f20140ced50 legacy=0x7f201406dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:29:29.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.464+0000 7f200affd700 1 -- 172.21.15.114:0/2352607360 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20140cf130 con 0x7f201406e6d0 2023-10-18T12:29:29.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.464+0000 7f200affd700 1 --2- 172.21.15.114:0/2352607360 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f201406e6d0 0x7f2014071ce0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f201406fbb0 tx=0x7f1ffc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b3b14119a5a6762 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:29:29.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.464+0000 7f2012ffd700 1 -- 172.21.15.114:0/2352607360 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc00e070 con 0x7f201406e6d0 2023-10-18T12:29:29.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.464+0000 7f2012ffd700 1 -- 172.21.15.114:0/2352607360 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ffc00bb90 con 0x7f201406e6d0 2023-10-18T12:29:29.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.464+0000 7f2012ffd700 1 -- 172.21.15.114:0/2352607360 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc012430 con 0x7f201406e6d0 2023-10-18T12:29:29.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.464+0000 7f2018f48700 1 -- 172.21.15.114:0/2352607360 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f201406e6d0 msgr2=0x7f2014071ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:29:29.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.464+0000 7f2018f48700 1 --2- 172.21.15.114:0/2352607360 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f201406e6d0 0x7f2014071ce0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f201406fbb0 tx=0x7f1ffc00b330 comp rx=0 tx=0).stop 2023-10-18T12:29:29.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.464+0000 7f2018f48700 1 -- 172.21.15.114:0/2352607360 shutdown_connections 2023-10-18T12:29:29.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.464+0000 7f2018f48700 1 --2- 172.21.15.114:0/2352607360 >> v2:172.21.15.172:3300/0 conn(0x7f20140cd320 0x7f2014070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:29.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.464+0000 7f2018f48700 1 --2- 172.21.15.114:0/2352607360 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f201406e6d0 0x7f2014071ce0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:29.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.464+0000 7f2018f48700 1 -- 172.21.15.114:0/2352607360 >> 172.21.15.114:0/2352607360 conn(0x7f20140cc1d0 msgr2=0x7f20140cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:29:29.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.464+0000 7f2018f48700 1 -- 172.21.15.114:0/2352607360 shutdown_connections 2023-10-18T12:29:29.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.464+0000 7f2018f48700 1 -- 172.21.15.114:0/2352607360 wait complete. 2023-10-18T12:29:29.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.468+0000 7f2018f48700 1 Processor -- start 2023-10-18T12:29:29.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.468+0000 7f2018f48700 1 -- start start 2023-10-18T12:29:29.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.472+0000 7f2018f48700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f201406e6d0 0x7f201415ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:29:29.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.472+0000 7f2018f48700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20140cd320 0x7f20140c6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:29:29.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.472+0000 7f2018f48700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f20140ced50 0x7f20140c5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:29:29.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.472+0000 7f2018f48700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20140c3560 con 0x7f201406e6d0 2023-10-18T12:29:29.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.472+0000 7f2018f48700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20140c7830 con 0x7f20140cd320 2023-10-18T12:29:29.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.472+0000 7f2018f48700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20140c7270 con 0x7f20140ced50 2023-10-18T12:29:29.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.472+0000 7f20137fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f201406e6d0 0x7f201415ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:29:29.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.472+0000 7f20137fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f201406e6d0 0x7f201415ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37636/0 (socket says 172.21.15.114:37636) 2023-10-18T12:29:29.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.472+0000 7f20137fe700 1 -- 172.21.15.114:0/3592164655 learned_addr learned my addr 172.21.15.114:0/3592164655 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:29:29.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.472+0000 7f200affd700 1 --2- 172.21.15.114:0/3592164655 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20140cd320 0x7f20140c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:29:29.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.472+0000 7f2013fff700 1 --2- 172.21.15.114:0/3592164655 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f20140ced50 0x7f20140c5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:29:29.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.472+0000 7f20137fe700 1 -- 172.21.15.114:0/3592164655 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f20140ced50 msgr2=0x7f20140c5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:29:29.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.472+0000 7f20137fe700 1 --2- 172.21.15.114:0/3592164655 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f20140ced50 0x7f20140c5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:29.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.472+0000 7f20137fe700 1 -- 172.21.15.114:0/3592164655 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20140cd320 msgr2=0x7f20140c6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:29:29.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.472+0000 7f20137fe700 1 --2- 172.21.15.114:0/3592164655 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20140cd320 0x7f20140c6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:29.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.472+0000 7f20137fe700 1 -- 172.21.15.114:0/3592164655 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ffc009a70 con 0x7f201406e6d0 2023-10-18T12:29:29.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.472+0000 7f200affd700 1 --2- 172.21.15.114:0/3592164655 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20140cd320 0x7f20140c6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:29:29.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.472+0000 7f20137fe700 1 --2- 172.21.15.114:0/3592164655 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f201406e6d0 0x7f201415ddd0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f200400c410 tx=0x7f200400c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:29:29.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.472+0000 7f2010ff9700 1 -- 172.21.15.114:0/3592164655 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2004005d90 con 0x7f201406e6d0 2023-10-18T12:29:29.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.472+0000 7f2010ff9700 1 -- 172.21.15.114:0/3592164655 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20040070d0 con 0x7f201406e6d0 2023-10-18T12:29:29.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.472+0000 7f2018f48700 1 -- 172.21.15.114:0/3592164655 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20140c7550 con 0x7f201406e6d0 2023-10-18T12:29:29.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.472+0000 7f2010ff9700 1 -- 172.21.15.114:0/3592164655 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2004007460 con 0x7f201406e6d0 2023-10-18T12:29:29.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.472+0000 7f2018f48700 1 -- 172.21.15.114:0/3592164655 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20141f77f0 con 0x7f201406e6d0 2023-10-18T12:29:29.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.472+0000 7f2018f48700 1 -- 172.21.15.114:0/3592164655 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2014072e60 con 0x7f201406e6d0 2023-10-18T12:29:29.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.476+0000 7f2010ff9700 1 -- 172.21.15.114:0/3592164655 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f20040075c0 con 0x7f201406e6d0 2023-10-18T12:29:29.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.476+0000 7f2010ff9700 1 --2- 172.21.15.114:0/3592164655 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1ff40656f0 0x7f1ff4067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:29:29.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.476+0000 7f2010ff9700 1 -- 172.21.15.114:0/3592164655 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 7063+0+0 (secure 0 0 0) 0x7f20040826d0 con 0x7f201406e6d0 2023-10-18T12:29:29.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.476+0000 7f200affd700 1 --2- 172.21.15.114:0/3592164655 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1ff40656f0 0x7f1ff4067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:29:29.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.476+0000 7f200affd700 1 --2- 172.21.15.114:0/3592164655 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1ff40656f0 0x7f1ff4067bb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f20140cf720 tx=0x7f1ffc011000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:29:29.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.480+0000 7f2010ff9700 1 -- 172.21.15.114:0/3592164655 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f200404fd00 con 0x7f201406e6d0 2023-10-18T12:29:29.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.500+0000 7fba397ca700 1 Processor -- start 2023-10-18T12:29:29.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.504+0000 7fba397ca700 1 -- start start 2023-10-18T12:29:29.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.504+0000 7fba397ca700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fba3415ac20 0x7fba340cf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:29:29.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.504+0000 7fba397ca700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fba340b1340 0x7fba340b17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:29:29.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.504+0000 7fba397ca700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fba340ae760 0x7fba340aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:29:29.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.504+0000 7fba397ca700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba340cdf20 con 0x7fba340b1340 2023-10-18T12:29:29.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.504+0000 7fba397ca700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba340b1cf0 con 0x7fba3415ac20 2023-10-18T12:29:29.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.504+0000 7fba397ca700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba340cf6e0 con 0x7fba340ae760 2023-10-18T12:29:29.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.504+0000 7fba337fe700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fba340b1340 0x7fba340b17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:29:29.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.504+0000 7fba337fe700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fba340b1340 0x7fba340b17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37648/0 (socket says 172.21.15.114:37648) 2023-10-18T12:29:29.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.504+0000 7fba337fe700 1 -- 172.21.15.114:0/2978298645 learned_addr learned my addr 172.21.15.114:0/2978298645 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:29:29.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.504+0000 7fba38fc9700 1 --2- 172.21.15.114:0/2978298645 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fba340ae760 0x7fba340aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:29:29.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.504+0000 7fba33fff700 1 --2- 172.21.15.114:0/2978298645 >> v2:172.21.15.172:3300/0 conn(0x7fba3415ac20 0x7fba340cf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:29:29.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.508+0000 7fba337fe700 1 -- 172.21.15.114:0/2978298645 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fba340ae760 msgr2=0x7fba340aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:29:29.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.508+0000 7fba337fe700 1 --2- 172.21.15.114:0/2978298645 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fba340ae760 0x7fba340aebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:29.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.508+0000 7fba337fe700 1 -- 172.21.15.114:0/2978298645 >> v2:172.21.15.172:3300/0 conn(0x7fba3415ac20 msgr2=0x7fba340cf1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:29:29.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.508+0000 7fba337fe700 1 --2- 172.21.15.114:0/2978298645 >> v2:172.21.15.172:3300/0 conn(0x7fba3415ac20 0x7fba340cf1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:29.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.508+0000 7fba337fe700 1 -- 172.21.15.114:0/2978298645 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba340af110 con 0x7fba340b1340 2023-10-18T12:29:29.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.508+0000 7fba38fc9700 1 --2- 172.21.15.114:0/2978298645 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fba340ae760 0x7fba340aebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:29:29.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.508+0000 7fba337fe700 1 --2- 172.21.15.114:0/2978298645 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba340b1340 0x7fba340b17b0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fba3406f220 tx=0x7fba28009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de59834914120450 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:29:29.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.508+0000 7fba32ffd700 1 -- 172.21.15.114:0/2978298645 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2800ba20 con 0x7fba340b1340 2023-10-18T12:29:29.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.508+0000 7fba32ffd700 1 -- 172.21.15.114:0/2978298645 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba2800bb80 con 0x7fba340b1340 2023-10-18T12:29:29.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.508+0000 7fba32ffd700 1 -- 172.21.15.114:0/2978298645 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba28009e60 con 0x7fba340b1340 2023-10-18T12:29:29.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.508+0000 7fba397ca700 1 -- 172.21.15.114:0/2978298645 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba340b1340 msgr2=0x7fba340b17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:29:29.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.508+0000 7fba397ca700 1 --2- 172.21.15.114:0/2978298645 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba340b1340 0x7fba340b17b0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fba3406f220 tx=0x7fba28009c20 comp rx=0 tx=0).stop 2023-10-18T12:29:29.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.508+0000 7fba397ca700 1 -- 172.21.15.114:0/2978298645 shutdown_connections 2023-10-18T12:29:29.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.508+0000 7fba397ca700 1 --2- 172.21.15.114:0/2978298645 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fba340ae760 0x7fba340aebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:29.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.508+0000 7fba397ca700 1 --2- 172.21.15.114:0/2978298645 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba340b1340 0x7fba340b17b0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:29.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.508+0000 7fba397ca700 1 --2- 172.21.15.114:0/2978298645 >> v2:172.21.15.172:3300/0 conn(0x7fba3415ac20 0x7fba340cf1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:29.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.508+0000 7fba397ca700 1 -- 172.21.15.114:0/2978298645 >> 172.21.15.114:0/2978298645 conn(0x7fba340cc340 msgr2=0x7fba340cc750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:29:29.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.508+0000 7fba397ca700 1 -- 172.21.15.114:0/2978298645 shutdown_connections 2023-10-18T12:29:29.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.508+0000 7fba397ca700 1 -- 172.21.15.114:0/2978298645 wait complete. 2023-10-18T12:29:29.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.512+0000 7fba397ca700 1 Processor -- start 2023-10-18T12:29:29.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.512+0000 7fba397ca700 1 -- start start 2023-10-18T12:29:29.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.512+0000 7fba397ca700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fba340ae760 0x7fba341542d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:29:29.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.512+0000 7fba397ca700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba3415ac20 0x7fba340c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:29:29.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.512+0000 7fba397ca700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba340c4240 0x7fba340c46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:29:29.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.512+0000 7fba397ca700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba34154810 con 0x7fba3415ac20 2023-10-18T12:29:29.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.512+0000 7fba397ca700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba340c62c0 con 0x7fba340c4240 2023-10-18T12:29:29.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.512+0000 7fba397ca700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba340c4ce0 con 0x7fba340ae760 2023-10-18T12:29:29.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.512+0000 7fba337fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba3415ac20 0x7fba340c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:29:29.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.512+0000 7fba337fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba3415ac20 0x7fba340c5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37658/0 (socket says 172.21.15.114:37658) 2023-10-18T12:29:29.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.512+0000 7fba337fe700 1 -- 172.21.15.114:0/2059476837 learned_addr learned my addr 172.21.15.114:0/2059476837 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:29:29.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.512+0000 7fba38fc9700 1 --2- 172.21.15.114:0/2059476837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba340c4240 0x7fba340c46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:29:29.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.512+0000 7fba33fff700 1 --2- 172.21.15.114:0/2059476837 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fba340ae760 0x7fba341542d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:29:29.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.512+0000 7fba337fe700 1 -- 172.21.15.114:0/2059476837 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fba340ae760 msgr2=0x7fba341542d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:29:29.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.512+0000 7fba337fe700 1 --2- 172.21.15.114:0/2059476837 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fba340ae760 0x7fba341542d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:29.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.512+0000 7fba337fe700 1 -- 172.21.15.114:0/2059476837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba340c4240 msgr2=0x7fba340c46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:29:29.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.512+0000 7fba337fe700 1 --2- 172.21.15.114:0/2059476837 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba340c4240 0x7fba340c46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:29.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.512+0000 7fba337fe700 1 -- 172.21.15.114:0/2059476837 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba28009570 con 0x7fba3415ac20 2023-10-18T12:29:29.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.512+0000 7fba337fe700 1 --2- 172.21.15.114:0/2059476837 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fba3415ac20 0x7fba340c5d80 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fba28013000 tx=0x7fba28004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:29:29.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.512+0000 7fba30ff9700 1 -- 172.21.15.114:0/2059476837 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba280044d0 con 0x7fba3415ac20 2023-10-18T12:29:29.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.516+0000 7fba30ff9700 1 -- 172.21.15.114:0/2059476837 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba2801f070 con 0x7fba3415ac20 2023-10-18T12:29:29.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.516+0000 7fba30ff9700 1 -- 172.21.15.114:0/2059476837 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba28003900 con 0x7fba3415ac20 2023-10-18T12:29:29.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.516+0000 7fba397ca700 1 -- 172.21.15.114:0/2059476837 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba340c4fc0 con 0x7fba3415ac20 2023-10-18T12:29:29.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.516+0000 7fba397ca700 1 -- 172.21.15.114:0/2059476837 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba340c5580 con 0x7fba3415ac20 2023-10-18T12:29:29.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.516+0000 7fba397ca700 1 -- 172.21.15.114:0/2059476837 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fba34071ff0 con 0x7fba3415ac20 2023-10-18T12:29:29.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.516+0000 7fba30ff9700 1 -- 172.21.15.114:0/2059476837 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fba28003a60 con 0x7fba3415ac20 2023-10-18T12:29:29.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.520+0000 7fba30ff9700 1 --2- 172.21.15.114:0/2059476837 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fba200656f0 0x7fba20067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:29:29.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.520+0000 7fba30ff9700 1 -- 172.21.15.114:0/2059476837 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 7063+0+0 (secure 0 0 0) 0x7fba28021070 con 0x7fba3415ac20 2023-10-18T12:29:29.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.520+0000 7fba30ff9700 1 -- 172.21.15.114:0/2059476837 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+838 (secure 0 0 0) 0x7fba28084b00 con 0x7fba3415ac20 2023-10-18T12:29:29.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.520+0000 7fba33fff700 1 --2- 172.21.15.114:0/2059476837 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fba200656f0 0x7fba20067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:29:29.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.520+0000 7fba397ca700 1 -- 172.21.15.114:0/2059476837 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7fba3415a450 con 0x7fba3415ac20 2023-10-18T12:29:29.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.520+0000 7fba30ff9700 1 -- 172.21.15.114:0/2059476837 <== mon.0 v2:172.21.15.114:3300/0 7 ==== log(1 entries from seq 516 at 2023-10-18T12:29:28.500115+0000) v1 ==== 350+0+0 (secure 0 0 0) 0x7fba28059b30 con 0x7fba3415ac20 2023-10-18T12:29:29.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.520+0000 7fba33fff700 1 --2- 172.21.15.114:0/2059476837 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fba200656f0 0x7fba20067bb0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fba2400b950 tx=0x7fba24008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:29:29.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.672+0000 7fba30ff9700 1 -- 172.21.15.114:0/2059476837 <== mon.0 v2:172.21.15.114:3300/0 8 ==== log(3 entries from seq 517 at 2023-10-18T12:29:28.660472+0000) v1 ==== 897+0+0 (secure 0 0 0) 0x7fba2805da80 con 0x7fba3415ac20 2023-10-18T12:29:29.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.728+0000 7f2018f48700 1 -- 172.21.15.114:0/3592164655 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f201406eca0 con 0x7f201406e6d0 2023-10-18T12:29:29.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.732+0000 7f2010ff9700 1 -- 172.21.15.114:0/3592164655 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4889 (secure 0 0 0) 0x7f2004017090 con 0x7f201406e6d0 2023-10-18T12:29:29.738 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:29:29.738 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2034957068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2034957068},{"type":"v1","addr":"172.21.15.172:6836","nonce":2034957068}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5039,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4215710360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4215710360},{"type":"v1","addr":"172.21.15.172:6837","nonce":4215710360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2387835210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2387835210},{"type":"v1","addr":"172.21.15.114:6833","nonce":2387835210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T12:21:14.159069+0000","modified":"2023-10-18T12:29:23.762500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":126,"addr":"172.21.15.114:6835/1284474820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1284474820},{"type":"v1","addr":"172.21.15.114:6835","nonce":1284474820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-18T12:29:29.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.732+0000 7f2018f48700 1 -- 172.21.15.114:0/3592164655 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1ff40656f0 msgr2=0x7f1ff4067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:29:29.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.732+0000 7f2018f48700 1 --2- 172.21.15.114:0/3592164655 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1ff40656f0 0x7f1ff4067bb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f20140cf720 tx=0x7f1ffc011000 comp rx=0 tx=0).stop 2023-10-18T12:29:29.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.732+0000 7f2018f48700 1 -- 172.21.15.114:0/3592164655 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f201406e6d0 msgr2=0x7f201415ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:29:29.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.732+0000 7f2018f48700 1 --2- 172.21.15.114:0/3592164655 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f201406e6d0 0x7f201415ddd0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f200400c410 tx=0x7f200400c7d0 comp rx=0 tx=0).stop 2023-10-18T12:29:29.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.732+0000 7f2018f48700 1 -- 172.21.15.114:0/3592164655 shutdown_connections 2023-10-18T12:29:29.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.732+0000 7f2018f48700 1 --2- 172.21.15.114:0/3592164655 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1ff40656f0 0x7f1ff4067bb0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:29.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.732+0000 7f2018f48700 1 --2- 172.21.15.114:0/3592164655 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f20140ced50 0x7f20140c5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:29.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.732+0000 7f2018f48700 1 --2- 172.21.15.114:0/3592164655 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20140cd320 0x7f20140c6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:29.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.732+0000 7f2018f48700 1 --2- 172.21.15.114:0/3592164655 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f201406e6d0 0x7f201415ddd0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:29:29.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.732+0000 7f2018f48700 1 -- 172.21.15.114:0/3592164655 >> 172.21.15.114:0/3592164655 conn(0x7f20140cc1d0 msgr2=0x7f20140af920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:29:29.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.732+0000 7f2018f48700 1 -- 172.21.15.114:0/3592164655 shutdown_connections 2023-10-18T12:29:29.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:29.732+0000 7f2018f48700 1 -- 172.21.15.114:0/3592164655 wait complete. 2023-10-18T12:29:29.743 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 20 2023-10-18T12:29:29.760 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-10-18T12:29:29.949 INFO:teuthology.orchestra.run.smithi114.stdout:[{"id":5162,"entity":{"name":{"type":"client","num":5162},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":989916161}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":485.96463191999999,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.32536505751098954,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":3,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5162 v1:192.168.0.1:0/989916161","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi172","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}}] 2023-10-18T12:29:29.949 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "1", "hostname": "smithi172", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 989916161, "type": "v1" }, "name": { "num": 5162, "type": "client" } }, "id": 5162, "inst": "client.5162 v1:192.168.0.1:0/989916161", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 3, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.32536505751098954 }, "state": "open", "uptime": 485.96463192 } ] 2023-10-18T12:29:30.050 DEBUG:tasks.ceph_test_case:No log hits yet, waiting... 2023-10-18T12:29:30.697 INFO:teuthology.orchestra.run.smithi114.stdout: cluster: 2023-10-18T12:29:30.697 INFO:teuthology.orchestra.run.smithi114.stdout: id: 240ea340-5d3d-4f52-a4bc-af075aca3deb 2023-10-18T12:29:30.697 INFO:teuthology.orchestra.run.smithi114.stdout: health: HEALTH_WARN 2023-10-18T12:29:30.698 INFO:teuthology.orchestra.run.smithi114.stdout: 1 osds down 2023-10-18T12:29:30.698 INFO:teuthology.orchestra.run.smithi114.stdout: Degraded data redundancy: 8/48 objects degraded (16.667%), 3 pgs degraded 2023-10-18T12:29:30.698 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:29:30.698 INFO:teuthology.orchestra.run.smithi114.stdout: services: 2023-10-18T12:29:30.698 INFO:teuthology.orchestra.run.smithi114.stdout: mon: 3 daemons, quorum a,b,c (age 10m) 2023-10-18T12:29:30.699 INFO:teuthology.orchestra.run.smithi114.stdout: mgr: x(active, since 10m), standbys: y 2023-10-18T12:29:30.699 INFO:teuthology.orchestra.run.smithi114.stdout: mds: 1/1 daemons up, 3 standby 2023-10-18T12:29:30.699 INFO:teuthology.orchestra.run.smithi114.stdout: osd: 8 osds: 7 up (since 11s), 8 in (since 10m); 10 remapped pgs 2023-10-18T12:29:30.699 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:29:30.699 INFO:teuthology.orchestra.run.smithi114.stdout: data: 2023-10-18T12:29:30.700 INFO:teuthology.orchestra.run.smithi114.stdout: volumes: 1/1 healthy 2023-10-18T12:29:30.700 INFO:teuthology.orchestra.run.smithi114.stdout: pools: 4 pools, 105 pgs 2023-10-18T12:29:30.700 INFO:teuthology.orchestra.run.smithi114.stdout: objects: 24 objects, 580 KiB 2023-10-18T12:29:30.700 INFO:teuthology.orchestra.run.smithi114.stdout: usage: 217 MiB used, 720 GiB / 720 GiB avail 2023-10-18T12:29:30.700 INFO:teuthology.orchestra.run.smithi114.stdout: pgs: 8/48 objects degraded (16.667%) 2023-10-18T12:29:30.701 INFO:teuthology.orchestra.run.smithi114.stdout: 1/48 objects misplaced (2.083%) 2023-10-18T12:29:30.701 INFO:teuthology.orchestra.run.smithi114.stdout: 69 active+clean 2023-10-18T12:29:30.701 INFO:teuthology.orchestra.run.smithi114.stdout: 23 active+undersized 2023-10-18T12:29:30.701 INFO:teuthology.orchestra.run.smithi114.stdout: 10 active+clean+remapped 2023-10-18T12:29:30.701 INFO:teuthology.orchestra.run.smithi114.stdout: 3 active+undersized+degraded 2023-10-18T12:29:30.702 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:29:30.702 INFO:teuthology.orchestra.run.smithi114.stdout: io: 2023-10-18T12:29:30.702 INFO:teuthology.orchestra.run.smithi114.stdout: client: 317 B/s wr, 0 op/s rd, 0 op/s wr 2023-10-18T12:29:30.702 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:29:30.702 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:29:30.703 INFO:teuthology.orchestra.run.smithi114.stdout:2023-10-18T12:29:29.655719+0000 mon.a [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-10-18T12:29:30.703 INFO:teuthology.orchestra.run.smithi114.stdout:2023-10-18T12:29:29.664660+0000 mon.a [INF] osd.0 [v2:172.21.15.114:6816/1953670272,v1:172.21.15.114:6817/1953670272] boot 2023-10-18T12:29:30.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:30.688+0000 7fba30ff9700 1 -- 172.21.15.114:0/2059476837 <== mon.0 v2:172.21.15.114:3300/0 9 ==== log(2 entries from seq 522 at 2023-10-18T12:29:29.655719+0000) v1 ==== 429+0+0 (secure 0 0 0) 0x7fba28053eb0 con 0x7fba3415ac20 2023-10-18T12:29:32.704 INFO:teuthology.orchestra.run.smithi114.stdout:2023-10-18T12:29:31.695152+0000 mon.a [WRN] Health check update: Degraded data redundancy: 4/48 objects degraded (8.333%), 1 pg degraded (PG_DEGRADED) 2023-10-18T12:29:32.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:32.696+0000 7fba30ff9700 1 -- 172.21.15.114:0/2059476837 <== mon.0 v2:172.21.15.114:3300/0 10 ==== log(1 entries from seq 528 at 2023-10-18T12:29:31.695152+0000) v1 ==== 276+0+0 (secure 0 0 0) 0x7fba28082980 con 0x7fba3415ac20 2023-10-18T12:29:33.832 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:29:33.841 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:29:35.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:29:35.760+0000 7fba30ff9700 1 -- 172.21.15.114:0/2059476837 <== mon.0 v2:172.21.15.114:3300/0 11 ==== log(2 entries from seq 529 at 2023-10-18T12:29:35.707092+0000) v1 ==== 436+0+0 (secure 0 0 0) 0x7fba28052480 con 0x7fba3415ac20 2023-10-18T12:29:35.767 INFO:teuthology.orchestra.run.smithi114.stdout:2023-10-18T12:29:35.707092+0000 mon.a [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4/48 objects degraded (8.333%), 1 pg degraded) 2023-10-18T12:29:35.767 INFO:teuthology.orchestra.run.smithi114.stdout:2023-10-18T12:29:35.707140+0000 mon.a [INF] Cluster is now healthy 2023-10-18T12:30:00.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:00.731+0000 7fba30ff9700 1 -- 172.21.15.114:0/2059476837 <== mon.0 v2:172.21.15.114:3300/0 12 ==== log(1 entries from seq 531 at 2023-10-18T12:30:00.000152+0000) v1 ==== 187+0+0 (secure 0 0 0) 0x7fba28055260 con 0x7fba3415ac20 2023-10-18T12:30:00.741 INFO:teuthology.orchestra.run.smithi114.stdout:2023-10-18T12:30:00.000152+0000 mon.a [INF] overall HEALTH_OK 2023-10-18T12:30:03.952 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:30:03.960 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:30:05.079 ERROR:tasks.ceph_test_case:Log output: cluster: id: 240ea340-5d3d-4f52-a4bc-af075aca3deb health: HEALTH_WARN 1 osds down Degraded data redundancy: 8/48 objects degraded (16.667%), 3 pgs degraded services: mon: 3 daemons, quorum a,b,c (age 10m) mgr: x(active, since 10m), standbys: y mds: 1/1 daemons up, 3 standby osd: 8 osds: 7 up (since 11s), 8 in (since 10m); 10 remapped pgs data: volumes: 1/1 healthy pools: 4 pools, 105 pgs objects: 24 objects, 580 KiB usage: 217 MiB used, 720 GiB / 720 GiB avail pgs: 8/48 objects degraded (16.667%) 1/48 objects misplaced (2.083%) 69 active+clean 23 active+undersized 10 active+clean+remapped 3 active+undersized+degraded io: client: 317 B/s wr, 0 op/s rd, 0 op/s wr 2023-10-18T12:29:29.655719+0000 mon.a [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2023-10-18T12:29:29.664660+0000 mon.a [INF] osd.0 [v2:172.21.15.114:6816/1953670272,v1:172.21.15.114:6817/1953670272] boot 2023-10-18T12:29:31.695152+0000 mon.a [WRN] Health check update: Degraded data redundancy: 4/48 objects degraded (8.333%), 1 pg degraded (PG_DEGRADED) 2023-10-18T12:29:35.707092+0000 mon.a [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4/48 objects degraded (8.333%), 1 pg degraded) 2023-10-18T12:29:35.707140+0000 mon.a [INF] Cluster is now healthy 2023-10-18T12:30:00.000152+0000 mon.a [INF] overall HEALTH_OK 2023-10-18T12:30:05.080 DEBUG:tasks.cephfs.test_client_recovery:Expected log message found: 'Health check cleared: MDS_CLIENTS_LAGGY', retrying 2023-10-18T12:30:06.080 DEBUG:teuthology.orchestra.run.smithi114:> sudo daemon-helper kill ceph --cluster ceph -w 2023-10-18T12:30:06.089 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T12:30:06.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.255+0000 7f801b590700 1 Processor -- start 2023-10-18T12:30:06.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.255+0000 7f801b590700 1 -- start start 2023-10-18T12:30:06.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.255+0000 7f801b590700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f80141594d0 0x7f80140c4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:30:06.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.255+0000 7f801b590700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f80140cd870 0x7f80140cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:30:06.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.255+0000 7f801b590700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80140c4fc0 con 0x7f801415a0e0 2023-10-18T12:30:06.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.255+0000 7f801b590700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f801415a4c0 con 0x7f80141594d0 2023-10-18T12:30:06.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.255+0000 7f801b590700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80140ce240 con 0x7f80140cd870 2023-10-18T12:30:06.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.255+0000 7f8019d8d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f80141594d0 0x7f80140c4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:30:06.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.255+0000 7f8019d8d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f80141594d0 0x7f80140c4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58496/0 (socket says 172.21.15.114:58496) 2023-10-18T12:30:06.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.255+0000 7f8019d8d700 1 -- 172.21.15.114:0/4185667527 learned_addr learned my addr 172.21.15.114:0/4185667527 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:30:06.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.255+0000 7f801ad8f700 1 --2- 172.21.15.114:0/4185667527 >> v2:172.21.15.172:3300/0 conn(0x7f80140cd870 0x7f80140cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:30:06.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.255+0000 7f8019d8d700 1 -- 172.21.15.114:0/4185667527 >> v2:172.21.15.172:3300/0 conn(0x7f80140cd870 msgr2=0x7f80140cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:30:06.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.255+0000 7f8019d8d700 1 --2- 172.21.15.114:0/4185667527 >> v2:172.21.15.172:3300/0 conn(0x7f80140cd870 0x7f80140cdd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:30:06.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.255+0000 7f8019d8d700 1 -- 172.21.15.114:0/4185667527 >> v1:172.21.15.172:6789/0 conn(0x7f801415a0e0 legacy=0x7f8014060fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:30:06.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.255+0000 7f8019d8d700 1 -- 172.21.15.114:0/4185667527 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80140c52a0 con 0x7f80141594d0 2023-10-18T12:30:06.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.259+0000 7f8019d8d700 1 --2- 172.21.15.114:0/4185667527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80141594d0 0x7f80140c4870 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f80140c9480 tx=0x7f8004009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38fd93c83bed0f37 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:30:06.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.259+0000 7f801958c700 1 -- 172.21.15.114:0/4185667527 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800400b8a0 con 0x7f80141594d0 2023-10-18T12:30:06.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.259+0000 7f801958c700 1 -- 172.21.15.114:0/4185667527 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800400ba00 con 0x7f80141594d0 2023-10-18T12:30:06.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.259+0000 7f801958c700 1 -- 172.21.15.114:0/4185667527 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800400bd90 con 0x7f80141594d0 2023-10-18T12:30:06.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.259+0000 7f801b590700 1 -- 172.21.15.114:0/4185667527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80141594d0 msgr2=0x7f80140c4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:30:06.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.259+0000 7f801b590700 1 --2- 172.21.15.114:0/4185667527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80141594d0 0x7f80140c4870 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f80140c9480 tx=0x7f8004009bf0 comp rx=0 tx=0).stop 2023-10-18T12:30:06.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.259+0000 7f801b590700 1 -- 172.21.15.114:0/4185667527 shutdown_connections 2023-10-18T12:30:06.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.259+0000 7f801b590700 1 --2- 172.21.15.114:0/4185667527 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f80141594d0 0x7f80140c4870 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:30:06.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.259+0000 7f801b590700 1 --2- 172.21.15.114:0/4185667527 >> v2:172.21.15.172:3300/0 conn(0x7f80140cd870 0x7f80140cdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:30:06.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.259+0000 7f801b590700 1 -- 172.21.15.114:0/4185667527 >> 172.21.15.114:0/4185667527 conn(0x7f80140cb920 msgr2=0x7f80140cbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:30:06.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.259+0000 7f801b590700 1 -- 172.21.15.114:0/4185667527 shutdown_connections 2023-10-18T12:30:06.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.259+0000 7f801b590700 1 -- 172.21.15.114:0/4185667527 wait complete. 2023-10-18T12:30:06.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.263+0000 7f801b590700 1 Processor -- start 2023-10-18T12:30:06.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.263+0000 7f801b590700 1 -- start start 2023-10-18T12:30:06.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.263+0000 7f801b590700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80140cd870 0x7f80140c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:30:06.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.263+0000 7f801b590700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f80141594d0 0x7f80140c6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:30:06.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.263+0000 7f801b590700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f801415a0e0 0x7f80141f1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:30:06.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.263+0000 7f801b590700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801406b540 con 0x7f801415a0e0 2023-10-18T12:30:06.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.263+0000 7f801b590700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801406bd50 con 0x7f80140cd870 2023-10-18T12:30:06.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.263+0000 7f801b590700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80140c8c90 con 0x7f80141594d0 2023-10-18T12:30:06.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.263+0000 7f801ad8f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f801415a0e0 0x7f80141f1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:30:06.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.263+0000 7f801ad8f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f801415a0e0 0x7f80141f1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58508/0 (socket says 172.21.15.114:58508) 2023-10-18T12:30:06.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.263+0000 7f801ad8f700 1 -- 172.21.15.114:0/2685294697 learned_addr learned my addr 172.21.15.114:0/2685294697 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:30:06.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.263+0000 7f8019d8d700 1 --2- 172.21.15.114:0/2685294697 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f80141594d0 0x7f80140c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:30:06.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.263+0000 7f801ad8f700 1 -- 172.21.15.114:0/2685294697 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f80141594d0 msgr2=0x7f80140c6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:30:06.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.263+0000 7f801ad8f700 1 --2- 172.21.15.114:0/2685294697 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f80141594d0 0x7f80140c6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:30:06.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.263+0000 7f801ad8f700 1 -- 172.21.15.114:0/2685294697 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80140cd870 msgr2=0x7f80140c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:30:06.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.263+0000 7f801a58e700 1 --2- 172.21.15.114:0/2685294697 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80140cd870 0x7f80140c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:30:06.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.263+0000 7f801ad8f700 1 --2- 172.21.15.114:0/2685294697 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80140cd870 0x7f80140c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:30:06.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.263+0000 7f801ad8f700 1 -- 172.21.15.114:0/2685294697 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8004009570 con 0x7f801415a0e0 2023-10-18T12:30:06.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.263+0000 7f8019d8d700 1 --2- 172.21.15.114:0/2685294697 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f80141594d0 0x7f80140c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:30:06.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.263+0000 7f801a58e700 1 --2- 172.21.15.114:0/2685294697 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80140cd870 0x7f80140c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:30:06.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.263+0000 7f801ad8f700 1 --2- 172.21.15.114:0/2685294697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f801415a0e0 0x7f80141f1e40 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f800c00e810 tx=0x7f800c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:30:06.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.263+0000 7f800affd700 1 -- 172.21.15.114:0/2685294697 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c013610 con 0x7f801415a0e0 2023-10-18T12:30:06.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.263+0000 7f800affd700 1 -- 172.21.15.114:0/2685294697 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800c013770 con 0x7f801415a0e0 2023-10-18T12:30:06.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.263+0000 7f801b590700 1 -- 172.21.15.114:0/2685294697 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f801406b790 con 0x7f801415a0e0 2023-10-18T12:30:06.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.263+0000 7f800affd700 1 -- 172.21.15.114:0/2685294697 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c013b20 con 0x7f801415a0e0 2023-10-18T12:30:06.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.263+0000 7f801b590700 1 -- 172.21.15.114:0/2685294697 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80140c6670 con 0x7f801415a0e0 2023-10-18T12:30:06.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.267+0000 7f801b590700 1 -- 172.21.15.114:0/2685294697 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8014070940 con 0x7f801415a0e0 2023-10-18T12:30:06.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.267+0000 7f800affd700 1 -- 172.21.15.114:0/2685294697 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f800c013c80 con 0x7f801415a0e0 2023-10-18T12:30:06.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.267+0000 7f800affd700 1 --2- 172.21.15.114:0/2685294697 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7ff8065720 0x7f7ff8067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:30:06.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.267+0000 7f800affd700 1 -- 172.21.15.114:0/2685294697 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6773+0+0 (secure 0 0 0) 0x7f800c082ca0 con 0x7f801415a0e0 2023-10-18T12:30:06.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.271+0000 7f801a58e700 1 --2- 172.21.15.114:0/2685294697 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7ff8065720 0x7f7ff8067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:30:06.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.271+0000 7f801a58e700 1 --2- 172.21.15.114:0/2685294697 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7ff8065720 0x7f7ff8067be0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8010002170 tx=0x7f8010009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:30:06.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.275+0000 7f800affd700 1 -- 172.21.15.114:0/2685294697 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f800c053f10 con 0x7f801415a0e0 2023-10-18T12:30:06.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.283+0000 7ffa3af90700 1 Processor -- start 2023-10-18T12:30:06.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.283+0000 7ffa3af90700 1 -- start start 2023-10-18T12:30:06.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.283+0000 7ffa3af90700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ffa340719e0 0x7ffa340cc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:30:06.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.283+0000 7ffa3af90700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffa340c1990 0x7ffa340c9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:30:06.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.283+0000 7ffa3af90700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa340ae070 con 0x7ffa340adc90 2023-10-18T12:30:06.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.283+0000 7ffa3af90700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa34161850 con 0x7ffa340719e0 2023-10-18T12:30:06.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.283+0000 7ffa3af90700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa340cac90 con 0x7ffa340c1990 2023-10-18T12:30:06.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.283+0000 7ffa3978d700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ffa340719e0 0x7ffa340cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:30:06.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.283+0000 7ffa3978d700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ffa340719e0 0x7ffa340cc380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:38394/0 (socket says 172.21.15.114:38394) 2023-10-18T12:30:06.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.283+0000 7ffa3978d700 1 -- 172.21.15.114:0/2717566594 learned_addr learned my addr 172.21.15.114:0/2717566594 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:30:06.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.283+0000 7ffa3a78f700 1 --2- 172.21.15.114:0/2717566594 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffa340c1990 0x7ffa340c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:30:06.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.287+0000 7ffa3978d700 1 -- 172.21.15.114:0/2717566594 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffa340c1990 msgr2=0x7ffa340c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:30:06.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.287+0000 7ffa3978d700 1 --2- 172.21.15.114:0/2717566594 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffa340c1990 0x7ffa340c9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:30:06.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.287+0000 7ffa3978d700 1 -- 172.21.15.114:0/2717566594 >> v1:172.21.15.172:6789/0 conn(0x7ffa340adc90 legacy=0x7ffa340712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:30:06.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.287+0000 7ffa3978d700 1 -- 172.21.15.114:0/2717566594 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa3406d920 con 0x7ffa340719e0 2023-10-18T12:30:06.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.287+0000 7ffa38f8c700 1 -- 172.21.15.114:0/2717566594 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1150191295 0 0) 0x7ffa30001110 con 0x7ffa340adc90 2023-10-18T12:30:06.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.287+0000 7ffa3978d700 1 --2- 172.21.15.114:0/2717566594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa340719e0 0x7ffa340cc380 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ffa24009910 tx=0x7ffa24009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ad4f8775cb5a847 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:30:06.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.287+0000 7ffa38f8c700 1 -- 172.21.15.114:0/2717566594 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa24011830 con 0x7ffa340719e0 2023-10-18T12:30:06.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.287+0000 7ffa38f8c700 1 -- 172.21.15.114:0/2717566594 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa24011990 con 0x7ffa340719e0 2023-10-18T12:30:06.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.287+0000 7ffa38f8c700 1 -- 172.21.15.114:0/2717566594 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa24011d40 con 0x7ffa340719e0 2023-10-18T12:30:06.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.287+0000 7ffa3af90700 1 -- 172.21.15.114:0/2717566594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa340719e0 msgr2=0x7ffa340cc380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:30:06.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.287+0000 7ffa3af90700 1 --2- 172.21.15.114:0/2717566594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa340719e0 0x7ffa340cc380 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ffa24009910 tx=0x7ffa24009c20 comp rx=0 tx=0).stop 2023-10-18T12:30:06.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.287+0000 7ffa3af90700 1 -- 172.21.15.114:0/2717566594 shutdown_connections 2023-10-18T12:30:06.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.287+0000 7ffa3af90700 1 --2- 172.21.15.114:0/2717566594 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffa340c1990 0x7ffa340c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:30:06.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.287+0000 7ffa3af90700 1 --2- 172.21.15.114:0/2717566594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa340719e0 0x7ffa340cc380 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:30:06.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.287+0000 7ffa3af90700 1 -- 172.21.15.114:0/2717566594 >> 172.21.15.114:0/2717566594 conn(0x7ffa340b02a0 msgr2=0x7ffa340b06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:30:06.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.287+0000 7ffa3af90700 1 -- 172.21.15.114:0/2717566594 shutdown_connections 2023-10-18T12:30:06.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.287+0000 7ffa3af90700 1 -- 172.21.15.114:0/2717566594 wait complete. 2023-10-18T12:30:06.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.291+0000 7ffa3af90700 1 Processor -- start 2023-10-18T12:30:06.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.291+0000 7ffa3af90700 1 -- start start 2023-10-18T12:30:06.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.291+0000 7ffa3af90700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa340719e0 0x7ffa341fa4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:30:06.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.291+0000 7ffa3af90700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffa340adc90 0x7ffa3415a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:30:06.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.291+0000 7ffa3af90700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa340c1990 0x7ffa340b36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:30:06.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.291+0000 7ffa3af90700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa34163960 con 0x7ffa340719e0 2023-10-18T12:30:06.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.291+0000 7ffa3af90700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa341fa9e0 con 0x7ffa340c1990 2023-10-18T12:30:06.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.291+0000 7ffa3af90700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa34162d50 con 0x7ffa340adc90 2023-10-18T12:30:06.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.291+0000 7ffa39f8e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa340719e0 0x7ffa341fa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:30:06.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.291+0000 7ffa39f8e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa340719e0 0x7ffa341fa4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58522/0 (socket says 172.21.15.114:58522) 2023-10-18T12:30:06.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.291+0000 7ffa39f8e700 1 -- 172.21.15.114:0/3819439665 learned_addr learned my addr 172.21.15.114:0/3819439665 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:30:06.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.295+0000 7ffa3978d700 1 --2- 172.21.15.114:0/3819439665 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffa340adc90 0x7ffa3415a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:30:06.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.295+0000 7ffa3a78f700 1 --2- 172.21.15.114:0/3819439665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa340c1990 0x7ffa340b36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:30:06.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.295+0000 7ffa39f8e700 1 -- 172.21.15.114:0/3819439665 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffa340adc90 msgr2=0x7ffa3415a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:30:06.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.295+0000 7ffa39f8e700 1 --2- 172.21.15.114:0/3819439665 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffa340adc90 0x7ffa3415a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:30:06.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.295+0000 7ffa39f8e700 1 -- 172.21.15.114:0/3819439665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa340c1990 msgr2=0x7ffa340b36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:30:06.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.295+0000 7ffa39f8e700 1 --2- 172.21.15.114:0/3819439665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa340c1990 0x7ffa340b36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:30:06.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.295+0000 7ffa39f8e700 1 -- 172.21.15.114:0/3819439665 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa24009570 con 0x7ffa340719e0 2023-10-18T12:30:06.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.295+0000 7ffa39f8e700 1 --2- 172.21.15.114:0/3819439665 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa340719e0 0x7ffa341fa4a0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7ffa3000c550 tx=0x7ffa3000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:30:06.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.295+0000 7ffa2a7fc700 1 -- 172.21.15.114:0/3819439665 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa300054e0 con 0x7ffa340719e0 2023-10-18T12:30:06.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.295+0000 7ffa2a7fc700 1 -- 172.21.15.114:0/3819439665 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa300036a0 con 0x7ffa340719e0 2023-10-18T12:30:06.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.295+0000 7ffa3af90700 1 -- 172.21.15.114:0/3819439665 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa34163030 con 0x7ffa340719e0 2023-10-18T12:30:06.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.295+0000 7ffa2a7fc700 1 -- 172.21.15.114:0/3819439665 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa30003a50 con 0x7ffa340719e0 2023-10-18T12:30:06.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.295+0000 7ffa3af90700 1 -- 172.21.15.114:0/3819439665 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa341635f0 con 0x7ffa340719e0 2023-10-18T12:30:06.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.295+0000 7ffa3af90700 1 -- 172.21.15.114:0/3819439665 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7ffa34072e60 con 0x7ffa340719e0 2023-10-18T12:30:06.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.299+0000 7ffa2a7fc700 1 -- 172.21.15.114:0/3819439665 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ffa30003bb0 con 0x7ffa340719e0 2023-10-18T12:30:06.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.299+0000 7ffa2a7fc700 1 --2- 172.21.15.114:0/3819439665 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ffa180656f0 0x7ffa18067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:30:06.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.299+0000 7ffa2a7fc700 1 -- 172.21.15.114:0/3819439665 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6773+0+0 (secure 0 0 0) 0x7ffa300824a0 con 0x7ffa340719e0 2023-10-18T12:30:06.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.299+0000 7ffa2a7fc700 1 -- 172.21.15.114:0/3819439665 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+450 (secure 0 0 0) 0x7ffa30089070 con 0x7ffa340719e0 2023-10-18T12:30:06.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.299+0000 7ffa3978d700 1 --2- 172.21.15.114:0/3819439665 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ffa180656f0 0x7ffa18067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:30:06.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.299+0000 7ffa3af90700 1 -- 172.21.15.114:0/3819439665 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7ffa340ae070 con 0x7ffa340719e0 2023-10-18T12:30:06.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.299+0000 7ffa3978d700 1 --2- 172.21.15.114:0/3819439665 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ffa180656f0 0x7ffa18067bb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ffa24009910 tx=0x7ffa24008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:30:06.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.507+0000 7f801b590700 1 -- 172.21.15.114:0/2685294697 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8014072e60 con 0x7f801415a0e0 2023-10-18T12:30:06.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.511+0000 7f800affd700 1 -- 172.21.15.114:0/2685294697 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4889 (secure 0 0 0) 0x7f800c053aa0 con 0x7f801415a0e0 2023-10-18T12:30:06.518 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:30:06.518 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2034957068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2034957068},{"type":"v1","addr":"172.21.15.172:6836","nonce":2034957068}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5039,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4215710360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4215710360},{"type":"v1","addr":"172.21.15.172:6837","nonce":4215710360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2387835210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2387835210},{"type":"v1","addr":"172.21.15.114:6833","nonce":2387835210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T12:21:14.159069+0000","modified":"2023-10-18T12:29:23.762500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":126,"addr":"172.21.15.114:6835/1284474820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1284474820},{"type":"v1","addr":"172.21.15.114:6835","nonce":1284474820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-18T12:30:06.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.511+0000 7f801b590700 1 -- 172.21.15.114:0/2685294697 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7ff8065720 msgr2=0x7f7ff8067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:30:06.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.511+0000 7f801b590700 1 --2- 172.21.15.114:0/2685294697 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7ff8065720 0x7f7ff8067be0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8010002170 tx=0x7f8010009040 comp rx=0 tx=0).stop 2023-10-18T12:30:06.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.511+0000 7f801b590700 1 -- 172.21.15.114:0/2685294697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f801415a0e0 msgr2=0x7f80141f1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:30:06.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.511+0000 7f801b590700 1 --2- 172.21.15.114:0/2685294697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f801415a0e0 0x7f80141f1e40 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f800c00e810 tx=0x7f800c00ebd0 comp rx=0 tx=0).stop 2023-10-18T12:30:06.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.511+0000 7f801b590700 1 -- 172.21.15.114:0/2685294697 shutdown_connections 2023-10-18T12:30:06.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.511+0000 7f801b590700 1 --2- 172.21.15.114:0/2685294697 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7ff8065720 0x7f7ff8067be0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:30:06.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.511+0000 7f801b590700 1 --2- 172.21.15.114:0/2685294697 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f80141594d0 0x7f80140c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:30:06.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.511+0000 7f801b590700 1 --2- 172.21.15.114:0/2685294697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f801415a0e0 0x7f80141f1e40 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:30:06.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.511+0000 7f801b590700 1 --2- 172.21.15.114:0/2685294697 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80140cd870 0x7f80140c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:30:06.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.511+0000 7f801b590700 1 -- 172.21.15.114:0/2685294697 >> 172.21.15.114:0/2685294697 conn(0x7f80140cb920 msgr2=0x7f80140cbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:30:06.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.511+0000 7f801b590700 1 -- 172.21.15.114:0/2685294697 shutdown_connections 2023-10-18T12:30:06.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:06.511+0000 7f801b590700 1 -- 172.21.15.114:0/2685294697 wait complete. 2023-10-18T12:30:06.524 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 20 2023-10-18T12:30:06.541 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-10-18T12:30:06.733 INFO:teuthology.orchestra.run.smithi114.stdout:[{"id":5162,"entity":{"name":{"type":"client","num":5162},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":989916161}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":522.74782088799998,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.29885562385541836,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":3,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5162 v1:192.168.0.1:0/989916161","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi172","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}}] 2023-10-18T12:30:06.734 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "1", "hostname": "smithi172", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 989916161, "type": "v1" }, "name": { "num": 5162, "type": "client" } }, "id": 5162, "inst": "client.5162 v1:192.168.0.1:0/989916161", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 3, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.29885562385541836 }, "state": "open", "uptime": 522.747820888 } ] 2023-10-18T12:30:06.835 DEBUG:tasks.ceph_test_case:No log hits yet, waiting... 2023-10-18T12:30:21.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:21.731+0000 7ffa2a7fc700 1 -- 172.21.15.114:0/3819439665 <== mon.0 v2:172.21.15.114:3300/0 7 ==== log(4 entries from seq 126 at 2023-10-18T12:30:20.753853+0000) v1 ==== 1076+0+0 (secure 0 0 0) 0x7ffa30053f40 con 0x7ffa340719e0 2023-10-18T12:30:22.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:22.751+0000 7ffa2a7fc700 1 -- 172.21.15.114:0/3819439665 <== mon.0 v2:172.21.15.114:3300/0 8 ==== log(2 entries from seq 536 at 2023-10-18T12:30:21.729775+0000) v1 ==== 535+0+0 (secure 0 0 0) 0x7ffa30057670 con 0x7ffa340719e0 2023-10-18T12:30:34.040 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:30:34.048 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:30:41.861 ERROR:tasks.ceph_test_case:Log output: 2023-10-18T12:30:41.862 DEBUG:tasks.cephfs.test_client_recovery:Expected log message found: 'Health check cleared: MDS_CLIENTS_LAGGY', retrying 2023-10-18T12:30:42.863 DEBUG:teuthology.orchestra.run.smithi114:> sudo daemon-helper kill ceph --cluster ceph -w 2023-10-18T12:30:42.871 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T12:30:43.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.038+0000 7f7708f0c700 1 Processor -- start 2023-10-18T12:30:43.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.038+0000 7f7708f0c700 1 -- start start 2023-10-18T12:30:43.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.038+0000 7f7708f0c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7704071840 0x7f770406fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:30:43.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.038+0000 7f7708f0c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f770406a7c0 0x7f77040ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:30:43.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.038+0000 7f7708f0c700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f770415d000 con 0x7f770415cc20 2023-10-18T12:30:43.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.038+0000 7f7708f0c700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77040ca600 con 0x7f770406a7c0 2023-10-18T12:30:43.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.038+0000 7f7708f0c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7704160710 con 0x7f7704071840 2023-10-18T12:30:43.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.038+0000 7f77037fe700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f770415cc20 0x7f770406a0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:38310/0 (socket says 172.21.15.114:38310) 2023-10-18T12:30:43.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.038+0000 7f77037fe700 1 -- 172.21.15.114:0/901458769 learned_addr learned my addr 172.21.15.114:0/901458769 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:30:43.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.042+0000 7f7702ffd700 1 --2- 172.21.15.114:0/901458769 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7704071840 0x7f770406fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:30:43.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.042+0000 7f7703fff700 1 --2- 172.21.15.114:0/901458769 >> v2:172.21.15.172:3300/0 conn(0x7f770406a7c0 0x7f77040ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:30:43.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.042+0000 7f77027fc700 1 -- 172.21.15.114:0/901458769 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1657920440 0 0) 0x7f770415d000 con 0x7f770415cc20 2023-10-18T12:30:43.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.042+0000 7f77027fc700 1 -- 172.21.15.114:0/901458769 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76ec0035d0 con 0x7f770415cc20 2023-10-18T12:30:43.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.042+0000 7f7702ffd700 1 -- 172.21.15.114:0/901458769 >> v2:172.21.15.172:3300/0 conn(0x7f770406a7c0 msgr2=0x7f77040ca0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:30:43.051 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.042+0000 7f7702ffd700 1 --2- 172.21.15.114:0/901458769 >> v2:172.21.15.172:3300/0 conn(0x7f770406a7c0 0x7f77040ca0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:30:43.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.042+0000 7f7702ffd700 1 -- 172.21.15.114:0/901458769 >> v1:172.21.15.114:6789/0 conn(0x7f770415cc20 legacy=0x7f770406a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:30:43.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.042+0000 7f7702ffd700 1 -- 172.21.15.114:0/901458769 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77041609f0 con 0x7f7704071840 2023-10-18T12:30:43.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.042+0000 7f7702ffd700 1 --2- 172.21.15.114:0/901458769 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7704071840 0x7f770406fcd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f76f8009880 tx=0x7f76f8009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5449db5ea89c21df server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:30:43.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.042+0000 7f77027fc700 1 -- 172.21.15.114:0/901458769 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f8011830 con 0x7f7704071840 2023-10-18T12:30:43.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.042+0000 7f77027fc700 1 -- 172.21.15.114:0/901458769 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f8011990 con 0x7f7704071840 2023-10-18T12:30:43.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.042+0000 7f77027fc700 1 -- 172.21.15.114:0/901458769 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f8011d00 con 0x7f7704071840 2023-10-18T12:30:43.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.042+0000 7f7708f0c700 1 -- 172.21.15.114:0/901458769 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7704071840 msgr2=0x7f770406fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:30:43.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.042+0000 7f7708f0c700 1 --2- 172.21.15.114:0/901458769 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7704071840 0x7f770406fcd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f76f8009880 tx=0x7f76f8009b90 comp rx=0 tx=0).stop 2023-10-18T12:30:43.054 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.042+0000 7f7708f0c700 1 -- 172.21.15.114:0/901458769 shutdown_connections 2023-10-18T12:30:43.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.042+0000 7f7708f0c700 1 --2- 172.21.15.114:0/901458769 >> v2:172.21.15.172:3300/0 conn(0x7f770406a7c0 0x7f77040ca0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:30:43.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.042+0000 7f7708f0c700 1 --2- 172.21.15.114:0/901458769 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7704071840 0x7f770406fcd0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:30:43.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.042+0000 7f7708f0c700 1 -- 172.21.15.114:0/901458769 >> 172.21.15.114:0/901458769 conn(0x7f77040cf6b0 msgr2=0x7f77040cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:30:43.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.042+0000 7f7708f0c700 1 -- 172.21.15.114:0/901458769 shutdown_connections 2023-10-18T12:30:43.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.042+0000 7f7708f0c700 1 -- 172.21.15.114:0/901458769 wait complete. 2023-10-18T12:30:43.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.046+0000 7f7708f0c700 1 Processor -- start 2023-10-18T12:30:43.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.046+0000 7f7708f0c700 1 -- start start 2023-10-18T12:30:43.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.050+0000 7f7708f0c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f770406a7c0 0x7f7704150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:30:43.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.050+0000 7f7708f0c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7704071840 0x7f77040ad350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:30:43.059 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.050+0000 7f7708f0c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f770415cc20 0x7f77040b1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:30:43.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.050+0000 7f7708f0c700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77040b3850 con 0x7f770406a7c0 2023-10-18T12:30:43.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.050+0000 7f7708f0c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77040ae280 con 0x7f7704071840 2023-10-18T12:30:43.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.050+0000 7f7708f0c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77040b3b10 con 0x7f770415cc20 2023-10-18T12:30:43.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.050+0000 7f77037fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f770406a7c0 0x7f7704150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:30:43.060 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.050+0000 7f77037fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f770406a7c0 0x7f7704150c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50932/0 (socket says 172.21.15.114:50932) 2023-10-18T12:30:43.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.050+0000 7f77037fe700 1 -- 172.21.15.114:0/658302050 learned_addr learned my addr 172.21.15.114:0/658302050 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:30:43.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.050+0000 7f7702ffd700 1 --2- 172.21.15.114:0/658302050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7704071840 0x7f77040ad350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:30:43.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.050+0000 7f77037fe700 1 -- 172.21.15.114:0/658302050 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f770415cc20 msgr2=0x7f77040b1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:30:43.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.050+0000 7f77037fe700 1 --2- 172.21.15.114:0/658302050 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f770415cc20 0x7f77040b1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:30:43.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.050+0000 7f77037fe700 1 -- 172.21.15.114:0/658302050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7704071840 msgr2=0x7f77040ad350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:30:43.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.050+0000 7f77037fe700 1 --2- 172.21.15.114:0/658302050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7704071840 0x7f77040ad350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:30:43.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.050+0000 7f77037fe700 1 -- 172.21.15.114:0/658302050 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f80094b0 con 0x7f770406a7c0 2023-10-18T12:30:43.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.050+0000 7f7702ffd700 1 --2- 172.21.15.114:0/658302050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7704071840 0x7f77040ad350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:30:43.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.050+0000 7f77037fe700 1 --2- 172.21.15.114:0/658302050 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f770406a7c0 0x7f7704150c60 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f76f400c450 tx=0x7f76f400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:30:43.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.050+0000 7f76ebfff700 1 -- 172.21.15.114:0/658302050 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f4005d90 con 0x7f770406a7c0 2023-10-18T12:30:43.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.050+0000 7f76ebfff700 1 -- 172.21.15.114:0/658302050 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f40070d0 con 0x7f770406a7c0 2023-10-18T12:30:43.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.050+0000 7f76ebfff700 1 -- 172.21.15.114:0/658302050 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f4007440 con 0x7f770406a7c0 2023-10-18T12:30:43.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.050+0000 7f7708f0c700 1 -- 172.21.15.114:0/658302050 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77040ad9e0 con 0x7f770406a7c0 2023-10-18T12:30:43.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.050+0000 7f7708f0c700 1 -- 172.21.15.114:0/658302050 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77040adfa0 con 0x7f770406a7c0 2023-10-18T12:30:43.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.054+0000 7f76ebfff700 1 -- 172.21.15.114:0/658302050 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f76f40075a0 con 0x7f770406a7c0 2023-10-18T12:30:43.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.054+0000 7f7708f0c700 1 -- 172.21.15.114:0/658302050 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7704066d10 con 0x7f770406a7c0 2023-10-18T12:30:43.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.054+0000 7f76ebfff700 1 --2- 172.21.15.114:0/658302050 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f76f0065720 0x7f76f0067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:30:43.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.054+0000 7f76ebfff700 1 -- 172.21.15.114:0/658302050 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7f76f4082340 con 0x7f770406a7c0 2023-10-18T12:30:43.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.054+0000 7f7702ffd700 1 --2- 172.21.15.114:0/658302050 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f76f0065720 0x7f76f0067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:30:43.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.058+0000 7f7702ffd700 1 --2- 172.21.15.114:0/658302050 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f76f0065720 0x7f76f0067be0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f76f8009fd0 tx=0x7f76f8008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:30:43.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.066+0000 7f76ebfff700 1 -- 172.21.15.114:0/658302050 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f76f404fc10 con 0x7f770406a7c0 2023-10-18T12:30:43.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.066+0000 7fc63e89a700 1 Processor -- start 2023-10-18T12:30:43.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.066+0000 7fc63e89a700 1 -- start start 2023-10-18T12:30:43.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.070+0000 7fc63e89a700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc6381572f0 0x7fc638160830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:30:43.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.070+0000 7fc63e89a700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6380cf320 0x7fc6380b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:30:43.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.070+0000 7fc63e89a700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc6380d2f60 0x7fc6380d33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:30:43.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.070+0000 7fc63e89a700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6380d3930 con 0x7fc6380d2f60 2023-10-18T12:30:43.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.070+0000 7fc63e89a700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6381576d0 con 0x7fc6381572f0 2023-10-18T12:30:43.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.070+0000 7fc63e89a700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc63806dd60 con 0x7fc6380cf320 2023-10-18T12:30:43.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.070+0000 7fc63e099700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc6380d2f60 0x7fc6380d33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:30:43.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.070+0000 7fc63d097700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6380cf320 0x7fc6380b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:30:43.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.070+0000 7fc63e099700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc6380d2f60 0x7fc6380d33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50942/0 (socket says 172.21.15.114:50942) 2023-10-18T12:30:43.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.070+0000 7fc63e099700 1 -- 172.21.15.114:0/1872253944 learned_addr learned my addr 172.21.15.114:0/1872253944 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:30:43.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.070+0000 7fc63d898700 1 --2- 172.21.15.114:0/1872253944 >> v2:172.21.15.172:3300/0 conn(0x7fc6381572f0 0x7fc638160830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:30:43.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.070+0000 7fc63e099700 1 -- 172.21.15.114:0/1872253944 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6380cf320 msgr2=0x7fc6380b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:30:43.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.070+0000 7fc63e099700 1 --2- 172.21.15.114:0/1872253944 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6380cf320 0x7fc6380b5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:30:43.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.070+0000 7fc63e099700 1 -- 172.21.15.114:0/1872253944 >> v2:172.21.15.172:3300/0 conn(0x7fc6381572f0 msgr2=0x7fc638160830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:30:43.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.070+0000 7fc63e099700 1 --2- 172.21.15.114:0/1872253944 >> v2:172.21.15.172:3300/0 conn(0x7fc6381572f0 0x7fc638160830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:30:43.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.070+0000 7fc63e099700 1 -- 172.21.15.114:0/1872253944 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc63806e040 con 0x7fc6380d2f60 2023-10-18T12:30:43.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.070+0000 7fc63e099700 1 --2- 172.21.15.114:0/1872253944 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6380d2f60 0x7fc6380d33f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fc63806dc00 tx=0x7fc63000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a4bd14045ff8f4e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:30:43.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.070+0000 7fc63c896700 1 -- 172.21.15.114:0/1872253944 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63000e070 con 0x7fc6380d2f60 2023-10-18T12:30:43.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.070+0000 7fc63c896700 1 -- 172.21.15.114:0/1872253944 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63000b910 con 0x7fc6380d2f60 2023-10-18T12:30:43.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.070+0000 7fc63c896700 1 -- 172.21.15.114:0/1872253944 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63000bcc0 con 0x7fc6380d2f60 2023-10-18T12:30:43.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.074+0000 7fc63e89a700 1 -- 172.21.15.114:0/1872253944 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6380d2f60 msgr2=0x7fc6380d33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:30:43.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.074+0000 7fc63e89a700 1 --2- 172.21.15.114:0/1872253944 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6380d2f60 0x7fc6380d33f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fc63806dc00 tx=0x7fc63000b330 comp rx=0 tx=0).stop 2023-10-18T12:30:43.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.074+0000 7fc63e89a700 1 -- 172.21.15.114:0/1872253944 shutdown_connections 2023-10-18T12:30:43.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.074+0000 7fc63e89a700 1 --2- 172.21.15.114:0/1872253944 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6380d2f60 0x7fc6380d33f0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:30:43.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.074+0000 7fc63e89a700 1 --2- 172.21.15.114:0/1872253944 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6380cf320 0x7fc6380b5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:30:43.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.074+0000 7fc63e89a700 1 --2- 172.21.15.114:0/1872253944 >> v2:172.21.15.172:3300/0 conn(0x7fc6381572f0 0x7fc638160830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:30:43.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.074+0000 7fc63e89a700 1 -- 172.21.15.114:0/1872253944 >> 172.21.15.114:0/1872253944 conn(0x7fc638069ef0 msgr2=0x7fc63806a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:30:43.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.074+0000 7fc63e89a700 1 -- 172.21.15.114:0/1872253944 shutdown_connections 2023-10-18T12:30:43.087 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.074+0000 7fc63e89a700 1 -- 172.21.15.114:0/1872253944 wait complete. 2023-10-18T12:30:43.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.074+0000 7fc63e89a700 1 Processor -- start 2023-10-18T12:30:43.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.074+0000 7fc63e89a700 1 -- start start 2023-10-18T12:30:43.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.074+0000 7fc63e89a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6380cf320 0x7fc63813e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:30:43.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.074+0000 7fc63e89a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6380d2f60 0x7fc63815f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:30:43.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.078+0000 7fc63e89a700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6381572f0 0x7fc6381559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:30:43.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.078+0000 7fc63e89a700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63815fe70 con 0x7fc6380cf320 2023-10-18T12:30:43.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.078+0000 7fc63e89a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc638160150 con 0x7fc6380d2f60 2023-10-18T12:30:43.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.078+0000 7fc63e89a700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc638160430 con 0x7fc6381572f0 2023-10-18T12:30:43.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.078+0000 7fc63d898700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6380cf320 0x7fc63813e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:30:43.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.078+0000 7fc63d898700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6380cf320 0x7fc63813e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:50946/0 (socket says 172.21.15.114:50946) 2023-10-18T12:30:43.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.078+0000 7fc63d898700 1 -- 172.21.15.114:0/162845947 learned_addr learned my addr 172.21.15.114:0/162845947 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:30:43.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.078+0000 7fc63d097700 1 --2- 172.21.15.114:0/162845947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6380d2f60 0x7fc63815f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:30:43.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.078+0000 7fc63e099700 1 --2- 172.21.15.114:0/162845947 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6381572f0 0x7fc6381559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:30:43.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.078+0000 7fc63d898700 1 -- 172.21.15.114:0/162845947 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6381572f0 msgr2=0x7fc6381559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:30:43.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.078+0000 7fc63d898700 1 --2- 172.21.15.114:0/162845947 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6381572f0 0x7fc6381559d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:30:43.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.078+0000 7fc63d898700 1 -- 172.21.15.114:0/162845947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6380d2f60 msgr2=0x7fc63815f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:30:43.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.078+0000 7fc63d898700 1 --2- 172.21.15.114:0/162845947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6380d2f60 0x7fc63815f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:30:43.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.078+0000 7fc63d898700 1 -- 172.21.15.114:0/162845947 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc630009b30 con 0x7fc6380cf320 2023-10-18T12:30:43.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.078+0000 7fc63e099700 1 --2- 172.21.15.114:0/162845947 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6381572f0 0x7fc6381559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:30:43.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.078+0000 7fc63d898700 1 --2- 172.21.15.114:0/162845947 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6380cf320 0x7fc63813e1f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fc63400e840 tx=0x7fc63400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:30:43.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.078+0000 7fc62e7fc700 1 -- 172.21.15.114:0/162845947 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6340095a0 con 0x7fc6380cf320 2023-10-18T12:30:43.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.078+0000 7fc62e7fc700 1 -- 172.21.15.114:0/162845947 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63400c690 con 0x7fc6380cf320 2023-10-18T12:30:43.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.078+0000 7fc63e89a700 1 -- 172.21.15.114:0/162845947 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc63813eb20 con 0x7fc6380cf320 2023-10-18T12:30:43.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.078+0000 7fc62e7fc700 1 -- 172.21.15.114:0/162845947 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63400ca00 con 0x7fc6380cf320 2023-10-18T12:30:43.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.078+0000 7fc63e89a700 1 -- 172.21.15.114:0/162845947 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc63813e730 con 0x7fc6380cf320 2023-10-18T12:30:43.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.078+0000 7fc63e89a700 1 -- 172.21.15.114:0/162845947 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fc638073540 con 0x7fc6380cf320 2023-10-18T12:30:43.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.082+0000 7fc62e7fc700 1 -- 172.21.15.114:0/162845947 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fc63400cb60 con 0x7fc6380cf320 2023-10-18T12:30:43.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.082+0000 7fc62e7fc700 1 --2- 172.21.15.114:0/162845947 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc61c065720 0x7fc61c067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:30:43.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.082+0000 7fc62e7fc700 1 -- 172.21.15.114:0/162845947 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7fc634083350 con 0x7fc6380cf320 2023-10-18T12:30:43.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.082+0000 7fc62e7fc700 1 -- 172.21.15.114:0/162845947 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+450 (secure 0 0 0) 0x7fc6340836e0 con 0x7fc6380cf320 2023-10-18T12:30:43.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.082+0000 7fc63d097700 1 --2- 172.21.15.114:0/162845947 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc61c065720 0x7fc61c067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:30:43.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.082+0000 7fc63e89a700 1 -- 172.21.15.114:0/162845947 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7fc638072e60 con 0x7fc6380cf320 2023-10-18T12:30:43.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.086+0000 7fc63d097700 1 --2- 172.21.15.114:0/162845947 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc61c065720 0x7fc61c067be0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc63814f040 tx=0x7fc628008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:30:43.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.290+0000 7f7708f0c700 1 -- 172.21.15.114:0/658302050 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7704072e60 con 0x7f770406a7c0 2023-10-18T12:30:43.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.294+0000 7f76ebfff700 1 -- 172.21.15.114:0/658302050 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4889 (secure 0 0 0) 0x7f76f4053230 con 0x7f770406a7c0 2023-10-18T12:30:43.302 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:30:43.302 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2034957068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2034957068},{"type":"v1","addr":"172.21.15.172:6836","nonce":2034957068}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5039,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4215710360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4215710360},{"type":"v1","addr":"172.21.15.172:6837","nonce":4215710360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2387835210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2387835210},{"type":"v1","addr":"172.21.15.114:6833","nonce":2387835210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T12:21:14.159069+0000","modified":"2023-10-18T12:29:23.762500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":126,"addr":"172.21.15.114:6835/1284474820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1284474820},{"type":"v1","addr":"172.21.15.114:6835","nonce":1284474820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-18T12:30:43.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.294+0000 7f7708f0c700 1 -- 172.21.15.114:0/658302050 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f76f0065720 msgr2=0x7f76f0067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:30:43.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.294+0000 7f7708f0c700 1 --2- 172.21.15.114:0/658302050 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f76f0065720 0x7f76f0067be0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f76f8009fd0 tx=0x7f76f8008030 comp rx=0 tx=0).stop 2023-10-18T12:30:43.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.294+0000 7f7708f0c700 1 -- 172.21.15.114:0/658302050 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f770406a7c0 msgr2=0x7f7704150c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:30:43.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.294+0000 7f7708f0c700 1 --2- 172.21.15.114:0/658302050 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f770406a7c0 0x7f7704150c60 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f76f400c450 tx=0x7f76f400c810 comp rx=0 tx=0).stop 2023-10-18T12:30:43.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.294+0000 7f7708f0c700 1 -- 172.21.15.114:0/658302050 shutdown_connections 2023-10-18T12:30:43.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.294+0000 7f7708f0c700 1 --2- 172.21.15.114:0/658302050 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f76f0065720 0x7f76f0067be0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:30:43.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.294+0000 7f7708f0c700 1 --2- 172.21.15.114:0/658302050 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f770415cc20 0x7f77040b1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:30:43.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.294+0000 7f7708f0c700 1 --2- 172.21.15.114:0/658302050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7704071840 0x7f77040ad350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:30:43.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.294+0000 7f7708f0c700 1 --2- 172.21.15.114:0/658302050 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f770406a7c0 0x7f7704150c60 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:30:43.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.294+0000 7f7708f0c700 1 -- 172.21.15.114:0/658302050 >> 172.21.15.114:0/658302050 conn(0x7f77040cf6b0 msgr2=0x7f77040cfa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:30:43.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.294+0000 7f7708f0c700 1 -- 172.21.15.114:0/658302050 shutdown_connections 2023-10-18T12:30:43.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:30:43.294+0000 7f7708f0c700 1 -- 172.21.15.114:0/658302050 wait complete. 2023-10-18T12:30:43.307 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 20 2023-10-18T12:30:43.326 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-10-18T12:30:43.518 INFO:teuthology.orchestra.run.smithi114.stdout:[{"id":5162,"entity":{"name":{"type":"client","num":5162},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":989916161}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":559.53100516100005,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.27450607499810648,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":3,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5162 v1:192.168.0.1:0/989916161","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi172","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}}] 2023-10-18T12:30:43.518 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "1", "hostname": "smithi172", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 989916161, "type": "v1" }, "name": { "num": 5162, "type": "client" } }, "id": 5162, "inst": "client.5162 v1:192.168.0.1:0/989916161", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 3, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.2745060749981065 }, "state": "open", "uptime": 559.531005161 } ] 2023-10-18T12:30:43.619 DEBUG:tasks.ceph_test_case:No log hits yet, waiting... 2023-10-18T12:31:04.147 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:31:04.155 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:31:18.642 ERROR:tasks.ceph_test_case:Log output: 2023-10-18T12:31:18.642 DEBUG:tasks.cephfs.test_client_recovery:Expected log message found: 'Health check cleared: MDS_CLIENTS_LAGGY', retrying 2023-10-18T12:31:19.644 DEBUG:teuthology.orchestra.run.smithi114:> sudo daemon-helper kill ceph --cluster ceph -w 2023-10-18T12:31:19.652 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T12:31:19.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.818+0000 7ffa7ec20700 1 Processor -- start 2023-10-18T12:31:19.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.818+0000 7ffa7ec20700 1 -- start start 2023-10-18T12:31:19.826 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.822+0000 7ffa7ec20700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffa78164a20 0x7ffa780cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:31:19.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.822+0000 7ffa7ec20700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ffa7806ce20 0x7ffa7806d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:31:19.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.822+0000 7ffa7ec20700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa780ca4c0 con 0x7ffa780b3d40 2023-10-18T12:31:19.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.822+0000 7ffa7ec20700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa7806e2d0 con 0x7ffa7806ce20 2023-10-18T12:31:19.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.822+0000 7ffa7ec20700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7806d7d0 con 0x7ffa78164a20 2023-10-18T12:31:19.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.822+0000 7ffa7e41f700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ffa7806ce20 0x7ffa7806d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:31:19.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.822+0000 7ffa7e41f700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ffa7806ce20 0x7ffa7806d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40294/0 (socket says 172.21.15.114:40294) 2023-10-18T12:31:19.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.822+0000 7ffa7e41f700 1 -- 172.21.15.114:0/2796142524 learned_addr learned my addr 172.21.15.114:0/2796142524 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:31:19.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.822+0000 7ffa7d41d700 1 --2- 172.21.15.114:0/2796142524 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffa78164a20 0x7ffa780cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:31:19.828 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.822+0000 7ffa7e41f700 1 -- 172.21.15.114:0/2796142524 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffa78164a20 msgr2=0x7ffa780cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:31:19.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.822+0000 7ffa7e41f700 1 --2- 172.21.15.114:0/2796142524 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffa78164a20 0x7ffa780cc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:31:19.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.822+0000 7ffa7e41f700 1 -- 172.21.15.114:0/2796142524 >> v1:172.21.15.172:6789/0 conn(0x7ffa780b3d40 legacy=0x7ffa780c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:31:19.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.822+0000 7ffa7e41f700 1 -- 172.21.15.114:0/2796142524 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa780ca7a0 con 0x7ffa7806ce20 2023-10-18T12:31:19.829 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.822+0000 7ffa7e41f700 1 --2- 172.21.15.114:0/2796142524 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa7806ce20 0x7ffa7806d290 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7ffa70009910 tx=0x7ffa70009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a464427052fd3a30 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:31:19.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.822+0000 7ffa7cc1c700 1 -- 172.21.15.114:0/2796142524 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7000ba60 con 0x7ffa7806ce20 2023-10-18T12:31:19.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.822+0000 7ffa7cc1c700 1 -- 172.21.15.114:0/2796142524 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7000bbc0 con 0x7ffa7806ce20 2023-10-18T12:31:19.831 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.822+0000 7ffa7cc1c700 1 -- 172.21.15.114:0/2796142524 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa70009e60 con 0x7ffa7806ce20 2023-10-18T12:31:19.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.822+0000 7ffa7ec20700 1 -- 172.21.15.114:0/2796142524 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa7806ce20 msgr2=0x7ffa7806d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:31:19.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.822+0000 7ffa7ec20700 1 --2- 172.21.15.114:0/2796142524 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa7806ce20 0x7ffa7806d290 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7ffa70009910 tx=0x7ffa70009c20 comp rx=0 tx=0).stop 2023-10-18T12:31:19.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.822+0000 7ffa7ec20700 1 -- 172.21.15.114:0/2796142524 shutdown_connections 2023-10-18T12:31:19.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.822+0000 7ffa7ec20700 1 --2- 172.21.15.114:0/2796142524 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa7806ce20 0x7ffa7806d290 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:31:19.832 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.822+0000 7ffa7ec20700 1 --2- 172.21.15.114:0/2796142524 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffa78164a20 0x7ffa780cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:31:19.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.822+0000 7ffa7ec20700 1 -- 172.21.15.114:0/2796142524 >> 172.21.15.114:0/2796142524 conn(0x7ffa780ce5c0 msgr2=0x7ffa780ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:31:19.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.822+0000 7ffa7ec20700 1 -- 172.21.15.114:0/2796142524 shutdown_connections 2023-10-18T12:31:19.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.822+0000 7ffa7ec20700 1 -- 172.21.15.114:0/2796142524 wait complete. 2023-10-18T12:31:19.833 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.826+0000 7ffa7ec20700 1 Processor -- start 2023-10-18T12:31:19.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.826+0000 7ffa7ec20700 1 -- start start 2023-10-18T12:31:19.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.826+0000 7ffa7ec20700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa7806ce20 0x7ffa781f6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:31:19.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.826+0000 7ffa7ec20700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffa780b3d40 0x7ffa781518a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:31:19.836 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.826+0000 7ffa7ec20700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa78164a20 0x7ffa780c7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:31:19.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.830+0000 7ffa7ec20700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7815d2a0 con 0x7ffa7806ce20 2023-10-18T12:31:19.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.830+0000 7ffa7ec20700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa78151de0 con 0x7ffa78164a20 2023-10-18T12:31:19.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.830+0000 7ffa7ec20700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7815c620 con 0x7ffa780b3d40 2023-10-18T12:31:19.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.830+0000 7ffa7dc1e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa7806ce20 0x7ffa781f6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:31:19.837 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.830+0000 7ffa7dc1e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa7806ce20 0x7ffa781f6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40302/0 (socket says 172.21.15.114:40302) 2023-10-18T12:31:19.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.830+0000 7ffa7dc1e700 1 -- 172.21.15.114:0/1038174053 learned_addr learned my addr 172.21.15.114:0/1038174053 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:31:19.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.830+0000 7ffa7dc1e700 1 -- 172.21.15.114:0/1038174053 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffa780b3d40 msgr2=0x7ffa781518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:31:19.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.830+0000 7ffa7dc1e700 1 --2- 172.21.15.114:0/1038174053 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffa780b3d40 0x7ffa781518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:31:19.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.830+0000 7ffa7dc1e700 1 -- 172.21.15.114:0/1038174053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa78164a20 msgr2=0x7ffa780c7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:31:19.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.830+0000 7ffa7dc1e700 1 --2- 172.21.15.114:0/1038174053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa78164a20 0x7ffa780c7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:31:19.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.830+0000 7ffa7dc1e700 1 -- 172.21.15.114:0/1038174053 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa70009570 con 0x7ffa7806ce20 2023-10-18T12:31:19.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.830+0000 7ffa7dc1e700 1 --2- 172.21.15.114:0/1038174053 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa7806ce20 0x7ffa781f6cf0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7ffa74001ed0 tx=0x7ffa7400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:31:19.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.830+0000 7ffa6e7fc700 1 -- 172.21.15.114:0/1038174053 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7400ade0 con 0x7ffa7806ce20 2023-10-18T12:31:19.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.830+0000 7ffa6e7fc700 1 -- 172.21.15.114:0/1038174053 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa740020d0 con 0x7ffa7806ce20 2023-10-18T12:31:19.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.830+0000 7ffa7ec20700 1 -- 172.21.15.114:0/1038174053 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa7815c900 con 0x7ffa7806ce20 2023-10-18T12:31:19.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.830+0000 7ffa6e7fc700 1 -- 172.21.15.114:0/1038174053 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa74003c40 con 0x7ffa7806ce20 2023-10-18T12:31:19.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.830+0000 7ffa7ec20700 1 -- 172.21.15.114:0/1038174053 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa7815cec0 con 0x7ffa7806ce20 2023-10-18T12:31:19.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.830+0000 7ffa7ec20700 1 -- 172.21.15.114:0/1038174053 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa7815d3e0 con 0x7ffa7806ce20 2023-10-18T12:31:19.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.834+0000 7ffa6e7fc700 1 -- 172.21.15.114:0/1038174053 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ffa740050d0 con 0x7ffa7806ce20 2023-10-18T12:31:19.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.834+0000 7ffa6e7fc700 1 --2- 172.21.15.114:0/1038174053 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ffa5c0656f0 0x7ffa5c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:31:19.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.834+0000 7ffa6e7fc700 1 -- 172.21.15.114:0/1038174053 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7ffa74083130 con 0x7ffa7806ce20 2023-10-18T12:31:19.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.834+0000 7ffa7d41d700 1 --2- 172.21.15.114:0/1038174053 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ffa5c0656f0 0x7ffa5c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:31:19.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.834+0000 7ffa7d41d700 1 --2- 172.21.15.114:0/1038174053 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ffa5c0656f0 0x7ffa5c067bb0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ffa780c5ae0 tx=0x7ffa68008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:31:19.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.842+0000 7ffa6e7fc700 1 -- 172.21.15.114:0/1038174053 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7ffa7815d3e0 con 0x7ffa7806ce20 2023-10-18T12:31:19.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.846+0000 7f306dc7d700 1 Processor -- start 2023-10-18T12:31:19.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.846+0000 7f306dc7d700 1 -- start start 2023-10-18T12:31:19.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.846+0000 7f306dc7d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30680b1f70 0x7f30681609a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:31:19.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.846+0000 7f306dc7d700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3068161940 con 0x7f30680b6d80 2023-10-18T12:31:19.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.846+0000 7f306dc7d700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30680b5d10 con 0x7f30680b2350 2023-10-18T12:31:19.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.846+0000 7f306dc7d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f306806f680 con 0x7f30680b1f70 2023-10-18T12:31:19.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.846+0000 7f306d47c700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f30680b6d80 0x7f306806faa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:40850/0 (socket says 172.21.15.114:40850) 2023-10-18T12:31:19.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.846+0000 7f306d47c700 1 -- 172.21.15.114:0/1916055184 learned_addr learned my addr 172.21.15.114:0/1916055184 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:31:19.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.846+0000 7f306cc7b700 1 --2- 172.21.15.114:0/1916055184 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30680b1f70 0x7f30681609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:31:19.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.850+0000 7f30677fe700 1 -- 172.21.15.114:0/1916055184 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2806937734 0 0) 0x7f3068161940 con 0x7f30680b6d80 2023-10-18T12:31:19.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.850+0000 7f30677fe700 1 -- 172.21.15.114:0/1916055184 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30580035d0 con 0x7f30680b6d80 2023-10-18T12:31:19.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.850+0000 7f30677fe700 1 -- 172.21.15.114:0/1916055184 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2548920160 0 0) 0x7f30680b5d10 con 0x7f30680b2350 2023-10-18T12:31:19.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.850+0000 7f30677fe700 1 -- 172.21.15.114:0/1916055184 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3068161940 con 0x7f30680b2350 2023-10-18T12:31:19.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.850+0000 7f306cc7b700 1 -- 172.21.15.114:0/1916055184 >> v1:172.21.15.172:6789/0 conn(0x7f30680b2350 legacy=0x7f30680b6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:31:19.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.850+0000 7f306cc7b700 1 -- 172.21.15.114:0/1916055184 >> v1:172.21.15.114:6789/0 conn(0x7f30680b6d80 legacy=0x7f306806faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:31:19.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.850+0000 7f30677fe700 1 -- 172.21.15.114:0/1916055184 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2801309171 0 0) 0x7f30580035d0 con 0x7f30680b6d80 2023-10-18T12:31:19.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.850+0000 7f306cc7b700 1 -- 172.21.15.114:0/1916055184 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30681610a0 con 0x7f30680b1f70 2023-10-18T12:31:19.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.850+0000 7f306cc7b700 1 --2- 172.21.15.114:0/1916055184 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30680b1f70 0x7f30681609a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f305c009880 tx=0x7f305c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fab20ef195223cf server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:31:19.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.850+0000 7f30677fe700 1 -- 172.21.15.114:0/1916055184 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3060001a40 con 0x7f30680b1f70 2023-10-18T12:31:19.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.850+0000 7f30677fe700 1 -- 172.21.15.114:0/1916055184 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305c004030 con 0x7f30680b1f70 2023-10-18T12:31:19.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.850+0000 7f30677fe700 1 -- 172.21.15.114:0/1916055184 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c0043c0 con 0x7f30680b1f70 2023-10-18T12:31:19.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.850+0000 7f306dc7d700 1 -- 172.21.15.114:0/1916055184 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30680b1f70 msgr2=0x7f30681609a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:31:19.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.850+0000 7f306dc7d700 1 --2- 172.21.15.114:0/1916055184 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30680b1f70 0x7f30681609a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f305c009880 tx=0x7f305c009b90 comp rx=0 tx=0).stop 2023-10-18T12:31:19.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.850+0000 7f306dc7d700 1 -- 172.21.15.114:0/1916055184 shutdown_connections 2023-10-18T12:31:19.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.850+0000 7f306dc7d700 1 --2- 172.21.15.114:0/1916055184 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30680b1f70 0x7f30681609a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:31:19.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.850+0000 7f306dc7d700 1 -- 172.21.15.114:0/1916055184 >> 172.21.15.114:0/1916055184 conn(0x7f306806a500 msgr2=0x7f30680b47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:31:19.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.850+0000 7f306dc7d700 1 -- 172.21.15.114:0/1916055184 shutdown_connections 2023-10-18T12:31:19.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.850+0000 7f306dc7d700 1 -- 172.21.15.114:0/1916055184 wait complete. 2023-10-18T12:31:19.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.854+0000 7f306dc7d700 1 Processor -- start 2023-10-18T12:31:19.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.854+0000 7f306dc7d700 1 -- start start 2023-10-18T12:31:19.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.858+0000 7f306dc7d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30680b1f70 0x7f3068154d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:31:19.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.858+0000 7f306dc7d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30680b2350 0x7f306815f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:31:19.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.858+0000 7f306dc7d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30680b6d80 0x7f30681f1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:31:19.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.858+0000 7f306dc7d700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3068156250 con 0x7f30680b6d80 2023-10-18T12:31:19.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.858+0000 7f306dc7d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3068146ae0 con 0x7f30680b2350 2023-10-18T12:31:19.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.858+0000 7f306dc7d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3068155290 con 0x7f30680b1f70 2023-10-18T12:31:19.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.858+0000 7f306d47c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30680b6d80 0x7f30681f1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:31:19.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.858+0000 7f306d47c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30680b6d80 0x7f30681f1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40310/0 (socket says 172.21.15.114:40310) 2023-10-18T12:31:19.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.858+0000 7f306d47c700 1 -- 172.21.15.114:0/2873601849 learned_addr learned my addr 172.21.15.114:0/2873601849 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:31:19.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.858+0000 7f306cc7b700 1 --2- 172.21.15.114:0/2873601849 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30680b1f70 0x7f3068154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:31:19.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.858+0000 7f3067fff700 1 --2- 172.21.15.114:0/2873601849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30680b2350 0x7f306815f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:31:19.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.858+0000 7f306d47c700 1 -- 172.21.15.114:0/2873601849 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30680b1f70 msgr2=0x7f3068154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:31:19.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.858+0000 7f306d47c700 1 --2- 172.21.15.114:0/2873601849 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30680b1f70 0x7f3068154d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:31:19.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.858+0000 7f306d47c700 1 -- 172.21.15.114:0/2873601849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30680b2350 msgr2=0x7f306815f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:31:19.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.858+0000 7f306d47c700 1 --2- 172.21.15.114:0/2873601849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30680b2350 0x7f306815f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:31:19.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.858+0000 7f306d47c700 1 -- 172.21.15.114:0/2873601849 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305c0094b0 con 0x7f30680b6d80 2023-10-18T12:31:19.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.858+0000 7f306cc7b700 1 --2- 172.21.15.114:0/2873601849 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f30680b1f70 0x7f3068154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:31:19.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.858+0000 7f3067fff700 1 --2- 172.21.15.114:0/2873601849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30680b2350 0x7f306815f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:31:19.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.858+0000 7f306d47c700 1 --2- 172.21.15.114:0/2873601849 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30680b6d80 0x7f30681f1c90 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f3060002280 tx=0x7f306000cec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:31:19.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.858+0000 7f30657fa700 1 -- 172.21.15.114:0/2873601849 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306000ab00 con 0x7f30680b6d80 2023-10-18T12:31:19.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.858+0000 7f30657fa700 1 -- 172.21.15.114:0/2873601849 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306000ac60 con 0x7f30680b6d80 2023-10-18T12:31:19.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.858+0000 7f306dc7d700 1 -- 172.21.15.114:0/2873601849 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30681555d0 con 0x7f30680b6d80 2023-10-18T12:31:19.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.858+0000 7f30657fa700 1 -- 172.21.15.114:0/2873601849 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30600070d0 con 0x7f30680b6d80 2023-10-18T12:31:19.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.858+0000 7f306dc7d700 1 -- 172.21.15.114:0/2873601849 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3068155b90 con 0x7f30680b6d80 2023-10-18T12:31:19.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.858+0000 7f306dc7d700 1 -- 172.21.15.114:0/2873601849 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f3068156390 con 0x7f30680b6d80 2023-10-18T12:31:19.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.862+0000 7f30657fa700 1 -- 172.21.15.114:0/2873601849 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f3060007250 con 0x7f30680b6d80 2023-10-18T12:31:19.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.862+0000 7f30657fa700 1 --2- 172.21.15.114:0/2873601849 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f304c0656f0 0x7f304c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:31:19.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.862+0000 7f30657fa700 1 -- 172.21.15.114:0/2873601849 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7f3060082e20 con 0x7f30680b6d80 2023-10-18T12:31:19.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.862+0000 7f30657fa700 1 -- 172.21.15.114:0/2873601849 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+451 (secure 0 0 0) 0x7f3068156390 con 0x7f30680b6d80 2023-10-18T12:31:19.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.862+0000 7f306cc7b700 1 --2- 172.21.15.114:0/2873601849 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f304c0656f0 0x7f304c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:31:19.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.862+0000 7f306dc7d700 1 -- 172.21.15.114:0/2873601849 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7f3068156390 con 0x7f30680b6d80 2023-10-18T12:31:19.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:19.866+0000 7f306cc7b700 1 --2- 172.21.15.114:0/2873601849 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f304c0656f0 0x7f304c067bb0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f305c0097d0 tx=0x7f305c010000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:31:20.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:20.070+0000 7ffa7ec20700 1 -- 172.21.15.114:0/1038174053 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffa78072e60 con 0x7ffa7806ce20 2023-10-18T12:31:20.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:20.070+0000 7ffa6e7fc700 1 -- 172.21.15.114:0/1038174053 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4889 (secure 0 0 0) 0x7ffa740509f0 con 0x7ffa7806ce20 2023-10-18T12:31:20.075 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:31:20.076 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2034957068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2034957068},{"type":"v1","addr":"172.21.15.172:6836","nonce":2034957068}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5039,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4215710360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4215710360},{"type":"v1","addr":"172.21.15.172:6837","nonce":4215710360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2387835210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2387835210},{"type":"v1","addr":"172.21.15.114:6833","nonce":2387835210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T12:21:14.159069+0000","modified":"2023-10-18T12:29:23.762500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":126,"addr":"172.21.15.114:6835/1284474820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1284474820},{"type":"v1","addr":"172.21.15.114:6835","nonce":1284474820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-18T12:31:20.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:20.074+0000 7ffa7ec20700 1 -- 172.21.15.114:0/1038174053 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ffa5c0656f0 msgr2=0x7ffa5c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:31:20.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:20.074+0000 7ffa7ec20700 1 --2- 172.21.15.114:0/1038174053 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ffa5c0656f0 0x7ffa5c067bb0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ffa780c5ae0 tx=0x7ffa68008040 comp rx=0 tx=0).stop 2023-10-18T12:31:20.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:20.074+0000 7ffa7ec20700 1 -- 172.21.15.114:0/1038174053 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa7806ce20 msgr2=0x7ffa781f6cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:31:20.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:20.074+0000 7ffa7ec20700 1 --2- 172.21.15.114:0/1038174053 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa7806ce20 0x7ffa781f6cf0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7ffa74001ed0 tx=0x7ffa7400a340 comp rx=0 tx=0).stop 2023-10-18T12:31:20.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:20.074+0000 7ffa7ec20700 1 -- 172.21.15.114:0/1038174053 shutdown_connections 2023-10-18T12:31:20.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:20.074+0000 7ffa7ec20700 1 --2- 172.21.15.114:0/1038174053 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ffa5c0656f0 0x7ffa5c067bb0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:31:20.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:20.074+0000 7ffa7ec20700 1 --2- 172.21.15.114:0/1038174053 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffa780b3d40 0x7ffa781518a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:31:20.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:20.074+0000 7ffa7ec20700 1 --2- 172.21.15.114:0/1038174053 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa78164a20 0x7ffa780c7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:31:20.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:20.074+0000 7ffa7ec20700 1 --2- 172.21.15.114:0/1038174053 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa7806ce20 0x7ffa781f6cf0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:31:20.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:20.074+0000 7ffa7ec20700 1 -- 172.21.15.114:0/1038174053 >> 172.21.15.114:0/1038174053 conn(0x7ffa780ce5c0 msgr2=0x7ffa78164f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:31:20.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:20.074+0000 7ffa7ec20700 1 -- 172.21.15.114:0/1038174053 shutdown_connections 2023-10-18T12:31:20.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:20.074+0000 7ffa7ec20700 1 -- 172.21.15.114:0/1038174053 wait complete. 2023-10-18T12:31:20.080 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 20 2023-10-18T12:31:20.098 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-10-18T12:31:20.284 INFO:teuthology.orchestra.run.smithi114.stdout:[{"id":5162,"entity":{"name":{"type":"client","num":5162},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":989916161}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":596.29818574399997,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.25214975242121118,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":3,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5162 v1:192.168.0.1:0/989916161","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi172","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}}] 2023-10-18T12:31:20.285 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "1", "hostname": "smithi172", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 989916161, "type": "v1" }, "name": { "num": 5162, "type": "client" } }, "id": 5162, "inst": "client.5162 v1:192.168.0.1:0/989916161", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 3, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.2521497524212112 }, "state": "open", "uptime": 596.298185744 } ] 2023-10-18T12:31:20.387 DEBUG:tasks.ceph_test_case:No log hits yet, waiting... 2023-10-18T12:31:34.226 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:31:34.234 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:31:55.412 ERROR:tasks.ceph_test_case:Log output: 2023-10-18T12:31:55.413 DEBUG:tasks.cephfs.test_client_recovery:Expected log message found: 'Health check cleared: MDS_CLIENTS_LAGGY', retrying 2023-10-18T12:31:56.414 DEBUG:teuthology.orchestra.run.smithi114:> sudo daemon-helper kill ceph --cluster ceph -w 2023-10-18T12:31:56.422 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T12:31:56.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.589+0000 7fdb1333a700 1 Processor -- start 2023-10-18T12:31:56.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.593+0000 7fdb1333a700 1 -- start start 2023-10-18T12:31:56.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.593+0000 7fdb1333a700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fdb0c156e80 0x7fdb0c070a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:31:56.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.593+0000 7fdb1333a700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdb0c069d10 0x7fdb0c06a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:31:56.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.593+0000 7fdb1333a700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb0c06a6a0 con 0x7fdb0c06d6c0 2023-10-18T12:31:56.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.593+0000 7fdb1333a700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb0c15a750 con 0x7fdb0c069d10 2023-10-18T12:31:56.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.593+0000 7fdb1333a700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb0c06ff60 con 0x7fdb0c156e80 2023-10-18T12:31:56.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.593+0000 7fdb108d5700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdb0c069d10 0x7fdb0c06a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:31:56.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.593+0000 7fdb108d5700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdb0c069d10 0x7fdb0c06a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45008/0 (socket says 172.21.15.114:45008) 2023-10-18T12:31:56.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.593+0000 7fdb108d5700 1 -- 172.21.15.114:0/2931665574 learned_addr learned my addr 172.21.15.114:0/2931665574 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:31:56.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.593+0000 7fdb110d6700 1 --2- 172.21.15.114:0/2931665574 >> v2:172.21.15.172:3300/0 conn(0x7fdb0c156e80 0x7fdb0c070a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:31:56.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.593+0000 7fdb108d5700 1 -- 172.21.15.114:0/2931665574 >> v2:172.21.15.172:3300/0 conn(0x7fdb0c156e80 msgr2=0x7fdb0c070a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:31:56.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.593+0000 7fdb108d5700 1 --2- 172.21.15.114:0/2931665574 >> v2:172.21.15.172:3300/0 conn(0x7fdb0c156e80 0x7fdb0c070a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:31:56.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.593+0000 7fdb108d5700 1 -- 172.21.15.114:0/2931665574 >> v1:172.21.15.172:6789/0 conn(0x7fdb0c06d6c0 legacy=0x7fdb0c06dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:31:56.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.593+0000 7fdb108d5700 1 -- 172.21.15.114:0/2931665574 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb0c06e3b0 con 0x7fdb0c069d10 2023-10-18T12:31:56.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.593+0000 7fdb108d5700 1 --2- 172.21.15.114:0/2931665574 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb0c069d10 0x7fdb0c06a160 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c071b30 tx=0x7fdafc00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=531f680d1954169e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:31:56.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.593+0000 7fdb03fff700 1 -- 172.21.15.114:0/2931665574 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdafc00dbd0 con 0x7fdb0c069d10 2023-10-18T12:31:56.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.593+0000 7fdb03fff700 1 -- 172.21.15.114:0/2931665574 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdafc00dd30 con 0x7fdb0c069d10 2023-10-18T12:31:56.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.593+0000 7fdb03fff700 1 -- 172.21.15.114:0/2931665574 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdafc00dea0 con 0x7fdb0c069d10 2023-10-18T12:31:56.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.597+0000 7fdb1333a700 1 -- 172.21.15.114:0/2931665574 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb0c069d10 msgr2=0x7fdb0c06a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:31:56.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.597+0000 7fdb1333a700 1 --2- 172.21.15.114:0/2931665574 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb0c069d10 0x7fdb0c06a160 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c071b30 tx=0x7fdafc00bea0 comp rx=0 tx=0).stop 2023-10-18T12:31:56.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.597+0000 7fdb1333a700 1 -- 172.21.15.114:0/2931665574 shutdown_connections 2023-10-18T12:31:56.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.597+0000 7fdb1333a700 1 --2- 172.21.15.114:0/2931665574 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb0c069d10 0x7fdb0c06a160 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:31:56.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.597+0000 7fdb1333a700 1 --2- 172.21.15.114:0/2931665574 >> v2:172.21.15.172:3300/0 conn(0x7fdb0c156e80 0x7fdb0c070a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:31:56.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.597+0000 7fdb1333a700 1 -- 172.21.15.114:0/2931665574 >> 172.21.15.114:0/2931665574 conn(0x7fdb0c0b0b90 msgr2=0x7fdb0c0b0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:31:56.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.597+0000 7fdb1333a700 1 -- 172.21.15.114:0/2931665574 shutdown_connections 2023-10-18T12:31:56.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.597+0000 7fdb1333a700 1 -- 172.21.15.114:0/2931665574 wait complete. 2023-10-18T12:31:56.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.597+0000 7fdb1333a700 1 Processor -- start 2023-10-18T12:31:56.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.597+0000 7fdb1333a700 1 -- start start 2023-10-18T12:31:56.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.601+0000 7fdb1333a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb0c069d10 0x7fdb0c14f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:31:56.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.601+0000 7fdb1333a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb0c06d6c0 0x7fdb0c1eeb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:31:56.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.601+0000 7fdb1333a700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdb0c156e80 0x7fdb0c1577d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:31:56.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.601+0000 7fdb1333a700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c155190 con 0x7fdb0c06d6c0 2023-10-18T12:31:56.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.601+0000 7fdb1333a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c155470 con 0x7fdb0c069d10 2023-10-18T12:31:56.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.601+0000 7fdb1333a700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c155750 con 0x7fdb0c156e80 2023-10-18T12:31:56.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.601+0000 7fdb108d5700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb0c06d6c0 0x7fdb0c1eeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:31:56.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.601+0000 7fdb108d5700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb0c06d6c0 0x7fdb0c1eeb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45012/0 (socket says 172.21.15.114:45012) 2023-10-18T12:31:56.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.601+0000 7fdb108d5700 1 -- 172.21.15.114:0/1459726088 learned_addr learned my addr 172.21.15.114:0/1459726088 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:31:56.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.601+0000 7fdb110d6700 1 --2- 172.21.15.114:0/1459726088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb0c069d10 0x7fdb0c14f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:31:56.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.601+0000 7fdb118d7700 1 --2- 172.21.15.114:0/1459726088 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdb0c156e80 0x7fdb0c1577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:31:56.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.601+0000 7fdb108d5700 1 -- 172.21.15.114:0/1459726088 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdb0c156e80 msgr2=0x7fdb0c1577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:31:56.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.601+0000 7fdb108d5700 1 --2- 172.21.15.114:0/1459726088 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdb0c156e80 0x7fdb0c1577d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:31:56.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.601+0000 7fdb108d5700 1 -- 172.21.15.114:0/1459726088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb0c069d10 msgr2=0x7fdb0c14f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:31:56.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.601+0000 7fdb108d5700 1 --2- 172.21.15.114:0/1459726088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb0c069d10 0x7fdb0c14f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:31:56.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.601+0000 7fdb108d5700 1 -- 172.21.15.114:0/1459726088 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdafc00b820 con 0x7fdb0c06d6c0 2023-10-18T12:31:56.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.601+0000 7fdb118d7700 1 --2- 172.21.15.114:0/1459726088 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdb0c156e80 0x7fdb0c1577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:31:56.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.601+0000 7fdb108d5700 1 --2- 172.21.15.114:0/1459726088 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb0c06d6c0 0x7fdb0c1eeb90 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fdafc01a040 tx=0x7fdafc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:31:56.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.601+0000 7fdb01ffb700 1 -- 172.21.15.114:0/1459726088 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdafc00dea0 con 0x7fdb0c06d6c0 2023-10-18T12:31:56.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.601+0000 7fdb01ffb700 1 -- 172.21.15.114:0/1459726088 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdafc017e00 con 0x7fdb0c06d6c0 2023-10-18T12:31:56.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.601+0000 7fdb1333a700 1 -- 172.21.15.114:0/1459726088 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb0c1e3fe0 con 0x7fdb0c06d6c0 2023-10-18T12:31:56.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.601+0000 7fdb01ffb700 1 -- 172.21.15.114:0/1459726088 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdafc022690 con 0x7fdb0c06d6c0 2023-10-18T12:31:56.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.601+0000 7fdb1333a700 1 -- 172.21.15.114:0/1459726088 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb0c14f030 con 0x7fdb0c06d6c0 2023-10-18T12:31:56.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.605+0000 7fdb1333a700 1 -- 172.21.15.114:0/1459726088 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb0c1e41f0 con 0x7fdb0c06d6c0 2023-10-18T12:31:56.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.605+0000 7fdb01ffb700 1 -- 172.21.15.114:0/1459726088 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fdafc01e070 con 0x7fdb0c06d6c0 2023-10-18T12:31:56.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.605+0000 7fdb01ffb700 1 --2- 172.21.15.114:0/1459726088 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdaf00656f0 0x7fdaf0067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:31:56.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.609+0000 7fdb01ffb700 1 -- 172.21.15.114:0/1459726088 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7fdafc086490 con 0x7fdb0c06d6c0 2023-10-18T12:31:56.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.609+0000 7fdb110d6700 1 --2- 172.21.15.114:0/1459726088 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdaf00656f0 0x7fdaf0067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:31:56.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.609+0000 7fdb110d6700 1 --2- 172.21.15.114:0/1459726088 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdaf00656f0 0x7fdaf0067bb0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdb0800b9d0 tx=0x7fdb08008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:31:56.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.613+0000 7fdb01ffb700 1 -- 172.21.15.114:0/1459726088 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fdafc053dd0 con 0x7fdb0c06d6c0 2023-10-18T12:31:56.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.617+0000 7fbcf5d73700 1 Processor -- start 2023-10-18T12:31:56.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.617+0000 7fbcf5d73700 1 -- start start 2023-10-18T12:31:56.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.617+0000 7fbcf5d73700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbcf015ab80 0x7fbcf006f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:31:56.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.617+0000 7fbcf5d73700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbcf00cb8e0 0x7fbcf00b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:31:56.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.617+0000 7fbcf5d73700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcf00709d0 con 0x7fbcf015af60 2023-10-18T12:31:56.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.617+0000 7fbcf5d73700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcf0070e60 con 0x7fbcf015ab80 2023-10-18T12:31:56.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.617+0000 7fbcf5d73700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf006fdc0 con 0x7fbcf00cb8e0 2023-10-18T12:31:56.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.617+0000 7fbcf5572700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbcf00cb8e0 0x7fbcf00b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:31:56.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.617+0000 7fbceffff700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fbcf015af60 0x7fbcf00cb1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.114:50032/0 (socket says 172.21.15.114:50032) 2023-10-18T12:31:56.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.617+0000 7fbceffff700 1 -- 172.21.15.114:0/3436328434 learned_addr learned my addr 172.21.15.114:0/3436328434 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:31:56.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.617+0000 7fbcf4d71700 1 --2- 172.21.15.114:0/3436328434 >> v2:172.21.15.172:3300/0 conn(0x7fbcf015ab80 0x7fbcf006f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:31:56.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.617+0000 7fbcf5572700 1 -- 172.21.15.114:0/3436328434 >> v2:172.21.15.172:3300/0 conn(0x7fbcf015ab80 msgr2=0x7fbcf006f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:31:56.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.617+0000 7fbcef7fe700 1 -- 172.21.15.114:0/3436328434 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3532274196 0 0) 0x7fbcf00709d0 con 0x7fbcf015af60 2023-10-18T12:31:56.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.617+0000 7fbcf5572700 1 --2- 172.21.15.114:0/3436328434 >> v2:172.21.15.172:3300/0 conn(0x7fbcf015ab80 0x7fbcf006f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:31:56.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.617+0000 7fbcf5572700 1 -- 172.21.15.114:0/3436328434 >> v1:172.21.15.172:6789/0 conn(0x7fbcf015af60 legacy=0x7fbcf00cb1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:31:56.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.617+0000 7fbcf5572700 1 -- 172.21.15.114:0/3436328434 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf00700a0 con 0x7fbcf00cb8e0 2023-10-18T12:31:56.627 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.621+0000 7fbcf5572700 1 --2- 172.21.15.114:0/3436328434 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbcf00cb8e0 0x7fbcf00b3a00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbce8009d90 tx=0x7fbce800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1faee227a64c128 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:31:56.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.621+0000 7fbcef7fe700 1 -- 172.21.15.114:0/3436328434 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce800e070 con 0x7fbcf00cb8e0 2023-10-18T12:31:56.628 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.621+0000 7fbcef7fe700 1 -- 172.21.15.114:0/3436328434 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce800bb20 con 0x7fbcf00cb8e0 2023-10-18T12:31:56.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.621+0000 7fbcef7fe700 1 -- 172.21.15.114:0/3436328434 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce8012430 con 0x7fbcf00cb8e0 2023-10-18T12:31:56.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.621+0000 7fbcf5d73700 1 -- 172.21.15.114:0/3436328434 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbcf00cb8e0 msgr2=0x7fbcf00b3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:31:56.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.621+0000 7fbcf5d73700 1 --2- 172.21.15.114:0/3436328434 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbcf00cb8e0 0x7fbcf00b3a00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbce8009d90 tx=0x7fbce800b330 comp rx=0 tx=0).stop 2023-10-18T12:31:56.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.621+0000 7fbcf5d73700 1 -- 172.21.15.114:0/3436328434 shutdown_connections 2023-10-18T12:31:56.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.621+0000 7fbcf5d73700 1 --2- 172.21.15.114:0/3436328434 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbcf00cb8e0 0x7fbcf00b3a00 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:31:56.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.621+0000 7fbcf5d73700 1 --2- 172.21.15.114:0/3436328434 >> v2:172.21.15.172:3300/0 conn(0x7fbcf015ab80 0x7fbcf006f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:31:56.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.621+0000 7fbcf5d73700 1 -- 172.21.15.114:0/3436328434 >> 172.21.15.114:0/3436328434 conn(0x7fbcf00d0970 msgr2=0x7fbcf00d0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:31:56.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.621+0000 7fbcf5d73700 1 -- 172.21.15.114:0/3436328434 shutdown_connections 2023-10-18T12:31:56.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.621+0000 7fbcf5d73700 1 -- 172.21.15.114:0/3436328434 wait complete. 2023-10-18T12:31:56.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.625+0000 7fbcf5d73700 1 Processor -- start 2023-10-18T12:31:56.631 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.625+0000 7fbcf5d73700 1 -- start start 2023-10-18T12:31:56.633 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.629+0000 7fbcf5d73700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbcf00cb8e0 0x7fbcf0158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:31:56.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.629+0000 7fbcf5d73700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbcf015ab80 0x7fbcf00ca4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:31:56.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.629+0000 7fbcf5d73700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbcf00c57f0 0x7fbcf00c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:31:56.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.629+0000 7fbcf5d73700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf00b26d0 con 0x7fbcf00c57f0 2023-10-18T12:31:56.634 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.629+0000 7fbcf5d73700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf00b1ac0 con 0x7fbcf015ab80 2023-10-18T12:31:56.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.629+0000 7fbcf5d73700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf00b1da0 con 0x7fbcf00cb8e0 2023-10-18T12:31:56.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.629+0000 7fbcf5572700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbcf00c57f0 0x7fbcf00c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:31:56.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.629+0000 7fbcf5572700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbcf00c57f0 0x7fbcf00c8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45014/0 (socket says 172.21.15.114:45014) 2023-10-18T12:31:56.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.629+0000 7fbcf5572700 1 -- 172.21.15.114:0/539634128 learned_addr learned my addr 172.21.15.114:0/539634128 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:31:56.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.629+0000 7fbcf4d71700 1 --2- 172.21.15.114:0/539634128 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbcf00cb8e0 0x7fbcf0158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:31:56.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.629+0000 7fbceffff700 1 --2- 172.21.15.114:0/539634128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbcf015ab80 0x7fbcf00ca4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:31:56.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.629+0000 7fbcf5572700 1 -- 172.21.15.114:0/539634128 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbcf00cb8e0 msgr2=0x7fbcf0158f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:31:56.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.629+0000 7fbcf5572700 1 --2- 172.21.15.114:0/539634128 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbcf00cb8e0 0x7fbcf0158f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:31:56.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.629+0000 7fbcf5572700 1 -- 172.21.15.114:0/539634128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbcf015ab80 msgr2=0x7fbcf00ca4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:31:56.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.629+0000 7fbcf5572700 1 --2- 172.21.15.114:0/539634128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbcf015ab80 0x7fbcf00ca4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:31:56.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.629+0000 7fbcf5572700 1 -- 172.21.15.114:0/539634128 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce8009a70 con 0x7fbcf00c57f0 2023-10-18T12:31:56.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.629+0000 7fbceffff700 1 --2- 172.21.15.114:0/539634128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbcf015ab80 0x7fbcf00ca4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:31:56.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.629+0000 7fbcf5572700 1 --2- 172.21.15.114:0/539634128 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbcf00c57f0 0x7fbcf00c8430 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fbce8014040 tx=0x7fbce8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:31:56.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.629+0000 7fbced7fa700 1 -- 172.21.15.114:0/539634128 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce8012430 con 0x7fbcf00c57f0 2023-10-18T12:31:56.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.629+0000 7fbced7fa700 1 -- 172.21.15.114:0/539634128 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce8020070 con 0x7fbcf00c57f0 2023-10-18T12:31:56.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.629+0000 7fbcf5d73700 1 -- 172.21.15.114:0/539634128 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcf00b2080 con 0x7fbcf00c57f0 2023-10-18T12:31:56.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.629+0000 7fbced7fa700 1 -- 172.21.15.114:0/539634128 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce8004280 con 0x7fbcf00c57f0 2023-10-18T12:31:56.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.629+0000 7fbcf5d73700 1 -- 172.21.15.114:0/539634128 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcf0159440 con 0x7fbcf00c57f0 2023-10-18T12:31:56.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.633+0000 7fbcf5d73700 1 -- 172.21.15.114:0/539634128 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fbcf00b2880 con 0x7fbcf00c57f0 2023-10-18T12:31:56.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.633+0000 7fbced7fa700 1 -- 172.21.15.114:0/539634128 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fbce80043e0 con 0x7fbcf00c57f0 2023-10-18T12:31:56.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.633+0000 7fbced7fa700 1 --2- 172.21.15.114:0/539634128 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fbcd4065720 0x7fbcd4067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:31:56.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.633+0000 7fbced7fa700 1 -- 172.21.15.114:0/539634128 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7fbce8022070 con 0x7fbcf00c57f0 2023-10-18T12:31:56.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.633+0000 7fbced7fa700 1 -- 172.21.15.114:0/539634128 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+449 (secure 0 0 0) 0x7fbcf00b2880 con 0x7fbcf00c57f0 2023-10-18T12:31:56.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.633+0000 7fbcf4d71700 1 --2- 172.21.15.114:0/539634128 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fbcd4065720 0x7fbcd4067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:31:56.641 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.633+0000 7fbcf5d73700 1 -- 172.21.15.114:0/539634128 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7fbcf00b2840 con 0x7fbcf00c57f0 2023-10-18T12:31:56.642 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.637+0000 7fbcf4d71700 1 --2- 172.21.15.114:0/539634128 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fbcd4065720 0x7fbcd4067be0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbce4009bf0 tx=0x7fbce4009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:31:56.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.845+0000 7fdb1333a700 1 -- 172.21.15.114:0/1459726088 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdb0c06a6a0 con 0x7fdb0c06d6c0 2023-10-18T12:31:56.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.845+0000 7fdb01ffb700 1 -- 172.21.15.114:0/1459726088 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4889 (secure 0 0 0) 0x7fdb0c06a6a0 con 0x7fdb0c06d6c0 2023-10-18T12:31:56.851 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:31:56.851 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2034957068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2034957068},{"type":"v1","addr":"172.21.15.172:6836","nonce":2034957068}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5039,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4215710360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4215710360},{"type":"v1","addr":"172.21.15.172:6837","nonce":4215710360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2387835210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2387835210},{"type":"v1","addr":"172.21.15.114:6833","nonce":2387835210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T12:21:14.159069+0000","modified":"2023-10-18T12:29:23.762500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":126,"addr":"172.21.15.114:6835/1284474820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1284474820},{"type":"v1","addr":"172.21.15.114:6835","nonce":1284474820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-18T12:31:56.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.849+0000 7fdb1333a700 1 -- 172.21.15.114:0/1459726088 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdaf00656f0 msgr2=0x7fdaf0067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:31:56.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.849+0000 7fdb1333a700 1 --2- 172.21.15.114:0/1459726088 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdaf00656f0 0x7fdaf0067bb0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdb0800b9d0 tx=0x7fdb08008040 comp rx=0 tx=0).stop 2023-10-18T12:31:56.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.849+0000 7fdb1333a700 1 -- 172.21.15.114:0/1459726088 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb0c06d6c0 msgr2=0x7fdb0c1eeb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:31:56.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.849+0000 7fdb1333a700 1 --2- 172.21.15.114:0/1459726088 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb0c06d6c0 0x7fdb0c1eeb90 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fdafc01a040 tx=0x7fdafc004770 comp rx=0 tx=0).stop 2023-10-18T12:31:56.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.849+0000 7fdb1333a700 1 -- 172.21.15.114:0/1459726088 shutdown_connections 2023-10-18T12:31:56.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.849+0000 7fdb1333a700 1 --2- 172.21.15.114:0/1459726088 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdaf00656f0 0x7fdaf0067bb0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:31:56.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.849+0000 7fdb1333a700 1 --2- 172.21.15.114:0/1459726088 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdb0c156e80 0x7fdb0c1577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:31:56.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.849+0000 7fdb1333a700 1 --2- 172.21.15.114:0/1459726088 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb0c06d6c0 0x7fdb0c1eeb90 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:31:56.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.849+0000 7fdb1333a700 1 --2- 172.21.15.114:0/1459726088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb0c069d10 0x7fdb0c14f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:31:56.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.849+0000 7fdb1333a700 1 -- 172.21.15.114:0/1459726088 >> 172.21.15.114:0/1459726088 conn(0x7fdb0c0b0b90 msgr2=0x7fdb0c0ca990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:31:56.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.849+0000 7fdb1333a700 1 -- 172.21.15.114:0/1459726088 shutdown_connections 2023-10-18T12:31:56.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:31:56.849+0000 7fdb1333a700 1 -- 172.21.15.114:0/1459726088 wait complete. 2023-10-18T12:31:56.856 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 20 2023-10-18T12:31:56.873 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-10-18T12:31:57.059 INFO:teuthology.orchestra.run.smithi114.stdout:[{"id":5162,"entity":{"name":{"type":"client","num":5162},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":989916161}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":633.07336267000005,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.23160989422884823,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":3,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5162 v1:192.168.0.1:0/989916161","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi172","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}}] 2023-10-18T12:31:57.060 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "1", "hostname": "smithi172", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 989916161, "type": "v1" }, "name": { "num": 5162, "type": "client" } }, "id": 5162, "inst": "client.5162 v1:192.168.0.1:0/989916161", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 3, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.23160989422884823 }, "state": "open", "uptime": 633.07336267 } ] 2023-10-18T12:31:57.161 DEBUG:tasks.ceph_test_case:No log hits yet, waiting... 2023-10-18T12:32:04.323 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:32:04.331 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:32:32.186 ERROR:tasks.ceph_test_case:Log output: 2023-10-18T12:32:32.186 DEBUG:tasks.cephfs.test_client_recovery:Expected log message found: 'Health check cleared: MDS_CLIENTS_LAGGY', retrying 2023-10-18T12:32:33.188 DEBUG:teuthology.orchestra.run.smithi114:> sudo daemon-helper kill ceph --cluster ceph -w 2023-10-18T12:32:33.196 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T12:32:33.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.360+0000 7fb488f11700 1 Processor -- start 2023-10-18T12:32:33.369 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.360+0000 7fb488f11700 1 -- start start 2023-10-18T12:32:33.370 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.364+0000 7fb488f11700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb48406d470 0x7fb484070a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:32:33.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.364+0000 7fb488f11700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb484070f50 0x7fb48415a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:32:33.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.364+0000 7fb488f11700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb48415e990 con 0x7fb48406d090 2023-10-18T12:32:33.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.364+0000 7fb488f11700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb48415f4f0 con 0x7fb484070f50 2023-10-18T12:32:33.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.364+0000 7fb488f11700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4840b2ca0 con 0x7fb48406d470 2023-10-18T12:32:33.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.364+0000 7fb483fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb484070f50 0x7fb48415a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:32:33.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.364+0000 7fb483fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb484070f50 0x7fb48415a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58004/0 (socket says 172.21.15.114:58004) 2023-10-18T12:32:33.372 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.364+0000 7fb483fff700 1 -- 172.21.15.114:0/1595259756 learned_addr learned my addr 172.21.15.114:0/1595259756 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:32:33.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.364+0000 7fb47affd700 1 --2- 172.21.15.114:0/1595259756 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb48406d470 0x7fb484070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:32:33.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.364+0000 7fb483fff700 1 -- 172.21.15.114:0/1595259756 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb48406d470 msgr2=0x7fb484070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:32:33.373 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.364+0000 7fb483fff700 1 --2- 172.21.15.114:0/1595259756 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb48406d470 0x7fb484070a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:32:33.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.364+0000 7fb483fff700 1 -- 172.21.15.114:0/1595259756 >> v1:172.21.15.172:6789/0 conn(0x7fb48406d090 legacy=0x7fb4840b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:32:33.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.364+0000 7fb483fff700 1 -- 172.21.15.114:0/1595259756 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb48415ec50 con 0x7fb484070f50 2023-10-18T12:32:33.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.364+0000 7fb47affd700 1 --2- 172.21.15.114:0/1595259756 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb48406d470 0x7fb484070a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:32:33.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.364+0000 7fb483fff700 1 --2- 172.21.15.114:0/1595259756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb484070f50 0x7fb48415a410 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fb47c009e50 tx=0x7fb47c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb8839cacaf717d server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:32:33.374 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.364+0000 7fb482ffd700 1 -- 172.21.15.114:0/1595259756 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47c00e070 con 0x7fb484070f50 2023-10-18T12:32:33.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.364+0000 7fb482ffd700 1 -- 172.21.15.114:0/1595259756 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb47c00b9c0 con 0x7fb484070f50 2023-10-18T12:32:33.375 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.364+0000 7fb482ffd700 1 -- 172.21.15.114:0/1595259756 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47c00bd70 con 0x7fb484070f50 2023-10-18T12:32:33.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.368+0000 7fb488f11700 1 -- 172.21.15.114:0/1595259756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb484070f50 msgr2=0x7fb48415a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:32:33.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.368+0000 7fb488f11700 1 --2- 172.21.15.114:0/1595259756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb484070f50 0x7fb48415a410 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fb47c009e50 tx=0x7fb47c00b330 comp rx=0 tx=0).stop 2023-10-18T12:32:33.376 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.368+0000 7fb488f11700 1 -- 172.21.15.114:0/1595259756 shutdown_connections 2023-10-18T12:32:33.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.368+0000 7fb488f11700 1 --2- 172.21.15.114:0/1595259756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb484070f50 0x7fb48415a410 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:32:33.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.368+0000 7fb488f11700 1 --2- 172.21.15.114:0/1595259756 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb48406d470 0x7fb484070a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:32:33.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.368+0000 7fb488f11700 1 -- 172.21.15.114:0/1595259756 >> 172.21.15.114:0/1595259756 conn(0x7fb4840ce5c0 msgr2=0x7fb4840ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:32:33.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.368+0000 7fb488f11700 1 -- 172.21.15.114:0/1595259756 shutdown_connections 2023-10-18T12:32:33.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.368+0000 7fb488f11700 1 -- 172.21.15.114:0/1595259756 wait complete. 2023-10-18T12:32:33.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.368+0000 7fb488f11700 1 Processor -- start 2023-10-18T12:32:33.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.372+0000 7fb488f11700 1 -- start start 2023-10-18T12:32:33.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.372+0000 7fb488f11700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb48406d090 0x7fb484151980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:32:33.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.372+0000 7fb488f11700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb48406d470 0x7fb4840c45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:32:33.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.372+0000 7fb488f11700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb484070f50 0x7fb4840c4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:32:33.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.372+0000 7fb488f11700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4840c61b0 con 0x7fb48406d470 2023-10-18T12:32:33.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.372+0000 7fb488f11700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4840c5810 con 0x7fb48406d090 2023-10-18T12:32:33.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.372+0000 7fb488f11700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4840c5af0 con 0x7fb484070f50 2023-10-18T12:32:33.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.372+0000 7fb47affd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb48406d470 0x7fb4840c45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:32:33.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.372+0000 7fb47affd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb48406d470 0x7fb4840c45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58020/0 (socket says 172.21.15.114:58020) 2023-10-18T12:32:33.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.372+0000 7fb47affd700 1 -- 172.21.15.114:0/3210691983 learned_addr learned my addr 172.21.15.114:0/3210691983 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:32:33.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.372+0000 7fb4837fe700 1 --2- 172.21.15.114:0/3210691983 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb48406d090 0x7fb484151980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:32:33.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.372+0000 7fb483fff700 1 --2- 172.21.15.114:0/3210691983 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb484070f50 0x7fb4840c4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:32:33.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.372+0000 7fb47affd700 1 -- 172.21.15.114:0/3210691983 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb484070f50 msgr2=0x7fb4840c4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:32:33.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.372+0000 7fb47affd700 1 --2- 172.21.15.114:0/3210691983 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb484070f50 0x7fb4840c4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:32:33.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.372+0000 7fb47affd700 1 -- 172.21.15.114:0/3210691983 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb48406d090 msgr2=0x7fb484151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:32:33.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.372+0000 7fb47affd700 1 --2- 172.21.15.114:0/3210691983 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb48406d090 0x7fb484151980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:32:33.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.372+0000 7fb47affd700 1 -- 172.21.15.114:0/3210691983 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb47c009b30 con 0x7fb48406d470 2023-10-18T12:32:33.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.372+0000 7fb47affd700 1 --2- 172.21.15.114:0/3210691983 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb48406d470 0x7fb4840c45e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fb47400e760 tx=0x7fb47400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:32:33.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.372+0000 7fb480ff9700 1 -- 172.21.15.114:0/3210691983 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb474004230 con 0x7fb48406d470 2023-10-18T12:32:33.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.372+0000 7fb480ff9700 1 -- 172.21.15.114:0/3210691983 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4740043b0 con 0x7fb48406d470 2023-10-18T12:32:33.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.372+0000 7fb488f11700 1 -- 172.21.15.114:0/3210691983 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4840c5dd0 con 0x7fb48406d470 2023-10-18T12:32:33.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.372+0000 7fb480ff9700 1 -- 172.21.15.114:0/3210691983 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4740036c0 con 0x7fb48406d470 2023-10-18T12:32:33.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.372+0000 7fb488f11700 1 -- 172.21.15.114:0/3210691983 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4841529f0 con 0x7fb48406d470 2023-10-18T12:32:33.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.376+0000 7fb488f11700 1 -- 172.21.15.114:0/3210691983 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4840b27c0 con 0x7fb48406d470 2023-10-18T12:32:33.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.376+0000 7fb480ff9700 1 -- 172.21.15.114:0/3210691983 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fb474003820 con 0x7fb48406d470 2023-10-18T12:32:33.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.380+0000 7fb480ff9700 1 --2- 172.21.15.114:0/3210691983 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb4640656f0 0x7fb464067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:32:33.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.380+0000 7fb480ff9700 1 -- 172.21.15.114:0/3210691983 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7fb474082b30 con 0x7fb48406d470 2023-10-18T12:32:33.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.380+0000 7fb4837fe700 1 --2- 172.21.15.114:0/3210691983 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb4640656f0 0x7fb464067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:32:33.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.380+0000 7fb4837fe700 1 --2- 172.21.15.114:0/3210691983 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb4640656f0 0x7fb464067bb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb46c000f60 tx=0x7fb46c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:32:33.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.380+0000 7fb480ff9700 1 -- 172.21.15.114:0/3210691983 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fb4740503f0 con 0x7fb48406d470 2023-10-18T12:32:33.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.384+0000 7fd109918700 1 Processor -- start 2023-10-18T12:32:33.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.384+0000 7fd109918700 1 -- start start 2023-10-18T12:32:33.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.388+0000 7fd109918700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd10415ca90 0x7fd104069e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:32:33.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.388+0000 7fd109918700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd10415ce70 0x7fd104161280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:32:33.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.388+0000 7fd109918700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1041617c0 con 0x7fd10406b530 2023-10-18T12:32:33.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.388+0000 7fd109918700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd10406b0a0 con 0x7fd10415ce70 2023-10-18T12:32:33.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.388+0000 7fd109918700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd10406a490 con 0x7fd10415ca90 2023-10-18T12:32:33.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.388+0000 7fd1027fc700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd10415ce70 0x7fd104161280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:32:33.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.388+0000 7fd1027fc700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd10415ce70 0x7fd104161280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58028/0 (socket says 172.21.15.114:58028) 2023-10-18T12:32:33.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.388+0000 7fd1027fc700 1 -- 172.21.15.114:0/3011155816 learned_addr learned my addr 172.21.15.114:0/3011155816 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:32:33.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.388+0000 7fd102ffd700 1 --2- 172.21.15.114:0/3011155816 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd10415ca90 0x7fd104069e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:32:33.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.388+0000 7fd1027fc700 1 -- 172.21.15.114:0/3011155816 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd10415ca90 msgr2=0x7fd104069e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:32:33.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.388+0000 7fd1027fc700 1 --2- 172.21.15.114:0/3011155816 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd10415ca90 0x7fd104069e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:32:33.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.388+0000 7fd1027fc700 1 -- 172.21.15.114:0/3011155816 >> v1:172.21.15.172:6789/0 conn(0x7fd10406b530 legacy=0x7fd1040b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:32:33.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.388+0000 7fd1027fc700 1 -- 172.21.15.114:0/3011155816 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd10406a770 con 0x7fd10415ce70 2023-10-18T12:32:33.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.388+0000 7fd102ffd700 1 --2- 172.21.15.114:0/3011155816 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd10415ca90 0x7fd104069e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:32:33.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.388+0000 7fd1027fc700 1 --2- 172.21.15.114:0/3011155816 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd10415ce70 0x7fd104161280 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fd0f8009910 tx=0x7fd0f8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85cf3523b618db8f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:32:33.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.388+0000 7fd101ffb700 1 -- 172.21.15.114:0/3011155816 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f800ba60 con 0x7fd10415ce70 2023-10-18T12:32:33.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.388+0000 7fd101ffb700 1 -- 172.21.15.114:0/3011155816 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f800bbc0 con 0x7fd10415ce70 2023-10-18T12:32:33.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.388+0000 7fd101ffb700 1 -- 172.21.15.114:0/3011155816 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f8009e60 con 0x7fd10415ce70 2023-10-18T12:32:33.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.388+0000 7fd109918700 1 -- 172.21.15.114:0/3011155816 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd10415ce70 msgr2=0x7fd104161280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:32:33.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.388+0000 7fd109918700 1 --2- 172.21.15.114:0/3011155816 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd10415ce70 0x7fd104161280 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fd0f8009910 tx=0x7fd0f8009c20 comp rx=0 tx=0).stop 2023-10-18T12:32:33.400 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.388+0000 7fd109918700 1 -- 172.21.15.114:0/3011155816 shutdown_connections 2023-10-18T12:32:33.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.388+0000 7fd109918700 1 --2- 172.21.15.114:0/3011155816 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd10415ce70 0x7fd104161280 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:32:33.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.388+0000 7fd109918700 1 --2- 172.21.15.114:0/3011155816 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd10415ca90 0x7fd104069e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:32:33.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.388+0000 7fd109918700 1 -- 172.21.15.114:0/3011155816 >> 172.21.15.114:0/3011155816 conn(0x7fd1040cd670 msgr2=0x7fd1040cda80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:32:33.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.392+0000 7fd109918700 1 -- 172.21.15.114:0/3011155816 shutdown_connections 2023-10-18T12:32:33.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.392+0000 7fd109918700 1 -- 172.21.15.114:0/3011155816 wait complete. 2023-10-18T12:32:33.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.392+0000 7fd109918700 1 Processor -- start 2023-10-18T12:32:33.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.392+0000 7fd109918700 1 -- start start 2023-10-18T12:32:33.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.396+0000 7fd109918700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd10406b530 0x7fd1040b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:32:33.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.396+0000 7fd109918700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd10415ca90 0x7fd1041f6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:32:33.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.396+0000 7fd109918700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd10415ce70 0x7fd1040ca210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:32:33.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.396+0000 7fd109918700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1040c9190 con 0x7fd10415ce70 2023-10-18T12:32:33.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.396+0000 7fd109918700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1040c9470 con 0x7fd10406b530 2023-10-18T12:32:33.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.396+0000 7fd109918700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1040c9750 con 0x7fd10415ca90 2023-10-18T12:32:33.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.396+0000 7fd103fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd10415ce70 0x7fd1040ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:32:33.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.396+0000 7fd103fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd10415ce70 0x7fd1040ca210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:58036/0 (socket says 172.21.15.114:58036) 2023-10-18T12:32:33.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.396+0000 7fd103fff700 1 -- 172.21.15.114:0/4283148095 learned_addr learned my addr 172.21.15.114:0/4283148095 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:32:33.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.396+0000 7fd1027fc700 1 --2- 172.21.15.114:0/4283148095 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd10415ca90 0x7fd1041f6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:32:33.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.396+0000 7fd102ffd700 1 --2- 172.21.15.114:0/4283148095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd10406b530 0x7fd1040b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:32:33.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.396+0000 7fd103fff700 1 -- 172.21.15.114:0/4283148095 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd10415ca90 msgr2=0x7fd1041f6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:32:33.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.396+0000 7fd103fff700 1 --2- 172.21.15.114:0/4283148095 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd10415ca90 0x7fd1041f6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:32:33.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.396+0000 7fd103fff700 1 -- 172.21.15.114:0/4283148095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd10406b530 msgr2=0x7fd1040b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:32:33.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.396+0000 7fd103fff700 1 --2- 172.21.15.114:0/4283148095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd10406b530 0x7fd1040b43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:32:33.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.396+0000 7fd103fff700 1 -- 172.21.15.114:0/4283148095 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f8009570 con 0x7fd10415ce70 2023-10-18T12:32:33.407 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.396+0000 7fd102ffd700 1 --2- 172.21.15.114:0/4283148095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd10406b530 0x7fd1040b43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:32:33.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.396+0000 7fd103fff700 1 --2- 172.21.15.114:0/4283148095 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd10415ce70 0x7fd1040ca210 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc00cb50 tx=0x7fd0fc00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:32:33.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.396+0000 7fd0ebfff700 1 -- 172.21.15.114:0/4283148095 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc003c20 con 0x7fd10415ce70 2023-10-18T12:32:33.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.396+0000 7fd109918700 1 -- 172.21.15.114:0/4283148095 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1040c9a30 con 0x7fd10415ce70 2023-10-18T12:32:33.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.396+0000 7fd0ebfff700 1 -- 172.21.15.114:0/4283148095 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0fc003d80 con 0x7fd10415ce70 2023-10-18T12:32:33.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.396+0000 7fd0ebfff700 1 -- 172.21.15.114:0/4283148095 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc00aac0 con 0x7fd10415ce70 2023-10-18T12:32:33.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.396+0000 7fd109918700 1 -- 172.21.15.114:0/4283148095 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1040b4920 con 0x7fd10415ce70 2023-10-18T12:32:33.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.396+0000 7fd109918700 1 -- 172.21.15.114:0/4283148095 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fd104073f00 con 0x7fd10415ce70 2023-10-18T12:32:33.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.400+0000 7fd0ebfff700 1 -- 172.21.15.114:0/4283148095 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fd0fc00ac20 con 0x7fd10415ce70 2023-10-18T12:32:33.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.400+0000 7fd0ebfff700 1 --2- 172.21.15.114:0/4283148095 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd0f00656f0 0x7fd0f0067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:32:33.410 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.400+0000 7fd0ebfff700 1 -- 172.21.15.114:0/4283148095 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7fd0fc082f30 con 0x7fd10415ce70 2023-10-18T12:32:33.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.400+0000 7fd0ebfff700 1 -- 172.21.15.114:0/4283148095 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+449 (secure 0 0 0) 0x7fd0fc085490 con 0x7fd10415ce70 2023-10-18T12:32:33.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.400+0000 7fd102ffd700 1 --2- 172.21.15.114:0/4283148095 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd0f00656f0 0x7fd0f0067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:32:33.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.400+0000 7fd109918700 1 -- 172.21.15.114:0/4283148095 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7fd1041617c0 con 0x7fd10415ce70 2023-10-18T12:32:33.411 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.400+0000 7fd102ffd700 1 --2- 172.21.15.114:0/4283148095 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd0f00656f0 0x7fd0f0067bb0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd1040b42c0 tx=0x7fd0f4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:32:33.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.588+0000 7fb488f11700 1 -- 172.21.15.114:0/3210691983 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb48415ef00 con 0x7fb48406d470 2023-10-18T12:32:33.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.588+0000 7fb480ff9700 1 -- 172.21.15.114:0/3210691983 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4889 (secure 0 0 0) 0x7fb474020090 con 0x7fb48406d470 2023-10-18T12:32:33.597 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:32:33.597 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2034957068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2034957068},{"type":"v1","addr":"172.21.15.172:6836","nonce":2034957068}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5039,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4215710360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4215710360},{"type":"v1","addr":"172.21.15.172:6837","nonce":4215710360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2387835210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2387835210},{"type":"v1","addr":"172.21.15.114:6833","nonce":2387835210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T12:21:14.159069+0000","modified":"2023-10-18T12:29:23.762500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":126,"addr":"172.21.15.114:6835/1284474820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1284474820},{"type":"v1","addr":"172.21.15.114:6835","nonce":1284474820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-18T12:32:33.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.592+0000 7fb488f11700 1 -- 172.21.15.114:0/3210691983 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb4640656f0 msgr2=0x7fb464067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:32:33.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.592+0000 7fb488f11700 1 --2- 172.21.15.114:0/3210691983 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb4640656f0 0x7fb464067bb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb46c000f60 tx=0x7fb46c009040 comp rx=0 tx=0).stop 2023-10-18T12:32:33.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.592+0000 7fb488f11700 1 -- 172.21.15.114:0/3210691983 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb48406d470 msgr2=0x7fb4840c45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:32:33.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.592+0000 7fb488f11700 1 --2- 172.21.15.114:0/3210691983 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb48406d470 0x7fb4840c45e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fb47400e760 tx=0x7fb47400eb20 comp rx=0 tx=0).stop 2023-10-18T12:32:33.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.592+0000 7fb488f11700 1 -- 172.21.15.114:0/3210691983 shutdown_connections 2023-10-18T12:32:33.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.592+0000 7fb488f11700 1 --2- 172.21.15.114:0/3210691983 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb4640656f0 0x7fb464067bb0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:32:33.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.592+0000 7fb488f11700 1 --2- 172.21.15.114:0/3210691983 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb484070f50 0x7fb4840c4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:32:33.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.592+0000 7fb488f11700 1 --2- 172.21.15.114:0/3210691983 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb48406d470 0x7fb4840c45e0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:32:33.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.592+0000 7fb488f11700 1 --2- 172.21.15.114:0/3210691983 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb48406d090 0x7fb484151980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:32:33.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.592+0000 7fb488f11700 1 -- 172.21.15.114:0/3210691983 >> 172.21.15.114:0/3210691983 conn(0x7fb4840ce5c0 msgr2=0x7fb4840c8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:32:33.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.592+0000 7fb488f11700 1 -- 172.21.15.114:0/3210691983 shutdown_connections 2023-10-18T12:32:33.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:32:33.592+0000 7fb488f11700 1 -- 172.21.15.114:0/3210691983 wait complete. 2023-10-18T12:32:33.601 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 20 2023-10-18T12:32:33.618 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-10-18T12:32:33.807 INFO:teuthology.orchestra.run.smithi114.stdout:[{"id":5162,"entity":{"name":{"type":"client","num":5162},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":989916161}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":669.82060669800001,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.21275692226511794,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":3,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5162 v1:192.168.0.1:0/989916161","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi172","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}}] 2023-10-18T12:32:33.807 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "1", "hostname": "smithi172", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 989916161, "type": "v1" }, "name": { "num": 5162, "type": "client" } }, "id": 5162, "inst": "client.5162 v1:192.168.0.1:0/989916161", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 3, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.21275692226511794 }, "state": "open", "uptime": 669.820606698 } ] 2023-10-18T12:32:33.908 DEBUG:tasks.ceph_test_case:No log hits yet, waiting... 2023-10-18T12:32:34.397 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:32:34.404 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:33:04.487 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:33:04.495 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:33:08.932 ERROR:tasks.ceph_test_case:Log output: 2023-10-18T12:33:08.933 DEBUG:tasks.cephfs.test_client_recovery:Expected log message found: 'Health check cleared: MDS_CLIENTS_LAGGY', retrying 2023-10-18T12:33:09.934 DEBUG:teuthology.orchestra.run.smithi114:> sudo daemon-helper kill ceph --cluster ceph -w 2023-10-18T12:33:09.942 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T12:33:10.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.115+0000 7efdbae62700 1 Processor -- start 2023-10-18T12:33:10.122 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.115+0000 7efdbae62700 1 -- start start 2023-10-18T12:33:10.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.115+0000 7efdbae62700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efdb40d2de0 0x7efdb41654d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:33:10.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.115+0000 7efdbae62700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdb40d1180 con 0x7efdb40b2100 2023-10-18T12:33:10.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.115+0000 7efdbae62700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdb40d1460 con 0x7efdb40b8920 2023-10-18T12:33:10.123 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.115+0000 7efdbae62700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb406ce20 con 0x7efdb40d2de0 2023-10-18T12:33:10.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.115+0000 7efdb8bfe700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7efdb40b2100 0x7efdb406d800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33210/0 (socket says 172.21.15.114:33210) 2023-10-18T12:33:10.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.115+0000 7efdb8bfe700 1 -- 172.21.15.114:0/2861489156 learned_addr learned my addr 172.21.15.114:0/2861489156 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:33:10.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.115+0000 7efdb37fe700 1 -- 172.21.15.114:0/2861489156 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 146581296 0 0) 0x7efdb40d1180 con 0x7efdb40b2100 2023-10-18T12:33:10.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.115+0000 7efdb93ff700 1 --2- 172.21.15.114:0/2861489156 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efdb40d2de0 0x7efdb41654d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:33:10.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.115+0000 7efdb37fe700 1 -- 172.21.15.114:0/2861489156 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efda40035d0 con 0x7efdb40b2100 2023-10-18T12:33:10.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.115+0000 7efdb37fe700 1 -- 172.21.15.114:0/2861489156 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4283955206 0 0) 0x7efda40035d0 con 0x7efdb40b2100 2023-10-18T12:33:10.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.115+0000 7efdb37fe700 1 -- 172.21.15.114:0/2861489156 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efdb40d2de0 msgr2=0x7efdb41654d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:33:10.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.115+0000 7efdb37fe700 1 --2- 172.21.15.114:0/2861489156 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efdb40d2de0 0x7efdb41654d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:33:10.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.115+0000 7efdb37fe700 1 -- 172.21.15.114:0/2861489156 >> v1:172.21.15.172:6789/0 conn(0x7efdb40b8920 legacy=0x7efdb40d26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:33:10.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.115+0000 7efdb37fe700 1 -- 172.21.15.114:0/2861489156 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb406d000 con 0x7efdb40b2100 2023-10-18T12:33:10.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.115+0000 7efdb37fe700 1 -- 172.21.15.114:0/2861489156 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3368469509 0 0) 0x7efda80017f0 con 0x7efdb40b2100 2023-10-18T12:33:10.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.115+0000 7efdb37fe700 1 -- 172.21.15.114:0/2861489156 >> v1:172.21.15.114:6789/0 conn(0x7efdb40b2100 legacy=0x7efdb406d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:33:10.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.115+0000 7efdb37fe700 1 --2- 172.21.15.114:0/2861489156 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efdb40d2de0 0x7efda4003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:33:10.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.115+0000 7efdb37fe700 1 --2- 172.21.15.114:0/2861489156 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efda4003f90 0x7efda4004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:33:10.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.119+0000 7efdb37fe700 1 --2- 172.21.15.114:0/2861489156 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efda4004db0 0x7efda4005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:33:10.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.119+0000 7efdb37fe700 1 -- 172.21.15.114:0/2861489156 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb406ce20 con 0x7efda4004db0 2023-10-18T12:33:10.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.119+0000 7efdb37fe700 1 -- 172.21.15.114:0/2861489156 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda400ba90 con 0x7efda4003f90 2023-10-18T12:33:10.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.119+0000 7efdb37fe700 1 -- 172.21.15.114:0/2861489156 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda400bc50 con 0x7efdb40d2de0 2023-10-18T12:33:10.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.119+0000 7efdb93ff700 1 --2- 172.21.15.114:0/2861489156 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efda4004db0 0x7efda4005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:33:10.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.119+0000 7efdb3fff700 1 --2- 172.21.15.114:0/2861489156 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efda4003f90 0x7efda4004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:33:10.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.119+0000 7efdb8bfe700 1 --2- 172.21.15.114:0/2861489156 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efdb40d2de0 0x7efda4003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:33:10.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.119+0000 7efdb93ff700 1 -- 172.21.15.114:0/2861489156 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efdb40d2de0 msgr2=0x7efda4003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:33:10.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.119+0000 7efdb93ff700 1 --2- 172.21.15.114:0/2861489156 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efdb40d2de0 0x7efda4003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:33:10.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.119+0000 7efdb93ff700 1 -- 172.21.15.114:0/2861489156 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efda4003f90 msgr2=0x7efda4004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:33:10.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.119+0000 7efdb93ff700 1 --2- 172.21.15.114:0/2861489156 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efda4003f90 0x7efda4004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:33:10.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.119+0000 7efdb93ff700 1 -- 172.21.15.114:0/2861489156 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda40035d0 con 0x7efda4004db0 2023-10-18T12:33:10.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.119+0000 7efdb93ff700 1 --2- 172.21.15.114:0/2861489156 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efda4004db0 0x7efda4005230 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7efdac009fc0 tx=0x7efda40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bef62374274dae3f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:33:10.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.119+0000 7efdb37fe700 1 -- 172.21.15.114:0/2861489156 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac00ec30 con 0x7efda4004db0 2023-10-18T12:33:10.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.119+0000 7efdb37fe700 1 -- 172.21.15.114:0/2861489156 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdac00f040 con 0x7efda4004db0 2023-10-18T12:33:10.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.119+0000 7efdb37fe700 1 -- 172.21.15.114:0/2861489156 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac014480 con 0x7efda4004db0 2023-10-18T12:33:10.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.119+0000 7efdbae62700 1 -- 172.21.15.114:0/2861489156 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efda4004db0 msgr2=0x7efda4005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:33:10.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.119+0000 7efdbae62700 1 --2- 172.21.15.114:0/2861489156 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efda4004db0 0x7efda4005230 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7efdac009fc0 tx=0x7efda40058a0 comp rx=0 tx=0).stop 2023-10-18T12:33:10.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.119+0000 7efdb93ff700 1 -- 172.21.15.114:0/2861489156 reap_dead start 2023-10-18T12:33:10.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.119+0000 7efdbae62700 1 -- 172.21.15.114:0/2861489156 shutdown_connections 2023-10-18T12:33:10.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.119+0000 7efdbae62700 1 -- 172.21.15.114:0/2861489156 >> 172.21.15.114:0/2861489156 conn(0x7efdb40cf530 msgr2=0x7efdb40cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:33:10.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.119+0000 7efdbae62700 1 -- 172.21.15.114:0/2861489156 shutdown_connections 2023-10-18T12:33:10.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.119+0000 7efdbae62700 1 -- 172.21.15.114:0/2861489156 wait complete. 2023-10-18T12:33:10.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.123+0000 7efdbae62700 1 Processor -- start 2023-10-18T12:33:10.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.123+0000 7efdbae62700 1 -- start start 2023-10-18T12:33:10.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.123+0000 7efdbae62700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efda4004db0 0x7efdb415c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:33:10.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.123+0000 7efdbae62700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdb40b12d0 0x7efdb408bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:33:10.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.123+0000 7efdbae62700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efdb408c210 0x7efdb408a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:33:10.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.123+0000 7efdbae62700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb40b6cc0 con 0x7efdb408c210 2023-10-18T12:33:10.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.123+0000 7efdbae62700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb41f6330 con 0x7efdb40b12d0 2023-10-18T12:33:10.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.123+0000 7efdbae62700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb408c690 con 0x7efda4004db0 2023-10-18T12:33:10.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.123+0000 7efdb93ff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efdb408c210 0x7efdb408a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:33:10.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.123+0000 7efdb93ff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efdb408c210 0x7efdb408a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53428/0 (socket says 172.21.15.114:53428) 2023-10-18T12:33:10.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.123+0000 7efdb93ff700 1 -- 172.21.15.114:0/832657669 learned_addr learned my addr 172.21.15.114:0/832657669 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:33:10.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.123+0000 7efdb8bfe700 1 --2- 172.21.15.114:0/832657669 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efda4004db0 0x7efdb415c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:33:10.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.123+0000 7efdb3fff700 1 --2- 172.21.15.114:0/832657669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdb40b12d0 0x7efdb408bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:33:10.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.123+0000 7efdb93ff700 1 -- 172.21.15.114:0/832657669 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efda4004db0 msgr2=0x7efdb415c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:33:10.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.123+0000 7efdb93ff700 1 --2- 172.21.15.114:0/832657669 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efda4004db0 0x7efdb415c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:33:10.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.123+0000 7efdb93ff700 1 -- 172.21.15.114:0/832657669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdb40b12d0 msgr2=0x7efdb408bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:33:10.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.123+0000 7efdb93ff700 1 --2- 172.21.15.114:0/832657669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdb40b12d0 0x7efdb408bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:33:10.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.127+0000 7efdb93ff700 1 -- 172.21.15.114:0/832657669 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb408b770 con 0x7efdb408c210 2023-10-18T12:33:10.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.127+0000 7efdb3fff700 1 --2- 172.21.15.114:0/832657669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdb40b12d0 0x7efdb408bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:33:10.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.127+0000 7efdb93ff700 1 --2- 172.21.15.114:0/832657669 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efdb408c210 0x7efdb408a000 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7efdac017040 tx=0x7efdac009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:33:10.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.127+0000 7efdb17fa700 1 -- 172.21.15.114:0/832657669 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac007000 con 0x7efdb408c210 2023-10-18T12:33:10.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.127+0000 7efdb17fa700 1 -- 172.21.15.114:0/832657669 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdac003e70 con 0x7efdb408c210 2023-10-18T12:33:10.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.127+0000 7efdb17fa700 1 -- 172.21.15.114:0/832657669 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac014a80 con 0x7efdb408c210 2023-10-18T12:33:10.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.127+0000 7efdbae62700 1 -- 172.21.15.114:0/832657669 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb408b1b0 con 0x7efdb408c210 2023-10-18T12:33:10.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.127+0000 7efdbae62700 1 -- 172.21.15.114:0/832657669 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb40b68e0 con 0x7efdb408c210 2023-10-18T12:33:10.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.127+0000 7efdbae62700 1 -- 172.21.15.114:0/832657669 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdb40b6e00 con 0x7efdb408c210 2023-10-18T12:33:10.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.131+0000 7efdb17fa700 1 -- 172.21.15.114:0/832657669 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7efdac023020 con 0x7efdb408c210 2023-10-18T12:33:10.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.131+0000 7efdb17fa700 1 --2- 172.21.15.114:0/832657669 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7efd980656f0 0x7efd98067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:33:10.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.131+0000 7efdb17fa700 1 -- 172.21.15.114:0/832657669 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7efdac084520 con 0x7efdb408c210 2023-10-18T12:33:10.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.131+0000 7efdb8bfe700 1 --2- 172.21.15.114:0/832657669 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7efd980656f0 0x7efd98067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:33:10.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.131+0000 7efdb8bfe700 1 --2- 172.21.15.114:0/832657669 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7efd980656f0 0x7efd98067bb0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7efda8000ef0 tx=0x7efda8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:33:10.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.135+0000 7fcc495d6700 1 Processor -- start 2023-10-18T12:33:10.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.135+0000 7fcc495d6700 1 -- start start 2023-10-18T12:33:10.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.139+0000 7fcc495d6700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc4415ab70 0x7fcc440adcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:33:10.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.139+0000 7fcc495d6700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc44070a30 con 0x7fcc440c9b40 2023-10-18T12:33:10.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.139+0000 7fcc495d6700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc44070cd0 con 0x7fcc440ad760 2023-10-18T12:33:10.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.139+0000 7fcc495d6700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4415e850 con 0x7fcc4415ab70 2023-10-18T12:33:10.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.139+0000 7fcc48dd5700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fcc440c9b40 0x7fcc4406f450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:33216/0 (socket says 172.21.15.114:33216) 2023-10-18T12:33:10.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.139+0000 7fcc48dd5700 1 -- 172.21.15.114:0/97083410 learned_addr learned my addr 172.21.15.114:0/97083410 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:33:10.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.139+0000 7fcc43fff700 1 --2- 172.21.15.114:0/97083410 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc4415ab70 0x7fcc440adcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:33:10.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.139+0000 7fcc437fe700 1 -- 172.21.15.114:0/97083410 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 976832563 0 0) 0x7fcc44070a30 con 0x7fcc440c9b40 2023-10-18T12:33:10.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.139+0000 7fcc437fe700 1 -- 172.21.15.114:0/97083410 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc300035d0 con 0x7fcc440c9b40 2023-10-18T12:33:10.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.139+0000 7fcc43fff700 1 -- 172.21.15.114:0/97083410 >> v1:172.21.15.172:6789/0 conn(0x7fcc440ad760 legacy=0x7fcc440c9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:33:10.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.139+0000 7fcc43fff700 1 -- 172.21.15.114:0/97083410 >> v1:172.21.15.114:6789/0 conn(0x7fcc440c9b40 legacy=0x7fcc4406f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:33:10.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.139+0000 7fcc43fff700 1 -- 172.21.15.114:0/97083410 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc4415eb30 con 0x7fcc4415ab70 2023-10-18T12:33:10.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.139+0000 7efdb17fa700 1 -- 172.21.15.114:0/832657669 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7efdb40b6e00 con 0x7efdb408c210 2023-10-18T12:33:10.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.139+0000 7fcc43fff700 1 --2- 172.21.15.114:0/97083410 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc4415ab70 0x7fcc440adcb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcc34009880 tx=0x7fcc34009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d22d6267fa9633b server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:33:10.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.139+0000 7fcc437fe700 1 -- 172.21.15.114:0/97083410 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc34011830 con 0x7fcc4415ab70 2023-10-18T12:33:10.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.139+0000 7fcc437fe700 1 -- 172.21.15.114:0/97083410 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc34011990 con 0x7fcc4415ab70 2023-10-18T12:33:10.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.139+0000 7fcc437fe700 1 -- 172.21.15.114:0/97083410 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc34011d20 con 0x7fcc4415ab70 2023-10-18T12:33:10.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.139+0000 7fcc495d6700 1 -- 172.21.15.114:0/97083410 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc4415ab70 msgr2=0x7fcc440adcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:33:10.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.139+0000 7fcc495d6700 1 --2- 172.21.15.114:0/97083410 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc4415ab70 0x7fcc440adcb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcc34009880 tx=0x7fcc34009b90 comp rx=0 tx=0).stop 2023-10-18T12:33:10.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.139+0000 7fcc495d6700 1 -- 172.21.15.114:0/97083410 shutdown_connections 2023-10-18T12:33:10.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.139+0000 7fcc495d6700 1 --2- 172.21.15.114:0/97083410 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc4415ab70 0x7fcc440adcb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:33:10.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.139+0000 7fcc495d6700 1 -- 172.21.15.114:0/97083410 >> 172.21.15.114:0/97083410 conn(0x7fcc440b02a0 msgr2=0x7fcc440b06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:33:10.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.139+0000 7fcc495d6700 1 -- 172.21.15.114:0/97083410 shutdown_connections 2023-10-18T12:33:10.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.139+0000 7fcc495d6700 1 -- 172.21.15.114:0/97083410 wait complete. 2023-10-18T12:33:10.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.143+0000 7fcc495d6700 1 Processor -- start 2023-10-18T12:33:10.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.143+0000 7fcc495d6700 1 -- start start 2023-10-18T12:33:10.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.143+0000 7fcc495d6700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc440ad760 0x7fcc441f33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:33:10.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.143+0000 7fcc495d6700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc440c9b40 0x7fcc44153bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:33:10.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.143+0000 7fcc495d6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc4415ab70 0x7fcc44155300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:33:10.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.143+0000 7fcc495d6700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc441f3930 con 0x7fcc440c9b40 2023-10-18T12:33:10.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.143+0000 7fcc495d6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc440cc750 con 0x7fcc4415ab70 2023-10-18T12:33:10.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.143+0000 7fcc495d6700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc440cc9f0 con 0x7fcc440ad760 2023-10-18T12:33:10.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.143+0000 7fcc3b7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc440c9b40 0x7fcc44153bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:33:10.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.143+0000 7fcc3b7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc440c9b40 0x7fcc44153bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:53434/0 (socket says 172.21.15.114:53434) 2023-10-18T12:33:10.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.143+0000 7fcc3b7fe700 1 -- 172.21.15.114:0/2316530320 learned_addr learned my addr 172.21.15.114:0/2316530320 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:33:10.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.147+0000 7fcc48dd5700 1 --2- 172.21.15.114:0/2316530320 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc4415ab70 0x7fcc44155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:33:10.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.147+0000 7fcc43fff700 1 --2- 172.21.15.114:0/2316530320 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc440ad760 0x7fcc441f33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:33:10.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.147+0000 7fcc3b7fe700 1 -- 172.21.15.114:0/2316530320 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc440ad760 msgr2=0x7fcc441f33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:33:10.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.147+0000 7fcc3b7fe700 1 --2- 172.21.15.114:0/2316530320 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcc440ad760 0x7fcc441f33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:33:10.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.147+0000 7fcc3b7fe700 1 -- 172.21.15.114:0/2316530320 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc4415ab70 msgr2=0x7fcc44155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:33:10.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.147+0000 7fcc3b7fe700 1 --2- 172.21.15.114:0/2316530320 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc4415ab70 0x7fcc44155300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:33:10.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.147+0000 7fcc3b7fe700 1 -- 172.21.15.114:0/2316530320 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc340094b0 con 0x7fcc440c9b40 2023-10-18T12:33:10.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.147+0000 7fcc3b7fe700 1 --2- 172.21.15.114:0/2316530320 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc440c9b40 0x7fcc44153bf0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c001ed0 tx=0x7fcc2c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:33:10.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.147+0000 7fcc417fa700 1 -- 172.21.15.114:0/2316530320 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c00ade0 con 0x7fcc440c9b40 2023-10-18T12:33:10.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.147+0000 7fcc417fa700 1 -- 172.21.15.114:0/2316530320 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc2c0020d0 con 0x7fcc440c9b40 2023-10-18T12:33:10.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.147+0000 7fcc495d6700 1 -- 172.21.15.114:0/2316530320 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc440cccd0 con 0x7fcc440c9b40 2023-10-18T12:33:10.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.147+0000 7fcc417fa700 1 -- 172.21.15.114:0/2316530320 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c003c40 con 0x7fcc440c9b40 2023-10-18T12:33:10.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.147+0000 7fcc495d6700 1 -- 172.21.15.114:0/2316530320 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc440cd290 con 0x7fcc440c9b40 2023-10-18T12:33:10.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.147+0000 7fcc495d6700 1 -- 172.21.15.114:0/2316530320 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fcc440cd420 con 0x7fcc440c9b40 2023-10-18T12:33:10.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.151+0000 7fcc417fa700 1 -- 172.21.15.114:0/2316530320 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fcc2c0050d0 con 0x7fcc440c9b40 2023-10-18T12:33:10.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.151+0000 7fcc417fa700 1 --2- 172.21.15.114:0/2316530320 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fcc24065720 0x7fcc24067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:33:10.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.151+0000 7fcc417fa700 1 -- 172.21.15.114:0/2316530320 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7fcc2c083250 con 0x7fcc440c9b40 2023-10-18T12:33:10.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.151+0000 7fcc43fff700 1 --2- 172.21.15.114:0/2316530320 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fcc24065720 0x7fcc24067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:33:10.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.151+0000 7fcc417fa700 1 -- 172.21.15.114:0/2316530320 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+449 (secure 0 0 0) 0x7fcc2c08a070 con 0x7fcc440c9b40 2023-10-18T12:33:10.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.151+0000 7fcc495d6700 1 -- 172.21.15.114:0/2316530320 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7fcc44072e60 con 0x7fcc440c9b40 2023-10-18T12:33:10.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.151+0000 7fcc43fff700 1 --2- 172.21.15.114:0/2316530320 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fcc24065720 0x7fcc24067be0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcc340090b0 tx=0x7fcc34010000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:33:10.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.375+0000 7efdbae62700 1 -- 172.21.15.114:0/832657669 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efdb40b6e00 con 0x7efdb408c210 2023-10-18T12:33:10.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.375+0000 7efdb17fa700 1 -- 172.21.15.114:0/832657669 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4889 (secure 0 0 0) 0x7efdb40b6e00 con 0x7efdb408c210 2023-10-18T12:33:10.384 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:33:10.384 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2034957068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2034957068},{"type":"v1","addr":"172.21.15.172:6836","nonce":2034957068}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5039,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4215710360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4215710360},{"type":"v1","addr":"172.21.15.172:6837","nonce":4215710360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2387835210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2387835210},{"type":"v1","addr":"172.21.15.114:6833","nonce":2387835210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T12:21:14.159069+0000","modified":"2023-10-18T12:29:23.762500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":126,"addr":"172.21.15.114:6835/1284474820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1284474820},{"type":"v1","addr":"172.21.15.114:6835","nonce":1284474820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-18T12:33:10.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.379+0000 7efdbae62700 1 -- 172.21.15.114:0/832657669 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7efd980656f0 msgr2=0x7efd98067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:33:10.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.379+0000 7efdbae62700 1 --2- 172.21.15.114:0/832657669 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7efd980656f0 0x7efd98067bb0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7efda8000ef0 tx=0x7efda8009040 comp rx=0 tx=0).stop 2023-10-18T12:33:10.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.379+0000 7efdbae62700 1 -- 172.21.15.114:0/832657669 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efdb408c210 msgr2=0x7efdb408a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:33:10.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.379+0000 7efdbae62700 1 --2- 172.21.15.114:0/832657669 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efdb408c210 0x7efdb408a000 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7efdac017040 tx=0x7efdac009750 comp rx=0 tx=0).stop 2023-10-18T12:33:10.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.379+0000 7efdbae62700 1 -- 172.21.15.114:0/832657669 shutdown_connections 2023-10-18T12:33:10.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.379+0000 7efdbae62700 1 --2- 172.21.15.114:0/832657669 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7efd980656f0 0x7efd98067bb0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:33:10.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.379+0000 7efdbae62700 1 --2- 172.21.15.114:0/832657669 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efdb408c210 0x7efdb408a000 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:33:10.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.379+0000 7efdbae62700 1 --2- 172.21.15.114:0/832657669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdb40b12d0 0x7efdb408bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:33:10.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.379+0000 7efdbae62700 1 --2- 172.21.15.114:0/832657669 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7efda4004db0 0x7efdb415c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:33:10.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.379+0000 7efdbae62700 1 -- 172.21.15.114:0/832657669 >> 172.21.15.114:0/832657669 conn(0x7efdb40cf530 msgr2=0x7efdb40b4790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:33:10.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.379+0000 7efdbae62700 1 -- 172.21.15.114:0/832657669 shutdown_connections 2023-10-18T12:33:10.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:10.379+0000 7efdbae62700 1 -- 172.21.15.114:0/832657669 wait complete. 2023-10-18T12:33:10.390 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 20 2023-10-18T12:33:10.410 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-10-18T12:33:10.598 INFO:teuthology.orchestra.run.smithi114.stdout:[{"id":5162,"entity":{"name":{"type":"client","num":5162},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":989916161}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":706.61190751499998,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.19541868301554827,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":3,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5162 v1:192.168.0.1:0/989916161","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi172","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}}] 2023-10-18T12:33:10.599 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "1", "hostname": "smithi172", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 989916161, "type": "v1" }, "name": { "num": 5162, "type": "client" } }, "id": 5162, "inst": "client.5162 v1:192.168.0.1:0/989916161", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 3, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.19541868301554827 }, "state": "open", "uptime": 706.611907515 } ] 2023-10-18T12:33:10.700 DEBUG:tasks.ceph_test_case:No log hits yet, waiting... 2023-10-18T12:33:34.566 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:33:34.575 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:33:45.726 ERROR:tasks.ceph_test_case:Log output: 2023-10-18T12:33:45.727 DEBUG:tasks.cephfs.test_client_recovery:Expected log message found: 'Health check cleared: MDS_CLIENTS_LAGGY', retrying 2023-10-18T12:33:46.728 DEBUG:teuthology.orchestra.run.smithi114:> sudo daemon-helper kill ceph --cluster ceph -w 2023-10-18T12:33:46.734 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T12:33:46.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.903+0000 7f63d555f700 1 Processor -- start 2023-10-18T12:33:46.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.903+0000 7f63d555f700 1 -- start start 2023-10-18T12:33:46.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.903+0000 7f63d555f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63d00cf760 0x7f63d0069f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:33:46.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.903+0000 7f63d555f700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f63d006a460 0x7f63d015d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:33:46.911 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.903+0000 7f63d555f700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63d0160870 con 0x7f63d015cd20 2023-10-18T12:33:46.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.903+0000 7f63d555f700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63d00d0500 con 0x7f63d006a460 2023-10-18T12:33:46.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.903+0000 7f63d555f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d006a8f0 con 0x7f63d00cf760 2023-10-18T12:33:46.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.903+0000 7f63cffff700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f63d015cd20 0x7f63d00cfdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:54764/0 (socket says 172.21.15.114:54764) 2023-10-18T12:33:46.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.903+0000 7f63cffff700 1 -- 172.21.15.114:0/2412333341 learned_addr learned my addr 172.21.15.114:0/2412333341 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:33:46.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.903+0000 7f63d4d5e700 1 --2- 172.21.15.114:0/2412333341 >> v2:172.21.15.114:3300/0 conn(0x7f63d006a460 0x7f63d015d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:33:46.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.903+0000 7f63cf7fe700 1 --2- 172.21.15.114:0/2412333341 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63d00cf760 0x7f63d0069f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:33:46.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.903+0000 7f63ceffd700 1 -- 172.21.15.114:0/2412333341 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2904541460 0 0) 0x7f63d0160870 con 0x7f63d015cd20 2023-10-18T12:33:46.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.903+0000 7f63ceffd700 1 -- 172.21.15.114:0/2412333341 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63b80035d0 con 0x7f63d015cd20 2023-10-18T12:33:46.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.903+0000 7f63cf7fe700 1 -- 172.21.15.114:0/2412333341 >> v2:172.21.15.114:3300/0 conn(0x7f63d006a460 msgr2=0x7f63d015d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:33:46.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.903+0000 7f63cf7fe700 1 --2- 172.21.15.114:0/2412333341 >> v2:172.21.15.114:3300/0 conn(0x7f63d006a460 0x7f63d015d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:33:46.914 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.903+0000 7f63cf7fe700 1 -- 172.21.15.114:0/2412333341 >> v1:172.21.15.114:6789/0 conn(0x7f63d015cd20 legacy=0x7f63d00cfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:33:46.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.903+0000 7f63cf7fe700 1 -- 172.21.15.114:0/2412333341 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d0070460 con 0x7f63d00cf760 2023-10-18T12:33:46.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.903+0000 7f63d4d5e700 1 --2- 172.21.15.114:0/2412333341 >> v2:172.21.15.114:3300/0 conn(0x7f63d006a460 0x7f63d015d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:33:46.915 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.907+0000 7f63cf7fe700 1 --2- 172.21.15.114:0/2412333341 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63d00cf760 0x7f63d0069f20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f63c4009850 tx=0x7f63c4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c0fc5ae8eb9cb27 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:33:46.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.907+0000 7f63ceffd700 1 -- 172.21.15.114:0/2412333341 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c4011830 con 0x7f63d00cf760 2023-10-18T12:33:46.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.907+0000 7f63ceffd700 1 -- 172.21.15.114:0/2412333341 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c4011990 con 0x7f63d00cf760 2023-10-18T12:33:46.916 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.907+0000 7f63ceffd700 1 -- 172.21.15.114:0/2412333341 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c4011d40 con 0x7f63d00cf760 2023-10-18T12:33:46.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.907+0000 7f63d555f700 1 -- 172.21.15.114:0/2412333341 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63d00cf760 msgr2=0x7f63d0069f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:33:46.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.907+0000 7f63d555f700 1 --2- 172.21.15.114:0/2412333341 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63d00cf760 0x7f63d0069f20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f63c4009850 tx=0x7f63c4009b60 comp rx=0 tx=0).stop 2023-10-18T12:33:46.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.907+0000 7f63d555f700 1 -- 172.21.15.114:0/2412333341 shutdown_connections 2023-10-18T12:33:46.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.907+0000 7f63d555f700 1 --2- 172.21.15.114:0/2412333341 >> v2:172.21.15.114:3300/0 conn(0x7f63d006a460 0x7f63d015d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:33:46.917 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.907+0000 7f63d555f700 1 --2- 172.21.15.114:0/2412333341 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63d00cf760 0x7f63d0069f20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:33:46.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.907+0000 7f63d555f700 1 -- 172.21.15.114:0/2412333341 >> 172.21.15.114:0/2412333341 conn(0x7f63d00b22f0 msgr2=0x7f63d00b26d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:33:46.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.907+0000 7f63d555f700 1 -- 172.21.15.114:0/2412333341 shutdown_connections 2023-10-18T12:33:46.918 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.907+0000 7f63d555f700 1 -- 172.21.15.114:0/2412333341 wait complete. 2023-10-18T12:33:46.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.911+0000 7f63d555f700 1 Processor -- start 2023-10-18T12:33:46.919 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.911+0000 7f63d555f700 1 -- start start 2023-10-18T12:33:46.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.911+0000 7f63d555f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63d006a460 0x7f63d00b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:33:46.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.911+0000 7f63d555f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63d00cf760 0x7f63d01f3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:33:46.920 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.911+0000 7f63d555f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63d015cd20 0x7f63d01ef900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:33:46.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.911+0000 7f63d555f700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d01f35d0 con 0x7f63d00cf760 2023-10-18T12:33:46.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.911+0000 7f63d555f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d00b3a50 con 0x7f63d006a460 2023-10-18T12:33:46.921 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.911+0000 7f63d555f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d00b3d30 con 0x7f63d015cd20 2023-10-18T12:33:46.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.911+0000 7f63cf7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63d00cf760 0x7f63d01f3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:33:46.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.915+0000 7f63cf7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63d00cf760 0x7f63d01f3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56544/0 (socket says 172.21.15.114:56544) 2023-10-18T12:33:46.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.915+0000 7f63cf7fe700 1 -- 172.21.15.114:0/2365045201 learned_addr learned my addr 172.21.15.114:0/2365045201 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:33:46.923 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.915+0000 7f63cffff700 1 --2- 172.21.15.114:0/2365045201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63d006a460 0x7f63d00b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:33:46.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.915+0000 7f63d4d5e700 1 --2- 172.21.15.114:0/2365045201 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63d015cd20 0x7f63d01ef900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:33:46.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.915+0000 7f63cf7fe700 1 -- 172.21.15.114:0/2365045201 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63d015cd20 msgr2=0x7f63d01ef900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:33:46.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.915+0000 7f63cf7fe700 1 --2- 172.21.15.114:0/2365045201 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63d015cd20 0x7f63d01ef900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:33:46.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.915+0000 7f63cf7fe700 1 -- 172.21.15.114:0/2365045201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63d006a460 msgr2=0x7f63d00b33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:33:46.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.915+0000 7f63cf7fe700 1 --2- 172.21.15.114:0/2365045201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63d006a460 0x7f63d00b33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:33:46.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.915+0000 7f63cf7fe700 1 -- 172.21.15.114:0/2365045201 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c8009a70 con 0x7f63d00cf760 2023-10-18T12:33:46.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.915+0000 7f63cf7fe700 1 --2- 172.21.15.114:0/2365045201 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63d00cf760 0x7f63d01f3090 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f63c40090b0 tx=0x7f63c4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:33:46.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.915+0000 7f63ccff9700 1 -- 172.21.15.114:0/2365045201 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c4004380 con 0x7f63d00cf760 2023-10-18T12:33:46.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.915+0000 7f63ccff9700 1 -- 172.21.15.114:0/2365045201 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c401f070 con 0x7f63d00cf760 2023-10-18T12:33:46.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.915+0000 7f63d555f700 1 -- 172.21.15.114:0/2365045201 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63c40094b0 con 0x7f63d00cf760 2023-10-18T12:33:46.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.915+0000 7f63ccff9700 1 -- 172.21.15.114:0/2365045201 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c40036c0 con 0x7f63d00cf760 2023-10-18T12:33:46.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.915+0000 7f63d555f700 1 -- 172.21.15.114:0/2365045201 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63d00b42f0 con 0x7f63d00cf760 2023-10-18T12:33:46.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.915+0000 7f63d555f700 1 -- 172.21.15.114:0/2365045201 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63d00c7870 con 0x7f63d00cf760 2023-10-18T12:33:46.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.919+0000 7f63ccff9700 1 -- 172.21.15.114:0/2365045201 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f63c4021030 con 0x7f63d00cf760 2023-10-18T12:33:46.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.919+0000 7f63ccff9700 1 --2- 172.21.15.114:0/2365045201 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f63bc0656f0 0x7f63bc067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:33:46.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.919+0000 7f63ccff9700 1 -- 172.21.15.114:0/2365045201 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7f63c4084390 con 0x7f63d00cf760 2023-10-18T12:33:46.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.919+0000 7f63cffff700 1 --2- 172.21.15.114:0/2365045201 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f63bc0656f0 0x7f63bc067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:33:46.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.919+0000 7f63cffff700 1 --2- 172.21.15.114:0/2365045201 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f63bc0656f0 0x7f63bc067bb0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f63c0007fd0 tx=0x7f63c0007de0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:33:46.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.923+0000 7f63ccff9700 1 -- 172.21.15.114:0/2365045201 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f63c4051c50 con 0x7f63d00cf760 2023-10-18T12:33:46.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.927+0000 7f91d759e700 1 Processor -- start 2023-10-18T12:33:46.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.927+0000 7f91d759e700 1 -- start start 2023-10-18T12:33:46.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.931+0000 7f91d759e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f91d80ce7b0 0x7f91d80b23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:33:46.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.931+0000 7f91d759e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91d80b2920 0x7f91d806a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:33:46.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.931+0000 7f91d759e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91d806a260 con 0x7f91d815cd90 2023-10-18T12:33:46.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.931+0000 7f91d759e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91d80b2dd0 con 0x7f91d80ce7b0 2023-10-18T12:33:46.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.931+0000 7f91d759e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d806fb60 con 0x7f91d80b2920 2023-10-18T12:33:46.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.931+0000 7f91d659c700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f91d815cd90 0x7f91d806f450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:54766/0 (socket says 172.21.15.114:54766) 2023-10-18T12:33:46.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.931+0000 7f91d659c700 1 -- 172.21.15.114:0/849960620 learned_addr learned my addr 172.21.15.114:0/849960620 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:33:46.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.931+0000 7f91cffff700 1 --2- 172.21.15.114:0/849960620 >> v2:172.21.15.172:3300/0 conn(0x7f91d80ce7b0 0x7f91d80b23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:33:46.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.931+0000 7f91d6d9d700 1 --2- 172.21.15.114:0/849960620 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91d80b2920 0x7f91d806a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:33:46.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.931+0000 7f91d5d9b700 1 -- 172.21.15.114:0/849960620 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3831023610 0 0) 0x7f91d806a260 con 0x7f91d815cd90 2023-10-18T12:33:46.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.931+0000 7f91d5d9b700 1 -- 172.21.15.114:0/849960620 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91c40035d0 con 0x7f91d815cd90 2023-10-18T12:33:46.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.931+0000 7f91cffff700 1 -- 172.21.15.114:0/849960620 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91d80b2920 msgr2=0x7f91d806a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:33:46.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.931+0000 7f91cffff700 1 --2- 172.21.15.114:0/849960620 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91d80b2920 0x7f91d806a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:33:46.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.931+0000 7f91cffff700 1 -- 172.21.15.114:0/849960620 >> v1:172.21.15.114:6789/0 conn(0x7f91d815cd90 legacy=0x7f91d806f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:33:46.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.931+0000 7f91cffff700 1 -- 172.21.15.114:0/849960620 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d806fd50 con 0x7f91d80ce7b0 2023-10-18T12:33:46.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.931+0000 7f91cffff700 1 --2- 172.21.15.114:0/849960620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91d80ce7b0 0x7f91d80b23e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f91c0009850 tx=0x7f91c0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45d65541dd9677aa server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:33:46.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.931+0000 7f91d5d9b700 1 -- 172.21.15.114:0/849960620 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c0011830 con 0x7f91d80ce7b0 2023-10-18T12:33:46.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.931+0000 7f91d5d9b700 1 -- 172.21.15.114:0/849960620 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c0011990 con 0x7f91d80ce7b0 2023-10-18T12:33:46.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.931+0000 7f91d5d9b700 1 -- 172.21.15.114:0/849960620 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c0011d40 con 0x7f91d80ce7b0 2023-10-18T12:33:46.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.935+0000 7f91d759e700 1 -- 172.21.15.114:0/849960620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91d80ce7b0 msgr2=0x7f91d80b23e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:33:46.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.935+0000 7f91d759e700 1 --2- 172.21.15.114:0/849960620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91d80ce7b0 0x7f91d80b23e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f91c0009850 tx=0x7f91c0009b60 comp rx=0 tx=0).stop 2023-10-18T12:33:46.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.935+0000 7f91d759e700 1 -- 172.21.15.114:0/849960620 shutdown_connections 2023-10-18T12:33:46.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.935+0000 7f91d759e700 1 --2- 172.21.15.114:0/849960620 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91d80b2920 0x7f91d806a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:33:46.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.935+0000 7f91d759e700 1 --2- 172.21.15.114:0/849960620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91d80ce7b0 0x7f91d80b23e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:33:46.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.935+0000 7f91d759e700 1 -- 172.21.15.114:0/849960620 >> 172.21.15.114:0/849960620 conn(0x7f91d806cad0 msgr2=0x7f91d80cd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:33:46.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.935+0000 7f91d759e700 1 -- 172.21.15.114:0/849960620 shutdown_connections 2023-10-18T12:33:46.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.935+0000 7f91d759e700 1 -- 172.21.15.114:0/849960620 wait complete. 2023-10-18T12:33:46.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.939+0000 7f91d759e700 1 Processor -- start 2023-10-18T12:33:46.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.939+0000 7f91d759e700 1 -- start start 2023-10-18T12:33:46.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.939+0000 7f91d759e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91d80b2920 0x7f91d8158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:33:46.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.939+0000 7f91d759e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91d80ce7b0 0x7f91d80ad3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:33:46.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.939+0000 7f91d759e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91d815cd90 0x7f91d80ad8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:33:46.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.939+0000 7f91d759e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d815e6d0 con 0x7f91d815cd90 2023-10-18T12:33:46.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.939+0000 7f91d759e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d80ae170 con 0x7f91d80b2920 2023-10-18T12:33:46.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.939+0000 7f91d759e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d80acbd0 con 0x7f91d80ce7b0 2023-10-18T12:33:46.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.939+0000 7f91d6d9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91d815cd90 0x7f91d80ad8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:33:46.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.939+0000 7f91d6d9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91d815cd90 0x7f91d80ad8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56560/0 (socket says 172.21.15.114:56560) 2023-10-18T12:33:46.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.939+0000 7f91d6d9d700 1 -- 172.21.15.114:0/3327989114 learned_addr learned my addr 172.21.15.114:0/3327989114 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:33:46.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.939+0000 7f91d659c700 1 --2- 172.21.15.114:0/3327989114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91d80b2920 0x7f91d8158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:33:46.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.939+0000 7f91cffff700 1 --2- 172.21.15.114:0/3327989114 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91d80ce7b0 0x7f91d80ad3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:33:46.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.939+0000 7f91d6d9d700 1 -- 172.21.15.114:0/3327989114 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91d80ce7b0 msgr2=0x7f91d80ad3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:33:46.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.939+0000 7f91d6d9d700 1 --2- 172.21.15.114:0/3327989114 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f91d80ce7b0 0x7f91d80ad3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:33:46.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.939+0000 7f91d6d9d700 1 -- 172.21.15.114:0/3327989114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91d80b2920 msgr2=0x7f91d8158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:33:46.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.939+0000 7f91d6d9d700 1 --2- 172.21.15.114:0/3327989114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91d80b2920 0x7f91d8158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:33:46.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.939+0000 7f91d6d9d700 1 -- 172.21.15.114:0/3327989114 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c00094b0 con 0x7f91d815cd90 2023-10-18T12:33:46.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.939+0000 7f91d6d9d700 1 --2- 172.21.15.114:0/3327989114 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f91d815cd90 0x7f91d80ad8e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f91d000efc0 tx=0x7f91d000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:33:46.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.939+0000 7f91ceffd700 1 -- 172.21.15.114:0/3327989114 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d0009ea0 con 0x7f91d815cd90 2023-10-18T12:33:46.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.939+0000 7f91ceffd700 1 -- 172.21.15.114:0/3327989114 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d000f040 con 0x7f91d815cd90 2023-10-18T12:33:46.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.939+0000 7f91ceffd700 1 -- 172.21.15.114:0/3327989114 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d000ced0 con 0x7f91d815cd90 2023-10-18T12:33:46.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.939+0000 7f91d759e700 1 -- 172.21.15.114:0/3327989114 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91d80ac610 con 0x7f91d815cd90 2023-10-18T12:33:46.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.943+0000 7f91d759e700 1 -- 172.21.15.114:0/3327989114 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91d815e2f0 con 0x7f91d815cd90 2023-10-18T12:33:46.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.943+0000 7f91d759e700 1 -- 172.21.15.114:0/3327989114 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f91d8072e60 con 0x7f91d815cd90 2023-10-18T12:33:46.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.943+0000 7f91ceffd700 1 -- 172.21.15.114:0/3327989114 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f91d0014480 con 0x7f91d815cd90 2023-10-18T12:33:46.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.947+0000 7f91ceffd700 1 --2- 172.21.15.114:0/3327989114 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f91b80656f0 0x7f91b8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:33:46.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.947+0000 7f91ceffd700 1 -- 172.21.15.114:0/3327989114 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7f91d00837a0 con 0x7f91d815cd90 2023-10-18T12:33:46.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.947+0000 7f91ceffd700 1 -- 172.21.15.114:0/3327989114 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+449 (secure 0 0 0) 0x7f91d008a070 con 0x7f91d815cd90 2023-10-18T12:33:46.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.947+0000 7f91d659c700 1 --2- 172.21.15.114:0/3327989114 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f91b80656f0 0x7f91b8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:33:46.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.947+0000 7f91d759e700 1 -- 172.21.15.114:0/3327989114 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7f91d80b68e0 con 0x7f91d815cd90 2023-10-18T12:33:46.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:46.947+0000 7f91d659c700 1 --2- 172.21.15.114:0/3327989114 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f91b80656f0 0x7f91b8067bb0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f91c8007fd0 tx=0x7f91c8007de0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:33:47.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:47.135+0000 7f63d555f700 1 -- 172.21.15.114:0/2365045201 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f63d0072e60 con 0x7f63d00cf760 2023-10-18T12:33:47.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:47.135+0000 7f63ccff9700 1 -- 172.21.15.114:0/2365045201 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4889 (secure 0 0 0) 0x7f63c4055270 con 0x7f63d00cf760 2023-10-18T12:33:47.144 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:33:47.145 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2034957068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2034957068},{"type":"v1","addr":"172.21.15.172:6836","nonce":2034957068}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5039,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4215710360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4215710360},{"type":"v1","addr":"172.21.15.172:6837","nonce":4215710360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2387835210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2387835210},{"type":"v1","addr":"172.21.15.114:6833","nonce":2387835210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T12:21:14.159069+0000","modified":"2023-10-18T12:29:23.762500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":126,"addr":"172.21.15.114:6835/1284474820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1284474820},{"type":"v1","addr":"172.21.15.114:6835","nonce":1284474820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-18T12:33:47.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:47.139+0000 7f63d555f700 1 -- 172.21.15.114:0/2365045201 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f63bc0656f0 msgr2=0x7f63bc067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:33:47.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:47.139+0000 7f63d555f700 1 --2- 172.21.15.114:0/2365045201 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f63bc0656f0 0x7f63bc067bb0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f63c0007fd0 tx=0x7f63c0007de0 comp rx=0 tx=0).stop 2023-10-18T12:33:47.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:47.139+0000 7f63d555f700 1 -- 172.21.15.114:0/2365045201 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63d00cf760 msgr2=0x7f63d01f3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:33:47.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:47.139+0000 7f63d555f700 1 --2- 172.21.15.114:0/2365045201 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63d00cf760 0x7f63d01f3090 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f63c40090b0 tx=0x7f63c4004770 comp rx=0 tx=0).stop 2023-10-18T12:33:47.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:47.139+0000 7f63d555f700 1 -- 172.21.15.114:0/2365045201 shutdown_connections 2023-10-18T12:33:47.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:47.139+0000 7f63d555f700 1 --2- 172.21.15.114:0/2365045201 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f63bc0656f0 0x7f63bc067bb0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:33:47.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:47.139+0000 7f63d555f700 1 --2- 172.21.15.114:0/2365045201 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63d015cd20 0x7f63d01ef900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:33:47.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:47.139+0000 7f63d555f700 1 --2- 172.21.15.114:0/2365045201 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f63d00cf760 0x7f63d01f3090 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:33:47.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:47.139+0000 7f63d555f700 1 --2- 172.21.15.114:0/2365045201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f63d006a460 0x7f63d00b33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:33:47.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:47.139+0000 7f63d555f700 1 -- 172.21.15.114:0/2365045201 >> 172.21.15.114:0/2365045201 conn(0x7f63d00b22f0 msgr2=0x7f63d015bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:33:47.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:47.139+0000 7f63d555f700 1 -- 172.21.15.114:0/2365045201 shutdown_connections 2023-10-18T12:33:47.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:33:47.139+0000 7f63d555f700 1 -- 172.21.15.114:0/2365045201 wait complete. 2023-10-18T12:33:47.150 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 20 2023-10-18T12:33:47.167 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-10-18T12:33:47.354 INFO:teuthology.orchestra.run.smithi114.stdout:[{"id":5162,"entity":{"name":{"type":"client","num":5162},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":989916161}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":743.36719036399995,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.17950833002046512,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":3,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5162 v1:192.168.0.1:0/989916161","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi172","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}}] 2023-10-18T12:33:47.355 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "1", "hostname": "smithi172", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 989916161, "type": "v1" }, "name": { "num": 5162, "type": "client" } }, "id": 5162, "inst": "client.5162 v1:192.168.0.1:0/989916161", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 3, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.17950833002046512 }, "state": "open", "uptime": 743.367190364 } ] 2023-10-18T12:33:47.459 DEBUG:tasks.ceph_test_case:No log hits yet, waiting... 2023-10-18T12:34:04.658 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:34:04.666 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:34:22.490 ERROR:tasks.ceph_test_case:Log output: 2023-10-18T12:34:22.491 DEBUG:tasks.cephfs.test_client_recovery:Expected log message found: 'Health check cleared: MDS_CLIENTS_LAGGY', retrying 2023-10-18T12:34:23.492 DEBUG:teuthology.orchestra.run.smithi114:> sudo daemon-helper kill ceph --cluster ceph -w 2023-10-18T12:34:23.500 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T12:34:23.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.674+0000 7f95634df700 1 Processor -- start 2023-10-18T12:34:23.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.674+0000 7f95634df700 1 -- start start 2023-10-18T12:34:23.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.678+0000 7f95634df700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f955c146770 0x7f955c15d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:34:23.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.678+0000 7f95634df700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f955c0b7dd0 0x7f955c161370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:34:23.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.678+0000 7f95634df700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f955c1618b0 con 0x7f955c0b5b80 2023-10-18T12:34:23.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.678+0000 7f95634df700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f955c06fcd0 con 0x7f955c146770 2023-10-18T12:34:23.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.678+0000 7f95634df700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f955c146b50 con 0x7f955c0b7dd0 2023-10-18T12:34:23.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.678+0000 7f956127b700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f955c146770 0x7f955c15d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:34:23.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.678+0000 7f956127b700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f955c146770 0x7f955c15d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38312/0 (socket says 172.21.15.114:38312) 2023-10-18T12:34:23.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.678+0000 7f956127b700 1 -- 172.21.15.114:0/680976721 learned_addr learned my addr 172.21.15.114:0/680976721 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:34:23.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.678+0000 7f956127b700 1 -- 172.21.15.114:0/680976721 >> v2:172.21.15.172:3300/0 conn(0x7f955c0b7dd0 msgr2=0x7f955c161370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:34:23.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.678+0000 7f956127b700 1 --2- 172.21.15.114:0/680976721 >> v2:172.21.15.172:3300/0 conn(0x7f955c0b7dd0 0x7f955c161370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:34:23.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.678+0000 7f956127b700 1 -- 172.21.15.114:0/680976721 >> v1:172.21.15.172:6789/0 conn(0x7f955c0b5b80 legacy=0x7f955c0b76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:34:23.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.678+0000 7f956127b700 1 -- 172.21.15.114:0/680976721 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f955c0b60b0 con 0x7f955c146770 2023-10-18T12:34:23.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.678+0000 7f956127b700 1 --2- 172.21.15.114:0/680976721 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f955c146770 0x7f955c15d3c0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f955c06ce00 tx=0x7f9558009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14dde2c893307e83 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:34:23.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.678+0000 7f9553fff700 1 -- 172.21.15.114:0/680976721 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9558004230 con 0x7f955c146770 2023-10-18T12:34:23.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.678+0000 7f9553fff700 1 -- 172.21.15.114:0/680976721 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9558004390 con 0x7f955c146770 2023-10-18T12:34:23.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.678+0000 7f9553fff700 1 -- 172.21.15.114:0/680976721 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95580036c0 con 0x7f955c146770 2023-10-18T12:34:23.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.678+0000 7f95634df700 1 -- 172.21.15.114:0/680976721 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f955c146770 msgr2=0x7f955c15d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:34:23.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.678+0000 7f95634df700 1 --2- 172.21.15.114:0/680976721 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f955c146770 0x7f955c15d3c0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f955c06ce00 tx=0x7f9558009bf0 comp rx=0 tx=0).stop 2023-10-18T12:34:23.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.678+0000 7f95634df700 1 -- 172.21.15.114:0/680976721 shutdown_connections 2023-10-18T12:34:23.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.678+0000 7f95634df700 1 --2- 172.21.15.114:0/680976721 >> v2:172.21.15.172:3300/0 conn(0x7f955c0b7dd0 0x7f955c161370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:34:23.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.678+0000 7f95634df700 1 --2- 172.21.15.114:0/680976721 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f955c146770 0x7f955c15d3c0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:34:23.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.678+0000 7f95634df700 1 -- 172.21.15.114:0/680976721 >> 172.21.15.114:0/680976721 conn(0x7f955c06a130 msgr2=0x7f955c06a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:34:23.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.682+0000 7f95634df700 1 -- 172.21.15.114:0/680976721 shutdown_connections 2023-10-18T12:34:23.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.682+0000 7f95634df700 1 -- 172.21.15.114:0/680976721 wait complete. 2023-10-18T12:34:23.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.682+0000 7f95634df700 1 Processor -- start 2023-10-18T12:34:23.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.686+0000 7f95634df700 1 -- start start 2023-10-18T12:34:23.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.686+0000 7f95634df700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f955c0b5b80 0x7f955c13e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:34:23.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.686+0000 7f95634df700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f955c0b7dd0 0x7f955c15c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:34:23.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.686+0000 7f95634df700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f955c146770 0x7f955c15d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:34:23.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.686+0000 7f95634df700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f955c1f6d30 con 0x7f955c0b5b80 2023-10-18T12:34:23.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.686+0000 7f95634df700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f955c13fa40 con 0x7f955c146770 2023-10-18T12:34:23.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.686+0000 7f95634df700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f955c13ee30 con 0x7f955c0b7dd0 2023-10-18T12:34:23.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.686+0000 7f956127b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f955c0b5b80 0x7f955c13e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:34:23.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.686+0000 7f956127b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f955c0b5b80 0x7f955c13e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38320/0 (socket says 172.21.15.114:38320) 2023-10-18T12:34:23.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.686+0000 7f956127b700 1 -- 172.21.15.114:0/4145558695 learned_addr learned my addr 172.21.15.114:0/4145558695 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:34:23.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.686+0000 7f9560a7a700 1 --2- 172.21.15.114:0/4145558695 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f955c0b7dd0 0x7f955c15c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:34:23.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.686+0000 7f9561a7c700 1 --2- 172.21.15.114:0/4145558695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f955c146770 0x7f955c15d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:34:23.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.686+0000 7f956127b700 1 -- 172.21.15.114:0/4145558695 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f955c0b7dd0 msgr2=0x7f955c15c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:34:23.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.686+0000 7f956127b700 1 --2- 172.21.15.114:0/4145558695 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f955c0b7dd0 0x7f955c15c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:34:23.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.686+0000 7f956127b700 1 -- 172.21.15.114:0/4145558695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f955c146770 msgr2=0x7f955c15d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:34:23.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.686+0000 7f956127b700 1 --2- 172.21.15.114:0/4145558695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f955c146770 0x7f955c15d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:34:23.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.686+0000 7f956127b700 1 -- 172.21.15.114:0/4145558695 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9558009570 con 0x7f955c0b5b80 2023-10-18T12:34:23.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.686+0000 7f956127b700 1 --2- 172.21.15.114:0/4145558695 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f955c0b5b80 0x7f955c13e7a0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f9558009c30 tx=0x7f9558004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:34:23.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.686+0000 7f9551ffb700 1 -- 172.21.15.114:0/4145558695 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955800b860 con 0x7f955c0b5b80 2023-10-18T12:34:23.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.686+0000 7f9551ffb700 1 -- 172.21.15.114:0/4145558695 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f955800b9c0 con 0x7f955c0b5b80 2023-10-18T12:34:23.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.686+0000 7f95634df700 1 -- 172.21.15.114:0/4145558695 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f955c13f110 con 0x7f955c0b5b80 2023-10-18T12:34:23.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.686+0000 7f9551ffb700 1 -- 172.21.15.114:0/4145558695 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955800bd50 con 0x7f955c0b5b80 2023-10-18T12:34:23.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.690+0000 7f95634df700 1 -- 172.21.15.114:0/4145558695 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f955c13f6d0 con 0x7f955c0b5b80 2023-10-18T12:34:23.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.690+0000 7f95634df700 1 -- 172.21.15.114:0/4145558695 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f955c072e60 con 0x7f955c0b5b80 2023-10-18T12:34:23.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.690+0000 7f9551ffb700 1 -- 172.21.15.114:0/4145558695 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f955801b440 con 0x7f955c0b5b80 2023-10-18T12:34:23.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.694+0000 7f9551ffb700 1 --2- 172.21.15.114:0/4145558695 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9540065720 0x7f9540067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:34:23.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.694+0000 7f9551ffb700 1 -- 172.21.15.114:0/4145558695 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7f9558084760 con 0x7f955c0b5b80 2023-10-18T12:34:23.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.694+0000 7f9560a7a700 1 --2- 172.21.15.114:0/4145558695 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9540065720 0x7f9540067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:34:23.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.694+0000 7f9560a7a700 1 --2- 172.21.15.114:0/4145558695 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9540065720 0x7f9540067be0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f955c08e3e0 tx=0x7f954c007ee0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:34:23.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.698+0000 7f9551ffb700 1 -- 172.21.15.114:0/4145558695 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f9558052020 con 0x7f955c0b5b80 2023-10-18T12:34:23.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.730+0000 7f58cb570700 1 Processor -- start 2023-10-18T12:34:23.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.730+0000 7f58cb570700 1 -- start start 2023-10-18T12:34:23.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.734+0000 7f58cb570700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f58c4143640 0x7f58c40cb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:34:23.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.734+0000 7f58cb570700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f58c406de20 0x7f58c40cb810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:34:23.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.734+0000 7f58cb570700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58c406f450 con 0x7f58c4143260 2023-10-18T12:34:23.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.734+0000 7f58cb570700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58c40ccdd0 con 0x7f58c4143640 2023-10-18T12:34:23.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.734+0000 7f58cb570700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c40cd0b0 con 0x7f58c406de20 2023-10-18T12:34:23.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.734+0000 7f58c8b0b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f58c4143640 0x7f58c40cb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:34:23.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.734+0000 7f58c9b0d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f58c406de20 0x7f58c40cb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:34:23.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.734+0000 7f58c9b0d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f58c406de20 0x7f58c40cb810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.114:59210/0 (socket says 172.21.15.114:59210) 2023-10-18T12:34:23.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.734+0000 7f58c9b0d700 1 -- 172.21.15.114:0/3454085667 learned_addr learned my addr 172.21.15.114:0/3454085667 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:34:23.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.734+0000 7f58c9b0d700 1 -- 172.21.15.114:0/3454085667 >> v2:172.21.15.172:3300/0 conn(0x7f58c4143640 msgr2=0x7f58c40cb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:34:23.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.734+0000 7f58c9b0d700 1 --2- 172.21.15.114:0/3454085667 >> v2:172.21.15.172:3300/0 conn(0x7f58c4143640 0x7f58c40cb2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:34:23.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.734+0000 7f58c9b0d700 1 -- 172.21.15.114:0/3454085667 >> v1:172.21.15.172:6789/0 conn(0x7f58c4143260 legacy=0x7f58c40cc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:34:23.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.734+0000 7f58c9b0d700 1 -- 172.21.15.114:0/3454085667 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c40cd390 con 0x7f58c406de20 2023-10-18T12:34:23.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.734+0000 7f58c9b0d700 1 --2- 172.21.15.114:0/3454085667 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f58c406de20 0x7f58c40cb810 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f58bc009910 tx=0x7f58bc009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d466265d2b2c183d server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:34:23.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.738+0000 7f58bbfff700 1 -- 172.21.15.114:0/3454085667 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58bc011830 con 0x7f58c406de20 2023-10-18T12:34:23.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.738+0000 7f58bbfff700 1 -- 172.21.15.114:0/3454085667 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58bc011990 con 0x7f58c406de20 2023-10-18T12:34:23.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.738+0000 7f58bbfff700 1 -- 172.21.15.114:0/3454085667 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58bc011d40 con 0x7f58c406de20 2023-10-18T12:34:23.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.738+0000 7f58cb570700 1 -- 172.21.15.114:0/3454085667 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f58c406de20 msgr2=0x7f58c40cb810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:34:23.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.738+0000 7f58cb570700 1 --2- 172.21.15.114:0/3454085667 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f58c406de20 0x7f58c40cb810 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f58bc009910 tx=0x7f58bc009c20 comp rx=0 tx=0).stop 2023-10-18T12:34:23.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.738+0000 7f58cb570700 1 -- 172.21.15.114:0/3454085667 shutdown_connections 2023-10-18T12:34:23.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.738+0000 7f58cb570700 1 --2- 172.21.15.114:0/3454085667 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f58c406de20 0x7f58c40cb810 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:34:23.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.738+0000 7f58cb570700 1 --2- 172.21.15.114:0/3454085667 >> v2:172.21.15.172:3300/0 conn(0x7f58c4143640 0x7f58c40cb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:34:23.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.738+0000 7f58cb570700 1 -- 172.21.15.114:0/3454085667 >> 172.21.15.114:0/3454085667 conn(0x7f58c40b0650 msgr2=0x7f58c40b0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:34:23.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.738+0000 7f58cb570700 1 -- 172.21.15.114:0/3454085667 shutdown_connections 2023-10-18T12:34:23.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.738+0000 7f58cb570700 1 -- 172.21.15.114:0/3454085667 wait complete. 2023-10-18T12:34:23.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.738+0000 7f58cb570700 1 Processor -- start 2023-10-18T12:34:23.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.738+0000 7f58cb570700 1 -- start start 2023-10-18T12:34:23.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.742+0000 7f58cb570700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58c406de20 0x7f58c413f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:34:23.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.742+0000 7f58cb570700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58c4143260 0x7f58c40b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:34:23.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.742+0000 7f58cb570700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f58c4143640 0x7f58c4141e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:34:23.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.742+0000 7f58cb570700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c415fba0 con 0x7f58c406de20 2023-10-18T12:34:23.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.742+0000 7f58cb570700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c40b26f0 con 0x7f58c4143260 2023-10-18T12:34:23.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.742+0000 7f58cb570700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c40b2fd0 con 0x7f58c4143640 2023-10-18T12:34:23.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.742+0000 7f58c930c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58c406de20 0x7f58c413f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:34:23.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.742+0000 7f58c8b0b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58c4143260 0x7f58c40b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:34:23.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.742+0000 7f58c930c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58c406de20 0x7f58c413f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:38324/0 (socket says 172.21.15.114:38324) 2023-10-18T12:34:23.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.742+0000 7f58c930c700 1 -- 172.21.15.114:0/2080270460 learned_addr learned my addr 172.21.15.114:0/2080270460 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:34:23.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.742+0000 7f58c9b0d700 1 --2- 172.21.15.114:0/2080270460 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f58c4143640 0x7f58c4141e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:34:23.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.742+0000 7f58c930c700 1 -- 172.21.15.114:0/2080270460 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f58c4143640 msgr2=0x7f58c4141e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:34:23.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.742+0000 7f58c930c700 1 --2- 172.21.15.114:0/2080270460 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f58c4143640 0x7f58c4141e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:34:23.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.742+0000 7f58c930c700 1 -- 172.21.15.114:0/2080270460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58c4143260 msgr2=0x7f58c40b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:34:23.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.742+0000 7f58c930c700 1 --2- 172.21.15.114:0/2080270460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58c4143260 0x7f58c40b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:34:23.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.742+0000 7f58c930c700 1 -- 172.21.15.114:0/2080270460 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58bc009570 con 0x7f58c406de20 2023-10-18T12:34:23.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.742+0000 7f58c8b0b700 1 --2- 172.21.15.114:0/2080270460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58c4143260 0x7f58c40b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:34:23.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.742+0000 7f58c930c700 1 --2- 172.21.15.114:0/2080270460 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58c406de20 0x7f58c413f500 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f58c0001f00 tx=0x7f58c000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:34:23.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.742+0000 7f58b9ffb700 1 -- 172.21.15.114:0/2080270460 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c0003c20 con 0x7f58c406de20 2023-10-18T12:34:23.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.742+0000 7f58b9ffb700 1 -- 172.21.15.114:0/2080270460 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c0003d80 con 0x7f58c406de20 2023-10-18T12:34:23.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.742+0000 7f58cb570700 1 -- 172.21.15.114:0/2080270460 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58c40b1ae0 con 0x7f58c406de20 2023-10-18T12:34:23.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.742+0000 7f58b9ffb700 1 -- 172.21.15.114:0/2080270460 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c000ab70 con 0x7f58c406de20 2023-10-18T12:34:23.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.742+0000 7f58cb570700 1 -- 172.21.15.114:0/2080270460 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58c40b20a0 con 0x7f58c406de20 2023-10-18T12:34:23.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.746+0000 7f58cb570700 1 -- 172.21.15.114:0/2080270460 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f58c4073f00 con 0x7f58c406de20 2023-10-18T12:34:23.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.746+0000 7f58b9ffb700 1 -- 172.21.15.114:0/2080270460 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f58c000acd0 con 0x7f58c406de20 2023-10-18T12:34:23.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.746+0000 7f58b9ffb700 1 --2- 172.21.15.114:0/2080270460 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f58a80656f0 0x7f58a8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:34:23.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.746+0000 7f58b9ffb700 1 -- 172.21.15.114:0/2080270460 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7f58c00830e0 con 0x7f58c406de20 2023-10-18T12:34:23.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.746+0000 7f58b9ffb700 1 -- 172.21.15.114:0/2080270460 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+449 (secure 0 0 0) 0x7f58c008a070 con 0x7f58c406de20 2023-10-18T12:34:23.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.746+0000 7f58c8b0b700 1 --2- 172.21.15.114:0/2080270460 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f58a80656f0 0x7f58a8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:34:23.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.746+0000 7f58cb570700 1 -- 172.21.15.114:0/2080270460 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7f58c41f2a40 con 0x7f58c406de20 2023-10-18T12:34:23.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.750+0000 7f58c8b0b700 1 --2- 172.21.15.114:0/2080270460 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f58a80656f0 0x7f58a8067bb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f58c40cadd0 tx=0x7f58b4009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:34:23.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.938+0000 7f95634df700 1 -- 172.21.15.114:0/4145558695 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f955c1618b0 con 0x7f955c0b5b80 2023-10-18T12:34:23.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.938+0000 7f9551ffb700 1 -- 172.21.15.114:0/4145558695 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4889 (secure 0 0 0) 0x7f955c1618b0 con 0x7f955c0b5b80 2023-10-18T12:34:23.944 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:34:23.944 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2034957068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2034957068},{"type":"v1","addr":"172.21.15.172:6836","nonce":2034957068}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5039,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4215710360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4215710360},{"type":"v1","addr":"172.21.15.172:6837","nonce":4215710360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2387835210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2387835210},{"type":"v1","addr":"172.21.15.114:6833","nonce":2387835210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T12:21:14.159069+0000","modified":"2023-10-18T12:29:23.762500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":126,"addr":"172.21.15.114:6835/1284474820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1284474820},{"type":"v1","addr":"172.21.15.114:6835","nonce":1284474820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-18T12:34:23.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.942+0000 7f95634df700 1 -- 172.21.15.114:0/4145558695 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9540065720 msgr2=0x7f9540067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:34:23.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.942+0000 7f95634df700 1 --2- 172.21.15.114:0/4145558695 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9540065720 0x7f9540067be0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f955c08e3e0 tx=0x7f954c007ee0 comp rx=0 tx=0).stop 2023-10-18T12:34:23.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.942+0000 7f95634df700 1 -- 172.21.15.114:0/4145558695 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f955c0b5b80 msgr2=0x7f955c13e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:34:23.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.942+0000 7f95634df700 1 --2- 172.21.15.114:0/4145558695 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f955c0b5b80 0x7f955c13e7a0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f9558009c30 tx=0x7f9558004770 comp rx=0 tx=0).stop 2023-10-18T12:34:23.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.942+0000 7f95634df700 1 -- 172.21.15.114:0/4145558695 shutdown_connections 2023-10-18T12:34:23.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.942+0000 7f95634df700 1 --2- 172.21.15.114:0/4145558695 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9540065720 0x7f9540067be0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:34:23.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.946+0000 7f95634df700 1 --2- 172.21.15.114:0/4145558695 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f955c0b7dd0 0x7f955c15c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:34:23.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.946+0000 7f95634df700 1 --2- 172.21.15.114:0/4145558695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f955c146770 0x7f955c15d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:34:23.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.946+0000 7f95634df700 1 --2- 172.21.15.114:0/4145558695 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f955c0b5b80 0x7f955c13e7a0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:34:23.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.946+0000 7f95634df700 1 -- 172.21.15.114:0/4145558695 >> 172.21.15.114:0/4145558695 conn(0x7f955c06a130 msgr2=0x7f955c144170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:34:23.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.946+0000 7f95634df700 1 -- 172.21.15.114:0/4145558695 shutdown_connections 2023-10-18T12:34:23.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:34:23.946+0000 7f95634df700 1 -- 172.21.15.114:0/4145558695 wait complete. 2023-10-18T12:34:23.952 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 20 2023-10-18T12:34:23.970 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-10-18T12:34:24.158 INFO:teuthology.orchestra.run.smithi114.stdout:[{"id":5162,"entity":{"name":{"type":"client","num":5162},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":989916161}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":780.17445618399995,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.16487354265254578,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":3,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5162 v1:192.168.0.1:0/989916161","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi172","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}}] 2023-10-18T12:34:24.159 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "1", "hostname": "smithi172", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 989916161, "type": "v1" }, "name": { "num": 5162, "type": "client" } }, "id": 5162, "inst": "client.5162 v1:192.168.0.1:0/989916161", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 3, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.16487354265254578 }, "state": "open", "uptime": 780.174456184 } ] 2023-10-18T12:34:24.260 DEBUG:tasks.ceph_test_case:No log hits yet, waiting... 2023-10-18T12:34:34.764 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:34:34.772 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:34:59.289 ERROR:tasks.ceph_test_case:Log output: 2023-10-18T12:34:59.290 DEBUG:tasks.cephfs.test_client_recovery:Expected log message found: 'Health check cleared: MDS_CLIENTS_LAGGY', retrying 2023-10-18T12:35:00.291 DEBUG:teuthology.orchestra.run.smithi114:> sudo daemon-helper kill ceph --cluster ceph -w 2023-10-18T12:35:00.301 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T12:35:00.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.473+0000 7fe086f2d700 1 Processor -- start 2023-10-18T12:35:00.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.473+0000 7fe086f2d700 1 -- start start 2023-10-18T12:35:00.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.473+0000 7fe086f2d700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe080146800 0x7fe0800b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:35:00.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.473+0000 7fe086f2d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe08015dd30 0x7fe08006f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:35:00.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.473+0000 7fe086f2d700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe08015e680 con 0x7fe08006fee0 2023-10-18T12:35:00.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.473+0000 7fe086f2d700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe080070310 con 0x7fe08015dd30 2023-10-18T12:35:00.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.473+0000 7fe086f2d700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0800b6180 con 0x7fe080146800 2023-10-18T12:35:00.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.473+0000 7fe07ffff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe08015dd30 0x7fe08006f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:35:00.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.473+0000 7fe0854ca700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe08006fee0 0x7fe0801608a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53136/0 (socket says 172.21.15.114:53136) 2023-10-18T12:35:00.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.473+0000 7fe0854ca700 1 -- 172.21.15.114:0/1161359395 learned_addr learned my addr 172.21.15.114:0/1161359395 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:35:00.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.477+0000 7fe07ffff700 1 -- 172.21.15.114:0/1161359395 >> v2:172.21.15.172:3300/0 conn(0x7fe080146800 msgr2=0x7fe0800b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:35:00.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.477+0000 7fe07ffff700 1 --2- 172.21.15.114:0/1161359395 >> v2:172.21.15.172:3300/0 conn(0x7fe080146800 0x7fe0800b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:35:00.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.477+0000 7fe07ffff700 1 -- 172.21.15.114:0/1161359395 >> v1:172.21.15.114:6789/0 conn(0x7fe08006fee0 legacy=0x7fe0801608a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:35:00.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.477+0000 7fe07ffff700 1 -- 172.21.15.114:0/1161359395 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0800b6460 con 0x7fe08015dd30 2023-10-18T12:35:00.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.477+0000 7fe07ffff700 1 --2- 172.21.15.114:0/1161359395 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe08015dd30 0x7fe08006f9a0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fe0800706b0 tx=0x7fe06c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a13d3f0972f8862e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:35:00.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.477+0000 7fe07f7fe700 1 -- 172.21.15.114:0/1161359395 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06c011830 con 0x7fe08015dd30 2023-10-18T12:35:00.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.477+0000 7fe07f7fe700 1 -- 172.21.15.114:0/1161359395 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe06c011990 con 0x7fe08015dd30 2023-10-18T12:35:00.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.477+0000 7fe07f7fe700 1 -- 172.21.15.114:0/1161359395 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06c011d40 con 0x7fe08015dd30 2023-10-18T12:35:00.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.477+0000 7fe086f2d700 1 -- 172.21.15.114:0/1161359395 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe08015dd30 msgr2=0x7fe08006f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:35:00.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.477+0000 7fe086f2d700 1 --2- 172.21.15.114:0/1161359395 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe08015dd30 0x7fe08006f9a0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fe0800706b0 tx=0x7fe06c009b30 comp rx=0 tx=0).stop 2023-10-18T12:35:00.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.477+0000 7fe086f2d700 1 -- 172.21.15.114:0/1161359395 shutdown_connections 2023-10-18T12:35:00.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.477+0000 7fe086f2d700 1 --2- 172.21.15.114:0/1161359395 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe08015dd30 0x7fe08006f9a0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:35:00.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.477+0000 7fe086f2d700 1 --2- 172.21.15.114:0/1161359395 >> v2:172.21.15.172:3300/0 conn(0x7fe080146800 0x7fe0800b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:35:00.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.477+0000 7fe086f2d700 1 -- 172.21.15.114:0/1161359395 >> 172.21.15.114:0/1161359395 conn(0x7fe08006a130 msgr2=0x7fe08006a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:35:00.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.477+0000 7fe086f2d700 1 -- 172.21.15.114:0/1161359395 shutdown_connections 2023-10-18T12:35:00.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.477+0000 7fe086f2d700 1 -- 172.21.15.114:0/1161359395 wait complete. 2023-10-18T12:35:00.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.481+0000 7fe086f2d700 1 Processor -- start 2023-10-18T12:35:00.488 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.481+0000 7fe086f2d700 1 -- start start 2023-10-18T12:35:00.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.485+0000 7fe086f2d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe08006fee0 0x7fe0800ac1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:35:00.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.485+0000 7fe086f2d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe080146800 0x7fe080140970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:35:00.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.485+0000 7fe086f2d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe08015dd30 0x7fe0801f29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:35:00.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.485+0000 7fe086f2d700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0800aca00 con 0x7fe08006fee0 2023-10-18T12:35:00.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.485+0000 7fe086f2d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0800acce0 con 0x7fe08015dd30 2023-10-18T12:35:00.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.485+0000 7fe086f2d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe08013e000 con 0x7fe080146800 2023-10-18T12:35:00.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.485+0000 7fe084cc9700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe08006fee0 0x7fe0800ac1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:35:00.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.485+0000 7fe084cc9700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe08006fee0 0x7fe0800ac1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57934/0 (socket says 172.21.15.114:57934) 2023-10-18T12:35:00.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.485+0000 7fe084cc9700 1 -- 172.21.15.114:0/91817732 learned_addr learned my addr 172.21.15.114:0/91817732 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:35:00.492 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.485+0000 7fe084cc9700 1 -- 172.21.15.114:0/91817732 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe080146800 msgr2=0x7fe080140970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:35:00.492 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.485+0000 7fe084cc9700 1 --2- 172.21.15.114:0/91817732 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe080146800 0x7fe080140970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:35:00.493 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.485+0000 7fe084cc9700 1 -- 172.21.15.114:0/91817732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe08015dd30 msgr2=0x7fe0801f29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:35:00.493 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.485+0000 7fe084cc9700 1 --2- 172.21.15.114:0/91817732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe08015dd30 0x7fe0801f29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:35:00.493 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.485+0000 7fe084cc9700 1 -- 172.21.15.114:0/91817732 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe06c0094b0 con 0x7fe08006fee0 2023-10-18T12:35:00.493 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.485+0000 7fe084cc9700 1 --2- 172.21.15.114:0/91817732 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe08006fee0 0x7fe0800ac1d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fe07400b550 tx=0x7fe07400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:35:00.494 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.485+0000 7fe07d7fa700 1 -- 172.21.15.114:0/91817732 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe074011830 con 0x7fe08006fee0 2023-10-18T12:35:00.494 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.485+0000 7fe07d7fa700 1 -- 172.21.15.114:0/91817732 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe074011990 con 0x7fe08006fee0 2023-10-18T12:35:00.494 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.485+0000 7fe086f2d700 1 -- 172.21.15.114:0/91817732 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe08013e2e0 con 0x7fe08006fee0 2023-10-18T12:35:00.494 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.485+0000 7fe07d7fa700 1 -- 172.21.15.114:0/91817732 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe074011d40 con 0x7fe08006fee0 2023-10-18T12:35:00.495 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.485+0000 7fe086f2d700 1 -- 172.21.15.114:0/91817732 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0800ac710 con 0x7fe08006fee0 2023-10-18T12:35:00.495 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.485+0000 7fe086f2d700 1 -- 172.21.15.114:0/91817732 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe080072e60 con 0x7fe08006fee0 2023-10-18T12:35:00.495 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.489+0000 7fe07d7fa700 1 -- 172.21.15.114:0/91817732 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fe07401a400 con 0x7fe08006fee0 2023-10-18T12:35:00.496 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.489+0000 7fe07d7fa700 1 --2- 172.21.15.114:0/91817732 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe0640656f0 0x7fe064067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:35:00.496 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.489+0000 7fe07d7fa700 1 -- 172.21.15.114:0/91817732 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7fe074083690 con 0x7fe08006fee0 2023-10-18T12:35:00.496 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.489+0000 7fe07ffff700 1 --2- 172.21.15.114:0/91817732 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe0640656f0 0x7fe064067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:35:00.497 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.493+0000 7fe07ffff700 1 --2- 172.21.15.114:0/91817732 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe0640656f0 0x7fe064067bb0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe08006e040 tx=0x7fe06c010000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:35:00.498 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.493+0000 7fe07d7fa700 1 -- 172.21.15.114:0/91817732 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fe074050fa0 con 0x7fe08006fee0 2023-10-18T12:35:00.500 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.493+0000 7f025db15700 1 Processor -- start 2023-10-18T12:35:00.501 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.497+0000 7f025db15700 1 -- start start 2023-10-18T12:35:00.502 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.497+0000 7f025db15700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f025806e650 0x7f02580b2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:35:00.503 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.497+0000 7f025db15700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f02580ca880 0x7f02580b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:35:00.503 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.497+0000 7f025db15700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02580cb9e0 con 0x7f025815ad70 2023-10-18T12:35:00.503 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.497+0000 7f025db15700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02580cadd0 con 0x7f025806e650 2023-10-18T12:35:00.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.497+0000 7f025db15700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02580cb0b0 con 0x7f02580ca880 2023-10-18T12:35:00.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.497+0000 7f0257fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f025806e650 0x7f02580b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:35:00.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.497+0000 7f0257fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f025806e650 0x7f02580b2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57942/0 (socket says 172.21.15.114:57942) 2023-10-18T12:35:00.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.497+0000 7f0257fff700 1 -- 172.21.15.114:0/343786539 learned_addr learned my addr 172.21.15.114:0/343786539 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:35:00.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.497+0000 7f025cb13700 1 --1- 172.21.15.114:0/343786539 >> v1:172.21.15.114:6789/0 conn(0x7f025815ad70 0x7f025806df40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53140/0 (socket says 172.21.15.114:53140) 2023-10-18T12:35:00.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.497+0000 7f025d314700 1 --2- 172.21.15.114:0/343786539 >> v2:172.21.15.172:3300/0 conn(0x7f02580ca880 0x7f02580b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:35:00.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.497+0000 7f0257fff700 1 -- 172.21.15.114:0/343786539 >> v2:172.21.15.172:3300/0 conn(0x7f02580ca880 msgr2=0x7f02580b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:35:00.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.497+0000 7f0257fff700 1 --2- 172.21.15.114:0/343786539 >> v2:172.21.15.172:3300/0 conn(0x7f02580ca880 0x7f02580b2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:35:00.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.497+0000 7f0257fff700 1 -- 172.21.15.114:0/343786539 >> v1:172.21.15.114:6789/0 conn(0x7f025815ad70 legacy=0x7f025806df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:35:00.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.497+0000 7f0257fff700 1 -- 172.21.15.114:0/343786539 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02580cb390 con 0x7f025806e650 2023-10-18T12:35:00.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.497+0000 7f02577fe700 1 -- 172.21.15.114:0/343786539 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2269586130 0 0) 0x7f02580cb9e0 con 0x7f025815ad70 2023-10-18T12:35:00.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.497+0000 7f0257fff700 1 --2- 172.21.15.114:0/343786539 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f025806e650 0x7f02580b2770 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f02580b12a0 tx=0x7f0244009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae8295ea4478d3d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:35:00.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.497+0000 7f02577fe700 1 -- 172.21.15.114:0/343786539 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0244011830 con 0x7f025806e650 2023-10-18T12:35:00.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.497+0000 7f02577fe700 1 -- 172.21.15.114:0/343786539 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0244011990 con 0x7f025806e650 2023-10-18T12:35:00.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.497+0000 7f02577fe700 1 -- 172.21.15.114:0/343786539 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0244011d20 con 0x7f025806e650 2023-10-18T12:35:00.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.501+0000 7f025db15700 1 -- 172.21.15.114:0/343786539 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f025806e650 msgr2=0x7f02580b2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:35:00.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.501+0000 7f025db15700 1 --2- 172.21.15.114:0/343786539 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f025806e650 0x7f02580b2770 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f02580b12a0 tx=0x7f0244009bf0 comp rx=0 tx=0).stop 2023-10-18T12:35:00.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.501+0000 7f025db15700 1 -- 172.21.15.114:0/343786539 shutdown_connections 2023-10-18T12:35:00.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.501+0000 7f025db15700 1 --2- 172.21.15.114:0/343786539 >> v2:172.21.15.172:3300/0 conn(0x7f02580ca880 0x7f02580b2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:35:00.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.501+0000 7f025db15700 1 --2- 172.21.15.114:0/343786539 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f025806e650 0x7f02580b2770 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:35:00.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.501+0000 7f025db15700 1 -- 172.21.15.114:0/343786539 >> 172.21.15.114:0/343786539 conn(0x7f02580cf820 msgr2=0x7f02580cfc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:35:00.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.501+0000 7f025db15700 1 -- 172.21.15.114:0/343786539 shutdown_connections 2023-10-18T12:35:00.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.501+0000 7f025db15700 1 -- 172.21.15.114:0/343786539 wait complete. 2023-10-18T12:35:00.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.501+0000 7f025db15700 1 Processor -- start 2023-10-18T12:35:00.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.505+0000 7f025db15700 1 -- start start 2023-10-18T12:35:00.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.505+0000 7f025db15700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f025806e650 0x7f02580ce950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:35:00.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.505+0000 7f025db15700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02580ca880 0x7f02580c3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:35:00.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.505+0000 7f025db15700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f025815ad70 0x7f0258151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:35:00.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.505+0000 7f025db15700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02580c3870 con 0x7f02580ca880 2023-10-18T12:35:00.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.505+0000 7f025db15700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02580c3b10 con 0x7f025815ad70 2023-10-18T12:35:00.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.505+0000 7f025db15700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02580c3df0 con 0x7f025806e650 2023-10-18T12:35:00.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.505+0000 7f0257fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02580ca880 0x7f02580c3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:35:00.518 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.505+0000 7f0257fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02580ca880 0x7f02580c3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57954/0 (socket says 172.21.15.114:57954) 2023-10-18T12:35:00.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.505+0000 7f0257fff700 1 -- 172.21.15.114:0/2268171612 learned_addr learned my addr 172.21.15.114:0/2268171612 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:35:00.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.505+0000 7f025d314700 1 --2- 172.21.15.114:0/2268171612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f025815ad70 0x7f0258151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:35:00.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.505+0000 7f025cb13700 1 --2- 172.21.15.114:0/2268171612 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f025806e650 0x7f02580ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:35:00.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.505+0000 7f0257fff700 1 -- 172.21.15.114:0/2268171612 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f025806e650 msgr2=0x7f02580ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:35:00.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.505+0000 7f0257fff700 1 --2- 172.21.15.114:0/2268171612 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f025806e650 0x7f02580ce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:35:00.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.505+0000 7f0257fff700 1 -- 172.21.15.114:0/2268171612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f025815ad70 msgr2=0x7f0258151c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:35:00.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.505+0000 7f0257fff700 1 --2- 172.21.15.114:0/2268171612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f025815ad70 0x7f0258151c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:35:00.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.505+0000 7f0257fff700 1 -- 172.21.15.114:0/2268171612 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0244009570 con 0x7f02580ca880 2023-10-18T12:35:00.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.505+0000 7f025d314700 1 --2- 172.21.15.114:0/2268171612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f025815ad70 0x7f0258151c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:35:00.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.505+0000 7f0257fff700 1 --2- 172.21.15.114:0/2268171612 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02580ca880 0x7f02580c3330 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f02580cf6f0 tx=0x7f0244004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:35:00.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.505+0000 7f02557fa700 1 -- 172.21.15.114:0/2268171612 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02440045d0 con 0x7f02580ca880 2023-10-18T12:35:00.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.505+0000 7f02557fa700 1 -- 172.21.15.114:0/2268171612 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f024401f070 con 0x7f02580ca880 2023-10-18T12:35:00.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.505+0000 7f02557fa700 1 -- 172.21.15.114:0/2268171612 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02440038e0 con 0x7f02580ca880 2023-10-18T12:35:00.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.505+0000 7f025db15700 1 -- 172.21.15.114:0/2268171612 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02580c40d0 con 0x7f02580ca880 2023-10-18T12:35:00.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.509+0000 7f025db15700 1 -- 172.21.15.114:0/2268171612 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02580c4690 con 0x7f02580ca880 2023-10-18T12:35:00.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.509+0000 7f025db15700 1 -- 172.21.15.114:0/2268171612 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f0258072e60 con 0x7f02580ca880 2023-10-18T12:35:00.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.509+0000 7f02557fa700 1 -- 172.21.15.114:0/2268171612 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f0244003a40 con 0x7f02580ca880 2023-10-18T12:35:00.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.513+0000 7f02557fa700 1 --2- 172.21.15.114:0/2268171612 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f023c065720 0x7f023c067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:35:00.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.513+0000 7f02557fa700 1 -- 172.21.15.114:0/2268171612 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7f0244021070 con 0x7f02580ca880 2023-10-18T12:35:00.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.513+0000 7f02557fa700 1 -- 172.21.15.114:0/2268171612 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+449 (secure 0 0 0) 0x7f024408b070 con 0x7f02580ca880 2023-10-18T12:35:00.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.513+0000 7f025db15700 1 -- 172.21.15.114:0/2268171612 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7f025806e130 con 0x7f02580ca880 2023-10-18T12:35:00.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.513+0000 7f025cb13700 1 --2- 172.21.15.114:0/2268171612 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f023c065720 0x7f023c067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:35:00.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.517+0000 7f025cb13700 1 --2- 172.21.15.114:0/2268171612 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f023c065720 0x7f023c067be0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f024c000f60 tx=0x7f024c007cb0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:35:00.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.729+0000 7fe086f2d700 1 -- 172.21.15.114:0/91817732 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe0800b71e0 con 0x7fe08006fee0 2023-10-18T12:35:00.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.733+0000 7fe07d7fa700 1 -- 172.21.15.114:0/91817732 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4889 (secure 0 0 0) 0x7fe0740545c0 con 0x7fe08006fee0 2023-10-18T12:35:00.738 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:35:00.738 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2034957068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2034957068},{"type":"v1","addr":"172.21.15.172:6836","nonce":2034957068}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5039,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4215710360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4215710360},{"type":"v1","addr":"172.21.15.172:6837","nonce":4215710360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2387835210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2387835210},{"type":"v1","addr":"172.21.15.114:6833","nonce":2387835210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T12:21:14.159069+0000","modified":"2023-10-18T12:29:23.762500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":126,"addr":"172.21.15.114:6835/1284474820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1284474820},{"type":"v1","addr":"172.21.15.114:6835","nonce":1284474820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-18T12:35:00.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.733+0000 7fe086f2d700 1 -- 172.21.15.114:0/91817732 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe0640656f0 msgr2=0x7fe064067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:35:00.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.733+0000 7fe086f2d700 1 --2- 172.21.15.114:0/91817732 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe0640656f0 0x7fe064067bb0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe08006e040 tx=0x7fe06c010000 comp rx=0 tx=0).stop 2023-10-18T12:35:00.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.733+0000 7fe086f2d700 1 -- 172.21.15.114:0/91817732 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe08006fee0 msgr2=0x7fe0800ac1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:35:00.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.733+0000 7fe086f2d700 1 --2- 172.21.15.114:0/91817732 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe08006fee0 0x7fe0800ac1d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fe07400b550 tx=0x7fe07400b910 comp rx=0 tx=0).stop 2023-10-18T12:35:00.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.737+0000 7fe086f2d700 1 -- 172.21.15.114:0/91817732 shutdown_connections 2023-10-18T12:35:00.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.737+0000 7fe086f2d700 1 --2- 172.21.15.114:0/91817732 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe0640656f0 0x7fe064067bb0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:35:00.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.737+0000 7fe086f2d700 1 --2- 172.21.15.114:0/91817732 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe080146800 0x7fe080140970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:35:00.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.737+0000 7fe086f2d700 1 --2- 172.21.15.114:0/91817732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe08015dd30 0x7fe0801f29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:35:00.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.737+0000 7fe086f2d700 1 --2- 172.21.15.114:0/91817732 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe08006fee0 0x7fe0800ac1d0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:35:00.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.737+0000 7fe086f2d700 1 -- 172.21.15.114:0/91817732 >> 172.21.15.114:0/91817732 conn(0x7fe08006a130 msgr2=0x7fe0800b5330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:35:00.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.737+0000 7fe086f2d700 1 -- 172.21.15.114:0/91817732 shutdown_connections 2023-10-18T12:35:00.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:00.737+0000 7fe086f2d700 1 -- 172.21.15.114:0/91817732 wait complete. 2023-10-18T12:35:00.744 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 20 2023-10-18T12:35:00.765 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-10-18T12:35:00.957 INFO:teuthology.orchestra.run.smithi114.stdout:[{"id":5162,"entity":{"name":{"type":"client","num":5162},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":989916161}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":816.96572690400001,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.15143748305221821,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":3,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5162 v1:192.168.0.1:0/989916161","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi172","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}}] 2023-10-18T12:35:00.958 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "1", "hostname": "smithi172", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 989916161, "type": "v1" }, "name": { "num": 5162, "type": "client" } }, "id": 5162, "inst": "client.5162 v1:192.168.0.1:0/989916161", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 3, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.1514374830522182 }, "state": "open", "uptime": 816.965726904 } ] 2023-10-18T12:35:01.059 DEBUG:tasks.ceph_test_case:No log hits yet, waiting... 2023-10-18T12:35:04.860 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:35:04.868 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:35:34.949 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:35:34.956 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:35:36.084 ERROR:tasks.ceph_test_case:Log output: 2023-10-18T12:35:36.084 DEBUG:tasks.cephfs.test_client_recovery:Expected log message found: 'Health check cleared: MDS_CLIENTS_LAGGY', retrying 2023-10-18T12:35:37.085 DEBUG:teuthology.orchestra.run.smithi114:> sudo daemon-helper kill ceph --cluster ceph -w 2023-10-18T12:35:37.094 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T12:35:37.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.260+0000 7f5e120f2700 1 Processor -- start 2023-10-18T12:35:37.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.264+0000 7f5e120f2700 1 -- start start 2023-10-18T12:35:37.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.264+0000 7f5e120f2700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5e0c0b3d40 0x7f5e0c0cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:35:37.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.264+0000 7f5e120f2700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5e0c06ce20 0x7f5e0c06d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:35:37.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.264+0000 7f5e120f2700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e0c06d7b0 con 0x7f5e0c164a20 2023-10-18T12:35:37.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.264+0000 7f5e120f2700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e0c06e2d0 con 0x7f5e0c0b3d40 2023-10-18T12:35:37.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.264+0000 7f5e120f2700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e0c0ca4c0 con 0x7f5e0c06ce20 2023-10-18T12:35:37.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.264+0000 7f5e108ef700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f5e0c164a20 0x7f5e0c0c9cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:54750/0 (socket says 172.21.15.114:54750) 2023-10-18T12:35:37.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.264+0000 7f5e108ef700 1 -- 172.21.15.114:0/1948129035 learned_addr learned my addr 172.21.15.114:0/1948129035 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:35:37.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.264+0000 7f5e110f0700 1 --2- 172.21.15.114:0/1948129035 >> v2:172.21.15.114:3300/0 conn(0x7f5e0c0b3d40 0x7f5e0c0cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:35:37.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.264+0000 7f5e03fff700 1 -- 172.21.15.114:0/1948129035 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1697965100 0 0) 0x7f5dfc001110 con 0x7f5e0c164a20 2023-10-18T12:35:37.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.264+0000 7f5e118f1700 1 --2- 172.21.15.114:0/1948129035 >> v2:172.21.15.172:3300/0 conn(0x7f5e0c06ce20 0x7f5e0c06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:35:37.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.264+0000 7f5e03fff700 1 -- 172.21.15.114:0/1948129035 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5df80035d0 con 0x7f5e0c164a20 2023-10-18T12:35:37.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.264+0000 7f5e110f0700 1 -- 172.21.15.114:0/1948129035 >> v2:172.21.15.172:3300/0 conn(0x7f5e0c06ce20 msgr2=0x7f5e0c06d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:35:37.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.264+0000 7f5e110f0700 1 --2- 172.21.15.114:0/1948129035 >> v2:172.21.15.172:3300/0 conn(0x7f5e0c06ce20 0x7f5e0c06d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:35:37.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.264+0000 7f5e110f0700 1 -- 172.21.15.114:0/1948129035 >> v1:172.21.15.114:6789/0 conn(0x7f5e0c164a20 legacy=0x7f5e0c0c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:35:37.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.264+0000 7f5e110f0700 1 -- 172.21.15.114:0/1948129035 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e0c0ca7a0 con 0x7f5e0c0b3d40 2023-10-18T12:35:37.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.264+0000 7f5e110f0700 1 --2- 172.21.15.114:0/1948129035 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e0c0b3d40 0x7f5e0c0cc190 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c0c9240 tx=0x7f5e08009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1a61e32bb7c4bb1 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:35:37.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.264+0000 7f5e03fff700 1 -- 172.21.15.114:0/1948129035 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e08011830 con 0x7f5e0c0b3d40 2023-10-18T12:35:37.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.264+0000 7f5e03fff700 1 -- 172.21.15.114:0/1948129035 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e08011990 con 0x7f5e0c0b3d40 2023-10-18T12:35:37.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.264+0000 7f5e03fff700 1 -- 172.21.15.114:0/1948129035 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e08011d20 con 0x7f5e0c0b3d40 2023-10-18T12:35:37.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.268+0000 7f5e120f2700 1 -- 172.21.15.114:0/1948129035 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e0c0b3d40 msgr2=0x7f5e0c0cc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:35:37.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.268+0000 7f5e120f2700 1 --2- 172.21.15.114:0/1948129035 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e0c0b3d40 0x7f5e0c0cc190 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c0c9240 tx=0x7f5e08009b30 comp rx=0 tx=0).stop 2023-10-18T12:35:37.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.268+0000 7f5e120f2700 1 -- 172.21.15.114:0/1948129035 shutdown_connections 2023-10-18T12:35:37.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.268+0000 7f5e120f2700 1 --2- 172.21.15.114:0/1948129035 >> v2:172.21.15.172:3300/0 conn(0x7f5e0c06ce20 0x7f5e0c06d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:35:37.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.268+0000 7f5e120f2700 1 --2- 172.21.15.114:0/1948129035 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e0c0b3d40 0x7f5e0c0cc190 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:35:37.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.268+0000 7f5e120f2700 1 -- 172.21.15.114:0/1948129035 >> 172.21.15.114:0/1948129035 conn(0x7f5e0c0ce5c0 msgr2=0x7f5e0c0ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:35:37.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.268+0000 7f5e120f2700 1 -- 172.21.15.114:0/1948129035 shutdown_connections 2023-10-18T12:35:37.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.268+0000 7f5e120f2700 1 -- 172.21.15.114:0/1948129035 wait complete. 2023-10-18T12:35:37.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.268+0000 7f5e120f2700 1 Processor -- start 2023-10-18T12:35:37.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.268+0000 7f5e120f2700 1 -- start start 2023-10-18T12:35:37.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.272+0000 7f5e120f2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e0c06ce20 0x7f5e0c157760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:35:37.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.272+0000 7f5e120f2700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e0c0b3d40 0x7f5e0c163ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:35:37.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.272+0000 7f5e120f2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5e0c164a20 0x7f5e0c0c43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:35:37.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.272+0000 7f5e120f2700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c162490 con 0x7f5e0c0b3d40 2023-10-18T12:35:37.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.272+0000 7f5e120f2700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c157ca0 con 0x7f5e0c06ce20 2023-10-18T12:35:37.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.272+0000 7f5e120f2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c163780 con 0x7f5e0c164a20 2023-10-18T12:35:37.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.272+0000 7f5e108ef700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e0c0b3d40 0x7f5e0c163ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:35:37.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.272+0000 7f5e108ef700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e0c0b3d40 0x7f5e0c163ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35210/0 (socket says 172.21.15.114:35210) 2023-10-18T12:35:37.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.272+0000 7f5e108ef700 1 -- 172.21.15.114:0/1693255621 learned_addr learned my addr 172.21.15.114:0/1693255621 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:35:37.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.272+0000 7f5e110f0700 1 --2- 172.21.15.114:0/1693255621 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e0c06ce20 0x7f5e0c157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:35:37.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.272+0000 7f5e118f1700 1 --2- 172.21.15.114:0/1693255621 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5e0c164a20 0x7f5e0c0c43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:35:37.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.272+0000 7f5e108ef700 1 -- 172.21.15.114:0/1693255621 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5e0c164a20 msgr2=0x7f5e0c0c43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:35:37.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.272+0000 7f5e108ef700 1 --2- 172.21.15.114:0/1693255621 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5e0c164a20 0x7f5e0c0c43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:35:37.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.272+0000 7f5e108ef700 1 -- 172.21.15.114:0/1693255621 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e0c06ce20 msgr2=0x7f5e0c157760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:35:37.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.272+0000 7f5e108ef700 1 --2- 172.21.15.114:0/1693255621 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e0c06ce20 0x7f5e0c157760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:35:37.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.272+0000 7f5e108ef700 1 -- 172.21.15.114:0/1693255621 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e080094b0 con 0x7f5e0c0b3d40 2023-10-18T12:35:37.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.272+0000 7f5e118f1700 1 --2- 172.21.15.114:0/1693255621 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5e0c164a20 0x7f5e0c0c43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:35:37.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.272+0000 7f5e108ef700 1 --2- 172.21.15.114:0/1693255621 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e0c0b3d40 0x7f5e0c163ee0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc00c4f0 tx=0x7f5dfc00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:35:37.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.272+0000 7f5e01ffb700 1 -- 172.21.15.114:0/1693255621 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc005d90 con 0x7f5e0c0b3d40 2023-10-18T12:35:37.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.272+0000 7f5e01ffb700 1 -- 172.21.15.114:0/1693255621 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dfc0070d0 con 0x7f5e0c0b3d40 2023-10-18T12:35:37.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.272+0000 7f5e01ffb700 1 -- 172.21.15.114:0/1693255621 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc007480 con 0x7f5e0c0b3d40 2023-10-18T12:35:37.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.272+0000 7f5e120f2700 1 -- 172.21.15.114:0/1693255621 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e0c1626e0 con 0x7f5e0c0b3d40 2023-10-18T12:35:37.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.272+0000 7f5e120f2700 1 -- 172.21.15.114:0/1693255621 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e0c162ca0 con 0x7f5e0c0b3d40 2023-10-18T12:35:37.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.276+0000 7f5e120f2700 1 -- 172.21.15.114:0/1693255621 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e0c072e60 con 0x7f5e0c0b3d40 2023-10-18T12:35:37.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.276+0000 7f5e01ffb700 1 -- 172.21.15.114:0/1693255621 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f5dfc0075e0 con 0x7f5e0c0b3d40 2023-10-18T12:35:37.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.280+0000 7f5e01ffb700 1 --2- 172.21.15.114:0/1693255621 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5df00656f0 0x7f5df0067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:35:37.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.280+0000 7f5e01ffb700 1 -- 172.21.15.114:0/1693255621 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7f5dfc0823b0 con 0x7f5e0c0b3d40 2023-10-18T12:35:37.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.280+0000 7f5e110f0700 1 --2- 172.21.15.114:0/1693255621 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5df00656f0 0x7f5df0067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:35:37.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.280+0000 7f5e110f0700 1 --2- 172.21.15.114:0/1693255621 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5df00656f0 0x7f5df0067bb0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5e08000c00 tx=0x7f5e08008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:35:37.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.288+0000 7f5e01ffb700 1 -- 172.21.15.114:0/1693255621 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f5dfc04fbe0 con 0x7f5e0c0b3d40 2023-10-18T12:35:37.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.296+0000 7ff03a98b700 1 Processor -- start 2023-10-18T12:35:37.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.296+0000 7ff03a98b700 1 -- start start 2023-10-18T12:35:37.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.296+0000 7ff03a98b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff0341610f0 0x7ff0340b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:35:37.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.300+0000 7ff03a98b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0340d24d0 0x7ff03406eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:35:37.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.300+0000 7ff03a98b700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff03406f060 con 0x7ff0340b6560 2023-10-18T12:35:37.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.300+0000 7ff03a98b700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0340cf000 con 0x7ff0341610f0 2023-10-18T12:35:37.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.300+0000 7ff03a98b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0340cf2e0 con 0x7ff0340d24d0 2023-10-18T12:35:37.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.300+0000 7ff039989700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff0341610f0 0x7ff0340b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:35:37.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.300+0000 7ff039989700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff0341610f0 0x7ff0340b5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:56518/0 (socket says 172.21.15.114:56518) 2023-10-18T12:35:37.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.300+0000 7ff039989700 1 -- 172.21.15.114:0/3910888036 learned_addr learned my addr 172.21.15.114:0/3910888036 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:35:37.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.300+0000 7ff03a18a700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7ff0340b6560 0x7ff03406f450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.114:55244/0 (socket says 172.21.15.114:55244) 2023-10-18T12:35:37.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.300+0000 7ff039188700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0340d24d0 0x7ff03406eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:35:37.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.300+0000 7ff039989700 1 -- 172.21.15.114:0/3910888036 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0340d24d0 msgr2=0x7ff03406eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:35:37.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.300+0000 7ff039989700 1 --2- 172.21.15.114:0/3910888036 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0340d24d0 0x7ff03406eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:35:37.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.300+0000 7ff039989700 1 -- 172.21.15.114:0/3910888036 >> v1:172.21.15.172:6789/0 conn(0x7ff0340b6560 legacy=0x7ff03406f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:35:37.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.300+0000 7ff039989700 1 -- 172.21.15.114:0/3910888036 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff03406e320 con 0x7ff0341610f0 2023-10-18T12:35:37.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.300+0000 7ff039989700 1 --2- 172.21.15.114:0/3910888036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0341610f0 0x7ff0340b5ae0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff030009910 tx=0x7ff030009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe40ee4f38bb686b server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:35:37.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.300+0000 7ff038987700 1 -- 172.21.15.114:0/3910888036 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff030011830 con 0x7ff0341610f0 2023-10-18T12:35:37.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.300+0000 7ff038987700 1 -- 172.21.15.114:0/3910888036 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff030011990 con 0x7ff0341610f0 2023-10-18T12:35:37.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.300+0000 7ff038987700 1 -- 172.21.15.114:0/3910888036 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff030011d40 con 0x7ff0341610f0 2023-10-18T12:35:37.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.300+0000 7ff03a98b700 1 -- 172.21.15.114:0/3910888036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0341610f0 msgr2=0x7ff0340b5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:35:37.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.300+0000 7ff03a98b700 1 --2- 172.21.15.114:0/3910888036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0341610f0 0x7ff0340b5ae0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff030009910 tx=0x7ff030009c20 comp rx=0 tx=0).stop 2023-10-18T12:35:37.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.300+0000 7ff03a98b700 1 -- 172.21.15.114:0/3910888036 shutdown_connections 2023-10-18T12:35:37.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.300+0000 7ff03a98b700 1 --2- 172.21.15.114:0/3910888036 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0340d24d0 0x7ff03406eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:35:37.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.300+0000 7ff03a98b700 1 --2- 172.21.15.114:0/3910888036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0341610f0 0x7ff0340b5ae0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:35:37.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.300+0000 7ff03a98b700 1 -- 172.21.15.114:0/3910888036 >> 172.21.15.114:0/3910888036 conn(0x7ff03406a500 msgr2=0x7ff0340b47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:35:37.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.304+0000 7ff03a98b700 1 -- 172.21.15.114:0/3910888036 shutdown_connections 2023-10-18T12:35:37.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.304+0000 7ff03a98b700 1 -- 172.21.15.114:0/3910888036 wait complete. 2023-10-18T12:35:37.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.304+0000 7ff03a98b700 1 Processor -- start 2023-10-18T12:35:37.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.304+0000 7ff03a98b700 1 -- start start 2023-10-18T12:35:37.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.304+0000 7ff03a98b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0340b6560 0x7ff0340b2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:35:37.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.304+0000 7ff03a98b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0340d24d0 0x7ff0341ee570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:35:37.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.304+0000 7ff03a98b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0341610f0 0x7ff0340b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:35:37.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.304+0000 7ff03a98b700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0341f6de0 con 0x7ff0340d24d0 2023-10-18T12:35:37.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.304+0000 7ff03a98b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff034162f80 con 0x7ff0340b6560 2023-10-18T12:35:37.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.304+0000 7ff03a98b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0340b35d0 con 0x7ff0341610f0 2023-10-18T12:35:37.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.304+0000 7ff039188700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0340d24d0 0x7ff0341ee570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:35:37.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.304+0000 7ff039989700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0340b6560 0x7ff0340b2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:35:37.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.308+0000 7ff039188700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0340d24d0 0x7ff0341ee570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:35220/0 (socket says 172.21.15.114:35220) 2023-10-18T12:35:37.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.308+0000 7ff039188700 1 -- 172.21.15.114:0/951800919 learned_addr learned my addr 172.21.15.114:0/951800919 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:35:37.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.308+0000 7ff03a18a700 1 --2- 172.21.15.114:0/951800919 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0341610f0 0x7ff0340b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:35:37.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.308+0000 7ff039989700 1 -- 172.21.15.114:0/951800919 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0341610f0 msgr2=0x7ff0340b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:35:37.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.308+0000 7ff039989700 1 --2- 172.21.15.114:0/951800919 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0341610f0 0x7ff0340b3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:35:37.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.308+0000 7ff039989700 1 -- 172.21.15.114:0/951800919 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0340d24d0 msgr2=0x7ff0341ee570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:35:37.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.308+0000 7ff039989700 1 --2- 172.21.15.114:0/951800919 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0340d24d0 0x7ff0341ee570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:35:37.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.308+0000 7ff039989700 1 -- 172.21.15.114:0/951800919 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff030009570 con 0x7ff0340b6560 2023-10-18T12:35:37.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.308+0000 7ff039989700 1 --2- 172.21.15.114:0/951800919 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0340b6560 0x7ff0340b2ff0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff030016000 tx=0x7ff030004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:35:37.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.308+0000 7ff02a7fc700 1 -- 172.21.15.114:0/951800919 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff030004510 con 0x7ff0340b6560 2023-10-18T12:35:37.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.308+0000 7ff02a7fc700 1 -- 172.21.15.114:0/951800919 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03001e070 con 0x7ff0340b6560 2023-10-18T12:35:37.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.308+0000 7ff02a7fc700 1 -- 172.21.15.114:0/951800919 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff030003900 con 0x7ff0340b6560 2023-10-18T12:35:37.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.308+0000 7ff03a98b700 1 -- 172.21.15.114:0/951800919 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff034162650 con 0x7ff0340b6560 2023-10-18T12:35:37.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.308+0000 7ff03a98b700 1 -- 172.21.15.114:0/951800919 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff034162c10 con 0x7ff0340b6560 2023-10-18T12:35:37.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.308+0000 7ff03a98b700 1 -- 172.21.15.114:0/951800919 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7ff034060ea0 con 0x7ff0340b6560 2023-10-18T12:35:37.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.312+0000 7ff02a7fc700 1 -- 172.21.15.114:0/951800919 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff030003a60 con 0x7ff0340b6560 2023-10-18T12:35:37.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.312+0000 7ff02a7fc700 1 --2- 172.21.15.114:0/951800919 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff0180656f0 0x7ff018067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:35:37.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.312+0000 7ff02a7fc700 1 -- 172.21.15.114:0/951800919 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7ff030084270 con 0x7ff0340b6560 2023-10-18T12:35:37.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.312+0000 7ff02a7fc700 1 -- 172.21.15.114:0/951800919 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+449 (secure 0 0 0) 0x7ff030084600 con 0x7ff0340b6560 2023-10-18T12:35:37.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.312+0000 7ff039188700 1 --2- 172.21.15.114:0/951800919 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff0180656f0 0x7ff018067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:35:37.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.312+0000 7ff03a98b700 1 -- 172.21.15.114:0/951800919 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7ff034072e60 con 0x7ff0340b6560 2023-10-18T12:35:37.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.316+0000 7ff039188700 1 --2- 172.21.15.114:0/951800919 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff0180656f0 0x7ff018067bb0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff0341eeab0 tx=0x7ff024009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:35:37.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.516+0000 7f5e120f2700 1 -- 172.21.15.114:0/1693255621 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5e0c06d7b0 con 0x7f5e0c0b3d40 2023-10-18T12:35:37.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.516+0000 7f5e01ffb700 1 -- 172.21.15.114:0/1693255621 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4889 (secure 0 0 0) 0x7f5e0c06d7b0 con 0x7f5e0c0b3d40 2023-10-18T12:35:37.526 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:35:37.526 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2034957068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2034957068},{"type":"v1","addr":"172.21.15.172:6836","nonce":2034957068}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5039,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4215710360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4215710360},{"type":"v1","addr":"172.21.15.172:6837","nonce":4215710360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2387835210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2387835210},{"type":"v1","addr":"172.21.15.114:6833","nonce":2387835210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T12:21:14.159069+0000","modified":"2023-10-18T12:29:23.762500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":126,"addr":"172.21.15.114:6835/1284474820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1284474820},{"type":"v1","addr":"172.21.15.114:6835","nonce":1284474820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-18T12:35:37.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.520+0000 7f5e120f2700 1 -- 172.21.15.114:0/1693255621 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5df00656f0 msgr2=0x7f5df0067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:35:37.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.520+0000 7f5e120f2700 1 --2- 172.21.15.114:0/1693255621 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5df00656f0 0x7f5df0067bb0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5e08000c00 tx=0x7f5e08008030 comp rx=0 tx=0).stop 2023-10-18T12:35:37.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.520+0000 7f5e120f2700 1 -- 172.21.15.114:0/1693255621 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e0c0b3d40 msgr2=0x7f5e0c163ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:35:37.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.520+0000 7f5e120f2700 1 --2- 172.21.15.114:0/1693255621 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e0c0b3d40 0x7f5e0c163ee0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc00c4f0 tx=0x7f5dfc00c800 comp rx=0 tx=0).stop 2023-10-18T12:35:37.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.520+0000 7f5e120f2700 1 -- 172.21.15.114:0/1693255621 shutdown_connections 2023-10-18T12:35:37.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.520+0000 7f5e120f2700 1 --2- 172.21.15.114:0/1693255621 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5df00656f0 0x7f5df0067bb0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:35:37.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.520+0000 7f5e120f2700 1 --2- 172.21.15.114:0/1693255621 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5e0c164a20 0x7f5e0c0c43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:35:37.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.520+0000 7f5e120f2700 1 --2- 172.21.15.114:0/1693255621 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e0c0b3d40 0x7f5e0c163ee0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:35:37.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.520+0000 7f5e120f2700 1 --2- 172.21.15.114:0/1693255621 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e0c06ce20 0x7f5e0c157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:35:37.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.520+0000 7f5e120f2700 1 -- 172.21.15.114:0/1693255621 >> 172.21.15.114:0/1693255621 conn(0x7f5e0c0ce5c0 msgr2=0x7f5e0c070c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:35:37.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.520+0000 7f5e120f2700 1 -- 172.21.15.114:0/1693255621 shutdown_connections 2023-10-18T12:35:37.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:35:37.520+0000 7f5e120f2700 1 -- 172.21.15.114:0/1693255621 wait complete. 2023-10-18T12:35:37.531 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 20 2023-10-18T12:35:37.548 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-10-18T12:35:37.749 INFO:teuthology.orchestra.run.smithi114.stdout:[{"id":5162,"entity":{"name":{"type":"client","num":5162},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":989916161}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":853.76498331799996,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.13909380346036945,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":3,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5162 v1:192.168.0.1:0/989916161","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi172","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}}] 2023-10-18T12:35:37.750 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "1", "hostname": "smithi172", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 989916161, "type": "v1" }, "name": { "num": 5162, "type": "client" } }, "id": 5162, "inst": "client.5162 v1:192.168.0.1:0/989916161", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 3, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.13909380346036945 }, "state": "open", "uptime": 853.764983318 } ] 2023-10-18T12:35:37.851 DEBUG:tasks.ceph_test_case:No log hits yet, waiting... 2023-10-18T12:36:05.028 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:36:05.037 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:36:12.880 ERROR:tasks.ceph_test_case:Log output: 2023-10-18T12:36:12.881 DEBUG:tasks.cephfs.test_client_recovery:Expected log message found: 'Health check cleared: MDS_CLIENTS_LAGGY', retrying 2023-10-18T12:36:13.882 DEBUG:teuthology.orchestra.run.smithi114:> sudo daemon-helper kill ceph --cluster ceph -w 2023-10-18T12:36:13.890 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T12:36:14.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.060+0000 7f8fbd434700 1 Processor -- start 2023-10-18T12:36:14.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.060+0000 7f8fbd434700 1 -- start start 2023-10-18T12:36:14.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.060+0000 7f8fbd434700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8fb815ce70 0x7f8fb8070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:36:14.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.060+0000 7f8fbd434700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fb815d250 0x7f8fb80ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:36:14.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.060+0000 7f8fbd434700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fb806f450 con 0x7f8fb80cea60 2023-10-18T12:36:14.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.060+0000 7f8fbd434700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb80709a0 con 0x7f8fb815ce70 2023-10-18T12:36:14.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.060+0000 7f8fbd434700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb806f6a0 con 0x7f8fb815d250 2023-10-18T12:36:14.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.060+0000 7f8fb6ffd700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8fb815ce70 0x7f8fb8070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:36:14.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.060+0000 7f8fb6ffd700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8fb815ce70 0x7f8fb8070460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34822/0 (socket says 172.21.15.114:34822) 2023-10-18T12:36:14.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.060+0000 7f8fb6ffd700 1 -- 172.21.15.114:0/90188986 learned_addr learned my addr 172.21.15.114:0/90188986 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:36:14.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.060+0000 7f8fb67fc700 1 --2- 172.21.15.114:0/90188986 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fb815d250 0x7f8fb80ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:36:14.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.060+0000 7f8fb6ffd700 1 -- 172.21.15.114:0/90188986 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fb815d250 msgr2=0x7f8fb80ce520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:36:14.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.060+0000 7f8fb6ffd700 1 --2- 172.21.15.114:0/90188986 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fb815d250 0x7f8fb80ce520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:36:14.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.064+0000 7f8fb6ffd700 1 -- 172.21.15.114:0/90188986 >> v1:172.21.15.172:6789/0 conn(0x7f8fb80cea60 legacy=0x7f8fb8158af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:36:14.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.064+0000 7f8fb6ffd700 1 -- 172.21.15.114:0/90188986 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb806f980 con 0x7f8fb815ce70 2023-10-18T12:36:14.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.064+0000 7f8fb6ffd700 1 --2- 172.21.15.114:0/90188986 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fb815ce70 0x7f8fb8070460 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8009910 tx=0x7f8fa8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2651b529e3534519 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:36:14.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.064+0000 7f8fb5ffb700 1 -- 172.21.15.114:0/90188986 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa800ba60 con 0x7f8fb815ce70 2023-10-18T12:36:14.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.064+0000 7f8fb5ffb700 1 -- 172.21.15.114:0/90188986 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa800bbc0 con 0x7f8fb815ce70 2023-10-18T12:36:14.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.064+0000 7f8fb5ffb700 1 -- 172.21.15.114:0/90188986 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa8009e60 con 0x7f8fb815ce70 2023-10-18T12:36:14.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.064+0000 7f8fbd434700 1 -- 172.21.15.114:0/90188986 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fb815ce70 msgr2=0x7f8fb8070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:36:14.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.064+0000 7f8fbd434700 1 --2- 172.21.15.114:0/90188986 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fb815ce70 0x7f8fb8070460 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8009910 tx=0x7f8fa8009c20 comp rx=0 tx=0).stop 2023-10-18T12:36:14.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.064+0000 7f8fbd434700 1 -- 172.21.15.114:0/90188986 shutdown_connections 2023-10-18T12:36:14.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.064+0000 7f8fbd434700 1 --2- 172.21.15.114:0/90188986 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fb815d250 0x7f8fb80ce520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:36:14.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.064+0000 7f8fbd434700 1 --2- 172.21.15.114:0/90188986 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fb815ce70 0x7f8fb8070460 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:36:14.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.064+0000 7f8fbd434700 1 -- 172.21.15.114:0/90188986 >> 172.21.15.114:0/90188986 conn(0x7f8fb80b1a50 msgr2=0x7f8fb80b1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:36:14.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.064+0000 7f8fbd434700 1 -- 172.21.15.114:0/90188986 shutdown_connections 2023-10-18T12:36:14.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.064+0000 7f8fbd434700 1 -- 172.21.15.114:0/90188986 wait complete. 2023-10-18T12:36:14.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.068+0000 7f8fbd434700 1 Processor -- start 2023-10-18T12:36:14.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.068+0000 7f8fbd434700 1 -- start start 2023-10-18T12:36:14.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.068+0000 7f8fbd434700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fb80cea60 0x7f8fb80c7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:36:14.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.068+0000 7f8fbd434700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fb815ce70 0x7f8fb81f1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:36:14.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.072+0000 7f8fbd434700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fb815d250 0x7f8fb815af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:36:14.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.072+0000 7f8fbd434700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb8153020 con 0x7f8fb815d250 2023-10-18T12:36:14.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.072+0000 7f8fbd434700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb8153300 con 0x7f8fb80cea60 2023-10-18T12:36:14.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.072+0000 7f8fbd434700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb81535e0 con 0x7f8fb815ce70 2023-10-18T12:36:14.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.072+0000 7f8fb67fc700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fb815ce70 0x7f8fb81f1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:36:14.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.072+0000 7f8fb6ffd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fb80cea60 0x7f8fb80c7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:36:14.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.072+0000 7f8fb6ffd700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fb80cea60 0x7f8fb80c7010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:45408/0 (socket says 172.21.15.114:45408) 2023-10-18T12:36:14.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.072+0000 7f8fb6ffd700 1 -- 172.21.15.114:0/52667998 learned_addr learned my addr 172.21.15.114:0/52667998 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:36:14.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.072+0000 7f8fb7fff700 1 --2- 172.21.15.114:0/52667998 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fb815d250 0x7f8fb815af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:36:14.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.072+0000 7f8fb6ffd700 1 -- 172.21.15.114:0/52667998 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fb815ce70 msgr2=0x7f8fb81f1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:36:14.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.072+0000 7f8fb6ffd700 1 --2- 172.21.15.114:0/52667998 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fb815ce70 0x7f8fb81f1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:36:14.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.072+0000 7f8fb6ffd700 1 -- 172.21.15.114:0/52667998 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fb815d250 msgr2=0x7f8fb815af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:36:14.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.072+0000 7f8fb6ffd700 1 --2- 172.21.15.114:0/52667998 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fb815d250 0x7f8fb815af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:36:14.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.072+0000 7f8fb6ffd700 1 -- 172.21.15.114:0/52667998 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa8009570 con 0x7f8fb80cea60 2023-10-18T12:36:14.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.072+0000 7f8fb7fff700 1 --2- 172.21.15.114:0/52667998 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fb815d250 0x7f8fb815af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:36:14.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.072+0000 7f8fb6ffd700 1 --2- 172.21.15.114:0/52667998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fb80cea60 0x7f8fb80c7010 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8fb80671a0 tx=0x7f8fa8004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:36:14.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.072+0000 7f8f9f7fe700 1 -- 172.21.15.114:0/52667998 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa8004510 con 0x7f8fb80cea60 2023-10-18T12:36:14.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.072+0000 7f8fbd434700 1 -- 172.21.15.114:0/52667998 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fb81538c0 con 0x7f8fb80cea60 2023-10-18T12:36:14.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.072+0000 7f8f9f7fe700 1 -- 172.21.15.114:0/52667998 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa801f070 con 0x7f8fb80cea60 2023-10-18T12:36:14.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.072+0000 7f8f9f7fe700 1 -- 172.21.15.114:0/52667998 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa8003900 con 0x7f8fb80cea60 2023-10-18T12:36:14.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.072+0000 7f8fbd434700 1 -- 172.21.15.114:0/52667998 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb81f24f0 con 0x7f8fb80cea60 2023-10-18T12:36:14.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.076+0000 7f8fbd434700 1 -- 172.21.15.114:0/52667998 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fb8072e60 con 0x7f8fb80cea60 2023-10-18T12:36:14.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.076+0000 7f8f9f7fe700 1 -- 172.21.15.114:0/52667998 <== mon.1 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f8fa8003a60 con 0x7f8fb80cea60 2023-10-18T12:36:14.087 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.080+0000 7f8f9f7fe700 1 --2- 172.21.15.114:0/52667998 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8fa40656f0 0x7f8fa4067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:36:14.087 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.080+0000 7f8f9f7fe700 1 -- 172.21.15.114:0/52667998 <== mon.1 v2:172.21.15.172:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7f8fa8021070 con 0x7f8fb80cea60 2023-10-18T12:36:14.087 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.080+0000 7f8fb67fc700 1 --2- 172.21.15.114:0/52667998 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8fa40656f0 0x7f8fa4067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:36:14.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.080+0000 7f8fb67fc700 1 --2- 172.21.15.114:0/52667998 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8fa40656f0 0x7f8fa4067bb0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8151090 tx=0x7f8fac008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:36:14.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.084+0000 7fc30759e700 1 Processor -- start 2023-10-18T12:36:14.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.088+0000 7fc30759e700 1 -- start start 2023-10-18T12:36:14.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.088+0000 7f8f9f7fe700 1 -- 172.21.15.114:0/52667998 <== mon.1 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f8fa8052040 con 0x7f8fb80cea60 2023-10-18T12:36:14.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.088+0000 7fc30759e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc3080719e0 0x7fc30806cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:36:14.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.088+0000 7fc30759e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc30806f9b0 con 0x7fc30815cf50 2023-10-18T12:36:14.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.088+0000 7fc30759e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc30815d330 con 0x7fc3080c9190 2023-10-18T12:36:14.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.088+0000 7fc30759e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc30806f680 con 0x7fc3080719e0 2023-10-18T12:36:14.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.088+0000 7fc30659c700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc30815cf50 0x7fc3080712d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51714/0 (socket says 172.21.15.114:51714) 2023-10-18T12:36:14.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.088+0000 7fc30659c700 1 -- 172.21.15.114:0/3879367489 learned_addr learned my addr 172.21.15.114:0/3879367489 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:36:14.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.088+0000 7fc305d9b700 1 --2- 172.21.15.114:0/3879367489 >> v2:172.21.15.172:3300/0 conn(0x7fc3080719e0 0x7fc30806cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:36:14.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.088+0000 7fc30559a700 1 -- 172.21.15.114:0/3879367489 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 266421014 0 0) 0x7fc30806f9b0 con 0x7fc30815cf50 2023-10-18T12:36:14.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.088+0000 7fc30559a700 1 -- 172.21.15.114:0/3879367489 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2f00035d0 con 0x7fc30815cf50 2023-10-18T12:36:14.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.088+0000 7fc30559a700 1 -- 172.21.15.114:0/3879367489 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2188950690 0 0) 0x7fc2f00035d0 con 0x7fc30815cf50 2023-10-18T12:36:14.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.088+0000 7fc30559a700 1 -- 172.21.15.114:0/3879367489 >> v2:172.21.15.172:3300/0 conn(0x7fc3080719e0 msgr2=0x7fc30806cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:36:14.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.088+0000 7fc30559a700 1 --2- 172.21.15.114:0/3879367489 >> v2:172.21.15.172:3300/0 conn(0x7fc3080719e0 0x7fc30806cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:36:14.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.088+0000 7fc30559a700 1 -- 172.21.15.114:0/3879367489 >> v1:172.21.15.172:6789/0 conn(0x7fc3080c9190 legacy=0x7fc30806fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:36:14.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.088+0000 7fc30559a700 1 -- 172.21.15.114:0/3879367489 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc30806d560 con 0x7fc30815cf50 2023-10-18T12:36:14.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.088+0000 7fc30559a700 1 -- 172.21.15.114:0/3879367489 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3368469509 0 0) 0x7fc2f8001670 con 0x7fc30815cf50 2023-10-18T12:36:14.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.088+0000 7fc30559a700 1 -- 172.21.15.114:0/3879367489 >> v1:172.21.15.114:6789/0 conn(0x7fc30815cf50 legacy=0x7fc3080712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:36:14.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.088+0000 7fc30559a700 1 --2- 172.21.15.114:0/3879367489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2f0003a20 0x7fc2f0003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:36:14.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.088+0000 7fc30559a700 1 --2- 172.21.15.114:0/3879367489 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc2f0004870 0x7fc2f0004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:36:14.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.088+0000 7fc30559a700 1 --2- 172.21.15.114:0/3879367489 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2f0005230 0x7fc2f000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:36:14.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.088+0000 7fc30559a700 1 -- 172.21.15.114:0/3879367489 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc30806f680 con 0x7fc2f0005230 2023-10-18T12:36:14.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.088+0000 7fc30559a700 1 -- 172.21.15.114:0/3879367489 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f000c0d0 con 0x7fc2f0003a20 2023-10-18T12:36:14.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.088+0000 7fc30559a700 1 -- 172.21.15.114:0/3879367489 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f000c290 con 0x7fc2f0004870 2023-10-18T12:36:14.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.088+0000 7fc30659c700 1 --2- 172.21.15.114:0/3879367489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2f0003a20 0x7fc2f0003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:36:14.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.088+0000 7fc306d9d700 1 --2- 172.21.15.114:0/3879367489 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2f0005230 0x7fc2f000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:36:14.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.092+0000 7fc305d9b700 1 --2- 172.21.15.114:0/3879367489 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc2f0004870 0x7fc2f0004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:36:14.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.092+0000 7fc30659c700 1 -- 172.21.15.114:0/3879367489 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc2f0004870 msgr2=0x7fc2f0004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:36:14.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.092+0000 7fc30659c700 1 --2- 172.21.15.114:0/3879367489 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc2f0004870 0x7fc2f0004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:36:14.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.092+0000 7fc30659c700 1 -- 172.21.15.114:0/3879367489 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2f0005230 msgr2=0x7fc2f000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:36:14.102 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.092+0000 7fc30659c700 1 --2- 172.21.15.114:0/3879367489 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2f0005230 0x7fc2f000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:36:14.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.092+0000 7fc30659c700 1 -- 172.21.15.114:0/3879367489 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f00035d0 con 0x7fc2f0003a20 2023-10-18T12:36:14.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.092+0000 7fc306d9d700 1 --2- 172.21.15.114:0/3879367489 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2f0005230 0x7fc2f000ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:36:14.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.092+0000 7fc306d9d700 1 -- 172.21.15.114:0/3879367489 reap_dead start 2023-10-18T12:36:14.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.092+0000 7fc30659c700 1 --2- 172.21.15.114:0/3879367489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2f0003a20 0x7fc2f0003e40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc2f800c320 tx=0x7fc2f00058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b71d0c7ccbe269f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:36:14.103 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.092+0000 7fc30559a700 1 -- 172.21.15.114:0/3879367489 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f8007c30 con 0x7fc2f0003a20 2023-10-18T12:36:14.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.092+0000 7fc30559a700 1 -- 172.21.15.114:0/3879367489 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f800ce80 con 0x7fc2f0003a20 2023-10-18T12:36:14.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.092+0000 7fc30559a700 1 -- 172.21.15.114:0/3879367489 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f8005bc0 con 0x7fc2f0003a20 2023-10-18T12:36:14.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.092+0000 7fc30759e700 1 -- 172.21.15.114:0/3879367489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2f0003a20 msgr2=0x7fc2f0003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:36:14.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.092+0000 7fc30759e700 1 --2- 172.21.15.114:0/3879367489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2f0003a20 0x7fc2f0003e40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc2f800c320 tx=0x7fc2f00058a0 comp rx=0 tx=0).stop 2023-10-18T12:36:14.104 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.092+0000 7fc30759e700 1 -- 172.21.15.114:0/3879367489 shutdown_connections 2023-10-18T12:36:14.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.092+0000 7fc30759e700 1 --2- 172.21.15.114:0/3879367489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2f0003a20 0x7fc2f0003e40 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:36:14.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.092+0000 7fc30759e700 1 -- 172.21.15.114:0/3879367489 >> 172.21.15.114:0/3879367489 conn(0x7fc3080b02a0 msgr2=0x7fc3080b06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:36:14.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.092+0000 7fc30759e700 1 -- 172.21.15.114:0/3879367489 shutdown_connections 2023-10-18T12:36:14.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.092+0000 7fc30759e700 1 -- 172.21.15.114:0/3879367489 wait complete. 2023-10-18T12:36:14.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.096+0000 7fc30759e700 1 Processor -- start 2023-10-18T12:36:14.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.096+0000 7fc30759e700 1 -- start start 2023-10-18T12:36:14.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.096+0000 7fc30759e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc2f0003a20 0x7fc3081f2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:36:14.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.096+0000 7fc30759e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3080acdc0 0x7fc308070000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:36:14.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.096+0000 7fc30759e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc308070540 0x7fc30815f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:36:14.108 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.096+0000 7fc30759e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3080c4be0 con 0x7fc308070540 2023-10-18T12:36:14.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.096+0000 7fc30759e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3080709c0 con 0x7fc3080acdc0 2023-10-18T12:36:14.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.096+0000 7fc30759e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3081f5ea0 con 0x7fc2f0003a20 2023-10-18T12:36:14.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.096+0000 7fc306d9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc308070540 0x7fc30815f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:36:14.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.100+0000 7fc306d9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc308070540 0x7fc30815f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34848/0 (socket says 172.21.15.114:34848) 2023-10-18T12:36:14.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.100+0000 7fc306d9d700 1 -- 172.21.15.114:0/2468628583 learned_addr learned my addr 172.21.15.114:0/2468628583 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:36:14.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.100+0000 7fc305d9b700 1 --2- 172.21.15.114:0/2468628583 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3080acdc0 0x7fc308070000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:36:14.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.100+0000 7fc30659c700 1 --2- 172.21.15.114:0/2468628583 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc2f0003a20 0x7fc3081f2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:36:14.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.100+0000 7fc306d9d700 1 -- 172.21.15.114:0/2468628583 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc2f0003a20 msgr2=0x7fc3081f2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:36:14.110 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.100+0000 7fc306d9d700 1 --2- 172.21.15.114:0/2468628583 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc2f0003a20 0x7fc3081f2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:36:14.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.100+0000 7fc306d9d700 1 -- 172.21.15.114:0/2468628583 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3080acdc0 msgr2=0x7fc308070000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:36:14.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.100+0000 7fc306d9d700 1 --2- 172.21.15.114:0/2468628583 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3080acdc0 0x7fc308070000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:36:14.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.100+0000 7fc306d9d700 1 -- 172.21.15.114:0/2468628583 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3081f6180 con 0x7fc308070540 2023-10-18T12:36:14.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.100+0000 7fc30659c700 1 --2- 172.21.15.114:0/2468628583 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc2f0003a20 0x7fc3081f2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:36:14.111 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.100+0000 7fc306d9d700 1 --2- 172.21.15.114:0/2468628583 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc308070540 0x7fc30815f3d0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fc3080c5830 tx=0x7fc30000d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:36:14.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.100+0000 7fc2f6ffd700 1 -- 172.21.15.114:0/2468628583 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3000020b0 con 0x7fc308070540 2023-10-18T12:36:14.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.100+0000 7fc2f6ffd700 1 -- 172.21.15.114:0/2468628583 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc300003c30 con 0x7fc308070540 2023-10-18T12:36:14.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.100+0000 7fc30759e700 1 -- 172.21.15.114:0/2468628583 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3081f6460 con 0x7fc308070540 2023-10-18T12:36:14.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.100+0000 7fc2f6ffd700 1 -- 172.21.15.114:0/2468628583 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30000d990 con 0x7fc308070540 2023-10-18T12:36:14.112 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.100+0000 7fc30759e700 1 -- 172.21.15.114:0/2468628583 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3081f6a20 con 0x7fc308070540 2023-10-18T12:36:14.113 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.100+0000 7fc30759e700 1 -- 172.21.15.114:0/2468628583 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fc3081f6be0 con 0x7fc308070540 2023-10-18T12:36:14.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.104+0000 7fc2f6ffd700 1 -- 172.21.15.114:0/2468628583 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fc30000daf0 con 0x7fc308070540 2023-10-18T12:36:14.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.104+0000 7fc2f6ffd700 1 --2- 172.21.15.114:0/2468628583 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc2e80656f0 0x7fc2e8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:36:14.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.104+0000 7fc2f6ffd700 1 -- 172.21.15.114:0/2468628583 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7fc3000831e0 con 0x7fc308070540 2023-10-18T12:36:14.114 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.104+0000 7fc2f6ffd700 1 -- 172.21.15.114:0/2468628583 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+449 (secure 0 0 0) 0x7fc30008a070 con 0x7fc308070540 2023-10-18T12:36:14.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.104+0000 7fc30659c700 1 --2- 172.21.15.114:0/2468628583 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc2e80656f0 0x7fc2e8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:36:14.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.104+0000 7fc30759e700 1 -- 172.21.15.114:0/2468628583 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7fc308072e60 con 0x7fc308070540 2023-10-18T12:36:14.115 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.104+0000 7fc30659c700 1 --2- 172.21.15.114:0/2468628583 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc2e80656f0 0x7fc2e8067bb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8015040 tx=0x7fc2f8007000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:36:14.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.316+0000 7f8fbd434700 1 -- 172.21.15.114:0/52667998 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8fb8153440 con 0x7f8fb80cea60 2023-10-18T12:36:14.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.320+0000 7f8f9f7fe700 1 -- 172.21.15.114:0/52667998 <== mon.1 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4889 (secure 0 0 0) 0x7f8fb8153440 con 0x7f8fb80cea60 2023-10-18T12:36:14.326 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:36:14.326 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2034957068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2034957068},{"type":"v1","addr":"172.21.15.172:6836","nonce":2034957068}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5039,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4215710360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4215710360},{"type":"v1","addr":"172.21.15.172:6837","nonce":4215710360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2387835210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2387835210},{"type":"v1","addr":"172.21.15.114:6833","nonce":2387835210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T12:21:14.159069+0000","modified":"2023-10-18T12:29:23.762500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":126,"addr":"172.21.15.114:6835/1284474820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1284474820},{"type":"v1","addr":"172.21.15.114:6835","nonce":1284474820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-18T12:36:14.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.320+0000 7f8fbd434700 1 -- 172.21.15.114:0/52667998 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8fa40656f0 msgr2=0x7f8fa4067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:36:14.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.320+0000 7f8fbd434700 1 --2- 172.21.15.114:0/52667998 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8fa40656f0 0x7f8fa4067bb0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8151090 tx=0x7f8fac008040 comp rx=0 tx=0).stop 2023-10-18T12:36:14.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.320+0000 7f8fbd434700 1 -- 172.21.15.114:0/52667998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fb80cea60 msgr2=0x7f8fb80c7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:36:14.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.320+0000 7f8fbd434700 1 --2- 172.21.15.114:0/52667998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fb80cea60 0x7f8fb80c7010 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8fb80671a0 tx=0x7f8fa8004770 comp rx=0 tx=0).stop 2023-10-18T12:36:14.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.320+0000 7f8fbd434700 1 -- 172.21.15.114:0/52667998 shutdown_connections 2023-10-18T12:36:14.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.320+0000 7f8fbd434700 1 --2- 172.21.15.114:0/52667998 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8fa40656f0 0x7f8fa4067bb0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:36:14.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.320+0000 7f8fbd434700 1 --2- 172.21.15.114:0/52667998 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8fb815ce70 0x7f8fb81f1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:36:14.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.320+0000 7f8fbd434700 1 --2- 172.21.15.114:0/52667998 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8fb815d250 0x7f8fb815af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:36:14.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.320+0000 7f8fbd434700 1 --2- 172.21.15.114:0/52667998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8fb80cea60 0x7f8fb80c7010 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:36:14.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.320+0000 7f8fbd434700 1 -- 172.21.15.114:0/52667998 >> 172.21.15.114:0/52667998 conn(0x7f8fb80b1a50 msgr2=0x7f8fb80caa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:36:14.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.324+0000 7f8fbd434700 1 -- 172.21.15.114:0/52667998 shutdown_connections 2023-10-18T12:36:14.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:14.324+0000 7f8fbd434700 1 -- 172.21.15.114:0/52667998 wait complete. 2023-10-18T12:36:14.331 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 20 2023-10-18T12:36:14.350 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-10-18T12:36:14.556 INFO:teuthology.orchestra.run.smithi114.stdout:[{"id":5162,"entity":{"name":{"type":"client","num":5162},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":989916161}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":890.56822738400001,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.12775508096730628,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":3,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5162 v1:192.168.0.1:0/989916161","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi172","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}}] 2023-10-18T12:36:14.557 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "1", "hostname": "smithi172", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 989916161, "type": "v1" }, "name": { "num": 5162, "type": "client" } }, "id": 5162, "inst": "client.5162 v1:192.168.0.1:0/989916161", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 3, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.12775508096730628 }, "state": "open", "uptime": 890.568227384 } ] 2023-10-18T12:36:14.658 DEBUG:tasks.ceph_test_case:No log hits yet, waiting... 2023-10-18T12:36:35.107 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:36:35.115 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:36:49.682 ERROR:tasks.ceph_test_case:Log output: 2023-10-18T12:36:49.683 DEBUG:tasks.cephfs.test_client_recovery:Expected log message found: 'Health check cleared: MDS_CLIENTS_LAGGY', retrying 2023-10-18T12:36:50.685 DEBUG:teuthology.orchestra.run.smithi114:> sudo daemon-helper kill ceph --cluster ceph -w 2023-10-18T12:36:50.693 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T12:36:50.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.855+0000 7fa5e2e40700 1 Processor -- start 2023-10-18T12:36:50.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.859+0000 7fa5e2e40700 1 -- start start 2023-10-18T12:36:50.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.859+0000 7fa5e2e40700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa5dc159a60 0x7fa5dc0ce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:36:50.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.859+0000 7fa5e2e40700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa5dc06e6d0 0x7fa5dc0cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:36:50.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.859+0000 7fa5e2e40700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5dc15d630 con 0x7fa5dc0ced40 2023-10-18T12:36:50.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.859+0000 7fa5e2e40700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5dc0cf5a0 con 0x7fa5dc06e6d0 2023-10-18T12:36:50.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.859+0000 7fa5e2e40700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc15ded0 con 0x7fa5dc159a60 2023-10-18T12:36:50.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.859+0000 7fa5e1e3e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa5dc159a60 0x7fa5dc0ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:36:50.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.859+0000 7fa5e263f700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa5dc06e6d0 0x7fa5dc0cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:36:50.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.859+0000 7fa5e163d700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7fa5dc0ced40 0x7fa5dc06dfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.114:60092/0 (socket says 172.21.15.114:60092) 2023-10-18T12:36:50.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.859+0000 7fa5e1e3e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa5dc159a60 0x7fa5dc0ce800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.114:49712/0 (socket says 172.21.15.114:49712) 2023-10-18T12:36:50.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.859+0000 7fa5e163d700 1 -- 172.21.15.114:0/438274280 learned_addr learned my addr 172.21.15.114:0/438274280 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:36:50.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.863+0000 7fa5e1e3e700 1 -- 172.21.15.114:0/438274280 >> v2:172.21.15.114:3300/0 conn(0x7fa5dc06e6d0 msgr2=0x7fa5dc0cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:36:50.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.863+0000 7fa5e1e3e700 1 --2- 172.21.15.114:0/438274280 >> v2:172.21.15.114:3300/0 conn(0x7fa5dc06e6d0 0x7fa5dc0cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:36:50.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.863+0000 7fa5e1e3e700 1 -- 172.21.15.114:0/438274280 >> v1:172.21.15.172:6789/0 conn(0x7fa5dc0ced40 legacy=0x7fa5dc06dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:36:50.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.863+0000 7fa5e1e3e700 1 -- 172.21.15.114:0/438274280 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5dc0cf2c0 con 0x7fa5dc159a60 2023-10-18T12:36:50.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.863+0000 7fa5e263f700 1 --2- 172.21.15.114:0/438274280 >> v2:172.21.15.114:3300/0 conn(0x7fa5dc06e6d0 0x7fa5dc0cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:36:50.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.863+0000 7fa5e1e3e700 1 --2- 172.21.15.114:0/438274280 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa5dc159a60 0x7fa5dc0ce800 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa5d8009850 tx=0x7fa5d8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5e0d3e87f6ff20c server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:36:50.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.863+0000 7fa5e0e3c700 1 -- 172.21.15.114:0/438274280 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d800f8a0 con 0x7fa5dc159a60 2023-10-18T12:36:50.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.863+0000 7fa5e0e3c700 1 -- 172.21.15.114:0/438274280 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d800fa00 con 0x7fa5dc159a60 2023-10-18T12:36:50.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.863+0000 7fa5e0e3c700 1 -- 172.21.15.114:0/438274280 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d800fdb0 con 0x7fa5dc159a60 2023-10-18T12:36:50.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.863+0000 7fa5e2e40700 1 -- 172.21.15.114:0/438274280 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa5dc159a60 msgr2=0x7fa5dc0ce800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:36:50.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.863+0000 7fa5e2e40700 1 --2- 172.21.15.114:0/438274280 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa5dc159a60 0x7fa5dc0ce800 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa5d8009850 tx=0x7fa5d8009b60 comp rx=0 tx=0).stop 2023-10-18T12:36:50.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.863+0000 7fa5e2e40700 1 -- 172.21.15.114:0/438274280 shutdown_connections 2023-10-18T12:36:50.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.863+0000 7fa5e2e40700 1 --2- 172.21.15.114:0/438274280 >> v2:172.21.15.114:3300/0 conn(0x7fa5dc06e6d0 0x7fa5dc0cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:36:50.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.863+0000 7fa5e2e40700 1 --2- 172.21.15.114:0/438274280 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa5dc159a60 0x7fa5dc0ce800 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:36:50.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.863+0000 7fa5e2e40700 1 -- 172.21.15.114:0/438274280 >> 172.21.15.114:0/438274280 conn(0x7fa5dc0cc1d0 msgr2=0x7fa5dc0cc5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:36:50.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.863+0000 7fa5e2e40700 1 -- 172.21.15.114:0/438274280 shutdown_connections 2023-10-18T12:36:50.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.863+0000 7fa5e2e40700 1 -- 172.21.15.114:0/438274280 wait complete. 2023-10-18T12:36:50.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.867+0000 7fa5e2e40700 1 Processor -- start 2023-10-18T12:36:50.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.867+0000 7fa5e2e40700 1 -- start start 2023-10-18T12:36:50.877 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.867+0000 7fa5e2e40700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa5dc06e6d0 0x7fa5dc0c5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:36:50.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.867+0000 7fa5e2e40700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5dc0ced40 0x7fa5dc1540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:36:50.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.867+0000 7fa5e2e40700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5dc159a60 0x7fa5dc154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:36:50.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.867+0000 7fa5e2e40700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc0c4560 con 0x7fa5dc159a60 2023-10-18T12:36:50.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.867+0000 7fa5e2e40700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc0c6110 con 0x7fa5dc0ced40 2023-10-18T12:36:50.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.867+0000 7fa5e2e40700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc0c6d30 con 0x7fa5dc06e6d0 2023-10-18T12:36:50.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.867+0000 7fa5e263f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5dc159a60 0x7fa5dc154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:36:50.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.867+0000 7fa5e263f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5dc159a60 0x7fa5dc154620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56654/0 (socket says 172.21.15.114:56654) 2023-10-18T12:36:50.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.867+0000 7fa5e263f700 1 -- 172.21.15.114:0/3707259046 learned_addr learned my addr 172.21.15.114:0/3707259046 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:36:50.879 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.871+0000 7fa5e1e3e700 1 --2- 172.21.15.114:0/3707259046 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa5dc06e6d0 0x7fa5dc0c5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:36:50.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.871+0000 7fa5e163d700 1 --2- 172.21.15.114:0/3707259046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5dc0ced40 0x7fa5dc1540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:36:50.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.871+0000 7fa5e263f700 1 -- 172.21.15.114:0/3707259046 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa5dc06e6d0 msgr2=0x7fa5dc0c5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:36:50.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.871+0000 7fa5e263f700 1 --2- 172.21.15.114:0/3707259046 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa5dc06e6d0 0x7fa5dc0c5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:36:50.880 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.871+0000 7fa5e263f700 1 -- 172.21.15.114:0/3707259046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5dc0ced40 msgr2=0x7fa5dc1540e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:36:50.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.871+0000 7fa5e263f700 1 --2- 172.21.15.114:0/3707259046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5dc0ced40 0x7fa5dc1540e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:36:50.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.871+0000 7fa5e263f700 1 -- 172.21.15.114:0/3707259046 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d4009a70 con 0x7fa5dc159a60 2023-10-18T12:36:50.881 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.871+0000 7fa5e263f700 1 --2- 172.21.15.114:0/3707259046 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5dc159a60 0x7fa5dc154620 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4009f00 tx=0x7fa5d400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:36:50.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.871+0000 7fa5d27fc700 1 -- 172.21.15.114:0/3707259046 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d4009d70 con 0x7fa5dc159a60 2023-10-18T12:36:50.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.871+0000 7fa5d27fc700 1 -- 172.21.15.114:0/3707259046 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d400f040 con 0x7fa5dc159a60 2023-10-18T12:36:50.882 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.871+0000 7fa5d27fc700 1 -- 172.21.15.114:0/3707259046 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d400cdc0 con 0x7fa5dc159a60 2023-10-18T12:36:50.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.871+0000 7fa5e2e40700 1 -- 172.21.15.114:0/3707259046 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5d80094b0 con 0x7fa5dc159a60 2023-10-18T12:36:50.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.871+0000 7fa5e2e40700 1 -- 172.21.15.114:0/3707259046 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5dc0c5e30 con 0x7fa5dc159a60 2023-10-18T12:36:50.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.871+0000 7fa5e2e40700 1 -- 172.21.15.114:0/3707259046 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5dc15db40 con 0x7fa5dc159a60 2023-10-18T12:36:50.883 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.875+0000 7fa5d27fc700 1 -- 172.21.15.114:0/3707259046 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fa5d4014480 con 0x7fa5dc159a60 2023-10-18T12:36:50.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.875+0000 7fa5d27fc700 1 --2- 172.21.15.114:0/3707259046 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa5c0065720 0x7fa5c0067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:36:50.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.875+0000 7fa5d27fc700 1 -- 172.21.15.114:0/3707259046 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7fa5d40836b0 con 0x7fa5dc159a60 2023-10-18T12:36:50.884 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.875+0000 7fa5e1e3e700 1 --2- 172.21.15.114:0/3707259046 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa5c0065720 0x7fa5c0067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:36:50.885 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.879+0000 7fa5e1e3e700 1 --2- 172.21.15.114:0/3707259046 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa5c0065720 0x7fa5c0067be0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa5d80090b0 tx=0x7fa5d8008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:36:50.890 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.883+0000 7fa5d27fc700 1 -- 172.21.15.114:0/3707259046 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fa5dc15db40 con 0x7fa5dc159a60 2023-10-18T12:36:50.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.883+0000 7fbcb146b700 1 Processor -- start 2023-10-18T12:36:50.892 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.883+0000 7fbcb146b700 1 -- start start 2023-10-18T12:36:50.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.887+0000 7fbcb146b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbcac1572f0 0x7fbcac160830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:36:50.895 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.887+0000 7fbcb146b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fbcac0d2f60 0x7fbcac0d33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:36:50.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.887+0000 7fbcb146b700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcac0b61f0 con 0x7fbcac0cf320 2023-10-18T12:36:50.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.887+0000 7fbcb146b700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcac0d3930 con 0x7fbcac0d2f60 2023-10-18T12:36:50.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.887+0000 7fbcb146b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac1576d0 con 0x7fbcac1572f0 2023-10-18T12:36:50.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.887+0000 7fbcab7fe700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fbcac0cf320 0x7fbcac0b5ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60382/0 (socket says 172.21.15.114:60382) 2023-10-18T12:36:50.896 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.887+0000 7fbcab7fe700 1 -- 172.21.15.114:0/803216336 learned_addr learned my addr 172.21.15.114:0/803216336 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:36:50.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.887+0000 7fbcabfff700 1 --2- 172.21.15.114:0/803216336 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbcac1572f0 0x7fbcac160830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:36:50.898 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.887+0000 7fbcb0c6a700 1 --2- 172.21.15.114:0/803216336 >> v2:172.21.15.172:3300/0 conn(0x7fbcac0d2f60 0x7fbcac0d33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:36:50.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.887+0000 7fbcaaffd700 1 -- 172.21.15.114:0/803216336 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1106082157 0 0) 0x7fbcac0b61f0 con 0x7fbcac0cf320 2023-10-18T12:36:50.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.887+0000 7fbcaaffd700 1 -- 172.21.15.114:0/803216336 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc940035d0 con 0x7fbcac0cf320 2023-10-18T12:36:50.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.887+0000 7fbcabfff700 1 -- 172.21.15.114:0/803216336 >> v2:172.21.15.172:3300/0 conn(0x7fbcac0d2f60 msgr2=0x7fbcac0d33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:36:50.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.887+0000 7fbcabfff700 1 --2- 172.21.15.114:0/803216336 >> v2:172.21.15.172:3300/0 conn(0x7fbcac0d2f60 0x7fbcac0d33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:36:50.899 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.887+0000 7fbcabfff700 1 -- 172.21.15.114:0/803216336 >> v1:172.21.15.114:6789/0 conn(0x7fbcac0cf320 legacy=0x7fbcac0b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:36:50.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.887+0000 7fbcabfff700 1 -- 172.21.15.114:0/803216336 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcac06dd60 con 0x7fbcac1572f0 2023-10-18T12:36:50.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.891+0000 7fbcabfff700 1 --2- 172.21.15.114:0/803216336 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbcac1572f0 0x7fbcac160830 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c009850 tx=0x7fbc9c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9952af23a1bf146 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:36:50.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.891+0000 7fbcaaffd700 1 -- 172.21.15.114:0/803216336 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c011830 con 0x7fbcac1572f0 2023-10-18T12:36:50.900 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.891+0000 7fbcaaffd700 1 -- 172.21.15.114:0/803216336 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc9c011990 con 0x7fbcac1572f0 2023-10-18T12:36:50.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.891+0000 7fbcaaffd700 1 -- 172.21.15.114:0/803216336 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c011d40 con 0x7fbcac1572f0 2023-10-18T12:36:50.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.891+0000 7fbcb146b700 1 -- 172.21.15.114:0/803216336 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbcac1572f0 msgr2=0x7fbcac160830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:36:50.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.891+0000 7fbcb146b700 1 --2- 172.21.15.114:0/803216336 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbcac1572f0 0x7fbcac160830 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c009850 tx=0x7fbc9c009b60 comp rx=0 tx=0).stop 2023-10-18T12:36:50.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.891+0000 7fbcb146b700 1 -- 172.21.15.114:0/803216336 shutdown_connections 2023-10-18T12:36:50.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.891+0000 7fbcb146b700 1 --2- 172.21.15.114:0/803216336 >> v2:172.21.15.172:3300/0 conn(0x7fbcac0d2f60 0x7fbcac0d33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:36:50.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.891+0000 7fbcb146b700 1 --2- 172.21.15.114:0/803216336 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbcac1572f0 0x7fbcac160830 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:36:50.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.891+0000 7fbcb146b700 1 -- 172.21.15.114:0/803216336 >> 172.21.15.114:0/803216336 conn(0x7fbcac069ef0 msgr2=0x7fbcac06a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:36:50.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.891+0000 7fbcb146b700 1 -- 172.21.15.114:0/803216336 shutdown_connections 2023-10-18T12:36:50.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.891+0000 7fbcb146b700 1 -- 172.21.15.114:0/803216336 wait complete. 2023-10-18T12:36:50.903 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.895+0000 7fbcb146b700 1 Processor -- start 2023-10-18T12:36:50.904 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.895+0000 7fbcb146b700 1 -- start start 2023-10-18T12:36:50.906 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.895+0000 7fbcb146b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbcac0cf320 0x7fbcac1f6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:36:50.906 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.895+0000 7fbcb146b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbcac0d2f60 0x7fbcac0b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:36:50.906 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.895+0000 7fbcb146b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbcac1572f0 0x7fbcac0b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:36:50.906 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.895+0000 7fbcb146b700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac140840 con 0x7fbcac0d2f60 2023-10-18T12:36:50.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.895+0000 7fbcb146b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac15f230 con 0x7fbcac0cf320 2023-10-18T12:36:50.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.895+0000 7fbcb146b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac140ae0 con 0x7fbcac1572f0 2023-10-18T12:36:50.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.895+0000 7fbcab7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbcac0d2f60 0x7fbcac0b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:36:50.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.895+0000 7fbcab7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbcac0d2f60 0x7fbcac0b38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:56670/0 (socket says 172.21.15.114:56670) 2023-10-18T12:36:50.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.895+0000 7fbcab7fe700 1 -- 172.21.15.114:0/1765150249 learned_addr learned my addr 172.21.15.114:0/1765150249 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:36:50.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.895+0000 7fbcabfff700 1 --2- 172.21.15.114:0/1765150249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbcac0cf320 0x7fbcac1f6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:36:50.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.895+0000 7fbcb0c6a700 1 --2- 172.21.15.114:0/1765150249 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbcac1572f0 0x7fbcac0b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:36:50.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.899+0000 7fbcab7fe700 1 -- 172.21.15.114:0/1765150249 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbcac1572f0 msgr2=0x7fbcac0b3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:36:50.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.899+0000 7fbcab7fe700 1 --2- 172.21.15.114:0/1765150249 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbcac1572f0 0x7fbcac0b3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:36:50.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.899+0000 7fbcab7fe700 1 -- 172.21.15.114:0/1765150249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbcac0cf320 msgr2=0x7fbcac1f6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:36:50.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.899+0000 7fbcab7fe700 1 --2- 172.21.15.114:0/1765150249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbcac0cf320 0x7fbcac1f6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:36:50.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.899+0000 7fbcab7fe700 1 -- 172.21.15.114:0/1765150249 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc9c0094b0 con 0x7fbcac0d2f60 2023-10-18T12:36:50.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.899+0000 7fbcab7fe700 1 --2- 172.21.15.114:0/1765150249 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbcac0d2f60 0x7fbcac0b38b0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fbca000c700 tx=0x7fbca000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:36:50.909 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.899+0000 7fbca8ff9700 1 -- 172.21.15.114:0/1765150249 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca0005d90 con 0x7fbcac0d2f60 2023-10-18T12:36:50.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.899+0000 7fbca8ff9700 1 -- 172.21.15.114:0/1765150249 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca00070d0 con 0x7fbcac0d2f60 2023-10-18T12:36:50.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.899+0000 7fbcb146b700 1 -- 172.21.15.114:0/1765150249 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcac140dc0 con 0x7fbcac0d2f60 2023-10-18T12:36:50.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.899+0000 7fbca8ff9700 1 -- 172.21.15.114:0/1765150249 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca0007480 con 0x7fbcac0d2f60 2023-10-18T12:36:50.910 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.899+0000 7fbcb146b700 1 -- 172.21.15.114:0/1765150249 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcac15e4c0 con 0x7fbcac0d2f60 2023-10-18T12:36:50.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.899+0000 7fbcb146b700 1 -- 172.21.15.114:0/1765150249 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fbcac072e60 con 0x7fbcac0d2f60 2023-10-18T12:36:50.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.903+0000 7fbca8ff9700 1 -- 172.21.15.114:0/1765150249 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fbca00075e0 con 0x7fbcac0d2f60 2023-10-18T12:36:50.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.903+0000 7fbca8ff9700 1 --2- 172.21.15.114:0/1765150249 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fbc980656f0 0x7fbc98067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:36:50.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.903+0000 7fbca8ff9700 1 -- 172.21.15.114:0/1765150249 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7fbca0082660 con 0x7fbcac0d2f60 2023-10-18T12:36:50.912 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.903+0000 7fbca8ff9700 1 -- 172.21.15.114:0/1765150249 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+449 (secure 0 0 0) 0x7fbca0089070 con 0x7fbcac0d2f60 2023-10-18T12:36:50.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.903+0000 7fbcabfff700 1 --2- 172.21.15.114:0/1765150249 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fbc980656f0 0x7fbc98067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:36:50.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.903+0000 7fbcb146b700 1 -- 172.21.15.114:0/1765150249 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7fbcac06d500 con 0x7fbcac0d2f60 2023-10-18T12:36:50.913 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:50.907+0000 7fbcabfff700 1 --2- 172.21.15.114:0/1765150249 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fbc980656f0 0x7fbc98067bb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c0090b0 tx=0x7fbc9c01c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:36:51.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:51.115+0000 7fa5e2e40700 1 -- 172.21.15.114:0/3707259046 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa5dc15db40 con 0x7fa5dc159a60 2023-10-18T12:36:51.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:51.119+0000 7fa5d27fc700 1 -- 172.21.15.114:0/3707259046 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4889 (secure 0 0 0) 0x7fa5dc15db40 con 0x7fa5dc159a60 2023-10-18T12:36:51.125 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:36:51.126 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2034957068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2034957068},{"type":"v1","addr":"172.21.15.172:6836","nonce":2034957068}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5039,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4215710360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4215710360},{"type":"v1","addr":"172.21.15.172:6837","nonce":4215710360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2387835210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2387835210},{"type":"v1","addr":"172.21.15.114:6833","nonce":2387835210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T12:21:14.159069+0000","modified":"2023-10-18T12:29:23.762500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":126,"addr":"172.21.15.114:6835/1284474820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1284474820},{"type":"v1","addr":"172.21.15.114:6835","nonce":1284474820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-18T12:36:51.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:51.119+0000 7fa5e2e40700 1 -- 172.21.15.114:0/3707259046 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa5c0065720 msgr2=0x7fa5c0067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:36:51.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:51.119+0000 7fa5e2e40700 1 --2- 172.21.15.114:0/3707259046 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa5c0065720 0x7fa5c0067be0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa5d80090b0 tx=0x7fa5d8008030 comp rx=0 tx=0).stop 2023-10-18T12:36:51.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:51.119+0000 7fa5e2e40700 1 -- 172.21.15.114:0/3707259046 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5dc159a60 msgr2=0x7fa5dc154620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:36:51.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:51.119+0000 7fa5e2e40700 1 --2- 172.21.15.114:0/3707259046 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5dc159a60 0x7fa5dc154620 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4009f00 tx=0x7fa5d400c3a0 comp rx=0 tx=0).stop 2023-10-18T12:36:51.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:51.119+0000 7fa5e2e40700 1 -- 172.21.15.114:0/3707259046 shutdown_connections 2023-10-18T12:36:51.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:51.119+0000 7fa5e2e40700 1 --2- 172.21.15.114:0/3707259046 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa5c0065720 0x7fa5c0067be0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:36:51.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:51.119+0000 7fa5e2e40700 1 --2- 172.21.15.114:0/3707259046 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5dc159a60 0x7fa5dc154620 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:36:51.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:51.119+0000 7fa5e2e40700 1 --2- 172.21.15.114:0/3707259046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa5dc0ced40 0x7fa5dc1540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:36:51.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:51.119+0000 7fa5e2e40700 1 --2- 172.21.15.114:0/3707259046 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa5dc06e6d0 0x7fa5dc0c5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:36:51.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:51.119+0000 7fa5e2e40700 1 -- 172.21.15.114:0/3707259046 >> 172.21.15.114:0/3707259046 conn(0x7fa5dc0cc1d0 msgr2=0x7fa5dc0cd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:36:51.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:51.119+0000 7fa5e2e40700 1 -- 172.21.15.114:0/3707259046 shutdown_connections 2023-10-18T12:36:51.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:36:51.119+0000 7fa5e2e40700 1 -- 172.21.15.114:0/3707259046 wait complete. 2023-10-18T12:36:51.131 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 20 2023-10-18T12:36:51.150 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-10-18T12:36:51.332 INFO:teuthology.orchestra.run.smithi114.stdout:[{"id":5162,"entity":{"name":{"type":"client","num":5162},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":989916161}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":927.34746132400005,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.11734718414682174,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":3,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5162 v1:192.168.0.1:0/989916161","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi172","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}}] 2023-10-18T12:36:51.333 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "1", "hostname": "smithi172", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 989916161, "type": "v1" }, "name": { "num": 5162, "type": "client" } }, "id": 5162, "inst": "client.5162 v1:192.168.0.1:0/989916161", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 3, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.11734718414682174 }, "state": "open", "uptime": 927.347461324 } ] 2023-10-18T12:36:51.434 DEBUG:tasks.ceph_test_case:No log hits yet, waiting... 2023-10-18T12:37:05.204 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:37:05.212 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:37:26.463 ERROR:tasks.ceph_test_case:Log output: 2023-10-18T12:37:26.464 DEBUG:tasks.cephfs.test_client_recovery:Expected log message found: 'Health check cleared: MDS_CLIENTS_LAGGY', retrying 2023-10-18T12:37:27.466 DEBUG:teuthology.orchestra.run.smithi114:> sudo daemon-helper kill ceph --cluster ceph -w 2023-10-18T12:37:27.473 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T12:37:27.646 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.638+0000 7f9fd0edf700 1 Processor -- start 2023-10-18T12:37:27.647 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.638+0000 7f9fd0edf700 1 -- start start 2023-10-18T12:37:27.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.642+0000 7f9fd0edf700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9fcc0cc190 0x7f9fcc0b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:37:27.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.642+0000 7f9fd0edf700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fcc15e000 con 0x7f9fcc0b4140 2023-10-18T12:37:27.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.642+0000 7f9fd0edf700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fcc0ce170 con 0x7f9fcc0cdd90 2023-10-18T12:37:27.653 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.642+0000 7f9fd0edf700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc0b45d0 con 0x7f9fcc0cc190 2023-10-18T12:37:27.654 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.646+0000 7f9fcbfff700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f9fcc0b4140 0x7f9fcc0ca0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:53840/0 (socket says 172.21.15.114:53840) 2023-10-18T12:37:27.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.646+0000 7f9fcbfff700 1 -- 172.21.15.114:0/3990218257 learned_addr learned my addr 172.21.15.114:0/3990218257 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:37:27.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.646+0000 7f9fc3fff700 1 --2- 172.21.15.114:0/3990218257 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9fcc0cc190 0x7f9fcc0b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:37:27.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.646+0000 7f9fcaffd700 1 -- 172.21.15.114:0/3990218257 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 22841135 0 0) 0x7f9fcc15e000 con 0x7f9fcc0b4140 2023-10-18T12:37:27.655 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.646+0000 7f9fcaffd700 1 -- 172.21.15.114:0/3990218257 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fb80035d0 con 0x7f9fcc0b4140 2023-10-18T12:37:27.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.646+0000 7f9fcaffd700 1 -- 172.21.15.114:0/3990218257 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3330174246 0 0) 0x7f9fcc0ce170 con 0x7f9fcc0cdd90 2023-10-18T12:37:27.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.646+0000 7f9fcaffd700 1 -- 172.21.15.114:0/3990218257 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fcc15e000 con 0x7f9fcc0cdd90 2023-10-18T12:37:27.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.646+0000 7f9fcaffd700 1 -- 172.21.15.114:0/3990218257 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 594847240 0 0) 0x7f9fb80035d0 con 0x7f9fcc0b4140 2023-10-18T12:37:27.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.646+0000 7f9fcaffd700 1 -- 172.21.15.114:0/3990218257 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9fcc0cc190 msgr2=0x7f9fcc0b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:37:27.656 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.646+0000 7f9fcaffd700 1 --2- 172.21.15.114:0/3990218257 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9fcc0cc190 0x7f9fcc0b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:37:27.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.646+0000 7f9fcaffd700 1 -- 172.21.15.114:0/3990218257 >> v1:172.21.15.172:6789/0 conn(0x7f9fcc0cdd90 legacy=0x7f9fcc06d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:37:27.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.646+0000 7f9fcaffd700 1 -- 172.21.15.114:0/3990218257 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fcc15d3f0 con 0x7f9fcc0b4140 2023-10-18T12:37:27.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.646+0000 7f9fcaffd700 1 -- 172.21.15.114:0/3990218257 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3368469509 0 0) 0x7f9fc40019f0 con 0x7f9fcc0b4140 2023-10-18T12:37:27.657 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.646+0000 7f9fcaffd700 1 -- 172.21.15.114:0/3990218257 >> v1:172.21.15.114:6789/0 conn(0x7f9fcc0b4140 legacy=0x7f9fcc0ca0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:37:27.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.646+0000 7f9fcaffd700 1 --2- 172.21.15.114:0/3990218257 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9fcc0cc190 0x7f9fb8003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:37:27.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.646+0000 7f9fcaffd700 1 --2- 172.21.15.114:0/3990218257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fb8004140 0x7f9fb8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:37:27.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.646+0000 7f9fcaffd700 1 --2- 172.21.15.114:0/3990218257 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fb8004db0 0x7f9fb8005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:37:27.658 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.646+0000 7f9fcaffd700 1 -- 172.21.15.114:0/3990218257 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc0b45d0 con 0x7f9fb8004db0 2023-10-18T12:37:27.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.646+0000 7f9fcaffd700 1 -- 172.21.15.114:0/3990218257 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb800bb10 con 0x7f9fb8004140 2023-10-18T12:37:27.659 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.646+0000 7f9fcaffd700 1 -- 172.21.15.114:0/3990218257 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb800bcd0 con 0x7f9fcc0cc190 2023-10-18T12:37:27.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.646+0000 7f9fcbfff700 1 --2- 172.21.15.114:0/3990218257 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fb8004db0 0x7f9fb8005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:37:27.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.646+0000 7f9fcb7fe700 1 --2- 172.21.15.114:0/3990218257 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9fcc0cc190 0x7f9fb8003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:37:27.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.646+0000 7f9fc3fff700 1 --2- 172.21.15.114:0/3990218257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fb8004140 0x7f9fb8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:37:27.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.646+0000 7f9fcbfff700 1 -- 172.21.15.114:0/3990218257 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9fcc0cc190 msgr2=0x7f9fb8003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:37:27.661 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.646+0000 7f9fcbfff700 1 --2- 172.21.15.114:0/3990218257 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9fcc0cc190 0x7f9fb8003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:37:27.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.646+0000 7f9fcbfff700 1 -- 172.21.15.114:0/3990218257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fb8004140 msgr2=0x7f9fb8004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:37:27.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.646+0000 7f9fcbfff700 1 --2- 172.21.15.114:0/3990218257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fb8004140 0x7f9fb8004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:37:27.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.646+0000 7f9fcbfff700 1 -- 172.21.15.114:0/3990218257 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb80035d0 con 0x7f9fb8004db0 2023-10-18T12:37:27.662 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.646+0000 7f9fcbfff700 1 --2- 172.21.15.114:0/3990218257 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fb8004db0 0x7f9fb8005230 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f9fc400a7a0 tx=0x7f9fb80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb1206154c558fcb server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:37:27.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.650+0000 7f9fcaffd700 1 -- 172.21.15.114:0/3990218257 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc40072d0 con 0x7f9fb8004db0 2023-10-18T12:37:27.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.650+0000 7f9fcaffd700 1 -- 172.21.15.114:0/3990218257 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc4007450 con 0x7f9fb8004db0 2023-10-18T12:37:27.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.650+0000 7f9fcaffd700 1 -- 172.21.15.114:0/3990218257 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc4007800 con 0x7f9fb8004db0 2023-10-18T12:37:27.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.650+0000 7f9fd0edf700 1 -- 172.21.15.114:0/3990218257 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fb8004db0 msgr2=0x7f9fb8005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:37:27.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.650+0000 7f9fd0edf700 1 --2- 172.21.15.114:0/3990218257 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fb8004db0 0x7f9fb8005230 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f9fc400a7a0 tx=0x7f9fb80058a0 comp rx=0 tx=0).stop 2023-10-18T12:37:27.663 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.650+0000 7f9fcbfff700 1 -- 172.21.15.114:0/3990218257 reap_dead start 2023-10-18T12:37:27.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.650+0000 7f9fd0edf700 1 -- 172.21.15.114:0/3990218257 shutdown_connections 2023-10-18T12:37:27.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.650+0000 7f9fd0edf700 1 -- 172.21.15.114:0/3990218257 >> 172.21.15.114:0/3990218257 conn(0x7f9fcc0ce5c0 msgr2=0x7f9fcc0ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:37:27.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.650+0000 7f9fd0edf700 1 -- 172.21.15.114:0/3990218257 shutdown_connections 2023-10-18T12:37:27.664 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.650+0000 7f9fd0edf700 1 -- 172.21.15.114:0/3990218257 wait complete. 2023-10-18T12:37:27.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.654+0000 7f9fd0edf700 1 Processor -- start 2023-10-18T12:37:27.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.654+0000 7f9fd0edf700 1 -- start start 2023-10-18T12:37:27.666 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.658+0000 7f9fd0edf700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fb8004db0 0x7f9fcc13ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:37:27.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.658+0000 7f9fd0edf700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fcc141b80 0x7f9fcc157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:37:27.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.658+0000 7f9fd0edf700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9fcc06f6c0 0x7f9fcc14cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:37:27.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.658+0000 7f9fd0edf700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc13e8b0 con 0x7f9fb8004db0 2023-10-18T12:37:27.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.658+0000 7f9fd0edf700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc13da30 con 0x7f9fcc141b80 2023-10-18T12:37:27.667 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.658+0000 7f9fd0edf700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fcc1583e0 con 0x7f9fcc06f6c0 2023-10-18T12:37:27.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.658+0000 7f9fcb7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fb8004db0 0x7f9fcc13ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:37:27.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.658+0000 7f9fcb7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fb8004db0 0x7f9fcc13ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42062/0 (socket says 172.21.15.114:42062) 2023-10-18T12:37:27.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.658+0000 7f9fcb7fe700 1 -- 172.21.15.114:0/2035954900 learned_addr learned my addr 172.21.15.114:0/2035954900 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:37:27.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.658+0000 7f9fc3fff700 1 --2- 172.21.15.114:0/2035954900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fcc141b80 0x7f9fcc157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:37:27.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.658+0000 7f9fcbfff700 1 --2- 172.21.15.114:0/2035954900 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9fcc06f6c0 0x7f9fcc14cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:37:27.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.658+0000 7f9fcb7fe700 1 -- 172.21.15.114:0/2035954900 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9fcc06f6c0 msgr2=0x7f9fcc14cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:37:27.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.658+0000 7f9fcb7fe700 1 --2- 172.21.15.114:0/2035954900 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9fcc06f6c0 0x7f9fcc14cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:37:27.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.658+0000 7f9fcb7fe700 1 -- 172.21.15.114:0/2035954900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fcc141b80 msgr2=0x7f9fcc157ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:37:27.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.658+0000 7f9fcb7fe700 1 --2- 172.21.15.114:0/2035954900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fcc141b80 0x7f9fcc157ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:37:27.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.658+0000 7f9fcb7fe700 1 -- 172.21.15.114:0/2035954900 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fcc13dca0 con 0x7f9fb8004db0 2023-10-18T12:37:27.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.658+0000 7f9fcb7fe700 1 --2- 172.21.15.114:0/2035954900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fb8004db0 0x7f9fcc13ba00 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc00f830 tx=0x7f9fbc00fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:37:27.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.658+0000 7f9fc8ff9700 1 -- 172.21.15.114:0/2035954900 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc001540 con 0x7f9fb8004db0 2023-10-18T12:37:27.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.658+0000 7f9fc8ff9700 1 -- 172.21.15.114:0/2035954900 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fbc0052e0 con 0x7f9fb8004db0 2023-10-18T12:37:27.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.658+0000 7f9fd0edf700 1 -- 172.21.15.114:0/2035954900 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fcc13df80 con 0x7f9fb8004db0 2023-10-18T12:37:27.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.658+0000 7f9fc8ff9700 1 -- 172.21.15.114:0/2035954900 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc0036a0 con 0x7f9fb8004db0 2023-10-18T12:37:27.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.658+0000 7f9fd0edf700 1 -- 172.21.15.114:0/2035954900 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fcc13e540 con 0x7f9fb8004db0 2023-10-18T12:37:27.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.662+0000 7f9fd0edf700 1 -- 172.21.15.114:0/2035954900 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fcc13e700 con 0x7f9fb8004db0 2023-10-18T12:37:27.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.662+0000 7f9fc8ff9700 1 -- 172.21.15.114:0/2035954900 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f9fbc003800 con 0x7f9fb8004db0 2023-10-18T12:37:27.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.662+0000 7f9fc8ff9700 1 --2- 172.21.15.114:0/2035954900 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9fac065720 0x7f9fac067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:37:27.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.662+0000 7f9fc8ff9700 1 -- 172.21.15.114:0/2035954900 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7f9fbc082fa0 con 0x7f9fb8004db0 2023-10-18T12:37:27.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.662+0000 7f9fc3fff700 1 --2- 172.21.15.114:0/2035954900 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9fac065720 0x7f9fac067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:37:27.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.666+0000 7f9fc3fff700 1 --2- 172.21.15.114:0/2035954900 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9fac065720 0x7f9fac067be0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc158b30 tx=0x7f9fb4009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:37:27.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.666+0000 7fc45a584700 1 Processor -- start 2023-10-18T12:37:27.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.666+0000 7fc45a584700 1 -- start start 2023-10-18T12:37:27.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.666+0000 7fc45a584700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc45415cfd0 0x7fc4540ce750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:37:27.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.666+0000 7fc45a584700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4541611d0 0x7fc45406ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:37:27.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.666+0000 7fc45a584700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc45406f4f0 con 0x7fc4541616f0 2023-10-18T12:37:27.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.666+0000 7fc45a584700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc45415d3b0 con 0x7fc45415cfd0 2023-10-18T12:37:27.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.666+0000 7fc45a584700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4540cf310 con 0x7fc4541611d0 2023-10-18T12:37:27.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.666+0000 7fc459582700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc45415cfd0 0x7fc4540ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:37:27.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.666+0000 7fc459d83700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4541611d0 0x7fc45406ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:37:27.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.666+0000 7fc459582700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc45415cfd0 0x7fc4540ce750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:57892/0 (socket says 172.21.15.114:57892) 2023-10-18T12:37:27.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.666+0000 7fc459d83700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4541611d0 0x7fc45406ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.114:36530/0 (socket says 172.21.15.114:36530) 2023-10-18T12:37:27.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.666+0000 7fc459582700 1 -- 172.21.15.114:0/4152352416 learned_addr learned my addr 172.21.15.114:0/4152352416 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:37:27.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.670+0000 7fc459582700 1 -- 172.21.15.114:0/4152352416 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4541611d0 msgr2=0x7fc45406ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:37:27.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.670+0000 7fc459582700 1 --2- 172.21.15.114:0/4152352416 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4541611d0 0x7fc45406ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:37:27.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.670+0000 7fc459582700 1 -- 172.21.15.114:0/4152352416 >> v1:172.21.15.172:6789/0 conn(0x7fc4541616f0 legacy=0x7fc454160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:37:27.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.670+0000 7fc459582700 1 -- 172.21.15.114:0/4152352416 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc45406f760 con 0x7fc45415cfd0 2023-10-18T12:37:27.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.670+0000 7f9fc8ff9700 1 -- 172.21.15.114:0/2035954900 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f9fbc0541c0 con 0x7f9fb8004db0 2023-10-18T12:37:27.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.670+0000 7fc459582700 1 --2- 172.21.15.114:0/4152352416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc45415cfd0 0x7fc4540ce750 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc450009e50 tx=0x7fc45000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fdee6e36695595dc server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:37:27.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.670+0000 7fc44bfff700 1 -- 172.21.15.114:0/4152352416 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45000e070 con 0x7fc45415cfd0 2023-10-18T12:37:27.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.670+0000 7fc44bfff700 1 -- 172.21.15.114:0/4152352416 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc45000b910 con 0x7fc45415cfd0 2023-10-18T12:37:27.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.670+0000 7fc44bfff700 1 -- 172.21.15.114:0/4152352416 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45000bcc0 con 0x7fc45415cfd0 2023-10-18T12:37:27.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.670+0000 7fc45a584700 1 -- 172.21.15.114:0/4152352416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc45415cfd0 msgr2=0x7fc4540ce750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:37:27.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.670+0000 7fc45a584700 1 --2- 172.21.15.114:0/4152352416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc45415cfd0 0x7fc4540ce750 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc450009e50 tx=0x7fc45000b330 comp rx=0 tx=0).stop 2023-10-18T12:37:27.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.670+0000 7fc45a584700 1 -- 172.21.15.114:0/4152352416 shutdown_connections 2023-10-18T12:37:27.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.670+0000 7fc45a584700 1 --2- 172.21.15.114:0/4152352416 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc4541611d0 0x7fc45406ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:37:27.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.670+0000 7fc45a584700 1 --2- 172.21.15.114:0/4152352416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc45415cfd0 0x7fc4540ce750 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:37:27.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.670+0000 7fc45a584700 1 -- 172.21.15.114:0/4152352416 >> 172.21.15.114:0/4152352416 conn(0x7fc4540d0970 msgr2=0x7fc4540d0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:37:27.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.670+0000 7fc45a584700 1 -- 172.21.15.114:0/4152352416 shutdown_connections 2023-10-18T12:37:27.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.670+0000 7fc45a584700 1 -- 172.21.15.114:0/4152352416 wait complete. 2023-10-18T12:37:27.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.674+0000 7fc45a584700 1 Processor -- start 2023-10-18T12:37:27.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.674+0000 7fc45a584700 1 -- start start 2023-10-18T12:37:27.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.674+0000 7fc45a584700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc45415cfd0 0x7fc4540c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:37:27.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.674+0000 7fc45a584700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4541611d0 0x7fc4541e6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:37:27.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.674+0000 7fc45a584700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4541616f0 0x7fc454150f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:37:27.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.674+0000 7fc45a584700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4541e99f0 con 0x7fc4541611d0 2023-10-18T12:37:27.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.674+0000 7fc45a584700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4540b25d0 con 0x7fc4541616f0 2023-10-18T12:37:27.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.674+0000 7fc45a584700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4541ea990 con 0x7fc45415cfd0 2023-10-18T12:37:27.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.674+0000 7fc458d81700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4541611d0 0x7fc4541e6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:37:27.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.674+0000 7fc458d81700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4541611d0 0x7fc4541e6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:42068/0 (socket says 172.21.15.114:42068) 2023-10-18T12:37:27.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.674+0000 7fc458d81700 1 -- 172.21.15.114:0/2296346131 learned_addr learned my addr 172.21.15.114:0/2296346131 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:37:27.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.674+0000 7fc459d83700 1 --2- 172.21.15.114:0/2296346131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4541616f0 0x7fc454150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:37:27.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.674+0000 7fc459582700 1 --2- 172.21.15.114:0/2296346131 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc45415cfd0 0x7fc4540c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:37:27.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.674+0000 7fc458d81700 1 -- 172.21.15.114:0/2296346131 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc45415cfd0 msgr2=0x7fc4540c87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:37:27.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.674+0000 7fc458d81700 1 --2- 172.21.15.114:0/2296346131 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc45415cfd0 0x7fc4540c87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:37:27.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.674+0000 7fc458d81700 1 -- 172.21.15.114:0/2296346131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4541616f0 msgr2=0x7fc454150f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:37:27.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.674+0000 7fc458d81700 1 --2- 172.21.15.114:0/2296346131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4541616f0 0x7fc454150f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:37:27.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.674+0000 7fc458d81700 1 -- 172.21.15.114:0/2296346131 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc450009b30 con 0x7fc4541611d0 2023-10-18T12:37:27.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.674+0000 7fc458d81700 1 --2- 172.21.15.114:0/2296346131 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc4541611d0 0x7fc4541e6b30 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fc44400c4d0 tx=0x7fc44400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:37:27.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.674+0000 7fc449ffb700 1 -- 172.21.15.114:0/2296346131 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4440052d0 con 0x7fc4541611d0 2023-10-18T12:37:27.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.674+0000 7fc449ffb700 1 -- 172.21.15.114:0/2296346131 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc444005430 con 0x7fc4541611d0 2023-10-18T12:37:27.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.674+0000 7fc45a584700 1 -- 172.21.15.114:0/2296346131 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4540c8ce0 con 0x7fc4541611d0 2023-10-18T12:37:27.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.678+0000 7fc449ffb700 1 -- 172.21.15.114:0/2296346131 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4440055a0 con 0x7fc4541611d0 2023-10-18T12:37:27.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.678+0000 7fc45a584700 1 -- 172.21.15.114:0/2296346131 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4540b2820 con 0x7fc4541611d0 2023-10-18T12:37:27.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.678+0000 7fc45a584700 1 -- 172.21.15.114:0/2296346131 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fc454072e60 con 0x7fc4541611d0 2023-10-18T12:37:27.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.678+0000 7fc449ffb700 1 -- 172.21.15.114:0/2296346131 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fc4440038c0 con 0x7fc4541611d0 2023-10-18T12:37:27.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.682+0000 7fc449ffb700 1 --2- 172.21.15.114:0/2296346131 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc4380656f0 0x7fc438067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:37:27.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.682+0000 7fc449ffb700 1 -- 172.21.15.114:0/2296346131 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7fc444082330 con 0x7fc4541611d0 2023-10-18T12:37:27.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.682+0000 7fc449ffb700 1 -- 172.21.15.114:0/2296346131 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+449 (secure 0 0 0) 0x7fc444089070 con 0x7fc4541611d0 2023-10-18T12:37:27.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.682+0000 7fc459582700 1 --2- 172.21.15.114:0/2296346131 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc4380656f0 0x7fc438067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:37:27.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.682+0000 7fc45a584700 1 -- 172.21.15.114:0/2296346131 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7fc4540b68f0 con 0x7fc4541611d0 2023-10-18T12:37:27.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.682+0000 7fc459582700 1 --2- 172.21.15.114:0/2296346131 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc4380656f0 0x7fc438067bb0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc45000b370 tx=0x7fc450009000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:37:27.901 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.894+0000 7f9fd0edf700 1 -- 172.21.15.114:0/2035954900 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9fcc072e60 con 0x7f9fb8004db0 2023-10-18T12:37:27.902 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.894+0000 7f9fc8ff9700 1 -- 172.21.15.114:0/2035954900 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4889 (secure 0 0 0) 0x7f9fbc053d50 con 0x7f9fb8004db0 2023-10-18T12:37:27.902 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:37:27.903 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2034957068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2034957068},{"type":"v1","addr":"172.21.15.172:6836","nonce":2034957068}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5039,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4215710360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4215710360},{"type":"v1","addr":"172.21.15.172:6837","nonce":4215710360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2387835210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2387835210},{"type":"v1","addr":"172.21.15.114:6833","nonce":2387835210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T12:21:14.159069+0000","modified":"2023-10-18T12:29:23.762500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":126,"addr":"172.21.15.114:6835/1284474820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1284474820},{"type":"v1","addr":"172.21.15.114:6835","nonce":1284474820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-18T12:37:27.906 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.898+0000 7f9fd0edf700 1 -- 172.21.15.114:0/2035954900 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9fac065720 msgr2=0x7f9fac067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:37:27.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.898+0000 7f9fd0edf700 1 --2- 172.21.15.114:0/2035954900 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9fac065720 0x7f9fac067be0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc158b30 tx=0x7f9fb4009240 comp rx=0 tx=0).stop 2023-10-18T12:37:27.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.898+0000 7f9fd0edf700 1 -- 172.21.15.114:0/2035954900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fb8004db0 msgr2=0x7f9fcc13ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:37:27.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.898+0000 7f9fd0edf700 1 --2- 172.21.15.114:0/2035954900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fb8004db0 0x7f9fcc13ba00 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc00f830 tx=0x7f9fbc00fbf0 comp rx=0 tx=0).stop 2023-10-18T12:37:27.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.898+0000 7f9fd0edf700 1 -- 172.21.15.114:0/2035954900 shutdown_connections 2023-10-18T12:37:27.907 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.898+0000 7f9fd0edf700 1 --2- 172.21.15.114:0/2035954900 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9fac065720 0x7f9fac067be0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:37:27.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.898+0000 7f9fd0edf700 1 --2- 172.21.15.114:0/2035954900 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9fcc06f6c0 0x7f9fcc14cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:37:27.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.898+0000 7f9fd0edf700 1 --2- 172.21.15.114:0/2035954900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fcc141b80 0x7f9fcc157ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:37:27.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.898+0000 7f9fd0edf700 1 --2- 172.21.15.114:0/2035954900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fb8004db0 0x7f9fcc13ba00 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:37:27.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.898+0000 7f9fd0edf700 1 -- 172.21.15.114:0/2035954900 >> 172.21.15.114:0/2035954900 conn(0x7f9fcc0ce5c0 msgr2=0x7f9fcc159080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:37:27.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.898+0000 7f9fd0edf700 1 -- 172.21.15.114:0/2035954900 shutdown_connections 2023-10-18T12:37:27.908 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:37:27.898+0000 7f9fd0edf700 1 -- 172.21.15.114:0/2035954900 wait complete. 2023-10-18T12:37:27.909 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 20 2023-10-18T12:37:27.930 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-10-18T12:37:28.122 INFO:teuthology.orchestra.run.smithi114.stdout:[{"id":5162,"entity":{"name":{"type":"client","num":5162},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":989916161}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":964.13468588199999,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.10778520348032397,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":3,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5162 v1:192.168.0.1:0/989916161","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi172","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}}] 2023-10-18T12:37:28.123 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "1", "hostname": "smithi172", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 989916161, "type": "v1" }, "name": { "num": 5162, "type": "client" } }, "id": 5162, "inst": "client.5162 v1:192.168.0.1:0/989916161", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 3, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.10778520348032397 }, "state": "open", "uptime": 964.134685882 } ] 2023-10-18T12:37:28.224 DEBUG:tasks.ceph_test_case:No log hits yet, waiting... 2023-10-18T12:37:35.303 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:37:35.311 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:38:03.252 ERROR:tasks.ceph_test_case:Log output: 2023-10-18T12:38:03.252 DEBUG:tasks.cephfs.test_client_recovery:Expected log message found: 'Health check cleared: MDS_CLIENTS_LAGGY', retrying 2023-10-18T12:38:04.254 DEBUG:teuthology.orchestra.run.smithi114:> sudo daemon-helper kill ceph --cluster ceph -w 2023-10-18T12:38:04.262 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T12:38:04.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.421+0000 7f127b59e700 1 Processor -- start 2023-10-18T12:38:04.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.421+0000 7f127b59e700 1 -- start start 2023-10-18T12:38:04.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.421+0000 7f127b59e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f127c0b1df0 0x7f127c0d13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:38:04.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.421+0000 7f127b59e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f127c15d060 con 0x7f127c0d30e0 2023-10-18T12:38:04.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.421+0000 7f127b59e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f127c06d830 con 0x7f127c15cc80 2023-10-18T12:38:04.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.421+0000 7f127b59e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f127c06dd60 con 0x7f127c0b1df0 2023-10-18T12:38:04.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.421+0000 7f1271d9b700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f127c0d30e0 0x7f127c160730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:55712/0 (socket says 172.21.15.114:55712) 2023-10-18T12:38:04.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.421+0000 7f1271d9b700 1 -- 172.21.15.114:0/3827572636 learned_addr learned my addr 172.21.15.114:0/3827572636 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:38:04.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.425+0000 7f1279d9b700 1 -- 172.21.15.114:0/3827572636 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3481819251 0 0) 0x7f127c15d060 con 0x7f127c0d30e0 2023-10-18T12:38:04.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.425+0000 7f1279d9b700 1 -- 172.21.15.114:0/3827572636 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12680035d0 con 0x7f127c0d30e0 2023-10-18T12:38:04.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.425+0000 7f127ad9d700 1 --2- 172.21.15.114:0/3827572636 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f127c0b1df0 0x7f127c0d13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:38:04.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.425+0000 7f1279d9b700 1 -- 172.21.15.114:0/3827572636 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2275312312 0 0) 0x7f12680035d0 con 0x7f127c0d30e0 2023-10-18T12:38:04.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.425+0000 7f1279d9b700 1 -- 172.21.15.114:0/3827572636 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f127c0b1df0 msgr2=0x7f127c0d13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:38:04.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.425+0000 7f1279d9b700 1 --2- 172.21.15.114:0/3827572636 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f127c0b1df0 0x7f127c0d13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:38:04.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.425+0000 7f1279d9b700 1 -- 172.21.15.114:0/3827572636 >> v1:172.21.15.172:6789/0 conn(0x7f127c15cc80 legacy=0x7f127c0d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:38:04.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.425+0000 7f1279d9b700 1 -- 172.21.15.114:0/3827572636 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f127c06da80 con 0x7f127c0d30e0 2023-10-18T12:38:04.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.425+0000 7f1279d9b700 1 -- 172.21.15.114:0/3827572636 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3368469509 0 0) 0x7f1264001670 con 0x7f127c0d30e0 2023-10-18T12:38:04.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.425+0000 7f1279d9b700 1 -- 172.21.15.114:0/3827572636 >> v1:172.21.15.114:6789/0 conn(0x7f127c0d30e0 legacy=0x7f127c160730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:38:04.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.425+0000 7f1279d9b700 1 --2- 172.21.15.114:0/3827572636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1268003a50 0x7f1268003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:38:04.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.425+0000 7f1279d9b700 1 --2- 172.21.15.114:0/3827572636 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f127c0b1df0 0x7f1268004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:38:04.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.425+0000 7f1279d9b700 1 --2- 172.21.15.114:0/3827572636 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1268004db0 0x7f1268005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:38:04.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.425+0000 7f1279d9b700 1 -- 172.21.15.114:0/3827572636 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127c06dd60 con 0x7f1268004db0 2023-10-18T12:38:04.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.425+0000 7f1279d9b700 1 -- 172.21.15.114:0/3827572636 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126800bcb0 con 0x7f1268003a50 2023-10-18T12:38:04.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.425+0000 7f1279d9b700 1 -- 172.21.15.114:0/3827572636 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f126800be70 con 0x7f127c0b1df0 2023-10-18T12:38:04.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.425+0000 7f127ad9d700 1 --2- 172.21.15.114:0/3827572636 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1268004db0 0x7f1268005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:38:04.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.425+0000 7f1271d9b700 1 --2- 172.21.15.114:0/3827572636 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f127c0b1df0 0x7f1268004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:38:04.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.425+0000 7f127a59c700 1 --2- 172.21.15.114:0/3827572636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1268003a50 0x7f1268003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:38:04.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.425+0000 7f127ad9d700 1 -- 172.21.15.114:0/3827572636 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f127c0b1df0 msgr2=0x7f1268004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:38:04.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.425+0000 7f127ad9d700 1 --2- 172.21.15.114:0/3827572636 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f127c0b1df0 0x7f1268004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:38:04.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.425+0000 7f127ad9d700 1 -- 172.21.15.114:0/3827572636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1268003a50 msgr2=0x7f1268003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:38:04.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.425+0000 7f127ad9d700 1 --2- 172.21.15.114:0/3827572636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1268003a50 0x7f1268003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:38:04.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.425+0000 7f127ad9d700 1 -- 172.21.15.114:0/3827572636 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12680035d0 con 0x7f1268004db0 2023-10-18T12:38:04.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.425+0000 7f127ad9d700 1 --2- 172.21.15.114:0/3827572636 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1268004db0 0x7f1268005230 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f1274007360 tx=0x7f12680058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d2f9973eb4a6fc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:38:04.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.425+0000 7f1279d9b700 1 -- 172.21.15.114:0/3827572636 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1274007e80 con 0x7f1268004db0 2023-10-18T12:38:04.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.425+0000 7f1279d9b700 1 -- 172.21.15.114:0/3827572636 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1274014400 con 0x7f1268004db0 2023-10-18T12:38:04.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.425+0000 7f1279d9b700 1 -- 172.21.15.114:0/3827572636 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1274014790 con 0x7f1268004db0 2023-10-18T12:38:04.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.425+0000 7f127b59e700 1 -- 172.21.15.114:0/3827572636 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1268004db0 msgr2=0x7f1268005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:38:04.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.425+0000 7f127b59e700 1 --2- 172.21.15.114:0/3827572636 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1268004db0 0x7f1268005230 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f1274007360 tx=0x7f12680058a0 comp rx=0 tx=0).stop 2023-10-18T12:38:04.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.425+0000 7f127ad9d700 1 -- 172.21.15.114:0/3827572636 reap_dead start 2023-10-18T12:38:04.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.425+0000 7f127b59e700 1 -- 172.21.15.114:0/3827572636 shutdown_connections 2023-10-18T12:38:04.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.425+0000 7f127b59e700 1 -- 172.21.15.114:0/3827572636 >> 172.21.15.114:0/3827572636 conn(0x7f127c0cf530 msgr2=0x7f127c0cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:38:04.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.425+0000 7f127b59e700 1 -- 172.21.15.114:0/3827572636 shutdown_connections 2023-10-18T12:38:04.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.425+0000 7f127b59e700 1 -- 172.21.15.114:0/3827572636 wait complete. 2023-10-18T12:38:04.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.429+0000 7f127b59e700 1 Processor -- start 2023-10-18T12:38:04.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.429+0000 7f127b59e700 1 -- start start 2023-10-18T12:38:04.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.433+0000 7f127b59e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1268004db0 0x7f127c15eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:38:04.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.433+0000 7f127b59e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f127c158f20 0x7f127c15bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:38:04.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.433+0000 7f127b59e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f127c14a6c0 0x7f127c14ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:38:04.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.433+0000 7f127b59e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127c144f20 con 0x7f127c14a6c0 2023-10-18T12:38:04.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.433+0000 7f127b59e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127c14b080 con 0x7f1268004db0 2023-10-18T12:38:04.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.433+0000 7f127b59e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f127c15f0a0 con 0x7f127c158f20 2023-10-18T12:38:04.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.433+0000 7f127ad9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f127c14a6c0 0x7f127c14ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:38:04.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.433+0000 7f127ad9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f127c14a6c0 0x7f127c14ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45156/0 (socket says 172.21.15.114:45156) 2023-10-18T12:38:04.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.433+0000 7f127ad9d700 1 -- 172.21.15.114:0/3827693687 learned_addr learned my addr 172.21.15.114:0/3827693687 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:38:04.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.433+0000 7f127a59c700 1 --2- 172.21.15.114:0/3827693687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1268004db0 0x7f127c15eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:38:04.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.433+0000 7f1271d9b700 1 --2- 172.21.15.114:0/3827693687 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f127c158f20 0x7f127c15bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:38:04.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.433+0000 7f127ad9d700 1 -- 172.21.15.114:0/3827693687 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f127c158f20 msgr2=0x7f127c15bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:38:04.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.433+0000 7f127ad9d700 1 --2- 172.21.15.114:0/3827693687 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f127c158f20 0x7f127c15bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:38:04.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.433+0000 7f127ad9d700 1 -- 172.21.15.114:0/3827693687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1268004db0 msgr2=0x7f127c15eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:38:04.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.433+0000 7f127ad9d700 1 --2- 172.21.15.114:0/3827693687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1268004db0 0x7f127c15eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:38:04.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.433+0000 7f127ad9d700 1 -- 172.21.15.114:0/3827693687 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f127c15f380 con 0x7f127c14a6c0 2023-10-18T12:38:04.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.433+0000 7f127ad9d700 1 --2- 172.21.15.114:0/3827693687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f127c14a6c0 0x7f127c14ab40 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f1274014000 tx=0x7f1274004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:38:04.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.433+0000 7f12737fe700 1 -- 172.21.15.114:0/3827693687 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1274007000 con 0x7f127c14a6c0 2023-10-18T12:38:04.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.433+0000 7f12737fe700 1 -- 172.21.15.114:0/3827693687 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f127401e410 con 0x7f127c14a6c0 2023-10-18T12:38:04.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.433+0000 7f12737fe700 1 -- 172.21.15.114:0/3827693687 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127401e7c0 con 0x7f127c14a6c0 2023-10-18T12:38:04.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.433+0000 7f127b59e700 1 -- 172.21.15.114:0/3827693687 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f127c15f660 con 0x7f127c14a6c0 2023-10-18T12:38:04.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.433+0000 7f127b59e700 1 -- 172.21.15.114:0/3827693687 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f127c159380 con 0x7f127c14a6c0 2023-10-18T12:38:04.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.437+0000 7f127b59e700 1 -- 172.21.15.114:0/3827693687 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f127c072e60 con 0x7f127c14a6c0 2023-10-18T12:38:04.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.437+0000 7f12737fe700 1 -- 172.21.15.114:0/3827693687 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f127401b050 con 0x7f127c14a6c0 2023-10-18T12:38:04.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.437+0000 7f12737fe700 1 --2- 172.21.15.114:0/3827693687 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f125c0656f0 0x7f125c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:38:04.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.437+0000 7f12737fe700 1 -- 172.21.15.114:0/3827693687 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7f1274084360 con 0x7f127c14a6c0 2023-10-18T12:38:04.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.437+0000 7f127a59c700 1 --2- 172.21.15.114:0/3827693687 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f125c0656f0 0x7f125c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:38:04.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.441+0000 7f127a59c700 1 --2- 172.21.15.114:0/3827693687 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f125c0656f0 0x7f125c067bb0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f126c0017c0 tx=0x7f126c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:38:04.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.445+0000 7f12737fe700 1 -- 172.21.15.114:0/3827693687 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f1274051b80 con 0x7f127c14a6c0 2023-10-18T12:38:04.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.453+0000 7f8779533700 1 Processor -- start 2023-10-18T12:38:04.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.453+0000 7f8779533700 1 -- start start 2023-10-18T12:38:04.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.457+0000 7f8779533700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f877415bd00 0x7f87740b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:38:04.461 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.457+0000 7f8779533700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f877415b870 con 0x7f8774144290 2023-10-18T12:38:04.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.457+0000 7f8779533700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87740b2700 con 0x7f8774144670 2023-10-18T12:38:04.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.457+0000 7f8779533700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87740b29e0 con 0x7f877415bd00 2023-10-18T12:38:04.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.457+0000 7f8772ffd700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f8774144290 0x7f87740b1c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:55726/0 (socket says 172.21.15.114:55726) 2023-10-18T12:38:04.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.457+0000 7f8772ffd700 1 -- 172.21.15.114:0/917026903 learned_addr learned my addr 172.21.15.114:0/917026903 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:38:04.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.457+0000 7f87727fc700 1 --2- 172.21.15.114:0/917026903 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f877415bd00 0x7f87740b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:38:04.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.457+0000 7f8771ffb700 1 -- 172.21.15.114:0/917026903 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3193258701 0 0) 0x7f87740b2700 con 0x7f8774144670 2023-10-18T12:38:04.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.457+0000 7f8771ffb700 1 -- 172.21.15.114:0/917026903 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f875c0035d0 con 0x7f8774144670 2023-10-18T12:38:04.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.457+0000 7f8771ffb700 1 -- 172.21.15.114:0/917026903 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2308629765 0 0) 0x7f877415b870 con 0x7f8774144290 2023-10-18T12:38:04.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.457+0000 7f87727fc700 1 -- 172.21.15.114:0/917026903 >> v1:172.21.15.172:6789/0 conn(0x7f8774144670 legacy=0x7f877406f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:38:04.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.457+0000 7f87727fc700 1 -- 172.21.15.114:0/917026903 >> v1:172.21.15.114:6789/0 conn(0x7f8774144290 legacy=0x7f87740b1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:38:04.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.457+0000 7f87727fc700 1 -- 172.21.15.114:0/917026903 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f877415b220 con 0x7f877415bd00 2023-10-18T12:38:04.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.457+0000 7f87727fc700 1 --2- 172.21.15.114:0/917026903 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f877415bd00 0x7f87740b3e90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8768009880 tx=0x7f8768009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e2147c75d5b8f61 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:38:04.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.457+0000 7f8771ffb700 1 -- 172.21.15.114:0/917026903 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8768011830 con 0x7f877415bd00 2023-10-18T12:38:04.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.457+0000 7f8771ffb700 1 -- 172.21.15.114:0/917026903 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8768011990 con 0x7f877415bd00 2023-10-18T12:38:04.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.457+0000 7f8771ffb700 1 -- 172.21.15.114:0/917026903 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8768011d00 con 0x7f877415bd00 2023-10-18T12:38:04.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.457+0000 7f8779533700 1 -- 172.21.15.114:0/917026903 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f877415bd00 msgr2=0x7f87740b3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:38:04.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.457+0000 7f8779533700 1 --2- 172.21.15.114:0/917026903 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f877415bd00 0x7f87740b3e90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8768009880 tx=0x7f8768009b90 comp rx=0 tx=0).stop 2023-10-18T12:38:04.467 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.461+0000 7f8779533700 1 -- 172.21.15.114:0/917026903 shutdown_connections 2023-10-18T12:38:04.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.461+0000 7f8779533700 1 --2- 172.21.15.114:0/917026903 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f877415bd00 0x7f87740b3e90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:38:04.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.461+0000 7f8779533700 1 -- 172.21.15.114:0/917026903 >> 172.21.15.114:0/917026903 conn(0x7f87740b0650 msgr2=0x7f87740b0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:38:04.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.461+0000 7f8779533700 1 -- 172.21.15.114:0/917026903 shutdown_connections 2023-10-18T12:38:04.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.461+0000 7f8779533700 1 -- 172.21.15.114:0/917026903 wait complete. 2023-10-18T12:38:04.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.461+0000 7f8779533700 1 Processor -- start 2023-10-18T12:38:04.469 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.461+0000 7f8779533700 1 -- start start 2023-10-18T12:38:04.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.461+0000 7f8779533700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8774144290 0x7f877413ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:38:04.471 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.461+0000 7f8779533700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8774144670 0x7f87741e4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:38:04.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.461+0000 7f8779533700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f877415bd00 0x7f87741f61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:38:04.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.461+0000 7f8779533700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87740cdfe0 con 0x7f8774144670 2023-10-18T12:38:04.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.461+0000 7f8779533700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877413f230 con 0x7f877415bd00 2023-10-18T12:38:04.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.461+0000 7f8779533700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87740cd360 con 0x7f8774144290 2023-10-18T12:38:04.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.461+0000 7f87727fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8774144670 0x7f87741e4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:38:04.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.461+0000 7f87727fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8774144670 0x7f87741e4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:45170/0 (socket says 172.21.15.114:45170) 2023-10-18T12:38:04.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.461+0000 7f87727fc700 1 -- 172.21.15.114:0/1460201478 learned_addr learned my addr 172.21.15.114:0/1460201478 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:38:04.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.465+0000 7f8772ffd700 1 --2- 172.21.15.114:0/1460201478 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8774144290 0x7f877413ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:38:04.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.465+0000 7f8773fff700 1 --2- 172.21.15.114:0/1460201478 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f877415bd00 0x7f87741f61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:38:04.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.465+0000 7f87727fc700 1 -- 172.21.15.114:0/1460201478 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8774144290 msgr2=0x7f877413ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:38:04.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.465+0000 7f87727fc700 1 --2- 172.21.15.114:0/1460201478 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8774144290 0x7f877413ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:38:04.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.465+0000 7f87727fc700 1 -- 172.21.15.114:0/1460201478 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f877415bd00 msgr2=0x7f87741f61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:38:04.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.465+0000 7f87727fc700 1 --2- 172.21.15.114:0/1460201478 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f877415bd00 0x7f87741f61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:38:04.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.465+0000 7f87727fc700 1 -- 172.21.15.114:0/1460201478 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87680094b0 con 0x7f8774144670 2023-10-18T12:38:04.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.465+0000 7f87727fc700 1 --2- 172.21.15.114:0/1460201478 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8774144670 0x7f87741e4420 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f8768013040 tx=0x7f8768004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:38:04.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.465+0000 7f875b7fe700 1 -- 172.21.15.114:0/1460201478 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87680036c0 con 0x7f8774144670 2023-10-18T12:38:04.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.465+0000 7f875b7fe700 1 -- 172.21.15.114:0/1460201478 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8768003840 con 0x7f8774144670 2023-10-18T12:38:04.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.465+0000 7f875b7fe700 1 -- 172.21.15.114:0/1460201478 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8768003bf0 con 0x7f8774144670 2023-10-18T12:38:04.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.465+0000 7f8779533700 1 -- 172.21.15.114:0/1460201478 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87740cd640 con 0x7f8774144670 2023-10-18T12:38:04.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.465+0000 7f8779533700 1 -- 172.21.15.114:0/1460201478 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87740cdc00 con 0x7f8774144670 2023-10-18T12:38:04.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.465+0000 7f8779533700 1 -- 172.21.15.114:0/1460201478 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f8774073f00 con 0x7f8774144670 2023-10-18T12:38:04.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.465+0000 7f875b7fe700 1 -- 172.21.15.114:0/1460201478 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f8768003d50 con 0x7f8774144670 2023-10-18T12:38:04.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.469+0000 7f875b7fe700 1 --2- 172.21.15.114:0/1460201478 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8760065720 0x7f8760067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:38:04.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.469+0000 7f875b7fe700 1 -- 172.21.15.114:0/1460201478 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7f87680846b0 con 0x7f8774144670 2023-10-18T12:38:04.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.469+0000 7f875b7fe700 1 -- 172.21.15.114:0/1460201478 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+449 (secure 0 0 0) 0x7f876808b070 con 0x7f8774144670 2023-10-18T12:38:04.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.469+0000 7f8772ffd700 1 --2- 172.21.15.114:0/1460201478 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8760065720 0x7f8760067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:38:04.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.469+0000 7f8779533700 1 -- 172.21.15.114:0/1460201478 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7f877406e3b0 con 0x7f8774144670 2023-10-18T12:38:04.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.469+0000 7f8772ffd700 1 --2- 172.21.15.114:0/1460201478 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8760065720 0x7f8760067be0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8764000f60 tx=0x7f8764007cb0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:38:04.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.673+0000 7f127b59e700 1 -- 172.21.15.114:0/3827693687 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f127c0b8bb0 con 0x7f127c14a6c0 2023-10-18T12:38:04.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.673+0000 7f12737fe700 1 -- 172.21.15.114:0/3827693687 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4889 (secure 0 0 0) 0x7f12740551a0 con 0x7f127c14a6c0 2023-10-18T12:38:04.680 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:38:04.681 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2034957068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2034957068},{"type":"v1","addr":"172.21.15.172:6836","nonce":2034957068}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5039,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4215710360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4215710360},{"type":"v1","addr":"172.21.15.172:6837","nonce":4215710360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2387835210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2387835210},{"type":"v1","addr":"172.21.15.114:6833","nonce":2387835210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T12:21:14.159069+0000","modified":"2023-10-18T12:29:23.762500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":126,"addr":"172.21.15.114:6835/1284474820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1284474820},{"type":"v1","addr":"172.21.15.114:6835","nonce":1284474820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-18T12:38:04.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.681+0000 7f127b59e700 1 -- 172.21.15.114:0/3827693687 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f125c0656f0 msgr2=0x7f125c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:38:04.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.681+0000 7f127b59e700 1 --2- 172.21.15.114:0/3827693687 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f125c0656f0 0x7f125c067bb0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f126c0017c0 tx=0x7f126c009040 comp rx=0 tx=0).stop 2023-10-18T12:38:04.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.681+0000 7f127b59e700 1 -- 172.21.15.114:0/3827693687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f127c14a6c0 msgr2=0x7f127c14ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:38:04.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.681+0000 7f127b59e700 1 --2- 172.21.15.114:0/3827693687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f127c14a6c0 0x7f127c14ab40 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f1274014000 tx=0x7f1274004b60 comp rx=0 tx=0).stop 2023-10-18T12:38:04.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.681+0000 7f127b59e700 1 -- 172.21.15.114:0/3827693687 shutdown_connections 2023-10-18T12:38:04.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.681+0000 7f127b59e700 1 --2- 172.21.15.114:0/3827693687 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f125c0656f0 0x7f125c067bb0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:38:04.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.681+0000 7f127b59e700 1 --2- 172.21.15.114:0/3827693687 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f127c158f20 0x7f127c15bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:38:04.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.681+0000 7f127b59e700 1 --2- 172.21.15.114:0/3827693687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f127c14a6c0 0x7f127c14ab40 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:38:04.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.681+0000 7f127b59e700 1 --2- 172.21.15.114:0/3827693687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1268004db0 0x7f127c15eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:38:04.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.681+0000 7f127b59e700 1 -- 172.21.15.114:0/3827693687 >> 172.21.15.114:0/3827693687 conn(0x7f127c0cf530 msgr2=0x7f127c0b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:38:04.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.681+0000 7f127b59e700 1 -- 172.21.15.114:0/3827693687 shutdown_connections 2023-10-18T12:38:04.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:04.681+0000 7f127b59e700 1 -- 172.21.15.114:0/3827693687 wait complete. 2023-10-18T12:38:04.688 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 20 2023-10-18T12:38:04.707 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-10-18T12:38:04.895 INFO:teuthology.orchestra.run.smithi114.stdout:[{"id":5162,"entity":{"name":{"type":"client","num":5162},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":989916161}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":1000.909935622,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.099005115563016027,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":3,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5162 v1:192.168.0.1:0/989916161","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi172","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}}] 2023-10-18T12:38:04.896 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "1", "hostname": "smithi172", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 989916161, "type": "v1" }, "name": { "num": 5162, "type": "client" } }, "id": 5162, "inst": "client.5162 v1:192.168.0.1:0/989916161", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 3, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.09900511556301603 }, "state": "open", "uptime": 1000.909935622 } ] 2023-10-18T12:38:04.997 DEBUG:tasks.ceph_test_case:No log hits yet, waiting... 2023-10-18T12:38:05.400 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:38:05.407 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:38:35.485 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:38:35.492 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:38:40.024 ERROR:tasks.ceph_test_case:Log output: 2023-10-18T12:38:40.024 DEBUG:tasks.cephfs.test_client_recovery:Expected log message found: 'Health check cleared: MDS_CLIENTS_LAGGY', retrying 2023-10-18T12:38:41.025 DEBUG:teuthology.orchestra.run.smithi114:> sudo daemon-helper kill ceph --cluster ceph -w 2023-10-18T12:38:41.034 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T12:38:41.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.201+0000 7f0221fe8700 1 Processor -- start 2023-10-18T12:38:41.206 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.201+0000 7f0221fe8700 1 -- start start 2023-10-18T12:38:41.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.201+0000 7f0221fe8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f021c154040 0x7f021c0cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:38:41.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.201+0000 7f0221fe8700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f021c0cb8a0 0x7f021c06f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:38:41.207 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.201+0000 7f0221fe8700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f021c15e130 con 0x7f021c06e8a0 2023-10-18T12:38:41.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.201+0000 7f0221fe8700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f021c0cdfa0 con 0x7f021c0cb8a0 2023-10-18T12:38:41.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.201+0000 7f0221fe8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f021c0ce1b0 con 0x7f021c154040 2023-10-18T12:38:41.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.201+0000 7f0212ffd700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f021c06e8a0 0x7f021c0cb190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:38590/0 (socket says 172.21.15.114:38590) 2023-10-18T12:38:41.208 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.201+0000 7f0212ffd700 1 -- 172.21.15.114:0/3285078157 learned_addr learned my addr 172.21.15.114:0/3285078157 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:38:41.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.201+0000 7f021b7fe700 1 --2- 172.21.15.114:0/3285078157 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f021c154040 0x7f021c0cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:38:41.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.201+0000 7f021bfff700 1 --2- 172.21.15.114:0/3285078157 >> v2:172.21.15.172:3300/0 conn(0x7f021c0cb8a0 0x7f021c06f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:38:41.210 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.201+0000 7f021affd700 1 -- 172.21.15.114:0/3285078157 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4246165107 0 0) 0x7f021c15e130 con 0x7f021c06e8a0 2023-10-18T12:38:41.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.201+0000 7f021affd700 1 -- 172.21.15.114:0/3285078157 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02080035d0 con 0x7f021c06e8a0 2023-10-18T12:38:41.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.201+0000 7f021affd700 1 -- 172.21.15.114:0/3285078157 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2213754665 0 0) 0x7f02080035d0 con 0x7f021c06e8a0 2023-10-18T12:38:41.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.201+0000 7f021affd700 1 -- 172.21.15.114:0/3285078157 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f021c154040 msgr2=0x7f021c0cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:38:41.211 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.201+0000 7f021affd700 1 --2- 172.21.15.114:0/3285078157 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f021c154040 0x7f021c0cc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:38:41.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.201+0000 7f021affd700 1 -- 172.21.15.114:0/3285078157 >> v2:172.21.15.172:3300/0 conn(0x7f021c0cb8a0 msgr2=0x7f021c06f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:38:41.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.205+0000 7f021affd700 1 --2- 172.21.15.114:0/3285078157 >> v2:172.21.15.172:3300/0 conn(0x7f021c0cb8a0 0x7f021c06f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:38:41.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.205+0000 7f021affd700 1 -- 172.21.15.114:0/3285078157 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021c0ce490 con 0x7f021c06e8a0 2023-10-18T12:38:41.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.205+0000 7f021affd700 1 -- 172.21.15.114:0/3285078157 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3368469509 0 0) 0x7f020c001670 con 0x7f021c06e8a0 2023-10-18T12:38:41.212 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.205+0000 7f021affd700 1 -- 172.21.15.114:0/3285078157 >> v1:172.21.15.114:6789/0 conn(0x7f021c06e8a0 legacy=0x7f021c0cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:38:41.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.205+0000 7f021affd700 1 --2- 172.21.15.114:0/3285078157 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f021c154040 0x7f0208003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:38:41.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.205+0000 7f021affd700 1 --2- 172.21.15.114:0/3285078157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0208003fa0 0x7f0208004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:38:41.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.205+0000 7f021affd700 1 --2- 172.21.15.114:0/3285078157 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0208004db0 0x7f0208005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:38:41.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.205+0000 7f021affd700 1 -- 172.21.15.114:0/3285078157 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c0cdfa0 con 0x7f0208004db0 2023-10-18T12:38:41.213 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.205+0000 7f021affd700 1 -- 172.21.15.114:0/3285078157 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c0ce1b0 con 0x7f0208003fa0 2023-10-18T12:38:41.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.205+0000 7f021affd700 1 -- 172.21.15.114:0/3285078157 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f020800ba30 con 0x7f021c154040 2023-10-18T12:38:41.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.205+0000 7f021b7fe700 1 --2- 172.21.15.114:0/3285078157 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f021c154040 0x7f0208003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:38:41.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.205+0000 7f0212ffd700 1 --2- 172.21.15.114:0/3285078157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0208003fa0 0x7f0208004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:38:41.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.205+0000 7f021bfff700 1 --2- 172.21.15.114:0/3285078157 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0208004db0 0x7f0208005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:38:41.214 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.205+0000 7f021bfff700 1 -- 172.21.15.114:0/3285078157 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f021c154040 msgr2=0x7f0208003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:38:41.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.205+0000 7f021bfff700 1 --2- 172.21.15.114:0/3285078157 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f021c154040 0x7f0208003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:38:41.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.205+0000 7f021bfff700 1 -- 172.21.15.114:0/3285078157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0208003fa0 msgr2=0x7f0208004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:38:41.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.205+0000 7f021bfff700 1 --2- 172.21.15.114:0/3285078157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0208003fa0 0x7f0208004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:38:41.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.205+0000 7f021bfff700 1 -- 172.21.15.114:0/3285078157 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02080035d0 con 0x7f0208004db0 2023-10-18T12:38:41.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.205+0000 7f0212ffd700 1 --2- 172.21.15.114:0/3285078157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0208003fa0 0x7f0208004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:38:41.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.205+0000 7f021bfff700 1 --2- 172.21.15.114:0/3285078157 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0208004db0 0x7f0208005230 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f0214009fc0 tx=0x7f02080058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc6150cc607d62bf server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:38:41.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.205+0000 7f021affd700 1 -- 172.21.15.114:0/3285078157 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021400ebd0 con 0x7f0208004db0 2023-10-18T12:38:41.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.205+0000 7f021affd700 1 -- 172.21.15.114:0/3285078157 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021400f040 con 0x7f0208004db0 2023-10-18T12:38:41.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.205+0000 7f021affd700 1 -- 172.21.15.114:0/3285078157 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0214014480 con 0x7f0208004db0 2023-10-18T12:38:41.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.205+0000 7f0221fe8700 1 -- 172.21.15.114:0/3285078157 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0208004db0 msgr2=0x7f0208005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:38:41.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.205+0000 7f0221fe8700 1 --2- 172.21.15.114:0/3285078157 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0208004db0 0x7f0208005230 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f0214009fc0 tx=0x7f02080058a0 comp rx=0 tx=0).stop 2023-10-18T12:38:41.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.205+0000 7f021bfff700 1 -- 172.21.15.114:0/3285078157 reap_dead start 2023-10-18T12:38:41.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.205+0000 7f0221fe8700 1 -- 172.21.15.114:0/3285078157 shutdown_connections 2023-10-18T12:38:41.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.205+0000 7f0221fe8700 1 -- 172.21.15.114:0/3285078157 >> 172.21.15.114:0/3285078157 conn(0x7f021c06a340 msgr2=0x7f021c0b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:38:41.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.205+0000 7f0221fe8700 1 -- 172.21.15.114:0/3285078157 shutdown_connections 2023-10-18T12:38:41.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.205+0000 7f0221fe8700 1 -- 172.21.15.114:0/3285078157 wait complete. 2023-10-18T12:38:41.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.209+0000 7f0221fe8700 1 Processor -- start 2023-10-18T12:38:41.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.209+0000 7f0221fe8700 1 -- start start 2023-10-18T12:38:41.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.213+0000 7f0221fe8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0208004db0 0x7f021c152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:38:41.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.213+0000 7f0221fe8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f021c1f6640 0x7f021c0a9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:38:41.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.213+0000 7f0221fe8700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f021c155470 0x7f021c0ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:38:41.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.213+0000 7f0221fe8700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c1564f0 con 0x7f021c155470 2023-10-18T12:38:41.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.213+0000 7f0221fe8700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c155970 con 0x7f021c1f6640 2023-10-18T12:38:41.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.213+0000 7f0221fe8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f021c155c50 con 0x7f0208004db0 2023-10-18T12:38:41.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.213+0000 7f021bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f021c155470 0x7f021c0ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:38:41.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.213+0000 7f021bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f021c155470 0x7f021c0ae6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44296/0 (socket says 172.21.15.114:44296) 2023-10-18T12:38:41.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.213+0000 7f021bfff700 1 -- 172.21.15.114:0/2600620687 learned_addr learned my addr 172.21.15.114:0/2600620687 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:38:41.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.213+0000 7f0212ffd700 1 --2- 172.21.15.114:0/2600620687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f021c1f6640 0x7f021c0a9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:38:41.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.213+0000 7f021b7fe700 1 --2- 172.21.15.114:0/2600620687 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0208004db0 0x7f021c152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:38:41.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.213+0000 7f021bfff700 1 -- 172.21.15.114:0/2600620687 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0208004db0 msgr2=0x7f021c152360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:38:41.224 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.213+0000 7f021bfff700 1 --2- 172.21.15.114:0/2600620687 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0208004db0 0x7f021c152360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:38:41.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.213+0000 7f021bfff700 1 -- 172.21.15.114:0/2600620687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f021c1f6640 msgr2=0x7f021c0a9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:38:41.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.213+0000 7f021bfff700 1 --2- 172.21.15.114:0/2600620687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f021c1f6640 0x7f021c0a9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:38:41.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.213+0000 7f021bfff700 1 -- 172.21.15.114:0/2600620687 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021c155f30 con 0x7f021c155470 2023-10-18T12:38:41.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.213+0000 7f021bfff700 1 --2- 172.21.15.114:0/2600620687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f021c155470 0x7f021c0ae6b0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f021400b010 tx=0x7f0214009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:38:41.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.213+0000 7f0218ff9700 1 -- 172.21.15.114:0/2600620687 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0214007000 con 0x7f021c155470 2023-10-18T12:38:41.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.213+0000 7f0218ff9700 1 -- 172.21.15.114:0/2600620687 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0214004450 con 0x7f021c155470 2023-10-18T12:38:41.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.213+0000 7f0218ff9700 1 -- 172.21.15.114:0/2600620687 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0214004800 con 0x7f021c155470 2023-10-18T12:38:41.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.213+0000 7f0221fe8700 1 -- 172.21.15.114:0/2600620687 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f021c156210 con 0x7f021c155470 2023-10-18T12:38:41.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.213+0000 7f0221fe8700 1 -- 172.21.15.114:0/2600620687 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f021c0a9540 con 0x7f021c155470 2023-10-18T12:38:41.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.217+0000 7f0221fe8700 1 -- 172.21.15.114:0/2600620687 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f021c072e60 con 0x7f021c155470 2023-10-18T12:38:41.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.217+0000 7f0218ff9700 1 -- 172.21.15.114:0/2600620687 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f0214024070 con 0x7f021c155470 2023-10-18T12:38:41.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.217+0000 7f0218ff9700 1 --2- 172.21.15.114:0/2600620687 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f01fc0656f0 0x7f01fc067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:38:41.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.217+0000 7f0218ff9700 1 -- 172.21.15.114:0/2600620687 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7f02140847d0 con 0x7f021c155470 2023-10-18T12:38:41.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.217+0000 7f021b7fe700 1 --2- 172.21.15.114:0/2600620687 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f01fc0656f0 0x7f01fc067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:38:41.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.221+0000 7f021b7fe700 1 --2- 172.21.15.114:0/2600620687 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f01fc0656f0 0x7f01fc067bb0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0204009c70 tx=0x7f0204009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:38:41.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.229+0000 7f0218ff9700 1 -- 172.21.15.114:0/2600620687 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f0214051f70 con 0x7f021c155470 2023-10-18T12:38:41.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.229+0000 7fd6ed538700 1 Processor -- start 2023-10-18T12:38:41.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.229+0000 7fd6ed538700 1 -- start start 2023-10-18T12:38:41.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.229+0000 7fd6ed538700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd6e80cce90 0x7fd6e8162240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:38:41.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.229+0000 7fd6ed538700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e80cc860 con 0x7fd6e80cb120 2023-10-18T12:38:41.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.229+0000 7fd6ed538700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e8161db0 con 0x7fd6e815ebc0 2023-10-18T12:38:41.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.229+0000 7fd6ed538700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6e81617a0 con 0x7fd6e80cce90 2023-10-18T12:38:41.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.233+0000 7fd6de7fc700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd6e80cce90 0x7fd6e8162240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:38:41.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.233+0000 7fd6e7fff700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd6e80cb120 0x7fd6e80cb540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:38600/0 (socket says 172.21.15.114:38600) 2023-10-18T12:38:41.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.233+0000 7fd6e7fff700 1 -- 172.21.15.114:0/246605726 learned_addr learned my addr 172.21.15.114:0/246605726 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:38:41.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.233+0000 7fd6de7fc700 1 -- 172.21.15.114:0/246605726 >> v1:172.21.15.172:6789/0 conn(0x7fd6e815ebc0 legacy=0x7fd6e8165690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:38:41.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.233+0000 7fd6de7fc700 1 -- 172.21.15.114:0/246605726 >> v1:172.21.15.114:6789/0 conn(0x7fd6e80cb120 legacy=0x7fd6e80cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:38:41.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.233+0000 7fd6de7fc700 1 -- 172.21.15.114:0/246605726 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e80cd330 con 0x7fd6e80cce90 2023-10-18T12:38:41.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.233+0000 7fd6de7fc700 1 --2- 172.21.15.114:0/246605726 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6e80cce90 0x7fd6e8162240 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0009850 tx=0x7fd6d0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df02c75162cfc74d server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:38:41.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.233+0000 7fd6e67fc700 1 -- 172.21.15.114:0/246605726 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d0011830 con 0x7fd6e80cce90 2023-10-18T12:38:41.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.233+0000 7fd6e67fc700 1 -- 172.21.15.114:0/246605726 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d0011990 con 0x7fd6e80cce90 2023-10-18T12:38:41.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.233+0000 7fd6e67fc700 1 -- 172.21.15.114:0/246605726 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d0011d20 con 0x7fd6e80cce90 2023-10-18T12:38:41.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.233+0000 7fd6ed538700 1 -- 172.21.15.114:0/246605726 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6e80cce90 msgr2=0x7fd6e8162240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:38:41.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.233+0000 7fd6ed538700 1 --2- 172.21.15.114:0/246605726 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6e80cce90 0x7fd6e8162240 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0009850 tx=0x7fd6d0009b60 comp rx=0 tx=0).stop 2023-10-18T12:38:41.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.233+0000 7fd6ed538700 1 -- 172.21.15.114:0/246605726 shutdown_connections 2023-10-18T12:38:41.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.233+0000 7fd6ed538700 1 --2- 172.21.15.114:0/246605726 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6e80cce90 0x7fd6e8162240 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:38:41.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.233+0000 7fd6ed538700 1 -- 172.21.15.114:0/246605726 >> 172.21.15.114:0/246605726 conn(0x7fd6e80b0650 msgr2=0x7fd6e80b0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:38:41.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.233+0000 7fd6ed538700 1 -- 172.21.15.114:0/246605726 shutdown_connections 2023-10-18T12:38:41.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.233+0000 7fd6ed538700 1 -- 172.21.15.114:0/246605726 wait complete. 2023-10-18T12:38:41.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.237+0000 7fd6ed538700 1 Processor -- start 2023-10-18T12:38:41.243 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.237+0000 7fd6ed538700 1 -- start start 2023-10-18T12:38:41.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.241+0000 7fd6ed538700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6e80cb120 0x7fd6e815aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:38:41.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.241+0000 7fd6ed538700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd6e80cce90 0x7fd6e80b4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:38:41.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.241+0000 7fd6ed538700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6e815ebc0 0x7fd6e80b4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:38:41.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.241+0000 7fd6ed538700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e815b030 con 0x7fd6e815ebc0 2023-10-18T12:38:41.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.241+0000 7fd6ed538700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e81fa060 con 0x7fd6e80cb120 2023-10-18T12:38:41.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.241+0000 7fd6ed538700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e81fa320 con 0x7fd6e80cce90 2023-10-18T12:38:41.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.241+0000 7fd6e7fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6e815ebc0 0x7fd6e80b4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:38:41.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.241+0000 7fd6e7fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6e815ebc0 0x7fd6e80b4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44310/0 (socket says 172.21.15.114:44310) 2023-10-18T12:38:41.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.241+0000 7fd6e7fff700 1 -- 172.21.15.114:0/3206873549 learned_addr learned my addr 172.21.15.114:0/3206873549 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:38:41.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.241+0000 7fd6de7fc700 1 --2- 172.21.15.114:0/3206873549 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd6e80cce90 0x7fd6e80b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:38:41.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.241+0000 7fd6e6ffd700 1 --2- 172.21.15.114:0/3206873549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6e80cb120 0x7fd6e815aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:38:41.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.241+0000 7fd6e7fff700 1 -- 172.21.15.114:0/3206873549 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd6e80cce90 msgr2=0x7fd6e80b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:38:41.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.241+0000 7fd6e7fff700 1 --2- 172.21.15.114:0/3206873549 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd6e80cce90 0x7fd6e80b4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:38:41.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.241+0000 7fd6e7fff700 1 -- 172.21.15.114:0/3206873549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6e80cb120 msgr2=0x7fd6e815aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:38:41.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.241+0000 7fd6e7fff700 1 --2- 172.21.15.114:0/3206873549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6e80cb120 0x7fd6e815aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:38:41.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.241+0000 7fd6e7fff700 1 -- 172.21.15.114:0/3206873549 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d00094b0 con 0x7fd6e815ebc0 2023-10-18T12:38:41.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.241+0000 7fd6e7fff700 1 --2- 172.21.15.114:0/3206873549 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6e815ebc0 0x7fd6e80b4780 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fd6e000cbc0 tx=0x7fd6e000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:38:41.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.241+0000 7fd6dffff700 1 -- 172.21.15.114:0/3206873549 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e0007480 con 0x7fd6e815ebc0 2023-10-18T12:38:41.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.241+0000 7fd6ed538700 1 -- 172.21.15.114:0/3206873549 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6e81fa600 con 0x7fd6e815ebc0 2023-10-18T12:38:41.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.241+0000 7fd6dffff700 1 -- 172.21.15.114:0/3206873549 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e00075e0 con 0x7fd6e815ebc0 2023-10-18T12:38:41.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.241+0000 7fd6ed538700 1 -- 172.21.15.114:0/3206873549 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6e81fabc0 con 0x7fd6e815ebc0 2023-10-18T12:38:41.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.241+0000 7fd6dffff700 1 -- 172.21.15.114:0/3206873549 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e0007950 con 0x7fd6e815ebc0 2023-10-18T12:38:41.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.245+0000 7fd6ed538700 1 -- 172.21.15.114:0/3206873549 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fd6cc0052f0 con 0x7fd6e815ebc0 2023-10-18T12:38:41.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.245+0000 7fd6dffff700 1 -- 172.21.15.114:0/3206873549 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fd6e0012400 con 0x7fd6e815ebc0 2023-10-18T12:38:41.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.245+0000 7fd6dffff700 1 --2- 172.21.15.114:0/3206873549 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd6c80656f0 0x7fd6c8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:38:41.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.245+0000 7fd6dffff700 1 -- 172.21.15.114:0/3206873549 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7fd6e00834f0 con 0x7fd6e815ebc0 2023-10-18T12:38:41.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.245+0000 7fd6dffff700 1 -- 172.21.15.114:0/3206873549 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+449 (secure 0 0 0) 0x7fd6e0083880 con 0x7fd6e815ebc0 2023-10-18T12:38:41.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.249+0000 7fd6e6ffd700 1 --2- 172.21.15.114:0/3206873549 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd6c80656f0 0x7fd6c8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:38:41.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.249+0000 7fd6ed538700 1 -- 172.21.15.114:0/3206873549 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7fd6cc0023e0 con 0x7fd6e815ebc0 2023-10-18T12:38:41.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.249+0000 7fd6e6ffd700 1 --2- 172.21.15.114:0/3206873549 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd6c80656f0 0x7fd6c8067bb0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd6e80a8700 tx=0x7fd6d8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:38:41.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.469+0000 7f0221fe8700 1 -- 172.21.15.114:0/2600620687 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f021c0b1160 con 0x7f021c155470 2023-10-18T12:38:41.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.469+0000 7f0218ff9700 1 -- 172.21.15.114:0/2600620687 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4889 (secure 0 0 0) 0x7f0214055590 con 0x7f021c155470 2023-10-18T12:38:41.474 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:38:41.474 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2034957068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2034957068},{"type":"v1","addr":"172.21.15.172:6836","nonce":2034957068}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5039,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4215710360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4215710360},{"type":"v1","addr":"172.21.15.172:6837","nonce":4215710360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2387835210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2387835210},{"type":"v1","addr":"172.21.15.114:6833","nonce":2387835210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T12:21:14.159069+0000","modified":"2023-10-18T12:29:23.762500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":126,"addr":"172.21.15.114:6835/1284474820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1284474820},{"type":"v1","addr":"172.21.15.114:6835","nonce":1284474820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-18T12:38:41.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.473+0000 7f0221fe8700 1 -- 172.21.15.114:0/2600620687 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f01fc0656f0 msgr2=0x7f01fc067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:38:41.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.473+0000 7f0221fe8700 1 --2- 172.21.15.114:0/2600620687 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f01fc0656f0 0x7f01fc067bb0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0204009c70 tx=0x7f0204009240 comp rx=0 tx=0).stop 2023-10-18T12:38:41.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.473+0000 7f0221fe8700 1 -- 172.21.15.114:0/2600620687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f021c155470 msgr2=0x7f021c0ae6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:38:41.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.473+0000 7f0221fe8700 1 --2- 172.21.15.114:0/2600620687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f021c155470 0x7f021c0ae6b0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f021400b010 tx=0x7f0214009750 comp rx=0 tx=0).stop 2023-10-18T12:38:41.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.473+0000 7f0221fe8700 1 -- 172.21.15.114:0/2600620687 shutdown_connections 2023-10-18T12:38:41.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.473+0000 7f0221fe8700 1 --2- 172.21.15.114:0/2600620687 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f01fc0656f0 0x7f01fc067bb0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:38:41.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.473+0000 7f0221fe8700 1 --2- 172.21.15.114:0/2600620687 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f021c155470 0x7f021c0ae6b0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:38:41.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.473+0000 7f0221fe8700 1 --2- 172.21.15.114:0/2600620687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f021c1f6640 0x7f021c0a9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:38:41.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.473+0000 7f0221fe8700 1 --2- 172.21.15.114:0/2600620687 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f0208004db0 0x7f021c152360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:38:41.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.473+0000 7f0221fe8700 1 -- 172.21.15.114:0/2600620687 >> 172.21.15.114:0/2600620687 conn(0x7f021c06a340 msgr2=0x7f021c0ab9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:38:41.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.473+0000 7f0221fe8700 1 -- 172.21.15.114:0/2600620687 shutdown_connections 2023-10-18T12:38:41.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:38:41.473+0000 7f0221fe8700 1 -- 172.21.15.114:0/2600620687 wait complete. 2023-10-18T12:38:41.480 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 20 2023-10-18T12:38:41.500 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-10-18T12:38:41.688 INFO:teuthology.orchestra.run.smithi114.stdout:[{"id":5162,"entity":{"name":{"type":"client","num":5162},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":989916161}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":1037.7051906740001,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.090936042537868481,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":3,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5162 v1:192.168.0.1:0/989916161","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi172","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}}] 2023-10-18T12:38:41.689 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "1", "hostname": "smithi172", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 989916161, "type": "v1" }, "name": { "num": 5162, "type": "client" } }, "id": 5162, "inst": "client.5162 v1:192.168.0.1:0/989916161", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 3, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.09093604253786848 }, "state": "open", "uptime": 1037.705190674 } ] 2023-10-18T12:38:41.790 DEBUG:tasks.ceph_test_case:No log hits yet, waiting... 2023-10-18T12:39:05.581 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:39:05.590 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:39:16.817 ERROR:tasks.ceph_test_case:Log output: 2023-10-18T12:39:16.818 DEBUG:tasks.cephfs.test_client_recovery:Expected log message found: 'Health check cleared: MDS_CLIENTS_LAGGY', retrying 2023-10-18T12:39:17.820 DEBUG:teuthology.orchestra.run.smithi114:> sudo daemon-helper kill ceph --cluster ceph -w 2023-10-18T12:39:17.828 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T12:39:18.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.004+0000 7f687d9e6700 1 Processor -- start 2023-10-18T12:39:18.011 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.004+0000 7f687d9e6700 1 -- start start 2023-10-18T12:39:18.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.004+0000 7f687d9e6700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f687815bf00 0x7f68780cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:39:18.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.004+0000 7f687d9e6700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f68780b0f90 0x7f68780ce150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:39:18.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.004+0000 7f687d9e6700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68780cbc80 con 0x7f6878155420 2023-10-18T12:39:18.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.004+0000 7f687d9e6700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6878155800 con 0x7f687815bf00 2023-10-18T12:39:18.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.004+0000 7f687d9e6700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68780cb9a0 con 0x7f68780b0f90 2023-10-18T12:39:18.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.008+0000 7f686e7fc700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f687815bf00 0x7f68780cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:39:18.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.008+0000 7f68777fe700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f68780b0f90 0x7f68780ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:39:18.015 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.008+0000 7f6876ffd700 1 --1- >> v1:172.21.15.172:6789/0 conn(0x7f6878155420 0x7f68780cb150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.114:55114/0 (socket says 172.21.15.114:55114) 2023-10-18T12:39:18.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.008+0000 7f6876ffd700 1 -- 172.21.15.114:0/752518705 learned_addr learned my addr 172.21.15.114:0/752518705 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:39:18.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.008+0000 7f68777fe700 1 -- 172.21.15.114:0/752518705 >> v2:172.21.15.114:3300/0 conn(0x7f687815bf00 msgr2=0x7f68780cdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:39:18.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.008+0000 7f68777fe700 1 --2- 172.21.15.114:0/752518705 >> v2:172.21.15.114:3300/0 conn(0x7f687815bf00 0x7f68780cdc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:39:18.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.008+0000 7f68777fe700 1 -- 172.21.15.114:0/752518705 >> v1:172.21.15.172:6789/0 conn(0x7f6878155420 legacy=0x7f68780cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:39:18.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.008+0000 7f68777fe700 1 -- 172.21.15.114:0/752518705 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f687815b420 con 0x7f68780b0f90 2023-10-18T12:39:18.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.008+0000 7f68777fe700 1 --2- 172.21.15.114:0/752518705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f68780b0f90 0x7f68780ce150 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f687806cc90 tx=0x7f6870009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3586a60fdfe6ead4 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:39:18.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.008+0000 7f68767fc700 1 -- 172.21.15.114:0/752518705 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6870011830 con 0x7f68780b0f90 2023-10-18T12:39:18.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.008+0000 7f68767fc700 1 -- 172.21.15.114:0/752518705 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6870011990 con 0x7f68780b0f90 2023-10-18T12:39:18.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.008+0000 7f68767fc700 1 -- 172.21.15.114:0/752518705 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6870011d20 con 0x7f68780b0f90 2023-10-18T12:39:18.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.008+0000 7f687d9e6700 1 -- 172.21.15.114:0/752518705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f68780b0f90 msgr2=0x7f68780ce150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:39:18.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.008+0000 7f687d9e6700 1 --2- 172.21.15.114:0/752518705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f68780b0f90 0x7f68780ce150 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f687806cc90 tx=0x7f6870009b30 comp rx=0 tx=0).stop 2023-10-18T12:39:18.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.008+0000 7f687d9e6700 1 -- 172.21.15.114:0/752518705 shutdown_connections 2023-10-18T12:39:18.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.008+0000 7f687d9e6700 1 --2- 172.21.15.114:0/752518705 >> v2:172.21.15.114:3300/0 conn(0x7f687815bf00 0x7f68780cdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:39:18.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.008+0000 7f687d9e6700 1 --2- 172.21.15.114:0/752518705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f68780b0f90 0x7f68780ce150 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:39:18.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.008+0000 7f687d9e6700 1 -- 172.21.15.114:0/752518705 >> 172.21.15.114:0/752518705 conn(0x7f687806a340 msgr2=0x7f68780b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:39:18.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.008+0000 7f687d9e6700 1 -- 172.21.15.114:0/752518705 shutdown_connections 2023-10-18T12:39:18.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.008+0000 7f687d9e6700 1 -- 172.21.15.114:0/752518705 wait complete. 2023-10-18T12:39:18.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.012+0000 7f687d9e6700 1 Processor -- start 2023-10-18T12:39:18.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.012+0000 7f687d9e6700 1 -- start start 2023-10-18T12:39:18.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.016+0000 7f687d9e6700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68780b0f90 0x7f687813cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:39:18.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.016+0000 7f687d9e6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6878155420 0x7f68780b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:39:18.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.016+0000 7f687d9e6700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f687815bf00 0x7f6878159d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:39:18.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.016+0000 7f687d9e6700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68780b2720 con 0x7f68780b0f90 2023-10-18T12:39:18.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.016+0000 7f687d9e6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68780b31b0 con 0x7f6878155420 2023-10-18T12:39:18.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.016+0000 7f687d9e6700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68780b2ed0 con 0x7f687815bf00 2023-10-18T12:39:18.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.016+0000 7f6876ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68780b0f90 0x7f687813cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:39:18.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.016+0000 7f6876ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68780b0f90 0x7f687813cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41096/0 (socket says 172.21.15.114:41096) 2023-10-18T12:39:18.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.016+0000 7f6876ffd700 1 -- 172.21.15.114:0/33677338 learned_addr learned my addr 172.21.15.114:0/33677338 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:39:18.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.016+0000 7f686e7fc700 1 --2- 172.21.15.114:0/33677338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6878155420 0x7f68780b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:39:18.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.016+0000 7f68777fe700 1 --2- 172.21.15.114:0/33677338 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f687815bf00 0x7f6878159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:39:18.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.016+0000 7f6876ffd700 1 -- 172.21.15.114:0/33677338 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f687815bf00 msgr2=0x7f6878159d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:39:18.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.016+0000 7f6876ffd700 1 --2- 172.21.15.114:0/33677338 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f687815bf00 0x7f6878159d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:39:18.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.016+0000 7f6876ffd700 1 -- 172.21.15.114:0/33677338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6878155420 msgr2=0x7f68780b21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:39:18.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.016+0000 7f6876ffd700 1 --2- 172.21.15.114:0/33677338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6878155420 0x7f68780b21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:39:18.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.016+0000 7f6876ffd700 1 -- 172.21.15.114:0/33677338 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68700094b0 con 0x7f68780b0f90 2023-10-18T12:39:18.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.016+0000 7f6876ffd700 1 --2- 172.21.15.114:0/33677338 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68780b0f90 0x7f687813cd00 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f686800c700 tx=0x7f686800cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:39:18.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.016+0000 7f6874ff9700 1 -- 172.21.15.114:0/33677338 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6868005d90 con 0x7f68780b0f90 2023-10-18T12:39:18.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.016+0000 7f6874ff9700 1 -- 172.21.15.114:0/33677338 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68680070d0 con 0x7f68780b0f90 2023-10-18T12:39:18.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.016+0000 7f6874ff9700 1 -- 172.21.15.114:0/33677338 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6868007440 con 0x7f68780b0f90 2023-10-18T12:39:18.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.016+0000 7f687d9e6700 1 -- 172.21.15.114:0/33677338 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f687813c220 con 0x7f68780b0f90 2023-10-18T12:39:18.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.016+0000 7f687d9e6700 1 -- 172.21.15.114:0/33677338 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f687813c7e0 con 0x7f68780b0f90 2023-10-18T12:39:18.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.020+0000 7f687d9e6700 1 -- 172.21.15.114:0/33677338 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6878072e60 con 0x7f68780b0f90 2023-10-18T12:39:18.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.020+0000 7f6874ff9700 1 -- 172.21.15.114:0/33677338 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f68680075a0 con 0x7f68780b0f90 2023-10-18T12:39:18.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.020+0000 7f6874ff9700 1 --2- 172.21.15.114:0/33677338 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f68580656f0 0x7f6858067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:39:18.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.020+0000 7f6874ff9700 1 -- 172.21.15.114:0/33677338 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7f6868082530 con 0x7f68780b0f90 2023-10-18T12:39:18.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.024+0000 7f686e7fc700 1 --2- 172.21.15.114:0/33677338 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f68580656f0 0x7f6858067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:39:18.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.024+0000 7f686e7fc700 1 --2- 172.21.15.114:0/33677338 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f68580656f0 0x7f6858067bb0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6878141470 tx=0x7f686000b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:39:18.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.028+0000 7f6874ff9700 1 -- 172.21.15.114:0/33677338 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f686804fd80 con 0x7f68780b0f90 2023-10-18T12:39:18.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.056+0000 7fb0add24700 1 Processor -- start 2023-10-18T12:39:18.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.056+0000 7fb0add24700 1 -- start start 2023-10-18T12:39:18.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.056+0000 7fb0add24700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb0a80ce170 0x7fb0a80b3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:39:18.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.056+0000 7fb0add24700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb0a80ad750 0x7fb0a80b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:39:18.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.056+0000 7fb0add24700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0a80cadf0 con 0x7fb0a8159a40 2023-10-18T12:39:18.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.056+0000 7fb0add24700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0a80adcc0 con 0x7fb0a80ce170 2023-10-18T12:39:18.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.056+0000 7fb0add24700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0a80ca220 con 0x7fb0a80ad750 2023-10-18T12:39:18.066 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.060+0000 7fb0a7fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb0a80ce170 0x7fb0a80b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:39:18.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.060+0000 7fb0a7fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb0a80ce170 0x7fb0a80b3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41112/0 (socket says 172.21.15.114:41112) 2023-10-18T12:39:18.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.060+0000 7fb0a7fff700 1 -- 172.21.15.114:0/2103823537 learned_addr learned my addr 172.21.15.114:0/2103823537 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:39:18.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.060+0000 7fb0ad523700 1 --2- 172.21.15.114:0/2103823537 >> v2:172.21.15.172:3300/0 conn(0x7fb0a80ad750 0x7fb0a80b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:39:18.067 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.060+0000 7fb0a7fff700 1 -- 172.21.15.114:0/2103823537 >> v2:172.21.15.172:3300/0 conn(0x7fb0a80ad750 msgr2=0x7fb0a80b3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:39:18.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.060+0000 7fb0a7fff700 1 --2- 172.21.15.114:0/2103823537 >> v2:172.21.15.172:3300/0 conn(0x7fb0a80ad750 0x7fb0a80b3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:39:18.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.060+0000 7fb0a7fff700 1 -- 172.21.15.114:0/2103823537 >> v1:172.21.15.172:6789/0 conn(0x7fb0a8159a40 legacy=0x7fb0a80cda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:39:18.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.060+0000 7fb0a7fff700 1 -- 172.21.15.114:0/2103823537 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a80ca4c0 con 0x7fb0a80ce170 2023-10-18T12:39:18.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.060+0000 7fb0a7fff700 1 --2- 172.21.15.114:0/2103823537 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0a80ce170 0x7fb0a80b3620 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fb0a80b10a0 tx=0x7fb09400be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4fcaa5dfc3a0f99 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:39:18.068 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.060+0000 7fb0a77fe700 1 -- 172.21.15.114:0/2103823537 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09400dd90 con 0x7fb0a80ce170 2023-10-18T12:39:18.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.060+0000 7fb0a77fe700 1 -- 172.21.15.114:0/2103823537 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb094010470 con 0x7fb0a80ce170 2023-10-18T12:39:18.069 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.060+0000 7fb0a77fe700 1 -- 172.21.15.114:0/2103823537 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb094010800 con 0x7fb0a80ce170 2023-10-18T12:39:18.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.060+0000 7fb0add24700 1 -- 172.21.15.114:0/2103823537 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0a80ce170 msgr2=0x7fb0a80b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:39:18.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.060+0000 7fb0add24700 1 --2- 172.21.15.114:0/2103823537 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0a80ce170 0x7fb0a80b3620 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fb0a80b10a0 tx=0x7fb09400be90 comp rx=0 tx=0).stop 2023-10-18T12:39:18.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.060+0000 7fb0add24700 1 -- 172.21.15.114:0/2103823537 shutdown_connections 2023-10-18T12:39:18.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.060+0000 7fb0add24700 1 --2- 172.21.15.114:0/2103823537 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0a80ce170 0x7fb0a80b3620 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:39:18.070 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.060+0000 7fb0add24700 1 --2- 172.21.15.114:0/2103823537 >> v2:172.21.15.172:3300/0 conn(0x7fb0a80ad750 0x7fb0a80b3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:39:18.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.060+0000 7fb0add24700 1 -- 172.21.15.114:0/2103823537 >> 172.21.15.114:0/2103823537 conn(0x7fb0a80b02a0 msgr2=0x7fb0a80b06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:39:18.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.060+0000 7fb0add24700 1 -- 172.21.15.114:0/2103823537 shutdown_connections 2023-10-18T12:39:18.071 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.060+0000 7fb0add24700 1 -- 172.21.15.114:0/2103823537 wait complete. 2023-10-18T12:39:18.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.064+0000 7fb0add24700 1 Processor -- start 2023-10-18T12:39:18.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.064+0000 7fb0add24700 1 -- start start 2023-10-18T12:39:18.072 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.064+0000 7fb0add24700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0a80ad750 0x7fb0a8156e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:39:18.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.064+0000 7fb0add24700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0a80ce170 0x7fb0a80b3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:39:18.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.064+0000 7fb0add24700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb0a8159a40 0x7fb0a81e4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:39:18.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.064+0000 7fb0add24700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a8157380 con 0x7fb0a80ce170 2023-10-18T12:39:18.073 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.064+0000 7fb0add24700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a81f6040 con 0x7fb0a80ad750 2023-10-18T12:39:18.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.064+0000 7fb0add24700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a80b14b0 con 0x7fb0a8159a40 2023-10-18T12:39:18.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.068+0000 7fb0a7fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0a80ce170 0x7fb0a80b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:39:18.075 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.068+0000 7fb0a7fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0a80ce170 0x7fb0a80b3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41120/0 (socket says 172.21.15.114:41120) 2023-10-18T12:39:18.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.068+0000 7fb0a7fff700 1 -- 172.21.15.114:0/2014135435 learned_addr learned my addr 172.21.15.114:0/2014135435 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:39:18.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.068+0000 7fb0acd22700 1 --2- 172.21.15.114:0/2014135435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0a80ad750 0x7fb0a8156e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:39:18.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.068+0000 7fb0ad523700 1 --2- 172.21.15.114:0/2014135435 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb0a8159a40 0x7fb0a81e4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:39:18.076 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.068+0000 7fb0a7fff700 1 -- 172.21.15.114:0/2014135435 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb0a8159a40 msgr2=0x7fb0a81e4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:39:18.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.068+0000 7fb0a7fff700 1 --2- 172.21.15.114:0/2014135435 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb0a8159a40 0x7fb0a81e4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:39:18.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.068+0000 7fb0a7fff700 1 -- 172.21.15.114:0/2014135435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0a80ad750 msgr2=0x7fb0a8156e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:39:18.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.068+0000 7fb0a7fff700 1 --2- 172.21.15.114:0/2014135435 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0a80ad750 0x7fb0a8156e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:39:18.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.068+0000 7fb0a7fff700 1 -- 172.21.15.114:0/2014135435 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb09400b810 con 0x7fb0a80ce170 2023-10-18T12:39:18.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.068+0000 7fb0a7fff700 1 --2- 172.21.15.114:0/2014135435 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb0a80ce170 0x7fb0a80b3010 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fb094000c00 tx=0x7fb094004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:39:18.077 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.068+0000 7fb0a57fa700 1 -- 172.21.15.114:0/2014135435 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb094003c10 con 0x7fb0a80ce170 2023-10-18T12:39:18.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.068+0000 7fb0a57fa700 1 -- 172.21.15.114:0/2014135435 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb094003d70 con 0x7fb0a80ce170 2023-10-18T12:39:18.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.068+0000 7fb0add24700 1 -- 172.21.15.114:0/2014135435 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0a80b1790 con 0x7fb0a80ce170 2023-10-18T12:39:18.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.068+0000 7fb0a57fa700 1 -- 172.21.15.114:0/2014135435 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb094010820 con 0x7fb0a80ce170 2023-10-18T12:39:18.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.068+0000 7fb0add24700 1 -- 172.21.15.114:0/2014135435 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0a80b1d50 con 0x7fb0a80ce170 2023-10-18T12:39:18.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.068+0000 7fb0add24700 1 -- 172.21.15.114:0/2014135435 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fb0a80b1f40 con 0x7fb0a80ce170 2023-10-18T12:39:18.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.072+0000 7fb0a57fa700 1 -- 172.21.15.114:0/2014135435 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fb094019400 con 0x7fb0a80ce170 2023-10-18T12:39:18.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.072+0000 7fb0a57fa700 1 --2- 172.21.15.114:0/2014135435 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb08c0656f0 0x7fb08c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:39:18.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.072+0000 7fb0a57fa700 1 -- 172.21.15.114:0/2014135435 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7fb094084920 con 0x7fb0a80ce170 2023-10-18T12:39:18.080 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.072+0000 7fb0a57fa700 1 -- 172.21.15.114:0/2014135435 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+449 (secure 0 0 0) 0x7fb094089240 con 0x7fb0a80ce170 2023-10-18T12:39:18.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.072+0000 7fb0acd22700 1 --2- 172.21.15.114:0/2014135435 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb08c0656f0 0x7fb08c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:39:18.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.072+0000 7fb0add24700 1 -- 172.21.15.114:0/2014135435 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7fb0a8072e60 con 0x7fb0a80ce170 2023-10-18T12:39:18.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.072+0000 7fb0acd22700 1 --2- 172.21.15.114:0/2014135435 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb08c0656f0 0x7fb08c067bb0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb09c000f60 tx=0x7fb09c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:39:18.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.236+0000 7f687d9e6700 1 -- 172.21.15.114:0/33677338 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f687806e4c0 con 0x7f68780b0f90 2023-10-18T12:39:18.241 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.236+0000 7f6874ff9700 1 -- 172.21.15.114:0/33677338 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4889 (secure 0 0 0) 0x7f68680533a0 con 0x7f68780b0f90 2023-10-18T12:39:18.242 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:39:18.242 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2034957068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2034957068},{"type":"v1","addr":"172.21.15.172:6836","nonce":2034957068}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5039,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4215710360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4215710360},{"type":"v1","addr":"172.21.15.172:6837","nonce":4215710360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2387835210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2387835210},{"type":"v1","addr":"172.21.15.114:6833","nonce":2387835210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T12:21:14.159069+0000","modified":"2023-10-18T12:29:23.762500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":126,"addr":"172.21.15.114:6835/1284474820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1284474820},{"type":"v1","addr":"172.21.15.114:6835","nonce":1284474820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-18T12:39:18.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.236+0000 7f687d9e6700 1 -- 172.21.15.114:0/33677338 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f68580656f0 msgr2=0x7f6858067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:39:18.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.236+0000 7f687d9e6700 1 --2- 172.21.15.114:0/33677338 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f68580656f0 0x7f6858067bb0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6878141470 tx=0x7f686000b040 comp rx=0 tx=0).stop 2023-10-18T12:39:18.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.236+0000 7f687d9e6700 1 -- 172.21.15.114:0/33677338 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68780b0f90 msgr2=0x7f687813cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:39:18.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.236+0000 7f687d9e6700 1 --2- 172.21.15.114:0/33677338 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68780b0f90 0x7f687813cd00 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f686800c700 tx=0x7f686800cac0 comp rx=0 tx=0).stop 2023-10-18T12:39:18.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.240+0000 7f687d9e6700 1 -- 172.21.15.114:0/33677338 shutdown_connections 2023-10-18T12:39:18.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.240+0000 7f687d9e6700 1 --2- 172.21.15.114:0/33677338 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f68580656f0 0x7f6858067bb0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:39:18.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.240+0000 7f687d9e6700 1 --2- 172.21.15.114:0/33677338 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f687815bf00 0x7f6878159d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:39:18.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.240+0000 7f687d9e6700 1 --2- 172.21.15.114:0/33677338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6878155420 0x7f68780b21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:39:18.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.240+0000 7f687d9e6700 1 --2- 172.21.15.114:0/33677338 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f68780b0f90 0x7f687813cd00 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:39:18.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.240+0000 7f687d9e6700 1 -- 172.21.15.114:0/33677338 >> 172.21.15.114:0/33677338 conn(0x7f687806a340 msgr2=0x7f687815c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:39:18.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.240+0000 7f687d9e6700 1 -- 172.21.15.114:0/33677338 shutdown_connections 2023-10-18T12:39:18.246 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:18.240+0000 7f687d9e6700 1 -- 172.21.15.114:0/33677338 wait complete. 2023-10-18T12:39:18.247 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 20 2023-10-18T12:39:18.265 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-10-18T12:39:18.444 INFO:teuthology.orchestra.run.smithi114.stdout:[{"id":5162,"entity":{"name":{"type":"client","num":5162},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":989916161}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":1074.4564352089999,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.083533105393190185,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":3,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5162 v1:192.168.0.1:0/989916161","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi172","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}}] 2023-10-18T12:39:18.445 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "1", "hostname": "smithi172", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 989916161, "type": "v1" }, "name": { "num": 5162, "type": "client" } }, "id": 5162, "inst": "client.5162 v1:192.168.0.1:0/989916161", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 3, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.08353310539319019 }, "state": "open", "uptime": 1074.456435209 } ] 2023-10-18T12:39:18.547 DEBUG:tasks.ceph_test_case:No log hits yet, waiting... 2023-10-18T12:39:35.662 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:39:35.670 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:39:53.572 ERROR:tasks.ceph_test_case:Log output: 2023-10-18T12:39:53.573 DEBUG:tasks.cephfs.test_client_recovery:Expected log message found: 'Health check cleared: MDS_CLIENTS_LAGGY', retrying 2023-10-18T12:39:54.574 DEBUG:teuthology.orchestra.run.smithi114:> sudo daemon-helper kill ceph --cluster ceph -w 2023-10-18T12:39:54.582 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T12:39:54.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.743+0000 7fc669c19700 1 Processor -- start 2023-10-18T12:39:54.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.743+0000 7fc669c19700 1 -- start start 2023-10-18T12:39:54.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.747+0000 7fc669c19700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6640cc190 0x7fc6640b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:39:54.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.747+0000 7fc669c19700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc66415e000 con 0x7fc6640cdd90 2023-10-18T12:39:54.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.747+0000 7fc669c19700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6640ce170 con 0x7fc6640b4140 2023-10-18T12:39:54.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.747+0000 7fc669c19700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6640b45d0 con 0x7fc6640cc190 2023-10-18T12:39:54.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.747+0000 7fc668c17700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc6640cdd90 0x7fc66406d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:59144/0 (socket says 172.21.15.114:59144) 2023-10-18T12:39:54.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.747+0000 7fc668c17700 1 -- 172.21.15.114:0/3791195032 learned_addr learned my addr 172.21.15.114:0/3791195032 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:39:54.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.747+0000 7fc65bfff700 1 --2- 172.21.15.114:0/3791195032 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6640cc190 0x7fc6640b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:39:54.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.747+0000 7fc65b7fe700 1 -- 172.21.15.114:0/3791195032 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3988186545 0 0) 0x7fc66415e000 con 0x7fc6640cdd90 2023-10-18T12:39:54.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.747+0000 7fc65b7fe700 1 -- 172.21.15.114:0/3791195032 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc64c0035d0 con 0x7fc6640cdd90 2023-10-18T12:39:54.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.751+0000 7fc65bfff700 1 -- 172.21.15.114:0/3791195032 >> v1:172.21.15.172:6789/0 conn(0x7fc6640b4140 legacy=0x7fc6640ca0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:39:54.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.751+0000 7fc65bfff700 1 -- 172.21.15.114:0/3791195032 >> v1:172.21.15.114:6789/0 conn(0x7fc6640cdd90 legacy=0x7fc66406d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:39:54.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.751+0000 7fc65bfff700 1 -- 172.21.15.114:0/3791195032 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc66415d3f0 con 0x7fc6640cc190 2023-10-18T12:39:54.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.751+0000 7fc65bfff700 1 --2- 172.21.15.114:0/3791195032 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6640cc190 0x7fc6640b3c00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc654009880 tx=0x7fc654009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64e2768b0c2114e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:39:54.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.751+0000 7fc65b7fe700 1 -- 172.21.15.114:0/3791195032 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc654011830 con 0x7fc6640cc190 2023-10-18T12:39:54.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.751+0000 7fc65b7fe700 1 -- 172.21.15.114:0/3791195032 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc654011990 con 0x7fc6640cc190 2023-10-18T12:39:54.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.751+0000 7fc65b7fe700 1 -- 172.21.15.114:0/3791195032 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc654011d20 con 0x7fc6640cc190 2023-10-18T12:39:54.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.751+0000 7fc669c19700 1 -- 172.21.15.114:0/3791195032 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6640cc190 msgr2=0x7fc6640b3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:39:54.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.751+0000 7fc669c19700 1 --2- 172.21.15.114:0/3791195032 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6640cc190 0x7fc6640b3c00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc654009880 tx=0x7fc654009b90 comp rx=0 tx=0).stop 2023-10-18T12:39:54.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.751+0000 7fc669c19700 1 -- 172.21.15.114:0/3791195032 shutdown_connections 2023-10-18T12:39:54.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.751+0000 7fc669c19700 1 --2- 172.21.15.114:0/3791195032 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6640cc190 0x7fc6640b3c00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:39:54.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.751+0000 7fc669c19700 1 -- 172.21.15.114:0/3791195032 >> 172.21.15.114:0/3791195032 conn(0x7fc6640ce5c0 msgr2=0x7fc6640ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:39:54.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.751+0000 7fc669c19700 1 -- 172.21.15.114:0/3791195032 shutdown_connections 2023-10-18T12:39:54.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.751+0000 7fc669c19700 1 -- 172.21.15.114:0/3791195032 wait complete. 2023-10-18T12:39:54.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.755+0000 7fc669c19700 1 Processor -- start 2023-10-18T12:39:54.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.755+0000 7fc669c19700 1 -- start start 2023-10-18T12:39:54.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.755+0000 7fc669c19700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6640b4140 0x7fc6640c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:39:54.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.755+0000 7fc669c19700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6640cc190 0x7fc6641f1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:39:54.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.755+0000 7fc669c19700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6640cdd90 0x7fc6640b2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:39:54.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.755+0000 7fc669c19700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6640b2a80 con 0x7fc6640b4140 2023-10-18T12:39:54.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.755+0000 7fc669c19700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6640b2d60 con 0x7fc6640cc190 2023-10-18T12:39:54.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.755+0000 7fc669c19700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc66415e1b0 con 0x7fc6640cdd90 2023-10-18T12:39:54.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.755+0000 7fc668c17700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6640b4140 0x7fc6640c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:39:54.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.755+0000 7fc668c17700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6640b4140 0x7fc6640c5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48886/0 (socket says 172.21.15.114:48886) 2023-10-18T12:39:54.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.755+0000 7fc668c17700 1 -- 172.21.15.114:0/793134553 learned_addr learned my addr 172.21.15.114:0/793134553 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:39:54.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.755+0000 7fc669418700 1 --2- 172.21.15.114:0/793134553 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6640cdd90 0x7fc6640b2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:39:54.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.755+0000 7fc65bfff700 1 --2- 172.21.15.114:0/793134553 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6640cc190 0x7fc6641f1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:39:54.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.755+0000 7fc668c17700 1 -- 172.21.15.114:0/793134553 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6640cdd90 msgr2=0x7fc6640b2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:39:54.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.755+0000 7fc668c17700 1 --2- 172.21.15.114:0/793134553 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6640cdd90 0x7fc6640b2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:39:54.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.755+0000 7fc668c17700 1 -- 172.21.15.114:0/793134553 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6640cc190 msgr2=0x7fc6641f1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:39:54.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.755+0000 7fc668c17700 1 --2- 172.21.15.114:0/793134553 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6640cc190 0x7fc6641f1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:39:54.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.755+0000 7fc668c17700 1 -- 172.21.15.114:0/793134553 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6540094b0 con 0x7fc6640b4140 2023-10-18T12:39:54.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.755+0000 7fc668c17700 1 --2- 172.21.15.114:0/793134553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6640b4140 0x7fc6640c5d90 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fc66000c700 tx=0x7fc66000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:39:54.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.759+0000 7fc6597fa700 1 -- 172.21.15.114:0/793134553 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc660005d90 con 0x7fc6640b4140 2023-10-18T12:39:54.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.759+0000 7fc6597fa700 1 -- 172.21.15.114:0/793134553 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6600070d0 con 0x7fc6640b4140 2023-10-18T12:39:54.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.759+0000 7fc6597fa700 1 -- 172.21.15.114:0/793134553 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc660007480 con 0x7fc6640b4140 2023-10-18T12:39:54.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.759+0000 7fc669c19700 1 -- 172.21.15.114:0/793134553 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc66415e490 con 0x7fc6640b4140 2023-10-18T12:39:54.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.759+0000 7fc669c19700 1 -- 172.21.15.114:0/793134553 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6641f2080 con 0x7fc6640b4140 2023-10-18T12:39:54.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.759+0000 7fc669c19700 1 -- 172.21.15.114:0/793134553 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc66415d990 con 0x7fc6640b4140 2023-10-18T12:39:54.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.759+0000 7fc6597fa700 1 -- 172.21.15.114:0/793134553 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fc6600075e0 con 0x7fc6640b4140 2023-10-18T12:39:54.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.763+0000 7fc6597fa700 1 --2- 172.21.15.114:0/793134553 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc6500656f0 0x7fc650067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:39:54.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.763+0000 7fc6597fa700 1 -- 172.21.15.114:0/793134553 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7fc660082570 con 0x7fc6640b4140 2023-10-18T12:39:54.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.763+0000 7fc65bfff700 1 --2- 172.21.15.114:0/793134553 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc6500656f0 0x7fc650067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:39:54.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.763+0000 7fc65bfff700 1 --2- 172.21.15.114:0/793134553 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc6500656f0 0x7fc650067bb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc6540090b0 tx=0x7fc654010000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:39:54.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.767+0000 7fc6597fa700 1 -- 172.21.15.114:0/793134553 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fc66415d990 con 0x7fc6640b4140 2023-10-18T12:39:54.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.779+0000 7f4edb59e700 1 Processor -- start 2023-10-18T12:39:54.787 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.779+0000 7f4edb59e700 1 -- start start 2023-10-18T12:39:54.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.779+0000 7f4edb59e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f4edc15ab70 0x7f4edc0adcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:39:54.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.779+0000 7f4edb59e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4edc0ad760 0x7f4edc15f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:39:54.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.779+0000 7f4edb59e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4edc0c9430 0x7f4edc0c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:39:54.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.779+0000 7f4edb59e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4edc0c9e00 con 0x7f4edc0ad760 2023-10-18T12:39:54.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.779+0000 7f4edb59e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4edc070a30 con 0x7f4edc15ab70 2023-10-18T12:39:54.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.779+0000 7f4edb59e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc070cd0 con 0x7f4edc0c9430 2023-10-18T12:39:54.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.783+0000 7f4ed1d9b700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4edc0ad760 0x7f4edc15f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:39:54.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.783+0000 7f4ed1d9b700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4edc0ad760 0x7f4edc15f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48896/0 (socket says 172.21.15.114:48896) 2023-10-18T12:39:54.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.783+0000 7f4ed1d9b700 1 -- 172.21.15.114:0/483589115 learned_addr learned my addr 172.21.15.114:0/483589115 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:39:54.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.783+0000 7f4eda59c700 1 --2- 172.21.15.114:0/483589115 >> v2:172.21.15.172:3300/0 conn(0x7f4edc15ab70 0x7f4edc0adcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:39:54.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.783+0000 7f4edad9d700 1 --2- 172.21.15.114:0/483589115 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4edc0c9430 0x7f4edc0c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:39:54.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.783+0000 7f4ed1d9b700 1 -- 172.21.15.114:0/483589115 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4edc0c9430 msgr2=0x7f4edc0c98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:39:54.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.783+0000 7f4ed1d9b700 1 --2- 172.21.15.114:0/483589115 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4edc0c9430 0x7f4edc0c98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:39:54.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.783+0000 7f4ed1d9b700 1 -- 172.21.15.114:0/483589115 >> v2:172.21.15.172:3300/0 conn(0x7f4edc15ab70 msgr2=0x7f4edc0adcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:39:54.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.783+0000 7f4ed1d9b700 1 --2- 172.21.15.114:0/483589115 >> v2:172.21.15.172:3300/0 conn(0x7f4edc15ab70 0x7f4edc0adcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:39:54.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.783+0000 7f4ed1d9b700 1 -- 172.21.15.114:0/483589115 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4edc15e850 con 0x7f4edc0ad760 2023-10-18T12:39:54.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.783+0000 7f4eda59c700 1 --2- 172.21.15.114:0/483589115 >> v2:172.21.15.172:3300/0 conn(0x7f4edc15ab70 0x7f4edc0adcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:39:54.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.783+0000 7f4ed1d9b700 1 --2- 172.21.15.114:0/483589115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4edc0ad760 0x7f4edc15f330 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f4edc0b13a0 tx=0x7f4ec4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8d96f6832e07f1a server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:39:54.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.783+0000 7f4ed9d9b700 1 -- 172.21.15.114:0/483589115 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec4011830 con 0x7f4edc0ad760 2023-10-18T12:39:54.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.783+0000 7f4ed9d9b700 1 -- 172.21.15.114:0/483589115 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec4011990 con 0x7f4edc0ad760 2023-10-18T12:39:54.793 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.783+0000 7f4ed9d9b700 1 -- 172.21.15.114:0/483589115 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec4011d20 con 0x7f4edc0ad760 2023-10-18T12:39:54.794 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.783+0000 7f4edb59e700 1 -- 172.21.15.114:0/483589115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4edc0ad760 msgr2=0x7f4edc15f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:39:54.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.783+0000 7f4edb59e700 1 --2- 172.21.15.114:0/483589115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4edc0ad760 0x7f4edc15f330 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f4edc0b13a0 tx=0x7f4ec4009bf0 comp rx=0 tx=0).stop 2023-10-18T12:39:54.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.783+0000 7f4edb59e700 1 -- 172.21.15.114:0/483589115 shutdown_connections 2023-10-18T12:39:54.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.783+0000 7f4edb59e700 1 --2- 172.21.15.114:0/483589115 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4edc0c9430 0x7f4edc0c98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:39:54.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.783+0000 7f4edb59e700 1 --2- 172.21.15.114:0/483589115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4edc0ad760 0x7f4edc15f330 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:39:54.795 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.783+0000 7f4edb59e700 1 --2- 172.21.15.114:0/483589115 >> v2:172.21.15.172:3300/0 conn(0x7f4edc15ab70 0x7f4edc0adcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:39:54.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.783+0000 7f4edb59e700 1 -- 172.21.15.114:0/483589115 >> 172.21.15.114:0/483589115 conn(0x7f4edc0b02a0 msgr2=0x7f4edc0b06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:39:54.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.783+0000 7f4edb59e700 1 -- 172.21.15.114:0/483589115 shutdown_connections 2023-10-18T12:39:54.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.783+0000 7f4edb59e700 1 -- 172.21.15.114:0/483589115 wait complete. 2023-10-18T12:39:54.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.787+0000 7f4edb59e700 1 Processor -- start 2023-10-18T12:39:54.796 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.787+0000 7f4edb59e700 1 -- start start 2023-10-18T12:39:54.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.787+0000 7f4edb59e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4edc0ad760 0x7f4edc0ace70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:39:54.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.787+0000 7f4edb59e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4edc0c9430 0x7f4edc0c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:39:54.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.787+0000 7f4edb59e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4edc15ab70 0x7f4edc06ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:39:54.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.787+0000 7f4edb59e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc0c5880 con 0x7f4edc0c9430 2023-10-18T12:39:54.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.787+0000 7f4edb59e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc15ccd0 con 0x7f4edc0ad760 2023-10-18T12:39:54.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.787+0000 7f4edb59e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc0c5ad0 con 0x7f4edc15ab70 2023-10-18T12:39:54.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.787+0000 7f4ed1d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4edc0c9430 0x7f4edc0c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:39:54.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.787+0000 7f4ed1d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4edc0c9430 0x7f4edc0c65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:48898/0 (socket says 172.21.15.114:48898) 2023-10-18T12:39:54.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.787+0000 7f4ed1d9b700 1 -- 172.21.15.114:0/1156152234 learned_addr learned my addr 172.21.15.114:0/1156152234 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:39:54.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.787+0000 7f4eda59c700 1 --2- 172.21.15.114:0/1156152234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4edc0ad760 0x7f4edc0ace70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:39:54.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.787+0000 7f4edad9d700 1 --2- 172.21.15.114:0/1156152234 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4edc15ab70 0x7f4edc06ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:39:54.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.791+0000 7f4ed1d9b700 1 -- 172.21.15.114:0/1156152234 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4edc15ab70 msgr2=0x7f4edc06ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:39:54.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.791+0000 7f4ed1d9b700 1 --2- 172.21.15.114:0/1156152234 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4edc15ab70 0x7f4edc06ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:39:54.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.791+0000 7f4ed1d9b700 1 -- 172.21.15.114:0/1156152234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4edc0ad760 msgr2=0x7f4edc0ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:39:54.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.791+0000 7f4ed1d9b700 1 --2- 172.21.15.114:0/1156152234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4edc0ad760 0x7f4edc0ace70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:39:54.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.791+0000 7f4ed1d9b700 1 -- 172.21.15.114:0/1156152234 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec4009570 con 0x7f4edc0c9430 2023-10-18T12:39:54.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.791+0000 7f4ed1d9b700 1 --2- 172.21.15.114:0/1156152234 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4edc0c9430 0x7f4edc0c65b0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4014040 tx=0x7f4ec4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:39:54.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.791+0000 7f4ed37fe700 1 -- 172.21.15.114:0/1156152234 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec4004450 con 0x7f4edc0c9430 2023-10-18T12:39:54.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.791+0000 7f4ed37fe700 1 -- 172.21.15.114:0/1156152234 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec401e070 con 0x7f4edc0c9430 2023-10-18T12:39:54.802 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.791+0000 7f4edb59e700 1 -- 172.21.15.114:0/1156152234 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4edc0c5db0 con 0x7f4edc0c9430 2023-10-18T12:39:54.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.791+0000 7f4ed37fe700 1 -- 172.21.15.114:0/1156152234 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec4003900 con 0x7f4edc0c9430 2023-10-18T12:39:54.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.791+0000 7f4edb59e700 1 -- 172.21.15.114:0/1156152234 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4edc0ad3b0 con 0x7f4edc0c9430 2023-10-18T12:39:54.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.791+0000 7f4edb59e700 1 -- 172.21.15.114:0/1156152234 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f4edc072e60 con 0x7f4edc0c9430 2023-10-18T12:39:54.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.791+0000 7f4ed37fe700 1 -- 172.21.15.114:0/1156152234 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f4ec4003a60 con 0x7f4edc0c9430 2023-10-18T12:39:54.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.795+0000 7f4ed37fe700 1 --2- 172.21.15.114:0/1156152234 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4ebc0656f0 0x7f4ebc067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:39:54.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.795+0000 7f4ed37fe700 1 -- 172.21.15.114:0/1156152234 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7f4ec4083e40 con 0x7f4edc0c9430 2023-10-18T12:39:54.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.795+0000 7f4ed37fe700 1 -- 172.21.15.114:0/1156152234 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+450 (secure 0 0 0) 0x7f4ec4086340 con 0x7f4edc0c9430 2023-10-18T12:39:54.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.795+0000 7f4eda59c700 1 --2- 172.21.15.114:0/1156152234 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4ebc0656f0 0x7f4ebc067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:39:54.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.795+0000 7f4edb59e700 1 -- 172.21.15.114:0/1156152234 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7f4edc158fc0 con 0x7f4edc0c9430 2023-10-18T12:39:54.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.795+0000 7f4eda59c700 1 --2- 172.21.15.114:0/1156152234 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4ebc0656f0 0x7f4ebc067bb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc0099f0 tx=0x7f4ecc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:39:55.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.991+0000 7fc669c19700 1 -- 172.21.15.114:0/793134553 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc66415d990 con 0x7fc6640b4140 2023-10-18T12:39:55.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.995+0000 7fc6597fa700 1 -- 172.21.15.114:0/793134553 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4889 (secure 0 0 0) 0x7fc66415d990 con 0x7fc6640b4140 2023-10-18T12:39:55.002 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:39:55.002 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2034957068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2034957068},{"type":"v1","addr":"172.21.15.172:6836","nonce":2034957068}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5039,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4215710360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4215710360},{"type":"v1","addr":"172.21.15.172:6837","nonce":4215710360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2387835210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2387835210},{"type":"v1","addr":"172.21.15.114:6833","nonce":2387835210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T12:21:14.159069+0000","modified":"2023-10-18T12:29:23.762500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":126,"addr":"172.21.15.114:6835/1284474820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1284474820},{"type":"v1","addr":"172.21.15.114:6835","nonce":1284474820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-18T12:39:55.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.995+0000 7fc669c19700 1 -- 172.21.15.114:0/793134553 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc6500656f0 msgr2=0x7fc650067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:39:55.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.995+0000 7fc669c19700 1 --2- 172.21.15.114:0/793134553 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc6500656f0 0x7fc650067bb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc6540090b0 tx=0x7fc654010000 comp rx=0 tx=0).stop 2023-10-18T12:39:55.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.995+0000 7fc669c19700 1 -- 172.21.15.114:0/793134553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6640b4140 msgr2=0x7fc6640c5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:39:55.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.995+0000 7fc669c19700 1 --2- 172.21.15.114:0/793134553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6640b4140 0x7fc6640c5d90 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fc66000c700 tx=0x7fc66000ca10 comp rx=0 tx=0).stop 2023-10-18T12:39:55.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.999+0000 7fc669c19700 1 -- 172.21.15.114:0/793134553 shutdown_connections 2023-10-18T12:39:55.006 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.999+0000 7fc669c19700 1 --2- 172.21.15.114:0/793134553 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc6500656f0 0x7fc650067bb0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:39:55.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.999+0000 7fc669c19700 1 --2- 172.21.15.114:0/793134553 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc6640cdd90 0x7fc6640b2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:39:55.007 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.999+0000 7fc669c19700 1 --2- 172.21.15.114:0/793134553 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6640cc190 0x7fc6641f1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:39:55.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.999+0000 7fc669c19700 1 --2- 172.21.15.114:0/793134553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc6640b4140 0x7fc6640c5d90 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:39:55.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.999+0000 7fc669c19700 1 -- 172.21.15.114:0/793134553 >> 172.21.15.114:0/793134553 conn(0x7fc6640ce5c0 msgr2=0x7fc6640ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:39:55.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.999+0000 7fc669c19700 1 -- 172.21.15.114:0/793134553 shutdown_connections 2023-10-18T12:39:55.009 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:39:54.999+0000 7fc669c19700 1 -- 172.21.15.114:0/793134553 wait complete. 2023-10-18T12:39:55.009 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 20 2023-10-18T12:39:55.025 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-10-18T12:39:55.208 INFO:teuthology.orchestra.run.smithi114.stdout:[{"id":5162,"entity":{"name":{"type":"client","num":5162},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":989916161}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":1111.2236695250001,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.07672999305778154,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":3,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5162 v1:192.168.0.1:0/989916161","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi172","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}}] 2023-10-18T12:39:55.209 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "1", "hostname": "smithi172", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 989916161, "type": "v1" }, "name": { "num": 5162, "type": "client" } }, "id": 5162, "inst": "client.5162 v1:192.168.0.1:0/989916161", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 3, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.07672999305778154 }, "state": "open", "uptime": 1111.223669525 } ] 2023-10-18T12:39:55.310 DEBUG:tasks.ceph_test_case:No log hits yet, waiting... 2023-10-18T12:40:00.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:00.515+0000 7f4ed37fe700 1 -- 172.21.15.114:0/1156152234 <== mon.0 v2:172.21.15.114:3300/0 7 ==== log(1 entries from seq 570 at 2023-10-18T12:40:00.000214+0000) v1 ==== 187+0+0 (secure 0 0 0) 0x7f4ec4088030 con 0x7f4edc0c9430 2023-10-18T12:40:00.524 INFO:teuthology.orchestra.run.smithi114.stdout: cluster: 2023-10-18T12:40:00.525 INFO:teuthology.orchestra.run.smithi114.stdout: id: 240ea340-5d3d-4f52-a4bc-af075aca3deb 2023-10-18T12:40:00.525 INFO:teuthology.orchestra.run.smithi114.stdout: health: HEALTH_OK 2023-10-18T12:40:00.525 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:40:00.525 INFO:teuthology.orchestra.run.smithi114.stdout: services: 2023-10-18T12:40:00.525 INFO:teuthology.orchestra.run.smithi114.stdout: mon: 3 daemons, quorum a,b,c (age 20m) 2023-10-18T12:40:00.526 INFO:teuthology.orchestra.run.smithi114.stdout: mgr: x(active, since 20m), standbys: y 2023-10-18T12:40:00.526 INFO:teuthology.orchestra.run.smithi114.stdout: mds: 1/1 daemons up, 3 standby 2023-10-18T12:40:00.526 INFO:teuthology.orchestra.run.smithi114.stdout: osd: 8 osds: 8 up (since 10m), 8 in (since 20m) 2023-10-18T12:40:00.526 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:40:00.526 INFO:teuthology.orchestra.run.smithi114.stdout: data: 2023-10-18T12:40:00.527 INFO:teuthology.orchestra.run.smithi114.stdout: volumes: 1/1 healthy 2023-10-18T12:40:00.527 INFO:teuthology.orchestra.run.smithi114.stdout: pools: 4 pools, 105 pgs 2023-10-18T12:40:00.527 INFO:teuthology.orchestra.run.smithi114.stdout: objects: 24 objects, 580 KiB 2023-10-18T12:40:00.527 INFO:teuthology.orchestra.run.smithi114.stdout: usage: 218 MiB used, 720 GiB / 720 GiB avail 2023-10-18T12:40:00.527 INFO:teuthology.orchestra.run.smithi114.stdout: pgs: 105 active+clean 2023-10-18T12:40:00.528 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:40:00.528 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:40:00.528 INFO:teuthology.orchestra.run.smithi114.stdout:2023-10-18T12:40:00.000214+0000 mon.a [INF] overall HEALTH_OK 2023-10-18T12:40:05.735 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:40:05.743 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:40:30.337 ERROR:tasks.ceph_test_case:Log output: cluster: id: 240ea340-5d3d-4f52-a4bc-af075aca3deb health: HEALTH_OK services: mon: 3 daemons, quorum a,b,c (age 20m) mgr: x(active, since 20m), standbys: y mds: 1/1 daemons up, 3 standby osd: 8 osds: 8 up (since 10m), 8 in (since 20m) data: volumes: 1/1 healthy pools: 4 pools, 105 pgs objects: 24 objects, 580 KiB usage: 218 MiB used, 720 GiB / 720 GiB avail pgs: 105 active+clean 2023-10-18T12:40:00.000214+0000 mon.a [INF] overall HEALTH_OK 2023-10-18T12:40:30.338 DEBUG:tasks.cephfs.test_client_recovery:Expected log message found: 'Health check cleared: MDS_CLIENTS_LAGGY', retrying 2023-10-18T12:40:31.339 DEBUG:teuthology.orchestra.run.smithi114:> sudo daemon-helper kill ceph --cluster ceph -w 2023-10-18T12:40:31.348 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T12:40:31.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.506+0000 7fb72d87b700 1 Processor -- start 2023-10-18T12:40:31.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.510+0000 7fb72d87b700 1 -- start start 2023-10-18T12:40:31.520 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.510+0000 7fb72d87b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb7281593c0 0x7fb7280cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:40:31.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.514+0000 7fb72d87b700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7280cdbd0 con 0x7fb7280703f0 2023-10-18T12:40:31.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.514+0000 7fb72d87b700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb72806db20 con 0x7fb72806ee40 2023-10-18T12:40:31.521 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.514+0000 7fb72d87b700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7281597a0 con 0x7fb7281593c0 2023-10-18T12:40:31.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.514+0000 7fb72c879700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb7281593c0 0x7fb7280cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:40:31.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.514+0000 7fb72c879700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb7281593c0 0x7fb7280cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:45282/0 (socket says 172.21.15.114:45282) 2023-10-18T12:40:31.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.514+0000 7fb72c879700 1 -- 172.21.15.114:0/707369755 learned_addr learned my addr 172.21.15.114:0/707369755 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:40:31.522 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.514+0000 7fb72d07a700 1 --1- 172.21.15.114:0/707369755 >> v1:172.21.15.114:6789/0 conn(0x7fb7280703f0 0x7fb7280c8b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:51110/0 (socket says 172.21.15.114:51110) 2023-10-18T12:40:31.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.514+0000 7fb71f7fe700 1 -- 172.21.15.114:0/707369755 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2151184424 0 0) 0x7fb7280cdbd0 con 0x7fb7280703f0 2023-10-18T12:40:31.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.514+0000 7fb71f7fe700 1 -- 172.21.15.114:0/707369755 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7100034f0 con 0x7fb7280703f0 2023-10-18T12:40:31.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.514+0000 7fb72c879700 1 -- 172.21.15.114:0/707369755 >> v1:172.21.15.172:6789/0 conn(0x7fb72806ee40 legacy=0x7fb72806fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:40:31.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.514+0000 7fb72c879700 1 -- 172.21.15.114:0/707369755 >> v1:172.21.15.114:6789/0 conn(0x7fb7280703f0 legacy=0x7fb7280c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:40:31.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.514+0000 7fb72c879700 1 -- 172.21.15.114:0/707369755 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb72806dda0 con 0x7fb7281593c0 2023-10-18T12:40:31.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.514+0000 7fb72c879700 1 --2- 172.21.15.114:0/707369755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7281593c0 0x7fb7280cd320 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb718009910 tx=0x7fb718009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83d244b533f2ce14 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:40:31.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.514+0000 7fb71f7fe700 1 -- 172.21.15.114:0/707369755 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb718011830 con 0x7fb7281593c0 2023-10-18T12:40:31.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.514+0000 7fb71f7fe700 1 -- 172.21.15.114:0/707369755 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb718011990 con 0x7fb7281593c0 2023-10-18T12:40:31.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.514+0000 7fb71f7fe700 1 -- 172.21.15.114:0/707369755 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb718011d40 con 0x7fb7281593c0 2023-10-18T12:40:31.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.514+0000 7fb72d87b700 1 -- 172.21.15.114:0/707369755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7281593c0 msgr2=0x7fb7280cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:40:31.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.514+0000 7fb72d87b700 1 --2- 172.21.15.114:0/707369755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7281593c0 0x7fb7280cd320 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb718009910 tx=0x7fb718009c20 comp rx=0 tx=0).stop 2023-10-18T12:40:31.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.514+0000 7fb72d87b700 1 -- 172.21.15.114:0/707369755 shutdown_connections 2023-10-18T12:40:31.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.514+0000 7fb72d87b700 1 --2- 172.21.15.114:0/707369755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb7281593c0 0x7fb7280cd320 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:40:31.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.514+0000 7fb72d87b700 1 -- 172.21.15.114:0/707369755 >> 172.21.15.114:0/707369755 conn(0x7fb7280ce530 msgr2=0x7fb7280ce940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:40:31.526 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.514+0000 7fb72d87b700 1 -- 172.21.15.114:0/707369755 shutdown_connections 2023-10-18T12:40:31.527 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.514+0000 7fb72d87b700 1 -- 172.21.15.114:0/707369755 wait complete. 2023-10-18T12:40:31.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.518+0000 7fb72d87b700 1 Processor -- start 2023-10-18T12:40:31.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.518+0000 7fb72d87b700 1 -- start start 2023-10-18T12:40:31.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.518+0000 7fb72d87b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb72806ee40 0x7fb7280ae3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:40:31.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.518+0000 7fb72d87b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7280703f0 0x7fb7281de5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:40:31.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.518+0000 7fb72d87b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb7281593c0 0x7fb7281deb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:40:31.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.518+0000 7fb72d87b700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7281560d0 con 0x7fb7280703f0 2023-10-18T12:40:31.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.518+0000 7fb72d87b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb728156370 con 0x7fb72806ee40 2023-10-18T12:40:31.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.518+0000 7fb72d87b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb728156650 con 0x7fb7281593c0 2023-10-18T12:40:31.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.522+0000 7fb71ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7280703f0 0x7fb7281de5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:40:31.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.522+0000 7fb71ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7280703f0 0x7fb7281de5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34966/0 (socket says 172.21.15.114:34966) 2023-10-18T12:40:31.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.522+0000 7fb71ffff700 1 -- 172.21.15.114:0/652227054 learned_addr learned my addr 172.21.15.114:0/652227054 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:40:31.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.522+0000 7fb72c879700 1 --2- 172.21.15.114:0/652227054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb72806ee40 0x7fb7280ae3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:40:31.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.522+0000 7fb72d07a700 1 --2- 172.21.15.114:0/652227054 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb7281593c0 0x7fb7281deb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:40:31.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.522+0000 7fb71ffff700 1 -- 172.21.15.114:0/652227054 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb7281593c0 msgr2=0x7fb7281deb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:40:31.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.522+0000 7fb71ffff700 1 --2- 172.21.15.114:0/652227054 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb7281593c0 0x7fb7281deb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:40:31.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.522+0000 7fb71ffff700 1 -- 172.21.15.114:0/652227054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb72806ee40 msgr2=0x7fb7280ae3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:40:31.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.522+0000 7fb71ffff700 1 --2- 172.21.15.114:0/652227054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb72806ee40 0x7fb7280ae3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:40:31.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.522+0000 7fb71ffff700 1 -- 172.21.15.114:0/652227054 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb718009570 con 0x7fb7280703f0 2023-10-18T12:40:31.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.522+0000 7fb72c879700 1 --2- 172.21.15.114:0/652227054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb72806ee40 0x7fb7280ae3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:40:31.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.522+0000 7fb72d07a700 1 --2- 172.21.15.114:0/652227054 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb7281593c0 0x7fb7281deb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:40:31.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.522+0000 7fb71ffff700 1 --2- 172.21.15.114:0/652227054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7280703f0 0x7fb7281de5f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fb72400c4d0 tx=0x7fb72400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:40:31.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.522+0000 7fb71d7fa700 1 -- 172.21.15.114:0/652227054 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7240052d0 con 0x7fb7280703f0 2023-10-18T12:40:31.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.522+0000 7fb71d7fa700 1 -- 172.21.15.114:0/652227054 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb724005430 con 0x7fb7280703f0 2023-10-18T12:40:31.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.522+0000 7fb71d7fa700 1 -- 172.21.15.114:0/652227054 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7240055a0 con 0x7fb7280703f0 2023-10-18T12:40:31.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.522+0000 7fb72d87b700 1 -- 172.21.15.114:0/652227054 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb728156930 con 0x7fb7280703f0 2023-10-18T12:40:31.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.522+0000 7fb72d87b700 1 -- 172.21.15.114:0/652227054 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb728156ef0 con 0x7fb7280703f0 2023-10-18T12:40:31.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.522+0000 7fb72d87b700 1 -- 172.21.15.114:0/652227054 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb728072e60 con 0x7fb7280703f0 2023-10-18T12:40:31.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.526+0000 7fb71d7fa700 1 -- 172.21.15.114:0/652227054 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fb7240038a0 con 0x7fb7280703f0 2023-10-18T12:40:31.535 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.526+0000 7fb71d7fa700 1 --2- 172.21.15.114:0/652227054 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb7140656f0 0x7fb714067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:40:31.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.526+0000 7fb71d7fa700 1 -- 172.21.15.114:0/652227054 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7fb724082400 con 0x7fb7280703f0 2023-10-18T12:40:31.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.526+0000 7fb72c879700 1 --2- 172.21.15.114:0/652227054 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb7140656f0 0x7fb714067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:40:31.536 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.526+0000 7fb72c879700 1 --2- 172.21.15.114:0/652227054 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb7140656f0 0x7fb714067bb0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb718006f80 tx=0x7fb718008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:40:31.540 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.530+0000 7fb71d7fa700 1 -- 172.21.15.114:0/652227054 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fb72404fc40 con 0x7fb7280703f0 2023-10-18T12:40:31.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.538+0000 7f216b07d700 1 Processor -- start 2023-10-18T12:40:31.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.538+0000 7f216b07d700 1 -- start start 2023-10-18T12:40:31.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.542+0000 7f216b07d700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f215c0e3160 0x7f215c03e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:40:31.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.542+0000 7f216b07d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f215c054470 0x7f215c0573b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:40:31.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.542+0000 7f216b07d700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f215c03ee30 con 0x7f215c038150 2023-10-18T12:40:31.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.542+0000 7f216b07d700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f215c03f0d0 con 0x7f215c0e3160 2023-10-18T12:40:31.551 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.542+0000 7f216b07d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f215c007c10 con 0x7f215c054470 2023-10-18T12:40:31.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.542+0000 7f216a87c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f215c054470 0x7f215c0573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:40:31.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.542+0000 7f216a07b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f215c0e3160 0x7f215c03e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:40:31.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.542+0000 7f216a87c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f215c054470 0x7f215c0573b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.114:60476/0 (socket says 172.21.15.114:60476) 2023-10-18T12:40:31.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.542+0000 7f216a87c700 1 -- 172.21.15.114:0/3372296991 learned_addr learned my addr 172.21.15.114:0/3372296991 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:40:31.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.542+0000 7f216a87c700 1 -- 172.21.15.114:0/3372296991 >> v2:172.21.15.172:3300/0 conn(0x7f215c0e3160 msgr2=0x7f215c03e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:40:31.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.542+0000 7f216a87c700 1 --2- 172.21.15.114:0/3372296991 >> v2:172.21.15.172:3300/0 conn(0x7f215c0e3160 0x7f215c03e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:40:31.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.542+0000 7f216a87c700 1 -- 172.21.15.114:0/3372296991 >> v1:172.21.15.172:6789/0 conn(0x7f215c038150 legacy=0x7f215c053d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:40:31.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.542+0000 7f216a87c700 1 -- 172.21.15.114:0/3372296991 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f215c006e50 con 0x7f215c054470 2023-10-18T12:40:31.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.542+0000 7f216a87c700 1 --2- 172.21.15.114:0/3372296991 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f215c054470 0x7f215c0573b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2164073230 tx=0x7f21640617c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a6f2195e251d0e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:40:31.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.546+0000 7f2169079700 1 -- 172.21.15.114:0/3372296991 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2164072e60 con 0x7f215c054470 2023-10-18T12:40:31.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.546+0000 7f2169079700 1 -- 172.21.15.114:0/3372296991 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216408d070 con 0x7f215c054470 2023-10-18T12:40:31.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.546+0000 7f2169079700 1 -- 172.21.15.114:0/3372296991 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2164073780 con 0x7f215c054470 2023-10-18T12:40:31.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.546+0000 7f216b07d700 1 -- 172.21.15.114:0/3372296991 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f215c054470 msgr2=0x7f215c0573b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:40:31.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.546+0000 7f216b07d700 1 --2- 172.21.15.114:0/3372296991 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f215c054470 0x7f215c0573b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2164073230 tx=0x7f21640617c0 comp rx=0 tx=0).stop 2023-10-18T12:40:31.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.546+0000 7f216b07d700 1 -- 172.21.15.114:0/3372296991 shutdown_connections 2023-10-18T12:40:31.556 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.546+0000 7f216b07d700 1 --2- 172.21.15.114:0/3372296991 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f215c054470 0x7f215c0573b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:40:31.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.546+0000 7f216b07d700 1 --2- 172.21.15.114:0/3372296991 >> v2:172.21.15.172:3300/0 conn(0x7f215c0e3160 0x7f215c03e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:40:31.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.546+0000 7f216b07d700 1 -- 172.21.15.114:0/3372296991 >> 172.21.15.114:0/3372296991 conn(0x7f215c059090 msgr2=0x7f215c0594a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:40:31.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.546+0000 7f216b07d700 1 -- 172.21.15.114:0/3372296991 shutdown_connections 2023-10-18T12:40:31.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.546+0000 7f216b07d700 1 -- 172.21.15.114:0/3372296991 wait complete. 2023-10-18T12:40:31.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.550+0000 7f216b07d700 1 Processor -- start 2023-10-18T12:40:31.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.550+0000 7f216b07d700 1 -- start start 2023-10-18T12:40:31.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.550+0000 7f216b07d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f215c038150 0x7f215c0d88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:40:31.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.550+0000 7f216b07d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f215c054470 0x7f215c168460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:40:31.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.550+0000 7f216b07d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f215c0e3160 0x7f215c17bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:40:31.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.550+0000 7f216b07d700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f215c0d8df0 con 0x7f215c038150 2023-10-18T12:40:31.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.550+0000 7f216b07d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f215c052fe0 con 0x7f215c054470 2023-10-18T12:40:31.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.550+0000 7f216b07d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f215c053560 con 0x7f215c0e3160 2023-10-18T12:40:31.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.554+0000 7f216a07b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f215c038150 0x7f215c0d88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:40:31.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.554+0000 7f216a07b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f215c038150 0x7f215c0d88b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:34980/0 (socket says 172.21.15.114:34980) 2023-10-18T12:40:31.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.554+0000 7f216a07b700 1 -- 172.21.15.114:0/4103165712 learned_addr learned my addr 172.21.15.114:0/4103165712 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:40:31.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.554+0000 7f216987a700 1 --2- 172.21.15.114:0/4103165712 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f215c054470 0x7f215c168460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:40:31.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.554+0000 7f216a87c700 1 --2- 172.21.15.114:0/4103165712 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f215c0e3160 0x7f215c17bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:40:31.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.554+0000 7f216a07b700 1 -- 172.21.15.114:0/4103165712 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f215c0e3160 msgr2=0x7f215c17bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:40:31.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.554+0000 7f216a07b700 1 --2- 172.21.15.114:0/4103165712 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f215c0e3160 0x7f215c17bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:40:31.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.554+0000 7f216a07b700 1 -- 172.21.15.114:0/4103165712 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f215c054470 msgr2=0x7f215c168460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:40:31.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.554+0000 7f216a07b700 1 --2- 172.21.15.114:0/4103165712 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f215c054470 0x7f215c168460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:40:31.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.554+0000 7f216a07b700 1 -- 172.21.15.114:0/4103165712 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f215c053280 con 0x7f215c038150 2023-10-18T12:40:31.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.554+0000 7f216a07b700 1 --2- 172.21.15.114:0/4103165712 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f215c038150 0x7f215c0d88b0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f216000e840 tx=0x7f216000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:40:31.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.554+0000 7f215affd700 1 -- 172.21.15.114:0/4103165712 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21600095a0 con 0x7f215c038150 2023-10-18T12:40:31.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.554+0000 7f215affd700 1 -- 172.21.15.114:0/4103165712 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2160013680 con 0x7f215c038150 2023-10-18T12:40:31.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.554+0000 7f216b07d700 1 -- 172.21.15.114:0/4103165712 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f215c0509a0 con 0x7f215c038150 2023-10-18T12:40:31.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.554+0000 7f215affd700 1 -- 172.21.15.114:0/4103165712 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21600139f0 con 0x7f215c038150 2023-10-18T12:40:31.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.554+0000 7f216b07d700 1 -- 172.21.15.114:0/4103165712 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f215c1689a0 con 0x7f215c038150 2023-10-18T12:40:31.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.554+0000 7f216b07d700 1 -- 172.21.15.114:0/4103165712 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f215c005420 con 0x7f215c038150 2023-10-18T12:40:31.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.558+0000 7f215affd700 1 -- 172.21.15.114:0/4103165712 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f2160013b50 con 0x7f215c038150 2023-10-18T12:40:31.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.558+0000 7f215affd700 1 --2- 172.21.15.114:0/4103165712 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f21480656f0 0x7f2148067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:40:31.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.558+0000 7f215affd700 1 -- 172.21.15.114:0/4103165712 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7f2160082eb0 con 0x7f215c038150 2023-10-18T12:40:31.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.558+0000 7f216987a700 1 --2- 172.21.15.114:0/4103165712 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f21480656f0 0x7f2148067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:40:31.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.558+0000 7f215affd700 1 -- 172.21.15.114:0/4103165712 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+450 (secure 0 0 0) 0x7f21600854f0 con 0x7f215c038150 2023-10-18T12:40:31.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.558+0000 7f216b07d700 1 -- 172.21.15.114:0/4103165712 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7f215c03a640 con 0x7f215c038150 2023-10-18T12:40:31.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.562+0000 7f216987a700 1 --2- 172.21.15.114:0/4103165712 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f21480656f0 0x7f2148067bb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f215c052ba0 tx=0x7f2154009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:40:31.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.758+0000 7fb72d87b700 1 -- 172.21.15.114:0/652227054 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb7280c9bd0 con 0x7fb7280703f0 2023-10-18T12:40:31.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.758+0000 7fb71d7fa700 1 -- 172.21.15.114:0/652227054 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4889 (secure 0 0 0) 0x7fb724053260 con 0x7fb7280703f0 2023-10-18T12:40:31.768 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:40:31.768 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2034957068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2034957068},{"type":"v1","addr":"172.21.15.172:6836","nonce":2034957068}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5039,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4215710360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4215710360},{"type":"v1","addr":"172.21.15.172:6837","nonce":4215710360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2387835210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2387835210},{"type":"v1","addr":"172.21.15.114:6833","nonce":2387835210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T12:21:14.159069+0000","modified":"2023-10-18T12:29:23.762500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":126,"addr":"172.21.15.114:6835/1284474820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1284474820},{"type":"v1","addr":"172.21.15.114:6835","nonce":1284474820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-18T12:40:31.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.762+0000 7fb72d87b700 1 -- 172.21.15.114:0/652227054 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb7140656f0 msgr2=0x7fb714067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:40:31.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.762+0000 7fb72d87b700 1 --2- 172.21.15.114:0/652227054 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb7140656f0 0x7fb714067bb0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb718006f80 tx=0x7fb718008030 comp rx=0 tx=0).stop 2023-10-18T12:40:31.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.762+0000 7fb72d87b700 1 -- 172.21.15.114:0/652227054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7280703f0 msgr2=0x7fb7281de5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:40:31.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.762+0000 7fb72d87b700 1 --2- 172.21.15.114:0/652227054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7280703f0 0x7fb7281de5f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fb72400c4d0 tx=0x7fb72400c890 comp rx=0 tx=0).stop 2023-10-18T12:40:31.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.762+0000 7fb72d87b700 1 -- 172.21.15.114:0/652227054 shutdown_connections 2023-10-18T12:40:31.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.762+0000 7fb72d87b700 1 --2- 172.21.15.114:0/652227054 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb7140656f0 0x7fb714067bb0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:40:31.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.762+0000 7fb72d87b700 1 --2- 172.21.15.114:0/652227054 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb7281593c0 0x7fb7281deb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:40:31.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.762+0000 7fb72d87b700 1 --2- 172.21.15.114:0/652227054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb7280703f0 0x7fb7281de5f0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:40:31.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.762+0000 7fb72d87b700 1 --2- 172.21.15.114:0/652227054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb72806ee40 0x7fb7280ae3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:40:31.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.762+0000 7fb72d87b700 1 -- 172.21.15.114:0/652227054 >> 172.21.15.114:0/652227054 conn(0x7fb7280ce530 msgr2=0x7fb7281513c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:40:31.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.762+0000 7fb72d87b700 1 -- 172.21.15.114:0/652227054 shutdown_connections 2023-10-18T12:40:31.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:40:31.762+0000 7fb72d87b700 1 -- 172.21.15.114:0/652227054 wait complete. 2023-10-18T12:40:31.773 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 20 2023-10-18T12:40:31.791 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-10-18T12:40:31.982 INFO:teuthology.orchestra.run.smithi114.stdout:[{"id":5162,"entity":{"name":{"type":"client","num":5162},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":989916161}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":1147.994895196,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.070480290572283555,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":3,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5162 v1:192.168.0.1:0/989916161","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi172","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}}] 2023-10-18T12:40:31.983 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "1", "hostname": "smithi172", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 989916161, "type": "v1" }, "name": { "num": 5162, "type": "client" } }, "id": 5162, "inst": "client.5162 v1:192.168.0.1:0/989916161", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 3, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.07048029057228355 }, "state": "open", "uptime": 1147.994895196 } ] 2023-10-18T12:40:32.085 DEBUG:tasks.ceph_test_case:No log hits yet, waiting... 2023-10-18T12:40:35.818 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:40:35.826 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:41:05.901 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:41:05.909 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:41:07.111 ERROR:tasks.ceph_test_case:Log output: 2023-10-18T12:41:07.111 DEBUG:tasks.cephfs.test_client_recovery:Expected log message found: 'Health check cleared: MDS_CLIENTS_LAGGY', retrying 2023-10-18T12:41:08.112 DEBUG:teuthology.orchestra.run.smithi114:> sudo daemon-helper kill ceph --cluster ceph -w 2023-10-18T12:41:08.120 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T12:41:08.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.290+0000 7f023574c700 1 Processor -- start 2023-10-18T12:41:08.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.290+0000 7f023574c700 1 -- start start 2023-10-18T12:41:08.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.290+0000 7f023574c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f02300d2e00 0x7f02300b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:08.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.290+0000 7f023574c700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f023015d0d0 con 0x7f02300b5ae0 2023-10-18T12:41:08.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.290+0000 7f023574c700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f023006f0f0 con 0x7f0230160710 2023-10-18T12:41:08.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.290+0000 7f023574c700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f023015df90 con 0x7f02300d2e00 2023-10-18T12:41:08.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.290+0000 7f0234f4b700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f02300b5ae0 0x7f023006db60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:43500/0 (socket says 172.21.15.114:43500) 2023-10-18T12:41:08.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.290+0000 7f0234f4b700 1 -- 172.21.15.114:0/4119034491 learned_addr learned my addr 172.21.15.114:0/4119034491 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:41:08.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.290+0000 7f022ffff700 1 --2- 172.21.15.114:0/4119034491 >> v2:172.21.15.172:3300/0 conn(0x7f02300d2e00 0x7f02300b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:08.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.290+0000 7f022effd700 1 -- 172.21.15.114:0/4119034491 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2823102692 0 0) 0x7f02280014e0 con 0x7f02300b5ae0 2023-10-18T12:41:08.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.290+0000 7f022effd700 1 -- 172.21.15.114:0/4119034491 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02180035d0 con 0x7f02300b5ae0 2023-10-18T12:41:08.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.290+0000 7f022ffff700 1 -- 172.21.15.114:0/4119034491 >> v1:172.21.15.172:6789/0 conn(0x7f0230160710 legacy=0x7f02300d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:08.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.290+0000 7f022effd700 1 -- 172.21.15.114:0/4119034491 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2805932397 0 0) 0x7f02180035d0 con 0x7f02300b5ae0 2023-10-18T12:41:08.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.290+0000 7f022ffff700 1 -- 172.21.15.114:0/4119034491 >> v1:172.21.15.114:6789/0 conn(0x7f02300b5ae0 legacy=0x7f023006db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:08.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.290+0000 7f022ffff700 1 -- 172.21.15.114:0/4119034491 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f023015d310 con 0x7f02300d2e00 2023-10-18T12:41:08.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.294+0000 7f022ffff700 1 --2- 172.21.15.114:0/4119034491 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02300d2e00 0x7f02300b6e00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0220009850 tx=0x7f0220009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2b9d1b6a009b65c server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:08.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.294+0000 7f022effd700 1 -- 172.21.15.114:0/4119034491 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0228001bd0 con 0x7f02300d2e00 2023-10-18T12:41:08.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.294+0000 7f022effd700 1 -- 172.21.15.114:0/4119034491 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0220004030 con 0x7f02300d2e00 2023-10-18T12:41:08.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.294+0000 7f022effd700 1 -- 172.21.15.114:0/4119034491 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02200043c0 con 0x7f02300d2e00 2023-10-18T12:41:08.299 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.294+0000 7f023574c700 1 -- 172.21.15.114:0/4119034491 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02300d2e00 msgr2=0x7f02300b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:08.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.294+0000 7f023574c700 1 --2- 172.21.15.114:0/4119034491 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02300d2e00 0x7f02300b6e00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0220009850 tx=0x7f0220009b60 comp rx=0 tx=0).stop 2023-10-18T12:41:08.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.294+0000 7f023574c700 1 -- 172.21.15.114:0/4119034491 shutdown_connections 2023-10-18T12:41:08.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.294+0000 7f023574c700 1 --2- 172.21.15.114:0/4119034491 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02300d2e00 0x7f02300b6e00 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:08.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.294+0000 7f023574c700 1 -- 172.21.15.114:0/4119034491 >> 172.21.15.114:0/4119034491 conn(0x7f0230069f20 msgr2=0x7f023006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:08.300 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.294+0000 7f023574c700 1 -- 172.21.15.114:0/4119034491 shutdown_connections 2023-10-18T12:41:08.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.294+0000 7f023574c700 1 -- 172.21.15.114:0/4119034491 wait complete. 2023-10-18T12:41:08.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.298+0000 7f023574c700 1 Processor -- start 2023-10-18T12:41:08.303 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.298+0000 7f023574c700 1 -- start start 2023-10-18T12:41:08.304 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.302+0000 7f023574c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02300b5ae0 0x7f023015a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:08.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.302+0000 7f023574c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f02300d2e00 0x7f02301515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:08.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.302+0000 7f023574c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0230160710 0x7f02300d0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:08.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.302+0000 7f023574c700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0230158ea0 con 0x7f02300b5ae0 2023-10-18T12:41:08.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.302+0000 7f023574c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0230159140 con 0x7f0230160710 2023-10-18T12:41:08.305 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.302+0000 7f023574c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0230159420 con 0x7f02300d2e00 2023-10-18T12:41:08.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.302+0000 7f022ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02300b5ae0 0x7f023015a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:08.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.302+0000 7f022ffff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02300b5ae0 0x7f023015a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57432/0 (socket says 172.21.15.114:57432) 2023-10-18T12:41:08.306 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.302+0000 7f022ffff700 1 -- 172.21.15.114:0/2991125073 learned_addr learned my addr 172.21.15.114:0/2991125073 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:41:08.307 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.302+0000 7f0234f4b700 1 --2- 172.21.15.114:0/2991125073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0230160710 0x7f02300d0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:08.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.302+0000 7f022f7fe700 1 --2- 172.21.15.114:0/2991125073 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f02300d2e00 0x7f02301515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:08.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.302+0000 7f022ffff700 1 -- 172.21.15.114:0/2991125073 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f02300d2e00 msgr2=0x7f02301515f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:08.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.302+0000 7f022ffff700 1 --2- 172.21.15.114:0/2991125073 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f02300d2e00 0x7f02301515f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:08.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.302+0000 7f022ffff700 1 -- 172.21.15.114:0/2991125073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0230160710 msgr2=0x7f02300d0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:08.308 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.302+0000 7f022ffff700 1 --2- 172.21.15.114:0/2991125073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0230160710 0x7f02300d0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.302+0000 7f022ffff700 1 -- 172.21.15.114:0/2991125073 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02200094b0 con 0x7f02300b5ae0 2023-10-18T12:41:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.302+0000 7f022ffff700 1 --2- 172.21.15.114:0/2991125073 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02300b5ae0 0x7f023015a210 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f0230070690 tx=0x7f0220004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.302+0000 7f022cff9700 1 -- 172.21.15.114:0/2991125073 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0220003d60 con 0x7f02300b5ae0 2023-10-18T12:41:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.302+0000 7f022cff9700 1 -- 172.21.15.114:0/2991125073 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f022001f070 con 0x7f02300b5ae0 2023-10-18T12:41:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.302+0000 7f023574c700 1 -- 172.21.15.114:0/2991125073 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0230159700 con 0x7f02300b5ae0 2023-10-18T12:41:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.302+0000 7f022cff9700 1 -- 172.21.15.114:0/2991125073 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0220011870 con 0x7f02300b5ae0 2023-10-18T12:41:08.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.302+0000 7f023574c700 1 -- 172.21.15.114:0/2991125073 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0230159cc0 con 0x7f02300b5ae0 2023-10-18T12:41:08.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.302+0000 7f023574c700 1 -- 172.21.15.114:0/2991125073 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0230072e60 con 0x7f02300b5ae0 2023-10-18T12:41:08.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.306+0000 7f022cff9700 1 -- 172.21.15.114:0/2991125073 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f0220021030 con 0x7f02300b5ae0 2023-10-18T12:41:08.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.306+0000 7f022cff9700 1 --2- 172.21.15.114:0/2991125073 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f021c065720 0x7f021c067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:08.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.306+0000 7f022cff9700 1 -- 172.21.15.114:0/2991125073 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7f02200843a0 con 0x7f02300b5ae0 2023-10-18T12:41:08.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.306+0000 7f022f7fe700 1 --2- 172.21.15.114:0/2991125073 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f021c065720 0x7f021c067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:08.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.310+0000 7f022f7fe700 1 --2- 172.21.15.114:0/2991125073 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f021c065720 0x7f021c067be0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0224000f60 tx=0x7f0224009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:08.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.310+0000 7f4e7738b700 1 Processor -- start 2023-10-18T12:41:08.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.310+0000 7f4e7738b700 1 -- start start 2023-10-18T12:41:08.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.310+0000 7f4e7738b700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4e701572f0 0x7f4e70160830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:08.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.310+0000 7f4e7738b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e700d2f60 0x7f4e700d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:08.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.310+0000 7f4e7738b700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e700b61f0 con 0x7f4e700cf320 2023-10-18T12:41:08.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.310+0000 7f4e7738b700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e700d3950 con 0x7f4e701572f0 2023-10-18T12:41:08.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.314+0000 7f4e7738b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e701576d0 con 0x7f4e700d2f60 2023-10-18T12:41:08.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.314+0000 7f4e76389700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f4e701572f0 0x7f4e70160830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:08.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.314+0000 7f4e75b88700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f4e700cf320 0x7f4e700b5ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:43514/0 (socket says 172.21.15.114:43514) 2023-10-18T12:41:08.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.314+0000 7f4e75b88700 1 -- 172.21.15.114:0/2061829851 learned_addr learned my addr 172.21.15.114:0/2061829851 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:41:08.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.314+0000 7f4e76b8a700 1 --2- 172.21.15.114:0/2061829851 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e700d2f60 0x7f4e700d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:08.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.314+0000 7f4e76389700 1 -- 172.21.15.114:0/2061829851 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e700d2f60 msgr2=0x7f4e700d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:41:08.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.314+0000 7f4e76389700 1 --2- 172.21.15.114:0/2061829851 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e700d2f60 0x7f4e700d3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:08.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.314+0000 7f4e76389700 1 -- 172.21.15.114:0/2061829851 >> v1:172.21.15.114:6789/0 conn(0x7f4e700cf320 legacy=0x7f4e700b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:08.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.314+0000 7f4e76389700 1 -- 172.21.15.114:0/2061829851 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e7006dd60 con 0x7f4e701572f0 2023-10-18T12:41:08.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.314+0000 7f4e76389700 1 --2- 172.21.15.114:0/2061829851 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e701572f0 0x7f4e70160830 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c009850 tx=0x7f4e6c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae87cd6bf198c2f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:08.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.314+0000 7f4e75387700 1 -- 172.21.15.114:0/2061829851 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c011830 con 0x7f4e701572f0 2023-10-18T12:41:08.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.314+0000 7f4e75387700 1 -- 172.21.15.114:0/2061829851 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e6c011990 con 0x7f4e701572f0 2023-10-18T12:41:08.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.314+0000 7f4e75387700 1 -- 172.21.15.114:0/2061829851 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c011d20 con 0x7f4e701572f0 2023-10-18T12:41:08.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.314+0000 7f022cff9700 1 -- 172.21.15.114:0/2991125073 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f0220051bc0 con 0x7f02300b5ae0 2023-10-18T12:41:08.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.314+0000 7f4e7738b700 1 -- 172.21.15.114:0/2061829851 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e701572f0 msgr2=0x7f4e70160830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:08.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.314+0000 7f4e7738b700 1 --2- 172.21.15.114:0/2061829851 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e701572f0 0x7f4e70160830 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c009850 tx=0x7f4e6c009b60 comp rx=0 tx=0).stop 2023-10-18T12:41:08.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.314+0000 7f4e7738b700 1 -- 172.21.15.114:0/2061829851 shutdown_connections 2023-10-18T12:41:08.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.314+0000 7f4e7738b700 1 --2- 172.21.15.114:0/2061829851 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e700d2f60 0x7f4e700d3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:08.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.314+0000 7f4e7738b700 1 --2- 172.21.15.114:0/2061829851 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e701572f0 0x7f4e70160830 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:08.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.314+0000 7f4e7738b700 1 -- 172.21.15.114:0/2061829851 >> 172.21.15.114:0/2061829851 conn(0x7f4e70069ef0 msgr2=0x7f4e7006a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:08.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.314+0000 7f4e7738b700 1 -- 172.21.15.114:0/2061829851 shutdown_connections 2023-10-18T12:41:08.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.314+0000 7f4e7738b700 1 -- 172.21.15.114:0/2061829851 wait complete. 2023-10-18T12:41:08.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.318+0000 7f4e7738b700 1 Processor -- start 2023-10-18T12:41:08.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.318+0000 7f4e7738b700 1 -- start start 2023-10-18T12:41:08.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.318+0000 7f4e7738b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e700cf320 0x7f4e7015e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:08.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.318+0000 7f4e7738b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e700d2f60 0x7f4e7014c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:08.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.318+0000 7f4e7738b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e701572f0 0x7f4e7014db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:08.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.318+0000 7f4e7738b700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7014efa0 con 0x7f4e700d2f60 2023-10-18T12:41:08.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.318+0000 7f4e7738b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7014ccd0 con 0x7f4e701572f0 2023-10-18T12:41:08.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.318+0000 7f4e7738b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7014e390 con 0x7f4e700cf320 2023-10-18T12:41:08.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.318+0000 7f4e75b88700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e700d2f60 0x7f4e7014c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:08.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.318+0000 7f4e75b88700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e700d2f60 0x7f4e7014c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57452/0 (socket says 172.21.15.114:57452) 2023-10-18T12:41:08.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.318+0000 7f4e75b88700 1 -- 172.21.15.114:0/1164177775 learned_addr learned my addr 172.21.15.114:0/1164177775 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:41:08.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.318+0000 7f4e76389700 1 --2- 172.21.15.114:0/1164177775 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e700cf320 0x7f4e7015e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:08.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.318+0000 7f4e76b8a700 1 --2- 172.21.15.114:0/1164177775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e701572f0 0x7f4e7014db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:08.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.322+0000 7f4e75b88700 1 -- 172.21.15.114:0/1164177775 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e700cf320 msgr2=0x7f4e7015e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:08.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.322+0000 7f4e75b88700 1 --2- 172.21.15.114:0/1164177775 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e700cf320 0x7f4e7015e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:08.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.322+0000 7f4e75b88700 1 -- 172.21.15.114:0/1164177775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e701572f0 msgr2=0x7f4e7014db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:08.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.322+0000 7f4e75b88700 1 --2- 172.21.15.114:0/1164177775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e701572f0 0x7f4e7014db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:08.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.322+0000 7f4e75b88700 1 -- 172.21.15.114:0/1164177775 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e6c0094b0 con 0x7f4e700d2f60 2023-10-18T12:41:08.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.322+0000 7f4e76389700 1 --2- 172.21.15.114:0/1164177775 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4e700cf320 0x7f4e7015e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:41:08.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.322+0000 7f4e75b88700 1 --2- 172.21.15.114:0/1164177775 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4e700d2f60 0x7f4e7014c790 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f4e6000c730 tx=0x7f4e6000caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:08.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.322+0000 7f4e66ffd700 1 -- 172.21.15.114:0/1164177775 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e60005d90 con 0x7f4e700d2f60 2023-10-18T12:41:08.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.322+0000 7f4e66ffd700 1 -- 172.21.15.114:0/1164177775 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e600070d0 con 0x7f4e700d2f60 2023-10-18T12:41:08.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.322+0000 7f4e7738b700 1 -- 172.21.15.114:0/1164177775 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e7014e670 con 0x7f4e700d2f60 2023-10-18T12:41:08.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.322+0000 7f4e66ffd700 1 -- 172.21.15.114:0/1164177775 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e60007440 con 0x7f4e700d2f60 2023-10-18T12:41:08.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.322+0000 7f4e7738b700 1 -- 172.21.15.114:0/1164177775 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e7014ec30 con 0x7f4e700d2f60 2023-10-18T12:41:08.333 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.322+0000 7f4e7738b700 1 -- 172.21.15.114:0/1164177775 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f4e7014f150 con 0x7f4e700d2f60 2023-10-18T12:41:08.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.322+0000 7f4e66ffd700 1 -- 172.21.15.114:0/1164177775 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f4e600075a0 con 0x7f4e700d2f60 2023-10-18T12:41:08.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.326+0000 7f4e66ffd700 1 --2- 172.21.15.114:0/1164177775 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4e540656f0 0x7f4e54067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:08.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.326+0000 7f4e66ffd700 1 -- 172.21.15.114:0/1164177775 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7f4e600823e0 con 0x7f4e700d2f60 2023-10-18T12:41:08.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.326+0000 7f4e66ffd700 1 -- 172.21.15.114:0/1164177775 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+450 (secure 0 0 0) 0x7f4e7014f150 con 0x7f4e700d2f60 2023-10-18T12:41:08.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.326+0000 7f4e7738b700 1 -- 172.21.15.114:0/1164177775 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7f4e7014f150 con 0x7f4e700d2f60 2023-10-18T12:41:08.335 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.326+0000 7f4e76389700 1 --2- 172.21.15.114:0/1164177775 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4e540656f0 0x7f4e54067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:08.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.326+0000 7f4e76389700 1 --2- 172.21.15.114:0/1164177775 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f4e540656f0 0x7f4e54067bb0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c014040 tx=0x7f4e6c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:08.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.538+0000 7f023574c700 1 -- 172.21.15.114:0/2991125073 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f023006d3e0 con 0x7f02300b5ae0 2023-10-18T12:41:08.543 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.538+0000 7f022cff9700 1 -- 172.21.15.114:0/2991125073 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4889 (secure 0 0 0) 0x7f02200551e0 con 0x7f02300b5ae0 2023-10-18T12:41:08.544 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:41:08.544 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2034957068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2034957068},{"type":"v1","addr":"172.21.15.172:6836","nonce":2034957068}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5039,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4215710360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4215710360},{"type":"v1","addr":"172.21.15.172:6837","nonce":4215710360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2387835210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2387835210},{"type":"v1","addr":"172.21.15.114:6833","nonce":2387835210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T12:21:14.159069+0000","modified":"2023-10-18T12:29:23.762500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":126,"addr":"172.21.15.114:6835/1284474820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1284474820},{"type":"v1","addr":"172.21.15.114:6835","nonce":1284474820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-18T12:41:08.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.542+0000 7f023574c700 1 -- 172.21.15.114:0/2991125073 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f021c065720 msgr2=0x7f021c067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:08.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.542+0000 7f023574c700 1 --2- 172.21.15.114:0/2991125073 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f021c065720 0x7f021c067be0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0224000f60 tx=0x7f0224009040 comp rx=0 tx=0).stop 2023-10-18T12:41:08.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.542+0000 7f023574c700 1 -- 172.21.15.114:0/2991125073 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02300b5ae0 msgr2=0x7f023015a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:08.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.542+0000 7f023574c700 1 --2- 172.21.15.114:0/2991125073 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02300b5ae0 0x7f023015a210 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f0230070690 tx=0x7f0220004770 comp rx=0 tx=0).stop 2023-10-18T12:41:08.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.542+0000 7f023574c700 1 -- 172.21.15.114:0/2991125073 shutdown_connections 2023-10-18T12:41:08.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.542+0000 7f023574c700 1 --2- 172.21.15.114:0/2991125073 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f021c065720 0x7f021c067be0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:08.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.542+0000 7f023574c700 1 --2- 172.21.15.114:0/2991125073 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f02300d2e00 0x7f02301515f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:08.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.542+0000 7f023574c700 1 --2- 172.21.15.114:0/2991125073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0230160710 0x7f02300d0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:08.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.542+0000 7f023574c700 1 --2- 172.21.15.114:0/2991125073 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f02300b5ae0 0x7f023015a210 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:08.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.542+0000 7f023574c700 1 -- 172.21.15.114:0/2991125073 >> 172.21.15.114:0/2991125073 conn(0x7f0230069f20 msgr2=0x7f023006f450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:08.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.542+0000 7f023574c700 1 -- 172.21.15.114:0/2991125073 shutdown_connections 2023-10-18T12:41:08.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:08.542+0000 7f023574c700 1 -- 172.21.15.114:0/2991125073 wait complete. 2023-10-18T12:41:08.550 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 20 2023-10-18T12:41:08.569 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2023-10-18T12:41:08.763 INFO:teuthology.orchestra.run.smithi114.stdout:[{"id":5162,"entity":{"name":{"type":"client","num":5162},"addr":{"type":"v1","addr":"192.168.0.1:0","nonce":989916161}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":1184.7781131859999,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.064737836193027462,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":3,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.5162 v1:192.168.0.1:0/989916161","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi172","kernel_version":"6.6.0-rc5-g47672119149b","root":"/"}}] 2023-10-18T12:41:08.763 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000017fbff" }, "entity_id": "1", "hostname": "smithi172", "kernel_version": "6.6.0-rc5-g47672119149b", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 989916161, "type": "v1" }, "name": { "num": 5162, "type": "client" } }, "id": 5162, "inst": "client.5162 v1:192.168.0.1:0/989916161", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 3, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.06473783619302746 }, "state": "open", "uptime": 1184.778113186 } ] 2023-10-18T12:41:08.864 DEBUG:tasks.ceph_test_case:No log hits yet, waiting... 2023-10-18T12:41:35.989 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:41:35.997 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:41:43.892 ERROR:tasks.ceph_test_case:Log output: 2023-10-18T12:41:43.892 DEBUG:tasks.cephfs.test_client_recovery:Expected log message found: 'Health check cleared: MDS_CLIENTS_LAGGY', retrying 2023-10-18T12:41:43.893 INFO:tasks.cephfs.mount:Cleaning up killed connection on ubuntu@smithi114.front.sepia.ceph.com 2023-10-18T12:41:43.893 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:41:43.894 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-18T12:41:43.957 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:41:43.958 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-18T12:41:44.023 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T12:41:44.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.245+0000 7f5af24f3700 1 Processor -- start 2023-10-18T12:41:44.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.245+0000 7f5af24f3700 1 -- start start 2023-10-18T12:41:44.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.245+0000 7f5af24f3700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5aec06e8a0 0x7f5aec0caf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:44.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.245+0000 7f5af24f3700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5aec0cb8c0 con 0x7f5aec0cb470 2023-10-18T12:41:44.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.245+0000 7f5af24f3700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5aec06f450 con 0x7f5aec15ee50 2023-10-18T12:41:44.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.245+0000 7f5af24f3700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aec06d4e0 con 0x7f5aec06e8a0 2023-10-18T12:41:44.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.245+0000 7f5af0a90700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f5aec0cb470 0x7f5aec06f8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:59360/0 (socket says 172.21.15.114:59360) 2023-10-18T12:41:44.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.245+0000 7f5af0a90700 1 -- 172.21.15.114:0/1600130208 learned_addr learned my addr 172.21.15.114:0/1600130208 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:41:44.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.245+0000 7f5ae3fff700 1 --2- 172.21.15.114:0/1600130208 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5aec06e8a0 0x7f5aec0caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:44.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.249+0000 7f5aeb7fe700 1 -- 172.21.15.114:0/1600130208 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3578065156 0 0) 0x7f5ae4001490 con 0x7f5aec0cb470 2023-10-18T12:41:44.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.249+0000 7f5aeb7fe700 1 -- 172.21.15.114:0/1600130208 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ad80035d0 con 0x7f5aec0cb470 2023-10-18T12:41:44.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.249+0000 7f5aeb7fe700 1 -- 172.21.15.114:0/1600130208 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 208184327 0 0) 0x7f5aec06f450 con 0x7f5aec15ee50 2023-10-18T12:41:44.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.249+0000 7f5aeb7fe700 1 -- 172.21.15.114:0/1600130208 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ae4001490 con 0x7f5aec15ee50 2023-10-18T12:41:44.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.249+0000 7f5aeb7fe700 1 -- 172.21.15.114:0/1600130208 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3704486171 0 0) 0x7f5ad80035d0 con 0x7f5aec0cb470 2023-10-18T12:41:44.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.249+0000 7f5aeb7fe700 1 -- 172.21.15.114:0/1600130208 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5aec06e8a0 msgr2=0x7f5aec0caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:41:44.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.249+0000 7f5aeb7fe700 1 --2- 172.21.15.114:0/1600130208 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5aec06e8a0 0x7f5aec0caf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:44.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.249+0000 7f5aeb7fe700 1 -- 172.21.15.114:0/1600130208 >> v1:172.21.15.172:6789/0 conn(0x7f5aec15ee50 legacy=0x7f5aec0cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:44.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.249+0000 7f5aeb7fe700 1 -- 172.21.15.114:0/1600130208 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aec1624a0 con 0x7f5aec0cb470 2023-10-18T12:41:44.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.249+0000 7f5aeb7fe700 1 -- 172.21.15.114:0/1600130208 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3368469509 0 0) 0x7f5ae4001b80 con 0x7f5aec0cb470 2023-10-18T12:41:44.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.249+0000 7f5aeb7fe700 1 -- 172.21.15.114:0/1600130208 >> v1:172.21.15.114:6789/0 conn(0x7f5aec0cb470 legacy=0x7f5aec06f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:44.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.249+0000 7f5aeb7fe700 1 --2- 172.21.15.114:0/1600130208 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5aec06e8a0 0x7f5ad8003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:44.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.249+0000 7f5aeb7fe700 1 --2- 172.21.15.114:0/1600130208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ad8004190 0x7f5ad8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:44.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.249+0000 7f5aeb7fe700 1 --2- 172.21.15.114:0/1600130208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ad8004db0 0x7f5ad8005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:44.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.249+0000 7f5aeb7fe700 1 -- 172.21.15.114:0/1600130208 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aec06d4e0 con 0x7f5ad8004db0 2023-10-18T12:41:44.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.249+0000 7f5aeb7fe700 1 -- 172.21.15.114:0/1600130208 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad800bb70 con 0x7f5ad8004190 2023-10-18T12:41:44.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.249+0000 7f5aeb7fe700 1 -- 172.21.15.114:0/1600130208 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad800bd30 con 0x7f5aec06e8a0 2023-10-18T12:41:44.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.249+0000 7f5af0a90700 1 --2- 172.21.15.114:0/1600130208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ad8004db0 0x7f5ad8005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:44.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.249+0000 7f5aebfff700 1 --2- 172.21.15.114:0/1600130208 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5aec06e8a0 0x7f5ad8003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:44.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.249+0000 7f5ae3fff700 1 --2- 172.21.15.114:0/1600130208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ad8004190 0x7f5ad8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:44.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.249+0000 7f5af0a90700 1 -- 172.21.15.114:0/1600130208 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5aec06e8a0 msgr2=0x7f5ad8003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:41:44.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.249+0000 7f5af0a90700 1 --2- 172.21.15.114:0/1600130208 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5aec06e8a0 0x7f5ad8003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:44.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.249+0000 7f5af0a90700 1 -- 172.21.15.114:0/1600130208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ad8004190 msgr2=0x7f5ad8004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:41:44.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.249+0000 7f5af0a90700 1 --2- 172.21.15.114:0/1600130208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ad8004190 0x7f5ad8004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:44.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.249+0000 7f5af0a90700 1 -- 172.21.15.114:0/1600130208 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad80035d0 con 0x7f5ad8004db0 2023-10-18T12:41:44.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.249+0000 7f5ae3fff700 1 --2- 172.21.15.114:0/1600130208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ad8004190 0x7f5ad8004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:41:44.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.249+0000 7f5af0a90700 1 --2- 172.21.15.114:0/1600130208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ad8004db0 0x7f5ad8005230 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f5ae400a780 tx=0x7f5ad80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0669f6a01411b5e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:44.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.249+0000 7f5aeb7fe700 1 -- 172.21.15.114:0/1600130208 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae400a360 con 0x7f5ad8004db0 2023-10-18T12:41:44.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.249+0000 7f5aeb7fe700 1 -- 172.21.15.114:0/1600130208 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae40072d0 con 0x7f5ad8004db0 2023-10-18T12:41:44.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.249+0000 7f5aeb7fe700 1 -- 172.21.15.114:0/1600130208 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4007660 con 0x7f5ad8004db0 2023-10-18T12:41:44.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.249+0000 7f5af24f3700 1 -- 172.21.15.114:0/1600130208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ad8004db0 msgr2=0x7f5ad8005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:44.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.249+0000 7f5af24f3700 1 --2- 172.21.15.114:0/1600130208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ad8004db0 0x7f5ad8005230 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f5ae400a780 tx=0x7f5ad80058a0 comp rx=0 tx=0).stop 2023-10-18T12:41:44.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.253+0000 7f5af0a90700 1 -- 172.21.15.114:0/1600130208 reap_dead start 2023-10-18T12:41:44.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.253+0000 7f5af24f3700 1 -- 172.21.15.114:0/1600130208 shutdown_connections 2023-10-18T12:41:44.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.253+0000 7f5af24f3700 1 -- 172.21.15.114:0/1600130208 >> 172.21.15.114:0/1600130208 conn(0x7f5aec06a340 msgr2=0x7f5aec0b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:44.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.253+0000 7f5af24f3700 1 -- 172.21.15.114:0/1600130208 shutdown_connections 2023-10-18T12:41:44.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.253+0000 7f5af24f3700 1 -- 172.21.15.114:0/1600130208 wait complete. 2023-10-18T12:41:44.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.253+0000 7f5af24f3700 1 Processor -- start 2023-10-18T12:41:44.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.253+0000 7f5af24f3700 1 -- start start 2023-10-18T12:41:44.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.257+0000 7f5af24f3700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ad8004db0 0x7f5aec0cc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:44.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.257+0000 7f5af24f3700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5aec1587b0 0x7f5aec158c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:44.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.257+0000 7f5af24f3700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aec15ff90 0x7f5aec160440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:44.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.257+0000 7f5af24f3700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aec159170 con 0x7f5aec15ff90 2023-10-18T12:41:44.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.257+0000 7f5af24f3700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aec0b2570 con 0x7f5ad8004db0 2023-10-18T12:41:44.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.257+0000 7f5af24f3700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aec160980 con 0x7f5aec1587b0 2023-10-18T12:41:44.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.257+0000 7f5af0a90700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aec15ff90 0x7f5aec160440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:44.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.257+0000 7f5aebfff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ad8004db0 0x7f5aec0cc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:44.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.257+0000 7f5af0a90700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aec15ff90 0x7f5aec160440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36260/0 (socket says 172.21.15.114:36260) 2023-10-18T12:41:44.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.257+0000 7f5af0a90700 1 -- 172.21.15.114:0/2224289916 learned_addr learned my addr 172.21.15.114:0/2224289916 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:41:44.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.257+0000 7f5aebfff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ad8004db0 0x7f5aec0cc8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:53294/0 (socket says 172.21.15.114:53294) 2023-10-18T12:41:44.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.257+0000 7f5ae3fff700 1 --2- 172.21.15.114:0/2224289916 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5aec1587b0 0x7f5aec158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:44.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.257+0000 7f5af0a90700 1 -- 172.21.15.114:0/2224289916 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5aec1587b0 msgr2=0x7f5aec158c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:44.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.257+0000 7f5af0a90700 1 --2- 172.21.15.114:0/2224289916 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5aec1587b0 0x7f5aec158c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:44.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.257+0000 7f5af0a90700 1 -- 172.21.15.114:0/2224289916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ad8004db0 msgr2=0x7f5aec0cc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:44.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.257+0000 7f5af0a90700 1 --2- 172.21.15.114:0/2224289916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ad8004db0 0x7f5aec0cc8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:44.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.257+0000 7f5af0a90700 1 -- 172.21.15.114:0/2224289916 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aec0b2810 con 0x7f5aec15ff90 2023-10-18T12:41:44.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.257+0000 7f5af0a90700 1 --2- 172.21.15.114:0/2224289916 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aec15ff90 0x7f5aec160440 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4000f80 tx=0x7f5ae4001e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:44.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.257+0000 7f5ae97fa700 1 -- 172.21.15.114:0/2224289916 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4025030 con 0x7f5aec15ff90 2023-10-18T12:41:44.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.257+0000 7f5ae97fa700 1 -- 172.21.15.114:0/2224289916 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae400ae40 con 0x7f5aec15ff90 2023-10-18T12:41:44.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.257+0000 7f5ae97fa700 1 -- 172.21.15.114:0/2224289916 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae400a360 con 0x7f5aec15ff90 2023-10-18T12:41:44.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.257+0000 7f5af24f3700 1 -- 172.21.15.114:0/2224289916 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aec0b2af0 con 0x7f5aec15ff90 2023-10-18T12:41:44.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.257+0000 7f5af24f3700 1 -- 172.21.15.114:0/2224289916 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aec0b30b0 con 0x7f5aec15ff90 2023-10-18T12:41:44.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.261+0000 7f5af24f3700 1 -- 172.21.15.114:0/2224289916 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aec0b32d0 con 0x7f5aec15ff90 2023-10-18T12:41:44.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.261+0000 7f5ae97fa700 1 -- 172.21.15.114:0/2224289916 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f5ae4028070 con 0x7f5aec15ff90 2023-10-18T12:41:44.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.265+0000 7f5ae97fa700 1 --2- 172.21.15.114:0/2224289916 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5acc065720 0x7f5acc067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:44.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.265+0000 7f5ae97fa700 1 -- 172.21.15.114:0/2224289916 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7f5ae4026070 con 0x7f5aec15ff90 2023-10-18T12:41:44.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.265+0000 7f5aebfff700 1 --2- 172.21.15.114:0/2224289916 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5acc065720 0x7f5acc067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:44.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.265+0000 7f5aebfff700 1 --2- 172.21.15.114:0/2224289916 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5acc065720 0x7f5acc067be0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5aec0ca880 tx=0x7f5adc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:44.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.273+0000 7f5ae97fa700 1 -- 172.21.15.114:0/2224289916 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f5ae4052430 con 0x7f5aec15ff90 2023-10-18T12:41:44.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.449+0000 7f5af24f3700 1 -- 172.21.15.114:0/2224289916 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5aec0cb8c0 con 0x7f5aec15ff90 2023-10-18T12:41:44.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.453+0000 7f5ae97fa700 1 -- 172.21.15.114:0/2224289916 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+19138 (secure 0 0 0) 0x7f5aec0cb8c0 con 0x7f5aec15ff90 2023-10-18T12:41:44.459 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:41:44.459 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":60,"fsid":"240ea340-5d3d-4f52-a4bc-af075aca3deb","created":"2023-10-18T12:19:12.512994+0000","modified":"2023-10-18T12:30:22.735724+0000","last_up_change":"2023-10-18T12:29:29.654825+0000","last_in_change":"2023-10-18T12:19:15.850693+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T12:19:27.040638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-18T12:19:32.358094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-18T12:21:12.105324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-18T12:21:13.154105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c3578978-1a03-4857-b9d2-34a5da3d7731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":49,"up_from":56,"up_thru":57,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1953670272},{"type":"v1","addr":"172.21.15.114:6817","nonce":1953670272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1953670272},{"type":"v1","addr":"172.21.15.114:6820","nonce":1953670272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1953670272},{"type":"v1","addr":"172.21.15.114:6830","nonce":1953670272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":1953670272},{"type":"v1","addr":"172.21.15.114:6825","nonce":1953670272}]},"public_addr":"172.21.15.114:6817/1953670272","cluster_addr":"172.21.15.114:6820/1953670272","heartbeat_back_addr":"172.21.15.114:6830/1953670272","heartbeat_front_addr":"172.21.15.114:6825/1953670272","state":["exists","up"]},{"osd":1,"uuid":"43eb26a6-e2b3-4670-9559-bd053b5140d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6801","nonce":3302727047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6803","nonce":3302727047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6807","nonce":3302727047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6805","nonce":3302727047}]},"public_addr":"172.21.15.114:6801/3302727047","cluster_addr":"172.21.15.114:6803/3302727047","heartbeat_back_addr":"172.21.15.114:6807/3302727047","heartbeat_front_addr":"172.21.15.114:6805/3302727047","state":["exists","up"]},{"osd":2,"uuid":"f3d4dbd5-521c-4dd2-b687-5768cc7d0938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6809","nonce":2699151351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6811","nonce":2699151351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6815","nonce":2699151351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6813","nonce":2699151351}]},"public_addr":"172.21.15.114:6809/2699151351","cluster_addr":"172.21.15.114:6811/2699151351","heartbeat_back_addr":"172.21.15.114:6815/2699151351","heartbeat_front_addr":"172.21.15.114:6813/2699151351","state":["exists","up"]},{"osd":3,"uuid":"823e5802-92b7-4f0d-b32d-a5748993f1b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6821","nonce":1361608073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6824","nonce":1361608073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6829","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6831","nonce":1361608073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6827","nonce":1361608073}]},"public_addr":"172.21.15.114:6821/1361608073","cluster_addr":"172.21.15.114:6824/1361608073","heartbeat_back_addr":"172.21.15.114:6831/1361608073","heartbeat_front_addr":"172.21.15.114:6827/1361608073","state":["exists","up"]},{"osd":4,"uuid":"e47fb93e-13b4-44a4-b084-8c4384ceb41e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6801","nonce":930839681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6803","nonce":930839681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6807","nonce":930839681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6805","nonce":930839681}]},"public_addr":"172.21.15.172:6801/930839681","cluster_addr":"172.21.15.172:6803/930839681","heartbeat_back_addr":"172.21.15.172:6807/930839681","heartbeat_front_addr":"172.21.15.172:6805/930839681","state":["exists","up"]},{"osd":5,"uuid":"7561a973-f479-45a0-af40-f324728d622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6814","nonce":571761850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6818","nonce":571761850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6824","nonce":571761850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6821","nonce":571761850}]},"public_addr":"172.21.15.172:6814/571761850","cluster_addr":"172.21.15.172:6818/571761850","heartbeat_back_addr":"172.21.15.172:6824/571761850","heartbeat_front_addr":"172.21.15.172:6821/571761850","state":["exists","up"]},{"osd":6,"uuid":"51753f4b-7f06-4f1c-9ec7-6e18a66eb980","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6825","nonce":1680398853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6827","nonce":1680398853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6831","nonce":1680398853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6829","nonce":1680398853}]},"public_addr":"172.21.15.172:6825/1680398853","cluster_addr":"172.21.15.172:6827/1680398853","heartbeat_back_addr":"172.21.15.172:6831/1680398853","heartbeat_front_addr":"172.21.15.172:6829/1680398853","state":["exists","up"]},{"osd":7,"uuid":"4d8b1e15-143d-4d17-9074-59d92f0f9af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6809","nonce":349710101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6811","nonce":349710101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6819","nonce":349710101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6815","nonce":349710101}]},"public_addr":"172.21.15.172:6809/349710101","cluster_addr":"172.21.15.172:6811/349710101","heartbeat_back_addr":"172.21.15.172:6819/349710101","heartbeat_front_addr":"172.21.15.172:6815/349710101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"2023-10-18T12:21:50.537022+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.889460+0000","dead_epoch":50},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.475494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.911473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.648596+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.609994+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.636248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.854589+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.885826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.5","mappings":[{"from":7,"to":0}]},{"pgid":"6.9","mappings":[{"from":7,"to":2}]},{"pgid":"6.c","mappings":[{"from":3,"to":0}]},{"pgid":"6.11","mappings":[{"from":3,"to":2}]},{"pgid":"6.1d","mappings":[{"from":5,"to":0}]},{"pgid":"7.12","mappings":[{"from":6,"to":4}]},{"pgid":"7.2d","mappings":[{"from":0,"to":4}]},{"pgid":"7.30","mappings":[{"from":6,"to":4}]},{"pgid":"7.35","mappings":[{"from":0,"to":5}]},{"pgid":"7.36","mappings":[{"from":6,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:0/1817588655":"2023-10-18T13:29:19.822093+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T12:41:44.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.457+0000 7f5af24f3700 1 -- 172.21.15.114:0/2224289916 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5acc065720 msgr2=0x7f5acc067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:44.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.457+0000 7f5af24f3700 1 --2- 172.21.15.114:0/2224289916 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5acc065720 0x7f5acc067be0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5aec0ca880 tx=0x7f5adc009040 comp rx=0 tx=0).stop 2023-10-18T12:41:44.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.457+0000 7f5af24f3700 1 -- 172.21.15.114:0/2224289916 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aec15ff90 msgr2=0x7f5aec160440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:44.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.457+0000 7f5af24f3700 1 --2- 172.21.15.114:0/2224289916 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aec15ff90 0x7f5aec160440 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4000f80 tx=0x7f5ae4001e40 comp rx=0 tx=0).stop 2023-10-18T12:41:44.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.457+0000 7f5af24f3700 1 -- 172.21.15.114:0/2224289916 shutdown_connections 2023-10-18T12:41:44.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.457+0000 7f5af24f3700 1 --2- 172.21.15.114:0/2224289916 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5acc065720 0x7f5acc067be0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:44.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.457+0000 7f5af24f3700 1 --2- 172.21.15.114:0/2224289916 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5aec1587b0 0x7f5aec158c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:44.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.457+0000 7f5af24f3700 1 --2- 172.21.15.114:0/2224289916 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5aec15ff90 0x7f5aec160440 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:44.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.457+0000 7f5af24f3700 1 --2- 172.21.15.114:0/2224289916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5ad8004db0 0x7f5aec0cc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:44.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.457+0000 7f5af24f3700 1 -- 172.21.15.114:0/2224289916 >> 172.21.15.114:0/2224289916 conn(0x7f5aec06a340 msgr2=0x7f5aec0b0420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:44.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.457+0000 7f5af24f3700 1 -- 172.21.15.114:0/2224289916 shutdown_connections 2023-10-18T12:41:44.466 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.457+0000 7f5af24f3700 1 -- 172.21.15.114:0/2224289916 wait complete. 2023-10-18T12:41:44.486 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-18T12:19:27.040638+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-18T12:19:32.358094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-18T12:21:12.105324+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-10-18T12:21:13.154105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-18T12:41:44.487 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-18T12:41:44.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.661+0000 7fa6393c1700 1 Processor -- start 2023-10-18T12:41:44.665 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.661+0000 7fa6393c1700 1 -- start start 2023-10-18T12:41:44.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.661+0000 7fa6393c1700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa63415a410 0x7fa63415a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:44.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.661+0000 7fa6393c1700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa634071120 con 0x7fa63406d090 2023-10-18T12:41:44.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.661+0000 7fa6393c1700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa63415e990 con 0x7fa63406d470 2023-10-18T12:41:44.668 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.661+0000 7fa6393c1700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa63415f4f0 con 0x7fa63415a410 2023-10-18T12:41:44.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.661+0000 7fa632ffd700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa63406d090 0x7fa6340b2590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:59372/0 (socket says 172.21.15.114:59372) 2023-10-18T12:41:44.669 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.661+0000 7fa632ffd700 1 -- 172.21.15.114:0/942077689 learned_addr learned my addr 172.21.15.114:0/942077689 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:41:44.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.665+0000 7fa6337fe700 1 --2- 172.21.15.114:0/942077689 >> v2:172.21.15.172:3300/0 conn(0x7fa63415a410 0x7fa63415a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:44.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.665+0000 7fa631ffb700 1 -- 172.21.15.114:0/942077689 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4198129459 0 0) 0x7fa634071120 con 0x7fa63406d090 2023-10-18T12:41:44.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.665+0000 7fa631ffb700 1 -- 172.21.15.114:0/942077689 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa61c0035d0 con 0x7fa63406d090 2023-10-18T12:41:44.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.665+0000 7fa631ffb700 1 -- 172.21.15.114:0/942077689 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3323950136 0 0) 0x7fa63415e990 con 0x7fa63406d470 2023-10-18T12:41:44.672 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.665+0000 7fa631ffb700 1 -- 172.21.15.114:0/942077689 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa634071120 con 0x7fa63406d470 2023-10-18T12:41:44.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.665+0000 7fa631ffb700 1 -- 172.21.15.114:0/942077689 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4036174433 0 0) 0x7fa61c0035d0 con 0x7fa63406d090 2023-10-18T12:41:44.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.665+0000 7fa631ffb700 1 -- 172.21.15.114:0/942077689 >> v2:172.21.15.172:3300/0 conn(0x7fa63415a410 msgr2=0x7fa63415a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:41:44.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.665+0000 7fa631ffb700 1 --2- 172.21.15.114:0/942077689 >> v2:172.21.15.172:3300/0 conn(0x7fa63415a410 0x7fa63415a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:44.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.665+0000 7fa631ffb700 1 -- 172.21.15.114:0/942077689 >> v1:172.21.15.172:6789/0 conn(0x7fa63406d470 legacy=0x7fa634070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:44.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.665+0000 7fa631ffb700 1 -- 172.21.15.114:0/942077689 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa63415ec50 con 0x7fa63406d090 2023-10-18T12:41:44.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.665+0000 7fa631ffb700 1 -- 172.21.15.114:0/942077689 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3368469509 0 0) 0x7fa6240015f0 con 0x7fa63406d090 2023-10-18T12:41:44.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.665+0000 7fa631ffb700 1 -- 172.21.15.114:0/942077689 >> v1:172.21.15.114:6789/0 conn(0x7fa63406d090 legacy=0x7fa6340b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:44.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.665+0000 7fa631ffb700 1 --2- 172.21.15.114:0/942077689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa61c003c70 0x7fa61c004070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:44.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.665+0000 7fa631ffb700 1 --2- 172.21.15.114:0/942077689 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa61c004870 0x7fa61c004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:44.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.665+0000 7fa631ffb700 1 --2- 172.21.15.114:0/942077689 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa61c0052f0 0x7fa61c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:44.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.665+0000 7fa631ffb700 1 -- 172.21.15.114:0/942077689 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63415f4f0 con 0x7fa61c0052f0 2023-10-18T12:41:44.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.665+0000 7fa631ffb700 1 -- 172.21.15.114:0/942077689 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c00c200 con 0x7fa61c003c70 2023-10-18T12:41:44.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.665+0000 7fa631ffb700 1 -- 172.21.15.114:0/942077689 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa61c00c3c0 con 0x7fa61c004870 2023-10-18T12:41:44.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.665+0000 7fa632ffd700 1 --2- 172.21.15.114:0/942077689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa61c003c70 0x7fa61c004070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:44.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.665+0000 7fa6327fc700 1 --2- 172.21.15.114:0/942077689 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa61c004870 0x7fa61c004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:44.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.665+0000 7fa6337fe700 1 --2- 172.21.15.114:0/942077689 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa61c0052f0 0x7fa61c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:44.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.665+0000 7fa632ffd700 1 -- 172.21.15.114:0/942077689 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa61c004870 msgr2=0x7fa61c004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:41:44.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.665+0000 7fa632ffd700 1 --2- 172.21.15.114:0/942077689 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa61c004870 0x7fa61c004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:44.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.665+0000 7fa632ffd700 1 -- 172.21.15.114:0/942077689 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa61c0052f0 msgr2=0x7fa61c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:41:44.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.665+0000 7fa632ffd700 1 --2- 172.21.15.114:0/942077689 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa61c0052f0 0x7fa61c00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:44.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.665+0000 7fa632ffd700 1 -- 172.21.15.114:0/942077689 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa61c0035d0 con 0x7fa61c003c70 2023-10-18T12:41:44.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.665+0000 7fa6337fe700 1 -- 172.21.15.114:0/942077689 reap_dead start 2023-10-18T12:41:44.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.665+0000 7fa632ffd700 1 --2- 172.21.15.114:0/942077689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa61c003c70 0x7fa61c004070 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa624007fc0 tx=0x7fa61c0058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a45fb28ffc0c036c server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:44.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.665+0000 7fa631ffb700 1 -- 172.21.15.114:0/942077689 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa624007a80 con 0x7fa61c003c70 2023-10-18T12:41:44.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.665+0000 7fa631ffb700 1 -- 172.21.15.114:0/942077689 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa62400cc50 con 0x7fa61c003c70 2023-10-18T12:41:44.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.669+0000 7fa631ffb700 1 -- 172.21.15.114:0/942077689 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa624005980 con 0x7fa61c003c70 2023-10-18T12:41:44.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.669+0000 7fa6393c1700 1 -- 172.21.15.114:0/942077689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa61c003c70 msgr2=0x7fa61c004070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:44.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.669+0000 7fa6393c1700 1 --2- 172.21.15.114:0/942077689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa61c003c70 0x7fa61c004070 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa624007fc0 tx=0x7fa61c0058a0 comp rx=0 tx=0).stop 2023-10-18T12:41:44.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.669+0000 7fa6393c1700 1 -- 172.21.15.114:0/942077689 shutdown_connections 2023-10-18T12:41:44.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.669+0000 7fa6393c1700 1 --2- 172.21.15.114:0/942077689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa61c003c70 0x7fa61c004070 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:44.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.669+0000 7fa6393c1700 1 -- 172.21.15.114:0/942077689 >> 172.21.15.114:0/942077689 conn(0x7fa6340ce5c0 msgr2=0x7fa6340ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:44.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.669+0000 7fa6393c1700 1 -- 172.21.15.114:0/942077689 shutdown_connections 2023-10-18T12:41:44.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.669+0000 7fa6393c1700 1 -- 172.21.15.114:0/942077689 wait complete. 2023-10-18T12:41:44.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.669+0000 7fa6393c1700 1 Processor -- start 2023-10-18T12:41:44.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.669+0000 7fa6393c1700 1 -- start start 2023-10-18T12:41:44.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.673+0000 7fa6393c1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa61c003c70 0x7fa6341466d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:44.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.673+0000 7fa6393c1700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa634143450 0x7fa63415cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:44.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.673+0000 7fa6393c1700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa6340c9470 0x7fa6340c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:44.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.673+0000 7fa6393c1700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63415b740 con 0x7fa61c003c70 2023-10-18T12:41:44.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.673+0000 7fa6393c1700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6340c9e30 con 0x7fa634143450 2023-10-18T12:41:44.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.673+0000 7fa6393c1700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa63415bb60 con 0x7fa6340c9470 2023-10-18T12:41:44.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.673+0000 7fa632ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa61c003c70 0x7fa6341466d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:44.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.673+0000 7fa632ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa61c003c70 0x7fa6341466d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36284/0 (socket says 172.21.15.114:36284) 2023-10-18T12:41:44.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.673+0000 7fa632ffd700 1 -- 172.21.15.114:0/993815381 learned_addr learned my addr 172.21.15.114:0/993815381 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:41:44.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.673+0000 7fa6327fc700 1 --2- 172.21.15.114:0/993815381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa634143450 0x7fa63415cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:44.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.673+0000 7fa6337fe700 1 --2- 172.21.15.114:0/993815381 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa6340c9470 0x7fa6340c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:44.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.673+0000 7fa632ffd700 1 -- 172.21.15.114:0/993815381 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa6340c9470 msgr2=0x7fa6340c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:44.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.673+0000 7fa632ffd700 1 --2- 172.21.15.114:0/993815381 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa6340c9470 0x7fa6340c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:44.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.673+0000 7fa632ffd700 1 -- 172.21.15.114:0/993815381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa634143450 msgr2=0x7fa63415cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:44.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.673+0000 7fa632ffd700 1 --2- 172.21.15.114:0/993815381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa634143450 0x7fa63415cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:44.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.673+0000 7fa632ffd700 1 -- 172.21.15.114:0/993815381 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa634154280 con 0x7fa61c003c70 2023-10-18T12:41:44.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.673+0000 7fa632ffd700 1 --2- 172.21.15.114:0/993815381 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa61c003c70 0x7fa6341466d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fa62400c6a0 tx=0x7fa6240018b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:44.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.673+0000 7fa61b7fe700 1 -- 172.21.15.114:0/993815381 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6240070d0 con 0x7fa61c003c70 2023-10-18T12:41:44.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.673+0000 7fa61b7fe700 1 -- 172.21.15.114:0/993815381 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa624007230 con 0x7fa61c003c70 2023-10-18T12:41:44.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.673+0000 7fa61b7fe700 1 -- 172.21.15.114:0/993815381 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6240075c0 con 0x7fa61c003c70 2023-10-18T12:41:44.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.673+0000 7fa6393c1700 1 -- 172.21.15.114:0/993815381 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa63415d4e0 con 0x7fa61c003c70 2023-10-18T12:41:44.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.673+0000 7fa6393c1700 1 -- 172.21.15.114:0/993815381 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa63415b360 con 0x7fa61c003c70 2023-10-18T12:41:44.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.677+0000 7fa6393c1700 1 -- 172.21.15.114:0/993815381 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa63415b520 con 0x7fa61c003c70 2023-10-18T12:41:44.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.677+0000 7fa61b7fe700 1 -- 172.21.15.114:0/993815381 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fa624007720 con 0x7fa61c003c70 2023-10-18T12:41:44.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.681+0000 7fa61b7fe700 1 --2- 172.21.15.114:0/993815381 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa620065720 0x7fa620067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:44.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.681+0000 7fa61b7fe700 1 -- 172.21.15.114:0/993815381 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7fa624084480 con 0x7fa61c003c70 2023-10-18T12:41:44.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.681+0000 7fa6327fc700 1 --2- 172.21.15.114:0/993815381 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa620065720 0x7fa620067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:44.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.681+0000 7fa6327fc700 1 --2- 172.21.15.114:0/993815381 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa620065720 0x7fa620067be0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa6340c5440 tx=0x7fa628009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:44.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.685+0000 7fa61b7fe700 1 -- 172.21.15.114:0/993815381 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fa624051ca0 con 0x7fa61c003c70 2023-10-18T12:41:44.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.861+0000 7fa6393c1700 1 -- 172.21.15.114:0/993815381 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa63415f1e0 con 0x7fa61c003c70 2023-10-18T12:41:44.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.861+0000 7fa61b7fe700 1 -- 172.21.15.114:0/993815381 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa6240552c0 con 0x7fa61c003c70 2023-10-18T12:41:44.866 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-10-18T12:41:44.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.865+0000 7fa6393c1700 1 -- 172.21.15.114:0/993815381 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa620065720 msgr2=0x7fa620067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:44.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.865+0000 7fa6393c1700 1 --2- 172.21.15.114:0/993815381 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa620065720 0x7fa620067be0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa6340c5440 tx=0x7fa628009040 comp rx=0 tx=0).stop 2023-10-18T12:41:44.869 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.865+0000 7fa6393c1700 1 -- 172.21.15.114:0/993815381 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa61c003c70 msgr2=0x7fa6341466d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:44.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.865+0000 7fa6393c1700 1 --2- 172.21.15.114:0/993815381 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa61c003c70 0x7fa6341466d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fa62400c6a0 tx=0x7fa6240018b0 comp rx=0 tx=0).stop 2023-10-18T12:41:44.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.865+0000 7fa6393c1700 1 -- 172.21.15.114:0/993815381 shutdown_connections 2023-10-18T12:41:44.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.865+0000 7fa6393c1700 1 --2- 172.21.15.114:0/993815381 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa620065720 0x7fa620067be0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:44.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.865+0000 7fa6393c1700 1 --2- 172.21.15.114:0/993815381 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa6340c9470 0x7fa6340c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:44.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.865+0000 7fa6393c1700 1 --2- 172.21.15.114:0/993815381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa634143450 0x7fa63415cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:44.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.865+0000 7fa6393c1700 1 --2- 172.21.15.114:0/993815381 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa61c003c70 0x7fa6341466d0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:44.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.865+0000 7fa6393c1700 1 -- 172.21.15.114:0/993815381 >> 172.21.15.114:0/993815381 conn(0x7fa6340ce5c0 msgr2=0x7fa6340b3980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:44.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.865+0000 7fa6393c1700 1 -- 172.21.15.114:0/993815381 shutdown_connections 2023-10-18T12:41:44.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:44.865+0000 7fa6393c1700 1 -- 172.21.15.114:0/993815381 wait complete. 2023-10-18T12:41:44.889 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-18T12:41:45.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.069+0000 7f6339786700 1 Processor -- start 2023-10-18T12:41:45.074 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.069+0000 7f6339786700 1 -- start start 2023-10-18T12:41:45.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.073+0000 7f6339786700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63340d2e00 0x7f63340b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:45.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.073+0000 7f6339786700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f63340b5ae0 0x7f633406db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:45.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.073+0000 7f6339786700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f633415d0d0 con 0x7f6334160710 2023-10-18T12:41:45.078 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.073+0000 7f6339786700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f633415df90 con 0x7f63340b5ae0 2023-10-18T12:41:45.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.073+0000 7f6339786700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f633406f0f0 con 0x7f63340d2e00 2023-10-18T12:41:45.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.073+0000 7f63327fc700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f6334160710 0x7f63340d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60214/0 (socket says 172.21.15.114:60214) 2023-10-18T12:41:45.079 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.073+0000 7f63327fc700 1 -- 172.21.15.114:0/3071487274 learned_addr learned my addr 172.21.15.114:0/3071487274 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:41:45.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.073+0000 7f63337fe700 1 --2- 172.21.15.114:0/3071487274 >> v2:172.21.15.114:3300/0 conn(0x7f63340b5ae0 0x7f633406db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:45.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.073+0000 7f6332ffd700 1 --2- 172.21.15.114:0/3071487274 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63340d2e00 0x7f63340b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:45.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.073+0000 7f6331ffb700 1 -- 172.21.15.114:0/3071487274 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2063823330 0 0) 0x7f6328001110 con 0x7f6334160710 2023-10-18T12:41:45.081 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.073+0000 7f6331ffb700 1 -- 172.21.15.114:0/3071487274 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f631c0035d0 con 0x7f6334160710 2023-10-18T12:41:45.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.073+0000 7f6331ffb700 1 -- 172.21.15.114:0/3071487274 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1422015697 0 0) 0x7f631c0035d0 con 0x7f6334160710 2023-10-18T12:41:45.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.073+0000 7f6331ffb700 1 -- 172.21.15.114:0/3071487274 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63340d2e00 msgr2=0x7f63340b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:41:45.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.073+0000 7f6331ffb700 1 --2- 172.21.15.114:0/3071487274 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63340d2e00 0x7f63340b6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:45.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.073+0000 7f6331ffb700 1 -- 172.21.15.114:0/3071487274 >> v2:172.21.15.114:3300/0 conn(0x7f63340b5ae0 msgr2=0x7f633406db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:41:45.082 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.073+0000 7f6331ffb700 1 --2- 172.21.15.114:0/3071487274 >> v2:172.21.15.114:3300/0 conn(0x7f63340b5ae0 0x7f633406db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:45.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.073+0000 7f6331ffb700 1 -- 172.21.15.114:0/3071487274 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f633415d310 con 0x7f6334160710 2023-10-18T12:41:45.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.073+0000 7f6331ffb700 1 -- 172.21.15.114:0/3071487274 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3368469509 0 0) 0x7f6328001800 con 0x7f6334160710 2023-10-18T12:41:45.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.073+0000 7f6331ffb700 1 -- 172.21.15.114:0/3071487274 >> v1:172.21.15.114:6789/0 conn(0x7f6334160710 legacy=0x7f63340d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:45.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.073+0000 7f6331ffb700 1 --2- 172.21.15.114:0/3071487274 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63340d2e00 0x7f631c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:45.083 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.073+0000 7f6331ffb700 1 --2- 172.21.15.114:0/3071487274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f631c004010 0x7f631c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:45.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.073+0000 7f6331ffb700 1 --2- 172.21.15.114:0/3071487274 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f631c004db0 0x7f631c005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:45.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.073+0000 7f6331ffb700 1 -- 172.21.15.114:0/3071487274 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633415df90 con 0x7f631c004db0 2023-10-18T12:41:45.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.073+0000 7f6331ffb700 1 -- 172.21.15.114:0/3071487274 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633406f0f0 con 0x7f631c004010 2023-10-18T12:41:45.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.073+0000 7f6331ffb700 1 -- 172.21.15.114:0/3071487274 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f631c00ba60 con 0x7f63340d2e00 2023-10-18T12:41:45.084 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.073+0000 7f63337fe700 1 --2- 172.21.15.114:0/3071487274 >> v2:172.21.15.114:3300/0 conn(0x7f63340b5ae0 0x7f633406db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:41:45.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.073+0000 7f63337fe700 1 --2- 172.21.15.114:0/3071487274 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f631c004db0 0x7f631c005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:45.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.077+0000 7f63327fc700 1 --2- 172.21.15.114:0/3071487274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f631c004010 0x7f631c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:45.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.077+0000 7f6332ffd700 1 --2- 172.21.15.114:0/3071487274 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63340d2e00 0x7f631c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:45.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.077+0000 7f63337fe700 1 -- 172.21.15.114:0/3071487274 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63340d2e00 msgr2=0x7f631c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:41:45.085 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.077+0000 7f63337fe700 1 --2- 172.21.15.114:0/3071487274 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63340d2e00 0x7f631c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:45.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.077+0000 7f63337fe700 1 -- 172.21.15.114:0/3071487274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f631c004010 msgr2=0x7f631c004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:41:45.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.077+0000 7f63337fe700 1 --2- 172.21.15.114:0/3071487274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f631c004010 0x7f631c004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:45.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.077+0000 7f63337fe700 1 -- 172.21.15.114:0/3071487274 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f631c0035d0 con 0x7f631c004db0 2023-10-18T12:41:45.087 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.077+0000 7f63337fe700 1 --2- 172.21.15.114:0/3071487274 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f631c004db0 0x7f631c005230 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f632c00e350 tx=0x7f631c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfb14f9124fb4661 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:45.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.077+0000 7f6331ffb700 1 -- 172.21.15.114:0/3071487274 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c00ee10 con 0x7f631c004db0 2023-10-18T12:41:45.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.077+0000 7f6331ffb700 1 -- 172.21.15.114:0/3071487274 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632c00f040 con 0x7f631c004db0 2023-10-18T12:41:45.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.077+0000 7f6331ffb700 1 -- 172.21.15.114:0/3071487274 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632c003cb0 con 0x7f631c004db0 2023-10-18T12:41:45.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.077+0000 7f6339786700 1 -- 172.21.15.114:0/3071487274 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f631c004db0 msgr2=0x7f631c005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:45.088 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.077+0000 7f6339786700 1 --2- 172.21.15.114:0/3071487274 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f631c004db0 0x7f631c005230 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f632c00e350 tx=0x7f631c0058a0 comp rx=0 tx=0).stop 2023-10-18T12:41:45.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.077+0000 7f63337fe700 1 -- 172.21.15.114:0/3071487274 reap_dead start 2023-10-18T12:41:45.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.077+0000 7f6339786700 1 -- 172.21.15.114:0/3071487274 shutdown_connections 2023-10-18T12:41:45.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.077+0000 7f6339786700 1 -- 172.21.15.114:0/3071487274 >> 172.21.15.114:0/3071487274 conn(0x7f6334069f20 msgr2=0x7f633406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:45.089 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.077+0000 7f6339786700 1 -- 172.21.15.114:0/3071487274 shutdown_connections 2023-10-18T12:41:45.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.077+0000 7f6339786700 1 -- 172.21.15.114:0/3071487274 wait complete. 2023-10-18T12:41:45.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.081+0000 7f6339786700 1 Processor -- start 2023-10-18T12:41:45.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.081+0000 7f6339786700 1 -- start start 2023-10-18T12:41:45.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.085+0000 7f6339786700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6334158210 0x7f63340ac8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:45.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.085+0000 7f6339786700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f633415e2c0 0x7f633415e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:45.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.085+0000 7f6339786700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63340b24d0 0x7f63340b2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:45.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.085+0000 7f6339786700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633415ec60 con 0x7f633415e2c0 2023-10-18T12:41:45.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.085+0000 7f6339786700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63340ab8e0 con 0x7f6334158210 2023-10-18T12:41:45.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.085+0000 7f6339786700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63340ace30 con 0x7f63340b24d0 2023-10-18T12:41:45.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.085+0000 7f63327fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f633415e2c0 0x7f633415e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:45.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.085+0000 7f63327fc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f633415e2c0 0x7f633415e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39552/0 (socket says 172.21.15.114:39552) 2023-10-18T12:41:45.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.085+0000 7f63327fc700 1 -- 172.21.15.114:0/3983957640 learned_addr learned my addr 172.21.15.114:0/3983957640 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:41:45.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.085+0000 7f6332ffd700 1 --2- 172.21.15.114:0/3983957640 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6334158210 0x7f63340ac8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:45.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.085+0000 7f63337fe700 1 --2- 172.21.15.114:0/3983957640 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63340b24d0 0x7f63340b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:45.094 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.085+0000 7f63327fc700 1 -- 172.21.15.114:0/3983957640 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63340b24d0 msgr2=0x7f63340b2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:45.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.085+0000 7f63327fc700 1 --2- 172.21.15.114:0/3983957640 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63340b24d0 0x7f63340b2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:45.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.085+0000 7f63327fc700 1 -- 172.21.15.114:0/3983957640 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6334158210 msgr2=0x7f63340ac8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:45.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.085+0000 7f63327fc700 1 --2- 172.21.15.114:0/3983957640 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6334158210 0x7f63340ac8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:45.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.085+0000 7f63327fc700 1 -- 172.21.15.114:0/3983957640 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63340abb30 con 0x7f633415e2c0 2023-10-18T12:41:45.095 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.085+0000 7f63327fc700 1 --2- 172.21.15.114:0/3983957640 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f633415e2c0 0x7f633415e720 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f6328001930 tx=0x7f6328007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:45.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.085+0000 7f631b7fe700 1 -- 172.21.15.114:0/3983957640 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6328007800 con 0x7f633415e2c0 2023-10-18T12:41:45.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.085+0000 7f631b7fe700 1 -- 172.21.15.114:0/3983957640 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632800f8d0 con 0x7f633415e2c0 2023-10-18T12:41:45.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.085+0000 7f631b7fe700 1 -- 172.21.15.114:0/3983957640 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632800fc60 con 0x7f633415e2c0 2023-10-18T12:41:45.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.085+0000 7f6339786700 1 -- 172.21.15.114:0/3983957640 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63340abe10 con 0x7f633415e2c0 2023-10-18T12:41:45.096 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.085+0000 7f6339786700 1 -- 172.21.15.114:0/3983957640 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63340ac3d0 con 0x7f633415e2c0 2023-10-18T12:41:45.097 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.089+0000 7f6339786700 1 -- 172.21.15.114:0/3983957640 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f633404e910 con 0x7f633415e2c0 2023-10-18T12:41:45.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.089+0000 7f631b7fe700 1 -- 172.21.15.114:0/3983957640 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f632801d460 con 0x7f633415e2c0 2023-10-18T12:41:45.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.089+0000 7f631b7fe700 1 --2- 172.21.15.114:0/3983957640 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f63200656f0 0x7f6320067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:45.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.089+0000 7f631b7fe700 1 -- 172.21.15.114:0/3983957640 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7f6328083030 con 0x7f633415e2c0 2023-10-18T12:41:45.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.089+0000 7f6332ffd700 1 --2- 172.21.15.114:0/3983957640 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f63200656f0 0x7f6320067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:45.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.093+0000 7f6332ffd700 1 --2- 172.21.15.114:0/3983957640 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f63200656f0 0x7f6320067bb0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6324009ac0 tx=0x7f6324008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:45.101 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.097+0000 7f631b7fe700 1 -- 172.21.15.114:0/3983957640 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f63280b3d40 con 0x7f633415e2c0 2023-10-18T12:41:45.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.269+0000 7f6339786700 1 -- 172.21.15.114:0/3983957640 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f633415d0d0 con 0x7f633415e2c0 2023-10-18T12:41:45.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.269+0000 7f631b7fe700 1 -- 172.21.15.114:0/3983957640 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v60) v1 ==== 92+0+10 (secure 0 0 0) 0x7f633415d0d0 con 0x7f633415e2c0 2023-10-18T12:41:45.276 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 8 2023-10-18T12:41:45.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.273+0000 7f6339786700 1 -- 172.21.15.114:0/3983957640 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f63200656f0 msgr2=0x7f6320067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:45.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.273+0000 7f6339786700 1 --2- 172.21.15.114:0/3983957640 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f63200656f0 0x7f6320067bb0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6324009ac0 tx=0x7f6324008040 comp rx=0 tx=0).stop 2023-10-18T12:41:45.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.273+0000 7f6339786700 1 -- 172.21.15.114:0/3983957640 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f633415e2c0 msgr2=0x7f633415e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:45.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.273+0000 7f6339786700 1 --2- 172.21.15.114:0/3983957640 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f633415e2c0 0x7f633415e720 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f6328001930 tx=0x7f6328007620 comp rx=0 tx=0).stop 2023-10-18T12:41:45.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.273+0000 7f6339786700 1 -- 172.21.15.114:0/3983957640 shutdown_connections 2023-10-18T12:41:45.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.273+0000 7f6339786700 1 --2- 172.21.15.114:0/3983957640 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f63200656f0 0x7f6320067bb0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:45.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.273+0000 7f6339786700 1 --2- 172.21.15.114:0/3983957640 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f63340b24d0 0x7f63340b2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:45.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.273+0000 7f6339786700 1 --2- 172.21.15.114:0/3983957640 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f633415e2c0 0x7f633415e720 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:45.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.273+0000 7f6339786700 1 --2- 172.21.15.114:0/3983957640 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6334158210 0x7f63340ac8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:45.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.273+0000 7f6339786700 1 -- 172.21.15.114:0/3983957640 >> 172.21.15.114:0/3983957640 conn(0x7f6334069f20 msgr2=0x7f633406da60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:45.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.273+0000 7f6339786700 1 -- 172.21.15.114:0/3983957640 shutdown_connections 2023-10-18T12:41:45.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.273+0000 7f6339786700 1 -- 172.21.15.114:0/3983957640 wait complete. 2023-10-18T12:41:45.299 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-18T12:41:45.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.481+0000 7faf49851700 1 Processor -- start 2023-10-18T12:41:45.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.481+0000 7faf49851700 1 -- start start 2023-10-18T12:41:45.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.481+0000 7faf49851700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faf4415adf0 0x7faf440cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:45.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.481+0000 7faf49851700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7faf44070460 0x7faf440708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:45.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.481+0000 7faf49851700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf4415b1d0 con 0x7faf440cce10 2023-10-18T12:41:45.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.481+0000 7faf49851700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf440ca590 con 0x7faf44070460 2023-10-18T12:41:45.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.481+0000 7faf49851700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf44070e30 con 0x7faf4415adf0 2023-10-18T12:41:45.488 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.481+0000 7faf437fe700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7faf44070460 0x7faf440708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:45.488 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.481+0000 7faf3bfff700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7faf440cce10 0x7faf440b1940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60226/0 (socket says 172.21.15.114:60226) 2023-10-18T12:41:45.488 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.481+0000 7faf3bfff700 1 -- 172.21.15.114:0/249856188 learned_addr learned my addr 172.21.15.114:0/249856188 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:41:45.488 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.481+0000 7faf42ffd700 1 --2- 172.21.15.114:0/249856188 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faf4415adf0 0x7faf440cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:45.488 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.481+0000 7faf437fe700 1 -- 172.21.15.114:0/249856188 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faf4415adf0 msgr2=0x7faf440cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:41:45.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.481+0000 7faf437fe700 1 --2- 172.21.15.114:0/249856188 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faf4415adf0 0x7faf440cc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:45.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.481+0000 7faf437fe700 1 -- 172.21.15.114:0/249856188 >> v1:172.21.15.114:6789/0 conn(0x7faf440cce10 legacy=0x7faf440b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:45.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.481+0000 7faf437fe700 1 -- 172.21.15.114:0/249856188 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf440ce600 con 0x7faf44070460 2023-10-18T12:41:45.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.481+0000 7faf437fe700 1 --2- 172.21.15.114:0/249856188 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf44070460 0x7faf440708f0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7faf3c009d90 tx=0x7faf3c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a63e28bf5cd43bec server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:45.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.485+0000 7faf427fc700 1 -- 172.21.15.114:0/249856188 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3c00e070 con 0x7faf44070460 2023-10-18T12:41:45.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.485+0000 7faf427fc700 1 -- 172.21.15.114:0/249856188 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf3c00bb20 con 0x7faf44070460 2023-10-18T12:41:45.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.485+0000 7faf427fc700 1 -- 172.21.15.114:0/249856188 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3c012430 con 0x7faf44070460 2023-10-18T12:41:45.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.485+0000 7faf49851700 1 -- 172.21.15.114:0/249856188 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf44070460 msgr2=0x7faf440708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:45.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.485+0000 7faf49851700 1 --2- 172.21.15.114:0/249856188 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf44070460 0x7faf440708f0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7faf3c009d90 tx=0x7faf3c00b330 comp rx=0 tx=0).stop 2023-10-18T12:41:45.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.485+0000 7faf49851700 1 -- 172.21.15.114:0/249856188 shutdown_connections 2023-10-18T12:41:45.492 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.485+0000 7faf49851700 1 --2- 172.21.15.114:0/249856188 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf44070460 0x7faf440708f0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:45.492 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.485+0000 7faf49851700 1 --2- 172.21.15.114:0/249856188 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faf4415adf0 0x7faf440cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:45.492 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.485+0000 7faf49851700 1 -- 172.21.15.114:0/249856188 >> 172.21.15.114:0/249856188 conn(0x7faf440ce820 msgr2=0x7faf440cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:45.492 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.485+0000 7faf49851700 1 -- 172.21.15.114:0/249856188 shutdown_connections 2023-10-18T12:41:45.492 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.485+0000 7faf49851700 1 -- 172.21.15.114:0/249856188 wait complete. 2023-10-18T12:41:45.493 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.485+0000 7faf49851700 1 Processor -- start 2023-10-18T12:41:45.493 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.489+0000 7faf49851700 1 -- start start 2023-10-18T12:41:45.494 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.489+0000 7faf49851700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faf44070460 0x7faf44159180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:45.494 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.489+0000 7faf49851700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf440cce10 0x7faf441f3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:45.494 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.489+0000 7faf49851700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf4415adf0 0x7faf4415ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:45.494 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.489+0000 7faf49851700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf441596c0 con 0x7faf440cce10 2023-10-18T12:41:45.495 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.489+0000 7faf49851700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf4406cf40 con 0x7faf4415adf0 2023-10-18T12:41:45.495 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.489+0000 7faf49851700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf4406dac0 con 0x7faf44070460 2023-10-18T12:41:45.496 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.489+0000 7faf3bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf440cce10 0x7faf441f3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:45.497 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.489+0000 7faf3bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf440cce10 0x7faf441f3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39572/0 (socket says 172.21.15.114:39572) 2023-10-18T12:41:45.497 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.489+0000 7faf3bfff700 1 -- 172.21.15.114:0/1890020929 learned_addr learned my addr 172.21.15.114:0/1890020929 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:41:45.497 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.489+0000 7faf42ffd700 1 --2- 172.21.15.114:0/1890020929 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faf44070460 0x7faf44159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:45.497 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.489+0000 7faf437fe700 1 --2- 172.21.15.114:0/1890020929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf4415adf0 0x7faf4415ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:45.497 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.489+0000 7faf3bfff700 1 -- 172.21.15.114:0/1890020929 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faf44070460 msgr2=0x7faf44159180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:45.498 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.489+0000 7faf3bfff700 1 --2- 172.21.15.114:0/1890020929 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faf44070460 0x7faf44159180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:45.498 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.489+0000 7faf3bfff700 1 -- 172.21.15.114:0/1890020929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf4415adf0 msgr2=0x7faf4415ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:45.498 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.489+0000 7faf3bfff700 1 --2- 172.21.15.114:0/1890020929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf4415adf0 0x7faf4415ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:45.498 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.489+0000 7faf3bfff700 1 -- 172.21.15.114:0/1890020929 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3c009a70 con 0x7faf440cce10 2023-10-18T12:41:45.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.489+0000 7faf42ffd700 1 --2- 172.21.15.114:0/1890020929 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faf44070460 0x7faf44159180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:41:45.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.489+0000 7faf3bfff700 1 --2- 172.21.15.114:0/1890020929 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf440cce10 0x7faf441f3520 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7faf2c00c700 tx=0x7faf2c00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:45.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.489+0000 7faf40ff9700 1 -- 172.21.15.114:0/1890020929 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c005d90 con 0x7faf440cce10 2023-10-18T12:41:45.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.489+0000 7faf40ff9700 1 -- 172.21.15.114:0/1890020929 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2c0070d0 con 0x7faf440cce10 2023-10-18T12:41:45.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.489+0000 7faf40ff9700 1 -- 172.21.15.114:0/1890020929 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c007440 con 0x7faf440cce10 2023-10-18T12:41:45.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.489+0000 7faf49851700 1 -- 172.21.15.114:0/1890020929 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf4406d190 con 0x7faf440cce10 2023-10-18T12:41:45.500 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.489+0000 7faf49851700 1 -- 172.21.15.114:0/1890020929 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf4406d750 con 0x7faf440cce10 2023-10-18T12:41:45.501 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.493+0000 7faf49851700 1 -- 172.21.15.114:0/1890020929 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf4406d8e0 con 0x7faf440cce10 2023-10-18T12:41:45.501 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.493+0000 7faf40ff9700 1 -- 172.21.15.114:0/1890020929 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7faf2c0075a0 con 0x7faf440cce10 2023-10-18T12:41:45.501 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.493+0000 7faf40ff9700 1 --2- 172.21.15.114:0/1890020929 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7faf24065720 0x7faf24067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:45.501 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.497+0000 7faf40ff9700 1 -- 172.21.15.114:0/1890020929 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7faf2c082320 con 0x7faf440cce10 2023-10-18T12:41:45.502 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.497+0000 7faf42ffd700 1 --2- 172.21.15.114:0/1890020929 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7faf24065720 0x7faf24067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:45.502 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.497+0000 7faf42ffd700 1 --2- 172.21.15.114:0/1890020929 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7faf24065720 0x7faf24067be0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7faf34009c40 tx=0x7faf34008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:45.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.501+0000 7faf40ff9700 1 -- 172.21.15.114:0/1890020929 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7faf2c04fb70 con 0x7faf440cce10 2023-10-18T12:41:45.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.733+0000 7faf49851700 1 -- 172.21.15.114:0/1890020929 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faf4415b1d0 con 0x7faf440cce10 2023-10-18T12:41:45.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.733+0000 7faf40ff9700 1 -- 172.21.15.114:0/1890020929 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v60) v1 ==== 104+0+11 (secure 0 0 0) 0x7faf4415b1d0 con 0x7faf440cce10 2023-10-18T12:41:45.738 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-10-18T12:41:45.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.737+0000 7faf49851700 1 -- 172.21.15.114:0/1890020929 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7faf24065720 msgr2=0x7faf24067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:45.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.737+0000 7faf49851700 1 --2- 172.21.15.114:0/1890020929 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7faf24065720 0x7faf24067be0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7faf34009c40 tx=0x7faf34008040 comp rx=0 tx=0).stop 2023-10-18T12:41:45.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.737+0000 7faf49851700 1 -- 172.21.15.114:0/1890020929 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf440cce10 msgr2=0x7faf441f3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:45.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.737+0000 7faf49851700 1 --2- 172.21.15.114:0/1890020929 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf440cce10 0x7faf441f3520 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7faf2c00c700 tx=0x7faf2c00cac0 comp rx=0 tx=0).stop 2023-10-18T12:41:45.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.737+0000 7faf49851700 1 -- 172.21.15.114:0/1890020929 shutdown_connections 2023-10-18T12:41:45.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.737+0000 7faf49851700 1 --2- 172.21.15.114:0/1890020929 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7faf24065720 0x7faf24067be0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:45.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.737+0000 7faf49851700 1 --2- 172.21.15.114:0/1890020929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf4415adf0 0x7faf4415ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:45.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.737+0000 7faf49851700 1 --2- 172.21.15.114:0/1890020929 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faf440cce10 0x7faf441f3520 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:45.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.737+0000 7faf49851700 1 --2- 172.21.15.114:0/1890020929 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faf44070460 0x7faf44159180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:45.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.737+0000 7faf49851700 1 -- 172.21.15.114:0/1890020929 >> 172.21.15.114:0/1890020929 conn(0x7faf440ce820 msgr2=0x7faf440c9330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:45.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.737+0000 7faf49851700 1 -- 172.21.15.114:0/1890020929 shutdown_connections 2023-10-18T12:41:45.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.737+0000 7faf49851700 1 -- 172.21.15.114:0/1890020929 wait complete. 2023-10-18T12:41:45.771 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-18T12:41:45.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.957+0000 7fdb92a11700 1 Processor -- start 2023-10-18T12:41:45.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.957+0000 7fdb92a11700 1 -- start start 2023-10-18T12:41:45.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.957+0000 7fdb92a11700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdb8c0b61f0 0x7fdb8c15bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:45.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.957+0000 7fdb92a11700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb8c15c0f0 con 0x7fdb8c0afb00 2023-10-18T12:41:45.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.957+0000 7fdb92a11700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb8c070d80 con 0x7fdb8c0cb1f0 2023-10-18T12:41:45.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.957+0000 7fdb92a11700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb8c06f5d0 con 0x7fdb8c0b61f0 2023-10-18T12:41:45.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.957+0000 7fdb8bfff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdb8c0b61f0 0x7fdb8c15bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:45.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.957+0000 7fdb837fe700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fdb8c0afb00 0x7fdb8c070670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60234/0 (socket says 172.21.15.114:60234) 2023-10-18T12:41:45.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.957+0000 7fdb837fe700 1 -- 172.21.15.114:0/2430541298 learned_addr learned my addr 172.21.15.114:0/2430541298 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:41:45.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.961+0000 7fdb8bfff700 1 -- 172.21.15.114:0/2430541298 >> v1:172.21.15.172:6789/0 conn(0x7fdb8c0cb1f0 legacy=0x7fdb8c15c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:45.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.961+0000 7fdb8bfff700 1 -- 172.21.15.114:0/2430541298 >> v1:172.21.15.114:6789/0 conn(0x7fdb8c0afb00 legacy=0x7fdb8c070670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:45.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.961+0000 7fdb8bfff700 1 -- 172.21.15.114:0/2430541298 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb8c06f8b0 con 0x7fdb8c0b61f0 2023-10-18T12:41:45.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.961+0000 7fdb8b7fe700 1 -- 172.21.15.114:0/2430541298 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3596173644 0 0) 0x7fdb8c15c0f0 con 0x7fdb8c0afb00 2023-10-18T12:41:45.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.961+0000 7fdb8bfff700 1 --2- 172.21.15.114:0/2430541298 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb8c0b61f0 0x7fdb8c15bbb0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c009d90 tx=0x7fdb7c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae4d0968ce183355 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:45.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.961+0000 7fdb8b7fe700 1 -- 172.21.15.114:0/2430541298 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c00e070 con 0x7fdb8c0b61f0 2023-10-18T12:41:45.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.961+0000 7fdb8b7fe700 1 -- 172.21.15.114:0/2430541298 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb7c00bbd0 con 0x7fdb8c0b61f0 2023-10-18T12:41:45.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.961+0000 7fdb8b7fe700 1 -- 172.21.15.114:0/2430541298 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c012430 con 0x7fdb8c0b61f0 2023-10-18T12:41:45.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.961+0000 7fdb92a11700 1 -- 172.21.15.114:0/2430541298 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb8c0b61f0 msgr2=0x7fdb8c15bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:45.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.961+0000 7fdb92a11700 1 --2- 172.21.15.114:0/2430541298 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb8c0b61f0 0x7fdb8c15bbb0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c009d90 tx=0x7fdb7c00b330 comp rx=0 tx=0).stop 2023-10-18T12:41:45.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.961+0000 7fdb92a11700 1 -- 172.21.15.114:0/2430541298 shutdown_connections 2023-10-18T12:41:45.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.961+0000 7fdb92a11700 1 --2- 172.21.15.114:0/2430541298 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb8c0b61f0 0x7fdb8c15bbb0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:45.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.961+0000 7fdb92a11700 1 -- 172.21.15.114:0/2430541298 >> 172.21.15.114:0/2430541298 conn(0x7fdb8c0d0990 msgr2=0x7fdb8c0d0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:45.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.961+0000 7fdb92a11700 1 -- 172.21.15.114:0/2430541298 shutdown_connections 2023-10-18T12:41:45.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.961+0000 7fdb92a11700 1 -- 172.21.15.114:0/2430541298 wait complete. 2023-10-18T12:41:45.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.965+0000 7fdb92a11700 1 Processor -- start 2023-10-18T12:41:45.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.965+0000 7fdb92a11700 1 -- start start 2023-10-18T12:41:45.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.969+0000 7fdb92a11700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdb8c0afb00 0x7fdb8c153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:45.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.969+0000 7fdb92a11700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb8c0b61f0 0x7fdb8c06b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:45.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.969+0000 7fdb92a11700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb8c0cb1f0 0x7fdb8c159c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:45.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.969+0000 7fdb92a11700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8c0c9dd0 con 0x7fdb8c0cb1f0 2023-10-18T12:41:45.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.969+0000 7fdb92a11700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8c153790 con 0x7fdb8c0b61f0 2023-10-18T12:41:45.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.969+0000 7fdb92a11700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8c0c8d30 con 0x7fdb8c0afb00 2023-10-18T12:41:45.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.969+0000 7fdb90fae700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb8c0cb1f0 0x7fdb8c159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:45.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.969+0000 7fdb90fae700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb8c0cb1f0 0x7fdb8c159c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39592/0 (socket says 172.21.15.114:39592) 2023-10-18T12:41:45.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.969+0000 7fdb90fae700 1 -- 172.21.15.114:0/632191300 learned_addr learned my addr 172.21.15.114:0/632191300 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:41:45.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.969+0000 7fdb837fe700 1 --2- 172.21.15.114:0/632191300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb8c0b61f0 0x7fdb8c06b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:45.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.969+0000 7fdb8bfff700 1 --2- 172.21.15.114:0/632191300 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdb8c0afb00 0x7fdb8c153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:45.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.969+0000 7fdb90fae700 1 -- 172.21.15.114:0/632191300 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdb8c0afb00 msgr2=0x7fdb8c153250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:45.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.969+0000 7fdb90fae700 1 --2- 172.21.15.114:0/632191300 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdb8c0afb00 0x7fdb8c153250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:45.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.969+0000 7fdb90fae700 1 -- 172.21.15.114:0/632191300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb8c0b61f0 msgr2=0x7fdb8c06b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:45.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.969+0000 7fdb90fae700 1 --2- 172.21.15.114:0/632191300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb8c0b61f0 0x7fdb8c06b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:45.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.969+0000 7fdb90fae700 1 -- 172.21.15.114:0/632191300 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb7c009a70 con 0x7fdb8c0cb1f0 2023-10-18T12:41:45.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.969+0000 7fdb90fae700 1 --2- 172.21.15.114:0/632191300 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb8c0cb1f0 0x7fdb8c159c00 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fdb8400c480 tx=0x7fdb8400c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:45.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.969+0000 7fdb897fa700 1 -- 172.21.15.114:0/632191300 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb840052d0 con 0x7fdb8c0cb1f0 2023-10-18T12:41:45.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.969+0000 7fdb897fa700 1 -- 172.21.15.114:0/632191300 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb84005430 con 0x7fdb8c0cb1f0 2023-10-18T12:41:45.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.969+0000 7fdb92a11700 1 -- 172.21.15.114:0/632191300 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb8c0c9010 con 0x7fdb8c0cb1f0 2023-10-18T12:41:45.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.969+0000 7fdb897fa700 1 -- 172.21.15.114:0/632191300 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb840055a0 con 0x7fdb8c0cb1f0 2023-10-18T12:41:45.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.969+0000 7fdb92a11700 1 -- 172.21.15.114:0/632191300 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb8c0c95d0 con 0x7fdb8c0cb1f0 2023-10-18T12:41:45.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.973+0000 7fdb92a11700 1 -- 172.21.15.114:0/632191300 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb8c072e60 con 0x7fdb8c0cb1f0 2023-10-18T12:41:45.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.973+0000 7fdb897fa700 1 -- 172.21.15.114:0/632191300 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fdb840038e0 con 0x7fdb8c0cb1f0 2023-10-18T12:41:45.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.973+0000 7fdb897fa700 1 --2- 172.21.15.114:0/632191300 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdb6c0656f0 0x7fdb6c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:45.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.977+0000 7fdb897fa700 1 -- 172.21.15.114:0/632191300 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7fdb840824a0 con 0x7fdb8c0cb1f0 2023-10-18T12:41:45.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.977+0000 7fdb8bfff700 1 --2- 172.21.15.114:0/632191300 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdb6c0656f0 0x7fdb6c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:45.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.977+0000 7fdb8bfff700 1 --2- 172.21.15.114:0/632191300 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdb6c0656f0 0x7fdb6c067bb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c014040 tx=0x7fdb7c01d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:45.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:45.981+0000 7fdb897fa700 1 -- 172.21.15.114:0/632191300 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fdb8404fd10 con 0x7fdb8c0cb1f0 2023-10-18T12:41:46.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.169+0000 7fdb92a11700 1 -- 172.21.15.114:0/632191300 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdb8c0b6910 con 0x7fdb8c0cb1f0 2023-10-18T12:41:46.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.169+0000 7fdb897fa700 1 -- 172.21.15.114:0/632191300 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v60) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdb8406fe60 con 0x7fdb8c0cb1f0 2023-10-18T12:41:46.174 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-10-18T12:41:46.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.169+0000 7fdb92a11700 1 -- 172.21.15.114:0/632191300 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdb6c0656f0 msgr2=0x7fdb6c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:46.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.169+0000 7fdb92a11700 1 --2- 172.21.15.114:0/632191300 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdb6c0656f0 0x7fdb6c067bb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c014040 tx=0x7fdb7c01d040 comp rx=0 tx=0).stop 2023-10-18T12:41:46.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.169+0000 7fdb92a11700 1 -- 172.21.15.114:0/632191300 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb8c0cb1f0 msgr2=0x7fdb8c159c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:46.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.169+0000 7fdb92a11700 1 --2- 172.21.15.114:0/632191300 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb8c0cb1f0 0x7fdb8c159c00 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fdb8400c480 tx=0x7fdb8400c790 comp rx=0 tx=0).stop 2023-10-18T12:41:46.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.173+0000 7fdb92a11700 1 -- 172.21.15.114:0/632191300 shutdown_connections 2023-10-18T12:41:46.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.173+0000 7fdb92a11700 1 --2- 172.21.15.114:0/632191300 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdb6c0656f0 0x7fdb6c067bb0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:46.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.173+0000 7fdb92a11700 1 --2- 172.21.15.114:0/632191300 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb8c0cb1f0 0x7fdb8c159c00 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:46.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.173+0000 7fdb92a11700 1 --2- 172.21.15.114:0/632191300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb8c0b61f0 0x7fdb8c06b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:46.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.173+0000 7fdb92a11700 1 --2- 172.21.15.114:0/632191300 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdb8c0afb00 0x7fdb8c153250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:46.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.173+0000 7fdb92a11700 1 -- 172.21.15.114:0/632191300 >> 172.21.15.114:0/632191300 conn(0x7fdb8c0d0990 msgr2=0x7fdb8c0d0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:46.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.173+0000 7fdb92a11700 1 -- 172.21.15.114:0/632191300 shutdown_connections 2023-10-18T12:41:46.179 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.173+0000 7fdb92a11700 1 -- 172.21.15.114:0/632191300 wait complete. 2023-10-18T12:41:46.197 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-18T12:41:46.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.373+0000 7fbb3bbd2700 1 Processor -- start 2023-10-18T12:41:46.379 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.373+0000 7fbb3bbd2700 1 -- start start 2023-10-18T12:41:46.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.377+0000 7fbb3bbd2700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbb340adb60 0x7fbb340cb190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:46.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.377+0000 7fbb3bbd2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbb340cb6d0 0x7fbb340cc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:46.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.377+0000 7fbb3bbd2700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb34165770 con 0x7fbb34161230 2023-10-18T12:41:46.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.377+0000 7fbb3bbd2700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb340cbb00 con 0x7fbb340adb60 2023-10-18T12:41:46.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.377+0000 7fbb3bbd2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3406ea40 con 0x7fbb340cb6d0 2023-10-18T12:41:46.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.377+0000 7fbb3916d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbb340adb60 0x7fbb340cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:46.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.377+0000 7fbb3916d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbb340adb60 0x7fbb340cb190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39594/0 (socket says 172.21.15.114:39594) 2023-10-18T12:41:46.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.377+0000 7fbb3916d700 1 -- 172.21.15.114:0/2390570697 learned_addr learned my addr 172.21.15.114:0/2390570697 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:41:46.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.377+0000 7fbb3a16f700 1 --2- 172.21.15.114:0/2390570697 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbb340cb6d0 0x7fbb340cc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:46.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.377+0000 7fbb3916d700 1 -- 172.21.15.114:0/2390570697 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbb340cb6d0 msgr2=0x7fbb340cc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:41:46.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.377+0000 7fbb3916d700 1 --2- 172.21.15.114:0/2390570697 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbb340cb6d0 0x7fbb340cc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:46.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.377+0000 7fbb3916d700 1 -- 172.21.15.114:0/2390570697 >> v1:172.21.15.172:6789/0 conn(0x7fbb34161230 legacy=0x7fbb3406ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:46.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.377+0000 7fbb3916d700 1 -- 172.21.15.114:0/2390570697 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb34161610 con 0x7fbb340adb60 2023-10-18T12:41:46.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.377+0000 7fbb3916d700 1 --2- 172.21.15.114:0/2390570697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb340adb60 0x7fbb340cb190 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fbb24009910 tx=0x7fbb24009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae7a73ec98ba4806 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:46.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.377+0000 7fbb3896c700 1 -- 172.21.15.114:0/2390570697 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb24011830 con 0x7fbb340adb60 2023-10-18T12:41:46.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.377+0000 7fbb3896c700 1 -- 172.21.15.114:0/2390570697 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb24011990 con 0x7fbb340adb60 2023-10-18T12:41:46.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.377+0000 7fbb3896c700 1 -- 172.21.15.114:0/2390570697 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb24011d40 con 0x7fbb340adb60 2023-10-18T12:41:46.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.381+0000 7fbb3bbd2700 1 -- 172.21.15.114:0/2390570697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb340adb60 msgr2=0x7fbb340cb190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:46.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.381+0000 7fbb3bbd2700 1 --2- 172.21.15.114:0/2390570697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb340adb60 0x7fbb340cb190 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fbb24009910 tx=0x7fbb24009c20 comp rx=0 tx=0).stop 2023-10-18T12:41:46.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.381+0000 7fbb3bbd2700 1 -- 172.21.15.114:0/2390570697 shutdown_connections 2023-10-18T12:41:46.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.381+0000 7fbb3bbd2700 1 --2- 172.21.15.114:0/2390570697 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbb340cb6d0 0x7fbb340cc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:46.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.381+0000 7fbb3bbd2700 1 --2- 172.21.15.114:0/2390570697 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb340adb60 0x7fbb340cb190 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:46.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.381+0000 7fbb3bbd2700 1 -- 172.21.15.114:0/2390570697 >> 172.21.15.114:0/2390570697 conn(0x7fbb3406a340 msgr2=0x7fbb340b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:46.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.381+0000 7fbb3bbd2700 1 -- 172.21.15.114:0/2390570697 shutdown_connections 2023-10-18T12:41:46.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.381+0000 7fbb3bbd2700 1 -- 172.21.15.114:0/2390570697 wait complete. 2023-10-18T12:41:46.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.385+0000 7fbb3bbd2700 1 Processor -- start 2023-10-18T12:41:46.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.385+0000 7fbb3bbd2700 1 -- start start 2023-10-18T12:41:46.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.385+0000 7fbb3bbd2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb340adb60 0x7fbb341f73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:46.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.385+0000 7fbb3bbd2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbb340cb6d0 0x7fbb34159a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:46.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.385+0000 7fbb3bbd2700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb34161230 0x7fbb341f9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:46.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.385+0000 7fbb3bbd2700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb341f7920 con 0x7fbb34161230 2023-10-18T12:41:46.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.385+0000 7fbb3bbd2700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb341f6920 con 0x7fbb340adb60 2023-10-18T12:41:46.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.385+0000 7fbb3bbd2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb341faa10 con 0x7fbb340cb6d0 2023-10-18T12:41:46.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.385+0000 7fbb3a16f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb34161230 0x7fbb341f9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:46.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.385+0000 7fbb3a16f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb34161230 0x7fbb341f9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39602/0 (socket says 172.21.15.114:39602) 2023-10-18T12:41:46.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.385+0000 7fbb3a16f700 1 -- 172.21.15.114:0/3060232085 learned_addr learned my addr 172.21.15.114:0/3060232085 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:41:46.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.385+0000 7fbb3996e700 1 --2- 172.21.15.114:0/3060232085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb340adb60 0x7fbb341f73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:46.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.389+0000 7fbb3916d700 1 --2- 172.21.15.114:0/3060232085 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbb340cb6d0 0x7fbb34159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:46.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.389+0000 7fbb3a16f700 1 -- 172.21.15.114:0/3060232085 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbb340cb6d0 msgr2=0x7fbb34159a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:46.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.389+0000 7fbb3a16f700 1 --2- 172.21.15.114:0/3060232085 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbb340cb6d0 0x7fbb34159a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:46.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.389+0000 7fbb3a16f700 1 -- 172.21.15.114:0/3060232085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb340adb60 msgr2=0x7fbb341f73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:46.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.389+0000 7fbb3a16f700 1 --2- 172.21.15.114:0/3060232085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb340adb60 0x7fbb341f73e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:46.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.389+0000 7fbb3a16f700 1 -- 172.21.15.114:0/3060232085 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb24009570 con 0x7fbb34161230 2023-10-18T12:41:46.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.389+0000 7fbb3916d700 1 --2- 172.21.15.114:0/3060232085 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbb340cb6d0 0x7fbb34159a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:41:46.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.389+0000 7fbb3a16f700 1 --2- 172.21.15.114:0/3060232085 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb34161230 0x7fbb341f9f10 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c00efc0 tx=0x7fbb2c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:46.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.389+0000 7fbb2a7fc700 1 -- 172.21.15.114:0/3060232085 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c009ba0 con 0x7fbb34161230 2023-10-18T12:41:46.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.389+0000 7fbb2a7fc700 1 -- 172.21.15.114:0/3060232085 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb2c00f040 con 0x7fbb34161230 2023-10-18T12:41:46.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.389+0000 7fbb2a7fc700 1 -- 172.21.15.114:0/3060232085 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c014480 con 0x7fbb34161230 2023-10-18T12:41:46.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.389+0000 7fbb3bbd2700 1 -- 172.21.15.114:0/3060232085 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb341facf0 con 0x7fbb34161230 2023-10-18T12:41:46.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.389+0000 7fbb3bbd2700 1 -- 172.21.15.114:0/3060232085 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb341f6ec0 con 0x7fbb34161230 2023-10-18T12:41:46.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.389+0000 7fbb3bbd2700 1 -- 172.21.15.114:0/3060232085 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb341f70b0 con 0x7fbb34161230 2023-10-18T12:41:46.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.393+0000 7fbb2a7fc700 1 -- 172.21.15.114:0/3060232085 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fbb2c0145e0 con 0x7fbb34161230 2023-10-18T12:41:46.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.393+0000 7fbb2a7fc700 1 --2- 172.21.15.114:0/3060232085 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fbb18065740 0x7fbb18067c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:46.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.393+0000 7fbb2a7fc700 1 -- 172.21.15.114:0/3060232085 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7fbb2c083820 con 0x7fbb34161230 2023-10-18T12:41:46.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.393+0000 7fbb3996e700 1 --2- 172.21.15.114:0/3060232085 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fbb18065740 0x7fbb18067c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:46.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.397+0000 7fbb3996e700 1 --2- 172.21.15.114:0/3060232085 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fbb18065740 0x7fbb18067c00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fbb300016e0 tx=0x7fbb30009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:46.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.401+0000 7fbb2a7fc700 1 -- 172.21.15.114:0/3060232085 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fbb2c051130 con 0x7fbb34161230 2023-10-18T12:41:46.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.605+0000 7fbb3bbd2700 1 -- 172.21.15.114:0/3060232085 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbb34072e60 con 0x7fbb34161230 2023-10-18T12:41:46.609 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.605+0000 7fbb2a7fc700 1 -- 172.21.15.114:0/3060232085 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 1 entries v60) v1 ==== 80+0+59 (secure 0 0 0) 0x7fbb2c054750 con 0x7fbb34161230 2023-10-18T12:41:46.610 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:0/1817588655 2023-10-18T13:29:19.822093+0000 2023-10-18T12:41:46.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.605+0000 7fbb3bbd2700 1 -- 172.21.15.114:0/3060232085 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fbb18065740 msgr2=0x7fbb18067c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:46.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.605+0000 7fbb3bbd2700 1 --2- 172.21.15.114:0/3060232085 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fbb18065740 0x7fbb18067c00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fbb300016e0 tx=0x7fbb30009040 comp rx=0 tx=0).stop 2023-10-18T12:41:46.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.605+0000 7fbb3bbd2700 1 -- 172.21.15.114:0/3060232085 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb34161230 msgr2=0x7fbb341f9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:46.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.605+0000 7fbb3bbd2700 1 --2- 172.21.15.114:0/3060232085 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb34161230 0x7fbb341f9f10 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c00efc0 tx=0x7fbb2c00c3a0 comp rx=0 tx=0).stop 2023-10-18T12:41:46.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.605+0000 7fbb3bbd2700 1 -- 172.21.15.114:0/3060232085 shutdown_connections 2023-10-18T12:41:46.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.605+0000 7fbb3bbd2700 1 --2- 172.21.15.114:0/3060232085 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fbb18065740 0x7fbb18067c00 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:46.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.605+0000 7fbb3bbd2700 1 --2- 172.21.15.114:0/3060232085 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbb340cb6d0 0x7fbb34159a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:46.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.605+0000 7fbb3bbd2700 1 --2- 172.21.15.114:0/3060232085 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbb34161230 0x7fbb341f9f10 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:46.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.605+0000 7fbb3bbd2700 1 --2- 172.21.15.114:0/3060232085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb340adb60 0x7fbb341f73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:46.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.609+0000 7fbb3bbd2700 1 -- 172.21.15.114:0/3060232085 >> 172.21.15.114:0/3060232085 conn(0x7fbb3406a340 msgr2=0x7fbb3415faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:46.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.609+0000 7fbb3bbd2700 1 -- 172.21.15.114:0/3060232085 shutdown_connections 2023-10-18T12:41:46.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.609+0000 7fbb3bbd2700 1 -- 172.21.15.114:0/3060232085 wait complete. 2023-10-18T12:41:46.615 INFO:teuthology.orchestra.run.smithi114.stderr:listed 1 entries 2023-10-18T12:41:46.632 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-18T12:41:46.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:41:46.633 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-18T12:41:46.674 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2023-10-18T12:41:46.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:41:46.675 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-18T12:41:46.733 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-18T12:41:46.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.941+0000 7ffb7f10c700 1 Processor -- start 2023-10-18T12:41:46.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.941+0000 7ffb7f10c700 1 -- start start 2023-10-18T12:41:46.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.945+0000 7ffb7f10c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ffb780d2e00 0x7ffb780b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:46.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.945+0000 7ffb7f10c700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb7815d0d0 con 0x7ffb780b5ae0 2023-10-18T12:41:46.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.945+0000 7ffb7f10c700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb7806f0f0 con 0x7ffb78160710 2023-10-18T12:41:46.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.945+0000 7ffb7f10c700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb7815df90 con 0x7ffb780d2e00 2023-10-18T12:41:46.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.945+0000 7ffb7e90b700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ffb780b5ae0 0x7ffb7806db60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60244/0 (socket says 172.21.15.114:60244) 2023-10-18T12:41:46.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.945+0000 7ffb7e90b700 1 -- 172.21.15.114:0/289550093 learned_addr learned my addr 172.21.15.114:0/289550093 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:41:46.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.945+0000 7ffb7e10a700 1 --2- 172.21.15.114:0/289550093 >> v2:172.21.15.172:3300/0 conn(0x7ffb780d2e00 0x7ffb780b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:46.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.945+0000 7ffb7d108700 1 -- 172.21.15.114:0/289550093 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3095574047 0 0) 0x7ffb7806f0f0 con 0x7ffb78160710 2023-10-18T12:41:46.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.945+0000 7ffb7e10a700 1 -- 172.21.15.114:0/289550093 >> v1:172.21.15.172:6789/0 conn(0x7ffb78160710 legacy=0x7ffb780d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:46.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.945+0000 7ffb7e10a700 1 -- 172.21.15.114:0/289550093 >> v1:172.21.15.114:6789/0 conn(0x7ffb780b5ae0 legacy=0x7ffb7806db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:46.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.945+0000 7ffb7e10a700 1 -- 172.21.15.114:0/289550093 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb7815d310 con 0x7ffb780d2e00 2023-10-18T12:41:46.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.945+0000 7ffb7e10a700 1 --2- 172.21.15.114:0/289550093 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb780d2e00 0x7ffb780b6e00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ffb74009850 tx=0x7ffb74009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=808753b0e6f3d1e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:46.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.949+0000 7ffb7d108700 1 -- 172.21.15.114:0/289550093 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb74004230 con 0x7ffb780d2e00 2023-10-18T12:41:46.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.949+0000 7ffb7d108700 1 -- 172.21.15.114:0/289550093 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb74004390 con 0x7ffb780d2e00 2023-10-18T12:41:46.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.949+0000 7ffb7d108700 1 -- 172.21.15.114:0/289550093 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb740036c0 con 0x7ffb780d2e00 2023-10-18T12:41:46.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.949+0000 7ffb7f10c700 1 -- 172.21.15.114:0/289550093 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb780d2e00 msgr2=0x7ffb780b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:46.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.949+0000 7ffb7f10c700 1 --2- 172.21.15.114:0/289550093 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb780d2e00 0x7ffb780b6e00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ffb74009850 tx=0x7ffb74009b60 comp rx=0 tx=0).stop 2023-10-18T12:41:46.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.949+0000 7ffb7f10c700 1 -- 172.21.15.114:0/289550093 shutdown_connections 2023-10-18T12:41:46.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.949+0000 7ffb7f10c700 1 --2- 172.21.15.114:0/289550093 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb780d2e00 0x7ffb780b6e00 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:46.955 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.949+0000 7ffb7f10c700 1 -- 172.21.15.114:0/289550093 >> 172.21.15.114:0/289550093 conn(0x7ffb78069f20 msgr2=0x7ffb7806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:46.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.949+0000 7ffb7f10c700 1 -- 172.21.15.114:0/289550093 shutdown_connections 2023-10-18T12:41:46.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.949+0000 7ffb7f10c700 1 -- 172.21.15.114:0/289550093 wait complete. 2023-10-18T12:41:46.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.953+0000 7ffb7f10c700 1 Processor -- start 2023-10-18T12:41:46.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.953+0000 7ffb7f10c700 1 -- start start 2023-10-18T12:41:46.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.953+0000 7ffb7f10c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb780b5ae0 0x7ffb7815fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:46.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.953+0000 7ffb7f10c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffb780d2e00 0x7ffb781f61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:46.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.953+0000 7ffb7f10c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb78160710 0x7ffb781f1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:46.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.953+0000 7ffb7f10c700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb781f6710 con 0x7ffb78160710 2023-10-18T12:41:46.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.953+0000 7ffb7f10c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7814f3e0 con 0x7ffb780b5ae0 2023-10-18T12:41:46.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.953+0000 7ffb7f10c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7815ede0 con 0x7ffb780d2e00 2023-10-18T12:41:46.960 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.953+0000 7ffb7e90b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb78160710 0x7ffb781f1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:46.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.953+0000 7ffb7e90b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb78160710 0x7ffb781f1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39614/0 (socket says 172.21.15.114:39614) 2023-10-18T12:41:46.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.953+0000 7ffb7e90b700 1 -- 172.21.15.114:0/1148560641 learned_addr learned my addr 172.21.15.114:0/1148560641 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:41:46.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.953+0000 7ffb7e10a700 1 --2- 172.21.15.114:0/1148560641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb780b5ae0 0x7ffb7815fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:46.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.953+0000 7ffb7d909700 1 --2- 172.21.15.114:0/1148560641 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffb780d2e00 0x7ffb781f61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:46.961 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.953+0000 7ffb7e90b700 1 -- 172.21.15.114:0/1148560641 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffb780d2e00 msgr2=0x7ffb781f61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:46.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.953+0000 7ffb7e90b700 1 --2- 172.21.15.114:0/1148560641 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffb780d2e00 0x7ffb781f61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:46.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.953+0000 7ffb7e90b700 1 -- 172.21.15.114:0/1148560641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb780b5ae0 msgr2=0x7ffb7815fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:46.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.953+0000 7ffb7e90b700 1 --2- 172.21.15.114:0/1148560641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb780b5ae0 0x7ffb7815fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:46.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.953+0000 7ffb7e90b700 1 -- 172.21.15.114:0/1148560641 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb740094b0 con 0x7ffb78160710 2023-10-18T12:41:46.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.953+0000 7ffb7e90b700 1 --2- 172.21.15.114:0/1148560641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb78160710 0x7ffb781f1a20 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7ffb700020a0 tx=0x7ffb7000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:46.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.957+0000 7ffb6effd700 1 -- 172.21.15.114:0/1148560641 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7000acd0 con 0x7ffb78160710 2023-10-18T12:41:46.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.957+0000 7ffb6effd700 1 -- 172.21.15.114:0/1148560641 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7000ae50 con 0x7ffb78160710 2023-10-18T12:41:46.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.957+0000 7ffb7f10c700 1 -- 172.21.15.114:0/1148560641 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb7815f070 con 0x7ffb78160710 2023-10-18T12:41:46.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.957+0000 7ffb6effd700 1 -- 172.21.15.114:0/1148560641 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb70007310 con 0x7ffb78160710 2023-10-18T12:41:46.963 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.957+0000 7ffb7f10c700 1 -- 172.21.15.114:0/1148560641 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb7814f630 con 0x7ffb78160710 2023-10-18T12:41:46.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.957+0000 7ffb7f10c700 1 -- 172.21.15.114:0/1148560641 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb7814f850 con 0x7ffb78160710 2023-10-18T12:41:46.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.957+0000 7ffb6effd700 1 -- 172.21.15.114:0/1148560641 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ffb70007470 con 0x7ffb78160710 2023-10-18T12:41:46.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.961+0000 7ffb6effd700 1 --2- 172.21.15.114:0/1148560641 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ffb5c0656f0 0x7ffb5c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:46.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.961+0000 7ffb6effd700 1 -- 172.21.15.114:0/1148560641 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7ffb700829d0 con 0x7ffb78160710 2023-10-18T12:41:46.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.961+0000 7ffb7e10a700 1 --2- 172.21.15.114:0/1148560641 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ffb5c0656f0 0x7ffb5c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:46.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.961+0000 7ffb7e10a700 1 --2- 172.21.15.114:0/1148560641 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ffb5c0656f0 0x7ffb5c067bb0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ffb74009850 tx=0x7ffb74010000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:46.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:46.965+0000 7ffb6effd700 1 -- 172.21.15.114:0/1148560641 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7ffb700502c0 con 0x7ffb78160710 2023-10-18T12:41:47.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:47.305+0000 7ffb7f10c700 1 -- 172.21.15.114:0/1148560641 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ffb7815d0d0 con 0x7ffb78160710 2023-10-18T12:41:47.311 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:47.305+0000 7ffb6effd700 1 -- 172.21.15.114:0/1148560641 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v20) v1 ==== 53+0+73 (secure 0 0 0) 0x7ffb70018060 con 0x7ffb78160710 2023-10-18T12:41:47.311 INFO:teuthology.orchestra.run.smithi114.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-18T12:41:47.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:47.309+0000 7ffb7f10c700 1 -- 172.21.15.114:0/1148560641 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ffb5c0656f0 msgr2=0x7ffb5c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:47.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:47.309+0000 7ffb7f10c700 1 --2- 172.21.15.114:0/1148560641 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ffb5c0656f0 0x7ffb5c067bb0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ffb74009850 tx=0x7ffb74010000 comp rx=0 tx=0).stop 2023-10-18T12:41:47.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:47.309+0000 7ffb7f10c700 1 -- 172.21.15.114:0/1148560641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb78160710 msgr2=0x7ffb781f1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:47.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:47.309+0000 7ffb7f10c700 1 --2- 172.21.15.114:0/1148560641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb78160710 0x7ffb781f1a20 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7ffb700020a0 tx=0x7ffb7000a340 comp rx=0 tx=0).stop 2023-10-18T12:41:47.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:47.309+0000 7ffb7f10c700 1 -- 172.21.15.114:0/1148560641 shutdown_connections 2023-10-18T12:41:47.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:47.309+0000 7ffb7f10c700 1 --2- 172.21.15.114:0/1148560641 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ffb5c0656f0 0x7ffb5c067bb0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:47.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:47.309+0000 7ffb7f10c700 1 --2- 172.21.15.114:0/1148560641 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ffb780d2e00 0x7ffb781f61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:47.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:47.309+0000 7ffb7f10c700 1 --2- 172.21.15.114:0/1148560641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffb78160710 0x7ffb781f1a20 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:47.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:47.309+0000 7ffb7f10c700 1 --2- 172.21.15.114:0/1148560641 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb780b5ae0 0x7ffb7815fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:47.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:47.309+0000 7ffb7f10c700 1 -- 172.21.15.114:0/1148560641 >> 172.21.15.114:0/1148560641 conn(0x7ffb78069f20 msgr2=0x7ffb780b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:47.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:47.309+0000 7ffb7f10c700 1 -- 172.21.15.114:0/1148560641 shutdown_connections 2023-10-18T12:41:47.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:47.309+0000 7ffb7f10c700 1 -- 172.21.15.114:0/1148560641 wait complete. 2023-10-18T12:41:47.339 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-18T12:41:47.339 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-18T12:41:47.340 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2023-10-18T12:41:47.340 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-18T12:41:47.340 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-18T12:41:47.341 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-18T12:41:47.341 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-18T12:41:47.341 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-18T12:41:47.342 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-18T12:41:47.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:41:47.343 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2023-10-18T12:41:47.361 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-18T12:41:47.361 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-18T12:41:47.362 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2023-10-18T12:41:47.362 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:41:47.362 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2023-10-18T12:41:47.362 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:41:47.362 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-18T12:41:47.363 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2023-10-18T12:41:47.363 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2023-10-18T12:41:47.363 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-18T12:41:47.363 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2023-10-18T12:41:47.364 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2023-10-18T12:41:47.364 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-10-18T12:41:47.364 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2023-10-18T12:41:47.364 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-18T12:41:47.364 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2023-10-18T12:41:47.364 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-10-18T12:41:47.365 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 41044sec preferred_lft 41044sec 2023-10-18T12:41:47.365 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2023-10-18T12:41:47.365 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:41:47.365 INFO:teuthology.orchestra.run.smithi114.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-10-18T12:41:47.365 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 02:42:85:ed:49:1d brd ff:ff:ff:ff:ff:ff 2023-10-18T12:41:47.365 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-10-18T12:41:47.366 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:41:47.366 INFO:teuthology.orchestra.run.smithi114.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-18T12:41:47.366 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 5a:38:e4:bb:88:05 brd ff:ff:ff:ff:ff:ff 2023-10-18T12:41:47.366 INFO:teuthology.orchestra.run.smithi114.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-18T12:41:47.366 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:41:47.367 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::5024:e8ff:fe3e:7146/64 scope link 2023-10-18T12:41:47.367 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:41:47.367 INFO:teuthology.orchestra.run.smithi114.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state DOWN group default qlen 1000 2023-10-18T12:41:47.367 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 5a:38:e4:bb:88:05 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-18T12:41:47.367 INFO:teuthology.orchestra.run.smithi114.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-18T12:41:47.368 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether b2:9f:84:96:f1:b4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-18T12:41:47.368 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::b09f:84ff:fe96:f1b4/64 scope link 2023-10-18T12:41:47.368 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2023-10-18T12:41:47.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:41:47.369 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-18T12:41:47.453 INFO:teuthology.orchestra.run.smithi114.stdout:1 2023-10-18T12:41:47.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:41:47.457 DEBUG:teuthology.orchestra.run.smithi114:> route 2023-10-18T12:41:47.521 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2023-10-18T12:41:47.522 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-18T12:41:47.522 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-10-18T12:41:47.523 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-18T12:41:47.523 INFO:teuthology.orchestra.run.smithi114.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-10-18T12:41:47.523 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-10-18T12:41:47.524 INFO:teuthology.orchestra.run.smithi114.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-10-18T12:41:47.524 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-18T12:41:47.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:41:47.526 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec bash -c ' 2023-10-18T12:41:47.526 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2023-10-18T12:41:47.527 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-18T12:41:47.528 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-18T12:41:47.529 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-18T12:41:47.529 DEBUG:teuthology.orchestra.run.smithi114:> ') 2023-10-18T12:41:47.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:41:47.659 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2023-10-18T12:41:47.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-18T12:41:47.678 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-18T12:41:47.679 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-18T12:41:47.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:41:47.680 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2023-10-18T12:41:47.760 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-18T12:41:47.760 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-18T12:41:47.825 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-18T12:41:47.826 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-18T12:41:47.826 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-18T12:41:47.887 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-18T12:41:47.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:41:47.888 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-18T12:41:48.026 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-18T12:41:48.026 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-18T12:41:48.026 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2023-10-18T12:41:48.056 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-18T12:41:48.057 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-18T12:41:48.057 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2023-10-18T12:41:48.057 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.172:3300,172.21.15.172:3301" 2023-10-18T12:41:48.057 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-18T12:41:48.112 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-18T12:41:48.112 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-18T12:41:48.112 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2023-10-18T12:41:48.112 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:3300,172.21.15.172:3300,172.21.15.172:3301" 2023-10-18T12:41:48.112 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-18T12:41:48.113 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.114:6789,172.21.15.172:6789,172.21.15.172:6790" 2023-10-18T12:41:48.113 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.114:6789,172.21.15.172:6789,172.21.15.172:6790:/ 2023-10-18T12:41:48.113 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=240ea340-5d3d-4f52-a4bc-af075aca3deb" will pass to kernel 2023-10-18T12:41:48.119 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-18T12:41:48.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:41:48.120 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-18T12:41:48.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:41:48.160 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-10-18T12:41:48.232 INFO:teuthology.orchestra.run.smithi114.stdout:client5456 2023-10-18T12:41:48.233 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:41:48.233 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-18T12:41:48.297 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:41:48.297 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-18T12:41:48.363 DEBUG:tasks.cephfs.mount:Creating test file 2023-10-18 12:41:48.363887 0 2023-10-18T12:41:48.364 DEBUG:teuthology.orchestra.run.smithi114:> touch '/home/ubuntu/cephtest/mnt.0/2023-10-18 12:41:48.363887 0' 2023-10-18T12:41:48.433 DEBUG:tasks.cephfs.mount:Deleting test file 2023-10-18 12:41:48.363887 0 2023-10-18T12:41:48.434 DEBUG:teuthology.orchestra.run.smithi114:> rm -f '/home/ubuntu/cephtest/mnt.0/2023-10-18 12:41:48.363887 0' 2023-10-18T12:41:48.497 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-18T12:41:48.498 DEBUG:teuthology.orchestra.run.smithi114:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-18T12:41:48.585 DEBUG:teuthology.orchestra.run.smithi172:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-18T12:41:48.629 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-18T12:41:48.630 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:41:48.630 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-18T12:41:48.650 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:41:48.650 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-18T12:41:48.711 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T12:41:48.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.929+0000 7f2f944a2700 1 Processor -- start 2023-10-18T12:41:48.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.929+0000 7f2f944a2700 1 -- start start 2023-10-18T12:41:48.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.933+0000 7f2f944a2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2f8c146800 0x7f2f8c0b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:48.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.933+0000 7f2f944a2700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2f8c0700b0 0x7f2f8c15eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:48.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.933+0000 7f2f944a2700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f8c15e680 con 0x7f2f8c15dd30 2023-10-18T12:41:48.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.933+0000 7f2f944a2700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f8c0b6180 con 0x7f2f8c0700b0 2023-10-18T12:41:48.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.933+0000 7f2f944a2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c0b6460 con 0x7f2f8c146800 2023-10-18T12:41:48.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.933+0000 7f2f91a3d700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f2f8c15dd30 0x7f2f8c06f9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60258/0 (socket says 172.21.15.114:60258) 2023-10-18T12:41:48.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.933+0000 7f2f92a3f700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f2f8c0700b0 0x7f2f8c15eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:48.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.933+0000 7f2f91a3d700 1 -- 172.21.15.114:0/3675562820 learned_addr learned my addr 172.21.15.114:0/3675562820 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:41:48.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.933+0000 7f2f9223e700 1 --2- 172.21.15.114:0/3675562820 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2f8c146800 0x7f2f8c0b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:48.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.933+0000 7f2f92a3f700 1 -- 172.21.15.114:0/3675562820 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2f8c146800 msgr2=0x7f2f8c0b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:41:48.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.933+0000 7f2f92a3f700 1 --2- 172.21.15.114:0/3675562820 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2f8c146800 0x7f2f8c0b5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:48.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.933+0000 7f2f92a3f700 1 -- 172.21.15.114:0/3675562820 >> v1:172.21.15.114:6789/0 conn(0x7f2f8c15dd30 legacy=0x7f2f8c06f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:48.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.933+0000 7f2f92a3f700 1 -- 172.21.15.114:0/3675562820 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8c0b6740 con 0x7f2f8c0700b0 2023-10-18T12:41:48.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.933+0000 7f2f92a3f700 1 --2- 172.21.15.114:0/3675562820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f8c0700b0 0x7f2f8c15eb10 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f2f84009d90 tx=0x7f2f8400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ea5733d65cd614 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:48.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.933+0000 7f2f9123c700 1 -- 172.21.15.114:0/3675562820 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8400e070 con 0x7f2f8c0700b0 2023-10-18T12:41:48.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.933+0000 7f2f9123c700 1 -- 172.21.15.114:0/3675562820 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8400bb20 con 0x7f2f8c0700b0 2023-10-18T12:41:48.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.933+0000 7f2f9123c700 1 -- 172.21.15.114:0/3675562820 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f84012430 con 0x7f2f8c0700b0 2023-10-18T12:41:48.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.933+0000 7f2f944a2700 1 -- 172.21.15.114:0/3675562820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f8c0700b0 msgr2=0x7f2f8c15eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:48.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.933+0000 7f2f944a2700 1 --2- 172.21.15.114:0/3675562820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f8c0700b0 0x7f2f8c15eb10 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f2f84009d90 tx=0x7f2f8400b330 comp rx=0 tx=0).stop 2023-10-18T12:41:48.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.937+0000 7f2f944a2700 1 -- 172.21.15.114:0/3675562820 shutdown_connections 2023-10-18T12:41:48.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.937+0000 7f2f944a2700 1 --2- 172.21.15.114:0/3675562820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f8c0700b0 0x7f2f8c15eb10 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:48.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.937+0000 7f2f944a2700 1 --2- 172.21.15.114:0/3675562820 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2f8c146800 0x7f2f8c0b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:48.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.937+0000 7f2f944a2700 1 -- 172.21.15.114:0/3675562820 >> 172.21.15.114:0/3675562820 conn(0x7f2f8c06a130 msgr2=0x7f2f8c06a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:48.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.937+0000 7f2f944a2700 1 -- 172.21.15.114:0/3675562820 shutdown_connections 2023-10-18T12:41:48.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.937+0000 7f2f944a2700 1 -- 172.21.15.114:0/3675562820 wait complete. 2023-10-18T12:41:48.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.941+0000 7f2f944a2700 1 Processor -- start 2023-10-18T12:41:48.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.941+0000 7f2f944a2700 1 -- start start 2023-10-18T12:41:48.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.941+0000 7f2f944a2700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f8c0700b0 0x7f2f8c15c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:48.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.941+0000 7f2f944a2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8c146800 0x7f2f8c0b0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:48.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.941+0000 7f2f944a2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2f8c15dd30 0x7f2f8c0b1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:48.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.941+0000 7f2f944a2700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c0abb60 con 0x7f2f8c0700b0 2023-10-18T12:41:48.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.941+0000 7f2f944a2700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c0b3a90 con 0x7f2f8c146800 2023-10-18T12:41:48.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.941+0000 7f2f944a2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c0b3d70 con 0x7f2f8c15dd30 2023-10-18T12:41:48.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.941+0000 7f2f9223e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f8c0700b0 0x7f2f8c15c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:48.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.941+0000 7f2f9223e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f8c0700b0 0x7f2f8c15c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39630/0 (socket says 172.21.15.114:39630) 2023-10-18T12:41:48.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.941+0000 7f2f9223e700 1 -- 172.21.15.114:0/3885533096 learned_addr learned my addr 172.21.15.114:0/3885533096 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:41:48.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.941+0000 7f2f92a3f700 1 --2- 172.21.15.114:0/3885533096 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2f8c15dd30 0x7f2f8c0b1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:48.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.941+0000 7f2f91a3d700 1 --2- 172.21.15.114:0/3885533096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8c146800 0x7f2f8c0b0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:48.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.941+0000 7f2f9223e700 1 -- 172.21.15.114:0/3885533096 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2f8c15dd30 msgr2=0x7f2f8c0b1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:48.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.941+0000 7f2f9223e700 1 --2- 172.21.15.114:0/3885533096 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2f8c15dd30 0x7f2f8c0b1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:48.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.941+0000 7f2f9223e700 1 -- 172.21.15.114:0/3885533096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8c146800 msgr2=0x7f2f8c0b0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:48.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.941+0000 7f2f9223e700 1 --2- 172.21.15.114:0/3885533096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8c146800 0x7f2f8c0b0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:48.950 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.941+0000 7f2f9223e700 1 -- 172.21.15.114:0/3885533096 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f84009a70 con 0x7f2f8c0700b0 2023-10-18T12:41:48.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.945+0000 7f2f9223e700 1 --2- 172.21.15.114:0/3885533096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f8c0700b0 0x7f2f8c15c7f0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f2f8800e9d0 tx=0x7f2f8800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:48.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.945+0000 7f2f82ffd700 1 -- 172.21.15.114:0/3885533096 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f88009720 con 0x7f2f8c0700b0 2023-10-18T12:41:48.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.945+0000 7f2f82ffd700 1 -- 172.21.15.114:0/3885533096 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8800c850 con 0x7f2f8c0700b0 2023-10-18T12:41:48.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.945+0000 7f2f82ffd700 1 -- 172.21.15.114:0/3885533096 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8800cbc0 con 0x7f2f8c0700b0 2023-10-18T12:41:48.951 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.945+0000 7f2f944a2700 1 -- 172.21.15.114:0/3885533096 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f8c0b4050 con 0x7f2f8c0700b0 2023-10-18T12:41:48.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.945+0000 7f2f944a2700 1 -- 172.21.15.114:0/3885533096 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f8c0b2e60 con 0x7f2f8c0700b0 2023-10-18T12:41:48.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.945+0000 7f2f944a2700 1 -- 172.21.15.114:0/3885533096 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f8c0b4270 con 0x7f2f8c0700b0 2023-10-18T12:41:48.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.945+0000 7f2f82ffd700 1 -- 172.21.15.114:0/3885533096 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f2f8800cd20 con 0x7f2f8c0700b0 2023-10-18T12:41:48.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.949+0000 7f2f82ffd700 1 --2- 172.21.15.114:0/3885533096 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2f700656f0 0x7f2f70067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:48.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.949+0000 7f2f82ffd700 1 -- 172.21.15.114:0/3885533096 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7f2f880837e0 con 0x7f2f8c0700b0 2023-10-18T12:41:48.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.949+0000 7f2f91a3d700 1 --2- 172.21.15.114:0/3885533096 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2f700656f0 0x7f2f70067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:48.954 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.949+0000 7f2f91a3d700 1 --2- 172.21.15.114:0/3885533096 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2f700656f0 0x7f2f70067bb0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c0d36e0 tx=0x7f2f7c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:48.959 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:48.953+0000 7f2f82ffd700 1 -- 172.21.15.114:0/3885533096 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f2f88051180 con 0x7f2f8c0700b0 2023-10-18T12:41:49.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.133+0000 7f2f944a2700 1 -- 172.21.15.114:0/3885533096 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f8c072e60 con 0x7f2f8c0700b0 2023-10-18T12:41:49.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.137+0000 7f2f82ffd700 1 -- 172.21.15.114:0/3885533096 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+19138 (secure 0 0 0) 0x7f2f88058e60 con 0x7f2f8c0700b0 2023-10-18T12:41:49.142 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:41:49.142 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":60,"fsid":"240ea340-5d3d-4f52-a4bc-af075aca3deb","created":"2023-10-18T12:19:12.512994+0000","modified":"2023-10-18T12:30:22.735724+0000","last_up_change":"2023-10-18T12:29:29.654825+0000","last_in_change":"2023-10-18T12:19:15.850693+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T12:19:27.040638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-18T12:19:32.358094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-18T12:21:12.105324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-18T12:21:13.154105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c3578978-1a03-4857-b9d2-34a5da3d7731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":49,"up_from":56,"up_thru":57,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1953670272},{"type":"v1","addr":"172.21.15.114:6817","nonce":1953670272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1953670272},{"type":"v1","addr":"172.21.15.114:6820","nonce":1953670272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1953670272},{"type":"v1","addr":"172.21.15.114:6830","nonce":1953670272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":1953670272},{"type":"v1","addr":"172.21.15.114:6825","nonce":1953670272}]},"public_addr":"172.21.15.114:6817/1953670272","cluster_addr":"172.21.15.114:6820/1953670272","heartbeat_back_addr":"172.21.15.114:6830/1953670272","heartbeat_front_addr":"172.21.15.114:6825/1953670272","state":["exists","up"]},{"osd":1,"uuid":"43eb26a6-e2b3-4670-9559-bd053b5140d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6801","nonce":3302727047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6803","nonce":3302727047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6807","nonce":3302727047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6805","nonce":3302727047}]},"public_addr":"172.21.15.114:6801/3302727047","cluster_addr":"172.21.15.114:6803/3302727047","heartbeat_back_addr":"172.21.15.114:6807/3302727047","heartbeat_front_addr":"172.21.15.114:6805/3302727047","state":["exists","up"]},{"osd":2,"uuid":"f3d4dbd5-521c-4dd2-b687-5768cc7d0938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6809","nonce":2699151351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6811","nonce":2699151351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6815","nonce":2699151351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6813","nonce":2699151351}]},"public_addr":"172.21.15.114:6809/2699151351","cluster_addr":"172.21.15.114:6811/2699151351","heartbeat_back_addr":"172.21.15.114:6815/2699151351","heartbeat_front_addr":"172.21.15.114:6813/2699151351","state":["exists","up"]},{"osd":3,"uuid":"823e5802-92b7-4f0d-b32d-a5748993f1b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6821","nonce":1361608073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6824","nonce":1361608073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6829","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6831","nonce":1361608073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6827","nonce":1361608073}]},"public_addr":"172.21.15.114:6821/1361608073","cluster_addr":"172.21.15.114:6824/1361608073","heartbeat_back_addr":"172.21.15.114:6831/1361608073","heartbeat_front_addr":"172.21.15.114:6827/1361608073","state":["exists","up"]},{"osd":4,"uuid":"e47fb93e-13b4-44a4-b084-8c4384ceb41e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6801","nonce":930839681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6803","nonce":930839681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6807","nonce":930839681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6805","nonce":930839681}]},"public_addr":"172.21.15.172:6801/930839681","cluster_addr":"172.21.15.172:6803/930839681","heartbeat_back_addr":"172.21.15.172:6807/930839681","heartbeat_front_addr":"172.21.15.172:6805/930839681","state":["exists","up"]},{"osd":5,"uuid":"7561a973-f479-45a0-af40-f324728d622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6814","nonce":571761850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6818","nonce":571761850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6824","nonce":571761850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6821","nonce":571761850}]},"public_addr":"172.21.15.172:6814/571761850","cluster_addr":"172.21.15.172:6818/571761850","heartbeat_back_addr":"172.21.15.172:6824/571761850","heartbeat_front_addr":"172.21.15.172:6821/571761850","state":["exists","up"]},{"osd":6,"uuid":"51753f4b-7f06-4f1c-9ec7-6e18a66eb980","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6825","nonce":1680398853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6827","nonce":1680398853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6831","nonce":1680398853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6829","nonce":1680398853}]},"public_addr":"172.21.15.172:6825/1680398853","cluster_addr":"172.21.15.172:6827/1680398853","heartbeat_back_addr":"172.21.15.172:6831/1680398853","heartbeat_front_addr":"172.21.15.172:6829/1680398853","state":["exists","up"]},{"osd":7,"uuid":"4d8b1e15-143d-4d17-9074-59d92f0f9af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6809","nonce":349710101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6811","nonce":349710101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6819","nonce":349710101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6815","nonce":349710101}]},"public_addr":"172.21.15.172:6809/349710101","cluster_addr":"172.21.15.172:6811/349710101","heartbeat_back_addr":"172.21.15.172:6819/349710101","heartbeat_front_addr":"172.21.15.172:6815/349710101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"2023-10-18T12:21:50.537022+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.889460+0000","dead_epoch":50},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.475494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.911473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.648596+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.609994+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.636248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.854589+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.885826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.5","mappings":[{"from":7,"to":0}]},{"pgid":"6.9","mappings":[{"from":7,"to":2}]},{"pgid":"6.c","mappings":[{"from":3,"to":0}]},{"pgid":"6.11","mappings":[{"from":3,"to":2}]},{"pgid":"6.1d","mappings":[{"from":5,"to":0}]},{"pgid":"7.12","mappings":[{"from":6,"to":4}]},{"pgid":"7.2d","mappings":[{"from":0,"to":4}]},{"pgid":"7.30","mappings":[{"from":6,"to":4}]},{"pgid":"7.35","mappings":[{"from":0,"to":5}]},{"pgid":"7.36","mappings":[{"from":6,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:0/1817588655":"2023-10-18T13:29:19.822093+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T12:41:49.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.137+0000 7f2f944a2700 1 -- 172.21.15.114:0/3885533096 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2f700656f0 msgr2=0x7f2f70067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:49.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.137+0000 7f2f944a2700 1 --2- 172.21.15.114:0/3885533096 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2f700656f0 0x7f2f70067bb0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c0d36e0 tx=0x7f2f7c009040 comp rx=0 tx=0).stop 2023-10-18T12:41:49.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.137+0000 7f2f944a2700 1 -- 172.21.15.114:0/3885533096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f8c0700b0 msgr2=0x7f2f8c15c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:49.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.137+0000 7f2f944a2700 1 --2- 172.21.15.114:0/3885533096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f8c0700b0 0x7f2f8c15c7f0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f2f8800e9d0 tx=0x7f2f8800ece0 comp rx=0 tx=0).stop 2023-10-18T12:41:49.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.137+0000 7f2f944a2700 1 -- 172.21.15.114:0/3885533096 shutdown_connections 2023-10-18T12:41:49.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.137+0000 7f2f944a2700 1 --2- 172.21.15.114:0/3885533096 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f2f700656f0 0x7f2f70067bb0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:49.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.137+0000 7f2f944a2700 1 --2- 172.21.15.114:0/3885533096 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f2f8c15dd30 0x7f2f8c0b1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:49.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.137+0000 7f2f944a2700 1 --2- 172.21.15.114:0/3885533096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f8c146800 0x7f2f8c0b0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:49.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.137+0000 7f2f944a2700 1 --2- 172.21.15.114:0/3885533096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f8c0700b0 0x7f2f8c15c7f0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:49.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.137+0000 7f2f944a2700 1 -- 172.21.15.114:0/3885533096 >> 172.21.15.114:0/3885533096 conn(0x7f2f8c06a130 msgr2=0x7f2f8c06e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:49.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.137+0000 7f2f944a2700 1 -- 172.21.15.114:0/3885533096 shutdown_connections 2023-10-18T12:41:49.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.137+0000 7f2f944a2700 1 -- 172.21.15.114:0/3885533096 wait complete. 2023-10-18T12:41:49.165 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-18T12:19:27.040638+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-18T12:19:32.358094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-18T12:21:12.105324+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-10-18T12:21:13.154105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-18T12:41:49.165 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-18T12:41:49.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.333+0000 7fdabb1e8700 1 Processor -- start 2023-10-18T12:41:49.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.333+0000 7fdabb1e8700 1 -- start start 2023-10-18T12:41:49.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.337+0000 7fdabb1e8700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fdab415adf0 0x7fdab40cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:49.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.337+0000 7fdabb1e8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdab4070460 0x7fdab40708b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:49.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.337+0000 7fdabb1e8700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdab415b1d0 con 0x7fdab40cce10 2023-10-18T12:41:49.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.337+0000 7fdabb1e8700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdab40ca590 con 0x7fdab415adf0 2023-10-18T12:41:49.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.337+0000 7fdabb1e8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab4070df0 con 0x7fdab4070460 2023-10-18T12:41:49.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.337+0000 7fdab8f84700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fdab415adf0 0x7fdab40cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:49.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.337+0000 7fdab9785700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdab4070460 0x7fdab40708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:49.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.337+0000 7fdab9785700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdab4070460 0x7fdab40708b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.114:33300/0 (socket says 172.21.15.114:33300) 2023-10-18T12:41:49.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.337+0000 7fdab9785700 1 -- 172.21.15.114:0/3401794980 learned_addr learned my addr 172.21.15.114:0/3401794980 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:41:49.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.337+0000 7fdab8f84700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fdab415adf0 0x7fdab40cc8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:57506/0 (socket says 172.21.15.114:57506) 2023-10-18T12:41:49.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.341+0000 7fdab37fe700 1 -- 172.21.15.114:0/3401794980 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3927008512 0 0) 0x7fdaa4001110 con 0x7fdab40cce10 2023-10-18T12:41:49.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.341+0000 7fdab9785700 1 -- 172.21.15.114:0/3401794980 >> v2:172.21.15.172:3300/0 conn(0x7fdab415adf0 msgr2=0x7fdab40cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:41:49.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.341+0000 7fdab9785700 1 --2- 172.21.15.114:0/3401794980 >> v2:172.21.15.172:3300/0 conn(0x7fdab415adf0 0x7fdab40cc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:49.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.341+0000 7fdab9785700 1 -- 172.21.15.114:0/3401794980 >> v1:172.21.15.172:6789/0 conn(0x7fdab40cce10 legacy=0x7fdab40b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:49.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.341+0000 7fdab9785700 1 -- 172.21.15.114:0/3401794980 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab40ce600 con 0x7fdab4070460 2023-10-18T12:41:49.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.341+0000 7fdab9785700 1 --2- 172.21.15.114:0/3401794980 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdab4070460 0x7fdab40708b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdaac009e50 tx=0x7fdaac00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12aa928f2e4ddf22 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:49.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.341+0000 7fdab37fe700 1 -- 172.21.15.114:0/3401794980 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaac00e070 con 0x7fdab4070460 2023-10-18T12:41:49.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.341+0000 7fdab37fe700 1 -- 172.21.15.114:0/3401794980 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaac00b910 con 0x7fdab4070460 2023-10-18T12:41:49.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.341+0000 7fdab37fe700 1 -- 172.21.15.114:0/3401794980 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaac00bcc0 con 0x7fdab4070460 2023-10-18T12:41:49.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.341+0000 7fdabb1e8700 1 -- 172.21.15.114:0/3401794980 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdab4070460 msgr2=0x7fdab40708b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:49.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.341+0000 7fdabb1e8700 1 --2- 172.21.15.114:0/3401794980 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdab4070460 0x7fdab40708b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdaac009e50 tx=0x7fdaac00b330 comp rx=0 tx=0).stop 2023-10-18T12:41:49.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.341+0000 7fdabb1e8700 1 -- 172.21.15.114:0/3401794980 shutdown_connections 2023-10-18T12:41:49.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.341+0000 7fdabb1e8700 1 --2- 172.21.15.114:0/3401794980 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdab4070460 0x7fdab40708b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:49.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.341+0000 7fdabb1e8700 1 --2- 172.21.15.114:0/3401794980 >> v2:172.21.15.172:3300/0 conn(0x7fdab415adf0 0x7fdab40cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:49.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.341+0000 7fdabb1e8700 1 -- 172.21.15.114:0/3401794980 >> 172.21.15.114:0/3401794980 conn(0x7fdab40ce820 msgr2=0x7fdab40cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:49.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.341+0000 7fdabb1e8700 1 -- 172.21.15.114:0/3401794980 shutdown_connections 2023-10-18T12:41:49.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.341+0000 7fdabb1e8700 1 -- 172.21.15.114:0/3401794980 wait complete. 2023-10-18T12:41:49.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.345+0000 7fdabb1e8700 1 Processor -- start 2023-10-18T12:41:49.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.345+0000 7fdabb1e8700 1 -- start start 2023-10-18T12:41:49.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.349+0000 7fdabb1e8700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdab4070460 0x7fdab40ac940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:49.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.349+0000 7fdabb1e8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdab40cce10 0x7fdab40c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:49.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.349+0000 7fdabb1e8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdab415adf0 0x7fdab40c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:49.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.349+0000 7fdabb1e8700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab40c3490 con 0x7fdab4070460 2023-10-18T12:41:49.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.349+0000 7fdabb1e8700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab40c2810 con 0x7fdab40cce10 2023-10-18T12:41:49.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.349+0000 7fdabb1e8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab40c2af0 con 0x7fdab415adf0 2023-10-18T12:41:49.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.349+0000 7fdab8f84700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdab4070460 0x7fdab40ac940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:49.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.349+0000 7fdab8f84700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdab4070460 0x7fdab40ac940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39642/0 (socket says 172.21.15.114:39642) 2023-10-18T12:41:49.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.349+0000 7fdab8f84700 1 -- 172.21.15.114:0/1369086647 learned_addr learned my addr 172.21.15.114:0/1369086647 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:41:49.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.349+0000 7fdab9785700 1 --2- 172.21.15.114:0/1369086647 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdab415adf0 0x7fdab40c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:49.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.349+0000 7fdab3fff700 1 --2- 172.21.15.114:0/1369086647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdab40cce10 0x7fdab40c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:49.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.349+0000 7fdab8f84700 1 -- 172.21.15.114:0/1369086647 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdab415adf0 msgr2=0x7fdab40c8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:49.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.349+0000 7fdab8f84700 1 --2- 172.21.15.114:0/1369086647 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdab415adf0 0x7fdab40c8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:49.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.349+0000 7fdab8f84700 1 -- 172.21.15.114:0/1369086647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdab40cce10 msgr2=0x7fdab40c7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:49.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.349+0000 7fdab8f84700 1 --2- 172.21.15.114:0/1369086647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdab40cce10 0x7fdab40c7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:49.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.349+0000 7fdab8f84700 1 -- 172.21.15.114:0/1369086647 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaac009b30 con 0x7fdab4070460 2023-10-18T12:41:49.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.349+0000 7fdab9785700 1 --2- 172.21.15.114:0/1369086647 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdab415adf0 0x7fdab40c8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:41:49.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.349+0000 7fdab3fff700 1 --2- 172.21.15.114:0/1369086647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdab40cce10 0x7fdab40c7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:41:49.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.349+0000 7fdab8f84700 1 --2- 172.21.15.114:0/1369086647 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdab4070460 0x7fdab40ac940 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fdaa800e9d0 tx=0x7fdaa800ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:49.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.349+0000 7fdab17fa700 1 -- 172.21.15.114:0/1369086647 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa8009720 con 0x7fdab4070460 2023-10-18T12:41:49.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.349+0000 7fdab17fa700 1 -- 172.21.15.114:0/1369086647 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa800c850 con 0x7fdab4070460 2023-10-18T12:41:49.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.349+0000 7fdabb1e8700 1 -- 172.21.15.114:0/1369086647 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdab40c2dd0 con 0x7fdab4070460 2023-10-18T12:41:49.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.349+0000 7fdab17fa700 1 -- 172.21.15.114:0/1369086647 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa800cbc0 con 0x7fdab4070460 2023-10-18T12:41:49.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.349+0000 7fdabb1e8700 1 -- 172.21.15.114:0/1369086647 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdab40ace80 con 0x7fdab4070460 2023-10-18T12:41:49.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.349+0000 7fdabb1e8700 1 -- 172.21.15.114:0/1369086647 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdab4072e60 con 0x7fdab4070460 2023-10-18T12:41:49.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.353+0000 7fdab17fa700 1 -- 172.21.15.114:0/1369086647 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fdaa800cd20 con 0x7fdab4070460 2023-10-18T12:41:49.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.353+0000 7fdab17fa700 1 --2- 172.21.15.114:0/1369086647 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdaa0065720 0x7fdaa0067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:49.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.353+0000 7fdab17fa700 1 -- 172.21.15.114:0/1369086647 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7fdaa80831c0 con 0x7fdab4070460 2023-10-18T12:41:49.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.357+0000 7fdab3fff700 1 --2- 172.21.15.114:0/1369086647 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdaa0065720 0x7fdaa0067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:49.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.357+0000 7fdab3fff700 1 --2- 172.21.15.114:0/1369086647 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdaa0065720 0x7fdaa0067be0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fdab415e520 tx=0x7fdaa4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:49.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.361+0000 7fdab17fa700 1 -- 172.21.15.114:0/1369086647 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fdaa80543e0 con 0x7fdab4070460 2023-10-18T12:41:49.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.537+0000 7fdabb1e8700 1 -- 172.21.15.114:0/1369086647 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdab40cbd60 con 0x7fdab4070460 2023-10-18T12:41:49.542 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.537+0000 7fdab17fa700 1 -- 172.21.15.114:0/1369086647 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdaa8053f70 con 0x7fdab4070460 2023-10-18T12:41:49.543 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-10-18T12:41:49.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.541+0000 7fdabb1e8700 1 -- 172.21.15.114:0/1369086647 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdaa0065720 msgr2=0x7fdaa0067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:49.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.541+0000 7fdabb1e8700 1 --2- 172.21.15.114:0/1369086647 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdaa0065720 0x7fdaa0067be0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fdab415e520 tx=0x7fdaa4009040 comp rx=0 tx=0).stop 2023-10-18T12:41:49.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.541+0000 7fdabb1e8700 1 -- 172.21.15.114:0/1369086647 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdab4070460 msgr2=0x7fdab40ac940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:49.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.541+0000 7fdabb1e8700 1 --2- 172.21.15.114:0/1369086647 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdab4070460 0x7fdab40ac940 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fdaa800e9d0 tx=0x7fdaa800ed90 comp rx=0 tx=0).stop 2023-10-18T12:41:49.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.541+0000 7fdabb1e8700 1 -- 172.21.15.114:0/1369086647 shutdown_connections 2023-10-18T12:41:49.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.541+0000 7fdabb1e8700 1 --2- 172.21.15.114:0/1369086647 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdaa0065720 0x7fdaa0067be0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:49.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.541+0000 7fdabb1e8700 1 --2- 172.21.15.114:0/1369086647 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdab415adf0 0x7fdab40c8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:49.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.541+0000 7fdabb1e8700 1 --2- 172.21.15.114:0/1369086647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdab40cce10 0x7fdab40c7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:49.549 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.541+0000 7fdabb1e8700 1 --2- 172.21.15.114:0/1369086647 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdab4070460 0x7fdab40ac940 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:49.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.541+0000 7fdabb1e8700 1 -- 172.21.15.114:0/1369086647 >> 172.21.15.114:0/1369086647 conn(0x7fdab40ce820 msgr2=0x7fdab40caf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:49.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.541+0000 7fdabb1e8700 1 -- 172.21.15.114:0/1369086647 shutdown_connections 2023-10-18T12:41:49.550 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.541+0000 7fdabb1e8700 1 -- 172.21.15.114:0/1369086647 wait complete. 2023-10-18T12:41:49.568 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-18T12:41:49.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.741+0000 7f352edef700 1 Processor -- start 2023-10-18T12:41:49.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.745+0000 7f352edef700 1 -- start start 2023-10-18T12:41:49.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.745+0000 7f352edef700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f35280b3d40 0x7f35280cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:49.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.745+0000 7f352edef700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35280ca4c0 con 0x7f3528164a20 2023-10-18T12:41:49.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.745+0000 7f352edef700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35280ca7a0 con 0x7f352806ce20 2023-10-18T12:41:49.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.745+0000 7f352edef700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f352806e2d0 con 0x7f35280b3d40 2023-10-18T12:41:49.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.749+0000 7f352d5ec700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f3528164a20 0x7f35280c9cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60268/0 (socket says 172.21.15.114:60268) 2023-10-18T12:41:49.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.749+0000 7f352d5ec700 1 -- 172.21.15.114:0/3152626887 learned_addr learned my addr 172.21.15.114:0/3152626887 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:41:49.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.749+0000 7f352dded700 1 --2- 172.21.15.114:0/3152626887 >> v2:172.21.15.114:3300/0 conn(0x7f35280b3d40 0x7f35280cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:49.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.749+0000 7f352cdeb700 1 -- 172.21.15.114:0/3152626887 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2547589950 0 0) 0x7f35280ca4c0 con 0x7f3528164a20 2023-10-18T12:41:49.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.749+0000 7f352cdeb700 1 -- 172.21.15.114:0/3152626887 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35140035d0 con 0x7f3528164a20 2023-10-18T12:41:49.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.749+0000 7f352cdeb700 1 -- 172.21.15.114:0/3152626887 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 292841500 0 0) 0x7f35280ca7a0 con 0x7f352806ce20 2023-10-18T12:41:49.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.749+0000 7f352dded700 1 -- 172.21.15.114:0/3152626887 >> v1:172.21.15.172:6789/0 conn(0x7f352806ce20 legacy=0x7f352806f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:49.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.749+0000 7f352dded700 1 -- 172.21.15.114:0/3152626887 >> v1:172.21.15.114:6789/0 conn(0x7f3528164a20 legacy=0x7f35280c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:49.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.749+0000 7f352dded700 1 -- 172.21.15.114:0/3152626887 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35280caa80 con 0x7f35280b3d40 2023-10-18T12:41:49.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.749+0000 7f352dded700 1 --2- 172.21.15.114:0/3152626887 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35280b3d40 0x7f35280cc190 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f3524009850 tx=0x7f3524009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6168836ca378b26 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:49.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.749+0000 7f352cdeb700 1 -- 172.21.15.114:0/3152626887 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3524011830 con 0x7f35280b3d40 2023-10-18T12:41:49.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.749+0000 7f352cdeb700 1 -- 172.21.15.114:0/3152626887 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3524011990 con 0x7f35280b3d40 2023-10-18T12:41:49.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.749+0000 7f352cdeb700 1 -- 172.21.15.114:0/3152626887 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3524011d40 con 0x7f35280b3d40 2023-10-18T12:41:49.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.749+0000 7f352edef700 1 -- 172.21.15.114:0/3152626887 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35280b3d40 msgr2=0x7f35280cc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:49.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.749+0000 7f352edef700 1 --2- 172.21.15.114:0/3152626887 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35280b3d40 0x7f35280cc190 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f3524009850 tx=0x7f3524009b60 comp rx=0 tx=0).stop 2023-10-18T12:41:49.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.749+0000 7f352edef700 1 -- 172.21.15.114:0/3152626887 shutdown_connections 2023-10-18T12:41:49.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.749+0000 7f352edef700 1 --2- 172.21.15.114:0/3152626887 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f35280b3d40 0x7f35280cc190 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:49.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.749+0000 7f352edef700 1 -- 172.21.15.114:0/3152626887 >> 172.21.15.114:0/3152626887 conn(0x7f35280ce5c0 msgr2=0x7f35280ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:49.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.753+0000 7f352edef700 1 -- 172.21.15.114:0/3152626887 shutdown_connections 2023-10-18T12:41:49.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.753+0000 7f352edef700 1 -- 172.21.15.114:0/3152626887 wait complete. 2023-10-18T12:41:49.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.753+0000 7f352edef700 1 Processor -- start 2023-10-18T12:41:49.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.753+0000 7f352edef700 1 -- start start 2023-10-18T12:41:49.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.753+0000 7f352edef700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f352806ce20 0x7f3528162a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:49.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.753+0000 7f352edef700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35280b3d40 0x7f352815e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:49.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.753+0000 7f352edef700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3528164a20 0x7f35280c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:49.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.753+0000 7f352edef700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35280c7190 con 0x7f352806ce20 2023-10-18T12:41:49.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.753+0000 7f352edef700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35280c7620 con 0x7f3528164a20 2023-10-18T12:41:49.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.753+0000 7f352edef700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35280c6580 con 0x7f35280b3d40 2023-10-18T12:41:49.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.753+0000 7f352dded700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f352806ce20 0x7f3528162a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:49.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.753+0000 7f352dded700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f352806ce20 0x7f3528162a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39660/0 (socket says 172.21.15.114:39660) 2023-10-18T12:41:49.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.753+0000 7f352dded700 1 -- 172.21.15.114:0/1433481924 learned_addr learned my addr 172.21.15.114:0/1433481924 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:41:49.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.757+0000 7f352e5ee700 1 --2- 172.21.15.114:0/1433481924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3528164a20 0x7f35280c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:49.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.757+0000 7f352d5ec700 1 --2- 172.21.15.114:0/1433481924 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35280b3d40 0x7f352815e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:49.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.757+0000 7f352dded700 1 -- 172.21.15.114:0/1433481924 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35280b3d40 msgr2=0x7f352815e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:49.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.757+0000 7f352dded700 1 --2- 172.21.15.114:0/1433481924 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35280b3d40 0x7f352815e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:49.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.757+0000 7f352dded700 1 -- 172.21.15.114:0/1433481924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3528164a20 msgr2=0x7f35280c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:49.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.757+0000 7f352dded700 1 --2- 172.21.15.114:0/1433481924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3528164a20 0x7f35280c7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:49.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.757+0000 7f352dded700 1 -- 172.21.15.114:0/1433481924 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35240094b0 con 0x7f352806ce20 2023-10-18T12:41:49.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.757+0000 7f352dded700 1 --2- 172.21.15.114:0/1433481924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f352806ce20 0x7f3528162a60 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f3524009eb0 tx=0x7f3524004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:49.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.757+0000 7f351e7fc700 1 -- 172.21.15.114:0/1433481924 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352401aba0 con 0x7f352806ce20 2023-10-18T12:41:49.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.757+0000 7f351e7fc700 1 -- 172.21.15.114:0/1433481924 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352401f070 con 0x7f352806ce20 2023-10-18T12:41:49.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.757+0000 7f352edef700 1 -- 172.21.15.114:0/1433481924 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35280c6860 con 0x7f352806ce20 2023-10-18T12:41:49.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.757+0000 7f351e7fc700 1 -- 172.21.15.114:0/1433481924 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352401b430 con 0x7f352806ce20 2023-10-18T12:41:49.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.757+0000 7f352edef700 1 -- 172.21.15.114:0/1433481924 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35280c6e20 con 0x7f352806ce20 2023-10-18T12:41:49.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.757+0000 7f352edef700 1 -- 172.21.15.114:0/1433481924 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f352804e910 con 0x7f352806ce20 2023-10-18T12:41:49.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.757+0000 7f351e7fc700 1 -- 172.21.15.114:0/1433481924 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f352401b590 con 0x7f352806ce20 2023-10-18T12:41:49.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.761+0000 7f351e7fc700 1 --2- 172.21.15.114:0/1433481924 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f350c0656f0 0x7f350c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:49.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.761+0000 7f351e7fc700 1 -- 172.21.15.114:0/1433481924 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7f35240841c0 con 0x7f352806ce20 2023-10-18T12:41:49.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.761+0000 7f352d5ec700 1 --2- 172.21.15.114:0/1433481924 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f350c0656f0 0x7f350c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:49.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.761+0000 7f352d5ec700 1 --2- 172.21.15.114:0/1433481924 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f350c0656f0 0x7f350c067bb0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f35281f9d00 tx=0x7f3518009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:49.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.765+0000 7f351e7fc700 1 -- 172.21.15.114:0/1433481924 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f3524051a80 con 0x7f352806ce20 2023-10-18T12:41:49.952 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.945+0000 7f352edef700 1 -- 172.21.15.114:0/1433481924 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f352815ffd0 con 0x7f352806ce20 2023-10-18T12:41:49.953 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.949+0000 7f351e7fc700 1 -- 172.21.15.114:0/1433481924 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v60) v1 ==== 92+0+10 (secure 0 0 0) 0x7f35240550a0 con 0x7f352806ce20 2023-10-18T12:41:49.953 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 8 2023-10-18T12:41:49.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.949+0000 7f352edef700 1 -- 172.21.15.114:0/1433481924 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f350c0656f0 msgr2=0x7f350c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:49.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.949+0000 7f352edef700 1 --2- 172.21.15.114:0/1433481924 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f350c0656f0 0x7f350c067bb0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f35281f9d00 tx=0x7f3518009040 comp rx=0 tx=0).stop 2023-10-18T12:41:49.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.949+0000 7f352edef700 1 -- 172.21.15.114:0/1433481924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f352806ce20 msgr2=0x7f3528162a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:49.956 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.949+0000 7f352edef700 1 --2- 172.21.15.114:0/1433481924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f352806ce20 0x7f3528162a60 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f3524009eb0 tx=0x7f3524004770 comp rx=0 tx=0).stop 2023-10-18T12:41:49.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.949+0000 7f352edef700 1 -- 172.21.15.114:0/1433481924 shutdown_connections 2023-10-18T12:41:49.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.949+0000 7f352edef700 1 --2- 172.21.15.114:0/1433481924 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f350c0656f0 0x7f350c067bb0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:49.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.949+0000 7f352edef700 1 --2- 172.21.15.114:0/1433481924 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f35280b3d40 0x7f352815e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:49.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.949+0000 7f352edef700 1 --2- 172.21.15.114:0/1433481924 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3528164a20 0x7f35280c7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:49.957 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.949+0000 7f352edef700 1 --2- 172.21.15.114:0/1433481924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f352806ce20 0x7f3528162a60 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:49.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.949+0000 7f352edef700 1 -- 172.21.15.114:0/1433481924 >> 172.21.15.114:0/1433481924 conn(0x7f35280ce5c0 msgr2=0x7f35280cafa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:49.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.953+0000 7f352edef700 1 -- 172.21.15.114:0/1433481924 shutdown_connections 2023-10-18T12:41:49.958 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:49.953+0000 7f352edef700 1 -- 172.21.15.114:0/1433481924 wait complete. 2023-10-18T12:41:49.975 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-18T12:41:50.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.149+0000 7f9afce47700 1 Processor -- start 2023-10-18T12:41:50.156 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.149+0000 7f9afce47700 1 -- start start 2023-10-18T12:41:50.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.153+0000 7f9afce47700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9af80ce040 0x7f9af8164780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:50.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.153+0000 7f9afce47700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af80b14f0 con 0x7f9af8070c70 2023-10-18T12:41:50.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.153+0000 7f9afce47700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af815d590 con 0x7f9af8159750 2023-10-18T12:41:50.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.153+0000 7f9afce47700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9af80c9aa0 con 0x7f9af80ce040 2023-10-18T12:41:50.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.153+0000 7f9af7fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9af80ce040 0x7f9af8164780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:50.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.153+0000 7f9aeeffd700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f9af8070c70 0x7f9af80cd930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60280/0 (socket says 172.21.15.114:60280) 2023-10-18T12:41:50.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.153+0000 7f9aeeffd700 1 -- 172.21.15.114:0/861923534 learned_addr learned my addr 172.21.15.114:0/861923534 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:41:50.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.153+0000 7f9af7fff700 1 -- 172.21.15.114:0/861923534 >> v1:172.21.15.172:6789/0 conn(0x7f9af8159750 legacy=0x7f9af8070560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:50.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.153+0000 7f9af7fff700 1 -- 172.21.15.114:0/861923534 >> v1:172.21.15.114:6789/0 conn(0x7f9af8070c70 legacy=0x7f9af80cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:50.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.153+0000 7f9af7fff700 1 -- 172.21.15.114:0/861923534 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af815d870 con 0x7f9af80ce040 2023-10-18T12:41:50.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.157+0000 7f9af7fff700 1 --2- 172.21.15.114:0/861923534 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9af80ce040 0x7f9af8164780 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f9af0009d90 tx=0x7f9af000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=895ece8db91c75da server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:50.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.157+0000 7f9af6ffd700 1 -- 172.21.15.114:0/861923534 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af000bdd0 con 0x7f9af80ce040 2023-10-18T12:41:50.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.157+0000 7f9af6ffd700 1 -- 172.21.15.114:0/861923534 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af0011460 con 0x7f9af80ce040 2023-10-18T12:41:50.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.157+0000 7f9af6ffd700 1 -- 172.21.15.114:0/861923534 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af0011810 con 0x7f9af80ce040 2023-10-18T12:41:50.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.157+0000 7f9afce47700 1 -- 172.21.15.114:0/861923534 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9af80ce040 msgr2=0x7f9af8164780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:50.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.157+0000 7f9afce47700 1 --2- 172.21.15.114:0/861923534 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9af80ce040 0x7f9af8164780 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f9af0009d90 tx=0x7f9af000b330 comp rx=0 tx=0).stop 2023-10-18T12:41:50.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.157+0000 7f9afce47700 1 -- 172.21.15.114:0/861923534 shutdown_connections 2023-10-18T12:41:50.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.157+0000 7f9afce47700 1 --2- 172.21.15.114:0/861923534 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9af80ce040 0x7f9af8164780 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:50.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.157+0000 7f9afce47700 1 -- 172.21.15.114:0/861923534 >> 172.21.15.114:0/861923534 conn(0x7f9af80ce5c0 msgr2=0x7f9af80ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:50.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.157+0000 7f9afce47700 1 -- 172.21.15.114:0/861923534 shutdown_connections 2023-10-18T12:41:50.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.157+0000 7f9afce47700 1 -- 172.21.15.114:0/861923534 wait complete. 2023-10-18T12:41:50.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.161+0000 7f9afce47700 1 Processor -- start 2023-10-18T12:41:50.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.161+0000 7f9afce47700 1 -- start start 2023-10-18T12:41:50.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.165+0000 7f9afce47700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9af8070c70 0x7f9af81f6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:50.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.165+0000 7f9afce47700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9af80ce040 0x7f9af8157070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:50.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.165+0000 7f9afce47700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9af8159750 0x7f9af814ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:50.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.165+0000 7f9afce47700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af81582f0 con 0x7f9af80ce040 2023-10-18T12:41:50.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.165+0000 7f9afce47700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af81576e0 con 0x7f9af8159750 2023-10-18T12:41:50.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.165+0000 7f9afce47700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af81579c0 con 0x7f9af8070c70 2023-10-18T12:41:50.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.165+0000 7f9aeeffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9af80ce040 0x7f9af8157070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:50.170 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.165+0000 7f9aeeffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9af80ce040 0x7f9af8157070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39678/0 (socket says 172.21.15.114:39678) 2023-10-18T12:41:50.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.165+0000 7f9aeeffd700 1 -- 172.21.15.114:0/127771964 learned_addr learned my addr 172.21.15.114:0/127771964 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:41:50.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.165+0000 7f9af77fe700 1 --2- 172.21.15.114:0/127771964 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9af8070c70 0x7f9af81f6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:50.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.165+0000 7f9af7fff700 1 --2- 172.21.15.114:0/127771964 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9af8159750 0x7f9af814ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:50.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.165+0000 7f9aeeffd700 1 -- 172.21.15.114:0/127771964 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9af8070c70 msgr2=0x7f9af81f6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:50.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.165+0000 7f9aeeffd700 1 --2- 172.21.15.114:0/127771964 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9af8070c70 0x7f9af81f6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:50.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.165+0000 7f9aeeffd700 1 -- 172.21.15.114:0/127771964 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9af8159750 msgr2=0x7f9af814ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:50.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.165+0000 7f9aeeffd700 1 --2- 172.21.15.114:0/127771964 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9af8159750 0x7f9af814ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:50.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.165+0000 7f9aeeffd700 1 -- 172.21.15.114:0/127771964 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af0009a70 con 0x7f9af80ce040 2023-10-18T12:41:50.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.165+0000 7f9af77fe700 1 --2- 172.21.15.114:0/127771964 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9af8070c70 0x7f9af81f6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:41:50.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.165+0000 7f9af7fff700 1 --2- 172.21.15.114:0/127771964 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9af8159750 0x7f9af814ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:41:50.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.165+0000 7f9aeeffd700 1 --2- 172.21.15.114:0/127771964 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9af80ce040 0x7f9af8157070 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f9ae000c520 tx=0x7f9ae000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:50.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.165+0000 7f9af4ff9700 1 -- 172.21.15.114:0/127771964 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae0005d90 con 0x7f9af80ce040 2023-10-18T12:41:50.174 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.165+0000 7f9af4ff9700 1 -- 172.21.15.114:0/127771964 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae00070d0 con 0x7f9af80ce040 2023-10-18T12:41:50.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.165+0000 7f9af4ff9700 1 -- 172.21.15.114:0/127771964 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae0007440 con 0x7f9af80ce040 2023-10-18T12:41:50.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.165+0000 7f9afce47700 1 -- 172.21.15.114:0/127771964 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9af8157ca0 con 0x7f9af80ce040 2023-10-18T12:41:50.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.165+0000 7f9afce47700 1 -- 172.21.15.114:0/127771964 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9af806e140 con 0x7f9af80ce040 2023-10-18T12:41:50.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.165+0000 7f9afce47700 1 -- 172.21.15.114:0/127771964 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9af804e910 con 0x7f9af80ce040 2023-10-18T12:41:50.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.169+0000 7f9af4ff9700 1 -- 172.21.15.114:0/127771964 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f9ae00075a0 con 0x7f9af80ce040 2023-10-18T12:41:50.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.169+0000 7f9af4ff9700 1 --2- 172.21.15.114:0/127771964 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9ad80656f0 0x7f9ad8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:50.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.169+0000 7f9af4ff9700 1 -- 172.21.15.114:0/127771964 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7f9ae0082470 con 0x7f9af80ce040 2023-10-18T12:41:50.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.169+0000 7f9af77fe700 1 --2- 172.21.15.114:0/127771964 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9ad80656f0 0x7f9ad8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:50.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.173+0000 7f9af77fe700 1 --2- 172.21.15.114:0/127771964 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9ad80656f0 0x7f9ad8067bb0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9ae8000f60 tx=0x7f9ae8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:50.180 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.173+0000 7f9af4ff9700 1 -- 172.21.15.114:0/127771964 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f9ae004fd40 con 0x7f9af80ce040 2023-10-18T12:41:50.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.353+0000 7f9afce47700 1 -- 172.21.15.114:0/127771964 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9af815db20 con 0x7f9af80ce040 2023-10-18T12:41:50.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.353+0000 7f9af4ff9700 1 -- 172.21.15.114:0/127771964 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v60) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9ae0053360 con 0x7f9af80ce040 2023-10-18T12:41:50.358 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-10-18T12:41:50.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.357+0000 7f9afce47700 1 -- 172.21.15.114:0/127771964 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9ad80656f0 msgr2=0x7f9ad8067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:50.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.357+0000 7f9afce47700 1 --2- 172.21.15.114:0/127771964 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9ad80656f0 0x7f9ad8067bb0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9ae8000f60 tx=0x7f9ae8009040 comp rx=0 tx=0).stop 2023-10-18T12:41:50.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.357+0000 7f9afce47700 1 -- 172.21.15.114:0/127771964 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9af80ce040 msgr2=0x7f9af8157070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:50.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.357+0000 7f9afce47700 1 --2- 172.21.15.114:0/127771964 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9af80ce040 0x7f9af8157070 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f9ae000c520 tx=0x7f9ae000c8e0 comp rx=0 tx=0).stop 2023-10-18T12:41:50.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.357+0000 7f9afce47700 1 -- 172.21.15.114:0/127771964 shutdown_connections 2023-10-18T12:41:50.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.357+0000 7f9afce47700 1 --2- 172.21.15.114:0/127771964 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9ad80656f0 0x7f9ad8067bb0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:50.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.357+0000 7f9afce47700 1 --2- 172.21.15.114:0/127771964 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9af8159750 0x7f9af814ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:50.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.357+0000 7f9afce47700 1 --2- 172.21.15.114:0/127771964 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9af80ce040 0x7f9af8157070 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:50.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.357+0000 7f9afce47700 1 --2- 172.21.15.114:0/127771964 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9af8070c70 0x7f9af81f6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:50.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.357+0000 7f9afce47700 1 -- 172.21.15.114:0/127771964 >> 172.21.15.114:0/127771964 conn(0x7f9af80ce5c0 msgr2=0x7f9af8070010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:50.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.357+0000 7f9afce47700 1 -- 172.21.15.114:0/127771964 shutdown_connections 2023-10-18T12:41:50.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.357+0000 7f9afce47700 1 -- 172.21.15.114:0/127771964 wait complete. 2023-10-18T12:41:50.383 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-18T12:41:50.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.561+0000 7f890c271700 1 Processor -- start 2023-10-18T12:41:50.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.565+0000 7f890c271700 1 -- start start 2023-10-18T12:41:50.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.565+0000 7f890c271700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f890415adf0 0x7f89040cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:50.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.565+0000 7f890c271700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f89040cce10 0x7f89040b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:50.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.565+0000 7f890c271700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f890415b1d0 con 0x7f89040b1e80 2023-10-18T12:41:50.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.565+0000 7f890c271700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89040ca590 con 0x7f89040cce10 2023-10-18T12:41:50.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.565+0000 7f890c271700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89040ce600 con 0x7f890415adf0 2023-10-18T12:41:50.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.565+0000 7f890980c700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f89040cce10 0x7f89040b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:50.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.565+0000 7f890a80e700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f89040b1e80 0x7f89040b2310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60282/0 (socket says 172.21.15.114:60282) 2023-10-18T12:41:50.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.565+0000 7f890a80e700 1 -- 172.21.15.114:0/3000315262 learned_addr learned my addr 172.21.15.114:0/3000315262 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:41:50.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.565+0000 7f890a00d700 1 --2- 172.21.15.114:0/3000315262 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f890415adf0 0x7f89040cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:50.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.569+0000 7f890a00d700 1 -- 172.21.15.114:0/3000315262 >> v2:172.21.15.114:3300/0 conn(0x7f89040cce10 msgr2=0x7f89040b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:41:50.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.569+0000 7f890a00d700 1 --2- 172.21.15.114:0/3000315262 >> v2:172.21.15.114:3300/0 conn(0x7f89040cce10 0x7f89040b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:50.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.569+0000 7f890a00d700 1 -- 172.21.15.114:0/3000315262 >> v1:172.21.15.114:6789/0 conn(0x7f89040b1e80 legacy=0x7f89040b2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:50.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.569+0000 7f890a00d700 1 -- 172.21.15.114:0/3000315262 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89040cd580 con 0x7f890415adf0 2023-10-18T12:41:50.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.569+0000 7f890980c700 1 --2- 172.21.15.114:0/3000315262 >> v2:172.21.15.114:3300/0 conn(0x7f89040cce10 0x7f89040b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:41:50.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.569+0000 7f890900b700 1 -- 172.21.15.114:0/3000315262 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2926342503 0 0) 0x7f88fc001110 con 0x7f89040b1e80 2023-10-18T12:41:50.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.569+0000 7f890a00d700 1 --2- 172.21.15.114:0/3000315262 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f890415adf0 0x7f89040cc8d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8900009d90 tx=0x7f890000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b049a18022eff104 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:50.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.569+0000 7f890900b700 1 -- 172.21.15.114:0/3000315262 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890000e070 con 0x7f890415adf0 2023-10-18T12:41:50.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.569+0000 7f890900b700 1 -- 172.21.15.114:0/3000315262 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f890000bb20 con 0x7f890415adf0 2023-10-18T12:41:50.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.569+0000 7f890900b700 1 -- 172.21.15.114:0/3000315262 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8900012430 con 0x7f890415adf0 2023-10-18T12:41:50.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.569+0000 7f890c271700 1 -- 172.21.15.114:0/3000315262 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f890415adf0 msgr2=0x7f89040cc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:50.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.569+0000 7f890c271700 1 --2- 172.21.15.114:0/3000315262 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f890415adf0 0x7f89040cc8d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8900009d90 tx=0x7f890000b330 comp rx=0 tx=0).stop 2023-10-18T12:41:50.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.569+0000 7f890c271700 1 -- 172.21.15.114:0/3000315262 shutdown_connections 2023-10-18T12:41:50.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.569+0000 7f890c271700 1 --2- 172.21.15.114:0/3000315262 >> v2:172.21.15.114:3300/0 conn(0x7f89040cce10 0x7f89040b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:50.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.569+0000 7f890c271700 1 --2- 172.21.15.114:0/3000315262 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f890415adf0 0x7f89040cc8d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:50.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.569+0000 7f890c271700 1 -- 172.21.15.114:0/3000315262 >> 172.21.15.114:0/3000315262 conn(0x7f89040ce820 msgr2=0x7f89040cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:50.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.569+0000 7f890c271700 1 -- 172.21.15.114:0/3000315262 shutdown_connections 2023-10-18T12:41:50.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.569+0000 7f890c271700 1 -- 172.21.15.114:0/3000315262 wait complete. 2023-10-18T12:41:50.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.573+0000 7f890c271700 1 Processor -- start 2023-10-18T12:41:50.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.573+0000 7f890c271700 1 -- start start 2023-10-18T12:41:50.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.577+0000 7f890c271700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89040b1e80 0x7f890414dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:50.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.577+0000 7f890c271700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89040cce10 0x7f890406e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:50.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.577+0000 7f890c271700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f890415adf0 0x7f89041f5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:50.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.577+0000 7f890c271700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89040abe60 con 0x7f89040cce10 2023-10-18T12:41:50.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.577+0000 7f890c271700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89040ac140 con 0x7f890415adf0 2023-10-18T12:41:50.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.577+0000 7f890c271700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89040ac420 con 0x7f89040b1e80 2023-10-18T12:41:50.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.577+0000 7f890980c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89040cce10 0x7f890406e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:50.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.577+0000 7f890980c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89040cce10 0x7f890406e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39692/0 (socket says 172.21.15.114:39692) 2023-10-18T12:41:50.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.577+0000 7f890980c700 1 -- 172.21.15.114:0/1939192740 learned_addr learned my addr 172.21.15.114:0/1939192740 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:41:50.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.577+0000 7f890a00d700 1 --2- 172.21.15.114:0/1939192740 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89040b1e80 0x7f890414dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:50.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.577+0000 7f890a80e700 1 --2- 172.21.15.114:0/1939192740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f890415adf0 0x7f89041f5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:50.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.577+0000 7f890980c700 1 -- 172.21.15.114:0/1939192740 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89040b1e80 msgr2=0x7f890414dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:50.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.577+0000 7f890980c700 1 --2- 172.21.15.114:0/1939192740 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89040b1e80 0x7f890414dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:50.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.577+0000 7f890980c700 1 -- 172.21.15.114:0/1939192740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f890415adf0 msgr2=0x7f89041f5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:50.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.577+0000 7f890980c700 1 --2- 172.21.15.114:0/1939192740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f890415adf0 0x7f89041f5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:50.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.577+0000 7f890980c700 1 -- 172.21.15.114:0/1939192740 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f40094b0 con 0x7f89040cce10 2023-10-18T12:41:50.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.577+0000 7f890980c700 1 --2- 172.21.15.114:0/1939192740 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89040cce10 0x7f890406e450 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f88f400ebe0 tx=0x7f88f400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:50.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.577+0000 7f88faffd700 1 -- 172.21.15.114:0/1939192740 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f400c850 con 0x7f89040cce10 2023-10-18T12:41:50.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.577+0000 7f88faffd700 1 -- 172.21.15.114:0/1939192740 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f400c9b0 con 0x7f89040cce10 2023-10-18T12:41:50.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.577+0000 7f88faffd700 1 -- 172.21.15.114:0/1939192740 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f400cd40 con 0x7f89040cce10 2023-10-18T12:41:50.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.577+0000 7f890c271700 1 -- 172.21.15.114:0/1939192740 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8900009a70 con 0x7f89040cce10 2023-10-18T12:41:50.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.577+0000 7f890c271700 1 -- 172.21.15.114:0/1939192740 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89040ac9e0 con 0x7f89040cce10 2023-10-18T12:41:50.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.581+0000 7f890c271700 1 -- 172.21.15.114:0/1939192740 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8904072e60 con 0x7f89040cce10 2023-10-18T12:41:50.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.581+0000 7f88faffd700 1 -- 172.21.15.114:0/1939192740 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f88f4013470 con 0x7f89040cce10 2023-10-18T12:41:50.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.581+0000 7f88faffd700 1 --2- 172.21.15.114:0/1939192740 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f88e80656f0 0x7f88e8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:50.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.585+0000 7f88faffd700 1 -- 172.21.15.114:0/1939192740 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7f88f4083210 con 0x7f89040cce10 2023-10-18T12:41:50.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.585+0000 7f890a00d700 1 --2- 172.21.15.114:0/1939192740 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f88e80656f0 0x7f88e8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:50.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.585+0000 7f890a00d700 1 --2- 172.21.15.114:0/1939192740 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f88e80656f0 0x7f88e8067bb0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8900014040 tx=0x7f8900011000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:50.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.589+0000 7f88faffd700 1 -- 172.21.15.114:0/1939192740 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f88f40509a0 con 0x7f89040cce10 2023-10-18T12:41:50.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.765+0000 7f890c271700 1 -- 172.21.15.114:0/1939192740 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f89040ce0d0 con 0x7f89040cce10 2023-10-18T12:41:50.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.769+0000 7f88faffd700 1 -- 172.21.15.114:0/1939192740 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v60) v1 ==== 100+0+11 (secure 0 0 0) 0x7f88f400cea0 con 0x7f89040cce10 2023-10-18T12:41:50.773 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-10-18T12:41:50.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.769+0000 7f890c271700 1 -- 172.21.15.114:0/1939192740 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f88e80656f0 msgr2=0x7f88e8067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:50.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.769+0000 7f890c271700 1 --2- 172.21.15.114:0/1939192740 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f88e80656f0 0x7f88e8067bb0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8900014040 tx=0x7f8900011000 comp rx=0 tx=0).stop 2023-10-18T12:41:50.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.769+0000 7f890c271700 1 -- 172.21.15.114:0/1939192740 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89040cce10 msgr2=0x7f890406e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:50.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.769+0000 7f890c271700 1 --2- 172.21.15.114:0/1939192740 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89040cce10 0x7f890406e450 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f88f400ebe0 tx=0x7f88f400eef0 comp rx=0 tx=0).stop 2023-10-18T12:41:50.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.769+0000 7f890c271700 1 -- 172.21.15.114:0/1939192740 shutdown_connections 2023-10-18T12:41:50.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.769+0000 7f890c271700 1 --2- 172.21.15.114:0/1939192740 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f88e80656f0 0x7f88e8067bb0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:50.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.769+0000 7f890c271700 1 --2- 172.21.15.114:0/1939192740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f890415adf0 0x7f89041f5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:50.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.769+0000 7f890c271700 1 --2- 172.21.15.114:0/1939192740 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f89040cce10 0x7f890406e450 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:50.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.769+0000 7f890c271700 1 --2- 172.21.15.114:0/1939192740 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f89040b1e80 0x7f890414dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:50.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.769+0000 7f890c271700 1 -- 172.21.15.114:0/1939192740 >> 172.21.15.114:0/1939192740 conn(0x7f89040ce820 msgr2=0x7f890406f450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:50.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.769+0000 7f890c271700 1 -- 172.21.15.114:0/1939192740 shutdown_connections 2023-10-18T12:41:50.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.769+0000 7f890c271700 1 -- 172.21.15.114:0/1939192740 wait complete. 2023-10-18T12:41:50.797 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-18T12:41:50.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.965+0000 7f27dc915700 1 Processor -- start 2023-10-18T12:41:50.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.969+0000 7f27dc915700 1 -- start start 2023-10-18T12:41:50.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.969+0000 7f27dc915700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f27d80cb8a0 0x7f27d80cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:50.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.969+0000 7f27dc915700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d8070de0 con 0x7f27d80b22f0 2023-10-18T12:41:50.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.969+0000 7f27dc915700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d80701d0 con 0x7f27d8144150 2023-10-18T12:41:50.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.969+0000 7f27dc915700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d80cc270 con 0x7f27d80cb8a0 2023-10-18T12:41:50.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.969+0000 7f27d7fff700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f27d80b22f0 0x7f27d80b2740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60292/0 (socket says 172.21.15.114:60292) 2023-10-18T12:41:50.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.969+0000 7f27d7fff700 1 -- 172.21.15.114:0/4039988099 learned_addr learned my addr 172.21.15.114:0/4039988099 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:41:50.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.969+0000 7f27ceffd700 1 --2- 172.21.15.114:0/4039988099 >> v2:172.21.15.114:3300/0 conn(0x7f27d80cb8a0 0x7f27d80cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:50.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.969+0000 7f27d6ffd700 1 -- 172.21.15.114:0/4039988099 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1508474077 0 0) 0x7f27d8070de0 con 0x7f27d80b22f0 2023-10-18T12:41:50.976 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.969+0000 7f27d6ffd700 1 -- 172.21.15.114:0/4039988099 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27b80035d0 con 0x7f27d80b22f0 2023-10-18T12:41:50.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.969+0000 7f27ceffd700 1 -- 172.21.15.114:0/4039988099 >> v1:172.21.15.172:6789/0 conn(0x7f27d8144150 legacy=0x7f27d80cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:50.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.969+0000 7f27d6ffd700 1 -- 172.21.15.114:0/4039988099 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3063178548 0 0) 0x7f27d80701d0 con 0x7f27d8144150 2023-10-18T12:41:50.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.969+0000 7f27ceffd700 1 -- 172.21.15.114:0/4039988099 >> v1:172.21.15.114:6789/0 conn(0x7f27d80b22f0 legacy=0x7f27d80b2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:50.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.969+0000 7f27ceffd700 1 -- 172.21.15.114:0/4039988099 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d80704b0 con 0x7f27d80cb8a0 2023-10-18T12:41:50.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.969+0000 7f27ceffd700 1 --2- 172.21.15.114:0/4039988099 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27d80cb8a0 0x7f27d80cbd30 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f27c0009850 tx=0x7f27c0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9ec46db86918970 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:50.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.973+0000 7f27d6ffd700 1 -- 172.21.15.114:0/4039988099 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c0011830 con 0x7f27d80cb8a0 2023-10-18T12:41:50.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.973+0000 7f27d6ffd700 1 -- 172.21.15.114:0/4039988099 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c0011990 con 0x7f27d80cb8a0 2023-10-18T12:41:50.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.973+0000 7f27d6ffd700 1 -- 172.21.15.114:0/4039988099 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c0011d00 con 0x7f27d80cb8a0 2023-10-18T12:41:50.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.973+0000 7f27dc915700 1 -- 172.21.15.114:0/4039988099 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27d80cb8a0 msgr2=0x7f27d80cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:50.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.973+0000 7f27dc915700 1 --2- 172.21.15.114:0/4039988099 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27d80cb8a0 0x7f27d80cbd30 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f27c0009850 tx=0x7f27c0009b60 comp rx=0 tx=0).stop 2023-10-18T12:41:50.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.973+0000 7f27dc915700 1 -- 172.21.15.114:0/4039988099 shutdown_connections 2023-10-18T12:41:50.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.973+0000 7f27dc915700 1 --2- 172.21.15.114:0/4039988099 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27d80cb8a0 0x7f27d80cbd30 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:50.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.973+0000 7f27dc915700 1 -- 172.21.15.114:0/4039988099 >> 172.21.15.114:0/4039988099 conn(0x7f27d80b0bf0 msgr2=0x7f27d80ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:50.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.973+0000 7f27dc915700 1 -- 172.21.15.114:0/4039988099 shutdown_connections 2023-10-18T12:41:50.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.973+0000 7f27dc915700 1 -- 172.21.15.114:0/4039988099 wait complete. 2023-10-18T12:41:50.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.977+0000 7f27dc915700 1 Processor -- start 2023-10-18T12:41:50.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.977+0000 7f27dc915700 1 -- start start 2023-10-18T12:41:50.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.977+0000 7f27dc915700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27d80b22f0 0x7f27d80ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:50.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.977+0000 7f27dc915700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27d80cb8a0 0x7f27d80afc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:50.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.977+0000 7f27dc915700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27d8144150 0x7f27d813e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:50.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.977+0000 7f27dc915700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d80acbf0 con 0x7f27d80cb8a0 2023-10-18T12:41:50.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.977+0000 7f27dc915700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d80b0170 con 0x7f27d8144150 2023-10-18T12:41:50.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.977+0000 7f27dc915700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d813e7e0 con 0x7f27d80b22f0 2023-10-18T12:41:50.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.981+0000 7f27ceffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27d80cb8a0 0x7f27d80afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:50.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.981+0000 7f27ceffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27d80cb8a0 0x7f27d80afc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39710/0 (socket says 172.21.15.114:39710) 2023-10-18T12:41:50.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.981+0000 7f27ceffd700 1 -- 172.21.15.114:0/3093166559 learned_addr learned my addr 172.21.15.114:0/3093166559 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:41:50.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.981+0000 7f27d77fe700 1 --2- 172.21.15.114:0/3093166559 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27d80b22f0 0x7f27d80ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:50.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.981+0000 7f27d7fff700 1 --2- 172.21.15.114:0/3093166559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27d8144150 0x7f27d813e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:50.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.981+0000 7f27ceffd700 1 -- 172.21.15.114:0/3093166559 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27d80b22f0 msgr2=0x7f27d80ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:50.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.981+0000 7f27ceffd700 1 --2- 172.21.15.114:0/3093166559 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27d80b22f0 0x7f27d80ab8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:50.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.981+0000 7f27ceffd700 1 -- 172.21.15.114:0/3093166559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27d8144150 msgr2=0x7f27d813e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:50.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.981+0000 7f27ceffd700 1 --2- 172.21.15.114:0/3093166559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27d8144150 0x7f27d813e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:50.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.981+0000 7f27ceffd700 1 -- 172.21.15.114:0/3093166559 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c00094b0 con 0x7f27d80cb8a0 2023-10-18T12:41:50.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.981+0000 7f27d7fff700 1 --2- 172.21.15.114:0/3093166559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27d8144150 0x7f27d813e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:41:50.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.981+0000 7f27ceffd700 1 --2- 172.21.15.114:0/3093166559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27d80cb8a0 0x7f27d80afc30 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f27c0014040 tx=0x7f27c0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:50.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.981+0000 7f27d4ff9700 1 -- 172.21.15.114:0/3093166559 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c00036c0 con 0x7f27d80cb8a0 2023-10-18T12:41:50.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.981+0000 7f27d4ff9700 1 -- 172.21.15.114:0/3093166559 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c001e070 con 0x7f27d80cb8a0 2023-10-18T12:41:50.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.981+0000 7f27d4ff9700 1 -- 172.21.15.114:0/3093166559 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c0003a40 con 0x7f27d80cb8a0 2023-10-18T12:41:50.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.981+0000 7f27dc915700 1 -- 172.21.15.114:0/3093166559 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d80abf70 con 0x7f27d80cb8a0 2023-10-18T12:41:50.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.981+0000 7f27dc915700 1 -- 172.21.15.114:0/3093166559 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d80ac530 con 0x7f27d80cb8a0 2023-10-18T12:41:50.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.985+0000 7f27dc915700 1 -- 172.21.15.114:0/3093166559 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27d806ee80 con 0x7f27d80cb8a0 2023-10-18T12:41:50.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.985+0000 7f27d4ff9700 1 -- 172.21.15.114:0/3093166559 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f27c0003ba0 con 0x7f27d80cb8a0 2023-10-18T12:41:50.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.985+0000 7f27d4ff9700 1 --2- 172.21.15.114:0/3093166559 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f27bc0656f0 0x7f27bc067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:50.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.985+0000 7f27d4ff9700 1 -- 172.21.15.114:0/3093166559 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7f27c0083f80 con 0x7f27d80cb8a0 2023-10-18T12:41:50.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.985+0000 7f27d77fe700 1 --2- 172.21.15.114:0/3093166559 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f27bc0656f0 0x7f27bc067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:50.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.989+0000 7f27d77fe700 1 --2- 172.21.15.114:0/3093166559 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f27bc0656f0 0x7f27bc067bb0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f27c8000f60 tx=0x7f27c8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:50.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:50.993+0000 7f27d4ff9700 1 -- 172.21.15.114:0/3093166559 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f27c00b4d40 con 0x7f27d80cb8a0 2023-10-18T12:41:51.199 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.193+0000 7f27dc915700 1 -- 172.21.15.114:0/3093166559 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f27d8070760 con 0x7f27d80cb8a0 2023-10-18T12:41:51.200 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.193+0000 7f27d4ff9700 1 -- 172.21.15.114:0/3093166559 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 1 entries v60) v1 ==== 80+0+59 (secure 0 0 0) 0x7f27c0020080 con 0x7f27d80cb8a0 2023-10-18T12:41:51.200 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:0/1817588655 2023-10-18T13:29:19.822093+0000 2023-10-18T12:41:51.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.197+0000 7f27dc915700 1 -- 172.21.15.114:0/3093166559 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f27bc0656f0 msgr2=0x7f27bc067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:51.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.197+0000 7f27dc915700 1 --2- 172.21.15.114:0/3093166559 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f27bc0656f0 0x7f27bc067bb0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f27c8000f60 tx=0x7f27c8009040 comp rx=0 tx=0).stop 2023-10-18T12:41:51.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.197+0000 7f27dc915700 1 -- 172.21.15.114:0/3093166559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27d80cb8a0 msgr2=0x7f27d80afc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:51.203 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.197+0000 7f27dc915700 1 --2- 172.21.15.114:0/3093166559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27d80cb8a0 0x7f27d80afc30 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f27c0014040 tx=0x7f27c0004770 comp rx=0 tx=0).stop 2023-10-18T12:41:51.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.197+0000 7f27dc915700 1 -- 172.21.15.114:0/3093166559 shutdown_connections 2023-10-18T12:41:51.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.197+0000 7f27dc915700 1 --2- 172.21.15.114:0/3093166559 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f27bc0656f0 0x7f27bc067bb0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:51.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.197+0000 7f27dc915700 1 --2- 172.21.15.114:0/3093166559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27d8144150 0x7f27d813e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:51.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.197+0000 7f27dc915700 1 --2- 172.21.15.114:0/3093166559 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f27d80cb8a0 0x7f27d80afc30 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:51.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.197+0000 7f27dc915700 1 --2- 172.21.15.114:0/3093166559 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f27d80b22f0 0x7f27d80ab8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:51.204 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.197+0000 7f27dc915700 1 -- 172.21.15.114:0/3093166559 >> 172.21.15.114:0/3093166559 conn(0x7f27d80b0bf0 msgr2=0x7f27d80ae8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:51.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.197+0000 7f27dc915700 1 -- 172.21.15.114:0/3093166559 shutdown_connections 2023-10-18T12:41:51.205 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.197+0000 7f27dc915700 1 -- 172.21.15.114:0/3093166559 wait complete. 2023-10-18T12:41:51.206 INFO:teuthology.orchestra.run.smithi114.stderr:listed 1 entries 2023-10-18T12:41:51.226 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-18T12:41:51.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:41:51.227 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-18T12:41:51.274 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2023-10-18T12:41:51.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:41:51.275 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-18T12:41:51.341 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T12:41:51.342 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-18T12:41:51.361 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T12:41:51.361 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-18T12:41:51.425 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T12:41:51.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.597+0000 7f1c1bc62700 1 Processor -- start 2023-10-18T12:41:51.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.601+0000 7f1c1bc62700 1 -- start start 2023-10-18T12:41:51.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.601+0000 7f1c1bc62700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f1c1415cdb0 0x7f1c140caf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:51.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.601+0000 7f1c1bc62700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1c1406f450 0x7f1c14069fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:51.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.601+0000 7f1c1bc62700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c140ce6c0 con 0x7f1c1406f8c0 2023-10-18T12:41:51.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.601+0000 7f1c1bc62700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c1406fe60 con 0x7f1c1415cdb0 2023-10-18T12:41:51.608 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.601+0000 7f1c1bc62700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c14070140 con 0x7f1c1406f450 2023-10-18T12:41:51.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.601+0000 7f1c1a1ff700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f1c1406f8c0 0x7f1c140cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60304/0 (socket says 172.21.15.114:60304) 2023-10-18T12:41:51.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.601+0000 7f1c1a1ff700 1 -- 172.21.15.114:0/225610974 learned_addr learned my addr 172.21.15.114:0/225610974 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:41:51.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.601+0000 7f1c199fe700 1 --2- 172.21.15.114:0/225610974 >> v2:172.21.15.172:3300/0 conn(0x7f1c1415cdb0 0x7f1c140caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:51.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.605+0000 7f1c191fd700 1 --2- 172.21.15.114:0/225610974 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1c1406f450 0x7f1c14069fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:51.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.605+0000 7f1c189fc700 1 -- 172.21.15.114:0/225610974 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3298534032 0 0) 0x7f1c140ce6c0 con 0x7f1c1406f8c0 2023-10-18T12:41:51.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.605+0000 7f1c189fc700 1 -- 172.21.15.114:0/225610974 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c000035d0 con 0x7f1c1406f8c0 2023-10-18T12:41:51.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.605+0000 7f1c199fe700 1 -- 172.21.15.114:0/225610974 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1c1406f450 msgr2=0x7f1c14069fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:41:51.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.605+0000 7f1c199fe700 1 --2- 172.21.15.114:0/225610974 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1c1406f450 0x7f1c14069fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:51.611 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.605+0000 7f1c199fe700 1 -- 172.21.15.114:0/225610974 >> v1:172.21.15.114:6789/0 conn(0x7f1c1406f8c0 legacy=0x7f1c140cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:51.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.605+0000 7f1c199fe700 1 -- 172.21.15.114:0/225610974 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c14070420 con 0x7f1c1415cdb0 2023-10-18T12:41:51.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.605+0000 7f1c191fd700 1 --2- 172.21.15.114:0/225610974 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1c1406f450 0x7f1c14069fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:41:51.612 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.605+0000 7f1c199fe700 1 --2- 172.21.15.114:0/225610974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c1415cdb0 0x7f1c140caf20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1c10009d90 tx=0x7f1c1000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=428a909aa40e2703 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:51.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.605+0000 7f1c189fc700 1 -- 172.21.15.114:0/225610974 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1000e070 con 0x7f1c1415cdb0 2023-10-18T12:41:51.613 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.605+0000 7f1c189fc700 1 -- 172.21.15.114:0/225610974 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c1000bb20 con 0x7f1c1415cdb0 2023-10-18T12:41:51.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.605+0000 7f1c189fc700 1 -- 172.21.15.114:0/225610974 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c10012430 con 0x7f1c1415cdb0 2023-10-18T12:41:51.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.605+0000 7f1c1bc62700 1 -- 172.21.15.114:0/225610974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c1415cdb0 msgr2=0x7f1c140caf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:51.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.605+0000 7f1c1bc62700 1 --2- 172.21.15.114:0/225610974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c1415cdb0 0x7f1c140caf20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1c10009d90 tx=0x7f1c1000b330 comp rx=0 tx=0).stop 2023-10-18T12:41:51.614 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.605+0000 7f1c1bc62700 1 -- 172.21.15.114:0/225610974 shutdown_connections 2023-10-18T12:41:51.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.605+0000 7f1c1bc62700 1 --2- 172.21.15.114:0/225610974 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1c1406f450 0x7f1c14069fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:51.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.605+0000 7f1c1bc62700 1 --2- 172.21.15.114:0/225610974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c1415cdb0 0x7f1c140caf20 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:51.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.605+0000 7f1c1bc62700 1 -- 172.21.15.114:0/225610974 >> 172.21.15.114:0/225610974 conn(0x7f1c140cd240 msgr2=0x7f1c140cd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:51.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.605+0000 7f1c1bc62700 1 -- 172.21.15.114:0/225610974 shutdown_connections 2023-10-18T12:41:51.615 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.605+0000 7f1c1bc62700 1 -- 172.21.15.114:0/225610974 wait complete. 2023-10-18T12:41:51.616 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.609+0000 7f1c1bc62700 1 Processor -- start 2023-10-18T12:41:51.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.609+0000 7f1c1bc62700 1 -- start start 2023-10-18T12:41:51.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.609+0000 7f1c1bc62700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c1406f450 0x7f1c140b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:51.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.609+0000 7f1c1bc62700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c1406f8c0 0x7f1c140c5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:51.617 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.609+0000 7f1c1bc62700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1c1415cdb0 0x7f1c140ca430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:51.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.609+0000 7f1c1bc62700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c140c5a90 con 0x7f1c1406f8c0 2023-10-18T12:41:51.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.613+0000 7f1c1bc62700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c140b33c0 con 0x7f1c1406f450 2023-10-18T12:41:51.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.613+0000 7f1c1bc62700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c140ca970 con 0x7f1c1415cdb0 2023-10-18T12:41:51.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.613+0000 7f1c191fd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c1406f8c0 0x7f1c140c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:51.618 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.613+0000 7f1c191fd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c1406f8c0 0x7f1c140c5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39720/0 (socket says 172.21.15.114:39720) 2023-10-18T12:41:51.619 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.613+0000 7f1c191fd700 1 -- 172.21.15.114:0/4079268385 learned_addr learned my addr 172.21.15.114:0/4079268385 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:41:51.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.613+0000 7f1c1a1ff700 1 --2- 172.21.15.114:0/4079268385 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1c1415cdb0 0x7f1c140ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:51.620 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.613+0000 7f1c199fe700 1 --2- 172.21.15.114:0/4079268385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c1406f450 0x7f1c140b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:51.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.613+0000 7f1c191fd700 1 -- 172.21.15.114:0/4079268385 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1c1415cdb0 msgr2=0x7f1c140ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:51.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.613+0000 7f1c191fd700 1 --2- 172.21.15.114:0/4079268385 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1c1415cdb0 0x7f1c140ca430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:51.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.613+0000 7f1c191fd700 1 -- 172.21.15.114:0/4079268385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c1406f450 msgr2=0x7f1c140b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:51.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.613+0000 7f1c191fd700 1 --2- 172.21.15.114:0/4079268385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c1406f450 0x7f1c140b4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:51.621 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.613+0000 7f1c191fd700 1 -- 172.21.15.114:0/4079268385 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c10009a70 con 0x7f1c1406f8c0 2023-10-18T12:41:51.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.613+0000 7f1c191fd700 1 --2- 172.21.15.114:0/4079268385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c1406f8c0 0x7f1c140c5550 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f1c0400e790 tx=0x7f1c0400eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:51.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.613+0000 7f1c0a7fc700 1 -- 172.21.15.114:0/4079268385 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0400c070 con 0x7f1c1406f8c0 2023-10-18T12:41:51.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.613+0000 7f1c0a7fc700 1 -- 172.21.15.114:0/4079268385 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c04004230 con 0x7f1c1406f8c0 2023-10-18T12:41:51.622 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.613+0000 7f1c0a7fc700 1 -- 172.21.15.114:0/4079268385 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c040045c0 con 0x7f1c1406f8c0 2023-10-18T12:41:51.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.613+0000 7f1c1bc62700 1 -- 172.21.15.114:0/4079268385 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c140b51a0 con 0x7f1c1406f8c0 2023-10-18T12:41:51.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.613+0000 7f1c1bc62700 1 -- 172.21.15.114:0/4079268385 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c140b5860 con 0x7f1c1406f8c0 2023-10-18T12:41:51.623 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.617+0000 7f1c1bc62700 1 -- 172.21.15.114:0/4079268385 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c140cac60 con 0x7f1c1406f8c0 2023-10-18T12:41:51.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.617+0000 7f1c0a7fc700 1 -- 172.21.15.114:0/4079268385 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f1c040036c0 con 0x7f1c1406f8c0 2023-10-18T12:41:51.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.617+0000 7f1c0a7fc700 1 --2- 172.21.15.114:0/4079268385 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1bf80656f0 0x7f1bf8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:51.624 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.621+0000 7f1c0a7fc700 1 -- 172.21.15.114:0/4079268385 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7f1c04082cc0 con 0x7f1c1406f8c0 2023-10-18T12:41:51.625 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.621+0000 7f1c199fe700 1 --2- 172.21.15.114:0/4079268385 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1bf80656f0 0x7f1bf8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:51.626 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.621+0000 7f1c199fe700 1 --2- 172.21.15.114:0/4079268385 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1bf80656f0 0x7f1bf8067bb0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1c10014040 tx=0x7f1c10011000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:51.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.625+0000 7f1c0a7fc700 1 -- 172.21.15.114:0/4079268385 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f1c040504f0 con 0x7f1c1406f8c0 2023-10-18T12:41:51.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.805+0000 7f1c1bc62700 1 -- 172.21.15.114:0/4079268385 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c140b3570 con 0x7f1c1406f8c0 2023-10-18T12:41:51.815 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.809+0000 7f1c0a7fc700 1 -- 172.21.15.114:0/4079268385 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+19138 (secure 0 0 0) 0x7f1c140b3570 con 0x7f1c1406f8c0 2023-10-18T12:41:51.816 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:41:51.816 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":60,"fsid":"240ea340-5d3d-4f52-a4bc-af075aca3deb","created":"2023-10-18T12:19:12.512994+0000","modified":"2023-10-18T12:30:22.735724+0000","last_up_change":"2023-10-18T12:29:29.654825+0000","last_in_change":"2023-10-18T12:19:15.850693+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T12:19:27.040638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-18T12:19:32.358094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-18T12:21:12.105324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-18T12:21:13.154105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c3578978-1a03-4857-b9d2-34a5da3d7731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":49,"up_from":56,"up_thru":57,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1953670272},{"type":"v1","addr":"172.21.15.114:6817","nonce":1953670272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1953670272},{"type":"v1","addr":"172.21.15.114:6820","nonce":1953670272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1953670272},{"type":"v1","addr":"172.21.15.114:6830","nonce":1953670272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":1953670272},{"type":"v1","addr":"172.21.15.114:6825","nonce":1953670272}]},"public_addr":"172.21.15.114:6817/1953670272","cluster_addr":"172.21.15.114:6820/1953670272","heartbeat_back_addr":"172.21.15.114:6830/1953670272","heartbeat_front_addr":"172.21.15.114:6825/1953670272","state":["exists","up"]},{"osd":1,"uuid":"43eb26a6-e2b3-4670-9559-bd053b5140d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6801","nonce":3302727047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6803","nonce":3302727047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6807","nonce":3302727047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6805","nonce":3302727047}]},"public_addr":"172.21.15.114:6801/3302727047","cluster_addr":"172.21.15.114:6803/3302727047","heartbeat_back_addr":"172.21.15.114:6807/3302727047","heartbeat_front_addr":"172.21.15.114:6805/3302727047","state":["exists","up"]},{"osd":2,"uuid":"f3d4dbd5-521c-4dd2-b687-5768cc7d0938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6809","nonce":2699151351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6811","nonce":2699151351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6815","nonce":2699151351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6813","nonce":2699151351}]},"public_addr":"172.21.15.114:6809/2699151351","cluster_addr":"172.21.15.114:6811/2699151351","heartbeat_back_addr":"172.21.15.114:6815/2699151351","heartbeat_front_addr":"172.21.15.114:6813/2699151351","state":["exists","up"]},{"osd":3,"uuid":"823e5802-92b7-4f0d-b32d-a5748993f1b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6821","nonce":1361608073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6824","nonce":1361608073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6829","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6831","nonce":1361608073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6827","nonce":1361608073}]},"public_addr":"172.21.15.114:6821/1361608073","cluster_addr":"172.21.15.114:6824/1361608073","heartbeat_back_addr":"172.21.15.114:6831/1361608073","heartbeat_front_addr":"172.21.15.114:6827/1361608073","state":["exists","up"]},{"osd":4,"uuid":"e47fb93e-13b4-44a4-b084-8c4384ceb41e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6801","nonce":930839681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6803","nonce":930839681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6807","nonce":930839681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6805","nonce":930839681}]},"public_addr":"172.21.15.172:6801/930839681","cluster_addr":"172.21.15.172:6803/930839681","heartbeat_back_addr":"172.21.15.172:6807/930839681","heartbeat_front_addr":"172.21.15.172:6805/930839681","state":["exists","up"]},{"osd":5,"uuid":"7561a973-f479-45a0-af40-f324728d622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6814","nonce":571761850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6818","nonce":571761850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6824","nonce":571761850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6821","nonce":571761850}]},"public_addr":"172.21.15.172:6814/571761850","cluster_addr":"172.21.15.172:6818/571761850","heartbeat_back_addr":"172.21.15.172:6824/571761850","heartbeat_front_addr":"172.21.15.172:6821/571761850","state":["exists","up"]},{"osd":6,"uuid":"51753f4b-7f06-4f1c-9ec7-6e18a66eb980","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6825","nonce":1680398853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6827","nonce":1680398853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6831","nonce":1680398853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6829","nonce":1680398853}]},"public_addr":"172.21.15.172:6825/1680398853","cluster_addr":"172.21.15.172:6827/1680398853","heartbeat_back_addr":"172.21.15.172:6831/1680398853","heartbeat_front_addr":"172.21.15.172:6829/1680398853","state":["exists","up"]},{"osd":7,"uuid":"4d8b1e15-143d-4d17-9074-59d92f0f9af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6809","nonce":349710101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6811","nonce":349710101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6819","nonce":349710101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6815","nonce":349710101}]},"public_addr":"172.21.15.172:6809/349710101","cluster_addr":"172.21.15.172:6811/349710101","heartbeat_back_addr":"172.21.15.172:6819/349710101","heartbeat_front_addr":"172.21.15.172:6815/349710101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"2023-10-18T12:21:50.537022+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.889460+0000","dead_epoch":50},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.475494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.911473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.648596+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.609994+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.636248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.854589+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.885826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.5","mappings":[{"from":7,"to":0}]},{"pgid":"6.9","mappings":[{"from":7,"to":2}]},{"pgid":"6.c","mappings":[{"from":3,"to":0}]},{"pgid":"6.11","mappings":[{"from":3,"to":2}]},{"pgid":"6.1d","mappings":[{"from":5,"to":0}]},{"pgid":"7.12","mappings":[{"from":6,"to":4}]},{"pgid":"7.2d","mappings":[{"from":0,"to":4}]},{"pgid":"7.30","mappings":[{"from":6,"to":4}]},{"pgid":"7.35","mappings":[{"from":0,"to":5}]},{"pgid":"7.36","mappings":[{"from":6,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:0/1817588655":"2023-10-18T13:29:19.822093+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T12:41:51.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.813+0000 7f1c1bc62700 1 -- 172.21.15.114:0/4079268385 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1bf80656f0 msgr2=0x7f1bf8067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:51.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.813+0000 7f1c1bc62700 1 --2- 172.21.15.114:0/4079268385 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1bf80656f0 0x7f1bf8067bb0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1c10014040 tx=0x7f1c10011000 comp rx=0 tx=0).stop 2023-10-18T12:41:51.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.813+0000 7f1c1bc62700 1 -- 172.21.15.114:0/4079268385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c1406f8c0 msgr2=0x7f1c140c5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:51.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.813+0000 7f1c1bc62700 1 --2- 172.21.15.114:0/4079268385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c1406f8c0 0x7f1c140c5550 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f1c0400e790 tx=0x7f1c0400eaa0 comp rx=0 tx=0).stop 2023-10-18T12:41:51.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.813+0000 7f1c1bc62700 1 -- 172.21.15.114:0/4079268385 shutdown_connections 2023-10-18T12:41:51.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.813+0000 7f1c1bc62700 1 --2- 172.21.15.114:0/4079268385 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f1bf80656f0 0x7f1bf8067bb0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:51.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.813+0000 7f1c1bc62700 1 --2- 172.21.15.114:0/4079268385 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1c1415cdb0 0x7f1c140ca430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:51.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.813+0000 7f1c1bc62700 1 --2- 172.21.15.114:0/4079268385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1c1406f8c0 0x7f1c140c5550 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:51.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.813+0000 7f1c1bc62700 1 --2- 172.21.15.114:0/4079268385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c1406f450 0x7f1c140b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:51.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.813+0000 7f1c1bc62700 1 -- 172.21.15.114:0/4079268385 >> 172.21.15.114:0/4079268385 conn(0x7f1c140cd240 msgr2=0x7f1c140cb5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:51.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.813+0000 7f1c1bc62700 1 -- 172.21.15.114:0/4079268385 shutdown_connections 2023-10-18T12:41:51.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:51.813+0000 7f1c1bc62700 1 -- 172.21.15.114:0/4079268385 wait complete. 2023-10-18T12:41:51.843 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-18T12:19:27.040638+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-18T12:19:32.358094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-18T12:21:12.105324+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-10-18T12:21:13.154105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-18T12:41:51.844 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-18T12:41:52.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.017+0000 7fc2552df700 1 Processor -- start 2023-10-18T12:41:52.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.017+0000 7fc2552df700 1 -- start start 2023-10-18T12:41:52.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.017+0000 7fc2552df700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc2500cd1b0 0x7fc2500cd590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:52.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.017+0000 7fc2552df700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2500cada0 con 0x7fc2500cb5c0 2023-10-18T12:41:52.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.017+0000 7fc2552df700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2500cdad0 con 0x7fc25006e550 2023-10-18T12:41:52.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.017+0000 7fc2552df700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc25006e9e0 con 0x7fc2500cd1b0 2023-10-18T12:41:52.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.021+0000 7fc254ade700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fc2500cb5c0 0x7fc2500ca000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60310/0 (socket says 172.21.15.114:60310) 2023-10-18T12:41:52.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.021+0000 7fc254ade700 1 -- 172.21.15.114:0/2181352996 learned_addr learned my addr 172.21.15.114:0/2181352996 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:41:52.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.021+0000 7fc24ffff700 1 --2- 172.21.15.114:0/2181352996 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc2500cd1b0 0x7fc2500cd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:52.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.021+0000 7fc24f7fe700 1 -- 172.21.15.114:0/2181352996 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1591950672 0 0) 0x7fc2500cada0 con 0x7fc2500cb5c0 2023-10-18T12:41:52.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.021+0000 7fc24f7fe700 1 -- 172.21.15.114:0/2181352996 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc23c0035d0 con 0x7fc2500cb5c0 2023-10-18T12:41:52.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.021+0000 7fc24ffff700 1 -- 172.21.15.114:0/2181352996 >> v1:172.21.15.172:6789/0 conn(0x7fc25006e550 legacy=0x7fc2500c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:52.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.021+0000 7fc24ffff700 1 -- 172.21.15.114:0/2181352996 >> v1:172.21.15.114:6789/0 conn(0x7fc2500cb5c0 legacy=0x7fc2500ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:52.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.021+0000 7fc24ffff700 1 -- 172.21.15.114:0/2181352996 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2500caac0 con 0x7fc2500cd1b0 2023-10-18T12:41:52.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.021+0000 7fc24ffff700 1 --2- 172.21.15.114:0/2181352996 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc2500cd1b0 0x7fc2500cd590 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc240009880 tx=0x7fc240009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b79e686aa33bb978 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:52.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.021+0000 7fc24f7fe700 1 -- 172.21.15.114:0/2181352996 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc240011830 con 0x7fc2500cd1b0 2023-10-18T12:41:52.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.021+0000 7fc24f7fe700 1 -- 172.21.15.114:0/2181352996 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc240011990 con 0x7fc2500cd1b0 2023-10-18T12:41:52.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.021+0000 7fc24f7fe700 1 -- 172.21.15.114:0/2181352996 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc240011d20 con 0x7fc2500cd1b0 2023-10-18T12:41:52.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.021+0000 7fc2552df700 1 -- 172.21.15.114:0/2181352996 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc2500cd1b0 msgr2=0x7fc2500cd590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:52.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.021+0000 7fc2552df700 1 --2- 172.21.15.114:0/2181352996 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc2500cd1b0 0x7fc2500cd590 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc240009880 tx=0x7fc240009b90 comp rx=0 tx=0).stop 2023-10-18T12:41:52.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.021+0000 7fc2552df700 1 -- 172.21.15.114:0/2181352996 shutdown_connections 2023-10-18T12:41:52.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.021+0000 7fc2552df700 1 --2- 172.21.15.114:0/2181352996 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc2500cd1b0 0x7fc2500cd590 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:52.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.021+0000 7fc2552df700 1 -- 172.21.15.114:0/2181352996 >> 172.21.15.114:0/2181352996 conn(0x7fc2500cb9f0 msgr2=0x7fc2500cbe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:52.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.021+0000 7fc2552df700 1 -- 172.21.15.114:0/2181352996 shutdown_connections 2023-10-18T12:41:52.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.021+0000 7fc2552df700 1 -- 172.21.15.114:0/2181352996 wait complete. 2023-10-18T12:41:52.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.025+0000 7fc2552df700 1 Processor -- start 2023-10-18T12:41:52.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.025+0000 7fc2552df700 1 -- start start 2023-10-18T12:41:52.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.029+0000 7fc2552df700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc2500cb5c0 0x7fc2500c7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:52.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.029+0000 7fc2552df700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2500cd1b0 0x7fc2500b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:52.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.029+0000 7fc2552df700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2500b43d0 0x7fc2500c64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:52.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.029+0000 7fc2552df700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2500b4850 con 0x7fc2500b43d0 2023-10-18T12:41:52.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.029+0000 7fc2552df700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2500c8140 con 0x7fc2500cd1b0 2023-10-18T12:41:52.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.029+0000 7fc2552df700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2500c83a0 con 0x7fc2500cb5c0 2023-10-18T12:41:52.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.029+0000 7fc254ade700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2500b43d0 0x7fc2500c64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:52.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.029+0000 7fc254ade700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2500b43d0 0x7fc2500c64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39736/0 (socket says 172.21.15.114:39736) 2023-10-18T12:41:52.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.029+0000 7fc254ade700 1 -- 172.21.15.114:0/208016133 learned_addr learned my addr 172.21.15.114:0/208016133 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:41:52.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.029+0000 7fc24ffff700 1 --2- 172.21.15.114:0/208016133 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc2500cb5c0 0x7fc2500c7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:52.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.029+0000 7fc2477fe700 1 --2- 172.21.15.114:0/208016133 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2500cd1b0 0x7fc2500b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:52.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.029+0000 7fc254ade700 1 -- 172.21.15.114:0/208016133 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc2500cb5c0 msgr2=0x7fc2500c7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:52.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.029+0000 7fc254ade700 1 --2- 172.21.15.114:0/208016133 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc2500cb5c0 0x7fc2500c7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:52.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.029+0000 7fc254ade700 1 -- 172.21.15.114:0/208016133 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2500cd1b0 msgr2=0x7fc2500b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:52.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.029+0000 7fc254ade700 1 --2- 172.21.15.114:0/208016133 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2500cd1b0 0x7fc2500b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:52.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.029+0000 7fc254ade700 1 -- 172.21.15.114:0/208016133 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2400094b0 con 0x7fc2500b43d0 2023-10-18T12:41:52.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.029+0000 7fc24ffff700 1 --2- 172.21.15.114:0/208016133 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc2500cb5c0 0x7fc2500c7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:41:52.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.029+0000 7fc2477fe700 1 --2- 172.21.15.114:0/208016133 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2500cd1b0 0x7fc2500b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:41:52.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.029+0000 7fc254ade700 1 --2- 172.21.15.114:0/208016133 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2500b43d0 0x7fc2500c64e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fc24800ca70 tx=0x7fc24800cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:52.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.029+0000 7fc24d7fa700 1 -- 172.21.15.114:0/208016133 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24800a770 con 0x7fc2500b43d0 2023-10-18T12:41:52.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.029+0000 7fc24d7fa700 1 -- 172.21.15.114:0/208016133 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc24800a8d0 con 0x7fc2500b43d0 2023-10-18T12:41:52.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.029+0000 7fc2552df700 1 -- 172.21.15.114:0/208016133 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2500c8680 con 0x7fc2500b43d0 2023-10-18T12:41:52.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.029+0000 7fc24d7fa700 1 -- 172.21.15.114:0/208016133 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24800ac40 con 0x7fc2500b43d0 2023-10-18T12:41:52.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.029+0000 7fc2552df700 1 -- 172.21.15.114:0/208016133 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2500c8c40 con 0x7fc2500b43d0 2023-10-18T12:41:52.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.033+0000 7fc2552df700 1 -- 172.21.15.114:0/208016133 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc25004e910 con 0x7fc2500b43d0 2023-10-18T12:41:52.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.033+0000 7fc24d7fa700 1 -- 172.21.15.114:0/208016133 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fc24801b3b0 con 0x7fc2500b43d0 2023-10-18T12:41:52.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.033+0000 7fc24d7fa700 1 --2- 172.21.15.114:0/208016133 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc2300656f0 0x7fc230067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:52.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.037+0000 7fc24d7fa700 1 -- 172.21.15.114:0/208016133 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7fc248082930 con 0x7fc2500b43d0 2023-10-18T12:41:52.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.037+0000 7fc24ffff700 1 --2- 172.21.15.114:0/208016133 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc2300656f0 0x7fc230067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:52.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.037+0000 7fc24ffff700 1 --2- 172.21.15.114:0/208016133 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc2300656f0 0x7fc230067bb0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc2400090b0 tx=0x7fc240010000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:52.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.041+0000 7fc24d7fa700 1 -- 172.21.15.114:0/208016133 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fc248050210 con 0x7fc2500b43d0 2023-10-18T12:41:52.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.217+0000 7fc2552df700 1 -- 172.21.15.114:0/208016133 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc2500c9320 con 0x7fc2500b43d0 2023-10-18T12:41:52.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.217+0000 7fc24d7fa700 1 -- 172.21.15.114:0/208016133 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc248053830 con 0x7fc2500b43d0 2023-10-18T12:41:52.223 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-10-18T12:41:52.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.221+0000 7fc2552df700 1 -- 172.21.15.114:0/208016133 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc2300656f0 msgr2=0x7fc230067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:52.225 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.221+0000 7fc2552df700 1 --2- 172.21.15.114:0/208016133 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc2300656f0 0x7fc230067bb0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc2400090b0 tx=0x7fc240010000 comp rx=0 tx=0).stop 2023-10-18T12:41:52.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.221+0000 7fc2552df700 1 -- 172.21.15.114:0/208016133 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2500b43d0 msgr2=0x7fc2500c64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:52.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.221+0000 7fc2552df700 1 --2- 172.21.15.114:0/208016133 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2500b43d0 0x7fc2500c64e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fc24800ca70 tx=0x7fc24800cb50 comp rx=0 tx=0).stop 2023-10-18T12:41:52.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.221+0000 7fc2552df700 1 -- 172.21.15.114:0/208016133 shutdown_connections 2023-10-18T12:41:52.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.221+0000 7fc2552df700 1 --2- 172.21.15.114:0/208016133 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc2300656f0 0x7fc230067bb0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:52.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.221+0000 7fc2552df700 1 --2- 172.21.15.114:0/208016133 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2500b43d0 0x7fc2500c64e0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:52.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.221+0000 7fc2552df700 1 --2- 172.21.15.114:0/208016133 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2500cd1b0 0x7fc2500b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:52.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.221+0000 7fc2552df700 1 --2- 172.21.15.114:0/208016133 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc2500cb5c0 0x7fc2500c7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:52.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.221+0000 7fc2552df700 1 -- 172.21.15.114:0/208016133 >> 172.21.15.114:0/208016133 conn(0x7fc2500cb9f0 msgr2=0x7fc25006d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:52.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.221+0000 7fc2552df700 1 -- 172.21.15.114:0/208016133 shutdown_connections 2023-10-18T12:41:52.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.221+0000 7fc2552df700 1 -- 172.21.15.114:0/208016133 wait complete. 2023-10-18T12:41:52.250 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-18T12:41:52.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.421+0000 7fb819592700 1 Processor -- start 2023-10-18T12:41:52.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.421+0000 7fb819592700 1 -- start start 2023-10-18T12:41:52.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.425+0000 7fb819592700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb8140d2e00 0x7fb8140b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:52.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.425+0000 7fb819592700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb814160710 0x7fb8140d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:52.430 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.425+0000 7fb819592700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8140b5ae0 0x7fb81406db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:52.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.425+0000 7fb819592700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb81415df90 con 0x7fb8140d2e00 2023-10-18T12:41:52.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.425+0000 7fb819592700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb81415d0d0 con 0x7fb814160710 2023-10-18T12:41:52.431 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.425+0000 7fb819592700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb81406f0f0 con 0x7fb8140b5ae0 2023-10-18T12:41:52.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.425+0000 7fb812ffd700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb8140d2e00 0x7fb8140b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:52.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.425+0000 7fb812ffd700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb8140d2e00 0x7fb8140b6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39744/0 (socket says 172.21.15.114:39744) 2023-10-18T12:41:52.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.425+0000 7fb812ffd700 1 -- 172.21.15.114:0/3738841134 learned_addr learned my addr 172.21.15.114:0/3738841134 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:41:52.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.425+0000 7fb8137fe700 1 --2- 172.21.15.114:0/3738841134 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8140b5ae0 0x7fb81406db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:52.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.425+0000 7fb8127fc700 1 --2- 172.21.15.114:0/3738841134 >> v2:172.21.15.172:3300/0 conn(0x7fb814160710 0x7fb8140d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:52.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.425+0000 7fb812ffd700 1 -- 172.21.15.114:0/3738841134 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8140b5ae0 msgr2=0x7fb81406db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:41:52.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.425+0000 7fb812ffd700 1 --2- 172.21.15.114:0/3738841134 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8140b5ae0 0x7fb81406db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:52.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.425+0000 7fb812ffd700 1 -- 172.21.15.114:0/3738841134 >> v2:172.21.15.172:3300/0 conn(0x7fb814160710 msgr2=0x7fb8140d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:41:52.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.425+0000 7fb812ffd700 1 --2- 172.21.15.114:0/3738841134 >> v2:172.21.15.172:3300/0 conn(0x7fb814160710 0x7fb8140d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:52.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.425+0000 7fb812ffd700 1 -- 172.21.15.114:0/3738841134 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8140d3720 con 0x7fb8140d2e00 2023-10-18T12:41:52.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.425+0000 7fb812ffd700 1 --2- 172.21.15.114:0/3738841134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8140d2e00 0x7fb8140b6e00 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fb8140d2420 tx=0x7fb804009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b3946d3adcd52dc server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:52.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.429+0000 7fb811ffb700 1 -- 172.21.15.114:0/3738841134 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb804011830 con 0x7fb8140d2e00 2023-10-18T12:41:52.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.429+0000 7fb811ffb700 1 -- 172.21.15.114:0/3738841134 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb804011990 con 0x7fb8140d2e00 2023-10-18T12:41:52.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.429+0000 7fb811ffb700 1 -- 172.21.15.114:0/3738841134 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb804011d20 con 0x7fb8140d2e00 2023-10-18T12:41:52.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.429+0000 7fb819592700 1 -- 172.21.15.114:0/3738841134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8140d2e00 msgr2=0x7fb8140b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:52.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.429+0000 7fb819592700 1 --2- 172.21.15.114:0/3738841134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8140d2e00 0x7fb8140b6e00 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fb8140d2420 tx=0x7fb804009bf0 comp rx=0 tx=0).stop 2023-10-18T12:41:52.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.429+0000 7fb819592700 1 -- 172.21.15.114:0/3738841134 shutdown_connections 2023-10-18T12:41:52.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.429+0000 7fb819592700 1 --2- 172.21.15.114:0/3738841134 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8140b5ae0 0x7fb81406db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:52.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.429+0000 7fb819592700 1 --2- 172.21.15.114:0/3738841134 >> v2:172.21.15.172:3300/0 conn(0x7fb814160710 0x7fb8140d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:52.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.429+0000 7fb819592700 1 --2- 172.21.15.114:0/3738841134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8140d2e00 0x7fb8140b6e00 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:52.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.429+0000 7fb819592700 1 -- 172.21.15.114:0/3738841134 >> 172.21.15.114:0/3738841134 conn(0x7fb814069f20 msgr2=0x7fb81406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:52.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.429+0000 7fb819592700 1 -- 172.21.15.114:0/3738841134 shutdown_connections 2023-10-18T12:41:52.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.429+0000 7fb819592700 1 -- 172.21.15.114:0/3738841134 wait complete. 2023-10-18T12:41:52.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.433+0000 7fb819592700 1 Processor -- start 2023-10-18T12:41:52.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.433+0000 7fb819592700 1 -- start start 2023-10-18T12:41:52.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.433+0000 7fb819592700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8140b5ae0 0x7fb81414e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:52.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.433+0000 7fb819592700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8140d2e00 0x7fb8140b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:52.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.433+0000 7fb819592700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb814160710 0x7fb8140b1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:52.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.433+0000 7fb819592700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb81414f750 con 0x7fb814160710 2023-10-18T12:41:52.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.433+0000 7fb819592700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb81414e890 con 0x7fb8140d2e00 2023-10-18T12:41:52.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.433+0000 7fb819592700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb81414eb40 con 0x7fb8140b5ae0 2023-10-18T12:41:52.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.433+0000 7fb8137fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb814160710 0x7fb8140b1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:52.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.433+0000 7fb8137fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb814160710 0x7fb8140b1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39754/0 (socket says 172.21.15.114:39754) 2023-10-18T12:41:52.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.433+0000 7fb8137fe700 1 -- 172.21.15.114:0/1441882159 learned_addr learned my addr 172.21.15.114:0/1441882159 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:41:52.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.433+0000 7fb8127fc700 1 --2- 172.21.15.114:0/1441882159 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8140d2e00 0x7fb8140b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:52.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.433+0000 7fb812ffd700 1 --2- 172.21.15.114:0/1441882159 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8140b5ae0 0x7fb81414e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:52.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.433+0000 7fb8137fe700 1 -- 172.21.15.114:0/1441882159 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8140b5ae0 msgr2=0x7fb81414e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:52.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.433+0000 7fb8137fe700 1 --2- 172.21.15.114:0/1441882159 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8140b5ae0 0x7fb81414e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:52.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.433+0000 7fb8137fe700 1 -- 172.21.15.114:0/1441882159 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8140d2e00 msgr2=0x7fb8140b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:52.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.433+0000 7fb8137fe700 1 --2- 172.21.15.114:0/1441882159 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8140d2e00 0x7fb8140b0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:52.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.433+0000 7fb8137fe700 1 -- 172.21.15.114:0/1441882159 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb804009570 con 0x7fb814160710 2023-10-18T12:41:52.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.433+0000 7fb8127fc700 1 --2- 172.21.15.114:0/1441882159 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8140d2e00 0x7fb8140b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:41:52.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.433+0000 7fb8137fe700 1 --2- 172.21.15.114:0/1441882159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb814160710 0x7fb8140b1270 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00eed0 tx=0x7fb80c00b0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:52.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.437+0000 7fb7fb7fe700 1 -- 172.21.15.114:0/1441882159 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80c010040 con 0x7fb814160710 2023-10-18T12:41:52.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.437+0000 7fb7fb7fe700 1 -- 172.21.15.114:0/1441882159 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb80c00bb70 con 0x7fb814160710 2023-10-18T12:41:52.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.437+0000 7fb7fb7fe700 1 -- 172.21.15.114:0/1441882159 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80c014400 con 0x7fb814160710 2023-10-18T12:41:52.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.437+0000 7fb819592700 1 -- 172.21.15.114:0/1441882159 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb81414ee20 con 0x7fb814160710 2023-10-18T12:41:52.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.437+0000 7fb819592700 1 -- 172.21.15.114:0/1441882159 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb81414f3e0 con 0x7fb814160710 2023-10-18T12:41:52.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.437+0000 7fb819592700 1 -- 172.21.15.114:0/1441882159 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb81414f900 con 0x7fb814160710 2023-10-18T12:41:52.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.437+0000 7fb7fb7fe700 1 -- 172.21.15.114:0/1441882159 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fb80c014560 con 0x7fb814160710 2023-10-18T12:41:52.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.441+0000 7fb7fb7fe700 1 --2- 172.21.15.114:0/1441882159 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb8000656f0 0x7fb800067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:52.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.441+0000 7fb7fb7fe700 1 -- 172.21.15.114:0/1441882159 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7fb80c006e40 con 0x7fb814160710 2023-10-18T12:41:52.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.441+0000 7fb812ffd700 1 --2- 172.21.15.114:0/1441882159 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb8000656f0 0x7fb800067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:52.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.441+0000 7fb812ffd700 1 --2- 172.21.15.114:0/1441882159 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb8000656f0 0x7fb800067bb0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb804000c00 tx=0x7fb804008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:52.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.445+0000 7fb7fb7fe700 1 -- 172.21.15.114:0/1441882159 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fb81414f900 con 0x7fb814160710 2023-10-18T12:41:52.629 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.625+0000 7fb819592700 1 -- 172.21.15.114:0/1441882159 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb81414f570 con 0x7fb814160710 2023-10-18T12:41:52.630 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.625+0000 7fb7fb7fe700 1 -- 172.21.15.114:0/1441882159 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v60) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb80c051140 con 0x7fb814160710 2023-10-18T12:41:52.631 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 8 2023-10-18T12:41:52.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.629+0000 7fb819592700 1 -- 172.21.15.114:0/1441882159 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb8000656f0 msgr2=0x7fb800067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:52.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.629+0000 7fb819592700 1 --2- 172.21.15.114:0/1441882159 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb8000656f0 0x7fb800067bb0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb804000c00 tx=0x7fb804008030 comp rx=0 tx=0).stop 2023-10-18T12:41:52.635 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.629+0000 7fb819592700 1 -- 172.21.15.114:0/1441882159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb814160710 msgr2=0x7fb8140b1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:52.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.629+0000 7fb819592700 1 --2- 172.21.15.114:0/1441882159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb814160710 0x7fb8140b1270 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00eed0 tx=0x7fb80c00b0b0 comp rx=0 tx=0).stop 2023-10-18T12:41:52.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.629+0000 7fb819592700 1 -- 172.21.15.114:0/1441882159 shutdown_connections 2023-10-18T12:41:52.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.629+0000 7fb819592700 1 --2- 172.21.15.114:0/1441882159 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb8000656f0 0x7fb800067bb0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:52.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.629+0000 7fb819592700 1 --2- 172.21.15.114:0/1441882159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb814160710 0x7fb8140b1270 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:52.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.629+0000 7fb819592700 1 --2- 172.21.15.114:0/1441882159 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8140d2e00 0x7fb8140b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:52.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.629+0000 7fb819592700 1 --2- 172.21.15.114:0/1441882159 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb8140b5ae0 0x7fb81414e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:52.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.629+0000 7fb819592700 1 -- 172.21.15.114:0/1441882159 >> 172.21.15.114:0/1441882159 conn(0x7fb814069f20 msgr2=0x7fb81415b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:52.637 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.629+0000 7fb819592700 1 -- 172.21.15.114:0/1441882159 shutdown_connections 2023-10-18T12:41:52.638 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.629+0000 7fb819592700 1 -- 172.21.15.114:0/1441882159 wait complete. 2023-10-18T12:41:52.659 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-18T12:41:52.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.833+0000 7fb76b59e700 1 Processor -- start 2023-10-18T12:41:52.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.833+0000 7fb76b59e700 1 -- start start 2023-10-18T12:41:52.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.837+0000 7fb76b59e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb76c15dcf0 0x7fb76c06fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:52.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.837+0000 7fb76b59e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb76c0d2e20 0x7fb76c0d3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:52.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.837+0000 7fb76b59e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb76c0d37a0 con 0x7fb76c0d23e0 2023-10-18T12:41:52.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.837+0000 7fb76b59e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb76c15e160 con 0x7fb76c15dcf0 2023-10-18T12:41:52.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.837+0000 7fb76b59e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb76c0b6e40 con 0x7fb76c0d2e20 2023-10-18T12:41:52.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.837+0000 7fb769d9b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb76c15dcf0 0x7fb76c06fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:52.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.837+0000 7fb769d9b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb76c15dcf0 0x7fb76c06fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:57628/0 (socket says 172.21.15.114:57628) 2023-10-18T12:41:52.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.837+0000 7fb769d9b700 1 -- 172.21.15.114:0/1121432865 learned_addr learned my addr 172.21.15.114:0/1121432865 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:41:52.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.837+0000 7fb76ad9d700 1 --2- 172.21.15.114:0/1121432865 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb76c0d2e20 0x7fb76c0d3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:52.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.837+0000 7fb769d9b700 1 -- 172.21.15.114:0/1121432865 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb76c0d2e20 msgr2=0x7fb76c0d3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:41:52.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.837+0000 7fb769d9b700 1 --2- 172.21.15.114:0/1121432865 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb76c0d2e20 0x7fb76c0d3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:52.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.837+0000 7fb769d9b700 1 -- 172.21.15.114:0/1121432865 >> v1:172.21.15.172:6789/0 conn(0x7fb76c0d23e0 legacy=0x7fb76c0b65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:52.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.837+0000 7fb769d9b700 1 -- 172.21.15.114:0/1121432865 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb76c0b7120 con 0x7fb76c15dcf0 2023-10-18T12:41:52.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.841+0000 7fb769d9b700 1 --2- 172.21.15.114:0/1121432865 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb76c15dcf0 0x7fb76c06fef0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb760009910 tx=0x7fb760009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83510062689e9491 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:52.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.841+0000 7fb76959a700 1 -- 172.21.15.114:0/1121432865 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb760011830 con 0x7fb76c15dcf0 2023-10-18T12:41:52.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.841+0000 7fb76959a700 1 -- 172.21.15.114:0/1121432865 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb760011990 con 0x7fb76c15dcf0 2023-10-18T12:41:52.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.841+0000 7fb76959a700 1 -- 172.21.15.114:0/1121432865 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb760011d40 con 0x7fb76c15dcf0 2023-10-18T12:41:52.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.841+0000 7fb76b59e700 1 -- 172.21.15.114:0/1121432865 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb76c15dcf0 msgr2=0x7fb76c06fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:52.848 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.841+0000 7fb76b59e700 1 --2- 172.21.15.114:0/1121432865 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb76c15dcf0 0x7fb76c06fef0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb760009910 tx=0x7fb760009c20 comp rx=0 tx=0).stop 2023-10-18T12:41:52.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.841+0000 7fb76b59e700 1 -- 172.21.15.114:0/1121432865 shutdown_connections 2023-10-18T12:41:52.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.841+0000 7fb76b59e700 1 --2- 172.21.15.114:0/1121432865 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb76c0d2e20 0x7fb76c0d3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:52.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.841+0000 7fb76b59e700 1 --2- 172.21.15.114:0/1121432865 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb76c15dcf0 0x7fb76c06fef0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:52.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.841+0000 7fb76b59e700 1 -- 172.21.15.114:0/1121432865 >> 172.21.15.114:0/1121432865 conn(0x7fb76c069f20 msgr2=0x7fb76c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:52.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.841+0000 7fb76b59e700 1 -- 172.21.15.114:0/1121432865 shutdown_connections 2023-10-18T12:41:52.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.841+0000 7fb76b59e700 1 -- 172.21.15.114:0/1121432865 wait complete. 2023-10-18T12:41:52.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.845+0000 7fb76b59e700 1 Processor -- start 2023-10-18T12:41:52.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.845+0000 7fb76b59e700 1 -- start start 2023-10-18T12:41:52.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.845+0000 7fb76b59e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb76c0d23e0 0x7fb76c154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:52.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.845+0000 7fb76b59e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb76c0d2e20 0x7fb76c0d0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:52.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.845+0000 7fb76b59e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb76c15dcf0 0x7fb76c0d0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:52.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.845+0000 7fb76b59e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb76c155d30 con 0x7fb76c0d2e20 2023-10-18T12:41:52.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.845+0000 7fb76b59e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb76c155700 con 0x7fb76c0d23e0 2023-10-18T12:41:52.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.845+0000 7fb76b59e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb76c152e70 con 0x7fb76c15dcf0 2023-10-18T12:41:52.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.845+0000 7fb769d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb76c0d2e20 0x7fb76c0d0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:52.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.845+0000 7fb769d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb76c0d2e20 0x7fb76c0d0a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39760/0 (socket says 172.21.15.114:39760) 2023-10-18T12:41:52.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.845+0000 7fb769d9b700 1 -- 172.21.15.114:0/3650614175 learned_addr learned my addr 172.21.15.114:0/3650614175 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:41:52.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.845+0000 7fb76ad9d700 1 --2- 172.21.15.114:0/3650614175 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb76c15dcf0 0x7fb76c0d0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:52.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.845+0000 7fb76a59c700 1 --2- 172.21.15.114:0/3650614175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb76c0d23e0 0x7fb76c154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:52.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.845+0000 7fb769d9b700 1 -- 172.21.15.114:0/3650614175 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb76c15dcf0 msgr2=0x7fb76c0d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:52.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.845+0000 7fb769d9b700 1 --2- 172.21.15.114:0/3650614175 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb76c15dcf0 0x7fb76c0d0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:52.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.845+0000 7fb769d9b700 1 -- 172.21.15.114:0/3650614175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb76c0d23e0 msgr2=0x7fb76c154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:52.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.845+0000 7fb769d9b700 1 --2- 172.21.15.114:0/3650614175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb76c0d23e0 0x7fb76c154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:52.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.845+0000 7fb769d9b700 1 -- 172.21.15.114:0/3650614175 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb760009570 con 0x7fb76c0d2e20 2023-10-18T12:41:52.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.849+0000 7fb769d9b700 1 --2- 172.21.15.114:0/3650614175 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb76c0d2e20 0x7fb76c0d0a90 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fb76c0706e0 tx=0x7fb760004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:52.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.849+0000 7fb75affd700 1 -- 172.21.15.114:0/3650614175 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76001a8f0 con 0x7fb76c0d2e20 2023-10-18T12:41:52.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.849+0000 7fb75affd700 1 -- 172.21.15.114:0/3650614175 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76001e070 con 0x7fb76c0d2e20 2023-10-18T12:41:52.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.849+0000 7fb76b59e700 1 -- 172.21.15.114:0/3650614175 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb76c153150 con 0x7fb76c0d2e20 2023-10-18T12:41:52.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.849+0000 7fb75affd700 1 -- 172.21.15.114:0/3650614175 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76001ac70 con 0x7fb76c0d2e20 2023-10-18T12:41:52.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.849+0000 7fb76b59e700 1 -- 172.21.15.114:0/3650614175 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb76c152180 con 0x7fb76c0d2e20 2023-10-18T12:41:52.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.849+0000 7fb76b59e700 1 -- 172.21.15.114:0/3650614175 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb76c04e910 con 0x7fb76c0d2e20 2023-10-18T12:41:52.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.849+0000 7fb75affd700 1 -- 172.21.15.114:0/3650614175 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fb76002d450 con 0x7fb76c0d2e20 2023-10-18T12:41:52.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.853+0000 7fb75affd700 1 --2- 172.21.15.114:0/3650614175 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb74c0656f0 0x7fb74c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:52.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.853+0000 7fb75affd700 1 -- 172.21.15.114:0/3650614175 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7fb760083fa0 con 0x7fb76c0d2e20 2023-10-18T12:41:52.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.853+0000 7fb76a59c700 1 --2- 172.21.15.114:0/3650614175 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb74c0656f0 0x7fb74c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:52.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.853+0000 7fb76a59c700 1 --2- 172.21.15.114:0/3650614175 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb74c0656f0 0x7fb74c067bb0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb75c000f60 tx=0x7fb75c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:52.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:52.857+0000 7fb75affd700 1 -- 172.21.15.114:0/3650614175 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fb7600517c0 con 0x7fb76c0d2e20 2023-10-18T12:41:53.099 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.093+0000 7fb76b59e700 1 -- 172.21.15.114:0/3650614175 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb76c06d450 con 0x7fb76c0d2e20 2023-10-18T12:41:53.100 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.097+0000 7fb75affd700 1 -- 172.21.15.114:0/3650614175 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v60) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb760054de0 con 0x7fb76c0d2e20 2023-10-18T12:41:53.101 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-10-18T12:41:53.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.101+0000 7fb76b59e700 1 -- 172.21.15.114:0/3650614175 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb74c0656f0 msgr2=0x7fb74c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:53.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.101+0000 7fb76b59e700 1 --2- 172.21.15.114:0/3650614175 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb74c0656f0 0x7fb74c067bb0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb75c000f60 tx=0x7fb75c009040 comp rx=0 tx=0).stop 2023-10-18T12:41:53.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.101+0000 7fb76b59e700 1 -- 172.21.15.114:0/3650614175 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb76c0d2e20 msgr2=0x7fb76c0d0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:53.105 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.101+0000 7fb76b59e700 1 --2- 172.21.15.114:0/3650614175 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb76c0d2e20 0x7fb76c0d0a90 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fb76c0706e0 tx=0x7fb760004770 comp rx=0 tx=0).stop 2023-10-18T12:41:53.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.101+0000 7fb76b59e700 1 -- 172.21.15.114:0/3650614175 shutdown_connections 2023-10-18T12:41:53.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.101+0000 7fb76b59e700 1 --2- 172.21.15.114:0/3650614175 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb74c0656f0 0x7fb74c067bb0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:53.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.101+0000 7fb76b59e700 1 --2- 172.21.15.114:0/3650614175 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb76c15dcf0 0x7fb76c0d0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:53.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.101+0000 7fb76b59e700 1 --2- 172.21.15.114:0/3650614175 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb76c0d2e20 0x7fb76c0d0a90 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:53.106 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.101+0000 7fb76b59e700 1 --2- 172.21.15.114:0/3650614175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb76c0d23e0 0x7fb76c154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:53.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.101+0000 7fb76b59e700 1 -- 172.21.15.114:0/3650614175 >> 172.21.15.114:0/3650614175 conn(0x7fb76c069f20 msgr2=0x7fb76c06f450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:53.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.101+0000 7fb76b59e700 1 -- 172.21.15.114:0/3650614175 shutdown_connections 2023-10-18T12:41:53.107 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.101+0000 7fb76b59e700 1 -- 172.21.15.114:0/3650614175 wait complete. 2023-10-18T12:41:53.129 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-18T12:41:53.309 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.305+0000 7f8c73b92700 1 Processor -- start 2023-10-18T12:41:53.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.305+0000 7f8c73b92700 1 -- start start 2023-10-18T12:41:53.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.305+0000 7f8c73b92700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c6c0c1e30 0x7f8c6c06f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:53.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.305+0000 7f8c73b92700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8c6c0cad50 0x7f8c6c06e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:53.312 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.305+0000 7f8c73b92700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f8c6c06ea50 0x7f8c6c164ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:53.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.305+0000 7f8c73b92700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c6c0c2210 con 0x7f8c6c0cad50 2023-10-18T12:41:53.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.305+0000 7f8c73b92700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c6c06d820 con 0x7f8c6c06ea50 2023-10-18T12:41:53.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.305+0000 7f8c73b92700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c0cc3f0 con 0x7f8c6c0c1e30 2023-10-18T12:41:53.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.309+0000 7f8c7112d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8c6c0cad50 0x7f8c6c06e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:53.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.309+0000 7f8c7112d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8c6c0cad50 0x7f8c6c06e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39766/0 (socket says 172.21.15.114:39766) 2023-10-18T12:41:53.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.309+0000 7f8c7112d700 1 -- 172.21.15.114:0/1382084861 learned_addr learned my addr 172.21.15.114:0/1382084861 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:41:53.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.309+0000 7f8c7192e700 1 --2- 172.21.15.114:0/1382084861 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c6c0c1e30 0x7f8c6c06f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:53.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.309+0000 7f8c7212f700 1 --2- 172.21.15.114:0/1382084861 >> v2:172.21.15.172:3300/0 conn(0x7f8c6c06ea50 0x7f8c6c164ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:53.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.309+0000 7f8c7112d700 1 -- 172.21.15.114:0/1382084861 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c6c0c1e30 msgr2=0x7f8c6c06f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:41:53.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.309+0000 7f8c7112d700 1 --2- 172.21.15.114:0/1382084861 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c6c0c1e30 0x7f8c6c06f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:53.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.309+0000 7f8c7112d700 1 -- 172.21.15.114:0/1382084861 >> v2:172.21.15.172:3300/0 conn(0x7f8c6c06ea50 msgr2=0x7f8c6c164ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:41:53.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.309+0000 7f8c7112d700 1 --2- 172.21.15.114:0/1382084861 >> v2:172.21.15.172:3300/0 conn(0x7f8c6c06ea50 0x7f8c6c164ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:53.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.309+0000 7f8c7112d700 1 -- 172.21.15.114:0/1382084861 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c6c06e080 con 0x7f8c6c0cad50 2023-10-18T12:41:53.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.309+0000 7f8c7112d700 1 --2- 172.21.15.114:0/1382084861 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c6c0cad50 0x7f8c6c06e510 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c0ccbf0 tx=0x7f8c5c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e23804ea8eb92577 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:53.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.309+0000 7f8c7092c700 1 -- 172.21.15.114:0/1382084861 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c00b8a0 con 0x7f8c6c0cad50 2023-10-18T12:41:53.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.309+0000 7f8c7092c700 1 -- 172.21.15.114:0/1382084861 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c5c00ba00 con 0x7f8c6c0cad50 2023-10-18T12:41:53.317 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.309+0000 7f8c7092c700 1 -- 172.21.15.114:0/1382084861 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c00bd90 con 0x7f8c6c0cad50 2023-10-18T12:41:53.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.309+0000 7f8c73b92700 1 -- 172.21.15.114:0/1382084861 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c6c0cad50 msgr2=0x7f8c6c06e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:53.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.309+0000 7f8c73b92700 1 --2- 172.21.15.114:0/1382084861 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c6c0cad50 0x7f8c6c06e510 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c0ccbf0 tx=0x7f8c5c009bf0 comp rx=0 tx=0).stop 2023-10-18T12:41:53.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.309+0000 7f8c73b92700 1 -- 172.21.15.114:0/1382084861 shutdown_connections 2023-10-18T12:41:53.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.309+0000 7f8c73b92700 1 --2- 172.21.15.114:0/1382084861 >> v2:172.21.15.172:3300/0 conn(0x7f8c6c06ea50 0x7f8c6c164ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:53.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.309+0000 7f8c73b92700 1 --2- 172.21.15.114:0/1382084861 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c6c0cad50 0x7f8c6c06e510 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:53.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.309+0000 7f8c73b92700 1 --2- 172.21.15.114:0/1382084861 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c6c0c1e30 0x7f8c6c06f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:53.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.309+0000 7f8c73b92700 1 -- 172.21.15.114:0/1382084861 >> 172.21.15.114:0/1382084861 conn(0x7f8c6c0ce820 msgr2=0x7f8c6c0cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:53.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.309+0000 7f8c73b92700 1 -- 172.21.15.114:0/1382084861 shutdown_connections 2023-10-18T12:41:53.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.309+0000 7f8c73b92700 1 -- 172.21.15.114:0/1382084861 wait complete. 2023-10-18T12:41:53.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.313+0000 7f8c73b92700 1 Processor -- start 2023-10-18T12:41:53.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.313+0000 7f8c73b92700 1 -- start start 2023-10-18T12:41:53.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.313+0000 7f8c73b92700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c6c06ea50 0x7f8c6c15d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:53.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.313+0000 7f8c73b92700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c6c0c1e30 0x7f8c6c0b3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:53.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.313+0000 7f8c73b92700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c6c0cad50 0x7f8c6c0b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:53.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.313+0000 7f8c73b92700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c161ce0 con 0x7f8c6c06ea50 2023-10-18T12:41:53.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.313+0000 7f8c73b92700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c15da00 con 0x7f8c6c0c1e30 2023-10-18T12:41:53.322 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.313+0000 7f8c73b92700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c0b26e0 con 0x7f8c6c0cad50 2023-10-18T12:41:53.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.313+0000 7f8c7192e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c6c06ea50 0x7f8c6c15d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:53.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.313+0000 7f8c7192e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c6c06ea50 0x7f8c6c15d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39770/0 (socket says 172.21.15.114:39770) 2023-10-18T12:41:53.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.313+0000 7f8c7192e700 1 -- 172.21.15.114:0/1729606038 learned_addr learned my addr 172.21.15.114:0/1729606038 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:41:53.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.313+0000 7f8c7212f700 1 --2- 172.21.15.114:0/1729606038 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c6c0cad50 0x7f8c6c0b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:53.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.317+0000 7f8c7112d700 1 --2- 172.21.15.114:0/1729606038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c6c0c1e30 0x7f8c6c0b3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:53.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.317+0000 7f8c7192e700 1 -- 172.21.15.114:0/1729606038 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c6c0cad50 msgr2=0x7f8c6c0b3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:53.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.317+0000 7f8c7192e700 1 --2- 172.21.15.114:0/1729606038 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c6c0cad50 0x7f8c6c0b3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:53.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.317+0000 7f8c7192e700 1 -- 172.21.15.114:0/1729606038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c6c0c1e30 msgr2=0x7f8c6c0b3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:53.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.317+0000 7f8c7192e700 1 --2- 172.21.15.114:0/1729606038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c6c0c1e30 0x7f8c6c0b3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:53.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.317+0000 7f8c7192e700 1 -- 172.21.15.114:0/1729606038 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c5c009570 con 0x7f8c6c06ea50 2023-10-18T12:41:53.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.317+0000 7f8c7212f700 1 --2- 172.21.15.114:0/1729606038 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c6c0cad50 0x7f8c6c0b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:41:53.325 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.317+0000 7f8c7112d700 1 --2- 172.21.15.114:0/1729606038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c6c0c1e30 0x7f8c6c0b3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:41:53.326 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.317+0000 7f8c7192e700 1 --2- 172.21.15.114:0/1729606038 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c6c06ea50 0x7f8c6c15d4c0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f8c6800e760 tx=0x7f8c6800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:53.326 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.317+0000 7f8c627fc700 1 -- 172.21.15.114:0/1729606038 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c68013610 con 0x7f8c6c06ea50 2023-10-18T12:41:53.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.317+0000 7f8c627fc700 1 -- 172.21.15.114:0/1729606038 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c68013770 con 0x7f8c6c06ea50 2023-10-18T12:41:53.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.317+0000 7f8c73b92700 1 -- 172.21.15.114:0/1729606038 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c6c0b29c0 con 0x7f8c6c06ea50 2023-10-18T12:41:53.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.317+0000 7f8c627fc700 1 -- 172.21.15.114:0/1729606038 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c68013ae0 con 0x7f8c6c06ea50 2023-10-18T12:41:53.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.317+0000 7f8c73b92700 1 -- 172.21.15.114:0/1729606038 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c6c161970 con 0x7f8c6c06ea50 2023-10-18T12:41:53.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.317+0000 7f8c73b92700 1 -- 172.21.15.114:0/1729606038 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c6c072e60 con 0x7f8c6c06ea50 2023-10-18T12:41:53.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.321+0000 7f8c627fc700 1 -- 172.21.15.114:0/1729606038 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f8c68013c40 con 0x7f8c6c06ea50 2023-10-18T12:41:53.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.321+0000 7f8c627fc700 1 --2- 172.21.15.114:0/1729606038 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8c50065720 0x7f8c50067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:53.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.321+0000 7f8c627fc700 1 -- 172.21.15.114:0/1729606038 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7f8c68082d30 con 0x7f8c6c06ea50 2023-10-18T12:41:53.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.321+0000 7f8c7112d700 1 --2- 172.21.15.114:0/1729606038 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8c50065720 0x7f8c50067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:53.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.321+0000 7f8c7112d700 1 --2- 172.21.15.114:0/1729606038 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8c50065720 0x7f8c50067be0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c000c00 tx=0x7f8c5c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:53.334 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.329+0000 7f8c627fc700 1 -- 172.21.15.114:0/1729606038 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f8c68053f70 con 0x7f8c6c06ea50 2023-10-18T12:41:53.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.501+0000 7f8c73b92700 1 -- 172.21.15.114:0/1729606038 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8c6c0c8990 con 0x7f8c6c06ea50 2023-10-18T12:41:53.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.505+0000 7f8c627fc700 1 -- 172.21.15.114:0/1729606038 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v60) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8c68053b00 con 0x7f8c6c06ea50 2023-10-18T12:41:53.509 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-10-18T12:41:53.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.505+0000 7f8c73b92700 1 -- 172.21.15.114:0/1729606038 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8c50065720 msgr2=0x7f8c50067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:53.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.505+0000 7f8c73b92700 1 --2- 172.21.15.114:0/1729606038 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8c50065720 0x7f8c50067be0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c000c00 tx=0x7f8c5c008030 comp rx=0 tx=0).stop 2023-10-18T12:41:53.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.505+0000 7f8c73b92700 1 -- 172.21.15.114:0/1729606038 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c6c06ea50 msgr2=0x7f8c6c15d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:53.511 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.505+0000 7f8c73b92700 1 --2- 172.21.15.114:0/1729606038 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c6c06ea50 0x7f8c6c15d4c0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f8c6800e760 tx=0x7f8c6800eb20 comp rx=0 tx=0).stop 2023-10-18T12:41:53.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.505+0000 7f8c73b92700 1 -- 172.21.15.114:0/1729606038 shutdown_connections 2023-10-18T12:41:53.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.505+0000 7f8c73b92700 1 --2- 172.21.15.114:0/1729606038 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8c50065720 0x7f8c50067be0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:53.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.505+0000 7f8c73b92700 1 --2- 172.21.15.114:0/1729606038 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8c6c0cad50 0x7f8c6c0b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:53.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.505+0000 7f8c73b92700 1 --2- 172.21.15.114:0/1729606038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8c6c0c1e30 0x7f8c6c0b3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:53.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.505+0000 7f8c73b92700 1 --2- 172.21.15.114:0/1729606038 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8c6c06ea50 0x7f8c6c15d4c0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:53.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.505+0000 7f8c73b92700 1 -- 172.21.15.114:0/1729606038 >> 172.21.15.114:0/1729606038 conn(0x7f8c6c0ce820 msgr2=0x7f8c6c0c4220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:53.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.505+0000 7f8c73b92700 1 -- 172.21.15.114:0/1729606038 shutdown_connections 2023-10-18T12:41:53.513 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.505+0000 7f8c73b92700 1 -- 172.21.15.114:0/1729606038 wait complete. 2023-10-18T12:41:53.531 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-18T12:41:53.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.705+0000 7ff432035700 1 Processor -- start 2023-10-18T12:41:53.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.705+0000 7ff432035700 1 -- start start 2023-10-18T12:41:53.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.705+0000 7ff432035700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff42c0cb500 0x7ff42c0b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:53.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.705+0000 7ff432035700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff42c0b2720 0x7ff42c06fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:53.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.705+0000 7ff432035700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff42c0b16d0 con 0x7ff42c160e50 2023-10-18T12:41:53.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.705+0000 7ff432035700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff42c0b1ee0 con 0x7ff42c0cb500 2023-10-18T12:41:53.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.705+0000 7ff432035700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c0b2bb0 con 0x7ff42c0b2720 2023-10-18T12:41:53.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.709+0000 7ff431033700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff42c160e50 0x7ff42c06e3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60320/0 (socket says 172.21.15.114:60320) 2023-10-18T12:41:53.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.709+0000 7ff431033700 1 -- 172.21.15.114:0/2160705162 learned_addr learned my addr 172.21.15.114:0/2160705162 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:41:53.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.709+0000 7ff430832700 1 --2- 172.21.15.114:0/2160705162 >> v2:172.21.15.114:3300/0 conn(0x7ff42c0cb500 0x7ff42c0b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:53.716 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.709+0000 7ff431834700 1 --2- 172.21.15.114:0/2160705162 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff42c0b2720 0x7ff42c06fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:53.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.709+0000 7ff423fff700 1 -- 172.21.15.114:0/2160705162 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3090894814 0 0) 0x7ff42c0b16d0 con 0x7ff42c160e50 2023-10-18T12:41:53.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.709+0000 7ff423fff700 1 -- 172.21.15.114:0/2160705162 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4180035d0 con 0x7ff42c160e50 2023-10-18T12:41:53.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.709+0000 7ff423fff700 1 -- 172.21.15.114:0/2160705162 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3783207190 0 0) 0x7ff4180035d0 con 0x7ff42c160e50 2023-10-18T12:41:53.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.709+0000 7ff423fff700 1 -- 172.21.15.114:0/2160705162 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff42c0b2720 msgr2=0x7ff42c06fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:41:53.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.709+0000 7ff423fff700 1 --2- 172.21.15.114:0/2160705162 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff42c0b2720 0x7ff42c06fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:53.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.709+0000 7ff423fff700 1 -- 172.21.15.114:0/2160705162 >> v2:172.21.15.114:3300/0 conn(0x7ff42c0cb500 msgr2=0x7ff42c0b21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:41:53.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.709+0000 7ff423fff700 1 --2- 172.21.15.114:0/2160705162 >> v2:172.21.15.114:3300/0 conn(0x7ff42c0cb500 0x7ff42c0b21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:53.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.709+0000 7ff423fff700 1 -- 172.21.15.114:0/2160705162 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff42c06eaf0 con 0x7ff42c160e50 2023-10-18T12:41:53.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.709+0000 7ff423fff700 1 -- 172.21.15.114:0/2160705162 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3368469509 0 0) 0x7ff428001670 con 0x7ff42c160e50 2023-10-18T12:41:53.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.709+0000 7ff423fff700 1 -- 172.21.15.114:0/2160705162 >> v1:172.21.15.114:6789/0 conn(0x7ff42c160e50 legacy=0x7ff42c06e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:53.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.709+0000 7ff423fff700 1 --2- 172.21.15.114:0/2160705162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff418003a20 0x7ff418003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:53.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.709+0000 7ff423fff700 1 --2- 172.21.15.114:0/2160705162 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff42c0b2720 0x7ff418004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:53.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.709+0000 7ff423fff700 1 --2- 172.21.15.114:0/2160705162 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff418004db0 0x7ff418005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:53.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.709+0000 7ff423fff700 1 -- 172.21.15.114:0/2160705162 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c0b1ee0 con 0x7ff418004db0 2023-10-18T12:41:53.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.709+0000 7ff423fff700 1 -- 172.21.15.114:0/2160705162 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c0b2bb0 con 0x7ff418003a20 2023-10-18T12:41:53.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.709+0000 7ff423fff700 1 -- 172.21.15.114:0/2160705162 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff41800ba30 con 0x7ff42c0b2720 2023-10-18T12:41:53.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.709+0000 7ff430832700 1 --2- 172.21.15.114:0/2160705162 >> v2:172.21.15.114:3300/0 conn(0x7ff42c0cb500 0x7ff42c0b21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:41:53.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.709+0000 7ff431834700 1 --2- 172.21.15.114:0/2160705162 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff418004db0 0x7ff418005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:53.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.709+0000 7ff431033700 1 --2- 172.21.15.114:0/2160705162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff418003a20 0x7ff418003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:53.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.709+0000 7ff430832700 1 --2- 172.21.15.114:0/2160705162 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff42c0b2720 0x7ff418004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:53.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.709+0000 7ff431834700 1 -- 172.21.15.114:0/2160705162 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff42c0b2720 msgr2=0x7ff418004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:41:53.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.709+0000 7ff431834700 1 --2- 172.21.15.114:0/2160705162 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff42c0b2720 0x7ff418004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:53.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.709+0000 7ff431834700 1 -- 172.21.15.114:0/2160705162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff418003a20 msgr2=0x7ff418003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:41:53.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.709+0000 7ff431834700 1 --2- 172.21.15.114:0/2160705162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff418003a20 0x7ff418003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:53.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.709+0000 7ff431834700 1 -- 172.21.15.114:0/2160705162 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4180035d0 con 0x7ff418004db0 2023-10-18T12:41:53.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.709+0000 7ff431834700 1 --2- 172.21.15.114:0/2160705162 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff418004db0 0x7ff418005230 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7ff424009fc0 tx=0x7ff4180058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dd4aa52b2a37e4f server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:53.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.709+0000 7ff423fff700 1 -- 172.21.15.114:0/2160705162 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42400ec30 con 0x7ff418004db0 2023-10-18T12:41:53.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.709+0000 7ff423fff700 1 -- 172.21.15.114:0/2160705162 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42400f040 con 0x7ff418004db0 2023-10-18T12:41:53.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.709+0000 7ff423fff700 1 -- 172.21.15.114:0/2160705162 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff424014480 con 0x7ff418004db0 2023-10-18T12:41:53.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.713+0000 7ff432035700 1 -- 172.21.15.114:0/2160705162 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff418004db0 msgr2=0x7ff418005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:53.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.713+0000 7ff432035700 1 --2- 172.21.15.114:0/2160705162 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff418004db0 0x7ff418005230 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7ff424009fc0 tx=0x7ff4180058a0 comp rx=0 tx=0).stop 2023-10-18T12:41:53.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.713+0000 7ff431834700 1 -- 172.21.15.114:0/2160705162 reap_dead start 2023-10-18T12:41:53.725 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.713+0000 7ff432035700 1 -- 172.21.15.114:0/2160705162 shutdown_connections 2023-10-18T12:41:53.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.713+0000 7ff432035700 1 -- 172.21.15.114:0/2160705162 >> 172.21.15.114:0/2160705162 conn(0x7ff42c0b0bf0 msgr2=0x7ff42c0ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:53.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.713+0000 7ff432035700 1 -- 172.21.15.114:0/2160705162 shutdown_connections 2023-10-18T12:41:53.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.713+0000 7ff432035700 1 -- 172.21.15.114:0/2160705162 wait complete. 2023-10-18T12:41:53.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.717+0000 7ff432035700 1 Processor -- start 2023-10-18T12:41:53.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.717+0000 7ff432035700 1 -- start start 2023-10-18T12:41:53.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.717+0000 7ff432035700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff418004db0 0x7ff42c163160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:53.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.717+0000 7ff432035700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff42c162310 0x7ff42c1f6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:53.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.717+0000 7ff432035700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff42c157670 0x7ff42c0af300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:53.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.717+0000 7ff432035700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c1591b0 con 0x7ff42c162310 2023-10-18T12:41:53.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.717+0000 7ff432035700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c158530 con 0x7ff418004db0 2023-10-18T12:41:53.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.717+0000 7ff432035700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c158810 con 0x7ff42c157670 2023-10-18T12:41:53.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.717+0000 7ff430832700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff42c162310 0x7ff42c1f6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:53.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.717+0000 7ff430832700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff42c162310 0x7ff42c1f6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39796/0 (socket says 172.21.15.114:39796) 2023-10-18T12:41:53.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.717+0000 7ff430832700 1 -- 172.21.15.114:0/1647982466 learned_addr learned my addr 172.21.15.114:0/1647982466 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:41:53.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.717+0000 7ff431033700 1 --2- 172.21.15.114:0/1647982466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff418004db0 0x7ff42c163160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:53.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.717+0000 7ff431834700 1 --2- 172.21.15.114:0/1647982466 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff42c157670 0x7ff42c0af300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:53.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.717+0000 7ff430832700 1 -- 172.21.15.114:0/1647982466 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff42c157670 msgr2=0x7ff42c0af300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:53.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.717+0000 7ff430832700 1 --2- 172.21.15.114:0/1647982466 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff42c157670 0x7ff42c0af300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:53.729 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.717+0000 7ff430832700 1 -- 172.21.15.114:0/1647982466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff418004db0 msgr2=0x7ff42c163160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:53.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.717+0000 7ff430832700 1 --2- 172.21.15.114:0/1647982466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff418004db0 0x7ff42c163160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:53.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.717+0000 7ff430832700 1 -- 172.21.15.114:0/1647982466 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff42c158af0 con 0x7ff42c162310 2023-10-18T12:41:53.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.717+0000 7ff431834700 1 --2- 172.21.15.114:0/1647982466 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff42c157670 0x7ff42c0af300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:41:53.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.717+0000 7ff430832700 1 --2- 172.21.15.114:0/1647982466 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff42c162310 0x7ff42c1f6740 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7ff41c011900 tx=0x7ff41c011cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:53.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.717+0000 7ff421ffb700 1 -- 172.21.15.114:0/1647982466 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41c00fae0 con 0x7ff42c162310 2023-10-18T12:41:53.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.717+0000 7ff421ffb700 1 -- 172.21.15.114:0/1647982466 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41c00fc40 con 0x7ff42c162310 2023-10-18T12:41:53.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.717+0000 7ff432035700 1 -- 172.21.15.114:0/1647982466 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff42c158dd0 con 0x7ff42c162310 2023-10-18T12:41:53.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.717+0000 7ff421ffb700 1 -- 172.21.15.114:0/1647982466 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41c011ea0 con 0x7ff42c162310 2023-10-18T12:41:53.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.721+0000 7ff432035700 1 -- 172.21.15.114:0/1647982466 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff42c157af0 con 0x7ff42c162310 2023-10-18T12:41:53.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.721+0000 7ff432035700 1 -- 172.21.15.114:0/1647982466 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff42c072e60 con 0x7ff42c162310 2023-10-18T12:41:53.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.721+0000 7ff421ffb700 1 -- 172.21.15.114:0/1647982466 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff41c015460 con 0x7ff42c162310 2023-10-18T12:41:53.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.725+0000 7ff421ffb700 1 --2- 172.21.15.114:0/1647982466 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff4100656f0 0x7ff410067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:53.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.725+0000 7ff421ffb700 1 -- 172.21.15.114:0/1647982466 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7ff41c083920 con 0x7ff42c162310 2023-10-18T12:41:53.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.725+0000 7ff431033700 1 --2- 172.21.15.114:0/1647982466 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff4100656f0 0x7ff410067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:53.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.725+0000 7ff431033700 1 --2- 172.21.15.114:0/1647982466 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff4100656f0 0x7ff410067bb0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff428001050 tx=0x7ff428009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:53.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.729+0000 7ff421ffb700 1 -- 172.21.15.114:0/1647982466 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7ff41c0511e0 con 0x7ff42c162310 2023-10-18T12:41:53.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.925+0000 7ff432035700 1 -- 172.21.15.114:0/1647982466 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff42c0cf3c0 con 0x7ff42c162310 2023-10-18T12:41:53.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.925+0000 7ff421ffb700 1 -- 172.21.15.114:0/1647982466 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 1 entries v60) v1 ==== 80+0+59 (secure 0 0 0) 0x7ff41c054800 con 0x7ff42c162310 2023-10-18T12:41:53.933 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114:0/1817588655 2023-10-18T13:29:19.822093+0000 2023-10-18T12:41:53.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.929+0000 7ff432035700 1 -- 172.21.15.114:0/1647982466 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff4100656f0 msgr2=0x7ff410067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:53.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.929+0000 7ff432035700 1 --2- 172.21.15.114:0/1647982466 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff4100656f0 0x7ff410067bb0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff428001050 tx=0x7ff428009040 comp rx=0 tx=0).stop 2023-10-18T12:41:53.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.929+0000 7ff432035700 1 -- 172.21.15.114:0/1647982466 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff42c162310 msgr2=0x7ff42c1f6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:53.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.929+0000 7ff432035700 1 --2- 172.21.15.114:0/1647982466 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff42c162310 0x7ff42c1f6740 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7ff41c011900 tx=0x7ff41c011cc0 comp rx=0 tx=0).stop 2023-10-18T12:41:53.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.929+0000 7ff432035700 1 -- 172.21.15.114:0/1647982466 shutdown_connections 2023-10-18T12:41:53.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.929+0000 7ff432035700 1 --2- 172.21.15.114:0/1647982466 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff4100656f0 0x7ff410067bb0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:53.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.929+0000 7ff432035700 1 --2- 172.21.15.114:0/1647982466 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff42c157670 0x7ff42c0af300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:53.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.929+0000 7ff432035700 1 --2- 172.21.15.114:0/1647982466 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff42c162310 0x7ff42c1f6740 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:53.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.929+0000 7ff432035700 1 --2- 172.21.15.114:0/1647982466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff418004db0 0x7ff42c163160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:53.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.929+0000 7ff432035700 1 -- 172.21.15.114:0/1647982466 >> 172.21.15.114:0/1647982466 conn(0x7ff42c0b0bf0 msgr2=0x7ff42c0ae950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:53.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.929+0000 7ff432035700 1 -- 172.21.15.114:0/1647982466 shutdown_connections 2023-10-18T12:41:53.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:53.929+0000 7ff432035700 1 -- 172.21.15.114:0/1647982466 wait complete. 2023-10-18T12:41:53.939 INFO:teuthology.orchestra.run.smithi114.stderr:listed 1 entries 2023-10-18T12:41:53.960 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-18T12:41:53.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:41:53.961 DEBUG:teuthology.orchestra.run.smithi172:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-18T12:41:54.014 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi172.front.sepia.ceph.com 2023-10-18T12:41:54.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:41:54.015 DEBUG:teuthology.orchestra.run.smithi172:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-18T12:41:54.029 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:41:54.030 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-18T12:41:54.050 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352264k,nr_inodes=4088066,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2657 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-18T12:41:54.051 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T12:41:54.051 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-18T12:41:54.094 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352316k,nr_inodes=4088079,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2928 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-18T12:41:54.095 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T12:41:54.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.269+0000 7fbd2f2c2700 1 Processor -- start 2023-10-18T12:41:54.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.273+0000 7fbd2f2c2700 1 -- start start 2023-10-18T12:41:54.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.273+0000 7fbd2f2c2700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fbd28159750 0x7fbd28070560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:54.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.273+0000 7fbd2f2c2700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd280b14f0 con 0x7fbd28070aa0 2023-10-18T12:41:54.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.273+0000 7fbd2f2c2700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd2815d590 con 0x7fbd280ce040 2023-10-18T12:41:54.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.273+0000 7fbd2f2c2700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd280c9aa0 con 0x7fbd28159750 2023-10-18T12:41:54.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.273+0000 7fbd2dabf700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fbd28070aa0 0x7fbd280cd930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60336/0 (socket says 172.21.15.114:60336) 2023-10-18T12:41:54.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.273+0000 7fbd2dabf700 1 -- 172.21.15.114:0/3605068703 learned_addr learned my addr 172.21.15.114:0/3605068703 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:41:54.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.277+0000 7fbd2e2c0700 1 --2- 172.21.15.114:0/3605068703 >> v2:172.21.15.114:3300/0 conn(0x7fbd28159750 0x7fbd28070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:54.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.277+0000 7fbd2d2be700 1 -- 172.21.15.114:0/3605068703 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2331690974 0 0) 0x7fbd280b14f0 con 0x7fbd28070aa0 2023-10-18T12:41:54.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.277+0000 7fbd2d2be700 1 -- 172.21.15.114:0/3605068703 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd140035d0 con 0x7fbd28070aa0 2023-10-18T12:41:54.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.277+0000 7fbd2d2be700 1 -- 172.21.15.114:0/3605068703 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3283895997 0 0) 0x7fbd2815d590 con 0x7fbd280ce040 2023-10-18T12:41:54.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.277+0000 7fbd2d2be700 1 -- 172.21.15.114:0/3605068703 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd280b14f0 con 0x7fbd280ce040 2023-10-18T12:41:54.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.277+0000 7fbd2e2c0700 1 -- 172.21.15.114:0/3605068703 >> v1:172.21.15.172:6789/0 conn(0x7fbd280ce040 legacy=0x7fbd2806cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:54.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.277+0000 7fbd2e2c0700 1 -- 172.21.15.114:0/3605068703 >> v1:172.21.15.114:6789/0 conn(0x7fbd28070aa0 legacy=0x7fbd280cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:54.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.277+0000 7fbd2e2c0700 1 -- 172.21.15.114:0/3605068703 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2815d870 con 0x7fbd28159750 2023-10-18T12:41:54.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.277+0000 7fbd2e2c0700 1 --2- 172.21.15.114:0/3605068703 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd28159750 0x7fbd28070560 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fbd24009850 tx=0x7fbd24009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49be131794b7dd88 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:54.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.277+0000 7fbd2d2be700 1 -- 172.21.15.114:0/3605068703 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd24011830 con 0x7fbd28159750 2023-10-18T12:41:54.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.277+0000 7fbd2d2be700 1 -- 172.21.15.114:0/3605068703 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd24011990 con 0x7fbd28159750 2023-10-18T12:41:54.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.277+0000 7fbd2d2be700 1 -- 172.21.15.114:0/3605068703 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd24011d40 con 0x7fbd28159750 2023-10-18T12:41:54.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.277+0000 7fbd2f2c2700 1 -- 172.21.15.114:0/3605068703 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd28159750 msgr2=0x7fbd28070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:54.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.277+0000 7fbd2f2c2700 1 --2- 172.21.15.114:0/3605068703 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd28159750 0x7fbd28070560 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fbd24009850 tx=0x7fbd24009b60 comp rx=0 tx=0).stop 2023-10-18T12:41:54.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.277+0000 7fbd2f2c2700 1 -- 172.21.15.114:0/3605068703 shutdown_connections 2023-10-18T12:41:54.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.277+0000 7fbd2f2c2700 1 --2- 172.21.15.114:0/3605068703 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd28159750 0x7fbd28070560 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:54.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.277+0000 7fbd2f2c2700 1 -- 172.21.15.114:0/3605068703 >> 172.21.15.114:0/3605068703 conn(0x7fbd280ce5c0 msgr2=0x7fbd280ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:54.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.277+0000 7fbd2f2c2700 1 -- 172.21.15.114:0/3605068703 shutdown_connections 2023-10-18T12:41:54.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.277+0000 7fbd2f2c2700 1 -- 172.21.15.114:0/3605068703 wait complete. 2023-10-18T12:41:54.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.281+0000 7fbd2f2c2700 1 Processor -- start 2023-10-18T12:41:54.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.281+0000 7fbd2f2c2700 1 -- start start 2023-10-18T12:41:54.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.281+0000 7fbd2f2c2700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd28070aa0 0x7fbd280c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:54.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.281+0000 7fbd2f2c2700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbd280ce040 0x7fbd28151640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:54.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.285+0000 7fbd2f2c2700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd28159750 0x7fbd28152660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:54.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.285+0000 7fbd2f2c2700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd28151b80 con 0x7fbd28159750 2023-10-18T12:41:54.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.285+0000 7fbd2f2c2700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd28152ba0 con 0x7fbd28070aa0 2023-10-18T12:41:54.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.285+0000 7fbd2f2c2700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd28152e70 con 0x7fbd280ce040 2023-10-18T12:41:54.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.285+0000 7fbd2eac1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd28159750 0x7fbd28152660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:54.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.285+0000 7fbd2eac1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd28159750 0x7fbd28152660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39820/0 (socket says 172.21.15.114:39820) 2023-10-18T12:41:54.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.285+0000 7fbd2eac1700 1 -- 172.21.15.114:0/2685878407 learned_addr learned my addr 172.21.15.114:0/2685878407 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:41:54.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.285+0000 7fbd2e2c0700 1 --2- 172.21.15.114:0/2685878407 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd28070aa0 0x7fbd280c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:54.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.285+0000 7fbd2dabf700 1 --2- 172.21.15.114:0/2685878407 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbd280ce040 0x7fbd28151640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:54.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.285+0000 7fbd2eac1700 1 -- 172.21.15.114:0/2685878407 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbd280ce040 msgr2=0x7fbd28151640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:54.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.285+0000 7fbd2eac1700 1 --2- 172.21.15.114:0/2685878407 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbd280ce040 0x7fbd28151640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:54.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.285+0000 7fbd2eac1700 1 -- 172.21.15.114:0/2685878407 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd28070aa0 msgr2=0x7fbd280c6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:54.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.285+0000 7fbd2eac1700 1 --2- 172.21.15.114:0/2685878407 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd28070aa0 0x7fbd280c6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:54.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.285+0000 7fbd2eac1700 1 -- 172.21.15.114:0/2685878407 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd240094b0 con 0x7fbd28159750 2023-10-18T12:41:54.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.285+0000 7fbd2eac1700 1 --2- 172.21.15.114:0/2685878407 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd28159750 0x7fbd28152660 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000cc20 tx=0x7fbd2000cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:54.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.285+0000 7fbd1effd700 1 -- 172.21.15.114:0/2685878407 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd20003c20 con 0x7fbd28159750 2023-10-18T12:41:54.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.285+0000 7fbd1effd700 1 -- 172.21.15.114:0/2685878407 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd20003d80 con 0x7fbd28159750 2023-10-18T12:41:54.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.285+0000 7fbd1effd700 1 -- 172.21.15.114:0/2685878407 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2000aae0 con 0x7fbd28159750 2023-10-18T12:41:54.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.285+0000 7fbd2f2c2700 1 -- 172.21.15.114:0/2685878407 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd28153150 con 0x7fbd28159750 2023-10-18T12:41:54.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.285+0000 7fbd2f2c2700 1 -- 172.21.15.114:0/2685878407 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd28153710 con 0x7fbd28159750 2023-10-18T12:41:54.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.289+0000 7fbd2f2c2700 1 -- 172.21.15.114:0/2685878407 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd28072e60 con 0x7fbd28159750 2023-10-18T12:41:54.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.289+0000 7fbd1effd700 1 -- 172.21.15.114:0/2685878407 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fbd2000ac40 con 0x7fbd28159750 2023-10-18T12:41:54.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.293+0000 7fbd1effd700 1 --2- 172.21.15.114:0/2685878407 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fbd0c0656f0 0x7fbd0c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:54.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.293+0000 7fbd1effd700 1 -- 172.21.15.114:0/2685878407 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7fbd20083140 con 0x7fbd28159750 2023-10-18T12:41:54.297 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.293+0000 7fbd2e2c0700 1 --2- 172.21.15.114:0/2685878407 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fbd0c0656f0 0x7fbd0c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:54.298 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.293+0000 7fbd2e2c0700 1 --2- 172.21.15.114:0/2685878407 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fbd0c0656f0 0x7fbd0c067bb0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fbd240090b0 tx=0x7fbd2401c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:54.302 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.297+0000 7fbd1effd700 1 -- 172.21.15.114:0/2685878407 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fbd200508d0 con 0x7fbd28159750 2023-10-18T12:41:54.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.521+0000 7fbd2f2c2700 1 -- 172.21.15.114:0/2685878407 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbd280c9be0 con 0x7fbd28159750 2023-10-18T12:41:54.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.525+0000 7fbd1effd700 1 -- 172.21.15.114:0/2685878407 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4889 (secure 0 0 0) 0x7fbd20053ef0 con 0x7fbd28159750 2023-10-18T12:41:54.529 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:41:54.530 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2034957068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2034957068},{"type":"v1","addr":"172.21.15.172:6836","nonce":2034957068}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5039,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4215710360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4215710360},{"type":"v1","addr":"172.21.15.172:6837","nonce":4215710360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2387835210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2387835210},{"type":"v1","addr":"172.21.15.114:6833","nonce":2387835210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T12:21:14.159069+0000","modified":"2023-10-18T12:29:23.762500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":126,"addr":"172.21.15.114:6835/1284474820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1284474820},{"type":"v1","addr":"172.21.15.114:6835","nonce":1284474820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-18T12:41:54.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.525+0000 7fbd2f2c2700 1 -- 172.21.15.114:0/2685878407 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fbd0c0656f0 msgr2=0x7fbd0c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:54.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.525+0000 7fbd2f2c2700 1 --2- 172.21.15.114:0/2685878407 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fbd0c0656f0 0x7fbd0c067bb0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fbd240090b0 tx=0x7fbd2401c040 comp rx=0 tx=0).stop 2023-10-18T12:41:54.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.525+0000 7fbd2f2c2700 1 -- 172.21.15.114:0/2685878407 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd28159750 msgr2=0x7fbd28152660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:54.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.525+0000 7fbd2f2c2700 1 --2- 172.21.15.114:0/2685878407 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd28159750 0x7fbd28152660 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000cc20 tx=0x7fbd2000cf30 comp rx=0 tx=0).stop 2023-10-18T12:41:54.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.525+0000 7fbd2f2c2700 1 -- 172.21.15.114:0/2685878407 shutdown_connections 2023-10-18T12:41:54.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.525+0000 7fbd2f2c2700 1 --2- 172.21.15.114:0/2685878407 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fbd0c0656f0 0x7fbd0c067bb0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:54.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.525+0000 7fbd2f2c2700 1 --2- 172.21.15.114:0/2685878407 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fbd280ce040 0x7fbd28151640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:54.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.525+0000 7fbd2f2c2700 1 --2- 172.21.15.114:0/2685878407 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbd28159750 0x7fbd28152660 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:54.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.525+0000 7fbd2f2c2700 1 --2- 172.21.15.114:0/2685878407 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbd28070aa0 0x7fbd280c6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:54.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.525+0000 7fbd2f2c2700 1 -- 172.21.15.114:0/2685878407 >> 172.21.15.114:0/2685878407 conn(0x7fbd280ce5c0 msgr2=0x7fbd2806ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:54.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.529+0000 7fbd2f2c2700 1 -- 172.21.15.114:0/2685878407 shutdown_connections 2023-10-18T12:41:54.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.529+0000 7fbd2f2c2700 1 -- 172.21.15.114:0/2685878407 wait complete. 2023-10-18T12:41:54.535 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 20 2023-10-18T12:41:54.553 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T12:41:54.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.721+0000 7f39a4471700 1 Processor -- start 2023-10-18T12:41:54.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.721+0000 7f39a4471700 1 -- start start 2023-10-18T12:41:54.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.721+0000 7f39a4471700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f399c155420 0x7f399c0cb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:54.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.721+0000 7f39a4471700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f399c15bf00 0x7f399c0cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:54.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.721+0000 7f39a4471700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f399c0cbc80 con 0x7f399c0b0f90 2023-10-18T12:41:54.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.721+0000 7f39a4471700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f399c155800 con 0x7f399c155420 2023-10-18T12:41:54.728 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.721+0000 7f39a4471700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f399c0cb9a0 con 0x7f399c15bf00 2023-10-18T12:41:54.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.721+0000 7f39a2a0e700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f399c0b0f90 0x7f399c0cc680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:60338/0 (socket says 172.21.15.114:60338) 2023-10-18T12:41:54.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.725+0000 7f39a2a0e700 1 -- 172.21.15.114:0/2274518098 learned_addr learned my addr 172.21.15.114:0/2274518098 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:41:54.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.725+0000 7f39a220d700 1 --2- 172.21.15.114:0/2274518098 >> v2:172.21.15.114:3300/0 conn(0x7f399c155420 0x7f399c0cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:54.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.725+0000 7f39a1a0c700 1 --2- 172.21.15.114:0/2274518098 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f399c15bf00 0x7f399c0cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:54.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.725+0000 7f39a120b700 1 -- 172.21.15.114:0/2274518098 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 582675701 0 0) 0x7f399c0cbc80 con 0x7f399c0b0f90 2023-10-18T12:41:54.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.725+0000 7f39a120b700 1 -- 172.21.15.114:0/2274518098 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39880035d0 con 0x7f399c0b0f90 2023-10-18T12:41:54.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.725+0000 7f39a1a0c700 1 -- 172.21.15.114:0/2274518098 >> v2:172.21.15.114:3300/0 conn(0x7f399c155420 msgr2=0x7f399c0cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:41:54.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.725+0000 7f39a1a0c700 1 --2- 172.21.15.114:0/2274518098 >> v2:172.21.15.114:3300/0 conn(0x7f399c155420 0x7f399c0cb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:54.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.725+0000 7f39a1a0c700 1 -- 172.21.15.114:0/2274518098 >> v1:172.21.15.114:6789/0 conn(0x7f399c0b0f90 legacy=0x7f399c0cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:54.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.725+0000 7f39a1a0c700 1 -- 172.21.15.114:0/2274518098 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f399c15b420 con 0x7f399c15bf00 2023-10-18T12:41:54.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.725+0000 7f39a1a0c700 1 --2- 172.21.15.114:0/2274518098 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f399c15bf00 0x7f399c0cdc10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f398c009850 tx=0x7f398c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ceff4e18fac6c30b server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:54.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.725+0000 7f39a120b700 1 -- 172.21.15.114:0/2274518098 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398c011830 con 0x7f399c15bf00 2023-10-18T12:41:54.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.725+0000 7f39a120b700 1 -- 172.21.15.114:0/2274518098 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f398c011990 con 0x7f399c15bf00 2023-10-18T12:41:54.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.725+0000 7f39a120b700 1 -- 172.21.15.114:0/2274518098 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398c011d40 con 0x7f399c15bf00 2023-10-18T12:41:54.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.725+0000 7f39a4471700 1 -- 172.21.15.114:0/2274518098 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f399c15bf00 msgr2=0x7f399c0cdc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:54.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.725+0000 7f39a4471700 1 --2- 172.21.15.114:0/2274518098 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f399c15bf00 0x7f399c0cdc10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f398c009850 tx=0x7f398c009b60 comp rx=0 tx=0).stop 2023-10-18T12:41:54.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.729+0000 7f39a4471700 1 -- 172.21.15.114:0/2274518098 shutdown_connections 2023-10-18T12:41:54.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.729+0000 7f39a4471700 1 --2- 172.21.15.114:0/2274518098 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f399c15bf00 0x7f399c0cdc10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:54.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.729+0000 7f39a4471700 1 --2- 172.21.15.114:0/2274518098 >> v2:172.21.15.114:3300/0 conn(0x7f399c155420 0x7f399c0cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:54.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.729+0000 7f39a4471700 1 -- 172.21.15.114:0/2274518098 >> 172.21.15.114:0/2274518098 conn(0x7f399c06a340 msgr2=0x7f399c0b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:54.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.729+0000 7f39a4471700 1 -- 172.21.15.114:0/2274518098 shutdown_connections 2023-10-18T12:41:54.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.729+0000 7f39a4471700 1 -- 172.21.15.114:0/2274518098 wait complete. 2023-10-18T12:41:54.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.729+0000 7f39a4471700 1 Processor -- start 2023-10-18T12:41:54.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.729+0000 7f39a4471700 1 -- start start 2023-10-18T12:41:54.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.733+0000 7f39a4471700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f399c0b0f90 0x7f399c1efb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:54.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.733+0000 7f39a4471700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f399c155420 0x7f399c0c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:54.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.733+0000 7f39a4471700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f399c15bf00 0x7f399c1f1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:54.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.733+0000 7f39a4471700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f399c0c8460 con 0x7f399c0b0f90 2023-10-18T12:41:54.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.733+0000 7f39a4471700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f399c1f0040 con 0x7f399c155420 2023-10-18T12:41:54.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.733+0000 7f39a4471700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f399c0c86d0 con 0x7f399c15bf00 2023-10-18T12:41:54.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.733+0000 7f39a220d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f399c0b0f90 0x7f399c1efb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:54.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.733+0000 7f39a220d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f399c0b0f90 0x7f399c1efb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:39828/0 (socket says 172.21.15.114:39828) 2023-10-18T12:41:54.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.733+0000 7f39a220d700 1 -- 172.21.15.114:0/2122759468 learned_addr learned my addr 172.21.15.114:0/2122759468 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:41:54.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.733+0000 7f39a2a0e700 1 --2- 172.21.15.114:0/2122759468 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f399c15bf00 0x7f399c1f1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:54.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.733+0000 7f39a1a0c700 1 --2- 172.21.15.114:0/2122759468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f399c155420 0x7f399c0c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:54.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.733+0000 7f39a220d700 1 -- 172.21.15.114:0/2122759468 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f399c15bf00 msgr2=0x7f399c1f1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:54.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.733+0000 7f39a220d700 1 --2- 172.21.15.114:0/2122759468 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f399c15bf00 0x7f399c1f1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:54.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.733+0000 7f39a220d700 1 -- 172.21.15.114:0/2122759468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f399c155420 msgr2=0x7f399c0c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:54.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.733+0000 7f39a220d700 1 --2- 172.21.15.114:0/2122759468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f399c155420 0x7f399c0c91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:54.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.733+0000 7f39a220d700 1 -- 172.21.15.114:0/2122759468 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398c0094b0 con 0x7f399c0b0f90 2023-10-18T12:41:54.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.733+0000 7f39a1a0c700 1 --2- 172.21.15.114:0/2122759468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f399c155420 0x7f399c0c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:41:54.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.733+0000 7f39a220d700 1 --2- 172.21.15.114:0/2122759468 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f399c0b0f90 0x7f399c1efb00 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f399800e840 tx=0x7f399800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:54.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.733+0000 7f3992ffd700 1 -- 172.21.15.114:0/2122759468 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39980095a0 con 0x7f399c0b0f90 2023-10-18T12:41:54.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.733+0000 7f3992ffd700 1 -- 172.21.15.114:0/2122759468 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3998013680 con 0x7f399c0b0f90 2023-10-18T12:41:54.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.733+0000 7f3992ffd700 1 -- 172.21.15.114:0/2122759468 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39980139f0 con 0x7f399c0b0f90 2023-10-18T12:41:54.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.733+0000 7f39a4471700 1 -- 172.21.15.114:0/2122759468 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f399c0c89b0 con 0x7f399c0b0f90 2023-10-18T12:41:54.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.733+0000 7f39a4471700 1 -- 172.21.15.114:0/2122759468 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f399c1f4620 con 0x7f399c0b0f90 2023-10-18T12:41:54.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.737+0000 7f39a4471700 1 -- 172.21.15.114:0/2122759468 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f399c072e60 con 0x7f399c0b0f90 2023-10-18T12:41:54.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.737+0000 7f3992ffd700 1 -- 172.21.15.114:0/2122759468 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f3998013b50 con 0x7f399c0b0f90 2023-10-18T12:41:54.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.741+0000 7f3992ffd700 1 --2- 172.21.15.114:0/2122759468 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f3980065740 0x7f3980067c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:54.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.741+0000 7f3992ffd700 1 -- 172.21.15.114:0/2122759468 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7f3998082ea0 con 0x7f399c0b0f90 2023-10-18T12:41:54.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.741+0000 7f39a1a0c700 1 --2- 172.21.15.114:0/2122759468 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f3980065740 0x7f3980067c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:54.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.741+0000 7f39a1a0c700 1 --2- 172.21.15.114:0/2122759468 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f3980065740 0x7f3980067c00 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f398c0090b0 tx=0x7f398c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:54.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.745+0000 7f3992ffd700 1 -- 172.21.15.114:0/2122759468 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f3998054240 con 0x7f399c0b0f90 2023-10-18T12:41:54.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.925+0000 7f39a4471700 1 -- 172.21.15.114:0/2122759468 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f399c060da0 con 0x7f399c0b0f90 2023-10-18T12:41:54.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.929+0000 7f3992ffd700 1 -- 172.21.15.114:0/2122759468 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+19138 (secure 0 0 0) 0x7f3998053dd0 con 0x7f399c0b0f90 2023-10-18T12:41:54.933 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:41:54.933 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":60,"fsid":"240ea340-5d3d-4f52-a4bc-af075aca3deb","created":"2023-10-18T12:19:12.512994+0000","modified":"2023-10-18T12:30:22.735724+0000","last_up_change":"2023-10-18T12:29:29.654825+0000","last_in_change":"2023-10-18T12:19:15.850693+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T12:19:27.040638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-18T12:19:32.358094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-18T12:21:12.105324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-18T12:21:13.154105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c3578978-1a03-4857-b9d2-34a5da3d7731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":49,"up_from":56,"up_thru":57,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1953670272},{"type":"v1","addr":"172.21.15.114:6817","nonce":1953670272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1953670272},{"type":"v1","addr":"172.21.15.114:6820","nonce":1953670272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1953670272},{"type":"v1","addr":"172.21.15.114:6830","nonce":1953670272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":1953670272},{"type":"v1","addr":"172.21.15.114:6825","nonce":1953670272}]},"public_addr":"172.21.15.114:6817/1953670272","cluster_addr":"172.21.15.114:6820/1953670272","heartbeat_back_addr":"172.21.15.114:6830/1953670272","heartbeat_front_addr":"172.21.15.114:6825/1953670272","state":["exists","up"]},{"osd":1,"uuid":"43eb26a6-e2b3-4670-9559-bd053b5140d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6801","nonce":3302727047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6803","nonce":3302727047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6807","nonce":3302727047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6805","nonce":3302727047}]},"public_addr":"172.21.15.114:6801/3302727047","cluster_addr":"172.21.15.114:6803/3302727047","heartbeat_back_addr":"172.21.15.114:6807/3302727047","heartbeat_front_addr":"172.21.15.114:6805/3302727047","state":["exists","up"]},{"osd":2,"uuid":"f3d4dbd5-521c-4dd2-b687-5768cc7d0938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6809","nonce":2699151351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6811","nonce":2699151351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6815","nonce":2699151351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6813","nonce":2699151351}]},"public_addr":"172.21.15.114:6809/2699151351","cluster_addr":"172.21.15.114:6811/2699151351","heartbeat_back_addr":"172.21.15.114:6815/2699151351","heartbeat_front_addr":"172.21.15.114:6813/2699151351","state":["exists","up"]},{"osd":3,"uuid":"823e5802-92b7-4f0d-b32d-a5748993f1b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6821","nonce":1361608073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6824","nonce":1361608073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6829","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6831","nonce":1361608073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6827","nonce":1361608073}]},"public_addr":"172.21.15.114:6821/1361608073","cluster_addr":"172.21.15.114:6824/1361608073","heartbeat_back_addr":"172.21.15.114:6831/1361608073","heartbeat_front_addr":"172.21.15.114:6827/1361608073","state":["exists","up"]},{"osd":4,"uuid":"e47fb93e-13b4-44a4-b084-8c4384ceb41e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6801","nonce":930839681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6803","nonce":930839681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6807","nonce":930839681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6805","nonce":930839681}]},"public_addr":"172.21.15.172:6801/930839681","cluster_addr":"172.21.15.172:6803/930839681","heartbeat_back_addr":"172.21.15.172:6807/930839681","heartbeat_front_addr":"172.21.15.172:6805/930839681","state":["exists","up"]},{"osd":5,"uuid":"7561a973-f479-45a0-af40-f324728d622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6814","nonce":571761850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6818","nonce":571761850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6824","nonce":571761850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6821","nonce":571761850}]},"public_addr":"172.21.15.172:6814/571761850","cluster_addr":"172.21.15.172:6818/571761850","heartbeat_back_addr":"172.21.15.172:6824/571761850","heartbeat_front_addr":"172.21.15.172:6821/571761850","state":["exists","up"]},{"osd":6,"uuid":"51753f4b-7f06-4f1c-9ec7-6e18a66eb980","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6825","nonce":1680398853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6827","nonce":1680398853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6831","nonce":1680398853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6829","nonce":1680398853}]},"public_addr":"172.21.15.172:6825/1680398853","cluster_addr":"172.21.15.172:6827/1680398853","heartbeat_back_addr":"172.21.15.172:6831/1680398853","heartbeat_front_addr":"172.21.15.172:6829/1680398853","state":["exists","up"]},{"osd":7,"uuid":"4d8b1e15-143d-4d17-9074-59d92f0f9af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6809","nonce":349710101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6811","nonce":349710101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6819","nonce":349710101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6815","nonce":349710101}]},"public_addr":"172.21.15.172:6809/349710101","cluster_addr":"172.21.15.172:6811/349710101","heartbeat_back_addr":"172.21.15.172:6819/349710101","heartbeat_front_addr":"172.21.15.172:6815/349710101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"2023-10-18T12:21:50.537022+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.889460+0000","dead_epoch":50},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.475494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.911473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.648596+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.609994+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.636248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.854589+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.885826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.5","mappings":[{"from":7,"to":0}]},{"pgid":"6.9","mappings":[{"from":7,"to":2}]},{"pgid":"6.c","mappings":[{"from":3,"to":0}]},{"pgid":"6.11","mappings":[{"from":3,"to":2}]},{"pgid":"6.1d","mappings":[{"from":5,"to":0}]},{"pgid":"7.12","mappings":[{"from":6,"to":4}]},{"pgid":"7.2d","mappings":[{"from":0,"to":4}]},{"pgid":"7.30","mappings":[{"from":6,"to":4}]},{"pgid":"7.35","mappings":[{"from":0,"to":5}]},{"pgid":"7.36","mappings":[{"from":6,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:0/1817588655":"2023-10-18T13:29:19.822093+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T12:41:54.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.929+0000 7f39a4471700 1 -- 172.21.15.114:0/2122759468 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f3980065740 msgr2=0x7f3980067c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:54.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.929+0000 7f39a4471700 1 --2- 172.21.15.114:0/2122759468 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f3980065740 0x7f3980067c00 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f398c0090b0 tx=0x7f398c008030 comp rx=0 tx=0).stop 2023-10-18T12:41:54.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.929+0000 7f39a4471700 1 -- 172.21.15.114:0/2122759468 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f399c0b0f90 msgr2=0x7f399c1efb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:54.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.929+0000 7f39a4471700 1 --2- 172.21.15.114:0/2122759468 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f399c0b0f90 0x7f399c1efb00 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f399800e840 tx=0x7f399800eb50 comp rx=0 tx=0).stop 2023-10-18T12:41:54.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.929+0000 7f39a4471700 1 -- 172.21.15.114:0/2122759468 shutdown_connections 2023-10-18T12:41:54.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.929+0000 7f39a4471700 1 --2- 172.21.15.114:0/2122759468 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f3980065740 0x7f3980067c00 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:54.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.929+0000 7f39a4471700 1 --2- 172.21.15.114:0/2122759468 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f399c15bf00 0x7f399c1f1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:54.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.929+0000 7f39a4471700 1 --2- 172.21.15.114:0/2122759468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f399c155420 0x7f399c0c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:54.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.929+0000 7f39a4471700 1 --2- 172.21.15.114:0/2122759468 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f399c0b0f90 0x7f399c1efb00 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:54.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.929+0000 7f39a4471700 1 -- 172.21.15.114:0/2122759468 >> 172.21.15.114:0/2122759468 conn(0x7f399c06a340 msgr2=0x7f399c0ccf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:54.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.929+0000 7f39a4471700 1 -- 172.21.15.114:0/2122759468 shutdown_connections 2023-10-18T12:41:54.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:54.929+0000 7f39a4471700 1 -- 172.21.15.114:0/2122759468 wait complete. 2023-10-18T12:41:54.958 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-18T12:19:27.040638+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-18T12:19:32.358094+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-18T12:21:12.105324+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-10-18T12:21:13.154105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-18T12:41:54.958 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-18T12:41:55.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.141+0000 7fd6fa1e6700 1 Processor -- start 2023-10-18T12:41:55.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.141+0000 7fd6fa1e6700 1 -- start start 2023-10-18T12:41:55.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.141+0000 7fd6fa1e6700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd6f40ccfe0 0x7fd6f406f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:55.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.141+0000 7fd6fa1e6700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd6f406f990 0x7fd6f406fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:55.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.141+0000 7fd6fa1e6700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6f415b1d0 con 0x7fd6f415adf0 2023-10-18T12:41:55.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.141+0000 7fd6fa1e6700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6f40ca590 con 0x7fd6f406f990 2023-10-18T12:41:55.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.141+0000 7fd6fa1e6700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f40ce600 con 0x7fd6f40ccfe0 2023-10-18T12:41:55.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.141+0000 7fd6f37fe700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd6f415adf0 0x7fd6f40cc8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:59352/0 (socket says 172.21.15.114:59352) 2023-10-18T12:41:55.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.141+0000 7fd6f37fe700 1 -- 172.21.15.114:0/3475771172 learned_addr learned my addr 172.21.15.114:0/3475771172 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:41:55.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.141+0000 7fd6eaffd700 1 --2- 172.21.15.114:0/3475771172 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd6f40ccfe0 0x7fd6f406f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:55.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.141+0000 7fd6f3fff700 1 --2- 172.21.15.114:0/3475771172 >> v2:172.21.15.172:3300/0 conn(0x7fd6f406f990 0x7fd6f406fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:55.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.141+0000 7fd6f2ffd700 1 -- 172.21.15.114:0/3475771172 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2291165568 0 0) 0x7fd6e4001110 con 0x7fd6f415adf0 2023-10-18T12:41:55.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.141+0000 7fd6f2ffd700 1 -- 172.21.15.114:0/3475771172 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6e00035d0 con 0x7fd6f415adf0 2023-10-18T12:41:55.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.145+0000 7fd6f2ffd700 1 -- 172.21.15.114:0/3475771172 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3421954246 0 0) 0x7fd6e00035d0 con 0x7fd6f415adf0 2023-10-18T12:41:55.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.145+0000 7fd6f2ffd700 1 -- 172.21.15.114:0/3475771172 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd6f40ccfe0 msgr2=0x7fd6f406f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:41:55.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.145+0000 7fd6f2ffd700 1 --2- 172.21.15.114:0/3475771172 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd6f40ccfe0 0x7fd6f406f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:55.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.145+0000 7fd6f2ffd700 1 -- 172.21.15.114:0/3475771172 >> v2:172.21.15.172:3300/0 conn(0x7fd6f406f990 msgr2=0x7fd6f406fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:41:55.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.145+0000 7fd6f2ffd700 1 --2- 172.21.15.114:0/3475771172 >> v2:172.21.15.172:3300/0 conn(0x7fd6f406f990 0x7fd6f406fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:55.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.145+0000 7fd6f2ffd700 1 -- 172.21.15.114:0/3475771172 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f40cd580 con 0x7fd6f415adf0 2023-10-18T12:41:55.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.145+0000 7fd6f2ffd700 1 -- 172.21.15.114:0/3475771172 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3368469509 0 0) 0x7fd6e4001800 con 0x7fd6f415adf0 2023-10-18T12:41:55.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.145+0000 7fd6f2ffd700 1 -- 172.21.15.114:0/3475771172 >> v1:172.21.15.114:6789/0 conn(0x7fd6f415adf0 legacy=0x7fd6f40cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:55.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.145+0000 7fd6f2ffd700 1 --2- 172.21.15.114:0/3475771172 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6e0003a90 0x7fd6e0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:55.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.145+0000 7fd6f2ffd700 1 --2- 172.21.15.114:0/3475771172 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd6f40ccfe0 0x7fd6e0004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:55.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.145+0000 7fd6f2ffd700 1 --2- 172.21.15.114:0/3475771172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6e0004db0 0x7fd6e0005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:55.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.145+0000 7fd6f2ffd700 1 -- 172.21.15.114:0/3475771172 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f40ce600 con 0x7fd6e0004db0 2023-10-18T12:41:55.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.145+0000 7fd6f2ffd700 1 -- 172.21.15.114:0/3475771172 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e000ba30 con 0x7fd6e0003a90 2023-10-18T12:41:55.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.145+0000 7fd6f2ffd700 1 -- 172.21.15.114:0/3475771172 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e000bb70 con 0x7fd6f40ccfe0 2023-10-18T12:41:55.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.145+0000 7fd6f3fff700 1 --2- 172.21.15.114:0/3475771172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6e0004db0 0x7fd6e0005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:55.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.145+0000 7fd6eaffd700 1 --2- 172.21.15.114:0/3475771172 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd6f40ccfe0 0x7fd6e0004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:55.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.145+0000 7fd6f37fe700 1 --2- 172.21.15.114:0/3475771172 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6e0003a90 0x7fd6e0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:55.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.145+0000 7fd6f3fff700 1 -- 172.21.15.114:0/3475771172 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd6f40ccfe0 msgr2=0x7fd6e0004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:41:55.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.145+0000 7fd6f3fff700 1 --2- 172.21.15.114:0/3475771172 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd6f40ccfe0 0x7fd6e0004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:55.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.145+0000 7fd6f3fff700 1 -- 172.21.15.114:0/3475771172 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6e0003a90 msgr2=0x7fd6e0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:41:55.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.145+0000 7fd6f3fff700 1 --2- 172.21.15.114:0/3475771172 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6e0003a90 0x7fd6e0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:55.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.145+0000 7fd6f3fff700 1 -- 172.21.15.114:0/3475771172 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e00035d0 con 0x7fd6e0004db0 2023-10-18T12:41:55.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.145+0000 7fd6f37fe700 1 --2- 172.21.15.114:0/3475771172 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6e0003a90 0x7fd6e0003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:41:55.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.145+0000 7fd6f3fff700 1 --2- 172.21.15.114:0/3475771172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6e0004db0 0x7fd6e0005230 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec00e170 tx=0x7fd6e00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98bc79d998d7ed95 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:55.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.145+0000 7fd6f2ffd700 1 -- 172.21.15.114:0/3475771172 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec00ec90 con 0x7fd6e0004db0 2023-10-18T12:41:55.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.145+0000 7fd6f2ffd700 1 -- 172.21.15.114:0/3475771172 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6ec00f040 con 0x7fd6e0004db0 2023-10-18T12:41:55.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.145+0000 7fd6f2ffd700 1 -- 172.21.15.114:0/3475771172 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec014480 con 0x7fd6e0004db0 2023-10-18T12:41:55.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.145+0000 7fd6fa1e6700 1 -- 172.21.15.114:0/3475771172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6e0004db0 msgr2=0x7fd6e0005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:55.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.145+0000 7fd6fa1e6700 1 --2- 172.21.15.114:0/3475771172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6e0004db0 0x7fd6e0005230 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec00e170 tx=0x7fd6e00058a0 comp rx=0 tx=0).stop 2023-10-18T12:41:55.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.145+0000 7fd6f3fff700 1 -- 172.21.15.114:0/3475771172 reap_dead start 2023-10-18T12:41:55.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.149+0000 7fd6fa1e6700 1 -- 172.21.15.114:0/3475771172 shutdown_connections 2023-10-18T12:41:55.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.149+0000 7fd6fa1e6700 1 -- 172.21.15.114:0/3475771172 >> 172.21.15.114:0/3475771172 conn(0x7fd6f40ce820 msgr2=0x7fd6f40cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:55.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.149+0000 7fd6fa1e6700 1 -- 172.21.15.114:0/3475771172 shutdown_connections 2023-10-18T12:41:55.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.149+0000 7fd6fa1e6700 1 -- 172.21.15.114:0/3475771172 wait complete. 2023-10-18T12:41:55.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.149+0000 7fd6fa1e6700 1 Processor -- start 2023-10-18T12:41:55.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.149+0000 7fd6fa1e6700 1 -- start start 2023-10-18T12:41:55.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.153+0000 7fd6fa1e6700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6e0004db0 0x7fd6f414fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:55.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.153+0000 7fd6fa1e6700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6f415b370 0x7fd6f41e4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:55.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.153+0000 7fd6fa1e6700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd6f406d970 0x7fd6f406de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:55.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.153+0000 7fd6fa1e6700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f406e340 con 0x7fd6f415b370 2023-10-18T12:41:55.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.153+0000 7fd6fa1e6700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f40c7450 con 0x7fd6e0004db0 2023-10-18T12:41:55.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.153+0000 7fd6fa1e6700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f41e3980 con 0x7fd6f406d970 2023-10-18T12:41:55.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.153+0000 7fd6eaffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6f415b370 0x7fd6f41e4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:55.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.153+0000 7fd6eaffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6f415b370 0x7fd6f41e4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44242/0 (socket says 172.21.15.114:44242) 2023-10-18T12:41:55.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.153+0000 7fd6eaffd700 1 -- 172.21.15.114:0/12951477 learned_addr learned my addr 172.21.15.114:0/12951477 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:41:55.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.153+0000 7fd6f37fe700 1 --2- 172.21.15.114:0/12951477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6e0004db0 0x7fd6f414fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:55.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.153+0000 7fd6f3fff700 1 --2- 172.21.15.114:0/12951477 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd6f406d970 0x7fd6f406de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:55.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.153+0000 7fd6eaffd700 1 -- 172.21.15.114:0/12951477 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd6f406d970 msgr2=0x7fd6f406de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:55.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.153+0000 7fd6eaffd700 1 --2- 172.21.15.114:0/12951477 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd6f406d970 0x7fd6f406de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:55.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.153+0000 7fd6eaffd700 1 -- 172.21.15.114:0/12951477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6e0004db0 msgr2=0x7fd6f414fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:55.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.153+0000 7fd6eaffd700 1 --2- 172.21.15.114:0/12951477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6e0004db0 0x7fd6f414fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:55.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.153+0000 7fd6eaffd700 1 -- 172.21.15.114:0/12951477 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f41e3c60 con 0x7fd6f415b370 2023-10-18T12:41:55.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.153+0000 7fd6f3fff700 1 --2- 172.21.15.114:0/12951477 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd6f406d970 0x7fd6f406de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:41:55.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.153+0000 7fd6eaffd700 1 --2- 172.21.15.114:0/12951477 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6f415b370 0x7fd6f41e4f20 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc0116d0 tx=0x7fd6dc011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:55.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.153+0000 7fd6f0ff9700 1 -- 172.21.15.114:0/12951477 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc015870 con 0x7fd6f415b370 2023-10-18T12:41:55.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.153+0000 7fd6f0ff9700 1 -- 172.21.15.114:0/12951477 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6dc0159d0 con 0x7fd6f415b370 2023-10-18T12:41:55.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.153+0000 7fd6fa1e6700 1 -- 172.21.15.114:0/12951477 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6f41e3f40 con 0x7fd6f415b370 2023-10-18T12:41:55.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.153+0000 7fd6f0ff9700 1 -- 172.21.15.114:0/12951477 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc015d40 con 0x7fd6f415b370 2023-10-18T12:41:55.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.153+0000 7fd6fa1e6700 1 -- 172.21.15.114:0/12951477 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f4150310 con 0x7fd6f415b370 2023-10-18T12:41:55.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.153+0000 7fd6fa1e6700 1 -- 172.21.15.114:0/12951477 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6f40c7650 con 0x7fd6f415b370 2023-10-18T12:41:55.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.157+0000 7fd6f0ff9700 1 -- 172.21.15.114:0/12951477 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fd6dc013400 con 0x7fd6f415b370 2023-10-18T12:41:55.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.157+0000 7fd6f0ff9700 1 --2- 172.21.15.114:0/12951477 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd6d40656f0 0x7fd6d4067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:55.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.157+0000 7fd6f0ff9700 1 -- 172.21.15.114:0/12951477 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7fd6dc0838f0 con 0x7fd6f415b370 2023-10-18T12:41:55.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.157+0000 7fd6f37fe700 1 --2- 172.21.15.114:0/12951477 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd6d40656f0 0x7fd6d4067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:55.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.161+0000 7fd6f37fe700 1 --2- 172.21.15.114:0/12951477 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd6d40656f0 0x7fd6d4067bb0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd6e40012b0 tx=0x7fd6e400a040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:55.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.165+0000 7fd6f0ff9700 1 -- 172.21.15.114:0/12951477 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fd6f40c7650 con 0x7fd6f415b370 2023-10-18T12:41:55.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.341+0000 7fd6fa1e6700 1 -- 172.21.15.114:0/12951477 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd6f40c7610 con 0x7fd6f415b370 2023-10-18T12:41:55.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.341+0000 7fd6f0ff9700 1 -- 172.21.15.114:0/12951477 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd6dc054bc0 con 0x7fd6f415b370 2023-10-18T12:41:55.347 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 1 2023-10-18T12:41:55.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.345+0000 7fd6fa1e6700 1 -- 172.21.15.114:0/12951477 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd6d40656f0 msgr2=0x7fd6d4067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:55.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.345+0000 7fd6fa1e6700 1 --2- 172.21.15.114:0/12951477 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd6d40656f0 0x7fd6d4067bb0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd6e40012b0 tx=0x7fd6e400a040 comp rx=0 tx=0).stop 2023-10-18T12:41:55.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.345+0000 7fd6fa1e6700 1 -- 172.21.15.114:0/12951477 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6f415b370 msgr2=0x7fd6f41e4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:55.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.345+0000 7fd6fa1e6700 1 --2- 172.21.15.114:0/12951477 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6f415b370 0x7fd6f41e4f20 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc0116d0 tx=0x7fd6dc011a90 comp rx=0 tx=0).stop 2023-10-18T12:41:55.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.345+0000 7fd6fa1e6700 1 -- 172.21.15.114:0/12951477 shutdown_connections 2023-10-18T12:41:55.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.345+0000 7fd6fa1e6700 1 --2- 172.21.15.114:0/12951477 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd6d40656f0 0x7fd6d4067bb0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:55.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.345+0000 7fd6fa1e6700 1 --2- 172.21.15.114:0/12951477 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd6f406d970 0x7fd6f406de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:55.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.345+0000 7fd6fa1e6700 1 --2- 172.21.15.114:0/12951477 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd6f415b370 0x7fd6f41e4f20 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:55.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.345+0000 7fd6fa1e6700 1 --2- 172.21.15.114:0/12951477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6e0004db0 0x7fd6f414fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:55.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.345+0000 7fd6fa1e6700 1 -- 172.21.15.114:0/12951477 >> 172.21.15.114:0/12951477 conn(0x7fd6f40ce820 msgr2=0x7fd6f4159700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:55.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.345+0000 7fd6fa1e6700 1 -- 172.21.15.114:0/12951477 shutdown_connections 2023-10-18T12:41:55.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.345+0000 7fd6fa1e6700 1 -- 172.21.15.114:0/12951477 wait complete. 2023-10-18T12:41:55.370 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-18T12:41:55.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.553+0000 7fd2a0bae700 1 Processor -- start 2023-10-18T12:41:55.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.553+0000 7fd2a0bae700 1 -- start start 2023-10-18T12:41:55.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.553+0000 7fd2a0bae700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd29c15adf0 0x7fd29c0cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:55.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.553+0000 7fd2a0bae700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd29c15b1d0 con 0x7fd29c0cce10 2023-10-18T12:41:55.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.553+0000 7fd2a0bae700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd29c0ce600 con 0x7fd29c070460 2023-10-18T12:41:55.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.553+0000 7fd2a0bae700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd29c0ca590 con 0x7fd29c15adf0 2023-10-18T12:41:55.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.557+0000 7fd299d9b700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd29c0cce10 0x7fd29c0b1940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:59356/0 (socket says 172.21.15.114:59356) 2023-10-18T12:41:55.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.557+0000 7fd299d9b700 1 -- 172.21.15.114:0/1192363214 learned_addr learned my addr 172.21.15.114:0/1192363214 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:41:55.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.557+0000 7fd29a59c700 1 --2- 172.21.15.114:0/1192363214 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd29c15adf0 0x7fd29c0cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:55.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.557+0000 7fd29959a700 1 -- 172.21.15.114:0/1192363214 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3282366710 0 0) 0x7fd290001110 con 0x7fd29c0cce10 2023-10-18T12:41:55.562 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.557+0000 7fd29959a700 1 -- 172.21.15.114:0/1192363214 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2840035d0 con 0x7fd29c0cce10 2023-10-18T12:41:55.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.557+0000 7fd29959a700 1 -- 172.21.15.114:0/1192363214 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 576123138 0 0) 0x7fd29c0ce600 con 0x7fd29c070460 2023-10-18T12:41:55.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.557+0000 7fd29959a700 1 -- 172.21.15.114:0/1192363214 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd290001110 con 0x7fd29c070460 2023-10-18T12:41:55.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.557+0000 7fd29a59c700 1 -- 172.21.15.114:0/1192363214 >> v1:172.21.15.172:6789/0 conn(0x7fd29c070460 legacy=0x7fd29c0b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:55.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.557+0000 7fd29959a700 1 -- 172.21.15.114:0/1192363214 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3862362802 0 0) 0x7fd2840035d0 con 0x7fd29c0cce10 2023-10-18T12:41:55.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.557+0000 7fd29a59c700 1 -- 172.21.15.114:0/1192363214 >> v1:172.21.15.114:6789/0 conn(0x7fd29c0cce10 legacy=0x7fd29c0b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:55.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.557+0000 7fd29a59c700 1 -- 172.21.15.114:0/1192363214 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd29c0cd580 con 0x7fd29c15adf0 2023-10-18T12:41:55.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.557+0000 7fd29a59c700 1 --2- 172.21.15.114:0/1192363214 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd29c15adf0 0x7fd29c0cc8d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd28c009880 tx=0x7fd28c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9369aba1af632de server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:55.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.557+0000 7fd29959a700 1 -- 172.21.15.114:0/1192363214 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd290001800 con 0x7fd29c15adf0 2023-10-18T12:41:55.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.557+0000 7fd29959a700 1 -- 172.21.15.114:0/1192363214 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28c004030 con 0x7fd29c15adf0 2023-10-18T12:41:55.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.557+0000 7fd29959a700 1 -- 172.21.15.114:0/1192363214 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28c0043c0 con 0x7fd29c15adf0 2023-10-18T12:41:55.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.557+0000 7fd2a0bae700 1 -- 172.21.15.114:0/1192363214 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd29c15adf0 msgr2=0x7fd29c0cc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:55.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.557+0000 7fd2a0bae700 1 --2- 172.21.15.114:0/1192363214 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd29c15adf0 0x7fd29c0cc8d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd28c009880 tx=0x7fd28c009b90 comp rx=0 tx=0).stop 2023-10-18T12:41:55.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.561+0000 7fd2a0bae700 1 -- 172.21.15.114:0/1192363214 shutdown_connections 2023-10-18T12:41:55.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.561+0000 7fd2a0bae700 1 --2- 172.21.15.114:0/1192363214 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd29c15adf0 0x7fd29c0cc8d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:55.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.561+0000 7fd2a0bae700 1 -- 172.21.15.114:0/1192363214 >> 172.21.15.114:0/1192363214 conn(0x7fd29c0ce820 msgr2=0x7fd29c0cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:55.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.561+0000 7fd2a0bae700 1 -- 172.21.15.114:0/1192363214 shutdown_connections 2023-10-18T12:41:55.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.561+0000 7fd2a0bae700 1 -- 172.21.15.114:0/1192363214 wait complete. 2023-10-18T12:41:55.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.561+0000 7fd2a0bae700 1 Processor -- start 2023-10-18T12:41:55.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.565+0000 7fd2a0bae700 1 -- start start 2023-10-18T12:41:55.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.565+0000 7fd2a0bae700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd29c070460 0x7fd29c0a93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:55.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.565+0000 7fd2a0bae700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd29c0cce10 0x7fd29c155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:55.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.565+0000 7fd2a0bae700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd29c15adf0 0x7fd29c156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:55.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.565+0000 7fd2a0bae700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd29c0a7830 con 0x7fd29c0cce10 2023-10-18T12:41:55.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.565+0000 7fd2a0bae700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd29c156740 con 0x7fd29c070460 2023-10-18T12:41:55.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.565+0000 7fd2a0bae700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd29c0ad1f0 con 0x7fd29c15adf0 2023-10-18T12:41:55.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.565+0000 7fd299d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd29c0cce10 0x7fd29c155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:55.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.565+0000 7fd299d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd29c0cce10 0x7fd29c155cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44258/0 (socket says 172.21.15.114:44258) 2023-10-18T12:41:55.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.565+0000 7fd299d9b700 1 -- 172.21.15.114:0/120116945 learned_addr learned my addr 172.21.15.114:0/120116945 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:41:55.572 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.565+0000 7fd29a59c700 1 --2- 172.21.15.114:0/120116945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd29c070460 0x7fd29c0a93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:55.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.565+0000 7fd29ad9d700 1 --2- 172.21.15.114:0/120116945 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd29c15adf0 0x7fd29c156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:55.573 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.565+0000 7fd299d9b700 1 -- 172.21.15.114:0/120116945 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd29c15adf0 msgr2=0x7fd29c156200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:55.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.565+0000 7fd299d9b700 1 --2- 172.21.15.114:0/120116945 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd29c15adf0 0x7fd29c156200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:55.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.565+0000 7fd299d9b700 1 -- 172.21.15.114:0/120116945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd29c070460 msgr2=0x7fd29c0a93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:55.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.565+0000 7fd299d9b700 1 --2- 172.21.15.114:0/120116945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd29c070460 0x7fd29c0a93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:55.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.565+0000 7fd299d9b700 1 -- 172.21.15.114:0/120116945 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd28c0094b0 con 0x7fd29c0cce10 2023-10-18T12:41:55.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.565+0000 7fd299d9b700 1 --2- 172.21.15.114:0/120116945 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd29c0cce10 0x7fd29c155cc0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fd29000cad0 tx=0x7fd29000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:55.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.565+0000 7fd28affd700 1 -- 172.21.15.114:0/120116945 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd290004ca0 con 0x7fd29c0cce10 2023-10-18T12:41:55.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.565+0000 7fd28affd700 1 -- 172.21.15.114:0/120116945 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd290004e20 con 0x7fd29c0cce10 2023-10-18T12:41:55.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.565+0000 7fd2a0bae700 1 -- 172.21.15.114:0/120116945 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd29c0a74e0 con 0x7fd29c0cce10 2023-10-18T12:41:55.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.565+0000 7fd28affd700 1 -- 172.21.15.114:0/120116945 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd290007310 con 0x7fd29c0cce10 2023-10-18T12:41:55.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.565+0000 7fd2a0bae700 1 -- 172.21.15.114:0/120116945 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd29c0abee0 con 0x7fd29c0cce10 2023-10-18T12:41:55.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.569+0000 7fd2a0bae700 1 -- 172.21.15.114:0/120116945 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd29c0a7970 con 0x7fd29c0cce10 2023-10-18T12:41:55.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.569+0000 7fd28affd700 1 -- 172.21.15.114:0/120116945 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fd290007470 con 0x7fd29c0cce10 2023-10-18T12:41:55.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.573+0000 7fd28affd700 1 --2- 172.21.15.114:0/120116945 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd27c0656f0 0x7fd27c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:55.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.573+0000 7fd28affd700 1 -- 172.21.15.114:0/120116945 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7fd2900821e0 con 0x7fd29c0cce10 2023-10-18T12:41:55.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.573+0000 7fd29a59c700 1 --2- 172.21.15.114:0/120116945 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd27c0656f0 0x7fd27c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:55.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.573+0000 7fd29a59c700 1 --2- 172.21.15.114:0/120116945 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd27c0656f0 0x7fd27c067bb0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd28c0090b0 tx=0x7fd28c010000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:55.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.577+0000 7fd28affd700 1 -- 172.21.15.114:0/120116945 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fd29c0a7970 con 0x7fd29c0cce10 2023-10-18T12:41:55.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.753+0000 7fd2a0bae700 1 -- 172.21.15.114:0/120116945 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd29c0a7970 con 0x7fd29c0cce10 2023-10-18T12:41:55.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.757+0000 7fd28affd700 1 -- 172.21.15.114:0/120116945 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v60) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd29c0a7970 con 0x7fd29c0cce10 2023-10-18T12:41:55.761 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 8 2023-10-18T12:41:55.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.761+0000 7fd2a0bae700 1 -- 172.21.15.114:0/120116945 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd27c0656f0 msgr2=0x7fd27c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:55.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.761+0000 7fd2a0bae700 1 --2- 172.21.15.114:0/120116945 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd27c0656f0 0x7fd27c067bb0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd28c0090b0 tx=0x7fd28c010000 comp rx=0 tx=0).stop 2023-10-18T12:41:55.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.761+0000 7fd2a0bae700 1 -- 172.21.15.114:0/120116945 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd29c0cce10 msgr2=0x7fd29c155cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:55.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.761+0000 7fd2a0bae700 1 --2- 172.21.15.114:0/120116945 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd29c0cce10 0x7fd29c155cc0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fd29000cad0 tx=0x7fd29000cde0 comp rx=0 tx=0).stop 2023-10-18T12:41:55.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.761+0000 7fd2a0bae700 1 -- 172.21.15.114:0/120116945 shutdown_connections 2023-10-18T12:41:55.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.761+0000 7fd2a0bae700 1 --2- 172.21.15.114:0/120116945 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd27c0656f0 0x7fd27c067bb0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:55.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.761+0000 7fd2a0bae700 1 --2- 172.21.15.114:0/120116945 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd29c15adf0 0x7fd29c156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:55.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.761+0000 7fd2a0bae700 1 --2- 172.21.15.114:0/120116945 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd29c0cce10 0x7fd29c155cc0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:55.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.761+0000 7fd2a0bae700 1 --2- 172.21.15.114:0/120116945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd29c070460 0x7fd29c0a93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:55.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.761+0000 7fd2a0bae700 1 -- 172.21.15.114:0/120116945 >> 172.21.15.114:0/120116945 conn(0x7fd29c0ce820 msgr2=0x7fd29c0ae340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:55.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.761+0000 7fd2a0bae700 1 -- 172.21.15.114:0/120116945 shutdown_connections 2023-10-18T12:41:55.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.761+0000 7fd2a0bae700 1 -- 172.21.15.114:0/120116945 wait complete. 2023-10-18T12:41:55.786 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-18T12:41:55.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.957+0000 7ff28a697700 1 Processor -- start 2023-10-18T12:41:55.962 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.957+0000 7ff28a697700 1 -- start start 2023-10-18T12:41:55.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.961+0000 7ff28a697700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff28406f9a0 0x7ff28406fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:55.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.961+0000 7ff28a697700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff284146ba0 con 0x7ff2840b5b80 2023-10-18T12:41:55.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.961+0000 7ff28a697700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2840d0920 con 0x7ff2841467c0 2023-10-18T12:41:55.965 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.961+0000 7ff28a697700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff284070320 con 0x7ff28406f9a0 2023-10-18T12:41:55.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.961+0000 7ff27bfff700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7ff2840b5b80 0x7ff28415d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:59368/0 (socket says 172.21.15.114:59368) 2023-10-18T12:41:55.966 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.961+0000 7ff27bfff700 1 -- 172.21.15.114:0/1287067676 learned_addr learned my addr 172.21.15.114:0/1287067676 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:41:55.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.961+0000 7ff288c34700 1 --2- 172.21.15.114:0/1287067676 >> v2:172.21.15.172:3300/0 conn(0x7ff28406f9a0 0x7ff28406fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:55.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.961+0000 7ff2837fe700 1 -- 172.21.15.114:0/1287067676 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1156016001 0 0) 0x7ff284146ba0 con 0x7ff2840b5b80 2023-10-18T12:41:55.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.961+0000 7ff2837fe700 1 -- 172.21.15.114:0/1287067676 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2700035d0 con 0x7ff2840b5b80 2023-10-18T12:41:55.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.961+0000 7ff2837fe700 1 -- 172.21.15.114:0/1287067676 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2854343495 0 0) 0x7ff2840d0920 con 0x7ff2841467c0 2023-10-18T12:41:55.967 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.961+0000 7ff288c34700 1 -- 172.21.15.114:0/1287067676 >> v1:172.21.15.172:6789/0 conn(0x7ff2841467c0 legacy=0x7ff2841612e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:55.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.961+0000 7ff288c34700 1 -- 172.21.15.114:0/1287067676 >> v1:172.21.15.114:6789/0 conn(0x7ff2840b5b80 legacy=0x7ff28415d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:55.968 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.961+0000 7ff288c34700 1 -- 172.21.15.114:0/1287067676 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2840b6160 con 0x7ff28406f9a0 2023-10-18T12:41:55.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.961+0000 7ff288c34700 1 --2- 172.21.15.114:0/1287067676 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff28406f9a0 0x7ff28406fde0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff27c009d90 tx=0x7ff27c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82a589327910d1a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:55.969 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.961+0000 7ff2837fe700 1 -- 172.21.15.114:0/1287067676 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27c00e070 con 0x7ff28406f9a0 2023-10-18T12:41:55.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.961+0000 7ff2837fe700 1 -- 172.21.15.114:0/1287067676 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27c00bb20 con 0x7ff28406f9a0 2023-10-18T12:41:55.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.961+0000 7ff2837fe700 1 -- 172.21.15.114:0/1287067676 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27c00be90 con 0x7ff28406f9a0 2023-10-18T12:41:55.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.965+0000 7ff28a697700 1 -- 172.21.15.114:0/1287067676 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff28406f9a0 msgr2=0x7ff28406fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:55.970 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.965+0000 7ff28a697700 1 --2- 172.21.15.114:0/1287067676 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff28406f9a0 0x7ff28406fde0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff27c009d90 tx=0x7ff27c00b330 comp rx=0 tx=0).stop 2023-10-18T12:41:55.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.965+0000 7ff28a697700 1 -- 172.21.15.114:0/1287067676 shutdown_connections 2023-10-18T12:41:55.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.965+0000 7ff28a697700 1 --2- 172.21.15.114:0/1287067676 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff28406f9a0 0x7ff28406fde0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:55.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.965+0000 7ff28a697700 1 -- 172.21.15.114:0/1287067676 >> 172.21.15.114:0/1287067676 conn(0x7ff28406a130 msgr2=0x7ff28406a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:55.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.965+0000 7ff28a697700 1 -- 172.21.15.114:0/1287067676 shutdown_connections 2023-10-18T12:41:55.971 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.965+0000 7ff28a697700 1 -- 172.21.15.114:0/1287067676 wait complete. 2023-10-18T12:41:55.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.965+0000 7ff28a697700 1 Processor -- start 2023-10-18T12:41:55.972 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.965+0000 7ff28a697700 1 -- start start 2023-10-18T12:41:55.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.969+0000 7ff28a697700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff28406f9a0 0x7ff28413e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:55.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.969+0000 7ff28a697700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff2840b5b80 0x7ff2840c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:55.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.969+0000 7ff28a697700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2841467c0 0x7ff2841f2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:55.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.969+0000 7ff28a697700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff284142c90 con 0x7ff28406f9a0 2023-10-18T12:41:55.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.969+0000 7ff28a697700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28413df30 con 0x7ff2841467c0 2023-10-18T12:41:55.975 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.969+0000 7ff28a697700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2840c8380 con 0x7ff2840b5b80 2023-10-18T12:41:55.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.969+0000 7ff283fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff28406f9a0 0x7ff28413e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:55.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.969+0000 7ff283fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff28406f9a0 0x7ff28413e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44264/0 (socket says 172.21.15.114:44264) 2023-10-18T12:41:55.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.969+0000 7ff283fff700 1 -- 172.21.15.114:0/1453229690 learned_addr learned my addr 172.21.15.114:0/1453229690 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:41:55.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.969+0000 7ff288c34700 1 --2- 172.21.15.114:0/1453229690 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2841467c0 0x7ff2841f2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:55.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.969+0000 7ff27bfff700 1 --2- 172.21.15.114:0/1453229690 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff2840b5b80 0x7ff2840c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:55.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.969+0000 7ff283fff700 1 -- 172.21.15.114:0/1453229690 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff2840b5b80 msgr2=0x7ff2840c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:55.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.969+0000 7ff283fff700 1 --2- 172.21.15.114:0/1453229690 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff2840b5b80 0x7ff2840c7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:55.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.969+0000 7ff283fff700 1 -- 172.21.15.114:0/1453229690 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2841467c0 msgr2=0x7ff2841f2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:55.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.969+0000 7ff283fff700 1 --2- 172.21.15.114:0/1453229690 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2841467c0 0x7ff2841f2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:55.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.969+0000 7ff283fff700 1 -- 172.21.15.114:0/1453229690 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff27c009a70 con 0x7ff28406f9a0 2023-10-18T12:41:55.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.969+0000 7ff283fff700 1 --2- 172.21.15.114:0/1453229690 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff28406f9a0 0x7ff28413e9d0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ff27400c450 tx=0x7ff27400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:55.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.969+0000 7ff2817fa700 1 -- 172.21.15.114:0/1453229690 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2740054e0 con 0x7ff28406f9a0 2023-10-18T12:41:55.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.969+0000 7ff2817fa700 1 -- 172.21.15.114:0/1453229690 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2740036a0 con 0x7ff28406f9a0 2023-10-18T12:41:55.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.969+0000 7ff28a697700 1 -- 172.21.15.114:0/1453229690 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff28415cc50 con 0x7ff28406f9a0 2023-10-18T12:41:55.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.969+0000 7ff2817fa700 1 -- 172.21.15.114:0/1453229690 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff274003a50 con 0x7ff28406f9a0 2023-10-18T12:41:55.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.973+0000 7ff28a697700 1 -- 172.21.15.114:0/1453229690 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2841429b0 con 0x7ff28406f9a0 2023-10-18T12:41:55.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.973+0000 7ff28a697700 1 -- 172.21.15.114:0/1453229690 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff284072e60 con 0x7ff28406f9a0 2023-10-18T12:41:55.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.973+0000 7ff2817fa700 1 -- 172.21.15.114:0/1453229690 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff274003bb0 con 0x7ff28406f9a0 2023-10-18T12:41:55.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.973+0000 7ff2817fa700 1 --2- 172.21.15.114:0/1453229690 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff2640656f0 0x7ff264067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:55.981 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.977+0000 7ff2817fa700 1 -- 172.21.15.114:0/1453229690 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7ff274082450 con 0x7ff28406f9a0 2023-10-18T12:41:55.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.977+0000 7ff27bfff700 1 --2- 172.21.15.114:0/1453229690 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff2640656f0 0x7ff264067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:55.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.977+0000 7ff27bfff700 1 --2- 172.21.15.114:0/1453229690 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff2640656f0 0x7ff264067bb0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff28413f200 tx=0x7ff26c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:55.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:55.981+0000 7ff2817fa700 1 -- 172.21.15.114:0/1453229690 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7ff27404fd10 con 0x7ff28406f9a0 2023-10-18T12:41:56.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.225+0000 7ff28a697700 1 -- 172.21.15.114:0/1453229690 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff28406d7a0 con 0x7ff28406f9a0 2023-10-18T12:41:56.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.225+0000 7ff2817fa700 1 -- 172.21.15.114:0/1453229690 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v60) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff274001160 con 0x7ff28406f9a0 2023-10-18T12:41:56.230 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 32 2023-10-18T12:41:56.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.229+0000 7ff28a697700 1 -- 172.21.15.114:0/1453229690 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff2640656f0 msgr2=0x7ff264067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:56.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.229+0000 7ff28a697700 1 --2- 172.21.15.114:0/1453229690 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff2640656f0 0x7ff264067bb0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff28413f200 tx=0x7ff26c009040 comp rx=0 tx=0).stop 2023-10-18T12:41:56.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.229+0000 7ff28a697700 1 -- 172.21.15.114:0/1453229690 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff28406f9a0 msgr2=0x7ff28413e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:56.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.229+0000 7ff28a697700 1 --2- 172.21.15.114:0/1453229690 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff28406f9a0 0x7ff28413e9d0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ff27400c450 tx=0x7ff27400c810 comp rx=0 tx=0).stop 2023-10-18T12:41:56.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.229+0000 7ff28a697700 1 -- 172.21.15.114:0/1453229690 shutdown_connections 2023-10-18T12:41:56.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.229+0000 7ff28a697700 1 --2- 172.21.15.114:0/1453229690 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff2640656f0 0x7ff264067bb0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:56.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.229+0000 7ff28a697700 1 --2- 172.21.15.114:0/1453229690 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff2840b5b80 0x7ff2840c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:56.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.229+0000 7ff28a697700 1 --2- 172.21.15.114:0/1453229690 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2841467c0 0x7ff2841f2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:56.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.229+0000 7ff28a697700 1 --2- 172.21.15.114:0/1453229690 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff28406f9a0 0x7ff28413e9d0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:56.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.229+0000 7ff28a697700 1 -- 172.21.15.114:0/1453229690 >> 172.21.15.114:0/1453229690 conn(0x7ff28406a130 msgr2=0x7ff2840d1390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:56.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.229+0000 7ff28a697700 1 -- 172.21.15.114:0/1453229690 shutdown_connections 2023-10-18T12:41:56.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.229+0000 7ff28a697700 1 -- 172.21.15.114:0/1453229690 wait complete. 2023-10-18T12:41:56.263 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-18T12:41:56.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.433+0000 7fe742313700 1 Processor -- start 2023-10-18T12:41:56.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.433+0000 7fe742313700 1 -- start start 2023-10-18T12:41:56.441 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.437+0000 7fe742313700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe73c15adf0 0x7fe73c0cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:56.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.437+0000 7fe742313700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe73c15b1d0 con 0x7fe73c0cce10 2023-10-18T12:41:56.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.437+0000 7fe742313700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe73c0ce600 con 0x7fe73c070460 2023-10-18T12:41:56.442 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.437+0000 7fe742313700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe73c0ca590 con 0x7fe73c15adf0 2023-10-18T12:41:56.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.437+0000 7fe7337fe700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe73c0cce10 0x7fe73c0b1940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:59370/0 (socket says 172.21.15.114:59370) 2023-10-18T12:41:56.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.437+0000 7fe7337fe700 1 -- 172.21.15.114:0/3077195976 learned_addr learned my addr 172.21.15.114:0/3077195976 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:41:56.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.437+0000 7fe73bfff700 1 --2- 172.21.15.114:0/3077195976 >> v2:172.21.15.172:3300/0 conn(0x7fe73c15adf0 0x7fe73c0cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:56.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.437+0000 7fe73b7fe700 1 -- 172.21.15.114:0/3077195976 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1546736581 0 0) 0x7fe724001110 con 0x7fe73c0cce10 2023-10-18T12:41:56.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.437+0000 7fe73b7fe700 1 -- 172.21.15.114:0/3077195976 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7280035d0 con 0x7fe73c0cce10 2023-10-18T12:41:56.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.437+0000 7fe73b7fe700 1 -- 172.21.15.114:0/3077195976 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3115419119 0 0) 0x7fe73c0ce600 con 0x7fe73c070460 2023-10-18T12:41:56.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.437+0000 7fe73b7fe700 1 -- 172.21.15.114:0/3077195976 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe724001110 con 0x7fe73c070460 2023-10-18T12:41:56.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.437+0000 7fe73bfff700 1 -- 172.21.15.114:0/3077195976 >> v1:172.21.15.172:6789/0 conn(0x7fe73c070460 legacy=0x7fe73c070870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:56.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.437+0000 7fe73bfff700 1 -- 172.21.15.114:0/3077195976 >> v1:172.21.15.114:6789/0 conn(0x7fe73c0cce10 legacy=0x7fe73c0b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:56.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.437+0000 7fe73b7fe700 1 -- 172.21.15.114:0/3077195976 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2147595155 0 0) 0x7fe7280035d0 con 0x7fe73c0cce10 2023-10-18T12:41:56.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.437+0000 7fe73bfff700 1 -- 172.21.15.114:0/3077195976 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe73c0cd580 con 0x7fe73c15adf0 2023-10-18T12:41:56.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.437+0000 7fe73bfff700 1 --2- 172.21.15.114:0/3077195976 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe73c15adf0 0x7fe73c0cc8d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe72c009850 tx=0x7fe72c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c787ae231b579c46 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:56.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.441+0000 7fe73b7fe700 1 -- 172.21.15.114:0/3077195976 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c011830 con 0x7fe73c15adf0 2023-10-18T12:41:56.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.441+0000 7fe73b7fe700 1 -- 172.21.15.114:0/3077195976 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe72c011990 con 0x7fe73c15adf0 2023-10-18T12:41:56.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.441+0000 7fe73b7fe700 1 -- 172.21.15.114:0/3077195976 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c011d40 con 0x7fe73c15adf0 2023-10-18T12:41:56.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.441+0000 7fe742313700 1 -- 172.21.15.114:0/3077195976 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe73c15adf0 msgr2=0x7fe73c0cc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:56.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.441+0000 7fe742313700 1 --2- 172.21.15.114:0/3077195976 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe73c15adf0 0x7fe73c0cc8d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe72c009850 tx=0x7fe72c009b60 comp rx=0 tx=0).stop 2023-10-18T12:41:56.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.441+0000 7fe742313700 1 -- 172.21.15.114:0/3077195976 shutdown_connections 2023-10-18T12:41:56.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.441+0000 7fe742313700 1 --2- 172.21.15.114:0/3077195976 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe73c15adf0 0x7fe73c0cc8d0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:56.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.441+0000 7fe742313700 1 -- 172.21.15.114:0/3077195976 >> 172.21.15.114:0/3077195976 conn(0x7fe73c0ce820 msgr2=0x7fe73c0cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:56.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.441+0000 7fe742313700 1 -- 172.21.15.114:0/3077195976 shutdown_connections 2023-10-18T12:41:56.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.441+0000 7fe742313700 1 -- 172.21.15.114:0/3077195976 wait complete. 2023-10-18T12:41:56.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.445+0000 7fe742313700 1 Processor -- start 2023-10-18T12:41:56.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.445+0000 7fe742313700 1 -- start start 2023-10-18T12:41:56.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.445+0000 7fe742313700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe73c070460 0x7fe73c1597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:56.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.445+0000 7fe742313700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe73c0cce10 0x7fe73c0c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:56.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.445+0000 7fe742313700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe73c15adf0 0x7fe73c06cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:56.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.445+0000 7fe742313700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c0c72b0 con 0x7fe73c15adf0 2023-10-18T12:41:56.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.445+0000 7fe742313700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c0c7590 con 0x7fe73c070460 2023-10-18T12:41:56.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.445+0000 7fe742313700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c0c7870 con 0x7fe73c0cce10 2023-10-18T12:41:56.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.445+0000 7fe7408b0700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe73c15adf0 0x7fe73c06cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:56.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.445+0000 7fe7408b0700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe73c15adf0 0x7fe73c06cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44266/0 (socket says 172.21.15.114:44266) 2023-10-18T12:41:56.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.445+0000 7fe7408b0700 1 -- 172.21.15.114:0/3416820851 learned_addr learned my addr 172.21.15.114:0/3416820851 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:41:56.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.449+0000 7fe7337fe700 1 --2- 172.21.15.114:0/3416820851 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe73c0cce10 0x7fe73c0c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:56.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.449+0000 7fe73bfff700 1 --2- 172.21.15.114:0/3416820851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe73c070460 0x7fe73c1597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:56.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.449+0000 7fe7408b0700 1 -- 172.21.15.114:0/3416820851 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe73c0cce10 msgr2=0x7fe73c0c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:56.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.449+0000 7fe7408b0700 1 --2- 172.21.15.114:0/3416820851 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe73c0cce10 0x7fe73c0c8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:56.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.449+0000 7fe7408b0700 1 -- 172.21.15.114:0/3416820851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe73c070460 msgr2=0x7fe73c1597e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:56.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.449+0000 7fe7408b0700 1 --2- 172.21.15.114:0/3416820851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe73c070460 0x7fe73c1597e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:56.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.449+0000 7fe7408b0700 1 -- 172.21.15.114:0/3416820851 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe72c0094b0 con 0x7fe73c15adf0 2023-10-18T12:41:56.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.449+0000 7fe73bfff700 1 --2- 172.21.15.114:0/3416820851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe73c070460 0x7fe73c1597e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:41:56.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.449+0000 7fe7408b0700 1 --2- 172.21.15.114:0/3416820851 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe73c15adf0 0x7fe73c06cf40 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fe73400cc20 tx=0x7fe73400cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:56.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.449+0000 7fe7397fa700 1 -- 172.21.15.114:0/3416820851 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe734003c20 con 0x7fe73c15adf0 2023-10-18T12:41:56.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.449+0000 7fe7397fa700 1 -- 172.21.15.114:0/3416820851 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe734003d80 con 0x7fe73c15adf0 2023-10-18T12:41:56.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.449+0000 7fe7397fa700 1 -- 172.21.15.114:0/3416820851 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73400ab90 con 0x7fe73c15adf0 2023-10-18T12:41:56.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.449+0000 7fe742313700 1 -- 172.21.15.114:0/3416820851 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe73c0c7b50 con 0x7fe73c15adf0 2023-10-18T12:41:56.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.449+0000 7fe742313700 1 -- 172.21.15.114:0/3416820851 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe73c06d480 con 0x7fe73c15adf0 2023-10-18T12:41:56.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.449+0000 7fe742313700 1 -- 172.21.15.114:0/3416820851 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe73c0c8070 con 0x7fe73c15adf0 2023-10-18T12:41:56.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.453+0000 7fe7397fa700 1 -- 172.21.15.114:0/3416820851 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fe73400acf0 con 0x7fe73c15adf0 2023-10-18T12:41:56.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.453+0000 7fe7397fa700 1 --2- 172.21.15.114:0/3416820851 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe71c0656f0 0x7fe71c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:56.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.453+0000 7fe7397fa700 1 -- 172.21.15.114:0/3416820851 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7fe7340830d0 con 0x7fe73c15adf0 2023-10-18T12:41:56.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.453+0000 7fe73bfff700 1 --2- 172.21.15.114:0/3416820851 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe71c0656f0 0x7fe71c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:56.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.453+0000 7fe73bfff700 1 --2- 172.21.15.114:0/3416820851 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe71c0656f0 0x7fe71c067bb0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe72c0090b0 tx=0x7fe72c01c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:56.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.461+0000 7fe7397fa700 1 -- 172.21.15.114:0/3416820851 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fe73c0c8070 con 0x7fe73c15adf0 2023-10-18T12:41:56.639 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.633+0000 7fe742313700 1 -- 172.21.15.114:0/3416820851 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe73c0c8070 con 0x7fe73c15adf0 2023-10-18T12:41:56.640 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.633+0000 7fe7397fa700 1 -- 172.21.15.114:0/3416820851 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v60) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe73c0c8070 con 0x7fe73c15adf0 2023-10-18T12:41:56.640 INFO:teuthology.orchestra.run.smithi114.stdout:pg_num: 64 2023-10-18T12:41:56.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.637+0000 7fe742313700 1 -- 172.21.15.114:0/3416820851 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe71c0656f0 msgr2=0x7fe71c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:56.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.637+0000 7fe742313700 1 --2- 172.21.15.114:0/3416820851 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe71c0656f0 0x7fe71c067bb0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe72c0090b0 tx=0x7fe72c01c040 comp rx=0 tx=0).stop 2023-10-18T12:41:56.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.637+0000 7fe742313700 1 -- 172.21.15.114:0/3416820851 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe73c15adf0 msgr2=0x7fe73c06cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:56.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.637+0000 7fe742313700 1 --2- 172.21.15.114:0/3416820851 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe73c15adf0 0x7fe73c06cf40 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fe73400cc20 tx=0x7fe73400cf30 comp rx=0 tx=0).stop 2023-10-18T12:41:56.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.637+0000 7fe742313700 1 -- 172.21.15.114:0/3416820851 shutdown_connections 2023-10-18T12:41:56.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.637+0000 7fe742313700 1 --2- 172.21.15.114:0/3416820851 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe71c0656f0 0x7fe71c067bb0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:56.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.637+0000 7fe742313700 1 --2- 172.21.15.114:0/3416820851 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe73c0cce10 0x7fe73c0c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:56.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.637+0000 7fe742313700 1 --2- 172.21.15.114:0/3416820851 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe73c15adf0 0x7fe73c06cf40 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:56.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.637+0000 7fe742313700 1 --2- 172.21.15.114:0/3416820851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe73c070460 0x7fe73c1597e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:56.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.637+0000 7fe742313700 1 -- 172.21.15.114:0/3416820851 >> 172.21.15.114:0/3416820851 conn(0x7fe73c0ce820 msgr2=0x7fe73c159f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:56.644 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.637+0000 7fe742313700 1 -- 172.21.15.114:0/3416820851 shutdown_connections 2023-10-18T12:41:56.645 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.637+0000 7fe742313700 1 -- 172.21.15.114:0/3416820851 wait complete. 2023-10-18T12:41:56.663 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T12:41:56.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.829+0000 7fd42b59e700 1 Processor -- start 2023-10-18T12:41:56.834 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.829+0000 7fd42b59e700 1 -- start start 2023-10-18T12:41:56.838 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.833+0000 7fd42b59e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd42c070c70 0x7fd42c0cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:56.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.833+0000 7fd42b59e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd42c0cde70 0x7fd42c06cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:56.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.833+0000 7fd42b59e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd42c0b14f0 con 0x7fd42c159750 2023-10-18T12:41:56.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.833+0000 7fd42b59e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd42c0c9aa0 con 0x7fd42c0cde70 2023-10-18T12:41:56.839 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.833+0000 7fd42b59e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd42c0ce2e0 con 0x7fd42c070c70 2023-10-18T12:41:56.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.833+0000 7fd42ad9d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd42c0cde70 0x7fd42c06cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:56.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.833+0000 7fd42ad9d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd42c0cde70 0x7fd42c06cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44272/0 (socket says 172.21.15.114:44272) 2023-10-18T12:41:56.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.833+0000 7fd42a59c700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd42c159750 0x7fd42c070560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:59378/0 (socket says 172.21.15.114:59378) 2023-10-18T12:41:56.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.833+0000 7fd42ad9d700 1 -- 172.21.15.114:0/350502179 learned_addr learned my addr 172.21.15.114:0/350502179 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:41:56.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.833+0000 7fd421d9b700 1 --2- 172.21.15.114:0/350502179 >> v2:172.21.15.172:3300/0 conn(0x7fd42c070c70 0x7fd42c0cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:56.840 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.833+0000 7fd42ad9d700 1 -- 172.21.15.114:0/350502179 >> v2:172.21.15.172:3300/0 conn(0x7fd42c070c70 msgr2=0x7fd42c0cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:41:56.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.833+0000 7fd42ad9d700 1 --2- 172.21.15.114:0/350502179 >> v2:172.21.15.172:3300/0 conn(0x7fd42c070c70 0x7fd42c0cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:56.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.833+0000 7fd42ad9d700 1 -- 172.21.15.114:0/350502179 >> v1:172.21.15.114:6789/0 conn(0x7fd42c159750 legacy=0x7fd42c070560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:56.841 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.833+0000 7fd42ad9d700 1 -- 172.21.15.114:0/350502179 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd42c15d590 con 0x7fd42c0cde70 2023-10-18T12:41:56.842 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.833+0000 7fd42ad9d700 1 --2- 172.21.15.114:0/350502179 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd42c0cde70 0x7fd42c06cf20 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fd42c15d320 tx=0x7fd42400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89a59cfe8937f5cd server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:56.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.833+0000 7fd429d9b700 1 -- 172.21.15.114:0/350502179 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42400e070 con 0x7fd42c0cde70 2023-10-18T12:41:56.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.833+0000 7fd429d9b700 1 -- 172.21.15.114:0/350502179 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd42400b9c0 con 0x7fd42c0cde70 2023-10-18T12:41:56.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.833+0000 7fd429d9b700 1 -- 172.21.15.114:0/350502179 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd42400bd70 con 0x7fd42c0cde70 2023-10-18T12:41:56.843 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.833+0000 7fd42b59e700 1 -- 172.21.15.114:0/350502179 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd42c0cde70 msgr2=0x7fd42c06cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:56.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.833+0000 7fd42b59e700 1 --2- 172.21.15.114:0/350502179 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd42c0cde70 0x7fd42c06cf20 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fd42c15d320 tx=0x7fd42400b330 comp rx=0 tx=0).stop 2023-10-18T12:41:56.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.837+0000 7fd42b59e700 1 -- 172.21.15.114:0/350502179 shutdown_connections 2023-10-18T12:41:56.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.837+0000 7fd42b59e700 1 --2- 172.21.15.114:0/350502179 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd42c0cde70 0x7fd42c06cf20 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:56.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.837+0000 7fd42b59e700 1 --2- 172.21.15.114:0/350502179 >> v2:172.21.15.172:3300/0 conn(0x7fd42c070c70 0x7fd42c0cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:56.844 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.837+0000 7fd42b59e700 1 -- 172.21.15.114:0/350502179 >> 172.21.15.114:0/350502179 conn(0x7fd42c0ce5c0 msgr2=0x7fd42c0ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:56.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.837+0000 7fd42b59e700 1 -- 172.21.15.114:0/350502179 shutdown_connections 2023-10-18T12:41:56.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.837+0000 7fd42b59e700 1 -- 172.21.15.114:0/350502179 wait complete. 2023-10-18T12:41:56.845 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.841+0000 7fd42b59e700 1 Processor -- start 2023-10-18T12:41:56.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.841+0000 7fd42b59e700 1 -- start start 2023-10-18T12:41:56.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.841+0000 7fd42b59e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd42c070c70 0x7fd42c0c6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:56.846 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.841+0000 7fd42b59e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd42c0cde70 0x7fd42c157820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:56.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.841+0000 7fd42b59e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd42c159750 0x7fd42c157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:56.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.841+0000 7fd42b59e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c0b1bc0 con 0x7fd42c070c70 2023-10-18T12:41:56.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.841+0000 7fd42b59e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c1589c0 con 0x7fd42c159750 2023-10-18T12:41:56.847 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.841+0000 7fd42b59e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd42c152610 con 0x7fd42c0cde70 2023-10-18T12:41:56.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.841+0000 7fd42a59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd42c070c70 0x7fd42c0c6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:56.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.841+0000 7fd42a59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd42c070c70 0x7fd42c0c6940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44286/0 (socket says 172.21.15.114:44286) 2023-10-18T12:41:56.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.841+0000 7fd42a59c700 1 -- 172.21.15.114:0/3444819232 learned_addr learned my addr 172.21.15.114:0/3444819232 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:41:56.849 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.841+0000 7fd421d9b700 1 --2- 172.21.15.114:0/3444819232 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd42c0cde70 0x7fd42c157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:56.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.841+0000 7fd42ad9d700 1 --2- 172.21.15.114:0/3444819232 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd42c159750 0x7fd42c157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:56.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.841+0000 7fd42a59c700 1 -- 172.21.15.114:0/3444819232 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd42c0cde70 msgr2=0x7fd42c157820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:56.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.841+0000 7fd42a59c700 1 --2- 172.21.15.114:0/3444819232 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd42c0cde70 0x7fd42c157820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:56.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.841+0000 7fd42a59c700 1 -- 172.21.15.114:0/3444819232 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd42c159750 msgr2=0x7fd42c157d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:56.850 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.841+0000 7fd42a59c700 1 --2- 172.21.15.114:0/3444819232 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd42c159750 0x7fd42c157d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:56.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.841+0000 7fd42a59c700 1 -- 172.21.15.114:0/3444819232 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd424009b30 con 0x7fd42c070c70 2023-10-18T12:41:56.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.845+0000 7fd42a59c700 1 --2- 172.21.15.114:0/3444819232 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd42c070c70 0x7fd42c0c6940 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fd41c00c500 tx=0x7fd41c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:56.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.845+0000 7fd4237fe700 1 -- 172.21.15.114:0/3444819232 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41c005cd0 con 0x7fd42c070c70 2023-10-18T12:41:56.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.845+0000 7fd4237fe700 1 -- 172.21.15.114:0/3444819232 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd41c00ce90 con 0x7fd42c070c70 2023-10-18T12:41:56.851 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.845+0000 7fd42b59e700 1 -- 172.21.15.114:0/3444819232 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd42c0b1820 con 0x7fd42c070c70 2023-10-18T12:41:56.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.845+0000 7fd4237fe700 1 -- 172.21.15.114:0/3444819232 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41c0072d0 con 0x7fd42c070c70 2023-10-18T12:41:56.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.845+0000 7fd42b59e700 1 -- 172.21.15.114:0/3444819232 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd42c1586e0 con 0x7fd42c070c70 2023-10-18T12:41:56.852 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.845+0000 7fd42b59e700 1 -- 172.21.15.114:0/3444819232 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd42c0b1680 con 0x7fd42c070c70 2023-10-18T12:41:56.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.849+0000 7fd4237fe700 1 -- 172.21.15.114:0/3444819232 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fd41c007430 con 0x7fd42c070c70 2023-10-18T12:41:56.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.849+0000 7fd4237fe700 1 --2- 172.21.15.114:0/3444819232 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd40c0656f0 0x7fd40c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:56.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.849+0000 7fd4237fe700 1 -- 172.21.15.114:0/3444819232 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7fd41c082260 con 0x7fd42c070c70 2023-10-18T12:41:56.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.849+0000 7fd421d9b700 1 --2- 172.21.15.114:0/3444819232 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd40c0656f0 0x7fd40c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:56.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.849+0000 7fd421d9b700 1 --2- 172.21.15.114:0/3444819232 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd40c0656f0 0x7fd40c067bb0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd42c152270 tx=0x7fd414008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:56.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:56.853+0000 7fd4237fe700 1 -- 172.21.15.114:0/3444819232 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fd42c0b1680 con 0x7fd42c070c70 2023-10-18T12:41:57.086 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.081+0000 7fd42b59e700 1 -- 172.21.15.114:0/3444819232 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd42c0b1680 con 0x7fd42c070c70 2023-10-18T12:41:57.087 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.081+0000 7fd4237fe700 1 -- 172.21.15.114:0/3444819232 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4889 (secure 0 0 0) 0x7fd42c0b1680 con 0x7fd42c070c70 2023-10-18T12:41:57.088 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:41:57.088 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2034957068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2034957068},{"type":"v1","addr":"172.21.15.172:6836","nonce":2034957068}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5039,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4215710360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4215710360},{"type":"v1","addr":"172.21.15.172:6837","nonce":4215710360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2387835210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2387835210},{"type":"v1","addr":"172.21.15.114:6833","nonce":2387835210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T12:21:14.159069+0000","modified":"2023-10-18T12:29:23.762500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":126,"addr":"172.21.15.114:6835/1284474820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1284474820},{"type":"v1","addr":"172.21.15.114:6835","nonce":1284474820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-18T12:41:57.090 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.085+0000 7fd42b59e700 1 -- 172.21.15.114:0/3444819232 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd40c0656f0 msgr2=0x7fd40c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:57.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.085+0000 7fd42b59e700 1 --2- 172.21.15.114:0/3444819232 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd40c0656f0 0x7fd40c067bb0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd42c152270 tx=0x7fd414008040 comp rx=0 tx=0).stop 2023-10-18T12:41:57.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.085+0000 7fd42b59e700 1 -- 172.21.15.114:0/3444819232 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd42c070c70 msgr2=0x7fd42c0c6940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:57.091 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.085+0000 7fd42b59e700 1 --2- 172.21.15.114:0/3444819232 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd42c070c70 0x7fd42c0c6940 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fd41c00c500 tx=0x7fd41c00c810 comp rx=0 tx=0).stop 2023-10-18T12:41:57.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.085+0000 7fd42b59e700 1 -- 172.21.15.114:0/3444819232 shutdown_connections 2023-10-18T12:41:57.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.085+0000 7fd42b59e700 1 --2- 172.21.15.114:0/3444819232 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd40c0656f0 0x7fd40c067bb0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:57.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.085+0000 7fd42b59e700 1 --2- 172.21.15.114:0/3444819232 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd42c0cde70 0x7fd42c157820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:57.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.085+0000 7fd42b59e700 1 --2- 172.21.15.114:0/3444819232 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd42c159750 0x7fd42c157d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:57.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.085+0000 7fd42b59e700 1 --2- 172.21.15.114:0/3444819232 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd42c070c70 0x7fd42c0c6940 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:57.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.085+0000 7fd42b59e700 1 -- 172.21.15.114:0/3444819232 >> 172.21.15.114:0/3444819232 conn(0x7fd42c0ce5c0 msgr2=0x7fd42c0cce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:57.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.085+0000 7fd42b59e700 1 -- 172.21.15.114:0/3444819232 shutdown_connections 2023-10-18T12:41:57.093 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.085+0000 7fd42b59e700 1 -- 172.21.15.114:0/3444819232 wait complete. 2023-10-18T12:41:57.093 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 20 2023-10-18T12:41:57.111 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T12:41:57.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.273+0000 7fe13a708700 1 Processor -- start 2023-10-18T12:41:57.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.273+0000 7fe13a708700 1 -- start start 2023-10-18T12:41:57.280 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.277+0000 7fe13a708700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe13415ee50 0x7fe1340cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:57.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.277+0000 7fe13a708700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe1340cb640 0x7fe13406f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:57.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.277+0000 7fe13a708700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe13406f450 con 0x7fe13406e8a0 2023-10-18T12:41:57.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.277+0000 7fe13a708700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe13406d4e0 con 0x7fe1340cb640 2023-10-18T12:41:57.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.277+0000 7fe13a708700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe134162780 con 0x7fe13415ee50 2023-10-18T12:41:57.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.277+0000 7fe138ca5700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe1340cb640 0x7fe13406f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:57.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.277+0000 7fe138ca5700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe1340cb640 0x7fe13406f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44298/0 (socket says 172.21.15.114:44298) 2023-10-18T12:41:57.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.277+0000 7fe138ca5700 1 -- 172.21.15.114:0/2158307275 learned_addr learned my addr 172.21.15.114:0/2158307275 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:41:57.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.277+0000 7fe133fff700 1 --2- 172.21.15.114:0/2158307275 >> v2:172.21.15.172:3300/0 conn(0x7fe13415ee50 0x7fe1340cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:57.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.277+0000 7fe138ca5700 1 -- 172.21.15.114:0/2158307275 >> v2:172.21.15.172:3300/0 conn(0x7fe13415ee50 msgr2=0x7fe1340cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:41:57.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.277+0000 7fe138ca5700 1 --2- 172.21.15.114:0/2158307275 >> v2:172.21.15.172:3300/0 conn(0x7fe13415ee50 0x7fe1340cc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:57.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.277+0000 7fe138ca5700 1 -- 172.21.15.114:0/2158307275 >> v1:172.21.15.172:6789/0 conn(0x7fe13406e8a0 legacy=0x7fe1340caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:57.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.277+0000 7fe138ca5700 1 -- 172.21.15.114:0/2158307275 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1340ccbc0 con 0x7fe1340cb640 2023-10-18T12:41:57.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.277+0000 7fe133fff700 1 --2- 172.21.15.114:0/2158307275 >> v2:172.21.15.172:3300/0 conn(0x7fe13415ee50 0x7fe1340cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:41:57.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.277+0000 7fe138ca5700 1 --2- 172.21.15.114:0/2158307275 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1340cb640 0x7fe13406f8e0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fe13406b360 tx=0x7fe12c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6296d8b1b07f252e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:57.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.277+0000 7fe1337fe700 1 -- 172.21.15.114:0/2158307275 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12c00ba20 con 0x7fe1340cb640 2023-10-18T12:41:57.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.277+0000 7fe1337fe700 1 -- 172.21.15.114:0/2158307275 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe12c00bb80 con 0x7fe1340cb640 2023-10-18T12:41:57.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.277+0000 7fe1337fe700 1 -- 172.21.15.114:0/2158307275 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12c009e60 con 0x7fe1340cb640 2023-10-18T12:41:57.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.277+0000 7fe13a708700 1 -- 172.21.15.114:0/2158307275 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1340cb640 msgr2=0x7fe13406f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:57.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.277+0000 7fe13a708700 1 --2- 172.21.15.114:0/2158307275 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1340cb640 0x7fe13406f8e0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fe13406b360 tx=0x7fe12c009c20 comp rx=0 tx=0).stop 2023-10-18T12:41:57.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.277+0000 7fe13a708700 1 -- 172.21.15.114:0/2158307275 shutdown_connections 2023-10-18T12:41:57.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.277+0000 7fe13a708700 1 --2- 172.21.15.114:0/2158307275 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe1340cb640 0x7fe13406f8e0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:57.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.277+0000 7fe13a708700 1 --2- 172.21.15.114:0/2158307275 >> v2:172.21.15.172:3300/0 conn(0x7fe13415ee50 0x7fe1340cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:57.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.277+0000 7fe13a708700 1 -- 172.21.15.114:0/2158307275 >> 172.21.15.114:0/2158307275 conn(0x7fe13406a340 msgr2=0x7fe1340b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:57.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.277+0000 7fe13a708700 1 -- 172.21.15.114:0/2158307275 shutdown_connections 2023-10-18T12:41:57.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.277+0000 7fe13a708700 1 -- 172.21.15.114:0/2158307275 wait complete. 2023-10-18T12:41:57.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.281+0000 7fe13a708700 1 Processor -- start 2023-10-18T12:41:57.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.281+0000 7fe13a708700 1 -- start start 2023-10-18T12:41:57.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.285+0000 7fe13a708700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe13406e8a0 0x7fe1340a7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:57.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.285+0000 7fe13a708700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe1340cb640 0x7fe1340af390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:57.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.285+0000 7fe13a708700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe13415ee50 0x7fe1340af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:57.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.285+0000 7fe13a708700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1341f7140 con 0x7fe13406e8a0 2023-10-18T12:41:57.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.285+0000 7fe13a708700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1341f7420 con 0x7fe13415ee50 2023-10-18T12:41:57.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.285+0000 7fe13a708700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1341f7700 con 0x7fe1340cb640 2023-10-18T12:41:57.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.285+0000 7fe133fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe13406e8a0 0x7fe1340a7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:57.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.285+0000 7fe133fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe13406e8a0 0x7fe1340a7d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44306/0 (socket says 172.21.15.114:44306) 2023-10-18T12:41:57.290 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.285+0000 7fe133fff700 1 -- 172.21.15.114:0/2559228376 learned_addr learned my addr 172.21.15.114:0/2559228376 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:41:57.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.285+0000 7fe138ca5700 1 --2- 172.21.15.114:0/2559228376 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe13415ee50 0x7fe1340af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:57.291 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.285+0000 7fe12b7fe700 1 --2- 172.21.15.114:0/2559228376 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe1340cb640 0x7fe1340af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:57.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.285+0000 7fe133fff700 1 -- 172.21.15.114:0/2559228376 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe1340cb640 msgr2=0x7fe1340af390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:57.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.285+0000 7fe133fff700 1 --2- 172.21.15.114:0/2559228376 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe1340cb640 0x7fe1340af390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:57.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.285+0000 7fe133fff700 1 -- 172.21.15.114:0/2559228376 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe13415ee50 msgr2=0x7fe1340af8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:57.292 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.285+0000 7fe133fff700 1 --2- 172.21.15.114:0/2559228376 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe13415ee50 0x7fe1340af8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:57.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.285+0000 7fe133fff700 1 -- 172.21.15.114:0/2559228376 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe12c009570 con 0x7fe13406e8a0 2023-10-18T12:41:57.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.285+0000 7fe133fff700 1 --2- 172.21.15.114:0/2559228376 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe13406e8a0 0x7fe1340a7d70 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fe124009fa0 tx=0x7fe12400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:57.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.285+0000 7fe1317fa700 1 -- 172.21.15.114:0/2559228376 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12400de60 con 0x7fe13406e8a0 2023-10-18T12:41:57.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.285+0000 7fe1317fa700 1 -- 172.21.15.114:0/2559228376 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe12400f040 con 0x7fe13406e8a0 2023-10-18T12:41:57.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.285+0000 7fe1317fa700 1 -- 172.21.15.114:0/2559228376 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe124003c60 con 0x7fe13406e8a0 2023-10-18T12:41:57.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.285+0000 7fe13a708700 1 -- 172.21.15.114:0/2559228376 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1340a7570 con 0x7fe13406e8a0 2023-10-18T12:41:57.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.285+0000 7fe13a708700 1 -- 172.21.15.114:0/2559228376 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1340a82b0 con 0x7fe13406e8a0 2023-10-18T12:41:57.294 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.289+0000 7fe13a708700 1 -- 172.21.15.114:0/2559228376 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1340a84d0 con 0x7fe13406e8a0 2023-10-18T12:41:57.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.289+0000 7fe1317fa700 1 -- 172.21.15.114:0/2559228376 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fe124004030 con 0x7fe13406e8a0 2023-10-18T12:41:57.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.289+0000 7fe1317fa700 1 --2- 172.21.15.114:0/2559228376 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe1140656f0 0x7fe114067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:57.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.289+0000 7fe1317fa700 1 -- 172.21.15.114:0/2559228376 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7fe124083000 con 0x7fe13406e8a0 2023-10-18T12:41:57.295 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.289+0000 7fe12b7fe700 1 --2- 172.21.15.114:0/2559228376 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe1140656f0 0x7fe114067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:57.296 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.293+0000 7fe12b7fe700 1 --2- 172.21.15.114:0/2559228376 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe1140656f0 0x7fe114067bb0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe13415e410 tx=0x7fe11c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:57.301 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.297+0000 7fe1317fa700 1 -- 172.21.15.114:0/2559228376 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fe1240508e0 con 0x7fe13406e8a0 2023-10-18T12:41:57.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.469+0000 7fe13a708700 1 -- 172.21.15.114:0/2559228376 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe134072e60 con 0x7fe13406e8a0 2023-10-18T12:41:57.476 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.469+0000 7fe1317fa700 1 -- 172.21.15.114:0/2559228376 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+19138 (secure 0 0 0) 0x7fe124053f00 con 0x7fe13406e8a0 2023-10-18T12:41:57.477 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:41:57.477 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":60,"fsid":"240ea340-5d3d-4f52-a4bc-af075aca3deb","created":"2023-10-18T12:19:12.512994+0000","modified":"2023-10-18T12:30:22.735724+0000","last_up_change":"2023-10-18T12:29:29.654825+0000","last_in_change":"2023-10-18T12:19:15.850693+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T12:19:27.040638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-18T12:19:32.358094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-18T12:21:12.105324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-18T12:21:13.154105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c3578978-1a03-4857-b9d2-34a5da3d7731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":49,"up_from":56,"up_thru":57,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1953670272},{"type":"v1","addr":"172.21.15.114:6817","nonce":1953670272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1953670272},{"type":"v1","addr":"172.21.15.114:6820","nonce":1953670272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1953670272},{"type":"v1","addr":"172.21.15.114:6830","nonce":1953670272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":1953670272},{"type":"v1","addr":"172.21.15.114:6825","nonce":1953670272}]},"public_addr":"172.21.15.114:6817/1953670272","cluster_addr":"172.21.15.114:6820/1953670272","heartbeat_back_addr":"172.21.15.114:6830/1953670272","heartbeat_front_addr":"172.21.15.114:6825/1953670272","state":["exists","up"]},{"osd":1,"uuid":"43eb26a6-e2b3-4670-9559-bd053b5140d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6801","nonce":3302727047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6803","nonce":3302727047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6807","nonce":3302727047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6805","nonce":3302727047}]},"public_addr":"172.21.15.114:6801/3302727047","cluster_addr":"172.21.15.114:6803/3302727047","heartbeat_back_addr":"172.21.15.114:6807/3302727047","heartbeat_front_addr":"172.21.15.114:6805/3302727047","state":["exists","up"]},{"osd":2,"uuid":"f3d4dbd5-521c-4dd2-b687-5768cc7d0938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6809","nonce":2699151351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6811","nonce":2699151351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6815","nonce":2699151351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6813","nonce":2699151351}]},"public_addr":"172.21.15.114:6809/2699151351","cluster_addr":"172.21.15.114:6811/2699151351","heartbeat_back_addr":"172.21.15.114:6815/2699151351","heartbeat_front_addr":"172.21.15.114:6813/2699151351","state":["exists","up"]},{"osd":3,"uuid":"823e5802-92b7-4f0d-b32d-a5748993f1b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6821","nonce":1361608073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6824","nonce":1361608073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6829","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6831","nonce":1361608073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6827","nonce":1361608073}]},"public_addr":"172.21.15.114:6821/1361608073","cluster_addr":"172.21.15.114:6824/1361608073","heartbeat_back_addr":"172.21.15.114:6831/1361608073","heartbeat_front_addr":"172.21.15.114:6827/1361608073","state":["exists","up"]},{"osd":4,"uuid":"e47fb93e-13b4-44a4-b084-8c4384ceb41e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6801","nonce":930839681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6803","nonce":930839681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6807","nonce":930839681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6805","nonce":930839681}]},"public_addr":"172.21.15.172:6801/930839681","cluster_addr":"172.21.15.172:6803/930839681","heartbeat_back_addr":"172.21.15.172:6807/930839681","heartbeat_front_addr":"172.21.15.172:6805/930839681","state":["exists","up"]},{"osd":5,"uuid":"7561a973-f479-45a0-af40-f324728d622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6814","nonce":571761850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6818","nonce":571761850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6824","nonce":571761850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6821","nonce":571761850}]},"public_addr":"172.21.15.172:6814/571761850","cluster_addr":"172.21.15.172:6818/571761850","heartbeat_back_addr":"172.21.15.172:6824/571761850","heartbeat_front_addr":"172.21.15.172:6821/571761850","state":["exists","up"]},{"osd":6,"uuid":"51753f4b-7f06-4f1c-9ec7-6e18a66eb980","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6825","nonce":1680398853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6827","nonce":1680398853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6831","nonce":1680398853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6829","nonce":1680398853}]},"public_addr":"172.21.15.172:6825/1680398853","cluster_addr":"172.21.15.172:6827/1680398853","heartbeat_back_addr":"172.21.15.172:6831/1680398853","heartbeat_front_addr":"172.21.15.172:6829/1680398853","state":["exists","up"]},{"osd":7,"uuid":"4d8b1e15-143d-4d17-9074-59d92f0f9af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6809","nonce":349710101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6811","nonce":349710101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6819","nonce":349710101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6815","nonce":349710101}]},"public_addr":"172.21.15.172:6809/349710101","cluster_addr":"172.21.15.172:6811/349710101","heartbeat_back_addr":"172.21.15.172:6819/349710101","heartbeat_front_addr":"172.21.15.172:6815/349710101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"2023-10-18T12:21:50.537022+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.889460+0000","dead_epoch":50},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.475494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.911473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.648596+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.609994+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.636248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.854589+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.885826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.5","mappings":[{"from":7,"to":0}]},{"pgid":"6.9","mappings":[{"from":7,"to":2}]},{"pgid":"6.c","mappings":[{"from":3,"to":0}]},{"pgid":"6.11","mappings":[{"from":3,"to":2}]},{"pgid":"6.1d","mappings":[{"from":5,"to":0}]},{"pgid":"7.12","mappings":[{"from":6,"to":4}]},{"pgid":"7.2d","mappings":[{"from":0,"to":4}]},{"pgid":"7.30","mappings":[{"from":6,"to":4}]},{"pgid":"7.35","mappings":[{"from":0,"to":5}]},{"pgid":"7.36","mappings":[{"from":6,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:0/1817588655":"2023-10-18T13:29:19.822093+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T12:41:57.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.477+0000 7fe13a708700 1 -- 172.21.15.114:0/2559228376 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe1140656f0 msgr2=0x7fe114067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:57.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.477+0000 7fe13a708700 1 --2- 172.21.15.114:0/2559228376 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe1140656f0 0x7fe114067bb0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe13415e410 tx=0x7fe11c009040 comp rx=0 tx=0).stop 2023-10-18T12:41:57.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.477+0000 7fe13a708700 1 -- 172.21.15.114:0/2559228376 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe13406e8a0 msgr2=0x7fe1340a7d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:57.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.477+0000 7fe13a708700 1 --2- 172.21.15.114:0/2559228376 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe13406e8a0 0x7fe1340a7d70 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fe124009fa0 tx=0x7fe12400d3b0 comp rx=0 tx=0).stop 2023-10-18T12:41:57.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.477+0000 7fe13a708700 1 -- 172.21.15.114:0/2559228376 shutdown_connections 2023-10-18T12:41:57.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.477+0000 7fe13a708700 1 --2- 172.21.15.114:0/2559228376 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe1140656f0 0x7fe114067bb0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:57.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.477+0000 7fe13a708700 1 --2- 172.21.15.114:0/2559228376 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe1340cb640 0x7fe1340af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:57.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.477+0000 7fe13a708700 1 --2- 172.21.15.114:0/2559228376 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe13415ee50 0x7fe1340af8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:57.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.477+0000 7fe13a708700 1 --2- 172.21.15.114:0/2559228376 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe13406e8a0 0x7fe1340a7d70 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:57.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.477+0000 7fe13a708700 1 -- 172.21.15.114:0/2559228376 >> 172.21.15.114:0/2559228376 conn(0x7fe13406a340 msgr2=0x7fe1340caec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:57.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.477+0000 7fe13a708700 1 -- 172.21.15.114:0/2559228376 shutdown_connections 2023-10-18T12:41:57.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.477+0000 7fe13a708700 1 -- 172.21.15.114:0/2559228376 wait complete. 2023-10-18T12:41:57.503 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-18T12:41:57.504 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T12:41:57.670 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.665+0000 7fd3a985e700 1 Processor -- start 2023-10-18T12:41:57.671 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.665+0000 7fd3a985e700 1 -- start start 2023-10-18T12:41:57.673 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.669+0000 7fd3a985e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd3a40d2e00 0x7fd3a40b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:57.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.669+0000 7fd3a985e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3a4160710 0x7fd3a40d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:57.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.669+0000 7fd3a985e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3a415d0d0 con 0x7fd3a40b5ae0 2023-10-18T12:41:57.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.669+0000 7fd3a985e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3a415df90 con 0x7fd3a40d2e00 2023-10-18T12:41:57.674 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.669+0000 7fd3a985e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a406f0f0 con 0x7fd3a4160710 2023-10-18T12:41:57.675 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.669+0000 7fd3a37fe700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fd3a40b5ae0 0x7fd3a406db60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:59392/0 (socket says 172.21.15.114:59392) 2023-10-18T12:41:57.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.669+0000 7fd3a37fe700 1 -- 172.21.15.114:0/2594417530 learned_addr learned my addr 172.21.15.114:0/2594417530 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:41:57.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.669+0000 7fd3a27fc700 1 --2- 172.21.15.114:0/2594417530 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3a4160710 0x7fd3a40d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:57.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.669+0000 7fd3a2ffd700 1 --2- 172.21.15.114:0/2594417530 >> v2:172.21.15.172:3300/0 conn(0x7fd3a40d2e00 0x7fd3a40b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:57.676 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.669+0000 7fd3a1ffb700 1 -- 172.21.15.114:0/2594417530 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 842770283 0 0) 0x7fd39c0014e0 con 0x7fd3a40b5ae0 2023-10-18T12:41:57.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.669+0000 7fd3a1ffb700 1 -- 172.21.15.114:0/2594417530 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd38c0035d0 con 0x7fd3a40b5ae0 2023-10-18T12:41:57.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.669+0000 7fd3a27fc700 1 -- 172.21.15.114:0/2594417530 >> v2:172.21.15.172:3300/0 conn(0x7fd3a40d2e00 msgr2=0x7fd3a40b6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:41:57.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.669+0000 7fd3a27fc700 1 --2- 172.21.15.114:0/2594417530 >> v2:172.21.15.172:3300/0 conn(0x7fd3a40d2e00 0x7fd3a40b6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:57.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.669+0000 7fd3a27fc700 1 -- 172.21.15.114:0/2594417530 >> v1:172.21.15.114:6789/0 conn(0x7fd3a40b5ae0 legacy=0x7fd3a406db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:57.677 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.669+0000 7fd3a27fc700 1 -- 172.21.15.114:0/2594417530 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a40d3720 con 0x7fd3a4160710 2023-10-18T12:41:57.678 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.669+0000 7fd3a27fc700 1 --2- 172.21.15.114:0/2594417530 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3a4160710 0x7fd3a40d31e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd398009880 tx=0x7fd398009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72b5189a53f1ea11 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:57.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.669+0000 7fd3a1ffb700 1 -- 172.21.15.114:0/2594417530 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd398011830 con 0x7fd3a4160710 2023-10-18T12:41:57.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.673+0000 7fd3a1ffb700 1 -- 172.21.15.114:0/2594417530 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd398011990 con 0x7fd3a4160710 2023-10-18T12:41:57.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.673+0000 7fd3a1ffb700 1 -- 172.21.15.114:0/2594417530 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd398011d00 con 0x7fd3a4160710 2023-10-18T12:41:57.679 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.673+0000 7fd3a985e700 1 -- 172.21.15.114:0/2594417530 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3a4160710 msgr2=0x7fd3a40d31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:57.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.673+0000 7fd3a985e700 1 --2- 172.21.15.114:0/2594417530 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3a4160710 0x7fd3a40d31e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd398009880 tx=0x7fd398009b90 comp rx=0 tx=0).stop 2023-10-18T12:41:57.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.673+0000 7fd3a985e700 1 -- 172.21.15.114:0/2594417530 shutdown_connections 2023-10-18T12:41:57.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.673+0000 7fd3a985e700 1 --2- 172.21.15.114:0/2594417530 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3a4160710 0x7fd3a40d31e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:57.680 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.673+0000 7fd3a985e700 1 --2- 172.21.15.114:0/2594417530 >> v2:172.21.15.172:3300/0 conn(0x7fd3a40d2e00 0x7fd3a40b6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:57.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.673+0000 7fd3a985e700 1 -- 172.21.15.114:0/2594417530 >> 172.21.15.114:0/2594417530 conn(0x7fd3a4069f20 msgr2=0x7fd3a406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:57.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.673+0000 7fd3a985e700 1 -- 172.21.15.114:0/2594417530 shutdown_connections 2023-10-18T12:41:57.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.673+0000 7fd3a985e700 1 -- 172.21.15.114:0/2594417530 wait complete. 2023-10-18T12:41:57.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.677+0000 7fd3a985e700 1 Processor -- start 2023-10-18T12:41:57.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.677+0000 7fd3a985e700 1 -- start start 2023-10-18T12:41:57.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.677+0000 7fd3a985e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3a40b5ae0 0x7fd3a414f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:57.683 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.677+0000 7fd3a985e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3a40d2e00 0x7fd3a40ae840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:57.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.677+0000 7fd3a985e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3a4160710 0x7fd3a415f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:57.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.677+0000 7fd3a985e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a414fb70 con 0x7fd3a40b5ae0 2023-10-18T12:41:57.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.677+0000 7fd3a985e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a40aed80 con 0x7fd3a40d2e00 2023-10-18T12:41:57.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.677+0000 7fd3a985e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a40ad7c0 con 0x7fd3a4160710 2023-10-18T12:41:57.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.677+0000 7fd3a2ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3a40b5ae0 0x7fd3a414f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:57.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.677+0000 7fd3a2ffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3a40b5ae0 0x7fd3a414f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44308/0 (socket says 172.21.15.114:44308) 2023-10-18T12:41:57.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.677+0000 7fd3a2ffd700 1 -- 172.21.15.114:0/183862780 learned_addr learned my addr 172.21.15.114:0/183862780 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:41:57.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.677+0000 7fd3a37fe700 1 --2- 172.21.15.114:0/183862780 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3a4160710 0x7fd3a415f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:57.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.681+0000 7fd3a27fc700 1 --2- 172.21.15.114:0/183862780 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3a40d2e00 0x7fd3a40ae840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:57.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.681+0000 7fd3a2ffd700 1 -- 172.21.15.114:0/183862780 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3a4160710 msgr2=0x7fd3a415f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:57.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.681+0000 7fd3a2ffd700 1 --2- 172.21.15.114:0/183862780 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3a4160710 0x7fd3a415f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:57.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.681+0000 7fd3a2ffd700 1 -- 172.21.15.114:0/183862780 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3a40d2e00 msgr2=0x7fd3a40ae840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:57.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.681+0000 7fd3a2ffd700 1 --2- 172.21.15.114:0/183862780 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3a40d2e00 0x7fd3a40ae840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:57.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.681+0000 7fd3a2ffd700 1 -- 172.21.15.114:0/183862780 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3980094b0 con 0x7fd3a40b5ae0 2023-10-18T12:41:57.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.681+0000 7fd3a2ffd700 1 --2- 172.21.15.114:0/183862780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3a40b5ae0 0x7fd3a414f180 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fd39400e840 tx=0x7fd39400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:57.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.681+0000 7fd38bfff700 1 -- 172.21.15.114:0/183862780 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3940095a0 con 0x7fd3a40b5ae0 2023-10-18T12:41:57.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.681+0000 7fd38bfff700 1 -- 172.21.15.114:0/183862780 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd394013680 con 0x7fd3a40b5ae0 2023-10-18T12:41:57.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.681+0000 7fd38bfff700 1 -- 172.21.15.114:0/183862780 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3940139f0 con 0x7fd3a40b5ae0 2023-10-18T12:41:57.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.681+0000 7fd3a985e700 1 -- 172.21.15.114:0/183862780 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3a40adaa0 con 0x7fd3a40b5ae0 2023-10-18T12:41:57.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.681+0000 7fd3a985e700 1 -- 172.21.15.114:0/183862780 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3a40ae060 con 0x7fd3a40b5ae0 2023-10-18T12:41:57.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.681+0000 7fd3a985e700 1 -- 172.21.15.114:0/183862780 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3a4072e60 con 0x7fd3a40b5ae0 2023-10-18T12:41:57.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.685+0000 7fd38bfff700 1 -- 172.21.15.114:0/183862780 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fd394013b50 con 0x7fd3a40b5ae0 2023-10-18T12:41:57.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.685+0000 7fd38bfff700 1 --2- 172.21.15.114:0/183862780 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd390065720 0x7fd390067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:57.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.685+0000 7fd38bfff700 1 -- 172.21.15.114:0/183862780 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7fd394082f90 con 0x7fd3a40b5ae0 2023-10-18T12:41:57.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.689+0000 7fd3a27fc700 1 --2- 172.21.15.114:0/183862780 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd390065720 0x7fd390067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:57.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.689+0000 7fd3a27fc700 1 --2- 172.21.15.114:0/183862780 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd390065720 0x7fd390067be0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd398009880 tx=0x7fd398008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:57.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.693+0000 7fd38bfff700 1 -- 172.21.15.114:0/183862780 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fd3940541b0 con 0x7fd3a40b5ae0 2023-10-18T12:41:57.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.917+0000 7fd3a985e700 1 -- 172.21.15.114:0/183862780 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3a406d3e0 con 0x7fd3a40b5ae0 2023-10-18T12:41:57.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.921+0000 7fd38bfff700 1 -- 172.21.15.114:0/183862780 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4889 (secure 0 0 0) 0x7fd394053d40 con 0x7fd3a40b5ae0 2023-10-18T12:41:57.925 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:41:57.926 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2034957068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2034957068},{"type":"v1","addr":"172.21.15.172:6836","nonce":2034957068}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5039,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4215710360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4215710360},{"type":"v1","addr":"172.21.15.172:6837","nonce":4215710360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2387835210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2387835210},{"type":"v1","addr":"172.21.15.114:6833","nonce":2387835210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T12:21:14.159069+0000","modified":"2023-10-18T12:29:23.762500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":126,"addr":"172.21.15.114:6835/1284474820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1284474820},{"type":"v1","addr":"172.21.15.114:6835","nonce":1284474820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-18T12:41:57.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.921+0000 7fd3a985e700 1 -- 172.21.15.114:0/183862780 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd390065720 msgr2=0x7fd390067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:57.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.921+0000 7fd3a985e700 1 --2- 172.21.15.114:0/183862780 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd390065720 0x7fd390067be0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd398009880 tx=0x7fd398008030 comp rx=0 tx=0).stop 2023-10-18T12:41:57.928 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.921+0000 7fd3a985e700 1 -- 172.21.15.114:0/183862780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3a40b5ae0 msgr2=0x7fd3a414f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:57.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.921+0000 7fd3a985e700 1 --2- 172.21.15.114:0/183862780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3a40b5ae0 0x7fd3a414f180 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fd39400e840 tx=0x7fd39400eb50 comp rx=0 tx=0).stop 2023-10-18T12:41:57.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.925+0000 7fd3a985e700 1 -- 172.21.15.114:0/183862780 shutdown_connections 2023-10-18T12:41:57.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.925+0000 7fd3a985e700 1 --2- 172.21.15.114:0/183862780 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd390065720 0x7fd390067be0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:57.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.925+0000 7fd3a985e700 1 --2- 172.21.15.114:0/183862780 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd3a4160710 0x7fd3a415f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:57.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.925+0000 7fd3a985e700 1 --2- 172.21.15.114:0/183862780 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3a40d2e00 0x7fd3a40ae840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:57.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.925+0000 7fd3a985e700 1 --2- 172.21.15.114:0/183862780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3a40b5ae0 0x7fd3a414f180 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:57.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.925+0000 7fd3a985e700 1 -- 172.21.15.114:0/183862780 >> 172.21.15.114:0/183862780 conn(0x7fd3a4069f20 msgr2=0x7fd3a40d1330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:57.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.925+0000 7fd3a985e700 1 -- 172.21.15.114:0/183862780 shutdown_connections 2023-10-18T12:41:57.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:57.925+0000 7fd3a985e700 1 -- 172.21.15.114:0/183862780 wait complete. 2023-10-18T12:41:57.931 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 20 2023-10-18T12:41:57.949 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T12:41:58.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.117+0000 7f6f5af8b700 1 Processor -- start 2023-10-18T12:41:58.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.117+0000 7f6f5af8b700 1 -- start start 2023-10-18T12:41:58.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.117+0000 7f6f5af8b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6f54164a20 0x7f6f540cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:58.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.117+0000 7f6f5af8b700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6f5406ce20 0x7f6f5406d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:58.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.117+0000 7f6f5af8b700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f540ca4c0 con 0x7f6f540b3d40 2023-10-18T12:41:58.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.117+0000 7f6f5af8b700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f5406e2d0 con 0x7f6f5406ce20 2023-10-18T12:41:58.124 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.117+0000 7f6f5af8b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5406d7d0 con 0x7f6f54164a20 2023-10-18T12:41:58.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.121+0000 7f6f5a78a700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6f5406ce20 0x7f6f5406d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:58.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.121+0000 7f6f5a78a700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f6f5406ce20 0x7f6f5406d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44320/0 (socket says 172.21.15.114:44320) 2023-10-18T12:41:58.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.121+0000 7f6f5a78a700 1 -- 172.21.15.114:0/2699806670 learned_addr learned my addr 172.21.15.114:0/2699806670 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:41:58.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.121+0000 7f6f59788700 1 --2- 172.21.15.114:0/2699806670 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6f54164a20 0x7f6f540cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:58.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.121+0000 7f6f5a78a700 1 -- 172.21.15.114:0/2699806670 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6f54164a20 msgr2=0x7f6f540cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:41:58.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.121+0000 7f6f5a78a700 1 --2- 172.21.15.114:0/2699806670 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6f54164a20 0x7f6f540cc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:58.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.121+0000 7f6f5a78a700 1 -- 172.21.15.114:0/2699806670 >> v1:172.21.15.172:6789/0 conn(0x7f6f540b3d40 legacy=0x7f6f540c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:58.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.121+0000 7f6f5a78a700 1 -- 172.21.15.114:0/2699806670 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f540ca7a0 con 0x7f6f5406ce20 2023-10-18T12:41:58.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.121+0000 7f6f5a78a700 1 --2- 172.21.15.114:0/2699806670 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f5406ce20 0x7f6f5406d290 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c009e50 tx=0x7f6f4c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=660c6fbc5cc73143 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:58.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.121+0000 7f6f58f87700 1 -- 172.21.15.114:0/2699806670 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c00e070 con 0x7f6f5406ce20 2023-10-18T12:41:58.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.121+0000 7f6f58f87700 1 -- 172.21.15.114:0/2699806670 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4c00b910 con 0x7f6f5406ce20 2023-10-18T12:41:58.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.121+0000 7f6f58f87700 1 -- 172.21.15.114:0/2699806670 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c00bcc0 con 0x7f6f5406ce20 2023-10-18T12:41:58.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.121+0000 7f6f5af8b700 1 -- 172.21.15.114:0/2699806670 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f5406ce20 msgr2=0x7f6f5406d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:58.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.121+0000 7f6f5af8b700 1 --2- 172.21.15.114:0/2699806670 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f5406ce20 0x7f6f5406d290 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c009e50 tx=0x7f6f4c00b330 comp rx=0 tx=0).stop 2023-10-18T12:41:58.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.121+0000 7f6f5af8b700 1 -- 172.21.15.114:0/2699806670 shutdown_connections 2023-10-18T12:41:58.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.121+0000 7f6f5af8b700 1 --2- 172.21.15.114:0/2699806670 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f5406ce20 0x7f6f5406d290 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:58.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.121+0000 7f6f5af8b700 1 --2- 172.21.15.114:0/2699806670 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6f54164a20 0x7f6f540cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:58.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.121+0000 7f6f5af8b700 1 -- 172.21.15.114:0/2699806670 >> 172.21.15.114:0/2699806670 conn(0x7f6f540ce5c0 msgr2=0x7f6f540ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:58.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.125+0000 7f6f5af8b700 1 -- 172.21.15.114:0/2699806670 shutdown_connections 2023-10-18T12:41:58.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.125+0000 7f6f5af8b700 1 -- 172.21.15.114:0/2699806670 wait complete. 2023-10-18T12:41:58.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.125+0000 7f6f5af8b700 1 Processor -- start 2023-10-18T12:41:58.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.125+0000 7f6f5af8b700 1 -- start start 2023-10-18T12:41:58.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.125+0000 7f6f5af8b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f5406ce20 0x7f6f54146030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:58.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.125+0000 7f6f5af8b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6f540b3d40 0x7f6f540c3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:58.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.125+0000 7f6f5af8b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f54164a20 0x7f6f540c5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:58.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.125+0000 7f6f5af8b700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f541471e0 con 0x7f6f5406ce20 2023-10-18T12:41:58.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.125+0000 7f6f5af8b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f54147670 con 0x7f6f54164a20 2023-10-18T12:41:58.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.125+0000 7f6f5af8b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f540c43e0 con 0x7f6f540b3d40 2023-10-18T12:41:58.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.125+0000 7f6f59f89700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f5406ce20 0x7f6f54146030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:58.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.129+0000 7f6f5a78a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f54164a20 0x7f6f540c5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:58.134 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.129+0000 7f6f59f89700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f5406ce20 0x7f6f54146030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44324/0 (socket says 172.21.15.114:44324) 2023-10-18T12:41:58.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.129+0000 7f6f59f89700 1 -- 172.21.15.114:0/2611378378 learned_addr learned my addr 172.21.15.114:0/2611378378 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:41:58.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.129+0000 7f6f59788700 1 --2- 172.21.15.114:0/2611378378 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6f540b3d40 0x7f6f540c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:58.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.129+0000 7f6f59f89700 1 -- 172.21.15.114:0/2611378378 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6f540b3d40 msgr2=0x7f6f540c3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:58.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.129+0000 7f6f59f89700 1 --2- 172.21.15.114:0/2611378378 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6f540b3d40 0x7f6f540c3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:58.135 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.129+0000 7f6f59f89700 1 -- 172.21.15.114:0/2611378378 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f54164a20 msgr2=0x7f6f540c5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:58.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.129+0000 7f6f59f89700 1 --2- 172.21.15.114:0/2611378378 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f54164a20 0x7f6f540c5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:58.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.129+0000 7f6f59f89700 1 -- 172.21.15.114:0/2611378378 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f4c009b30 con 0x7f6f5406ce20 2023-10-18T12:41:58.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.129+0000 7f6f59f89700 1 --2- 172.21.15.114:0/2611378378 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f5406ce20 0x7f6f54146030 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f6f5000c500 tx=0x7f6f5000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:58.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.129+0000 7f6f4a7fc700 1 -- 172.21.15.114:0/2611378378 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f500052d0 con 0x7f6f5406ce20 2023-10-18T12:41:58.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.129+0000 7f6f4a7fc700 1 -- 172.21.15.114:0/2611378378 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f50005430 con 0x7f6f5406ce20 2023-10-18T12:41:58.136 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.129+0000 7f6f5af8b700 1 -- 172.21.15.114:0/2611378378 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f541468b0 con 0x7f6f5406ce20 2023-10-18T12:41:58.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.129+0000 7f6f4a7fc700 1 -- 172.21.15.114:0/2611378378 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f500055a0 con 0x7f6f5406ce20 2023-10-18T12:41:58.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.129+0000 7f6f5af8b700 1 -- 172.21.15.114:0/2611378378 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f54146e70 con 0x7f6f5406ce20 2023-10-18T12:41:58.137 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.129+0000 7f6f5af8b700 1 -- 172.21.15.114:0/2611378378 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f54072e60 con 0x7f6f5406ce20 2023-10-18T12:41:58.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.133+0000 7f6f4a7fc700 1 -- 172.21.15.114:0/2611378378 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f6f500038e0 con 0x7f6f5406ce20 2023-10-18T12:41:58.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.133+0000 7f6f4a7fc700 1 --2- 172.21.15.114:0/2611378378 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6f380656f0 0x7f6f38067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:58.139 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.133+0000 7f6f4a7fc700 1 -- 172.21.15.114:0/2611378378 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7f6f500823e0 con 0x7f6f5406ce20 2023-10-18T12:41:58.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.133+0000 7f6f59788700 1 --2- 172.21.15.114:0/2611378378 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6f380656f0 0x7f6f38067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:58.140 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.137+0000 7f6f59788700 1 --2- 172.21.15.114:0/2611378378 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6f380656f0 0x7f6f38067bb0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6f541556a0 tx=0x7f6f44009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:58.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.141+0000 7f6f4a7fc700 1 -- 172.21.15.114:0/2611378378 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f6f5004fc10 con 0x7f6f5406ce20 2023-10-18T12:41:58.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.377+0000 7f6f5af8b700 1 -- 172.21.15.114:0/2611378378 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f5406d3a0 con 0x7f6f5406ce20 2023-10-18T12:41:58.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.377+0000 7f6f4a7fc700 1 -- 172.21.15.114:0/2611378378 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4889 (secure 0 0 0) 0x7f6f50053230 con 0x7f6f5406ce20 2023-10-18T12:41:58.382 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:41:58.383 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2034957068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2034957068},{"type":"v1","addr":"172.21.15.172:6836","nonce":2034957068}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5039,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4215710360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4215710360},{"type":"v1","addr":"172.21.15.172:6837","nonce":4215710360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2387835210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2387835210},{"type":"v1","addr":"172.21.15.114:6833","nonce":2387835210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-18T12:21:14.159069+0000","modified":"2023-10-18T12:29:23.762500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5544},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5544":{"gid":5544,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":126,"addr":"172.21.15.114:6835/1284474820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":1284474820},{"type":"v1","addr":"172.21.15.114:6835","nonce":1284474820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-18T12:41:58.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.381+0000 7f6f5af8b700 1 -- 172.21.15.114:0/2611378378 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6f380656f0 msgr2=0x7f6f38067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:58.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.381+0000 7f6f5af8b700 1 --2- 172.21.15.114:0/2611378378 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6f380656f0 0x7f6f38067bb0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6f541556a0 tx=0x7f6f44009240 comp rx=0 tx=0).stop 2023-10-18T12:41:58.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.381+0000 7f6f5af8b700 1 -- 172.21.15.114:0/2611378378 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f5406ce20 msgr2=0x7f6f54146030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:58.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.381+0000 7f6f5af8b700 1 --2- 172.21.15.114:0/2611378378 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f5406ce20 0x7f6f54146030 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f6f5000c500 tx=0x7f6f5000c810 comp rx=0 tx=0).stop 2023-10-18T12:41:58.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.381+0000 7f6f5af8b700 1 -- 172.21.15.114:0/2611378378 shutdown_connections 2023-10-18T12:41:58.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.381+0000 7f6f5af8b700 1 --2- 172.21.15.114:0/2611378378 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f6f380656f0 0x7f6f38067bb0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:58.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.381+0000 7f6f5af8b700 1 --2- 172.21.15.114:0/2611378378 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f6f540b3d40 0x7f6f540c3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:58.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.381+0000 7f6f5af8b700 1 --2- 172.21.15.114:0/2611378378 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6f54164a20 0x7f6f540c5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:58.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.381+0000 7f6f5af8b700 1 --2- 172.21.15.114:0/2611378378 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f5406ce20 0x7f6f54146030 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:58.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.381+0000 7f6f5af8b700 1 -- 172.21.15.114:0/2611378378 >> 172.21.15.114:0/2611378378 conn(0x7f6f540ce5c0 msgr2=0x7f6f54070b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:58.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.381+0000 7f6f5af8b700 1 -- 172.21.15.114:0/2611378378 shutdown_connections 2023-10-18T12:41:58.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.381+0000 7f6f5af8b700 1 -- 172.21.15.114:0/2611378378 wait complete. 2023-10-18T12:41:58.388 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 20 2023-10-18T12:41:58.413 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T12:41:58.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.573+0000 7f970be62700 1 Processor -- start 2023-10-18T12:41:58.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.573+0000 7f970be62700 1 -- start start 2023-10-18T12:41:58.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.577+0000 7f970be62700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f97040cc190 0x7f97040b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:58.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.577+0000 7f970be62700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f97040b4140 0x7f97040ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:58.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.577+0000 7f970be62700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f970415e000 con 0x7f97040cdd90 2023-10-18T12:41:58.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.577+0000 7f970be62700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97040b45d0 con 0x7f97040b4140 2023-10-18T12:41:58.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.577+0000 7f970be62700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97040ce170 con 0x7f97040cc190 2023-10-18T12:41:58.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.577+0000 7f9709bfe700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f97040cdd90 0x7f970406d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:59396/0 (socket says 172.21.15.114:59396) 2023-10-18T12:41:58.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.577+0000 7f9709bfe700 1 -- 172.21.15.114:0/2327797710 learned_addr learned my addr 172.21.15.114:0/2327797710 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:41:58.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.577+0000 7f970a3ff700 1 --2- 172.21.15.114:0/2327797710 >> v2:172.21.15.114:3300/0 conn(0x7f97040b4140 0x7f97040ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:58.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.581+0000 7f97093fd700 1 --2- 172.21.15.114:0/2327797710 >> v2:172.21.15.172:3300/0 conn(0x7f97040cc190 0x7f97040b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:58.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.581+0000 7f9708bfc700 1 -- 172.21.15.114:0/2327797710 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 774617193 0 0) 0x7f970415e000 con 0x7f97040cdd90 2023-10-18T12:41:58.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.581+0000 7f9708bfc700 1 -- 172.21.15.114:0/2327797710 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96f00035d0 con 0x7f97040cdd90 2023-10-18T12:41:58.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.581+0000 7f970a3ff700 1 -- 172.21.15.114:0/2327797710 >> v2:172.21.15.172:3300/0 conn(0x7f97040cc190 msgr2=0x7f97040b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:41:58.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.581+0000 7f970a3ff700 1 --2- 172.21.15.114:0/2327797710 >> v2:172.21.15.172:3300/0 conn(0x7f97040cc190 0x7f97040b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:58.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.581+0000 7f970a3ff700 1 -- 172.21.15.114:0/2327797710 >> v1:172.21.15.114:6789/0 conn(0x7f97040cdd90 legacy=0x7f970406d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:58.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.581+0000 7f970a3ff700 1 -- 172.21.15.114:0/2327797710 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f970415d3f0 con 0x7f97040b4140 2023-10-18T12:41:58.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.581+0000 7f970a3ff700 1 --2- 172.21.15.114:0/2327797710 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97040b4140 0x7f97040ca0a0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f97040c8b70 tx=0x7f96fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d9d45b94a27a8d server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:58.588 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.581+0000 7f9708bfc700 1 -- 172.21.15.114:0/2327797710 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96fc00e070 con 0x7f97040b4140 2023-10-18T12:41:58.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.581+0000 7f9708bfc700 1 -- 172.21.15.114:0/2327797710 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96fc00bb20 con 0x7f97040b4140 2023-10-18T12:41:58.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.581+0000 7f9708bfc700 1 -- 172.21.15.114:0/2327797710 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96fc012430 con 0x7f97040b4140 2023-10-18T12:41:58.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.581+0000 7f970be62700 1 -- 172.21.15.114:0/2327797710 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97040b4140 msgr2=0x7f97040ca0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:58.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.581+0000 7f970be62700 1 --2- 172.21.15.114:0/2327797710 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97040b4140 0x7f97040ca0a0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f97040c8b70 tx=0x7f96fc00b330 comp rx=0 tx=0).stop 2023-10-18T12:41:58.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.581+0000 7f970be62700 1 -- 172.21.15.114:0/2327797710 shutdown_connections 2023-10-18T12:41:58.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.581+0000 7f970be62700 1 --2- 172.21.15.114:0/2327797710 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97040b4140 0x7f97040ca0a0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:58.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.581+0000 7f970be62700 1 --2- 172.21.15.114:0/2327797710 >> v2:172.21.15.172:3300/0 conn(0x7f97040cc190 0x7f97040b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:58.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.581+0000 7f970be62700 1 -- 172.21.15.114:0/2327797710 >> 172.21.15.114:0/2327797710 conn(0x7f97040ce5c0 msgr2=0x7f97040ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:58.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.581+0000 7f970be62700 1 -- 172.21.15.114:0/2327797710 shutdown_connections 2023-10-18T12:41:58.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.581+0000 7f970be62700 1 -- 172.21.15.114:0/2327797710 wait complete. 2023-10-18T12:41:58.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.585+0000 7f970be62700 1 Processor -- start 2023-10-18T12:41:58.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.585+0000 7f970be62700 1 -- start start 2023-10-18T12:41:58.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.585+0000 7f970be62700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97040b4140 0x7f9704144140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:58.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.585+0000 7f970be62700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f97040cc190 0x7f970415fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:58.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.585+0000 7f970be62700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97040cdd90 0x7f970415e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:58.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.585+0000 7f970be62700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970415f600 con 0x7f97040b4140 2023-10-18T12:41:58.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.585+0000 7f970be62700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970415e9f0 con 0x7f97040cdd90 2023-10-18T12:41:58.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.585+0000 7f970be62700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f970415ecd0 con 0x7f97040cc190 2023-10-18T12:41:58.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.589+0000 7f9709bfe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97040b4140 0x7f9704144140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:58.595 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.589+0000 7f9709bfe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97040b4140 0x7f9704144140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44344/0 (socket says 172.21.15.114:44344) 2023-10-18T12:41:58.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.589+0000 7f9709bfe700 1 -- 172.21.15.114:0/752981277 learned_addr learned my addr 172.21.15.114:0/752981277 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:41:58.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.589+0000 7f970a3ff700 1 --2- 172.21.15.114:0/752981277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97040cdd90 0x7f970415e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:58.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.589+0000 7f97093fd700 1 --2- 172.21.15.114:0/752981277 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f97040cc190 0x7f970415fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:58.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.589+0000 7f9709bfe700 1 -- 172.21.15.114:0/752981277 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f97040cc190 msgr2=0x7f970415fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:58.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.589+0000 7f9709bfe700 1 --2- 172.21.15.114:0/752981277 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f97040cc190 0x7f970415fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:58.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.589+0000 7f9709bfe700 1 -- 172.21.15.114:0/752981277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97040cdd90 msgr2=0x7f970415e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:58.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.589+0000 7f9709bfe700 1 --2- 172.21.15.114:0/752981277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97040cdd90 0x7f970415e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:58.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.589+0000 7f9709bfe700 1 -- 172.21.15.114:0/752981277 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96fc009a70 con 0x7f97040b4140 2023-10-18T12:41:58.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.589+0000 7f9709bfe700 1 --2- 172.21.15.114:0/752981277 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97040b4140 0x7f9704144140 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f970000c700 tx=0x7f970000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:58.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.589+0000 7f96fa7fc700 1 -- 172.21.15.114:0/752981277 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9700005d90 con 0x7f97040b4140 2023-10-18T12:41:58.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.589+0000 7f96fa7fc700 1 -- 172.21.15.114:0/752981277 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97000070d0 con 0x7f97040b4140 2023-10-18T12:41:58.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.589+0000 7f970be62700 1 -- 172.21.15.114:0/752981277 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f970415efb0 con 0x7f97040b4140 2023-10-18T12:41:58.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.589+0000 7f96fa7fc700 1 -- 172.21.15.114:0/752981277 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9700007480 con 0x7f97040b4140 2023-10-18T12:41:58.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.589+0000 7f970be62700 1 -- 172.21.15.114:0/752981277 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97040b14a0 con 0x7f97040b4140 2023-10-18T12:41:58.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.589+0000 7f970be62700 1 -- 172.21.15.114:0/752981277 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9704072e60 con 0x7f97040b4140 2023-10-18T12:41:58.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.593+0000 7f96fa7fc700 1 -- 172.21.15.114:0/752981277 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f97000075e0 con 0x7f97040b4140 2023-10-18T12:41:58.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.593+0000 7f96fa7fc700 1 --2- 172.21.15.114:0/752981277 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f96e80656f0 0x7f96e8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:58.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.593+0000 7f96fa7fc700 1 -- 172.21.15.114:0/752981277 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7f97000824b0 con 0x7f97040b4140 2023-10-18T12:41:58.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.593+0000 7f97093fd700 1 --2- 172.21.15.114:0/752981277 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f96e80656f0 0x7f96e8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:58.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.597+0000 7f97093fd700 1 --2- 172.21.15.114:0/752981277 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f96e80656f0 0x7f96e8067bb0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9704147c40 tx=0x7f96f4009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:58.605 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.601+0000 7f96fa7fc700 1 -- 172.21.15.114:0/752981277 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f970004fce0 con 0x7f97040b4140 2023-10-18T12:41:58.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.777+0000 7f970be62700 1 -- 172.21.15.114:0/752981277 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9704158a60 con 0x7f97040b4140 2023-10-18T12:41:58.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.781+0000 7f96fa7fc700 1 -- 172.21.15.114:0/752981277 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+19138 (secure 0 0 0) 0x7f9700017090 con 0x7f97040b4140 2023-10-18T12:41:58.786 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:41:58.786 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":60,"fsid":"240ea340-5d3d-4f52-a4bc-af075aca3deb","created":"2023-10-18T12:19:12.512994+0000","modified":"2023-10-18T12:30:22.735724+0000","last_up_change":"2023-10-18T12:29:29.654825+0000","last_in_change":"2023-10-18T12:19:15.850693+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T12:19:27.040638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-18T12:19:32.358094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-18T12:21:12.105324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-18T12:21:13.154105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c3578978-1a03-4857-b9d2-34a5da3d7731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":49,"up_from":56,"up_thru":57,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1953670272},{"type":"v1","addr":"172.21.15.114:6817","nonce":1953670272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1953670272},{"type":"v1","addr":"172.21.15.114:6820","nonce":1953670272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1953670272},{"type":"v1","addr":"172.21.15.114:6830","nonce":1953670272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":1953670272},{"type":"v1","addr":"172.21.15.114:6825","nonce":1953670272}]},"public_addr":"172.21.15.114:6817/1953670272","cluster_addr":"172.21.15.114:6820/1953670272","heartbeat_back_addr":"172.21.15.114:6830/1953670272","heartbeat_front_addr":"172.21.15.114:6825/1953670272","state":["exists","up"]},{"osd":1,"uuid":"43eb26a6-e2b3-4670-9559-bd053b5140d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6801","nonce":3302727047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6803","nonce":3302727047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6807","nonce":3302727047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6805","nonce":3302727047}]},"public_addr":"172.21.15.114:6801/3302727047","cluster_addr":"172.21.15.114:6803/3302727047","heartbeat_back_addr":"172.21.15.114:6807/3302727047","heartbeat_front_addr":"172.21.15.114:6805/3302727047","state":["exists","up"]},{"osd":2,"uuid":"f3d4dbd5-521c-4dd2-b687-5768cc7d0938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6809","nonce":2699151351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6811","nonce":2699151351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6815","nonce":2699151351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6813","nonce":2699151351}]},"public_addr":"172.21.15.114:6809/2699151351","cluster_addr":"172.21.15.114:6811/2699151351","heartbeat_back_addr":"172.21.15.114:6815/2699151351","heartbeat_front_addr":"172.21.15.114:6813/2699151351","state":["exists","up"]},{"osd":3,"uuid":"823e5802-92b7-4f0d-b32d-a5748993f1b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6821","nonce":1361608073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6824","nonce":1361608073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6829","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6831","nonce":1361608073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6827","nonce":1361608073}]},"public_addr":"172.21.15.114:6821/1361608073","cluster_addr":"172.21.15.114:6824/1361608073","heartbeat_back_addr":"172.21.15.114:6831/1361608073","heartbeat_front_addr":"172.21.15.114:6827/1361608073","state":["exists","up"]},{"osd":4,"uuid":"e47fb93e-13b4-44a4-b084-8c4384ceb41e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6801","nonce":930839681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6803","nonce":930839681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6807","nonce":930839681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6805","nonce":930839681}]},"public_addr":"172.21.15.172:6801/930839681","cluster_addr":"172.21.15.172:6803/930839681","heartbeat_back_addr":"172.21.15.172:6807/930839681","heartbeat_front_addr":"172.21.15.172:6805/930839681","state":["exists","up"]},{"osd":5,"uuid":"7561a973-f479-45a0-af40-f324728d622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6814","nonce":571761850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6818","nonce":571761850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6824","nonce":571761850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6821","nonce":571761850}]},"public_addr":"172.21.15.172:6814/571761850","cluster_addr":"172.21.15.172:6818/571761850","heartbeat_back_addr":"172.21.15.172:6824/571761850","heartbeat_front_addr":"172.21.15.172:6821/571761850","state":["exists","up"]},{"osd":6,"uuid":"51753f4b-7f06-4f1c-9ec7-6e18a66eb980","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6825","nonce":1680398853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6827","nonce":1680398853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6831","nonce":1680398853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6829","nonce":1680398853}]},"public_addr":"172.21.15.172:6825/1680398853","cluster_addr":"172.21.15.172:6827/1680398853","heartbeat_back_addr":"172.21.15.172:6831/1680398853","heartbeat_front_addr":"172.21.15.172:6829/1680398853","state":["exists","up"]},{"osd":7,"uuid":"4d8b1e15-143d-4d17-9074-59d92f0f9af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6809","nonce":349710101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6811","nonce":349710101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6819","nonce":349710101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6815","nonce":349710101}]},"public_addr":"172.21.15.172:6809/349710101","cluster_addr":"172.21.15.172:6811/349710101","heartbeat_back_addr":"172.21.15.172:6819/349710101","heartbeat_front_addr":"172.21.15.172:6815/349710101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"2023-10-18T12:21:50.537022+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.889460+0000","dead_epoch":50},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.475494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.911473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.648596+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.609994+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.636248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.854589+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.885826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.5","mappings":[{"from":7,"to":0}]},{"pgid":"6.9","mappings":[{"from":7,"to":2}]},{"pgid":"6.c","mappings":[{"from":3,"to":0}]},{"pgid":"6.11","mappings":[{"from":3,"to":2}]},{"pgid":"6.1d","mappings":[{"from":5,"to":0}]},{"pgid":"7.12","mappings":[{"from":6,"to":4}]},{"pgid":"7.2d","mappings":[{"from":0,"to":4}]},{"pgid":"7.30","mappings":[{"from":6,"to":4}]},{"pgid":"7.35","mappings":[{"from":0,"to":5}]},{"pgid":"7.36","mappings":[{"from":6,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:0/1817588655":"2023-10-18T13:29:19.822093+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T12:41:58.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.785+0000 7f970be62700 1 -- 172.21.15.114:0/752981277 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f96e80656f0 msgr2=0x7f96e8067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:58.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.785+0000 7f970be62700 1 --2- 172.21.15.114:0/752981277 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f96e80656f0 0x7f96e8067bb0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9704147c40 tx=0x7f96f4009240 comp rx=0 tx=0).stop 2023-10-18T12:41:58.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.785+0000 7f970be62700 1 -- 172.21.15.114:0/752981277 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97040b4140 msgr2=0x7f9704144140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:58.790 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.785+0000 7f970be62700 1 --2- 172.21.15.114:0/752981277 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97040b4140 0x7f9704144140 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f970000c700 tx=0x7f970000ca10 comp rx=0 tx=0).stop 2023-10-18T12:41:58.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.785+0000 7f970be62700 1 -- 172.21.15.114:0/752981277 shutdown_connections 2023-10-18T12:41:58.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.785+0000 7f970be62700 1 --2- 172.21.15.114:0/752981277 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f96e80656f0 0x7f96e8067bb0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:58.791 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.785+0000 7f970be62700 1 --2- 172.21.15.114:0/752981277 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f97040cc190 0x7f970415fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:58.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.785+0000 7f970be62700 1 --2- 172.21.15.114:0/752981277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f97040cdd90 0x7f970415e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:58.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.785+0000 7f970be62700 1 --2- 172.21.15.114:0/752981277 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97040b4140 0x7f9704144140 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:58.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.785+0000 7f970be62700 1 -- 172.21.15.114:0/752981277 >> 172.21.15.114:0/752981277 conn(0x7f97040ce5c0 msgr2=0x7f97040c41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:58.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.785+0000 7f970be62700 1 -- 172.21.15.114:0/752981277 shutdown_connections 2023-10-18T12:41:58.792 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.785+0000 7f970be62700 1 -- 172.21.15.114:0/752981277 wait complete. 2023-10-18T12:41:58.810 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-18T12:41:58.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.977+0000 7fad5abe8700 1 Processor -- start 2023-10-18T12:41:58.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.977+0000 7fad5abe8700 1 -- start start 2023-10-18T12:41:58.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.981+0000 7fad5abe8700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fad54146800 0x7fad540b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:58.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.981+0000 7fad5abe8700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad5415e680 con 0x7fad540700b0 2023-10-18T12:41:58.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.981+0000 7fad5abe8700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad540b6180 con 0x7fad5415dd30 2023-10-18T12:41:58.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.981+0000 7fad5abe8700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad540b6460 con 0x7fad54146800 2023-10-18T12:41:58.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.981+0000 7fad59185700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fad540700b0 0x7fad5415eb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:59398/0 (socket says 172.21.15.114:59398) 2023-10-18T12:41:58.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.981+0000 7fad59185700 1 -- 172.21.15.114:0/167752548 learned_addr learned my addr 172.21.15.114:0/167752548 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:41:58.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.981+0000 7fad58984700 1 --2- 172.21.15.114:0/167752548 >> v2:172.21.15.114:3300/0 conn(0x7fad54146800 0x7fad540b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:58.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.981+0000 7fad58984700 1 -- 172.21.15.114:0/167752548 >> v1:172.21.15.172:6789/0 conn(0x7fad5415dd30 legacy=0x7fad5406f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:58.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.981+0000 7fad58984700 1 -- 172.21.15.114:0/167752548 >> v1:172.21.15.114:6789/0 conn(0x7fad540700b0 legacy=0x7fad5415eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:58.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.981+0000 7fad58984700 1 -- 172.21.15.114:0/167752548 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad540b6740 con 0x7fad54146800 2023-10-18T12:41:58.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.981+0000 7fad58984700 1 --2- 172.21.15.114:0/167752548 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad54146800 0x7fad540b5b80 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fad48009850 tx=0x7fad48009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=412a222ee5acf661 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:58.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.981+0000 7fad537fe700 1 -- 172.21.15.114:0/167752548 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad48011830 con 0x7fad54146800 2023-10-18T12:41:58.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.981+0000 7fad537fe700 1 -- 172.21.15.114:0/167752548 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad48011990 con 0x7fad54146800 2023-10-18T12:41:58.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.981+0000 7fad537fe700 1 -- 172.21.15.114:0/167752548 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad48011d20 con 0x7fad54146800 2023-10-18T12:41:58.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.985+0000 7fad5abe8700 1 -- 172.21.15.114:0/167752548 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad54146800 msgr2=0x7fad540b5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:58.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.985+0000 7fad5abe8700 1 --2- 172.21.15.114:0/167752548 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad54146800 0x7fad540b5b80 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fad48009850 tx=0x7fad48009b60 comp rx=0 tx=0).stop 2023-10-18T12:41:58.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.985+0000 7fad5abe8700 1 -- 172.21.15.114:0/167752548 shutdown_connections 2023-10-18T12:41:58.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.985+0000 7fad5abe8700 1 --2- 172.21.15.114:0/167752548 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad54146800 0x7fad540b5b80 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:58.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.985+0000 7fad5abe8700 1 -- 172.21.15.114:0/167752548 >> 172.21.15.114:0/167752548 conn(0x7fad5406a130 msgr2=0x7fad5406a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:58.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.985+0000 7fad5abe8700 1 -- 172.21.15.114:0/167752548 shutdown_connections 2023-10-18T12:41:58.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.985+0000 7fad5abe8700 1 -- 172.21.15.114:0/167752548 wait complete. 2023-10-18T12:41:58.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.985+0000 7fad5abe8700 1 Processor -- start 2023-10-18T12:41:58.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.985+0000 7fad5abe8700 1 -- start start 2023-10-18T12:41:58.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.989+0000 7fad5abe8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad540700b0 0x7fad5413cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:58.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.989+0000 7fad5abe8700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad54146800 0x7fad5413dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:58.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.989+0000 7fad5abe8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad5415dd30 0x7fad541407e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:58.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.989+0000 7fad5abe8700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5413e5e0 con 0x7fad54146800 2023-10-18T12:41:58.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.989+0000 7fad5abe8700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5413e8c0 con 0x7fad540700b0 2023-10-18T12:41:58.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.989+0000 7fad5abe8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad5413eba0 con 0x7fad5415dd30 2023-10-18T12:41:58.994 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.989+0000 7fad53fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad54146800 0x7fad5413dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:58.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.989+0000 7fad53fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad54146800 0x7fad5413dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44360/0 (socket says 172.21.15.114:44360) 2023-10-18T12:41:58.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.989+0000 7fad53fff700 1 -- 172.21.15.114:0/3664407488 learned_addr learned my addr 172.21.15.114:0/3664407488 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:41:58.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.989+0000 7fad58984700 1 --2- 172.21.15.114:0/3664407488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad540700b0 0x7fad5413cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:58.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.989+0000 7fad59185700 1 --2- 172.21.15.114:0/3664407488 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad5415dd30 0x7fad541407e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:58.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.989+0000 7fad53fff700 1 -- 172.21.15.114:0/3664407488 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad5415dd30 msgr2=0x7fad541407e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:58.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.989+0000 7fad53fff700 1 --2- 172.21.15.114:0/3664407488 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad5415dd30 0x7fad541407e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:58.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.989+0000 7fad53fff700 1 -- 172.21.15.114:0/3664407488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad540700b0 msgr2=0x7fad5413cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:58.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.989+0000 7fad53fff700 1 --2- 172.21.15.114:0/3664407488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad540700b0 0x7fad5413cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:58.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.989+0000 7fad53fff700 1 -- 172.21.15.114:0/3664407488 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad480094b0 con 0x7fad54146800 2023-10-18T12:41:58.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.989+0000 7fad59185700 1 --2- 172.21.15.114:0/3664407488 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad5415dd30 0x7fad541407e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:41:58.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.989+0000 7fad53fff700 1 --2- 172.21.15.114:0/3664407488 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad54146800 0x7fad5413dd20 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fad4000c500 tx=0x7fad4000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:58.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.989+0000 7fad517fa700 1 -- 172.21.15.114:0/3664407488 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad400052d0 con 0x7fad54146800 2023-10-18T12:41:58.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.989+0000 7fad517fa700 1 -- 172.21.15.114:0/3664407488 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad40005430 con 0x7fad54146800 2023-10-18T12:41:58.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.989+0000 7fad517fa700 1 -- 172.21.15.114:0/3664407488 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad400055a0 con 0x7fad54146800 2023-10-18T12:41:58.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.989+0000 7fad5abe8700 1 -- 172.21.15.114:0/3664407488 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad5413ee80 con 0x7fad54146800 2023-10-18T12:41:58.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.989+0000 7fad5abe8700 1 -- 172.21.15.114:0/3664407488 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad5413e260 con 0x7fad54146800 2023-10-18T12:41:58.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.993+0000 7fad5abe8700 1 -- 172.21.15.114:0/3664407488 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad5413f3a0 con 0x7fad54146800 2023-10-18T12:41:58.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.993+0000 7fad517fa700 1 -- 172.21.15.114:0/3664407488 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fad400038e0 con 0x7fad54146800 2023-10-18T12:41:59.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.993+0000 7fad517fa700 1 --2- 172.21.15.114:0/3664407488 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fad38065720 0x7fad38067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:59.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.993+0000 7fad517fa700 1 -- 172.21.15.114:0/3664407488 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 6715+0+0 (secure 0 0 0) 0x7fad40082560 con 0x7fad54146800 2023-10-18T12:41:59.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.997+0000 7fad58984700 1 --2- 172.21.15.114:0/3664407488 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fad38065720 0x7fad38067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:59.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:58.997+0000 7fad58984700 1 --2- 172.21.15.114:0/3664407488 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fad38065720 0x7fad38067be0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fad48009fd0 tx=0x7fad48008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:59.005 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.001+0000 7fad517fa700 1 -- 172.21.15.114:0/3664407488 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fad5413f3a0 con 0x7fad54146800 2023-10-18T12:41:59.497 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.493+0000 7fad5abe8700 1 -- 172.21.15.114:0/3664407488 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fad5413f3a0 con 0x7fad54146800 2023-10-18T12:41:59.498 INFO:tasks.ceph.mon.a.smithi114.stderr:2023-10-18T12:41:59.493+0000 7f4626df4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-18T12:41:59.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.501+0000 7fad517fa700 1 -- 172.21.15.114:0/3664407488 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v21) v1 ==== 161+0+0 (secure 0 0 0) 0x7fad5413f3a0 con 0x7fad54146800 2023-10-18T12:41:59.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.509+0000 7fad5abe8700 1 -- 172.21.15.114:0/3664407488 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fad38065720 msgr2=0x7fad38067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:59.514 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.509+0000 7fad5abe8700 1 --2- 172.21.15.114:0/3664407488 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fad38065720 0x7fad38067be0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fad48009fd0 tx=0x7fad48008030 comp rx=0 tx=0).stop 2023-10-18T12:41:59.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.509+0000 7fad5abe8700 1 -- 172.21.15.114:0/3664407488 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad54146800 msgr2=0x7fad5413dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:59.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.509+0000 7fad5abe8700 1 --2- 172.21.15.114:0/3664407488 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad54146800 0x7fad5413dd20 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fad4000c500 tx=0x7fad4000c8c0 comp rx=0 tx=0).stop 2023-10-18T12:41:59.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.509+0000 7fad5abe8700 1 -- 172.21.15.114:0/3664407488 shutdown_connections 2023-10-18T12:41:59.515 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.509+0000 7fad5abe8700 1 --2- 172.21.15.114:0/3664407488 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fad38065720 0x7fad38067be0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:59.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.509+0000 7fad5abe8700 1 --2- 172.21.15.114:0/3664407488 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fad5415dd30 0x7fad541407e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:59.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.509+0000 7fad5abe8700 1 --2- 172.21.15.114:0/3664407488 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad54146800 0x7fad5413dd20 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:59.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.509+0000 7fad5abe8700 1 --2- 172.21.15.114:0/3664407488 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad540700b0 0x7fad5413cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:59.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.509+0000 7fad5abe8700 1 -- 172.21.15.114:0/3664407488 >> 172.21.15.114:0/3664407488 conn(0x7fad5406a130 msgr2=0x7fad5406e860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:59.516 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.509+0000 7fad5abe8700 1 -- 172.21.15.114:0/3664407488 shutdown_connections 2023-10-18T12:41:59.517 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.509+0000 7fad5abe8700 1 -- 172.21.15.114:0/3664407488 wait complete. 2023-10-18T12:41:59.517 INFO:teuthology.orchestra.run.smithi114.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-18T12:41:59.533 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-18T12:41:59.582 INFO:tasks.ceph.mds.a.smithi114.stdout:starting mds.a at 2023-10-18T12:41:59.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.700+0000 7f437cf4d700 1 Processor -- start 2023-10-18T12:41:59.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.700+0000 7f437cf4d700 1 -- start start 2023-10-18T12:41:59.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.700+0000 7f437cf4d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43780b5b80 0x7f437815d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:59.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.700+0000 7f437cf4d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f437806f9a0 0x7f437806fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:59.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.700+0000 7f437cf4d700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4378146ba0 con 0x7f43781467c0 2023-10-18T12:41:59.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.700+0000 7f437cf4d700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4378070350 con 0x7f437806f9a0 2023-10-18T12:41:59.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.700+0000 7f437cf4d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43780d0920 con 0x7f43780b5b80 2023-10-18T12:41:59.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.700+0000 7f4376d9d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f437806f9a0 0x7f437806fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:59.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.700+0000 7f4375d9b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43780b5b80 0x7f437815d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:59.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.704+0000 7f4375d9b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43780b5b80 0x7f437815d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3301/0 says I am v2:172.21.15.114:47380/0 (socket says 172.21.15.114:47380) 2023-10-18T12:41:59.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.704+0000 7f4375d9b700 1 -- 172.21.15.114:0/2215891713 learned_addr learned my addr 172.21.15.114:0/2215891713 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:41:59.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.704+0000 7f437659c700 1 --1- 172.21.15.114:0/2215891713 >> v1:172.21.15.172:6789/0 conn(0x7f43781467c0 0x7f43781612e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.172:6789/0 says I am v1:172.21.15.114:41816/0 (socket says 172.21.15.114:41816) 2023-10-18T12:41:59.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.704+0000 7f4376d9d700 1 -- 172.21.15.114:0/2215891713 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43780b5b80 msgr2=0x7f437815d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:41:59.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.704+0000 7f4376d9d700 1 --2- 172.21.15.114:0/2215891713 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43780b5b80 0x7f437815d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:59.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.704+0000 7f4376d9d700 1 -- 172.21.15.114:0/2215891713 >> v1:172.21.15.172:6789/0 conn(0x7f43781467c0 legacy=0x7f43781612e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:59.711 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.704+0000 7f4376d9d700 1 -- 172.21.15.114:0/2215891713 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43780b6160 con 0x7f437806f9a0 2023-10-18T12:41:59.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.704+0000 7f437559a700 1 -- 172.21.15.114:0/2215891713 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 970468886 0 0) 0x7f4378146ba0 con 0x7f43781467c0 2023-10-18T12:41:59.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.704+0000 7f4376d9d700 1 --2- 172.21.15.114:0/2215891713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f437806f9a0 0x7f437806fe10 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f4370009d90 tx=0x7f437000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fce9d42bc32dae48 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:59.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.704+0000 7f437559a700 1 -- 172.21.15.114:0/2215891713 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437000e070 con 0x7f437806f9a0 2023-10-18T12:41:59.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.704+0000 7f437559a700 1 -- 172.21.15.114:0/2215891713 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f437000bb20 con 0x7f437806f9a0 2023-10-18T12:41:59.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.704+0000 7f437559a700 1 -- 172.21.15.114:0/2215891713 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4370012430 con 0x7f437806f9a0 2023-10-18T12:41:59.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.704+0000 7f437cf4d700 1 -- 172.21.15.114:0/2215891713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f437806f9a0 msgr2=0x7f437806fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:59.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.704+0000 7f437cf4d700 1 --2- 172.21.15.114:0/2215891713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f437806f9a0 0x7f437806fe10 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f4370009d90 tx=0x7f437000b330 comp rx=0 tx=0).stop 2023-10-18T12:41:59.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.704+0000 7f437cf4d700 1 -- 172.21.15.114:0/2215891713 shutdown_connections 2023-10-18T12:41:59.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.704+0000 7f437cf4d700 1 --2- 172.21.15.114:0/2215891713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f437806f9a0 0x7f437806fe10 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:59.714 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.704+0000 7f437cf4d700 1 --2- 172.21.15.114:0/2215891713 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43780b5b80 0x7f437815d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:59.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.704+0000 7f437cf4d700 1 -- 172.21.15.114:0/2215891713 >> 172.21.15.114:0/2215891713 conn(0x7f437806a130 msgr2=0x7f437806a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:41:59.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.704+0000 7f437cf4d700 1 -- 172.21.15.114:0/2215891713 shutdown_connections 2023-10-18T12:41:59.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.704+0000 7f437cf4d700 1 -- 172.21.15.114:0/2215891713 wait complete. 2023-10-18T12:41:59.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.708+0000 7f437cf4d700 1 Processor -- start 2023-10-18T12:41:59.715 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.708+0000 7f437cf4d700 1 -- start start 2023-10-18T12:41:59.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.708+0000 7f437cf4d700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f437806f9a0 0x7f437815c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:59.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.708+0000 7f437cf4d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43780b5b80 0x7f43781408e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:59.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.708+0000 7f437cf4d700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43781467c0 0x7f43781609d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:59.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.708+0000 7f437cf4d700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437815cd40 con 0x7f43780b5b80 2023-10-18T12:41:59.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.708+0000 7f437cf4d700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437815dff0 con 0x7f437806f9a0 2023-10-18T12:41:59.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.708+0000 7f437cf4d700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f437815e2d0 con 0x7f43781467c0 2023-10-18T12:41:59.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.708+0000 7f4375d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43780b5b80 0x7f43781408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:59.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.708+0000 7f4375d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43780b5b80 0x7f43781408e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44412/0 (socket says 172.21.15.114:44412) 2023-10-18T12:41:59.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.708+0000 7f4375d9b700 1 -- 172.21.15.114:0/369785063 learned_addr learned my addr 172.21.15.114:0/369785063 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:41:59.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.708+0000 7f437659c700 1 --2- 172.21.15.114:0/369785063 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f437806f9a0 0x7f437815c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:59.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.708+0000 7f4376d9d700 1 --2- 172.21.15.114:0/369785063 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43781467c0 0x7f43781609d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:59.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.708+0000 7f4375d9b700 1 -- 172.21.15.114:0/369785063 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43781467c0 msgr2=0x7f43781609d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:59.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.708+0000 7f4375d9b700 1 --2- 172.21.15.114:0/369785063 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43781467c0 0x7f43781609d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:59.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.708+0000 7f4375d9b700 1 -- 172.21.15.114:0/369785063 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f437806f9a0 msgr2=0x7f437815c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:41:59.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.708+0000 7f4375d9b700 1 --2- 172.21.15.114:0/369785063 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f437806f9a0 0x7f437815c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:41:59.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.708+0000 7f4375d9b700 1 -- 172.21.15.114:0/369785063 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4370009a70 con 0x7f43780b5b80 2023-10-18T12:41:59.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.708+0000 7f4375d9b700 1 --2- 172.21.15.114:0/369785063 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43780b5b80 0x7f43781408e0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f436c00e930 tx=0x7f436c00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:59.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.708+0000 7f4366ffd700 1 -- 172.21.15.114:0/369785063 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c0096c0 con 0x7f43780b5b80 2023-10-18T12:41:59.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.708+0000 7f4366ffd700 1 -- 172.21.15.114:0/369785063 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436c00ee80 con 0x7f43780b5b80 2023-10-18T12:41:59.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.708+0000 7f4366ffd700 1 -- 172.21.15.114:0/369785063 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436c00ca90 con 0x7f43780b5b80 2023-10-18T12:41:59.721 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.708+0000 7f437cf4d700 1 -- 172.21.15.114:0/369785063 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f437815e5b0 con 0x7f43780b5b80 2023-10-18T12:41:59.722 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.712+0000 7f437cf4d700 1 -- 172.21.15.114:0/369785063 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f437815eb70 con 0x7f43780b5b80 2023-10-18T12:41:59.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.712+0000 7f437cf4d700 1 -- 172.21.15.114:0/369785063 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4378072e60 con 0x7f43780b5b80 2023-10-18T12:41:59.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.712+0000 7f4366ffd700 1 -- 172.21.15.114:0/369785063 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f436c00cbf0 con 0x7f43780b5b80 2023-10-18T12:41:59.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.716+0000 7f4366ffd700 1 --2- 172.21.15.114:0/369785063 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f43580656f0 0x7f4358067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:41:59.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.716+0000 7f4366ffd700 1 -- 172.21.15.114:0/369785063 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6801+0+0 (secure 0 0 0) 0x7f436c083100 con 0x7f43780b5b80 2023-10-18T12:41:59.723 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.716+0000 7f437659c700 1 --2- 172.21.15.114:0/369785063 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f43580656f0 0x7f4358067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:41:59.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.716+0000 7f437659c700 1 --2- 172.21.15.114:0/369785063 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f43580656f0 0x7f4358067bb0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4368000f60 tx=0x7f4368007e90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:41:59.724 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:41:59.716+0000 7f4366ffd700 1 -- 172.21.15.114:0/369785063 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f436c054360 con 0x7f43780b5b80 2023-10-18T12:42:00.197 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.192+0000 7f437cf4d700 1 -- 172.21.15.114:0/369785063 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f43780d24d0 con 0x7f43780b5b80 2023-10-18T12:42:00.519 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.512+0000 7f4366ffd700 1 -- 172.21.15.114:0/369785063 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v22) v1 ==== 104+0+0 (secure 0 0 0) 0x7f436c00cea0 con 0x7f43780b5b80 2023-10-18T12:42:00.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.516+0000 7f437cf4d700 1 -- 172.21.15.114:0/369785063 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f43580656f0 msgr2=0x7f4358067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:00.523 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.516+0000 7f437cf4d700 1 --2- 172.21.15.114:0/369785063 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f43580656f0 0x7f4358067bb0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4368000f60 tx=0x7f4368007e90 comp rx=0 tx=0).stop 2023-10-18T12:42:00.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.516+0000 7f437cf4d700 1 -- 172.21.15.114:0/369785063 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43780b5b80 msgr2=0x7f43781408e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:00.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.516+0000 7f437cf4d700 1 --2- 172.21.15.114:0/369785063 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43780b5b80 0x7f43781408e0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f436c00e930 tx=0x7f436c00ec40 comp rx=0 tx=0).stop 2023-10-18T12:42:00.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.516+0000 7f437cf4d700 1 -- 172.21.15.114:0/369785063 shutdown_connections 2023-10-18T12:42:00.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.516+0000 7f437cf4d700 1 --2- 172.21.15.114:0/369785063 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f43580656f0 0x7f4358067bb0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:00.524 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.516+0000 7f437cf4d700 1 --2- 172.21.15.114:0/369785063 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f43781467c0 0x7f43781609d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:00.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.516+0000 7f437cf4d700 1 --2- 172.21.15.114:0/369785063 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f43780b5b80 0x7f43781408e0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:00.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.516+0000 7f437cf4d700 1 --2- 172.21.15.114:0/369785063 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f437806f9a0 0x7f437815c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:00.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.516+0000 7f437cf4d700 1 -- 172.21.15.114:0/369785063 >> 172.21.15.114:0/369785063 conn(0x7f437806a130 msgr2=0x7f4378070910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:00.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.516+0000 7f437cf4d700 1 -- 172.21.15.114:0/369785063 shutdown_connections 2023-10-18T12:42:00.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.516+0000 7f437cf4d700 1 -- 172.21.15.114:0/369785063 wait complete. 2023-10-18T12:42:00.546 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-18T12:42:00.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.724+0000 7fd157de8700 1 Processor -- start 2023-10-18T12:42:00.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.724+0000 7fd157de8700 1 -- start start 2023-10-18T12:42:00.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.728+0000 7fd157de8700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd15015adc0 0x7fd1500d03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:00.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.728+0000 7fd157de8700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fd15006f450 0x7fd15006f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:00.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.728+0000 7fd157de8700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1500b69b0 con 0x7fd1500cbc60 2023-10-18T12:42:00.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.728+0000 7fd157de8700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd150070df0 con 0x7fd15015adc0 2023-10-18T12:42:00.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.728+0000 7fd157de8700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd15015b1a0 con 0x7fd15006f450 2023-10-18T12:42:00.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.728+0000 7fd155b84700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd15015adc0 0x7fd1500d03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:00.734 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.728+0000 7fd155b84700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fd15015adc0 0x7fd1500d03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44414/0 (socket says 172.21.15.114:44414) 2023-10-18T12:42:00.735 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.728+0000 7fd155b84700 1 -- 172.21.15.114:0/408791313 learned_addr learned my addr 172.21.15.114:0/408791313 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:42:00.736 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.728+0000 7fd155b84700 1 -- 172.21.15.114:0/408791313 >> v2:172.21.15.172:3300/0 conn(0x7fd15006f450 msgr2=0x7fd15006f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:42:00.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.728+0000 7fd155b84700 1 --2- 172.21.15.114:0/408791313 >> v2:172.21.15.172:3300/0 conn(0x7fd15006f450 0x7fd15006f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:00.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.728+0000 7fd155b84700 1 -- 172.21.15.114:0/408791313 >> v1:172.21.15.114:6789/0 conn(0x7fd1500cbc60 legacy=0x7fd1500b61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:00.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.728+0000 7fd155b84700 1 -- 172.21.15.114:0/408791313 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1500cf610 con 0x7fd15015adc0 2023-10-18T12:42:00.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.728+0000 7fd155b84700 1 --2- 172.21.15.114:0/408791313 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd15015adc0 0x7fd1500d03d0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fd15006f150 tx=0x7fd14c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baea9a1d94b0b398 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:00.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.728+0000 7fd154b82700 1 -- 172.21.15.114:0/408791313 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14c00b8a0 con 0x7fd15015adc0 2023-10-18T12:42:00.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.728+0000 7fd154b82700 1 -- 172.21.15.114:0/408791313 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd14c00ba00 con 0x7fd15015adc0 2023-10-18T12:42:00.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.728+0000 7fd154b82700 1 -- 172.21.15.114:0/408791313 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14c00bd90 con 0x7fd15015adc0 2023-10-18T12:42:00.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.728+0000 7fd157de8700 1 -- 172.21.15.114:0/408791313 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd15015adc0 msgr2=0x7fd1500d03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:00.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.728+0000 7fd157de8700 1 --2- 172.21.15.114:0/408791313 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd15015adc0 0x7fd1500d03d0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fd15006f150 tx=0x7fd14c009bf0 comp rx=0 tx=0).stop 2023-10-18T12:42:00.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.728+0000 7fd157de8700 1 -- 172.21.15.114:0/408791313 shutdown_connections 2023-10-18T12:42:00.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.728+0000 7fd157de8700 1 --2- 172.21.15.114:0/408791313 >> v2:172.21.15.172:3300/0 conn(0x7fd15006f450 0x7fd15006f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:00.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.728+0000 7fd157de8700 1 --2- 172.21.15.114:0/408791313 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd15015adc0 0x7fd1500d03d0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:00.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.728+0000 7fd157de8700 1 -- 172.21.15.114:0/408791313 >> 172.21.15.114:0/408791313 conn(0x7fd1500d09b0 msgr2=0x7fd1500d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:00.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.728+0000 7fd157de8700 1 -- 172.21.15.114:0/408791313 shutdown_connections 2023-10-18T12:42:00.739 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.732+0000 7fd157de8700 1 -- 172.21.15.114:0/408791313 wait complete. 2023-10-18T12:42:00.740 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.732+0000 7fd157de8700 1 Processor -- start 2023-10-18T12:42:00.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.732+0000 7fd157de8700 1 -- start start 2023-10-18T12:42:00.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.732+0000 7fd157de8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd15006f450 0x7fd1500b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:00.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.732+0000 7fd157de8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1500cbc60 0x7fd1500b0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:00.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.732+0000 7fd157de8700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd15015adc0 0x7fd1500b45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:00.741 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.732+0000 7fd157de8700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1500b0d10 con 0x7fd15015adc0 2023-10-18T12:42:00.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.732+0000 7fd157de8700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1500b0ff0 con 0x7fd1500cbc60 2023-10-18T12:42:00.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.732+0000 7fd157de8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1500b12d0 con 0x7fd15006f450 2023-10-18T12:42:00.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.732+0000 7fd156385700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd15015adc0 0x7fd1500b45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:00.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.736+0000 7fd156385700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd15015adc0 0x7fd1500b45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44426/0 (socket says 172.21.15.114:44426) 2023-10-18T12:42:00.742 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.736+0000 7fd156385700 1 -- 172.21.15.114:0/826472532 learned_addr learned my addr 172.21.15.114:0/826472532 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:42:00.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.736+0000 7fd155383700 1 --2- 172.21.15.114:0/826472532 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1500cbc60 0x7fd1500b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:00.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.736+0000 7fd155b84700 1 --2- 172.21.15.114:0/826472532 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd15006f450 0x7fd1500b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:00.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.736+0000 7fd156385700 1 -- 172.21.15.114:0/826472532 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd15006f450 msgr2=0x7fd1500b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:00.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.736+0000 7fd156385700 1 --2- 172.21.15.114:0/826472532 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd15006f450 0x7fd1500b1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:00.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.736+0000 7fd156385700 1 -- 172.21.15.114:0/826472532 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1500cbc60 msgr2=0x7fd1500b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:00.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.736+0000 7fd156385700 1 --2- 172.21.15.114:0/826472532 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1500cbc60 0x7fd1500b0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:00.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.736+0000 7fd156385700 1 -- 172.21.15.114:0/826472532 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd14c009570 con 0x7fd15015adc0 2023-10-18T12:42:00.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.736+0000 7fd156385700 1 --2- 172.21.15.114:0/826472532 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd15015adc0 0x7fd1500b45f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fd14800b970 tx=0x7fd14800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:00.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.736+0000 7fd1467fc700 1 -- 172.21.15.114:0/826472532 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14800d860 con 0x7fd15015adc0 2023-10-18T12:42:00.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.736+0000 7fd1467fc700 1 -- 172.21.15.114:0/826472532 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd14800d9e0 con 0x7fd15015adc0 2023-10-18T12:42:00.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.736+0000 7fd157de8700 1 -- 172.21.15.114:0/826472532 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1500b15b0 con 0x7fd15015adc0 2023-10-18T12:42:00.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.736+0000 7fd1467fc700 1 -- 172.21.15.114:0/826472532 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14800dd90 con 0x7fd15015adc0 2023-10-18T12:42:00.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.736+0000 7fd157de8700 1 -- 172.21.15.114:0/826472532 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1500b0950 con 0x7fd15015adc0 2023-10-18T12:42:00.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.736+0000 7fd157de8700 1 -- 172.21.15.114:0/826472532 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1500b1ad0 con 0x7fd15015adc0 2023-10-18T12:42:00.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.740+0000 7fd1467fc700 1 -- 172.21.15.114:0/826472532 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fd14800e430 con 0x7fd15015adc0 2023-10-18T12:42:00.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.740+0000 7fd1467fc700 1 --2- 172.21.15.114:0/826472532 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd134065720 0x7fd134067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:00.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.740+0000 7fd1467fc700 1 -- 172.21.15.114:0/826472532 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6801+0+0 (secure 0 0 0) 0x7fd1480832c0 con 0x7fd15015adc0 2023-10-18T12:42:00.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.740+0000 7fd155b84700 1 --2- 172.21.15.114:0/826472532 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd134065720 0x7fd134067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:00.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.740+0000 7fd155b84700 1 --2- 172.21.15.114:0/826472532 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd134065720 0x7fd134067be0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd14c000c00 tx=0x7fd14c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:00.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:00.744+0000 7fd1467fc700 1 -- 172.21.15.114:0/826472532 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fd1500b1ad0 con 0x7fd15015adc0 2023-10-18T12:42:01.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.008+0000 7fd157de8700 1 -- 172.21.15.114:0/826472532 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd1500b1ad0 con 0x7fd15015adc0 2023-10-18T12:42:01.525 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.520+0000 7fd1467fc700 1 -- 172.21.15.114:0/826472532 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v62) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd1500b1ad0 con 0x7fd15015adc0 2023-10-18T12:42:01.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.524+0000 7fd157de8700 1 -- 172.21.15.114:0/826472532 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd134065720 msgr2=0x7fd134067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:01.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.524+0000 7fd157de8700 1 --2- 172.21.15.114:0/826472532 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd134065720 0x7fd134067be0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd14c000c00 tx=0x7fd14c008030 comp rx=0 tx=0).stop 2023-10-18T12:42:01.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.524+0000 7fd157de8700 1 -- 172.21.15.114:0/826472532 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd15015adc0 msgr2=0x7fd1500b45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:01.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.524+0000 7fd157de8700 1 --2- 172.21.15.114:0/826472532 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd15015adc0 0x7fd1500b45f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fd14800b970 tx=0x7fd14800bc80 comp rx=0 tx=0).stop 2023-10-18T12:42:01.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.524+0000 7fd157de8700 1 -- 172.21.15.114:0/826472532 shutdown_connections 2023-10-18T12:42:01.530 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.524+0000 7fd157de8700 1 --2- 172.21.15.114:0/826472532 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fd134065720 0x7fd134067be0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:01.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.524+0000 7fd157de8700 1 --2- 172.21.15.114:0/826472532 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd15015adc0 0x7fd1500b45f0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:01.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.524+0000 7fd157de8700 1 --2- 172.21.15.114:0/826472532 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd1500cbc60 0x7fd1500b0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:01.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.524+0000 7fd157de8700 1 --2- 172.21.15.114:0/826472532 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fd15006f450 0x7fd1500b1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:01.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.524+0000 7fd157de8700 1 -- 172.21.15.114:0/826472532 >> 172.21.15.114:0/826472532 conn(0x7fd1500d09b0 msgr2=0x7fd150060730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:01.531 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.524+0000 7fd157de8700 1 -- 172.21.15.114:0/826472532 shutdown_connections 2023-10-18T12:42:01.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.524+0000 7fd157de8700 1 -- 172.21.15.114:0/826472532 wait complete. 2023-10-18T12:42:01.532 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_metadata' removed 2023-10-18T12:42:01.553 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-18T12:42:01.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.740+0000 7f11d5274700 1 Processor -- start 2023-10-18T12:42:01.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.740+0000 7f11d5274700 1 -- start start 2023-10-18T12:42:01.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.740+0000 7f11d5274700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f11d015ab20 0x7f11d00cbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:01.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.740+0000 7f11d5274700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f11d006f450 0x7f11d00b3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:01.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.744+0000 7f11d5274700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f11d00cd260 0x7f11d00cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:01.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.744+0000 7f11d5274700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11d00ce910 con 0x7f11d015ab20 2023-10-18T12:42:01.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.744+0000 7f11d5274700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11d00cdbf0 con 0x7f11d00cd260 2023-10-18T12:42:01.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.744+0000 7f11d5274700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11d00b3e50 con 0x7f11d006f450 2023-10-18T12:42:01.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.744+0000 7f11cffff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f11d015ab20 0x7f11d00cbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:01.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.744+0000 7f11cffff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f11d015ab20 0x7f11d00cbaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44430/0 (socket says 172.21.15.114:44430) 2023-10-18T12:42:01.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.744+0000 7f11cffff700 1 -- 172.21.15.114:0/1963920894 learned_addr learned my addr 172.21.15.114:0/1963920894 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:42:01.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.744+0000 7f11d4a73700 1 --2- 172.21.15.114:0/1963920894 >> v2:172.21.15.172:3300/0 conn(0x7f11d00cd260 0x7f11d00cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:01.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.744+0000 7f11c7fff700 1 --2- 172.21.15.114:0/1963920894 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f11d006f450 0x7f11d00b3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:01.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.744+0000 7f11cffff700 1 -- 172.21.15.114:0/1963920894 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f11d006f450 msgr2=0x7f11d00b3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:42:01.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.744+0000 7f11cffff700 1 --2- 172.21.15.114:0/1963920894 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f11d006f450 0x7f11d00b3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:01.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.744+0000 7f11cffff700 1 -- 172.21.15.114:0/1963920894 >> v2:172.21.15.172:3300/0 conn(0x7f11d00cd260 msgr2=0x7f11d00cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:42:01.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.744+0000 7f11cffff700 1 --2- 172.21.15.114:0/1963920894 >> v2:172.21.15.172:3300/0 conn(0x7f11d00cd260 0x7f11d00cd6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:01.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.744+0000 7f11cffff700 1 -- 172.21.15.114:0/1963920894 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d006f980 con 0x7f11d015ab20 2023-10-18T12:42:01.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.744+0000 7f11d4a73700 1 --2- 172.21.15.114:0/1963920894 >> v2:172.21.15.172:3300/0 conn(0x7f11d00cd260 0x7f11d00cd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:42:01.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.744+0000 7f11cffff700 1 --2- 172.21.15.114:0/1963920894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11d015ab20 0x7f11d00cbaf0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f11d015e650 tx=0x7f11c0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4ed1e9783480eb server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:01.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.744+0000 7f11cf7fe700 1 -- 172.21.15.114:0/1963920894 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c000b8a0 con 0x7f11d015ab20 2023-10-18T12:42:01.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.744+0000 7f11cf7fe700 1 -- 172.21.15.114:0/1963920894 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c000ba00 con 0x7f11d015ab20 2023-10-18T12:42:01.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.744+0000 7f11cf7fe700 1 -- 172.21.15.114:0/1963920894 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c000bd90 con 0x7f11d015ab20 2023-10-18T12:42:01.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.744+0000 7f11d5274700 1 -- 172.21.15.114:0/1963920894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11d015ab20 msgr2=0x7f11d00cbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:01.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.744+0000 7f11d5274700 1 --2- 172.21.15.114:0/1963920894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11d015ab20 0x7f11d00cbaf0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f11d015e650 tx=0x7f11c0009bf0 comp rx=0 tx=0).stop 2023-10-18T12:42:01.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.744+0000 7f11d5274700 1 -- 172.21.15.114:0/1963920894 shutdown_connections 2023-10-18T12:42:01.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.744+0000 7f11d5274700 1 --2- 172.21.15.114:0/1963920894 >> v2:172.21.15.172:3300/0 conn(0x7f11d00cd260 0x7f11d00cd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:01.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.744+0000 7f11d5274700 1 --2- 172.21.15.114:0/1963920894 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f11d006f450 0x7f11d00b3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:01.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.744+0000 7f11d5274700 1 --2- 172.21.15.114:0/1963920894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11d015ab20 0x7f11d00cbaf0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:01.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.744+0000 7f11d5274700 1 -- 172.21.15.114:0/1963920894 >> 172.21.15.114:0/1963920894 conn(0x7f11d00b2390 msgr2=0x7f11d00b2770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:01.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.744+0000 7f11d5274700 1 -- 172.21.15.114:0/1963920894 shutdown_connections 2023-10-18T12:42:01.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.744+0000 7f11d5274700 1 -- 172.21.15.114:0/1963920894 wait complete. 2023-10-18T12:42:01.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.748+0000 7f11d5274700 1 Processor -- start 2023-10-18T12:42:01.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.748+0000 7f11d5274700 1 -- start start 2023-10-18T12:42:01.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.748+0000 7f11d5274700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f11d006f450 0x7f11d00b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:01.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.748+0000 7f11d5274700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11d00cd260 0x7f11d00c9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:01.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.748+0000 7f11d5274700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11d015ab20 0x7f11d01f43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:01.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.748+0000 7f11d5274700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d00c4890 con 0x7f11d015ab20 2023-10-18T12:42:01.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.748+0000 7f11d5274700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d00c4b70 con 0x7f11d00cd260 2023-10-18T12:42:01.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.748+0000 7f11d5274700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11d00c4e50 con 0x7f11d006f450 2023-10-18T12:42:01.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.748+0000 7f11d4a73700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11d015ab20 0x7f11d01f43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:01.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.748+0000 7f11d4a73700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11d015ab20 0x7f11d01f43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44432/0 (socket says 172.21.15.114:44432) 2023-10-18T12:42:01.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.748+0000 7f11d4a73700 1 -- 172.21.15.114:0/4004509937 learned_addr learned my addr 172.21.15.114:0/4004509937 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:42:01.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.748+0000 7f11c7fff700 1 --2- 172.21.15.114:0/4004509937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11d00cd260 0x7f11d00c9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:01.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.748+0000 7f11cffff700 1 --2- 172.21.15.114:0/4004509937 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f11d006f450 0x7f11d00b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:01.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.752+0000 7f11d4a73700 1 -- 172.21.15.114:0/4004509937 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f11d006f450 msgr2=0x7f11d00b50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:01.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.752+0000 7f11d4a73700 1 --2- 172.21.15.114:0/4004509937 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f11d006f450 0x7f11d00b50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:01.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.752+0000 7f11d4a73700 1 -- 172.21.15.114:0/4004509937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11d00cd260 msgr2=0x7f11d00c9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:01.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.752+0000 7f11d4a73700 1 --2- 172.21.15.114:0/4004509937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11d00cd260 0x7f11d00c9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:01.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.752+0000 7f11d4a73700 1 -- 172.21.15.114:0/4004509937 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c0009570 con 0x7f11d015ab20 2023-10-18T12:42:01.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.752+0000 7f11c7fff700 1 --2- 172.21.15.114:0/4004509937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11d00cd260 0x7f11d00c9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:42:01.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.752+0000 7f11cffff700 1 --2- 172.21.15.114:0/4004509937 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f11d006f450 0x7f11d00b50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:42:01.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.752+0000 7f11d4a73700 1 --2- 172.21.15.114:0/4004509937 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11d015ab20 0x7f11d01f43b0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f11c8007e60 tx=0x7f11c800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:01.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.752+0000 7f11cd7fa700 1 -- 172.21.15.114:0/4004509937 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c800ddd0 con 0x7f11d015ab20 2023-10-18T12:42:01.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.752+0000 7f11cd7fa700 1 -- 172.21.15.114:0/4004509937 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c800f040 con 0x7f11d015ab20 2023-10-18T12:42:01.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.752+0000 7f11cd7fa700 1 -- 172.21.15.114:0/4004509937 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c8003c80 con 0x7f11d015ab20 2023-10-18T12:42:01.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.752+0000 7f11d5274700 1 -- 172.21.15.114:0/4004509937 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11d00c5130 con 0x7f11d015ab20 2023-10-18T12:42:01.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.752+0000 7f11d5274700 1 -- 172.21.15.114:0/4004509937 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11d00b5620 con 0x7f11d015ab20 2023-10-18T12:42:01.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.752+0000 7f11d5274700 1 -- 172.21.15.114:0/4004509937 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11d00c5650 con 0x7f11d015ab20 2023-10-18T12:42:01.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.752+0000 7f11cd7fa700 1 -- 172.21.15.114:0/4004509937 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f11c8004030 con 0x7f11d015ab20 2023-10-18T12:42:01.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.756+0000 7f11cd7fa700 1 --2- 172.21.15.114:0/4004509937 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f11b00656f0 0x7f11b0067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:01.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.756+0000 7f11cd7fa700 1 -- 172.21.15.114:0/4004509937 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6218+0+0 (secure 0 0 0) 0x7f11c8082ea0 con 0x7f11d015ab20 2023-10-18T12:42:01.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.756+0000 7f11cffff700 1 --2- 172.21.15.114:0/4004509937 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f11b00656f0 0x7f11b0067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:01.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.756+0000 7f11cffff700 1 --2- 172.21.15.114:0/4004509937 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f11b00656f0 0x7f11b0067bb0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f11c0000c00 tx=0x7f11c0008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:01.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:01.760+0000 7f11cd7fa700 1 -- 172.21.15.114:0/4004509937 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f11c80508c0 con 0x7f11d015ab20 2023-10-18T12:42:02.098 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.092+0000 7f11d5274700 1 -- 172.21.15.114:0/4004509937 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f11d0072e60 con 0x7f11d015ab20 2023-10-18T12:42:02.528 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.520+0000 7f11cd7fa700 1 -- 172.21.15.114:0/4004509937 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v63) v1 ==== 169+0+0 (secure 0 0 0) 0x7f11c8053ee0 con 0x7f11d015ab20 2023-10-18T12:42:02.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.524+0000 7f11d5274700 1 -- 172.21.15.114:0/4004509937 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f11b00656f0 msgr2=0x7f11b0067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:02.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.524+0000 7f11d5274700 1 --2- 172.21.15.114:0/4004509937 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f11b00656f0 0x7f11b0067bb0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f11c0000c00 tx=0x7f11c0008030 comp rx=0 tx=0).stop 2023-10-18T12:42:02.532 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.524+0000 7f11d5274700 1 -- 172.21.15.114:0/4004509937 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11d015ab20 msgr2=0x7f11d01f43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:02.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.524+0000 7f11d5274700 1 --2- 172.21.15.114:0/4004509937 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11d015ab20 0x7f11d01f43b0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f11c8007e60 tx=0x7f11c800d3b0 comp rx=0 tx=0).stop 2023-10-18T12:42:02.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.524+0000 7f11d5274700 1 -- 172.21.15.114:0/4004509937 shutdown_connections 2023-10-18T12:42:02.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.524+0000 7f11d5274700 1 --2- 172.21.15.114:0/4004509937 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f11b00656f0 0x7f11b0067bb0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:02.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.524+0000 7f11d5274700 1 --2- 172.21.15.114:0/4004509937 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f11d015ab20 0x7f11d01f43b0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:02.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.524+0000 7f11d5274700 1 --2- 172.21.15.114:0/4004509937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f11d00cd260 0x7f11d00c9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:02.533 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.524+0000 7f11d5274700 1 --2- 172.21.15.114:0/4004509937 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f11d006f450 0x7f11d00b50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:02.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.524+0000 7f11d5274700 1 -- 172.21.15.114:0/4004509937 >> 172.21.15.114:0/4004509937 conn(0x7f11d00b2390 msgr2=0x7f11d00cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:02.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.528+0000 7f11d5274700 1 -- 172.21.15.114:0/4004509937 shutdown_connections 2023-10-18T12:42:02.534 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.528+0000 7f11d5274700 1 -- 172.21.15.114:0/4004509937 wait complete. 2023-10-18T12:42:02.535 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'cephfs_data' removed 2023-10-18T12:42:02.555 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-18T12:42:02.737 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.732+0000 7fdc9b3d5700 1 Processor -- start 2023-10-18T12:42:02.738 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.732+0000 7fdc9b3d5700 1 -- start start 2023-10-18T12:42:02.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.736+0000 7fdc9b3d5700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdc94159750 0x7fdc94070560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:02.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.736+0000 7fdc9b3d5700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdc940ce040 0x7fdc9406cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:02.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.736+0000 7fdc9b3d5700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc94070f00 con 0x7fdc94070aa0 2023-10-18T12:42:02.743 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.736+0000 7fdc9b3d5700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc940c9aa0 con 0x7fdc940ce040 2023-10-18T12:42:02.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.736+0000 7fdc9b3d5700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc940b14f0 con 0x7fdc94159750 2023-10-18T12:42:02.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.736+0000 7fdc9abd4700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdc940ce040 0x7fdc9406cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:02.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.736+0000 7fdc9abd4700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdc940ce040 0x7fdc9406cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44438/0 (socket says 172.21.15.114:44438) 2023-10-18T12:42:02.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.736+0000 7fdc9abd4700 1 -- 172.21.15.114:0/2921886914 learned_addr learned my addr 172.21.15.114:0/2921886914 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:42:02.744 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.736+0000 7fdc9a3d3700 1 --2- 172.21.15.114:0/2921886914 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdc94159750 0x7fdc94070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:02.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.736+0000 7fdc9abd4700 1 -- 172.21.15.114:0/2921886914 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdc94159750 msgr2=0x7fdc94070560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:42:02.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.736+0000 7fdc9abd4700 1 --2- 172.21.15.114:0/2921886914 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdc94159750 0x7fdc94070560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:02.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.736+0000 7fdc9abd4700 1 -- 172.21.15.114:0/2921886914 >> v1:172.21.15.172:6789/0 conn(0x7fdc94070aa0 legacy=0x7fdc940cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:02.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.736+0000 7fdc9abd4700 1 -- 172.21.15.114:0/2921886914 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc9415d590 con 0x7fdc940ce040 2023-10-18T12:42:02.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.736+0000 7fdc9abd4700 1 --2- 172.21.15.114:0/2921886914 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc940ce040 0x7fdc9406cf20 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c009910 tx=0x7fdc8c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b45faf931a99cd8 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:02.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.740+0000 7fdc993d1700 1 -- 172.21.15.114:0/2921886914 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c00ba60 con 0x7fdc940ce040 2023-10-18T12:42:02.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.740+0000 7fdc993d1700 1 -- 172.21.15.114:0/2921886914 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc8c00bbc0 con 0x7fdc940ce040 2023-10-18T12:42:02.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.740+0000 7fdc993d1700 1 -- 172.21.15.114:0/2921886914 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c009e60 con 0x7fdc940ce040 2023-10-18T12:42:02.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.740+0000 7fdc9b3d5700 1 -- 172.21.15.114:0/2921886914 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc940ce040 msgr2=0x7fdc9406cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:02.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.740+0000 7fdc9b3d5700 1 --2- 172.21.15.114:0/2921886914 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc940ce040 0x7fdc9406cf20 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c009910 tx=0x7fdc8c009c20 comp rx=0 tx=0).stop 2023-10-18T12:42:02.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.740+0000 7fdc9b3d5700 1 -- 172.21.15.114:0/2921886914 shutdown_connections 2023-10-18T12:42:02.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.740+0000 7fdc9b3d5700 1 --2- 172.21.15.114:0/2921886914 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc940ce040 0x7fdc9406cf20 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:02.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.740+0000 7fdc9b3d5700 1 --2- 172.21.15.114:0/2921886914 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdc94159750 0x7fdc94070560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:02.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.740+0000 7fdc9b3d5700 1 -- 172.21.15.114:0/2921886914 >> 172.21.15.114:0/2921886914 conn(0x7fdc940ce5c0 msgr2=0x7fdc940ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:02.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.740+0000 7fdc9b3d5700 1 -- 172.21.15.114:0/2921886914 shutdown_connections 2023-10-18T12:42:02.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.740+0000 7fdc9b3d5700 1 -- 172.21.15.114:0/2921886914 wait complete. 2023-10-18T12:42:02.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.744+0000 7fdc9b3d5700 1 Processor -- start 2023-10-18T12:42:02.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.744+0000 7fdc9b3d5700 1 -- start start 2023-10-18T12:42:02.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.744+0000 7fdc9b3d5700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc94070aa0 0x7fdc941f2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:02.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.744+0000 7fdc9b3d5700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc940ce040 0x7fdc941f2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:02.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.744+0000 7fdc9b3d5700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdc94159750 0x7fdc941f3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:02.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.744+0000 7fdc9b3d5700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc94155110 con 0x7fdc940ce040 2023-10-18T12:42:02.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.744+0000 7fdc9b3d5700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc94155300 con 0x7fdc94070aa0 2023-10-18T12:42:02.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.744+0000 7fdc9b3d5700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc941555e0 con 0x7fdc94159750 2023-10-18T12:42:02.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.744+0000 7fdc99bd2700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc940ce040 0x7fdc941f2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:02.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.744+0000 7fdc99bd2700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc940ce040 0x7fdc941f2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44446/0 (socket says 172.21.15.114:44446) 2023-10-18T12:42:02.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.744+0000 7fdc99bd2700 1 -- 172.21.15.114:0/1677580054 learned_addr learned my addr 172.21.15.114:0/1677580054 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:42:02.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.744+0000 7fdc9abd4700 1 --2- 172.21.15.114:0/1677580054 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdc94159750 0x7fdc941f3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:02.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.744+0000 7fdc9a3d3700 1 --2- 172.21.15.114:0/1677580054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc94070aa0 0x7fdc941f2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:02.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.744+0000 7fdc99bd2700 1 -- 172.21.15.114:0/1677580054 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdc94159750 msgr2=0x7fdc941f3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:02.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.744+0000 7fdc99bd2700 1 --2- 172.21.15.114:0/1677580054 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdc94159750 0x7fdc941f3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:02.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.744+0000 7fdc99bd2700 1 -- 172.21.15.114:0/1677580054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc94070aa0 msgr2=0x7fdc941f2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:02.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.744+0000 7fdc99bd2700 1 --2- 172.21.15.114:0/1677580054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc94070aa0 0x7fdc941f2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:02.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.744+0000 7fdc99bd2700 1 -- 172.21.15.114:0/1677580054 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc8c009570 con 0x7fdc940ce040 2023-10-18T12:42:02.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.744+0000 7fdc99bd2700 1 --2- 172.21.15.114:0/1677580054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc940ce040 0x7fdc941f2dc0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fdc8400c500 tx=0x7fdc8400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:02.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.744+0000 7fdc8affd700 1 -- 172.21.15.114:0/1677580054 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc840052d0 con 0x7fdc940ce040 2023-10-18T12:42:02.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.744+0000 7fdc8affd700 1 -- 172.21.15.114:0/1677580054 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc84005430 con 0x7fdc940ce040 2023-10-18T12:42:02.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.744+0000 7fdc8affd700 1 -- 172.21.15.114:0/1677580054 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc840055a0 con 0x7fdc940ce040 2023-10-18T12:42:02.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.744+0000 7fdc9b3d5700 1 -- 172.21.15.114:0/1677580054 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc941558c0 con 0x7fdc940ce040 2023-10-18T12:42:02.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.744+0000 7fdc9b3d5700 1 -- 172.21.15.114:0/1677580054 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc94155e80 con 0x7fdc940ce040 2023-10-18T12:42:02.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.748+0000 7fdc9b3d5700 1 -- 172.21.15.114:0/1677580054 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc9404e910 con 0x7fdc940ce040 2023-10-18T12:42:02.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.748+0000 7fdc8affd700 1 -- 172.21.15.114:0/1677580054 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fdc840038e0 con 0x7fdc940ce040 2023-10-18T12:42:02.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.752+0000 7fdc8affd700 1 --2- 172.21.15.114:0/1677580054 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdc780656f0 0x7fdc78067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:02.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.752+0000 7fdc8affd700 1 -- 172.21.15.114:0/1677580054 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5659+0+0 (secure 0 0 0) 0x7fdc84081f90 con 0x7fdc940ce040 2023-10-18T12:42:02.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.752+0000 7fdc9a3d3700 1 --2- 172.21.15.114:0/1677580054 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdc780656f0 0x7fdc78067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:02.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.752+0000 7fdc9a3d3700 1 --2- 172.21.15.114:0/1677580054 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdc780656f0 0x7fdc78067bb0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fdc940c80b0 tx=0x7fdc900098d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:02.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:02.756+0000 7fdc8affd700 1 -- 172.21.15.114:0/1677580054 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fdc840b2d40 con 0x7fdc940ce040 2023-10-18T12:42:03.092 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.084+0000 7fdc9b3d5700 1 -- 172.21.15.114:0/1677580054 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fdc9414ef60 con 0x7fdc940ce040 2023-10-18T12:42:03.109 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.104+0000 7fdc8affd700 1 -- 172.21.15.114:0/1677580054 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v14) v1 ==== 104+0+0 (secure 0 0 0) 0x7fdc8404fbe0 con 0x7fdc940ce040 2023-10-18T12:42:03.117 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.112+0000 7fdc9b3d5700 1 -- 172.21.15.114:0/1677580054 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdc780656f0 msgr2=0x7fdc78067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:03.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.112+0000 7fdc9b3d5700 1 --2- 172.21.15.114:0/1677580054 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdc780656f0 0x7fdc78067bb0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fdc940c80b0 tx=0x7fdc900098d0 comp rx=0 tx=0).stop 2023-10-18T12:42:03.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.112+0000 7fdc9b3d5700 1 -- 172.21.15.114:0/1677580054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc940ce040 msgr2=0x7fdc941f2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:03.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.112+0000 7fdc9b3d5700 1 --2- 172.21.15.114:0/1677580054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc940ce040 0x7fdc941f2dc0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fdc8400c500 tx=0x7fdc8400c810 comp rx=0 tx=0).stop 2023-10-18T12:42:03.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.112+0000 7fdc9b3d5700 1 -- 172.21.15.114:0/1677580054 shutdown_connections 2023-10-18T12:42:03.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.112+0000 7fdc9b3d5700 1 --2- 172.21.15.114:0/1677580054 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdc780656f0 0x7fdc78067bb0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:03.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.112+0000 7fdc9b3d5700 1 --2- 172.21.15.114:0/1677580054 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdc94159750 0x7fdc941f3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:03.119 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.112+0000 7fdc9b3d5700 1 --2- 172.21.15.114:0/1677580054 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdc940ce040 0x7fdc941f2dc0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:03.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.112+0000 7fdc9b3d5700 1 --2- 172.21.15.114:0/1677580054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc94070aa0 0x7fdc941f2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:03.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.112+0000 7fdc9b3d5700 1 -- 172.21.15.114:0/1677580054 >> 172.21.15.114:0/1677580054 conn(0x7fdc940ce5c0 msgr2=0x7fdc9406ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:03.120 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.112+0000 7fdc9b3d5700 1 -- 172.21.15.114:0/1677580054 shutdown_connections 2023-10-18T12:42:03.121 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.112+0000 7fdc9b3d5700 1 -- 172.21.15.114:0/1677580054 wait complete. 2023-10-18T12:42:03.145 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_osd_laggy_weight 2023-10-18T12:42:03.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.304+0000 7f5bef59e700 1 Processor -- start 2023-10-18T12:42:03.310 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.304+0000 7f5bef59e700 1 -- start start 2023-10-18T12:42:03.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.308+0000 7f5bef59e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5bf0159750 0x7f5bf0070560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:03.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.308+0000 7f5bef59e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5bf00ce040 0x7f5bf006cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:03.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.308+0000 7f5bef59e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bf00b14f0 con 0x7f5bf0070aa0 2023-10-18T12:42:03.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.308+0000 7f5bef59e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bf00c9aa0 con 0x7f5bf00ce040 2023-10-18T12:42:03.313 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.308+0000 7f5bef59e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bf0070f30 con 0x7f5bf0159750 2023-10-18T12:42:03.314 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.308+0000 7f5bedd9b700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f5bf0070aa0 0x7f5bf00cd930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:59418/0 (socket says 172.21.15.114:59418) 2023-10-18T12:42:03.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.308+0000 7f5bedd9b700 1 -- 172.21.15.114:0/526170890 learned_addr learned my addr 172.21.15.114:0/526170890 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:42:03.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.308+0000 7f5beed9d700 1 --2- 172.21.15.114:0/526170890 >> v2:172.21.15.114:3300/0 conn(0x7f5bf00ce040 0x7f5bf006cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:03.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.308+0000 7f5bee59c700 1 --2- 172.21.15.114:0/526170890 >> v2:172.21.15.172:3300/0 conn(0x7f5bf0159750 0x7f5bf0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:03.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.308+0000 7f5bed59a700 1 -- 172.21.15.114:0/526170890 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 272717551 0 0) 0x7f5bf00b14f0 con 0x7f5bf0070aa0 2023-10-18T12:42:03.315 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.308+0000 7f5bed59a700 1 -- 172.21.15.114:0/526170890 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bd80057e0 con 0x7f5bf0070aa0 2023-10-18T12:42:03.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.308+0000 7f5bee59c700 1 -- 172.21.15.114:0/526170890 >> v2:172.21.15.114:3300/0 conn(0x7f5bf00ce040 msgr2=0x7f5bf006cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:42:03.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.308+0000 7f5bee59c700 1 --2- 172.21.15.114:0/526170890 >> v2:172.21.15.114:3300/0 conn(0x7f5bf00ce040 0x7f5bf006cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:03.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.308+0000 7f5bee59c700 1 -- 172.21.15.114:0/526170890 >> v1:172.21.15.114:6789/0 conn(0x7f5bf0070aa0 legacy=0x7f5bf00cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:03.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.308+0000 7f5bee59c700 1 -- 172.21.15.114:0/526170890 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf015d590 con 0x7f5bf0159750 2023-10-18T12:42:03.316 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.308+0000 7f5beed9d700 1 --2- 172.21.15.114:0/526170890 >> v2:172.21.15.114:3300/0 conn(0x7f5bf00ce040 0x7f5bf006cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:42:03.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.308+0000 7f5bee59c700 1 --2- 172.21.15.114:0/526170890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bf0159750 0x7f5bf0070560 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5bf006b330 tx=0x7f5be0009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f029f4c0646309a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:03.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.308+0000 7f5bed59a700 1 -- 172.21.15.114:0/526170890 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be0011830 con 0x7f5bf0159750 2023-10-18T12:42:03.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.308+0000 7f5bed59a700 1 -- 172.21.15.114:0/526170890 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be0011990 con 0x7f5bf0159750 2023-10-18T12:42:03.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.308+0000 7f5bed59a700 1 -- 172.21.15.114:0/526170890 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be0011d00 con 0x7f5bf0159750 2023-10-18T12:42:03.318 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.312+0000 7f5bef59e700 1 -- 172.21.15.114:0/526170890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bf0159750 msgr2=0x7f5bf0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:03.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.312+0000 7f5bef59e700 1 --2- 172.21.15.114:0/526170890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bf0159750 0x7f5bf0070560 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5bf006b330 tx=0x7f5be0009b30 comp rx=0 tx=0).stop 2023-10-18T12:42:03.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.312+0000 7f5bef59e700 1 -- 172.21.15.114:0/526170890 shutdown_connections 2023-10-18T12:42:03.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.312+0000 7f5bef59e700 1 --2- 172.21.15.114:0/526170890 >> v2:172.21.15.114:3300/0 conn(0x7f5bf00ce040 0x7f5bf006cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:03.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.312+0000 7f5bef59e700 1 --2- 172.21.15.114:0/526170890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bf0159750 0x7f5bf0070560 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:03.319 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.312+0000 7f5bef59e700 1 -- 172.21.15.114:0/526170890 >> 172.21.15.114:0/526170890 conn(0x7f5bf00ce5c0 msgr2=0x7f5bf00ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:03.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.312+0000 7f5bef59e700 1 -- 172.21.15.114:0/526170890 shutdown_connections 2023-10-18T12:42:03.320 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.312+0000 7f5bef59e700 1 -- 172.21.15.114:0/526170890 wait complete. 2023-10-18T12:42:03.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.316+0000 7f5bef59e700 1 Processor -- start 2023-10-18T12:42:03.321 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.316+0000 7f5bef59e700 1 -- start start 2023-10-18T12:42:03.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.316+0000 7f5bef59e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5bf0070aa0 0x7f5bf01410a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:03.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.316+0000 7f5bef59e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bf00ce040 0x7f5bf01f2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:03.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.316+0000 7f5bef59e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bf0159750 0x7f5bf00b2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:03.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.316+0000 7f5bef59e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf01415e0 con 0x7f5bf0159750 2023-10-18T12:42:03.323 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.316+0000 7f5bef59e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf00c58c0 con 0x7f5bf00ce040 2023-10-18T12:42:03.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.316+0000 7f5bef59e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf0152cb0 con 0x7f5bf0070aa0 2023-10-18T12:42:03.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.316+0000 7f5beed9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bf0159750 0x7f5bf00b2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:03.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.316+0000 7f5beed9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bf0159750 0x7f5bf00b2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44454/0 (socket says 172.21.15.114:44454) 2023-10-18T12:42:03.324 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.316+0000 7f5beed9d700 1 -- 172.21.15.114:0/2769444040 learned_addr learned my addr 172.21.15.114:0/2769444040 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:42:03.326 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.316+0000 7f5bedd9b700 1 --2- 172.21.15.114:0/2769444040 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bf00ce040 0x7f5bf01f2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:03.326 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.316+0000 7f5bee59c700 1 --2- 172.21.15.114:0/2769444040 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5bf0070aa0 0x7f5bf01410a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:03.326 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.316+0000 7f5beed9d700 1 -- 172.21.15.114:0/2769444040 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5bf0070aa0 msgr2=0x7f5bf01410a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:03.326 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.316+0000 7f5beed9d700 1 --2- 172.21.15.114:0/2769444040 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5bf0070aa0 0x7f5bf01410a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:03.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.316+0000 7f5beed9d700 1 -- 172.21.15.114:0/2769444040 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bf00ce040 msgr2=0x7f5bf01f2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:03.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.316+0000 7f5beed9d700 1 --2- 172.21.15.114:0/2769444040 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bf00ce040 0x7f5bf01f2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:03.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.316+0000 7f5beed9d700 1 -- 172.21.15.114:0/2769444040 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be8009a70 con 0x7f5bf0159750 2023-10-18T12:42:03.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.316+0000 7f5bedd9b700 1 --2- 172.21.15.114:0/2769444040 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bf00ce040 0x7f5bf01f2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:42:03.327 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.316+0000 7f5bee59c700 1 --2- 172.21.15.114:0/2769444040 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5bf0070aa0 0x7f5bf01410a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:42:03.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.316+0000 7f5beed9d700 1 --2- 172.21.15.114:0/2769444040 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bf0159750 0x7f5bf00b2440 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f5be8009f00 tx=0x7f5be800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:03.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.316+0000 7f5bdeffd700 1 -- 172.21.15.114:0/2769444040 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be8009d70 con 0x7f5bf0159750 2023-10-18T12:42:03.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.320+0000 7f5bdeffd700 1 -- 172.21.15.114:0/2769444040 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be800f040 con 0x7f5bf0159750 2023-10-18T12:42:03.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.320+0000 7f5bef59e700 1 -- 172.21.15.114:0/2769444040 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5be00094b0 con 0x7f5bf0159750 2023-10-18T12:42:03.328 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.320+0000 7f5bdeffd700 1 -- 172.21.15.114:0/2769444040 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be8014680 con 0x7f5bf0159750 2023-10-18T12:42:03.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.320+0000 7f5bef59e700 1 -- 172.21.15.114:0/2769444040 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf0153270 con 0x7f5bf0159750 2023-10-18T12:42:03.329 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.320+0000 7f5bef59e700 1 -- 172.21.15.114:0/2769444040 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bf004e910 con 0x7f5bf0159750 2023-10-18T12:42:03.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.320+0000 7f5bdeffd700 1 -- 172.21.15.114:0/2769444040 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f5be80147e0 con 0x7f5bf0159750 2023-10-18T12:42:03.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.324+0000 7f5bdeffd700 1 --2- 172.21.15.114:0/2769444040 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5bd00656f0 0x7f5bd0067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:03.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.324+0000 7f5bdeffd700 1 -- 172.21.15.114:0/2769444040 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5659+0+0 (secure 0 0 0) 0x7f5be8083a50 con 0x7f5bf0159750 2023-10-18T12:42:03.330 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.324+0000 7f5bee59c700 1 --2- 172.21.15.114:0/2769444040 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5bd00656f0 0x7f5bd0067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:03.331 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.324+0000 7f5bee59c700 1 --2- 172.21.15.114:0/2769444040 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5bd00656f0 0x7f5bd0067bb0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5bf00c8690 tx=0x7f5be0008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:03.336 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.332+0000 7f5bdeffd700 1 -- 172.21.15.114:0/2769444040 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f5be8051600 con 0x7f5bf0159750 2023-10-18T12:42:03.529 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.524+0000 7f5bef59e700 1 -- 172.21.15.114:0/2769444040 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_osd_laggy_weight"} v 0) v1 -- 0x7f5bf015e100 con 0x7f5bf0159750 2023-10-18T12:42:03.539 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.532+0000 7f5bdeffd700 1 -- 172.21.15.114:0/2769444040 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_osd_laggy_weight"}]=0 v15) v1 ==== 103+0+0 (secure 0 0 0) 0x7f5be8018020 con 0x7f5bf0159750 2023-10-18T12:42:03.544 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.536+0000 7f5bef59e700 1 -- 172.21.15.114:0/2769444040 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5bd00656f0 msgr2=0x7f5bd0067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:03.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.536+0000 7f5bef59e700 1 --2- 172.21.15.114:0/2769444040 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5bd00656f0 0x7f5bd0067bb0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5bf00c8690 tx=0x7f5be0008030 comp rx=0 tx=0).stop 2023-10-18T12:42:03.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.540+0000 7f5bef59e700 1 -- 172.21.15.114:0/2769444040 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bf0159750 msgr2=0x7f5bf00b2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:03.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.540+0000 7f5bef59e700 1 --2- 172.21.15.114:0/2769444040 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bf0159750 0x7f5bf00b2440 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f5be8009f00 tx=0x7f5be800c3a0 comp rx=0 tx=0).stop 2023-10-18T12:42:03.545 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.540+0000 7f5bef59e700 1 -- 172.21.15.114:0/2769444040 shutdown_connections 2023-10-18T12:42:03.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.540+0000 7f5bef59e700 1 --2- 172.21.15.114:0/2769444040 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5bd00656f0 0x7f5bd0067bb0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:03.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.540+0000 7f5bef59e700 1 --2- 172.21.15.114:0/2769444040 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bf0159750 0x7f5bf00b2440 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:03.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.540+0000 7f5bef59e700 1 --2- 172.21.15.114:0/2769444040 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bf00ce040 0x7f5bf01f2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:03.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.540+0000 7f5bef59e700 1 --2- 172.21.15.114:0/2769444040 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5bf0070aa0 0x7f5bf01410a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:03.546 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.540+0000 7f5bef59e700 1 -- 172.21.15.114:0/2769444040 >> 172.21.15.114:0/2769444040 conn(0x7f5bf00ce5c0 msgr2=0x7f5bf00cd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:03.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.540+0000 7f5bef59e700 1 -- 172.21.15.114:0/2769444040 shutdown_connections 2023-10-18T12:42:03.547 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.540+0000 7f5bef59e700 1 -- 172.21.15.114:0/2769444040 wait complete. 2023-10-18T12:42:03.566 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds defer_client_eviction_on_laggy_osds 2023-10-18T12:42:03.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.740+0000 7fb20520f700 1 Processor -- start 2023-10-18T12:42:03.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.740+0000 7fb20520f700 1 -- start start 2023-10-18T12:42:03.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.744+0000 7fb20520f700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb2000d2e00 0x7fb2000b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:03.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.744+0000 7fb20520f700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb2000b5ae0 0x7fb20006db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:03.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.744+0000 7fb20520f700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb20015d0d0 con 0x7fb200160710 2023-10-18T12:42:03.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.744+0000 7fb20520f700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb20015df90 con 0x7fb2000d2e00 2023-10-18T12:42:03.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.744+0000 7fb20520f700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb20006f0f0 con 0x7fb2000b5ae0 2023-10-18T12:42:03.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.744+0000 7fb1fffff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb2000d2e00 0x7fb2000b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:03.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.744+0000 7fb1fffff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fb2000d2e00 0x7fb2000b6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44456/0 (socket says 172.21.15.114:44456) 2023-10-18T12:42:03.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.744+0000 7fb1fffff700 1 -- 172.21.15.114:0/3241430422 learned_addr learned my addr 172.21.15.114:0/3241430422 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:42:03.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.744+0000 7fb204a0e700 1 --2- 172.21.15.114:0/3241430422 >> v2:172.21.15.172:3300/0 conn(0x7fb2000b5ae0 0x7fb20006db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:03.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.744+0000 7fb1fffff700 1 -- 172.21.15.114:0/3241430422 >> v2:172.21.15.172:3300/0 conn(0x7fb2000b5ae0 msgr2=0x7fb20006db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:42:03.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.744+0000 7fb1fffff700 1 --2- 172.21.15.114:0/3241430422 >> v2:172.21.15.172:3300/0 conn(0x7fb2000b5ae0 0x7fb20006db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:03.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.744+0000 7fb1fffff700 1 -- 172.21.15.114:0/3241430422 >> v1:172.21.15.172:6789/0 conn(0x7fb200160710 legacy=0x7fb2000d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:42:03.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.744+0000 7fb1fffff700 1 -- 172.21.15.114:0/3241430422 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb20015d310 con 0x7fb2000d2e00 2023-10-18T12:42:03.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.748+0000 7fb1fffff700 1 --2- 172.21.15.114:0/3241430422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2000d2e00 0x7fb2000b6e00 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fb20006d040 tx=0x7fb1f0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7ac4a44c1d5695 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:03.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.748+0000 7fb1ff7fe700 1 -- 172.21.15.114:0/3241430422 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f0004230 con 0x7fb2000d2e00 2023-10-18T12:42:03.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.748+0000 7fb1ff7fe700 1 -- 172.21.15.114:0/3241430422 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f0004390 con 0x7fb2000d2e00 2023-10-18T12:42:03.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.748+0000 7fb1ff7fe700 1 -- 172.21.15.114:0/3241430422 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f00036c0 con 0x7fb2000d2e00 2023-10-18T12:42:03.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.748+0000 7fb20520f700 1 -- 172.21.15.114:0/3241430422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2000d2e00 msgr2=0x7fb2000b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:03.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.748+0000 7fb20520f700 1 --2- 172.21.15.114:0/3241430422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2000d2e00 0x7fb2000b6e00 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fb20006d040 tx=0x7fb1f0009bf0 comp rx=0 tx=0).stop 2023-10-18T12:42:03.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.748+0000 7fb20520f700 1 -- 172.21.15.114:0/3241430422 shutdown_connections 2023-10-18T12:42:03.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.748+0000 7fb20520f700 1 --2- 172.21.15.114:0/3241430422 >> v2:172.21.15.172:3300/0 conn(0x7fb2000b5ae0 0x7fb20006db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:03.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.748+0000 7fb20520f700 1 --2- 172.21.15.114:0/3241430422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2000d2e00 0x7fb2000b6e00 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:03.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.748+0000 7fb20520f700 1 -- 172.21.15.114:0/3241430422 >> 172.21.15.114:0/3241430422 conn(0x7fb200069f20 msgr2=0x7fb20006a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:03.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.748+0000 7fb20520f700 1 -- 172.21.15.114:0/3241430422 shutdown_connections 2023-10-18T12:42:03.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.748+0000 7fb20520f700 1 -- 172.21.15.114:0/3241430422 wait complete. 2023-10-18T12:42:03.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.752+0000 7fb20520f700 1 Processor -- start 2023-10-18T12:42:03.758 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.752+0000 7fb20520f700 1 -- start start 2023-10-18T12:42:03.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.752+0000 7fb20520f700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2000b5ae0 0x7fb200152310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:03.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.752+0000 7fb20520f700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2000d2e00 0x7fb200151910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:03.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.752+0000 7fb20520f700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb200160710 0x7fb2000cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:03.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.752+0000 7fb20520f700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2001f32a0 con 0x7fb2000d2e00 2023-10-18T12:42:03.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.752+0000 7fb20520f700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2001f2690 con 0x7fb200160710 2023-10-18T12:42:03.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.752+0000 7fb20520f700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2001f2970 con 0x7fb2000b5ae0 2023-10-18T12:42:03.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.752+0000 7fb1f7fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2000d2e00 0x7fb200151910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:03.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.752+0000 7fb1f7fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2000d2e00 0x7fb200151910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44462/0 (socket says 172.21.15.114:44462) 2023-10-18T12:42:03.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.752+0000 7fb1f7fff700 1 -- 172.21.15.114:0/212290073 learned_addr learned my addr 172.21.15.114:0/212290073 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:42:03.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.752+0000 7fb1fffff700 1 --2- 172.21.15.114:0/212290073 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2000b5ae0 0x7fb200152310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:03.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.752+0000 7fb204a0e700 1 --2- 172.21.15.114:0/212290073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb200160710 0x7fb2000cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:03.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.752+0000 7fb1f7fff700 1 -- 172.21.15.114:0/212290073 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2000b5ae0 msgr2=0x7fb200152310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:03.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.752+0000 7fb1f7fff700 1 --2- 172.21.15.114:0/212290073 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2000b5ae0 0x7fb200152310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:03.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.752+0000 7fb1f7fff700 1 -- 172.21.15.114:0/212290073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb200160710 msgr2=0x7fb2000cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:03.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.752+0000 7fb1f7fff700 1 --2- 172.21.15.114:0/212290073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb200160710 0x7fb2000cf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:03.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.752+0000 7fb1f7fff700 1 -- 172.21.15.114:0/212290073 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f0009570 con 0x7fb2000d2e00 2023-10-18T12:42:03.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.752+0000 7fb204a0e700 1 --2- 172.21.15.114:0/212290073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb200160710 0x7fb2000cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:42:03.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.756+0000 7fb1f7fff700 1 --2- 172.21.15.114:0/212290073 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2000d2e00 0x7fb200151910 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fb1e800c550 tx=0x7fb1e800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:03.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.756+0000 7fb1fd7fa700 1 -- 172.21.15.114:0/212290073 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e8011790 con 0x7fb2000d2e00 2023-10-18T12:42:03.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.756+0000 7fb1fd7fa700 1 -- 172.21.15.114:0/212290073 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e80118f0 con 0x7fb2000d2e00 2023-10-18T12:42:03.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.756+0000 7fb1fd7fa700 1 -- 172.21.15.114:0/212290073 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e8011ca0 con 0x7fb2000d2e00 2023-10-18T12:42:03.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.756+0000 7fb20520f700 1 -- 172.21.15.114:0/212290073 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2001f2c50 con 0x7fb2000d2e00 2023-10-18T12:42:03.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.756+0000 7fb20520f700 1 -- 172.21.15.114:0/212290073 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2001f2380 con 0x7fb2000d2e00 2023-10-18T12:42:03.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.756+0000 7fb20520f700 1 -- 172.21.15.114:0/212290073 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb20004e910 con 0x7fb2000d2e00 2023-10-18T12:42:03.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.756+0000 7fb1fd7fa700 1 -- 172.21.15.114:0/212290073 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fb1e801c460 con 0x7fb2000d2e00 2023-10-18T12:42:03.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.756+0000 7fb1fd7fa700 1 --2- 172.21.15.114:0/212290073 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb1e00656f0 0x7fb1e0067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:03.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.760+0000 7fb1fd7fa700 1 -- 172.21.15.114:0/212290073 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5659+0+0 (secure 0 0 0) 0x7fb1e80828d0 con 0x7fb2000d2e00 2023-10-18T12:42:03.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.760+0000 7fb1fffff700 1 --2- 172.21.15.114:0/212290073 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb1e00656f0 0x7fb1e0067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:03.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.760+0000 7fb1fffff700 1 --2- 172.21.15.114:0/212290073 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb1e00656f0 0x7fb1e0067bb0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb20006d040 tx=0x7fb1f0008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:03.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.764+0000 7fb1fd7fa700 1 -- 172.21.15.114:0/212290073 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fb1e80504a0 con 0x7fb2000d2e00 2023-10-18T12:42:03.964 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.956+0000 7fb20520f700 1 -- 172.21.15.114:0/212290073 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "defer_client_eviction_on_laggy_osds"} v 0) v1 -- 0x7fb20006d3e0 con 0x7fb2000d2e00 2023-10-18T12:42:03.974 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.968+0000 7fb1fd7fa700 1 -- 172.21.15.114:0/212290073 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "defer_client_eviction_on_laggy_osds"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb1e8053ac0 con 0x7fb2000d2e00 2023-10-18T12:42:03.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.972+0000 7fb20520f700 1 -- 172.21.15.114:0/212290073 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb1e00656f0 msgr2=0x7fb1e0067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:03.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.972+0000 7fb20520f700 1 --2- 172.21.15.114:0/212290073 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb1e00656f0 0x7fb1e0067bb0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb20006d040 tx=0x7fb1f0008030 comp rx=0 tx=0).stop 2023-10-18T12:42:03.977 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.972+0000 7fb20520f700 1 -- 172.21.15.114:0/212290073 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2000d2e00 msgr2=0x7fb200151910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:03.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.972+0000 7fb20520f700 1 --2- 172.21.15.114:0/212290073 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2000d2e00 0x7fb200151910 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fb1e800c550 tx=0x7fb1e800c910 comp rx=0 tx=0).stop 2023-10-18T12:42:03.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.972+0000 7fb20520f700 1 -- 172.21.15.114:0/212290073 shutdown_connections 2023-10-18T12:42:03.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.972+0000 7fb20520f700 1 --2- 172.21.15.114:0/212290073 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb1e00656f0 0x7fb1e0067bb0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:03.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.972+0000 7fb20520f700 1 --2- 172.21.15.114:0/212290073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb200160710 0x7fb2000cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:03.978 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.972+0000 7fb20520f700 1 --2- 172.21.15.114:0/212290073 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb2000d2e00 0x7fb200151910 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:03.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.972+0000 7fb20520f700 1 --2- 172.21.15.114:0/212290073 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb2000b5ae0 0x7fb200152310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:03.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.972+0000 7fb20520f700 1 -- 172.21.15.114:0/212290073 >> 172.21.15.114:0/212290073 conn(0x7fb200069f20 msgr2=0x7fb2000b3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:03.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.972+0000 7fb20520f700 1 -- 172.21.15.114:0/212290073 shutdown_connections 2023-10-18T12:42:03.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:03.972+0000 7fb20520f700 1 -- 172.21.15.114:0/212290073 wait complete. 2023-10-18T12:42:03.999 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_recovery.TestClientOnLaggyOSD.test_client_eviction_if_config_is_set' 2023-10-18T12:42:04.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.160+0000 7feb5759e700 1 Processor -- start 2023-10-18T12:42:04.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.160+0000 7feb5759e700 1 -- start start 2023-10-18T12:42:04.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.160+0000 7feb5759e700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7feb58160710 0x7feb580b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:04.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.160+0000 7feb5759e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb5815d0d0 con 0x7feb580d2e00 2023-10-18T12:42:04.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.160+0000 7feb5759e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb5806f0f0 con 0x7feb580b5ae0 2023-10-18T12:42:04.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.160+0000 7feb5759e700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb5815df90 con 0x7feb58160710 2023-10-18T12:42:04.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.160+0000 7feb55d9b700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7feb58160710 0x7feb580b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:04.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.160+0000 7feb5659c700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7feb580d2e00 0x7feb580d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:59430/0 (socket says 172.21.15.114:59430) 2023-10-18T12:42:04.168 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.160+0000 7feb5659c700 1 -- 172.21.15.114:0/4238308823 learned_addr learned my addr 172.21.15.114:0/4238308823 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:42:04.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.160+0000 7feb55d9b700 1 -- 172.21.15.114:0/4238308823 >> v1:172.21.15.172:6789/0 conn(0x7feb580b5ae0 legacy=0x7feb5806db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:04.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.160+0000 7feb55d9b700 1 -- 172.21.15.114:0/4238308823 >> v1:172.21.15.114:6789/0 conn(0x7feb580d2e00 legacy=0x7feb580d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:04.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.164+0000 7feb55d9b700 1 -- 172.21.15.114:0/4238308823 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb5815d310 con 0x7feb58160710 2023-10-18T12:42:04.169 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.164+0000 7feb55d9b700 1 --2- 172.21.15.114:0/4238308823 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb58160710 0x7feb580b6e00 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7feb4c009850 tx=0x7feb4c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=932858822ef67e11 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:04.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.164+0000 7feb5559a700 1 -- 172.21.15.114:0/4238308823 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4c011830 con 0x7feb58160710 2023-10-18T12:42:04.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.164+0000 7feb5559a700 1 -- 172.21.15.114:0/4238308823 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb4c011990 con 0x7feb58160710 2023-10-18T12:42:04.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.164+0000 7feb5559a700 1 -- 172.21.15.114:0/4238308823 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4c011d20 con 0x7feb58160710 2023-10-18T12:42:04.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.164+0000 7feb5759e700 1 -- 172.21.15.114:0/4238308823 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb58160710 msgr2=0x7feb580b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:04.171 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.164+0000 7feb5759e700 1 --2- 172.21.15.114:0/4238308823 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb58160710 0x7feb580b6e00 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7feb4c009850 tx=0x7feb4c009b60 comp rx=0 tx=0).stop 2023-10-18T12:42:04.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.164+0000 7feb5759e700 1 -- 172.21.15.114:0/4238308823 shutdown_connections 2023-10-18T12:42:04.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.164+0000 7feb5759e700 1 --2- 172.21.15.114:0/4238308823 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb58160710 0x7feb580b6e00 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:04.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.164+0000 7feb5759e700 1 -- 172.21.15.114:0/4238308823 >> 172.21.15.114:0/4238308823 conn(0x7feb58069f20 msgr2=0x7feb5806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:04.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.164+0000 7feb5759e700 1 -- 172.21.15.114:0/4238308823 shutdown_connections 2023-10-18T12:42:04.172 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.164+0000 7feb5759e700 1 -- 172.21.15.114:0/4238308823 wait complete. 2023-10-18T12:42:04.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.168+0000 7feb5759e700 1 Processor -- start 2023-10-18T12:42:04.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.168+0000 7feb5759e700 1 -- start start 2023-10-18T12:42:04.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.168+0000 7feb5759e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb580b5ae0 0x7feb58151780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:04.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.168+0000 7feb5759e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feb580d2e00 0x7feb58154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:04.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.168+0000 7feb5759e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb58160710 0x7feb580d0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:04.175 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.168+0000 7feb5759e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb581f5ac0 con 0x7feb580b5ae0 2023-10-18T12:42:04.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.168+0000 7feb5759e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb581f5da0 con 0x7feb58160710 2023-10-18T12:42:04.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.168+0000 7feb5759e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb581f6080 con 0x7feb580d2e00 2023-10-18T12:42:04.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.168+0000 7feb5659c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb580b5ae0 0x7feb58151780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:04.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.168+0000 7feb5659c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb580b5ae0 0x7feb58151780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:44474/0 (socket says 172.21.15.114:44474) 2023-10-18T12:42:04.176 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.168+0000 7feb5659c700 1 -- 172.21.15.114:0/3645789848 learned_addr learned my addr 172.21.15.114:0/3645789848 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:42:04.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.168+0000 7feb56d9d700 1 --2- 172.21.15.114:0/3645789848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb58160710 0x7feb580d0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:04.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.168+0000 7feb55d9b700 1 --2- 172.21.15.114:0/3645789848 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feb580d2e00 0x7feb58154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:04.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.168+0000 7feb5659c700 1 -- 172.21.15.114:0/3645789848 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feb580d2e00 msgr2=0x7feb58154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:04.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.168+0000 7feb5659c700 1 --2- 172.21.15.114:0/3645789848 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feb580d2e00 0x7feb58154160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:04.177 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.168+0000 7feb5659c700 1 -- 172.21.15.114:0/3645789848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb58160710 msgr2=0x7feb580d0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:04.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.168+0000 7feb5659c700 1 --2- 172.21.15.114:0/3645789848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb58160710 0x7feb580d0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:04.178 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.168+0000 7feb5659c700 1 -- 172.21.15.114:0/3645789848 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb4c0094b0 con 0x7feb580b5ae0 2023-10-18T12:42:04.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.168+0000 7feb5659c700 1 --2- 172.21.15.114:0/3645789848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb580b5ae0 0x7feb58151780 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7feb48001eb0 tx=0x7feb4800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:04.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.168+0000 7feb46ffd700 1 -- 172.21.15.114:0/3645789848 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb48005d90 con 0x7feb580b5ae0 2023-10-18T12:42:04.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.168+0000 7feb46ffd700 1 -- 172.21.15.114:0/3645789848 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb480070d0 con 0x7feb580b5ae0 2023-10-18T12:42:04.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.168+0000 7feb46ffd700 1 -- 172.21.15.114:0/3645789848 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb48007440 con 0x7feb580b5ae0 2023-10-18T12:42:04.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.168+0000 7feb5759e700 1 -- 172.21.15.114:0/3645789848 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb581f6360 con 0x7feb580b5ae0 2023-10-18T12:42:04.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.172+0000 7feb5759e700 1 -- 172.21.15.114:0/3645789848 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb580b2e20 con 0x7feb580b5ae0 2023-10-18T12:42:04.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.172+0000 7feb5759e700 1 -- 172.21.15.114:0/3645789848 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb581f64f0 con 0x7feb580b5ae0 2023-10-18T12:42:04.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.172+0000 7feb46ffd700 1 -- 172.21.15.114:0/3645789848 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7feb480075a0 con 0x7feb580b5ae0 2023-10-18T12:42:04.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.176+0000 7feb46ffd700 1 --2- 172.21.15.114:0/3645789848 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7feb38065720 0x7feb38067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:04.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.176+0000 7feb46ffd700 1 -- 172.21.15.114:0/3645789848 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5659+0+0 (secure 0 0 0) 0x7feb48081e50 con 0x7feb580b5ae0 2023-10-18T12:42:04.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.176+0000 7feb55d9b700 1 --2- 172.21.15.114:0/3645789848 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7feb38065720 0x7feb38067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:04.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.176+0000 7feb55d9b700 1 --2- 172.21.15.114:0/3645789848 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7feb38065720 0x7feb38067be0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7feb4c009850 tx=0x7feb4c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:04.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.184+0000 7feb46ffd700 1 -- 172.21.15.114:0/3645789848 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7feb4804fb60 con 0x7feb580b5ae0 2023-10-18T12:42:04.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.464+0000 7feb5759e700 1 -- 172.21.15.114:0/3645789848 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientOnLaggyOSD.test_client_eviction_if_config_is_set"]} v 0) v1 -- 0x7feb5815d0d0 con 0x7feb580b5ae0 2023-10-18T12:42:04.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.548+0000 7feb46ffd700 1 -- 172.21.15.114:0/3645789848 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_recovery.TestClientOnLaggyOSD.test_client_eviction_if_config_is_set"]}]=0 v783) v1 ==== 171+0+0 (secure 0 0 0) 0x7feb5815d0d0 con 0x7feb580b5ae0 2023-10-18T12:42:04.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.552+0000 7feb5759e700 1 -- 172.21.15.114:0/3645789848 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7feb38065720 msgr2=0x7feb38067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:04.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.552+0000 7feb5759e700 1 --2- 172.21.15.114:0/3645789848 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7feb38065720 0x7feb38067be0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7feb4c009850 tx=0x7feb4c008030 comp rx=0 tx=0).stop 2023-10-18T12:42:04.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.552+0000 7feb5759e700 1 -- 172.21.15.114:0/3645789848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb580b5ae0 msgr2=0x7feb58151780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:04.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.552+0000 7feb5759e700 1 --2- 172.21.15.114:0/3645789848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb580b5ae0 0x7feb58151780 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7feb48001eb0 tx=0x7feb4800c860 comp rx=0 tx=0).stop 2023-10-18T12:42:04.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.552+0000 7feb5759e700 1 -- 172.21.15.114:0/3645789848 shutdown_connections 2023-10-18T12:42:04.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.552+0000 7feb5759e700 1 --2- 172.21.15.114:0/3645789848 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7feb38065720 0x7feb38067be0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:04.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.552+0000 7feb5759e700 1 --2- 172.21.15.114:0/3645789848 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7feb580d2e00 0x7feb58154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:04.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.552+0000 7feb5759e700 1 --2- 172.21.15.114:0/3645789848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb58160710 0x7feb580d0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:04.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.552+0000 7feb5759e700 1 --2- 172.21.15.114:0/3645789848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feb580b5ae0 0x7feb58151780 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:04.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.552+0000 7feb5759e700 1 -- 172.21.15.114:0/3645789848 >> 172.21.15.114:0/3645789848 conn(0x7feb58069f20 msgr2=0x7feb580b3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:04.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.552+0000 7feb5759e700 1 -- 172.21.15.114:0/3645789848 shutdown_connections 2023-10-18T12:42:04.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:04.552+0000 7feb5759e700 1 -- 172.21.15.114:0/3645789848 wait complete. 2023-10-18T12:42:04.583 INFO:tasks.cephfs_test_runner:If any client gets unresponsive/it's session get idle due to lagginess ... ERROR 2023-10-18T12:42:04.584 INFO:tasks.cephfs_test_runner: 2023-10-18T12:42:04.584 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-18T12:42:04.584 INFO:tasks.cephfs_test_runner:ERROR: test_client_eviction_if_config_is_set (tasks.cephfs.test_client_recovery.TestClientOnLaggyOSD) 2023-10-18T12:42:04.585 INFO:tasks.cephfs_test_runner:If any client gets unresponsive/it's session get idle due to lagginess 2023-10-18T12:42:04.585 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-18T12:42:04.585 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-18T12:42:04.586 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_dparmar18_ceph_cbffa2410012c3070b383ae678737c8b7a571026/qa/tasks/cephfs/test_client_recovery.py", line 827, in test_client_eviction_if_config_is_set 2023-10-18T12:42:04.586 INFO:tasks.cephfs_test_runner: while proceed(): 2023-10-18T12:42:04.586 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 134, in __call__ 2023-10-18T12:42:04.587 INFO:tasks.cephfs_test_runner: raise MaxWhileTries(error_msg) 2023-10-18T12:42:04.587 INFO:tasks.cephfs_test_runner:teuthology.exceptions.MaxWhileTries: reached maximum tries (21) after waiting for 20 seconds 2023-10-18T12:42:04.587 INFO:tasks.cephfs_test_runner: 2023-10-18T12:42:04.587 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-18T12:42:04.588 INFO:tasks.cephfs_test_runner:Ran 2 tests in 1290.617s 2023-10-18T12:42:04.588 INFO:tasks.cephfs_test_runner: 2023-10-18T12:42:04.588 INFO:tasks.cephfs_test_runner:FAILED (errors=1, skipped=1) 2023-10-18T12:42:04.588 INFO:tasks.cephfs_test_runner: 2023-10-18T12:42:04.589 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-18T12:42:04.589 INFO:tasks.cephfs_test_runner:ERROR: test_client_eviction_if_config_is_set (tasks.cephfs.test_client_recovery.TestClientOnLaggyOSD) 2023-10-18T12:42:04.589 INFO:tasks.cephfs_test_runner:If any client gets unresponsive/it's session get idle due to lagginess 2023-10-18T12:42:04.589 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-18T12:42:04.590 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-18T12:42:04.590 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_dparmar18_ceph_cbffa2410012c3070b383ae678737c8b7a571026/qa/tasks/cephfs/test_client_recovery.py", line 827, in test_client_eviction_if_config_is_set 2023-10-18T12:42:04.590 INFO:tasks.cephfs_test_runner: while proceed(): 2023-10-18T12:42:04.590 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 134, in __call__ 2023-10-18T12:42:04.591 INFO:tasks.cephfs_test_runner: raise MaxWhileTries(error_msg) 2023-10-18T12:42:04.591 INFO:tasks.cephfs_test_runner:teuthology.exceptions.MaxWhileTries: reached maximum tries (21) after waiting for 20 seconds 2023-10-18T12:42:04.591 INFO:tasks.cephfs_test_runner: 2023-10-18T12:42:04.592 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_cbffa2410012c3070b383ae678737c8b7a571026/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_client_eviction_if_config_is_set (tasks.cephfs.test_client_recovery.TestClientOnLaggyOSD) 2023-10-18T12:42:04.653 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=0e88186871bc4939bc83b9b33f5f6d21 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_cbffa2410012c3070b383ae678737c8b7a571026/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_client_eviction_if_config_is_set (tasks.cephfs.test_client_recovery.TestClientOnLaggyOSD) 2023-10-18T12:42:04.655 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-18T12:42:04.664 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-18T12:42:04.671 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-18T12:42:04.672 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:42:04.672 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-18T12:42:04.696 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352264k,nr_inodes=4088066,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2657 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-18T12:42:04.696 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2023-10-18T12:42:04.697 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-18T12:42:04.761 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352264k,nr_inodes=4088066,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2657 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-18T12:42:04.761 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T12:42:04.761 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-18T12:42:04.783 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352316k,nr_inodes=4088079,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2928 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-18T12:42:04.784 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-10-18T12:42:04.784 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-18T12:42:04.845 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352316k,nr_inodes=4088079,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2928 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275384k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-18T12:42:04.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:42:04.846 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2023-10-18T12:42:04.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-18T12:42:04.864 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-18T12:42:04.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:42:04.865 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-18T12:42:04.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:42:04.945 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-18T12:42:05.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:42:05.054 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link delete ceph-brx 2023-10-18T12:42:05.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:42:05.204 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2023-10-18T12:42:05.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:42:05.220 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link delete ceph-brx 2023-10-18T12:42:05.301 INFO:teuthology.orchestra.run.smithi114.stderr:Cannot find device "ceph-brx" 2023-10-18T12:42:05.302 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T12:42:05.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:42:05.303 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2023-10-18T12:42:05.326 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-18T12:42:05.326 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-18T12:42:05.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:42:05.327 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-18T12:42:05.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:42:05.410 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-18T12:42:05.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:42:05.510 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link delete ceph-brx 2023-10-18T12:42:05.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:42:05.674 DEBUG:teuthology.orchestra.run.smithi172:> ip netns list 2023-10-18T12:42:05.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-18T12:42:05.688 DEBUG:teuthology.orchestra.run.smithi172:> sudo ip link delete ceph-brx 2023-10-18T12:42:05.776 INFO:teuthology.orchestra.run.smithi172.stderr:Cannot find device "ceph-brx" 2023-10-18T12:42:05.779 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T12:42:05.779 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-18T12:42:05.789 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-18T12:42:05.790 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-18T12:42:05.979 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.972+0000 7fc72f3e8700 1 Processor -- start 2023-10-18T12:42:05.980 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.972+0000 7fc72f3e8700 1 -- start start 2023-10-18T12:42:05.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.976+0000 7fc72f3e8700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc72815ce10 0x7fc7280706f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:05.982 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.976+0000 7fc72f3e8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc72806dc30 0x7fc7280cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:05.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.976+0000 7fc72f3e8700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc7280ccbd0 0x7fc72806f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:05.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.976+0000 7fc72f3e8700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7280cd080 con 0x7fc7280ccbd0 2023-10-18T12:42:05.983 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.976+0000 7fc72f3e8700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc72806e130 con 0x7fc72815ce10 2023-10-18T12:42:05.984 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.976+0000 7fc72f3e8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc72806e410 con 0x7fc72806dc30 2023-10-18T12:42:05.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.976+0000 7fc72d985700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc7280ccbd0 0x7fc72806f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:05.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.976+0000 7fc72c983700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc72806dc30 0x7fc7280cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:05.985 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.976+0000 7fc72d184700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fc72815ce10 0x7fc7280706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:05.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.976+0000 7fc72d985700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc7280ccbd0 0x7fc72806f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36770/0 (socket says 172.21.15.114:36770) 2023-10-18T12:42:05.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.976+0000 7fc72d985700 1 -- 172.21.15.114:0/849491937 learned_addr learned my addr 172.21.15.114:0/849491937 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:42:05.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.976+0000 7fc72c983700 1 -- 172.21.15.114:0/849491937 >> v2:172.21.15.172:3300/0 conn(0x7fc72815ce10 msgr2=0x7fc7280706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:42:05.986 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.976+0000 7fc72c983700 1 --2- 172.21.15.114:0/849491937 >> v2:172.21.15.172:3300/0 conn(0x7fc72815ce10 0x7fc7280706f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:05.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.976+0000 7fc72c983700 1 -- 172.21.15.114:0/849491937 >> v2:172.21.15.114:3300/0 conn(0x7fc7280ccbd0 msgr2=0x7fc72806f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:42:05.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.976+0000 7fc72c983700 1 --2- 172.21.15.114:0/849491937 >> v2:172.21.15.114:3300/0 conn(0x7fc7280ccbd0 0x7fc72806f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:05.987 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.976+0000 7fc72c983700 1 -- 172.21.15.114:0/849491937 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc72806e6f0 con 0x7fc72806dc30 2023-10-18T12:42:05.988 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.980+0000 7fc72c983700 1 --2- 172.21.15.114:0/849491937 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc72806dc30 0x7fc7280cc690 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc7280b1420 tx=0x7fc718009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b2e17309131351c server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:05.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.980+0000 7fc71ffff700 1 -- 172.21.15.114:0/849491937 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc718011830 con 0x7fc72806dc30 2023-10-18T12:42:05.989 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.980+0000 7fc71ffff700 1 -- 172.21.15.114:0/849491937 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc718011990 con 0x7fc72806dc30 2023-10-18T12:42:05.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.980+0000 7fc71ffff700 1 -- 172.21.15.114:0/849491937 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc718011d20 con 0x7fc72806dc30 2023-10-18T12:42:05.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.980+0000 7fc72f3e8700 1 -- 172.21.15.114:0/849491937 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc72806dc30 msgr2=0x7fc7280cc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:05.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.980+0000 7fc72f3e8700 1 --2- 172.21.15.114:0/849491937 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc72806dc30 0x7fc7280cc690 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc7280b1420 tx=0x7fc718009b30 comp rx=0 tx=0).stop 2023-10-18T12:42:05.990 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.980+0000 7fc72f3e8700 1 -- 172.21.15.114:0/849491937 shutdown_connections 2023-10-18T12:42:05.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.980+0000 7fc72f3e8700 1 --2- 172.21.15.114:0/849491937 >> v2:172.21.15.114:3300/0 conn(0x7fc7280ccbd0 0x7fc72806f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:05.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.980+0000 7fc72f3e8700 1 --2- 172.21.15.114:0/849491937 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc72806dc30 0x7fc7280cc690 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:05.991 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.980+0000 7fc72f3e8700 1 --2- 172.21.15.114:0/849491937 >> v2:172.21.15.172:3300/0 conn(0x7fc72815ce10 0x7fc7280706f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:05.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.980+0000 7fc72f3e8700 1 -- 172.21.15.114:0/849491937 >> 172.21.15.114:0/849491937 conn(0x7fc7280cee50 msgr2=0x7fc7280cb2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:05.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.980+0000 7fc72f3e8700 1 -- 172.21.15.114:0/849491937 shutdown_connections 2023-10-18T12:42:05.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.980+0000 7fc72f3e8700 1 -- 172.21.15.114:0/849491937 wait complete. 2023-10-18T12:42:05.992 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.984+0000 7fc72f3e8700 1 Processor -- start 2023-10-18T12:42:05.993 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.984+0000 7fc72f3e8700 1 -- start start 2023-10-18T12:42:05.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.984+0000 7fc72f3e8700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc72806dc30 0x7fc7281548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:05.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.984+0000 7fc72f3e8700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7280ccbd0 0x7fc7280c4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:05.995 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.984+0000 7fc72f3e8700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc72815ce10 0x7fc7280c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:05.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.984+0000 7fc72f3e8700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7281f2030 con 0x7fc7280ccbd0 2023-10-18T12:42:05.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.984+0000 7fc72f3e8700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7280afce0 con 0x7fc72815ce10 2023-10-18T12:42:05.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.984+0000 7fc72f3e8700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc728154e10 con 0x7fc72806dc30 2023-10-18T12:42:05.996 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.984+0000 7fc72c983700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7280ccbd0 0x7fc7280c4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:05.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.984+0000 7fc72c983700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7280ccbd0 0x7fc7280c4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36780/0 (socket says 172.21.15.114:36780) 2023-10-18T12:42:05.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.984+0000 7fc72c983700 1 -- 172.21.15.114:0/4254038970 learned_addr learned my addr 172.21.15.114:0/4254038970 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:42:05.997 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.984+0000 7fc72d184700 1 --2- 172.21.15.114:0/4254038970 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc72806dc30 0x7fc7281548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:05.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.984+0000 7fc72d985700 1 --2- 172.21.15.114:0/4254038970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc72815ce10 0x7fc7280c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:05.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.984+0000 7fc72c983700 1 -- 172.21.15.114:0/4254038970 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc72806dc30 msgr2=0x7fc7281548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:05.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.984+0000 7fc72c983700 1 --2- 172.21.15.114:0/4254038970 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc72806dc30 0x7fc7281548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:05.998 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.984+0000 7fc72c983700 1 -- 172.21.15.114:0/4254038970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc72815ce10 msgr2=0x7fc7280c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:05.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.984+0000 7fc72c983700 1 --2- 172.21.15.114:0/4254038970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc72815ce10 0x7fc7280c73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:05.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.984+0000 7fc72c983700 1 -- 172.21.15.114:0/4254038970 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7180094b0 con 0x7fc7280ccbd0 2023-10-18T12:42:05.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.984+0000 7fc72d184700 1 --2- 172.21.15.114:0/4254038970 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc72806dc30 0x7fc7281548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:42:05.999 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.984+0000 7fc72c983700 1 --2- 172.21.15.114:0/4254038970 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7280ccbd0 0x7fc7280c4040 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fc7180090b0 tx=0x7fc718004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:06.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.988+0000 7fc71dffb700 1 -- 172.21.15.114:0/4254038970 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc718004590 con 0x7fc7280ccbd0 2023-10-18T12:42:06.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.988+0000 7fc71dffb700 1 -- 172.21.15.114:0/4254038970 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc71801f070 con 0x7fc7280ccbd0 2023-10-18T12:42:06.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.988+0000 7fc72f3e8700 1 -- 172.21.15.114:0/4254038970 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7280af0d0 con 0x7fc7280ccbd0 2023-10-18T12:42:06.000 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.988+0000 7fc71dffb700 1 -- 172.21.15.114:0/4254038970 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc718003900 con 0x7fc7280ccbd0 2023-10-18T12:42:06.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.988+0000 7fc72f3e8700 1 -- 172.21.15.114:0/4254038970 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7280af690 con 0x7fc7280ccbd0 2023-10-18T12:42:06.001 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.988+0000 7fc72f3e8700 1 -- 172.21.15.114:0/4254038970 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc728072e60 con 0x7fc7280ccbd0 2023-10-18T12:42:06.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.992+0000 7fc71dffb700 1 -- 172.21.15.114:0/4254038970 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fc718003a60 con 0x7fc7280ccbd0 2023-10-18T12:42:06.002 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.992+0000 7fc71dffb700 1 --2- 172.21.15.114:0/4254038970 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc70c0656f0 0x7fc70c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:06.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.992+0000 7fc71dffb700 1 -- 172.21.15.114:0/4254038970 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5659+0+0 (secure 0 0 0) 0x7fc718021070 con 0x7fc7280ccbd0 2023-10-18T12:42:06.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.992+0000 7fc72d184700 1 --2- 172.21.15.114:0/4254038970 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc70c0656f0 0x7fc70c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:06.003 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.992+0000 7fc72d184700 1 --2- 172.21.15.114:0/4254038970 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc70c0656f0 0x7fc70c067bb0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc724009ba0 tx=0x7fc724008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:06.004 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:05.996+0000 7fc71dffb700 1 -- 172.21.15.114:0/4254038970 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fc718051f30 con 0x7fc7280ccbd0 2023-10-18T12:42:06.085 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:42:06.093 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:42:06.173 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.168+0000 7fc72f3e8700 1 -- 172.21.15.114:0/4254038970 --> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc72806e9d0 con 0x7fc70c0656f0 2023-10-18T12:42:06.181 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.176+0000 7fc71dffb700 1 -- 172.21.15.114:0/4254038970 <== mgr.4108 v2:172.21.15.172:6832/461408666 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+70033 (secure 0 0 0) 0x7fc724004030 con 0x7fc70c0656f0 2023-10-18T12:42:06.182 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:42:06.184 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.176+0000 7fc72f3e8700 1 -- 172.21.15.114:0/4254038970 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc70c0656f0 msgr2=0x7fc70c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:06.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.176+0000 7fc72f3e8700 1 --2- 172.21.15.114:0/4254038970 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc70c0656f0 0x7fc70c067bb0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc724009ba0 tx=0x7fc724008040 comp rx=0 tx=0).stop 2023-10-18T12:42:06.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.176+0000 7fc72f3e8700 1 -- 172.21.15.114:0/4254038970 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7280ccbd0 msgr2=0x7fc7280c4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:06.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.176+0000 7fc72f3e8700 1 --2- 172.21.15.114:0/4254038970 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7280ccbd0 0x7fc7280c4040 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fc7180090b0 tx=0x7fc718004770 comp rx=0 tx=0).stop 2023-10-18T12:42:06.185 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.176+0000 7fc72f3e8700 1 -- 172.21.15.114:0/4254038970 shutdown_connections 2023-10-18T12:42:06.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.176+0000 7fc72f3e8700 1 --2- 172.21.15.114:0/4254038970 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc70c0656f0 0x7fc70c067bb0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:06.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.176+0000 7fc72f3e8700 1 --2- 172.21.15.114:0/4254038970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc72815ce10 0x7fc7280c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:06.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.176+0000 7fc72f3e8700 1 --2- 172.21.15.114:0/4254038970 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7280ccbd0 0x7fc7280c4040 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:06.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.180+0000 7fc72f3e8700 1 --2- 172.21.15.114:0/4254038970 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc72806dc30 0x7fc7281548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:06.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.180+0000 7fc72f3e8700 1 -- 172.21.15.114:0/4254038970 >> 172.21.15.114:0/4254038970 conn(0x7fc7280cee50 msgr2=0x7fc7280b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:06.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.180+0000 7fc72f3e8700 1 -- 172.21.15.114:0/4254038970 shutdown_connections 2023-10-18T12:42:06.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.180+0000 7fc72f3e8700 1 -- 172.21.15.114:0/4254038970 wait complete. 2023-10-18T12:42:06.188 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2023-10-18T12:42:06.205 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":736,"stamp":"2023-10-18T12:42:05.504579+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":179,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223708,"kb_used_data":6904,"kb_used_omap":24,"kb_used_meta":216679,"kb_avail":754751012,"statfs":{"total":773094113280,"available":772865036288,"internally_reserved":0,"allocated":7069696,"data_stored":4078125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25470,"internal_metadata":221879426},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-13419,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-65,"num_write_kb":-37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002216"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-18T12:41:59.793149+0000","last_change":"2023-10-18T12:19:33.531672+0000","last_active":"2023-10-18T12:41:59.793149+0000","last_peered":"2023-10-18T12:41:59.793149+0000","last_clean":"2023-10-18T12:41:59.793149+0000","last_became_active":"2023-10-18T12:19:33.530907+0000","last_became_peered":"2023-10-18T12:19:33.530907+0000","last_unstale":"2023-10-18T12:41:59.793149+0000","last_undegraded":"2023-10-18T12:41:59.793149+0000","last_fullsized":"2023-10-18T12:41:59.793149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:42:05.114838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-18T12:41:59.510356+0000","last_change":"2023-10-18T12:19:33.529329+0000","last_active":"2023-10-18T12:41:59.510356+0000","last_peered":"2023-10-18T12:41:59.510356+0000","last_clean":"2023-10-18T12:41:59.510356+0000","last_became_active":"2023-10-18T12:19:33.528930+0000","last_became_peered":"2023-10-18T12:19:33.528930+0000","last_unstale":"2023-10-18T12:41:59.510356+0000","last_undegraded":"2023-10-18T12:41:59.510356+0000","last_fullsized":"2023-10-18T12:41:59.510356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:42:05.114838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":113,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-18T12:41:59.734260+0000","last_change":"2023-10-18T12:29:30.706360+0000","last_active":"2023-10-18T12:41:59.734260+0000","last_peered":"2023-10-18T12:41:59.734260+0000","last_clean":"2023-10-18T12:41:59.734260+0000","last_became_active":"2023-10-18T12:29:30.706091+0000","last_became_peered":"2023-10-18T12:29:30.706091+0000","last_unstale":"2023-10-18T12:41:59.734260+0000","last_undegraded":"2023-10-18T12:41:59.734260+0000","last_fullsized":"2023-10-18T12:41:59.734260+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:38:22.120743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-18T12:41:59.510176+0000","last_change":"2023-10-18T12:29:30.707576+0000","last_active":"2023-10-18T12:41:59.510176+0000","last_peered":"2023-10-18T12:41:59.510176+0000","last_clean":"2023-10-18T12:41:59.510176+0000","last_became_active":"2023-10-18T12:29:30.707304+0000","last_became_peered":"2023-10-18T12:29:30.707304+0000","last_unstale":"2023-10-18T12:41:59.510176+0000","last_undegraded":"2023-10-18T12:41:59.510176+0000","last_fullsized":"2023-10-18T12:41:59.510176+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:51:34.130091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-18T12:41:59.792958+0000","last_change":"2023-10-18T12:19:33.533449+0000","last_active":"2023-10-18T12:41:59.792958+0000","last_peered":"2023-10-18T12:41:59.792958+0000","last_clean":"2023-10-18T12:41:59.792958+0000","last_became_active":"2023-10-18T12:19:33.533051+0000","last_became_peered":"2023-10-18T12:19:33.533051+0000","last_unstale":"2023-10-18T12:41:59.792958+0000","last_undegraded":"2023-10-18T12:41:59.792958+0000","last_fullsized":"2023-10-18T12:41:59.792958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:40:17.500932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":97,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-18T12:41:59.506746+0000","last_change":"2023-10-18T12:19:33.530766+0000","last_active":"2023-10-18T12:41:59.506746+0000","last_peered":"2023-10-18T12:41:59.506746+0000","last_clean":"2023-10-18T12:41:59.506746+0000","last_became_active":"2023-10-18T12:19:33.530346+0000","last_became_peered":"2023-10-18T12:19:33.530346+0000","last_unstale":"2023-10-18T12:41:59.506746+0000","last_undegraded":"2023-10-18T12:41:59.506746+0000","last_fullsized":"2023-10-18T12:41:59.506746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:52:04.972603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":100,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-18T12:41:59.733519+0000","last_change":"2023-10-18T12:19:33.528538+0000","last_active":"2023-10-18T12:41:59.733519+0000","last_peered":"2023-10-18T12:41:59.733519+0000","last_clean":"2023-10-18T12:41:59.733519+0000","last_became_active":"2023-10-18T12:19:33.528214+0000","last_became_peered":"2023-10-18T12:19:33.528214+0000","last_unstale":"2023-10-18T12:41:59.733519+0000","last_undegraded":"2023-10-18T12:41:59.733519+0000","last_fullsized":"2023-10-18T12:41:59.733519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:27:02.936664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-18T12:41:59.792933+0000","last_change":"2023-10-18T12:19:33.531214+0000","last_active":"2023-10-18T12:41:59.792933+0000","last_peered":"2023-10-18T12:41:59.792933+0000","last_clean":"2023-10-18T12:41:59.792933+0000","last_became_active":"2023-10-18T12:19:33.530795+0000","last_became_peered":"2023-10-18T12:19:33.530795+0000","last_unstale":"2023-10-18T12:41:59.792933+0000","last_undegraded":"2023-10-18T12:41:59.792933+0000","last_fullsized":"2023-10-18T12:41:59.792933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:09:42.796622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":270,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-18T12:41:59.733952+0000","last_change":"2023-10-18T12:29:30.706528+0000","last_active":"2023-10-18T12:41:59.733952+0000","last_peered":"2023-10-18T12:41:59.733952+0000","last_clean":"2023-10-18T12:41:59.733952+0000","last_became_active":"2023-10-18T12:29:30.706096+0000","last_became_peered":"2023-10-18T12:29:30.706096+0000","last_unstale":"2023-10-18T12:41:59.733952+0000","last_undegraded":"2023-10-18T12:41:59.733952+0000","last_fullsized":"2023-10-18T12:41:59.733952+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:27.318899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:27.318899+0000","last_clean_scrub_stamp":"2023-10-18T12:19:27.318899+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:43:54.628089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575123,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28304,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343536,"statfs":{"total":96636764160,"available":96607780864,"internally_reserved":0,"allocated":1314816,"data_stored":946434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.153,"15min":1.153},"min":{"1min":0.86399999999999999,"5min":0.56200000000000006,"15min":0.55000000000000004},"max":{"1min":1.3240000000000001,"5min":1.679,"15min":1.9179999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1859999999999999,"15min":1.159},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.61799999999999999},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.65700000000000003}]},{"osd":1,"last update":"Wed Oct 18 12:41:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1499999999999999,"15min":1.1579999999999999},"min":{"1min":0.83099999999999996,"5min":0.60999999999999999,"15min":0.48399999999999999},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.119},{"interface":"front","average":{"1min":1.226,"5min":1.1799999999999999,"15min":1.169},"min":{"1min":0.99199999999999999,"5min":0.79300000000000004,"15min":0.56000000000000005},"max":{"1min":1.599,"5min":1.6399999999999999,"15min":2.343},"last":0.84499999999999997}]},{"osd":2,"last update":"Wed Oct 18 12:41:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.3109999999999999,"15min":1.325},"min":{"1min":1.0569999999999999,"5min":0.69299999999999995,"15min":0.67000000000000004},"max":{"1min":1.5009999999999999,"5min":1.7350000000000001,"15min":2.198},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.238,"5min":1.29,"15min":1.2849999999999999},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.6220000000000001,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.998}]},{"osd":3,"last update":"Wed Oct 18 12:41:06 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.246,"15min":1.2569999999999999},"min":{"1min":0.94199999999999995,"5min":0.73799999999999999,"15min":0.55300000000000005},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.95},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.409,"15min":1.3999999999999999},"min":{"1min":1.0589999999999999,"5min":0.90400000000000003,"15min":0.78400000000000003},"max":{"1min":1.8420000000000001,"5min":1.8580000000000001,"15min":2.5710000000000002},"last":1.2989999999999999}]},{"osd":4,"last update":"Wed Oct 18 12:41:06 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.177,"15min":1.1739999999999999},"min":{"1min":0.84599999999999997,"5min":0.60399999999999998,"15min":0.57599999999999996},"max":{"1min":1.53,"5min":1.6830000000000001,"15min":2.0779999999999998},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.222,"5min":1.2390000000000001,"15min":1.2310000000000001},"min":{"1min":0.83899999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.5720000000000001,"5min":1.9570000000000001,"15min":2.0219999999999998},"last":1.2509999999999999}]},{"osd":5,"last update":"Wed Oct 18 12:41:06 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.3440000000000001,"15min":1.3129999999999999},"min":{"1min":0.89900000000000002,"5min":0.499,"15min":0.499},"max":{"1min":1.6859999999999999,"5min":2.0070000000000001,"15min":2.5150000000000001},"last":1.167},{"interface":"front","average":{"1min":1.355,"5min":1.3620000000000001,"15min":1.359},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.9159999999999999,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":1.341}]},{"osd":6,"last update":"Wed Oct 18 12:41:06 2023","interfaces":[{"interface":"back","average":{"1min":1.4259999999999999,"5min":1.4550000000000001,"15min":1.4419999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.67400000000000004},"max":{"1min":2.0070000000000001,"5min":2.1909999999999998,"15min":2.274},"last":1.425},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3620000000000001,"15min":1.343},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.61699999999999999},"max":{"1min":1.778,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":1.708}]}]},{"osd":6,"up_from":13,"seq":55834575123,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":733184,"data_stored":358080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:41:48 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.1419999999999999,"15min":1.127},"min":{"1min":0.81999999999999995,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.3779999999999999,"5min":1.7250000000000001,"15min":1.7509999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.141,"5min":1.159,"15min":1.149},"min":{"1min":0.81599999999999995,"5min":0.752,"15min":0.752},"max":{"1min":1.462,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":1.2589999999999999}]},{"osd":1,"last update":"Wed Oct 18 12:41:17 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.131,"15min":1.179},"min":{"1min":0.86099999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.488,"5min":1.5660000000000001,"15min":1.7969999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.206,"15min":1.2050000000000001},"min":{"1min":0.94499999999999995,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.4930000000000001,"5min":1.7050000000000001,"15min":1.8480000000000001},"last":1.163}]},{"osd":2,"last update":"Wed Oct 18 12:41:17 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.214,"15min":1.2430000000000001},"min":{"1min":0.91000000000000003,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.6399999999999999,"5min":1.6699999999999999,"15min":1.958},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.21,"5min":1.2010000000000001,"15min":1.2170000000000001},"min":{"1min":0.84999999999999998,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.5720000000000001,"5min":1.585,"15min":1.645},"last":0.95099999999999996}]},{"osd":3,"last update":"Wed Oct 18 12:41:17 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.2869999999999999,"15min":1.29},"min":{"1min":0.92600000000000005,"5min":0.84699999999999998,"15min":0.76100000000000001},"max":{"1min":1.51,"5min":1.6879999999999999,"15min":1.7290000000000001},"last":1.613},{"interface":"front","average":{"1min":1.331,"5min":1.3600000000000001,"15min":1.397},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.83399999999999996},"max":{"1min":1.647,"5min":1.8300000000000001,"15min":1.952},"last":1.3959999999999999}]},{"osd":4,"last update":"Wed Oct 18 12:41:17 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.1870000000000001,"15min":1.1850000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.528,"5min":1.74,"15min":1.8480000000000001},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.28,"5min":1.25,"15min":1.248},"min":{"1min":0.82999999999999996,"5min":0.66700000000000004,"15min":0.60799999999999998},"max":{"1min":1.5700000000000001,"5min":1.8759999999999999,"15min":1.917},"last":1.4430000000000001}]},{"osd":5,"last update":"Wed Oct 18 12:41:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.266,"15min":1.3149999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.446,"5min":1.8160000000000001,"15min":2.0430000000000001},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.329,"15min":1.345},"min":{"1min":0.88500000000000001,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.528,"5min":1.8300000000000001,"15min":1.9970000000000001},"last":1.496}]},{"osd":7,"last update":"Wed Oct 18 12:41:17 2023","interfaces":[{"interface":"back","average":{"1min":1.427,"5min":1.363,"15min":1.373},"min":{"1min":1.099,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.6499999999999999,"5min":2.0059999999999998,"15min":2.0059999999999998},"last":1.6779999999999999},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.423,"15min":1.4570000000000001},"min":{"1min":0.79600000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.744,"5min":1.9379999999999999,"15min":2.105},"last":1.546}]}]},{"osd":5,"up_from":13,"seq":55834575124,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":724992,"data_stored":357377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.262,"15min":1.2709999999999999},"min":{"1min":1.1399999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.7150000000000001},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.278,"5min":1.2649999999999999,"15min":1.2909999999999999},"min":{"1min":0.89500000000000002,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":1.387}]},{"osd":1,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.1479999999999999,"15min":1.1759999999999999},"min":{"1min":0.90300000000000002,"5min":0.753,"15min":0.70499999999999996},"max":{"1min":1.3839999999999999,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":1.123},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.155,"15min":1.181},"min":{"1min":0.80600000000000005,"5min":0.72599999999999998,"15min":0.55200000000000005},"max":{"1min":1.6160000000000001,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.72099999999999997}]},{"osd":2,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.1779999999999999,"15min":1.1539999999999999},"min":{"1min":0.86599999999999999,"5min":0.81100000000000005,"15min":0.58799999999999997},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.228,"5min":1.2030000000000001,"15min":1.226},"min":{"1min":0.93500000000000005,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.73},"last":1.258}]},{"osd":3,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.282,"15min":1.298},"min":{"1min":0.94299999999999995,"5min":0.83999999999999997,"15min":0.80000000000000004},"max":{"1min":1.478,"5min":1.651,"15min":1.8169999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.373,"15min":1.339},"min":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":0.90300000000000002},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.90500000000000003}]},{"osd":4,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.1499999999999999,"15min":1.167},"min":{"1min":0.76000000000000001,"5min":0.52500000000000002,"15min":0.42999999999999999},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.77},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.2,"5min":1.244,"15min":1.2430000000000001},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.61899999999999999},"max":{"1min":1.639,"5min":1.6819999999999999,"15min":1.8700000000000001},"last":1.415}]},{"osd":6,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2310000000000001,"15min":1.218},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.66200000000000003},"max":{"1min":1.639,"5min":1.774,"15min":2.411},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.321,"15min":1.323},"min":{"1min":0.92500000000000004,"5min":0.80600000000000005,"15min":0.48199999999999998},"max":{"1min":1.6359999999999999,"5min":1.796,"15min":2.1629999999999998},"last":1.373}]},{"osd":7,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.369,"15min":1.3540000000000001},"min":{"1min":0.85899999999999999,"5min":0.83999999999999997,"15min":0.63600000000000001},"max":{"1min":1.7250000000000001,"5min":1.873,"15min":1.873},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.415,"5min":1.399,"15min":1.3799999999999999},"min":{"1min":0.96499999999999997,"5min":0.83599999999999997,"15min":0.52000000000000002},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":2.496},"last":1.5580000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575121,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":741376,"data_stored":369827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:41:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1439999999999999,"15min":1.169},"min":{"1min":0.77700000000000002,"5min":0.59499999999999997,"15min":0.46500000000000002},"max":{"1min":1.74,"5min":1.74,"15min":1.9419999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.123,"5min":1.1679999999999999,"15min":1.1779999999999999},"min":{"1min":0.84199999999999997,"5min":0.78100000000000003,"15min":0.58799999999999997},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.7609999999999999},"last":1.3720000000000001}]},{"osd":1,"last update":"Wed Oct 18 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1870000000000001,"15min":1.1819999999999999},"min":{"1min":0.625,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.661,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.046},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.2070000000000001,"15min":1.21},"min":{"1min":0.81200000000000006,"5min":0.76800000000000002,"15min":0.69099999999999995},"max":{"1min":1.462,"5min":1.601,"15min":1.786},"last":0.98399999999999999}]},{"osd":2,"last update":"Wed Oct 18 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.1399999999999999,"15min":1.1599999999999999},"min":{"1min":0.76200000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3129999999999999,"5min":1.6020000000000001,"15min":1.6619999999999999},"last":1.095},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2549999999999999,"15min":1.28},"min":{"1min":0.70699999999999996,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.8680000000000001},"last":1.3380000000000001}]},{"osd":3,"last update":"Wed Oct 18 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.3109999999999999,"15min":1.349},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.847,"5min":1.847,"15min":1.8799999999999999},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.25,"5min":1.2849999999999999,"15min":1.3069999999999999},"min":{"1min":0.76900000000000002,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.502,"5min":1.986,"15min":1.986},"last":1.2949999999999999}]},{"osd":5,"last update":"Wed Oct 18 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2250000000000001,"15min":1.2110000000000001},"min":{"1min":0.70899999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.8,"5min":1.8,"15min":2.1259999999999999},"last":1.476},{"interface":"front","average":{"1min":1.236,"5min":1.2729999999999999,"15min":1.25},"min":{"1min":0.84599999999999997,"5min":0.78700000000000003,"15min":0.499},"max":{"1min":1.752,"5min":1.855,"15min":1.855},"last":1.2569999999999999}]},{"osd":6,"last update":"Wed Oct 18 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.212,"15min":1.232},"min":{"1min":0.78100000000000003,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.5900000000000001,"5min":1.8700000000000001,"15min":1.9930000000000001},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.3660000000000001,"15min":1.373},"min":{"1min":1.0720000000000001,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.865,"5min":1.865,"15min":2.0579999999999998},"last":1.2070000000000001}]},{"osd":7,"last update":"Wed Oct 18 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3759999999999999,"15min":1.3779999999999999},"min":{"1min":1.0569999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":2.79},"last":1.512},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.3680000000000001,"15min":1.373},"min":{"1min":0.86399999999999999,"5min":0.747,"15min":0.67900000000000005},"max":{"1min":1.8200000000000001,"5min":2.1019999999999999,"15min":2.173},"last":1.4330000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575123,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":733184,"data_stored":357945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.77100000000000002,"15min":0.76100000000000001},"min":{"1min":0.61799999999999999,"5min":0.53400000000000003,"15min":0.51600000000000001},"max":{"1min":1.1080000000000001,"5min":1.1100000000000001,"15min":1.417},"last":0.63600000000000001},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.099,"15min":1.0740000000000001},"min":{"1min":0.88400000000000001,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.4399999999999999,"5min":1.486,"15min":1.508},"last":0.94199999999999995}]},{"osd":1,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.85599999999999998,"15min":0.86499999999999999},"min":{"1min":0.66300000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1830000000000001,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.999,"5min":0.95099999999999996,"15min":0.94599999999999995},"min":{"1min":0.74399999999999999,"5min":0.58299999999999996,"15min":0.53000000000000003},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.1579999999999999}]},{"osd":2,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.163,"15min":1.1379999999999999},"min":{"1min":0.75900000000000001,"5min":0.67100000000000004,"15min":0.55100000000000005},"max":{"1min":1.5229999999999999,"5min":1.5680000000000001,"15min":1.6970000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2110000000000001,"15min":1.204},"min":{"1min":1.018,"5min":0.80700000000000005,"15min":0.64300000000000002},"max":{"1min":1.5589999999999999,"5min":1.651,"15min":1.7410000000000001},"last":1.365}]},{"osd":4,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.1930000000000001,"15min":1.1919999999999999},"min":{"1min":0.85899999999999999,"5min":0.79700000000000004,"15min":0.70599999999999996},"max":{"1min":1.609,"5min":1.609,"15min":2.306},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.262,"15min":1.268},"min":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.872},"max":{"1min":1.355,"5min":1.7070000000000001,"15min":2.2509999999999999},"last":1.421}]},{"osd":5,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.331,"15min":1.323},"min":{"1min":1.0409999999999999,"5min":0.98199999999999998,"15min":0.80600000000000005},"max":{"1min":1.54,"5min":1.667,"15min":1.6739999999999999},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2889999999999999,"15min":1.286},"min":{"1min":1.0609999999999999,"5min":0.90300000000000002,"15min":0.73499999999999999},"max":{"1min":1.4930000000000001,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":1.5409999999999999}]},{"osd":6,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.3180000000000001,"15min":1.2849999999999999},"min":{"1min":1.085,"5min":0.90600000000000003,"15min":0.872},"max":{"1min":1.7250000000000001,"5min":1.7250000000000001,"15min":3.2280000000000002},"last":1.329},{"interface":"front","average":{"1min":1.353,"5min":1.371,"15min":1.3720000000000001},"min":{"1min":1.1859999999999999,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":1.651,"5min":1.663,"15min":2.02},"last":1.121}]},{"osd":7,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3480000000000001,"15min":1.3380000000000001},"min":{"1min":1.083,"5min":0.99299999999999999,"15min":0.83699999999999997},"max":{"1min":1.522,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":1.482},{"interface":"front","average":{"1min":1.397,"5min":1.375,"15min":1.3540000000000001},"min":{"1min":1.159,"5min":0.98099999999999998,"15min":0.95399999999999996},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":3.3679999999999999},"last":1.409}]}]},{"osd":2,"up_from":13,"seq":55834575121,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":745472,"data_stored":369849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.81000000000000005,"15min":0.80500000000000005},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.52100000000000002},"max":{"1min":1.47,"5min":1.47,"15min":1.5800000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.91800000000000004,"15min":0.93000000000000005},"min":{"1min":0.67200000000000004,"5min":0.57299999999999995,"15min":0.55200000000000005},"max":{"1min":1.214,"5min":1.639,"15min":1.639},"last":0.77200000000000002}]},{"osd":1,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0349999999999999,"15min":0.98999999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.40500000000000003},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.258},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.92800000000000005,"15min":0.95699999999999996},"min":{"1min":0.67400000000000004,"5min":0.60699999999999998,"15min":0.54800000000000004},"max":{"1min":1.452,"5min":1.452,"15min":1.4890000000000001},"last":1.1240000000000001}]},{"osd":3,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.2989999999999999,"15min":1.266},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.595,"5min":1.7589999999999999,"15min":1.821},"last":1.5229999999999999},{"interface":"front","average":{"1min":1.073,"5min":1.048,"15min":1.0760000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.4650000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":1.0609999999999999}]},{"osd":4,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.2170000000000001,"15min":1.236},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.55,"5min":1.631,"15min":1.7130000000000001},"last":1.169},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.21,"15min":1.2370000000000001},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.4279999999999999,"5min":1.5389999999999999,"15min":1.7470000000000001},"last":1.877}]},{"osd":5,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.3440000000000001,"15min":1.3540000000000001},"min":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.76100000000000001},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":1.986},{"interface":"front","average":{"1min":1.429,"5min":1.427,"15min":1.403},"min":{"1min":1.1240000000000001,"5min":1.034,"15min":0.98099999999999998},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.863},"last":1.6439999999999999}]},{"osd":6,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.355,"15min":1.337},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.579,"5min":1.6899999999999999,"15min":1.6970000000000001},"last":1.8},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.2969999999999999,"15min":1.298},"min":{"1min":0.873,"5min":0.873,"15min":0.873},"max":{"1min":1.6910000000000001,"5min":1.778,"15min":1.8029999999999999},"last":1.319}]},{"osd":7,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.323,"15min":1.3320000000000001},"min":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":0.95699999999999996},"max":{"1min":1.6040000000000001,"5min":1.631,"15min":1.8029999999999999},"last":1.756},{"interface":"front","average":{"1min":1.395,"5min":1.421,"15min":1.411},"min":{"1min":1.1499999999999999,"5min":1.099,"15min":0.97599999999999998},"max":{"1min":1.647,"5min":1.8680000000000001,"15min":1.9590000000000001},"last":1.944}]}]},{"osd":1,"up_from":13,"seq":55834575122,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":729088,"data_stored":357478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.83699999999999997,"15min":0.85899999999999999},"min":{"1min":0.56399999999999995,"5min":0.47499999999999998,"15min":0.45200000000000001},"max":{"1min":0.97199999999999998,"5min":1.6020000000000001,"15min":1.6559999999999999},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.012,"5min":1.004,"15min":1.034},"min":{"1min":0.621,"5min":0.621,"15min":0.54800000000000004},"max":{"1min":1.603,"5min":1.603,"15min":1.9830000000000001},"last":0.84399999999999997}]},{"osd":2,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.90100000000000002,"15min":0.90700000000000003},"min":{"1min":0.60399999999999998,"5min":0.55700000000000005,"15min":0.436},"max":{"1min":1.52,"5min":1.52,"15min":1.7310000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.073,"15min":1.111},"min":{"1min":0.875,"5min":0.59799999999999998,"15min":0.505},"max":{"1min":1.4830000000000001,"5min":1.714,"15min":1.714},"last":0.79800000000000004}]},{"osd":3,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.161,"15min":1.204},"min":{"1min":0.83899999999999997,"5min":0.69199999999999995,"15min":0.57299999999999995},"max":{"1min":1.373,"5min":1.595,"15min":1.603},"last":1.157},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.96999999999999997,"15min":1},"min":{"1min":0.68300000000000005,"5min":0.59899999999999998,"15min":0.56799999999999995},"max":{"1min":1.4510000000000001,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.69999999999999996}]},{"osd":4,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.25,"15min":1.25},"min":{"1min":0.98599999999999999,"5min":0.81000000000000005,"15min":0.72199999999999998},"max":{"1min":1.476,"5min":1.9450000000000001,"15min":2.0470000000000002},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.1950000000000001,"15min":1.1970000000000001},"min":{"1min":0.94199999999999995,"5min":0.748,"15min":0.58499999999999996},"max":{"1min":1.6060000000000001,"5min":1.708,"15min":1.708},"last":1.2789999999999999}]},{"osd":5,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.2470000000000001,"15min":1.2410000000000001},"min":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.77300000000000002},"max":{"1min":1.452,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3,"15min":1.3080000000000001},"min":{"1min":1.0149999999999999,"5min":0.872,"15min":0.86899999999999999},"max":{"1min":1.4930000000000001,"5min":1.6060000000000001,"15min":1.7170000000000001},"last":1.448}]},{"osd":6,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.298,"15min":1.302},"min":{"1min":1.0580000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.5449999999999999,"5min":1.726,"15min":2.1240000000000001},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.264,"5min":1.2749999999999999,"15min":1.3009999999999999},"min":{"1min":1.1000000000000001,"5min":0.94199999999999995,"15min":0.82599999999999996},"max":{"1min":1.518,"5min":1.917,"15min":1.917},"last":1.133}]},{"osd":7,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.3560000000000001,"15min":1.3580000000000001},"min":{"1min":1.0660000000000001,"5min":0.80700000000000005,"15min":0.79900000000000004},"max":{"1min":1.5649999999999999,"5min":1.77,"15min":1.77},"last":1.516},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.3520000000000001,"15min":1.363},"min":{"1min":1.147,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.6399999999999999,"5min":1.8240000000000001,"15min":2.3199999999999998},"last":1.3340000000000001}]}]},{"osd":0,"up_from":56,"seq":240518168728,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28980,"kb_used_data":1316,"kb_used_omap":12,"kb_used_meta":27635,"kb_avail":94342860,"statfs":{"total":96636764160,"available":96607088640,"internally_reserved":0,"allocated":1347584,"data_stored":961135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13003,"internal_metadata":28298549},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 18 12:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.90100000000000002,"15min":0.95499999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.454,"5min":1.454,"15min":1.5109999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0649999999999999,"15min":1.073},"min":{"1min":0.68799999999999994,"5min":0.62,"15min":0.52000000000000002},"max":{"1min":1.46,"5min":1.577,"15min":1.577},"last":0.68000000000000005}]},{"osd":2,"last update":"Wed Oct 18 12:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.93600000000000005,"15min":0.99299999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.60799999999999998},"max":{"1min":1.321,"5min":1.496,"15min":1.6659999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.105,"5min":1.04,"15min":1.03},"min":{"1min":0.80300000000000005,"5min":0.59099999999999997,"15min":0.48899999999999999},"max":{"1min":1.468,"5min":1.673,"15min":1.673},"last":0.84699999999999998}]},{"osd":3,"last update":"Wed Oct 18 12:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.92800000000000005,"15min":0.94799999999999995},"min":{"1min":0.65800000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.2589999999999999,"5min":1.466,"15min":1.6060000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1080000000000001,"15min":1.169},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.48,"5min":1.589,"15min":1.589},"last":0.79000000000000004}]},{"osd":4,"last update":"Wed Oct 18 12:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.222,"15min":1.242},"min":{"1min":0.98999999999999999,"5min":0.87,"15min":0.87},"max":{"1min":1.5429999999999999,"5min":1.615,"15min":1.722},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3169999999999999,"15min":1.3839999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.756,"5min":1.756,"15min":2.1299999999999999},"last":1.111}]},{"osd":5,"last update":"Wed Oct 18 12:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.345,"15min":1.3720000000000001},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.84399999999999997},"max":{"1min":1.625,"5min":1.625,"15min":2.0960000000000001},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.347,"5min":1.2809999999999999,"15min":1.331},"min":{"1min":1.103,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":2.0819999999999999,"5min":2.0819999999999999,"15min":2.0819999999999999},"last":0.99399999999999999}]},{"osd":6,"last update":"Wed Oct 18 12:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.351,"15min":1.431},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":2.2200000000000002},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.367,"15min":1.415},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.89700000000000002},"max":{"1min":1.9279999999999999,"5min":1.9690000000000001,"15min":2.0329999999999999},"last":1.008}]},{"osd":7,"last update":"Wed Oct 18 12:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.399,"15min":1.4650000000000001},"min":{"1min":1.087,"5min":1.0169999999999999,"15min":1.0169999999999999},"max":{"1min":2.141,"5min":2.141,"15min":2.169},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3260000000000001,"15min":1.403},"min":{"1min":1.091,"5min":0.96599999999999997,"15min":0.92100000000000004},"max":{"1min":1.857,"5min":1.857,"15min":2.081},"last":1.393}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-18T12:42:06.208 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-18T12:42:06.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.416+0000 7f8aff1ef700 1 Processor -- start 2023-10-18T12:42:06.422 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.416+0000 7f8aff1ef700 1 -- start start 2023-10-18T12:42:06.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.420+0000 7f8aff1ef700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8af80b53f0 0x7f8af80ceeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:06.426 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.420+0000 7f8aff1ef700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8af806ded0 con 0x7f8af806a7c0 2023-10-18T12:42:06.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.420+0000 7f8aff1ef700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8af80cae00 con 0x7f8af8159bf0 2023-10-18T12:42:06.427 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.420+0000 7f8aff1ef700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8af8071c50 con 0x7f8af80b53f0 2023-10-18T12:42:06.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.420+0000 7f8afd9ec700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f8af80b53f0 0x7f8af80ceeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:06.428 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.420+0000 7f8afe9ee700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f8af806a7c0 0x7f8af815d590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50778/0 (socket says 172.21.15.114:50778) 2023-10-18T12:42:06.429 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.420+0000 7f8afe9ee700 1 -- 172.21.15.114:0/2563781235 learned_addr learned my addr 172.21.15.114:0/2563781235 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:42:06.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.420+0000 7f8afd9ec700 1 -- 172.21.15.114:0/2563781235 >> v1:172.21.15.172:6789/0 conn(0x7f8af8159bf0 legacy=0x7f8af806a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:06.432 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.420+0000 7f8afd9ec700 1 -- 172.21.15.114:0/2563781235 >> v1:172.21.15.114:6789/0 conn(0x7f8af806a7c0 legacy=0x7f8af815d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:06.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.420+0000 7f8afd9ec700 1 -- 172.21.15.114:0/2563781235 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af806e120 con 0x7f8af80b53f0 2023-10-18T12:42:06.433 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.420+0000 7f8afd1eb700 1 -- 172.21.15.114:0/2563781235 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1408800738 0 0) 0x7f8af80cae00 con 0x7f8af8159bf0 2023-10-18T12:42:06.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.420+0000 7f8afd9ec700 1 --2- 172.21.15.114:0/2563781235 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8af80b53f0 0x7f8af80ceeb0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f8ae8009850 tx=0x7f8ae8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c1c6d228c118824 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:06.434 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.420+0000 7f8afd1eb700 1 -- 172.21.15.114:0/2563781235 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae8004230 con 0x7f8af80b53f0 2023-10-18T12:42:06.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.420+0000 7f8afd1eb700 1 -- 172.21.15.114:0/2563781235 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae8004390 con 0x7f8af80b53f0 2023-10-18T12:42:06.435 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.420+0000 7f8afd1eb700 1 -- 172.21.15.114:0/2563781235 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae80036c0 con 0x7f8af80b53f0 2023-10-18T12:42:06.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.424+0000 7f8aff1ef700 1 -- 172.21.15.114:0/2563781235 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8af80b53f0 msgr2=0x7f8af80ceeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:06.436 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.424+0000 7f8aff1ef700 1 --2- 172.21.15.114:0/2563781235 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8af80b53f0 0x7f8af80ceeb0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f8ae8009850 tx=0x7f8ae8009b60 comp rx=0 tx=0).stop 2023-10-18T12:42:06.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.424+0000 7f8aff1ef700 1 -- 172.21.15.114:0/2563781235 shutdown_connections 2023-10-18T12:42:06.437 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.424+0000 7f8aff1ef700 1 --2- 172.21.15.114:0/2563781235 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8af80b53f0 0x7f8af80ceeb0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:06.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.424+0000 7f8aff1ef700 1 -- 172.21.15.114:0/2563781235 >> 172.21.15.114:0/2563781235 conn(0x7f8af80cf6b0 msgr2=0x7f8af80cfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:06.438 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.424+0000 7f8aff1ef700 1 -- 172.21.15.114:0/2563781235 shutdown_connections 2023-10-18T12:42:06.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.424+0000 7f8aff1ef700 1 -- 172.21.15.114:0/2563781235 wait complete. 2023-10-18T12:42:06.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.428+0000 7f8aff1ef700 1 Processor -- start 2023-10-18T12:42:06.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.428+0000 7f8aff1ef700 1 -- start start 2023-10-18T12:42:06.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.428+0000 7f8aff1ef700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8af806a7c0 0x7f8af80cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:06.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.428+0000 7f8aff1ef700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8af80b53f0 0x7f8af815c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:06.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.428+0000 7f8aff1ef700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8af8159bf0 0x7f8af8157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:06.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.428+0000 7f8aff1ef700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af80c8bc0 con 0x7f8af806a7c0 2023-10-18T12:42:06.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.428+0000 7f8aff1ef700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af80c8010 con 0x7f8af8159bf0 2023-10-18T12:42:06.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.428+0000 7f8aff1ef700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af80c8fe0 con 0x7f8af80b53f0 2023-10-18T12:42:06.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.428+0000 7f8afe1ed700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8af806a7c0 0x7f8af80cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:06.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.428+0000 7f8afe1ed700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8af806a7c0 0x7f8af80cdea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36796/0 (socket says 172.21.15.114:36796) 2023-10-18T12:42:06.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.428+0000 7f8afe1ed700 1 -- 172.21.15.114:0/91249442 learned_addr learned my addr 172.21.15.114:0/91249442 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:42:06.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.428+0000 7f8afe9ee700 1 --2- 172.21.15.114:0/91249442 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8af8159bf0 0x7f8af8157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:06.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.428+0000 7f8afd9ec700 1 --2- 172.21.15.114:0/91249442 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8af80b53f0 0x7f8af815c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:06.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.428+0000 7f8afe1ed700 1 -- 172.21.15.114:0/91249442 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8af80b53f0 msgr2=0x7f8af815c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:06.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.428+0000 7f8afe1ed700 1 --2- 172.21.15.114:0/91249442 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8af80b53f0 0x7f8af815c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:06.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.428+0000 7f8afe1ed700 1 -- 172.21.15.114:0/91249442 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8af8159bf0 msgr2=0x7f8af8157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:06.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.428+0000 7f8afe1ed700 1 --2- 172.21.15.114:0/91249442 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8af8159bf0 0x7f8af8157eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:06.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.428+0000 7f8afe1ed700 1 -- 172.21.15.114:0/91249442 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae80094b0 con 0x7f8af806a7c0 2023-10-18T12:42:06.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.428+0000 7f8afd9ec700 1 --2- 172.21.15.114:0/91249442 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8af80b53f0 0x7f8af815c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:42:06.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.432+0000 7f8afe1ed700 1 --2- 172.21.15.114:0/91249442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8af806a7c0 0x7f8af80cdea0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f8af400cca0 tx=0x7f8af400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:06.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.432+0000 7f8aeeffd700 1 -- 172.21.15.114:0/91249442 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af400cea0 con 0x7f8af806a7c0 2023-10-18T12:42:06.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.432+0000 7f8aeeffd700 1 -- 172.21.15.114:0/91249442 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af4003e50 con 0x7f8af806a7c0 2023-10-18T12:42:06.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.432+0000 7f8aeeffd700 1 -- 172.21.15.114:0/91249442 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af400abf0 con 0x7f8af806a7c0 2023-10-18T12:42:06.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.432+0000 7f8aff1ef700 1 -- 172.21.15.114:0/91249442 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8af80c8220 con 0x7f8af806a7c0 2023-10-18T12:42:06.455 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.432+0000 7f8aff1ef700 1 -- 172.21.15.114:0/91249442 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8af80c87e0 con 0x7f8af806a7c0 2023-10-18T12:42:06.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.432+0000 7f8aff1ef700 1 -- 172.21.15.114:0/91249442 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8af8072020 con 0x7f8af806a7c0 2023-10-18T12:42:06.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.436+0000 7f8aeeffd700 1 -- 172.21.15.114:0/91249442 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f8af400ad50 con 0x7f8af806a7c0 2023-10-18T12:42:06.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.436+0000 7f8aeeffd700 1 --2- 172.21.15.114:0/91249442 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8adc0656f0 0x7f8adc067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:06.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.436+0000 7f8aeeffd700 1 -- 172.21.15.114:0/91249442 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5659+0+0 (secure 0 0 0) 0x7f8af4082eb0 con 0x7f8af806a7c0 2023-10-18T12:42:06.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.436+0000 7f8afd9ec700 1 --2- 172.21.15.114:0/91249442 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8adc0656f0 0x7f8adc067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:06.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.436+0000 7f8afd9ec700 1 --2- 172.21.15.114:0/91249442 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8adc0656f0 0x7f8adc067bb0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8ae8009850 tx=0x7f8ae8010000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:06.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.444+0000 7f8aeeffd700 1 -- 172.21.15.114:0/91249442 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f8af4050a60 con 0x7f8af806a7c0 2023-10-18T12:42:06.636 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.628+0000 7f8aff1ef700 1 -- 172.21.15.114:0/91249442 --> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8af806e400 con 0x7f8adc0656f0 2023-10-18T12:42:06.643 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.636+0000 7f8aeeffd700 1 -- 172.21.15.114:0/91249442 <== mgr.4108 v2:172.21.15.172:6832/461408666 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+70033 (secure 0 0 0) 0x7f8ae80036c0 con 0x7f8adc0656f0 2023-10-18T12:42:06.644 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:42:06.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.640+0000 7f8aff1ef700 1 -- 172.21.15.114:0/91249442 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8adc0656f0 msgr2=0x7f8adc067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:06.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.640+0000 7f8aff1ef700 1 --2- 172.21.15.114:0/91249442 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8adc0656f0 0x7f8adc067bb0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8ae8009850 tx=0x7f8ae8010000 comp rx=0 tx=0).stop 2023-10-18T12:42:06.649 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.640+0000 7f8aff1ef700 1 -- 172.21.15.114:0/91249442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8af806a7c0 msgr2=0x7f8af80cdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:06.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.640+0000 7f8aff1ef700 1 --2- 172.21.15.114:0/91249442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8af806a7c0 0x7f8af80cdea0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f8af400cca0 tx=0x7f8af400a340 comp rx=0 tx=0).stop 2023-10-18T12:42:06.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.644+0000 7f8aff1ef700 1 -- 172.21.15.114:0/91249442 shutdown_connections 2023-10-18T12:42:06.650 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.644+0000 7f8aff1ef700 1 --2- 172.21.15.114:0/91249442 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f8adc0656f0 0x7f8adc067bb0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:06.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.644+0000 7f8aff1ef700 1 --2- 172.21.15.114:0/91249442 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f8af80b53f0 0x7f8af815c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:06.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.644+0000 7f8aff1ef700 1 --2- 172.21.15.114:0/91249442 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8af8159bf0 0x7f8af8157eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:06.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.644+0000 7f8aff1ef700 1 --2- 172.21.15.114:0/91249442 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8af806a7c0 0x7f8af80cdea0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:06.651 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.644+0000 7f8aff1ef700 1 -- 172.21.15.114:0/91249442 >> 172.21.15.114:0/91249442 conn(0x7f8af80cf6b0 msgr2=0x7f8af80c9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:06.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.644+0000 7f8aff1ef700 1 -- 172.21.15.114:0/91249442 shutdown_connections 2023-10-18T12:42:06.652 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.644+0000 7f8aff1ef700 1 -- 172.21.15.114:0/91249442 wait complete. 2023-10-18T12:42:06.653 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2023-10-18T12:42:06.670 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":736,"stamp":"2023-10-18T12:42:05.504579+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":179,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223708,"kb_used_data":6904,"kb_used_omap":24,"kb_used_meta":216679,"kb_avail":754751012,"statfs":{"total":773094113280,"available":772865036288,"internally_reserved":0,"allocated":7069696,"data_stored":4078125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25470,"internal_metadata":221879426},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-13419,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-65,"num_write_kb":-37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002216"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-18T12:41:59.793149+0000","last_change":"2023-10-18T12:19:33.531672+0000","last_active":"2023-10-18T12:41:59.793149+0000","last_peered":"2023-10-18T12:41:59.793149+0000","last_clean":"2023-10-18T12:41:59.793149+0000","last_became_active":"2023-10-18T12:19:33.530907+0000","last_became_peered":"2023-10-18T12:19:33.530907+0000","last_unstale":"2023-10-18T12:41:59.793149+0000","last_undegraded":"2023-10-18T12:41:59.793149+0000","last_fullsized":"2023-10-18T12:41:59.793149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:42:05.114838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-18T12:41:59.510356+0000","last_change":"2023-10-18T12:19:33.529329+0000","last_active":"2023-10-18T12:41:59.510356+0000","last_peered":"2023-10-18T12:41:59.510356+0000","last_clean":"2023-10-18T12:41:59.510356+0000","last_became_active":"2023-10-18T12:19:33.528930+0000","last_became_peered":"2023-10-18T12:19:33.528930+0000","last_unstale":"2023-10-18T12:41:59.510356+0000","last_undegraded":"2023-10-18T12:41:59.510356+0000","last_fullsized":"2023-10-18T12:41:59.510356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:42:05.114838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":113,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-18T12:41:59.734260+0000","last_change":"2023-10-18T12:29:30.706360+0000","last_active":"2023-10-18T12:41:59.734260+0000","last_peered":"2023-10-18T12:41:59.734260+0000","last_clean":"2023-10-18T12:41:59.734260+0000","last_became_active":"2023-10-18T12:29:30.706091+0000","last_became_peered":"2023-10-18T12:29:30.706091+0000","last_unstale":"2023-10-18T12:41:59.734260+0000","last_undegraded":"2023-10-18T12:41:59.734260+0000","last_fullsized":"2023-10-18T12:41:59.734260+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:38:22.120743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-18T12:41:59.510176+0000","last_change":"2023-10-18T12:29:30.707576+0000","last_active":"2023-10-18T12:41:59.510176+0000","last_peered":"2023-10-18T12:41:59.510176+0000","last_clean":"2023-10-18T12:41:59.510176+0000","last_became_active":"2023-10-18T12:29:30.707304+0000","last_became_peered":"2023-10-18T12:29:30.707304+0000","last_unstale":"2023-10-18T12:41:59.510176+0000","last_undegraded":"2023-10-18T12:41:59.510176+0000","last_fullsized":"2023-10-18T12:41:59.510176+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:51:34.130091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-18T12:41:59.792958+0000","last_change":"2023-10-18T12:19:33.533449+0000","last_active":"2023-10-18T12:41:59.792958+0000","last_peered":"2023-10-18T12:41:59.792958+0000","last_clean":"2023-10-18T12:41:59.792958+0000","last_became_active":"2023-10-18T12:19:33.533051+0000","last_became_peered":"2023-10-18T12:19:33.533051+0000","last_unstale":"2023-10-18T12:41:59.792958+0000","last_undegraded":"2023-10-18T12:41:59.792958+0000","last_fullsized":"2023-10-18T12:41:59.792958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:40:17.500932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":97,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-18T12:41:59.506746+0000","last_change":"2023-10-18T12:19:33.530766+0000","last_active":"2023-10-18T12:41:59.506746+0000","last_peered":"2023-10-18T12:41:59.506746+0000","last_clean":"2023-10-18T12:41:59.506746+0000","last_became_active":"2023-10-18T12:19:33.530346+0000","last_became_peered":"2023-10-18T12:19:33.530346+0000","last_unstale":"2023-10-18T12:41:59.506746+0000","last_undegraded":"2023-10-18T12:41:59.506746+0000","last_fullsized":"2023-10-18T12:41:59.506746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:52:04.972603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":100,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-18T12:41:59.733519+0000","last_change":"2023-10-18T12:19:33.528538+0000","last_active":"2023-10-18T12:41:59.733519+0000","last_peered":"2023-10-18T12:41:59.733519+0000","last_clean":"2023-10-18T12:41:59.733519+0000","last_became_active":"2023-10-18T12:19:33.528214+0000","last_became_peered":"2023-10-18T12:19:33.528214+0000","last_unstale":"2023-10-18T12:41:59.733519+0000","last_undegraded":"2023-10-18T12:41:59.733519+0000","last_fullsized":"2023-10-18T12:41:59.733519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:27:02.936664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-18T12:41:59.792933+0000","last_change":"2023-10-18T12:19:33.531214+0000","last_active":"2023-10-18T12:41:59.792933+0000","last_peered":"2023-10-18T12:41:59.792933+0000","last_clean":"2023-10-18T12:41:59.792933+0000","last_became_active":"2023-10-18T12:19:33.530795+0000","last_became_peered":"2023-10-18T12:19:33.530795+0000","last_unstale":"2023-10-18T12:41:59.792933+0000","last_undegraded":"2023-10-18T12:41:59.792933+0000","last_fullsized":"2023-10-18T12:41:59.792933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:09:42.796622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":270,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-18T12:41:59.733952+0000","last_change":"2023-10-18T12:29:30.706528+0000","last_active":"2023-10-18T12:41:59.733952+0000","last_peered":"2023-10-18T12:41:59.733952+0000","last_clean":"2023-10-18T12:41:59.733952+0000","last_became_active":"2023-10-18T12:29:30.706096+0000","last_became_peered":"2023-10-18T12:29:30.706096+0000","last_unstale":"2023-10-18T12:41:59.733952+0000","last_undegraded":"2023-10-18T12:41:59.733952+0000","last_fullsized":"2023-10-18T12:41:59.733952+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:27.318899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:27.318899+0000","last_clean_scrub_stamp":"2023-10-18T12:19:27.318899+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:43:54.628089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575123,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28304,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343536,"statfs":{"total":96636764160,"available":96607780864,"internally_reserved":0,"allocated":1314816,"data_stored":946434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.153,"15min":1.153},"min":{"1min":0.86399999999999999,"5min":0.56200000000000006,"15min":0.55000000000000004},"max":{"1min":1.3240000000000001,"5min":1.679,"15min":1.9179999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1859999999999999,"15min":1.159},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.61799999999999999},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.65700000000000003}]},{"osd":1,"last update":"Wed Oct 18 12:41:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1499999999999999,"15min":1.1579999999999999},"min":{"1min":0.83099999999999996,"5min":0.60999999999999999,"15min":0.48399999999999999},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.119},{"interface":"front","average":{"1min":1.226,"5min":1.1799999999999999,"15min":1.169},"min":{"1min":0.99199999999999999,"5min":0.79300000000000004,"15min":0.56000000000000005},"max":{"1min":1.599,"5min":1.6399999999999999,"15min":2.343},"last":0.84499999999999997}]},{"osd":2,"last update":"Wed Oct 18 12:41:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.3109999999999999,"15min":1.325},"min":{"1min":1.0569999999999999,"5min":0.69299999999999995,"15min":0.67000000000000004},"max":{"1min":1.5009999999999999,"5min":1.7350000000000001,"15min":2.198},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.238,"5min":1.29,"15min":1.2849999999999999},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.6220000000000001,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.998}]},{"osd":3,"last update":"Wed Oct 18 12:41:06 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.246,"15min":1.2569999999999999},"min":{"1min":0.94199999999999995,"5min":0.73799999999999999,"15min":0.55300000000000005},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.95},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.409,"15min":1.3999999999999999},"min":{"1min":1.0589999999999999,"5min":0.90400000000000003,"15min":0.78400000000000003},"max":{"1min":1.8420000000000001,"5min":1.8580000000000001,"15min":2.5710000000000002},"last":1.2989999999999999}]},{"osd":4,"last update":"Wed Oct 18 12:41:06 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.177,"15min":1.1739999999999999},"min":{"1min":0.84599999999999997,"5min":0.60399999999999998,"15min":0.57599999999999996},"max":{"1min":1.53,"5min":1.6830000000000001,"15min":2.0779999999999998},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.222,"5min":1.2390000000000001,"15min":1.2310000000000001},"min":{"1min":0.83899999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.5720000000000001,"5min":1.9570000000000001,"15min":2.0219999999999998},"last":1.2509999999999999}]},{"osd":5,"last update":"Wed Oct 18 12:41:06 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.3440000000000001,"15min":1.3129999999999999},"min":{"1min":0.89900000000000002,"5min":0.499,"15min":0.499},"max":{"1min":1.6859999999999999,"5min":2.0070000000000001,"15min":2.5150000000000001},"last":1.167},{"interface":"front","average":{"1min":1.355,"5min":1.3620000000000001,"15min":1.359},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.9159999999999999,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":1.341}]},{"osd":6,"last update":"Wed Oct 18 12:41:06 2023","interfaces":[{"interface":"back","average":{"1min":1.4259999999999999,"5min":1.4550000000000001,"15min":1.4419999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.67400000000000004},"max":{"1min":2.0070000000000001,"5min":2.1909999999999998,"15min":2.274},"last":1.425},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3620000000000001,"15min":1.343},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.61699999999999999},"max":{"1min":1.778,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":1.708}]}]},{"osd":6,"up_from":13,"seq":55834575123,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":733184,"data_stored":358080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:41:48 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.1419999999999999,"15min":1.127},"min":{"1min":0.81999999999999995,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.3779999999999999,"5min":1.7250000000000001,"15min":1.7509999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.141,"5min":1.159,"15min":1.149},"min":{"1min":0.81599999999999995,"5min":0.752,"15min":0.752},"max":{"1min":1.462,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":1.2589999999999999}]},{"osd":1,"last update":"Wed Oct 18 12:41:17 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.131,"15min":1.179},"min":{"1min":0.86099999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.488,"5min":1.5660000000000001,"15min":1.7969999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.206,"15min":1.2050000000000001},"min":{"1min":0.94499999999999995,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.4930000000000001,"5min":1.7050000000000001,"15min":1.8480000000000001},"last":1.163}]},{"osd":2,"last update":"Wed Oct 18 12:41:17 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.214,"15min":1.2430000000000001},"min":{"1min":0.91000000000000003,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.6399999999999999,"5min":1.6699999999999999,"15min":1.958},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.21,"5min":1.2010000000000001,"15min":1.2170000000000001},"min":{"1min":0.84999999999999998,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.5720000000000001,"5min":1.585,"15min":1.645},"last":0.95099999999999996}]},{"osd":3,"last update":"Wed Oct 18 12:41:17 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.2869999999999999,"15min":1.29},"min":{"1min":0.92600000000000005,"5min":0.84699999999999998,"15min":0.76100000000000001},"max":{"1min":1.51,"5min":1.6879999999999999,"15min":1.7290000000000001},"last":1.613},{"interface":"front","average":{"1min":1.331,"5min":1.3600000000000001,"15min":1.397},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.83399999999999996},"max":{"1min":1.647,"5min":1.8300000000000001,"15min":1.952},"last":1.3959999999999999}]},{"osd":4,"last update":"Wed Oct 18 12:41:17 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.1870000000000001,"15min":1.1850000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.528,"5min":1.74,"15min":1.8480000000000001},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.28,"5min":1.25,"15min":1.248},"min":{"1min":0.82999999999999996,"5min":0.66700000000000004,"15min":0.60799999999999998},"max":{"1min":1.5700000000000001,"5min":1.8759999999999999,"15min":1.917},"last":1.4430000000000001}]},{"osd":5,"last update":"Wed Oct 18 12:41:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.266,"15min":1.3149999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.446,"5min":1.8160000000000001,"15min":2.0430000000000001},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.329,"15min":1.345},"min":{"1min":0.88500000000000001,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.528,"5min":1.8300000000000001,"15min":1.9970000000000001},"last":1.496}]},{"osd":7,"last update":"Wed Oct 18 12:41:17 2023","interfaces":[{"interface":"back","average":{"1min":1.427,"5min":1.363,"15min":1.373},"min":{"1min":1.099,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.6499999999999999,"5min":2.0059999999999998,"15min":2.0059999999999998},"last":1.6779999999999999},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.423,"15min":1.4570000000000001},"min":{"1min":0.79600000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.744,"5min":1.9379999999999999,"15min":2.105},"last":1.546}]}]},{"osd":5,"up_from":13,"seq":55834575124,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":724992,"data_stored":357377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.262,"15min":1.2709999999999999},"min":{"1min":1.1399999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.7150000000000001},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.278,"5min":1.2649999999999999,"15min":1.2909999999999999},"min":{"1min":0.89500000000000002,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":1.387}]},{"osd":1,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.1479999999999999,"15min":1.1759999999999999},"min":{"1min":0.90300000000000002,"5min":0.753,"15min":0.70499999999999996},"max":{"1min":1.3839999999999999,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":1.123},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.155,"15min":1.181},"min":{"1min":0.80600000000000005,"5min":0.72599999999999998,"15min":0.55200000000000005},"max":{"1min":1.6160000000000001,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.72099999999999997}]},{"osd":2,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.1779999999999999,"15min":1.1539999999999999},"min":{"1min":0.86599999999999999,"5min":0.81100000000000005,"15min":0.58799999999999997},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.228,"5min":1.2030000000000001,"15min":1.226},"min":{"1min":0.93500000000000005,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.73},"last":1.258}]},{"osd":3,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.282,"15min":1.298},"min":{"1min":0.94299999999999995,"5min":0.83999999999999997,"15min":0.80000000000000004},"max":{"1min":1.478,"5min":1.651,"15min":1.8169999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.373,"15min":1.339},"min":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":0.90300000000000002},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.90500000000000003}]},{"osd":4,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.1499999999999999,"15min":1.167},"min":{"1min":0.76000000000000001,"5min":0.52500000000000002,"15min":0.42999999999999999},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.77},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.2,"5min":1.244,"15min":1.2430000000000001},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.61899999999999999},"max":{"1min":1.639,"5min":1.6819999999999999,"15min":1.8700000000000001},"last":1.415}]},{"osd":6,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2310000000000001,"15min":1.218},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.66200000000000003},"max":{"1min":1.639,"5min":1.774,"15min":2.411},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.321,"15min":1.323},"min":{"1min":0.92500000000000004,"5min":0.80600000000000005,"15min":0.48199999999999998},"max":{"1min":1.6359999999999999,"5min":1.796,"15min":2.1629999999999998},"last":1.373}]},{"osd":7,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.369,"15min":1.3540000000000001},"min":{"1min":0.85899999999999999,"5min":0.83999999999999997,"15min":0.63600000000000001},"max":{"1min":1.7250000000000001,"5min":1.873,"15min":1.873},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.415,"5min":1.399,"15min":1.3799999999999999},"min":{"1min":0.96499999999999997,"5min":0.83599999999999997,"15min":0.52000000000000002},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":2.496},"last":1.5580000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575121,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":741376,"data_stored":369827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:41:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1439999999999999,"15min":1.169},"min":{"1min":0.77700000000000002,"5min":0.59499999999999997,"15min":0.46500000000000002},"max":{"1min":1.74,"5min":1.74,"15min":1.9419999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.123,"5min":1.1679999999999999,"15min":1.1779999999999999},"min":{"1min":0.84199999999999997,"5min":0.78100000000000003,"15min":0.58799999999999997},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.7609999999999999},"last":1.3720000000000001}]},{"osd":1,"last update":"Wed Oct 18 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1870000000000001,"15min":1.1819999999999999},"min":{"1min":0.625,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.661,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.046},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.2070000000000001,"15min":1.21},"min":{"1min":0.81200000000000006,"5min":0.76800000000000002,"15min":0.69099999999999995},"max":{"1min":1.462,"5min":1.601,"15min":1.786},"last":0.98399999999999999}]},{"osd":2,"last update":"Wed Oct 18 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.1399999999999999,"15min":1.1599999999999999},"min":{"1min":0.76200000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3129999999999999,"5min":1.6020000000000001,"15min":1.6619999999999999},"last":1.095},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2549999999999999,"15min":1.28},"min":{"1min":0.70699999999999996,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.8680000000000001},"last":1.3380000000000001}]},{"osd":3,"last update":"Wed Oct 18 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.3109999999999999,"15min":1.349},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.847,"5min":1.847,"15min":1.8799999999999999},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.25,"5min":1.2849999999999999,"15min":1.3069999999999999},"min":{"1min":0.76900000000000002,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.502,"5min":1.986,"15min":1.986},"last":1.2949999999999999}]},{"osd":5,"last update":"Wed Oct 18 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2250000000000001,"15min":1.2110000000000001},"min":{"1min":0.70899999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.8,"5min":1.8,"15min":2.1259999999999999},"last":1.476},{"interface":"front","average":{"1min":1.236,"5min":1.2729999999999999,"15min":1.25},"min":{"1min":0.84599999999999997,"5min":0.78700000000000003,"15min":0.499},"max":{"1min":1.752,"5min":1.855,"15min":1.855},"last":1.2569999999999999}]},{"osd":6,"last update":"Wed Oct 18 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.212,"15min":1.232},"min":{"1min":0.78100000000000003,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.5900000000000001,"5min":1.8700000000000001,"15min":1.9930000000000001},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.3660000000000001,"15min":1.373},"min":{"1min":1.0720000000000001,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.865,"5min":1.865,"15min":2.0579999999999998},"last":1.2070000000000001}]},{"osd":7,"last update":"Wed Oct 18 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3759999999999999,"15min":1.3779999999999999},"min":{"1min":1.0569999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":2.79},"last":1.512},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.3680000000000001,"15min":1.373},"min":{"1min":0.86399999999999999,"5min":0.747,"15min":0.67900000000000005},"max":{"1min":1.8200000000000001,"5min":2.1019999999999999,"15min":2.173},"last":1.4330000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575123,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":733184,"data_stored":357945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.77100000000000002,"15min":0.76100000000000001},"min":{"1min":0.61799999999999999,"5min":0.53400000000000003,"15min":0.51600000000000001},"max":{"1min":1.1080000000000001,"5min":1.1100000000000001,"15min":1.417},"last":0.63600000000000001},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.099,"15min":1.0740000000000001},"min":{"1min":0.88400000000000001,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.4399999999999999,"5min":1.486,"15min":1.508},"last":0.94199999999999995}]},{"osd":1,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.85599999999999998,"15min":0.86499999999999999},"min":{"1min":0.66300000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1830000000000001,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.999,"5min":0.95099999999999996,"15min":0.94599999999999995},"min":{"1min":0.74399999999999999,"5min":0.58299999999999996,"15min":0.53000000000000003},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.1579999999999999}]},{"osd":2,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.163,"15min":1.1379999999999999},"min":{"1min":0.75900000000000001,"5min":0.67100000000000004,"15min":0.55100000000000005},"max":{"1min":1.5229999999999999,"5min":1.5680000000000001,"15min":1.6970000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2110000000000001,"15min":1.204},"min":{"1min":1.018,"5min":0.80700000000000005,"15min":0.64300000000000002},"max":{"1min":1.5589999999999999,"5min":1.651,"15min":1.7410000000000001},"last":1.365}]},{"osd":4,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.1930000000000001,"15min":1.1919999999999999},"min":{"1min":0.85899999999999999,"5min":0.79700000000000004,"15min":0.70599999999999996},"max":{"1min":1.609,"5min":1.609,"15min":2.306},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.262,"15min":1.268},"min":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.872},"max":{"1min":1.355,"5min":1.7070000000000001,"15min":2.2509999999999999},"last":1.421}]},{"osd":5,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.331,"15min":1.323},"min":{"1min":1.0409999999999999,"5min":0.98199999999999998,"15min":0.80600000000000005},"max":{"1min":1.54,"5min":1.667,"15min":1.6739999999999999},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2889999999999999,"15min":1.286},"min":{"1min":1.0609999999999999,"5min":0.90300000000000002,"15min":0.73499999999999999},"max":{"1min":1.4930000000000001,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":1.5409999999999999}]},{"osd":6,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.3180000000000001,"15min":1.2849999999999999},"min":{"1min":1.085,"5min":0.90600000000000003,"15min":0.872},"max":{"1min":1.7250000000000001,"5min":1.7250000000000001,"15min":3.2280000000000002},"last":1.329},{"interface":"front","average":{"1min":1.353,"5min":1.371,"15min":1.3720000000000001},"min":{"1min":1.1859999999999999,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":1.651,"5min":1.663,"15min":2.02},"last":1.121}]},{"osd":7,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3480000000000001,"15min":1.3380000000000001},"min":{"1min":1.083,"5min":0.99299999999999999,"15min":0.83699999999999997},"max":{"1min":1.522,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":1.482},{"interface":"front","average":{"1min":1.397,"5min":1.375,"15min":1.3540000000000001},"min":{"1min":1.159,"5min":0.98099999999999998,"15min":0.95399999999999996},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":3.3679999999999999},"last":1.409}]}]},{"osd":2,"up_from":13,"seq":55834575121,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":745472,"data_stored":369849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.81000000000000005,"15min":0.80500000000000005},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.52100000000000002},"max":{"1min":1.47,"5min":1.47,"15min":1.5800000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.91800000000000004,"15min":0.93000000000000005},"min":{"1min":0.67200000000000004,"5min":0.57299999999999995,"15min":0.55200000000000005},"max":{"1min":1.214,"5min":1.639,"15min":1.639},"last":0.77200000000000002}]},{"osd":1,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0349999999999999,"15min":0.98999999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.40500000000000003},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.258},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.92800000000000005,"15min":0.95699999999999996},"min":{"1min":0.67400000000000004,"5min":0.60699999999999998,"15min":0.54800000000000004},"max":{"1min":1.452,"5min":1.452,"15min":1.4890000000000001},"last":1.1240000000000001}]},{"osd":3,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.2989999999999999,"15min":1.266},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.595,"5min":1.7589999999999999,"15min":1.821},"last":1.5229999999999999},{"interface":"front","average":{"1min":1.073,"5min":1.048,"15min":1.0760000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.4650000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":1.0609999999999999}]},{"osd":4,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.2170000000000001,"15min":1.236},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.55,"5min":1.631,"15min":1.7130000000000001},"last":1.169},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.21,"15min":1.2370000000000001},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.4279999999999999,"5min":1.5389999999999999,"15min":1.7470000000000001},"last":1.877}]},{"osd":5,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.3440000000000001,"15min":1.3540000000000001},"min":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.76100000000000001},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":1.986},{"interface":"front","average":{"1min":1.429,"5min":1.427,"15min":1.403},"min":{"1min":1.1240000000000001,"5min":1.034,"15min":0.98099999999999998},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.863},"last":1.6439999999999999}]},{"osd":6,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.355,"15min":1.337},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.579,"5min":1.6899999999999999,"15min":1.6970000000000001},"last":1.8},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.2969999999999999,"15min":1.298},"min":{"1min":0.873,"5min":0.873,"15min":0.873},"max":{"1min":1.6910000000000001,"5min":1.778,"15min":1.8029999999999999},"last":1.319}]},{"osd":7,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.323,"15min":1.3320000000000001},"min":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":0.95699999999999996},"max":{"1min":1.6040000000000001,"5min":1.631,"15min":1.8029999999999999},"last":1.756},{"interface":"front","average":{"1min":1.395,"5min":1.421,"15min":1.411},"min":{"1min":1.1499999999999999,"5min":1.099,"15min":0.97599999999999998},"max":{"1min":1.647,"5min":1.8680000000000001,"15min":1.9590000000000001},"last":1.944}]}]},{"osd":1,"up_from":13,"seq":55834575122,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":729088,"data_stored":357478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.83699999999999997,"15min":0.85899999999999999},"min":{"1min":0.56399999999999995,"5min":0.47499999999999998,"15min":0.45200000000000001},"max":{"1min":0.97199999999999998,"5min":1.6020000000000001,"15min":1.6559999999999999},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.012,"5min":1.004,"15min":1.034},"min":{"1min":0.621,"5min":0.621,"15min":0.54800000000000004},"max":{"1min":1.603,"5min":1.603,"15min":1.9830000000000001},"last":0.84399999999999997}]},{"osd":2,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.90100000000000002,"15min":0.90700000000000003},"min":{"1min":0.60399999999999998,"5min":0.55700000000000005,"15min":0.436},"max":{"1min":1.52,"5min":1.52,"15min":1.7310000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.073,"15min":1.111},"min":{"1min":0.875,"5min":0.59799999999999998,"15min":0.505},"max":{"1min":1.4830000000000001,"5min":1.714,"15min":1.714},"last":0.79800000000000004}]},{"osd":3,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.161,"15min":1.204},"min":{"1min":0.83899999999999997,"5min":0.69199999999999995,"15min":0.57299999999999995},"max":{"1min":1.373,"5min":1.595,"15min":1.603},"last":1.157},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.96999999999999997,"15min":1},"min":{"1min":0.68300000000000005,"5min":0.59899999999999998,"15min":0.56799999999999995},"max":{"1min":1.4510000000000001,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.69999999999999996}]},{"osd":4,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.25,"15min":1.25},"min":{"1min":0.98599999999999999,"5min":0.81000000000000005,"15min":0.72199999999999998},"max":{"1min":1.476,"5min":1.9450000000000001,"15min":2.0470000000000002},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.1950000000000001,"15min":1.1970000000000001},"min":{"1min":0.94199999999999995,"5min":0.748,"15min":0.58499999999999996},"max":{"1min":1.6060000000000001,"5min":1.708,"15min":1.708},"last":1.2789999999999999}]},{"osd":5,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.2470000000000001,"15min":1.2410000000000001},"min":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.77300000000000002},"max":{"1min":1.452,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3,"15min":1.3080000000000001},"min":{"1min":1.0149999999999999,"5min":0.872,"15min":0.86899999999999999},"max":{"1min":1.4930000000000001,"5min":1.6060000000000001,"15min":1.7170000000000001},"last":1.448}]},{"osd":6,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.298,"15min":1.302},"min":{"1min":1.0580000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.5449999999999999,"5min":1.726,"15min":2.1240000000000001},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.264,"5min":1.2749999999999999,"15min":1.3009999999999999},"min":{"1min":1.1000000000000001,"5min":0.94199999999999995,"15min":0.82599999999999996},"max":{"1min":1.518,"5min":1.917,"15min":1.917},"last":1.133}]},{"osd":7,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.3560000000000001,"15min":1.3580000000000001},"min":{"1min":1.0660000000000001,"5min":0.80700000000000005,"15min":0.79900000000000004},"max":{"1min":1.5649999999999999,"5min":1.77,"15min":1.77},"last":1.516},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.3520000000000001,"15min":1.363},"min":{"1min":1.147,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.6399999999999999,"5min":1.8240000000000001,"15min":2.3199999999999998},"last":1.3340000000000001}]}]},{"osd":0,"up_from":56,"seq":240518168728,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28980,"kb_used_data":1316,"kb_used_omap":12,"kb_used_meta":27635,"kb_avail":94342860,"statfs":{"total":96636764160,"available":96607088640,"internally_reserved":0,"allocated":1347584,"data_stored":961135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13003,"internal_metadata":28298549},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 18 12:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.90100000000000002,"15min":0.95499999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.454,"5min":1.454,"15min":1.5109999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0649999999999999,"15min":1.073},"min":{"1min":0.68799999999999994,"5min":0.62,"15min":0.52000000000000002},"max":{"1min":1.46,"5min":1.577,"15min":1.577},"last":0.68000000000000005}]},{"osd":2,"last update":"Wed Oct 18 12:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.93600000000000005,"15min":0.99299999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.60799999999999998},"max":{"1min":1.321,"5min":1.496,"15min":1.6659999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.105,"5min":1.04,"15min":1.03},"min":{"1min":0.80300000000000005,"5min":0.59099999999999997,"15min":0.48899999999999999},"max":{"1min":1.468,"5min":1.673,"15min":1.673},"last":0.84699999999999998}]},{"osd":3,"last update":"Wed Oct 18 12:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.92800000000000005,"15min":0.94799999999999995},"min":{"1min":0.65800000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.2589999999999999,"5min":1.466,"15min":1.6060000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1080000000000001,"15min":1.169},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.48,"5min":1.589,"15min":1.589},"last":0.79000000000000004}]},{"osd":4,"last update":"Wed Oct 18 12:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.222,"15min":1.242},"min":{"1min":0.98999999999999999,"5min":0.87,"15min":0.87},"max":{"1min":1.5429999999999999,"5min":1.615,"15min":1.722},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3169999999999999,"15min":1.3839999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.756,"5min":1.756,"15min":2.1299999999999999},"last":1.111}]},{"osd":5,"last update":"Wed Oct 18 12:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.345,"15min":1.3720000000000001},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.84399999999999997},"max":{"1min":1.625,"5min":1.625,"15min":2.0960000000000001},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.347,"5min":1.2809999999999999,"15min":1.331},"min":{"1min":1.103,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":2.0819999999999999,"5min":2.0819999999999999,"15min":2.0819999999999999},"last":0.99399999999999999}]},{"osd":6,"last update":"Wed Oct 18 12:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.351,"15min":1.431},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":2.2200000000000002},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.367,"15min":1.415},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.89700000000000002},"max":{"1min":1.9279999999999999,"5min":1.9690000000000001,"15min":2.0329999999999999},"last":1.008}]},{"osd":7,"last update":"Wed Oct 18 12:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.399,"15min":1.4650000000000001},"min":{"1min":1.087,"5min":1.0169999999999999,"15min":1.0169999999999999},"max":{"1min":2.141,"5min":2.141,"15min":2.169},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3260000000000001,"15min":1.403},"min":{"1min":1.091,"5min":0.96599999999999997,"15min":0.92100000000000004},"max":{"1min":1.857,"5min":1.857,"15min":2.081},"last":1.393}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-18T12:42:06.672 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-18T12:42:06.673 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-18T12:42:06.853 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.848+0000 7fdad95dc700 1 Processor -- start 2023-10-18T12:42:06.854 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.848+0000 7fdad95dc700 1 -- start start 2023-10-18T12:42:06.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.848+0000 7fdad95dc700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdad40d30e0 0x7fdad40d13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:06.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.848+0000 7fdad95dc700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdad40b1df0 0x7fdad4070a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:06.855 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.848+0000 7fdad95dc700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdad415d060 con 0x7fdad415cc80 2023-10-18T12:42:06.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.848+0000 7fdad95dc700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdad406d830 con 0x7fdad40d30e0 2023-10-18T12:42:06.856 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.848+0000 7fdad95dc700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad406dd60 con 0x7fdad40b1df0 2023-10-18T12:42:06.857 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.848+0000 7fdad3fff700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fdad415cc80 0x7fdad40d29d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50786/0 (socket says 172.21.15.114:50786) 2023-10-18T12:42:06.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.848+0000 7fdad3fff700 1 -- 172.21.15.114:0/2986754283 learned_addr learned my addr 172.21.15.114:0/2986754283 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:42:06.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.848+0000 7fdacb7fe700 1 --2- 172.21.15.114:0/2986754283 >> v2:172.21.15.114:3300/0 conn(0x7fdad40d30e0 0x7fdad40d13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:06.858 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.848+0000 7fdad8ddb700 1 --2- 172.21.15.114:0/2986754283 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdad40b1df0 0x7fdad4070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:06.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.852+0000 7fdad37fe700 1 -- 172.21.15.114:0/2986754283 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3408258114 0 0) 0x7fdad415d060 con 0x7fdad415cc80 2023-10-18T12:42:06.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.852+0000 7fdad37fe700 1 -- 172.21.15.114:0/2986754283 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdac00035d0 con 0x7fdad415cc80 2023-10-18T12:42:06.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.852+0000 7fdacb7fe700 1 -- 172.21.15.114:0/2986754283 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdad40b1df0 msgr2=0x7fdad4070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:42:06.859 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.852+0000 7fdacb7fe700 1 --2- 172.21.15.114:0/2986754283 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdad40b1df0 0x7fdad4070a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:06.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.852+0000 7fdacb7fe700 1 -- 172.21.15.114:0/2986754283 >> v1:172.21.15.114:6789/0 conn(0x7fdad415cc80 legacy=0x7fdad40d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:06.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.852+0000 7fdacb7fe700 1 -- 172.21.15.114:0/2986754283 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad406da80 con 0x7fdad40d30e0 2023-10-18T12:42:06.860 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.852+0000 7fdacb7fe700 1 --2- 172.21.15.114:0/2986754283 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdad40d30e0 0x7fdad40d13c0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fdabc009850 tx=0x7fdabc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3863452019121863 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:06.861 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.852+0000 7fdad37fe700 1 -- 172.21.15.114:0/2986754283 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc011830 con 0x7fdad40d30e0 2023-10-18T12:42:06.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.852+0000 7fdad37fe700 1 -- 172.21.15.114:0/2986754283 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdabc011990 con 0x7fdad40d30e0 2023-10-18T12:42:06.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.852+0000 7fdad37fe700 1 -- 172.21.15.114:0/2986754283 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc011d40 con 0x7fdad40d30e0 2023-10-18T12:42:06.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.852+0000 7fdad95dc700 1 -- 172.21.15.114:0/2986754283 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdad40d30e0 msgr2=0x7fdad40d13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:06.862 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.852+0000 7fdad95dc700 1 --2- 172.21.15.114:0/2986754283 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdad40d30e0 0x7fdad40d13c0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fdabc009850 tx=0x7fdabc009b60 comp rx=0 tx=0).stop 2023-10-18T12:42:06.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.852+0000 7fdad95dc700 1 -- 172.21.15.114:0/2986754283 shutdown_connections 2023-10-18T12:42:06.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.852+0000 7fdad95dc700 1 --2- 172.21.15.114:0/2986754283 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdad40b1df0 0x7fdad4070a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:06.863 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.852+0000 7fdad95dc700 1 --2- 172.21.15.114:0/2986754283 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdad40d30e0 0x7fdad40d13c0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:06.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.852+0000 7fdad95dc700 1 -- 172.21.15.114:0/2986754283 >> 172.21.15.114:0/2986754283 conn(0x7fdad40cf530 msgr2=0x7fdad40cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:06.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.852+0000 7fdad95dc700 1 -- 172.21.15.114:0/2986754283 shutdown_connections 2023-10-18T12:42:06.864 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.852+0000 7fdad95dc700 1 -- 172.21.15.114:0/2986754283 wait complete. 2023-10-18T12:42:06.865 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.856+0000 7fdad95dc700 1 Processor -- start 2023-10-18T12:42:06.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.856+0000 7fdad95dc700 1 -- start start 2023-10-18T12:42:06.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.860+0000 7fdad95dc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdad40b1df0 0x7fdad414c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:06.866 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.860+0000 7fdad95dc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdad40d30e0 0x7fdad415da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:06.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.860+0000 7fdad95dc700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdad415cc80 0x7fdad4153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:06.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.860+0000 7fdad95dc700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad414cb80 con 0x7fdad40d30e0 2023-10-18T12:42:06.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.860+0000 7fdad95dc700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad415e330 con 0x7fdad40b1df0 2023-10-18T12:42:06.867 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.860+0000 7fdad95dc700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad415e610 con 0x7fdad415cc80 2023-10-18T12:42:06.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.860+0000 7fdacb7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdad40d30e0 0x7fdad415da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:06.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.860+0000 7fdacb7fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdad40d30e0 0x7fdad415da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36818/0 (socket says 172.21.15.114:36818) 2023-10-18T12:42:06.868 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.860+0000 7fdacb7fe700 1 -- 172.21.15.114:0/2125000839 learned_addr learned my addr 172.21.15.114:0/2125000839 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:42:06.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.860+0000 7fdad3fff700 1 --2- 172.21.15.114:0/2125000839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdad40b1df0 0x7fdad414c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:06.870 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.860+0000 7fdad8ddb700 1 --2- 172.21.15.114:0/2125000839 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdad415cc80 0x7fdad4153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:06.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.860+0000 7fdacb7fe700 1 -- 172.21.15.114:0/2125000839 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdad415cc80 msgr2=0x7fdad4153db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:06.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.860+0000 7fdacb7fe700 1 --2- 172.21.15.114:0/2125000839 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdad415cc80 0x7fdad4153db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:06.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.860+0000 7fdacb7fe700 1 -- 172.21.15.114:0/2125000839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdad40b1df0 msgr2=0x7fdad414c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:06.871 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.860+0000 7fdacb7fe700 1 --2- 172.21.15.114:0/2125000839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdad40b1df0 0x7fdad414c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:06.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.860+0000 7fdacb7fe700 1 -- 172.21.15.114:0/2125000839 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdabc0094b0 con 0x7fdad40d30e0 2023-10-18T12:42:06.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.860+0000 7fdacb7fe700 1 --2- 172.21.15.114:0/2125000839 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdad40d30e0 0x7fdad415da70 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fdabc0090b0 tx=0x7fdabc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:06.872 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.860+0000 7fdad17fa700 1 -- 172.21.15.114:0/2125000839 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc004480 con 0x7fdad40d30e0 2023-10-18T12:42:06.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.860+0000 7fdad17fa700 1 -- 172.21.15.114:0/2125000839 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdabc01f070 con 0x7fdad40d30e0 2023-10-18T12:42:06.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.860+0000 7fdad95dc700 1 -- 172.21.15.114:0/2125000839 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdad415e8f0 con 0x7fdad40d30e0 2023-10-18T12:42:06.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.860+0000 7fdad17fa700 1 -- 172.21.15.114:0/2125000839 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc003900 con 0x7fdad40d30e0 2023-10-18T12:42:06.873 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.860+0000 7fdad95dc700 1 -- 172.21.15.114:0/2125000839 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdad415ef40 con 0x7fdad40d30e0 2023-10-18T12:42:06.874 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.864+0000 7fdad95dc700 1 -- 172.21.15.114:0/2125000839 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdad4072e60 con 0x7fdad40d30e0 2023-10-18T12:42:06.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.864+0000 7fdad17fa700 1 -- 172.21.15.114:0/2125000839 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fdabc021030 con 0x7fdad40d30e0 2023-10-18T12:42:06.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.868+0000 7fdad17fa700 1 --2- 172.21.15.114:0/2125000839 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdab4065720 0x7fdab4067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:06.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.868+0000 7fdad17fa700 1 -- 172.21.15.114:0/2125000839 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5659+0+0 (secure 0 0 0) 0x7fdabc083f90 con 0x7fdad40d30e0 2023-10-18T12:42:06.875 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.868+0000 7fdad3fff700 1 --2- 172.21.15.114:0/2125000839 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdab4065720 0x7fdab4067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:06.876 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.868+0000 7fdad3fff700 1 --2- 172.21.15.114:0/2125000839 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdab4065720 0x7fdab4067be0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fdac4001460 tx=0x7fdac4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:06.878 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:06.872+0000 7fdad17fa700 1 -- 172.21.15.114:0/2125000839 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fdabc051cf0 con 0x7fdad40d30e0 2023-10-18T12:42:07.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.044+0000 7fdad95dc700 1 -- 172.21.15.114:0/2125000839 --> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdad40d0a50 con 0x7fdab4065720 2023-10-18T12:42:07.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.052+0000 7fdad17fa700 1 -- 172.21.15.114:0/2125000839 <== mgr.4108 v2:172.21.15.172:6832/461408666 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+70033 (secure 0 0 0) 0x7fdac4001f80 con 0x7fdab4065720 2023-10-18T12:42:07.058 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:42:07.061 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.056+0000 7fdad95dc700 1 -- 172.21.15.114:0/2125000839 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdab4065720 msgr2=0x7fdab4067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:07.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.056+0000 7fdad95dc700 1 --2- 172.21.15.114:0/2125000839 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdab4065720 0x7fdab4067be0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fdac4001460 tx=0x7fdac4009040 comp rx=0 tx=0).stop 2023-10-18T12:42:07.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.056+0000 7fdad95dc700 1 -- 172.21.15.114:0/2125000839 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdad40d30e0 msgr2=0x7fdad415da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:07.062 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.056+0000 7fdad95dc700 1 --2- 172.21.15.114:0/2125000839 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdad40d30e0 0x7fdad415da70 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fdabc0090b0 tx=0x7fdabc004770 comp rx=0 tx=0).stop 2023-10-18T12:42:07.063 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.056+0000 7fdad95dc700 1 -- 172.21.15.114:0/2125000839 shutdown_connections 2023-10-18T12:42:07.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.056+0000 7fdad95dc700 1 --2- 172.21.15.114:0/2125000839 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdab4065720 0x7fdab4067be0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:07.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.056+0000 7fdad95dc700 1 --2- 172.21.15.114:0/2125000839 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdad415cc80 0x7fdad4153db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:07.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.056+0000 7fdad95dc700 1 --2- 172.21.15.114:0/2125000839 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdad40d30e0 0x7fdad415da70 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:07.064 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.056+0000 7fdad95dc700 1 --2- 172.21.15.114:0/2125000839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdad40b1df0 0x7fdad414c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:07.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.056+0000 7fdad95dc700 1 -- 172.21.15.114:0/2125000839 >> 172.21.15.114:0/2125000839 conn(0x7fdad40cf530 msgr2=0x7fdad41594d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:07.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.056+0000 7fdad95dc700 1 -- 172.21.15.114:0/2125000839 shutdown_connections 2023-10-18T12:42:07.065 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.056+0000 7fdad95dc700 1 -- 172.21.15.114:0/2125000839 wait complete. 2023-10-18T12:42:07.066 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2023-10-18T12:42:07.085 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":736,"stamp":"2023-10-18T12:42:05.504579+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":179,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223708,"kb_used_data":6904,"kb_used_omap":24,"kb_used_meta":216679,"kb_avail":754751012,"statfs":{"total":773094113280,"available":772865036288,"internally_reserved":0,"allocated":7069696,"data_stored":4078125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25470,"internal_metadata":221879426},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-13419,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-65,"num_write_kb":-37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002216"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-18T12:41:59.793149+0000","last_change":"2023-10-18T12:19:33.531672+0000","last_active":"2023-10-18T12:41:59.793149+0000","last_peered":"2023-10-18T12:41:59.793149+0000","last_clean":"2023-10-18T12:41:59.793149+0000","last_became_active":"2023-10-18T12:19:33.530907+0000","last_became_peered":"2023-10-18T12:19:33.530907+0000","last_unstale":"2023-10-18T12:41:59.793149+0000","last_undegraded":"2023-10-18T12:41:59.793149+0000","last_fullsized":"2023-10-18T12:41:59.793149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:42:05.114838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":95,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-18T12:41:59.510356+0000","last_change":"2023-10-18T12:19:33.529329+0000","last_active":"2023-10-18T12:41:59.510356+0000","last_peered":"2023-10-18T12:41:59.510356+0000","last_clean":"2023-10-18T12:41:59.510356+0000","last_became_active":"2023-10-18T12:19:33.528930+0000","last_became_peered":"2023-10-18T12:19:33.528930+0000","last_unstale":"2023-10-18T12:41:59.510356+0000","last_undegraded":"2023-10-18T12:41:59.510356+0000","last_fullsized":"2023-10-18T12:41:59.510356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:42:05.114838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":113,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-18T12:41:59.734260+0000","last_change":"2023-10-18T12:29:30.706360+0000","last_active":"2023-10-18T12:41:59.734260+0000","last_peered":"2023-10-18T12:41:59.734260+0000","last_clean":"2023-10-18T12:41:59.734260+0000","last_became_active":"2023-10-18T12:29:30.706091+0000","last_became_peered":"2023-10-18T12:29:30.706091+0000","last_unstale":"2023-10-18T12:41:59.734260+0000","last_undegraded":"2023-10-18T12:41:59.734260+0000","last_fullsized":"2023-10-18T12:41:59.734260+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:38:22.120743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-18T12:41:59.510176+0000","last_change":"2023-10-18T12:29:30.707576+0000","last_active":"2023-10-18T12:41:59.510176+0000","last_peered":"2023-10-18T12:41:59.510176+0000","last_clean":"2023-10-18T12:41:59.510176+0000","last_became_active":"2023-10-18T12:29:30.707304+0000","last_became_peered":"2023-10-18T12:29:30.707304+0000","last_unstale":"2023-10-18T12:41:59.510176+0000","last_undegraded":"2023-10-18T12:41:59.510176+0000","last_fullsized":"2023-10-18T12:41:59.510176+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:51:34.130091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-18T12:41:59.792958+0000","last_change":"2023-10-18T12:19:33.533449+0000","last_active":"2023-10-18T12:41:59.792958+0000","last_peered":"2023-10-18T12:41:59.792958+0000","last_clean":"2023-10-18T12:41:59.792958+0000","last_became_active":"2023-10-18T12:19:33.533051+0000","last_became_peered":"2023-10-18T12:19:33.533051+0000","last_unstale":"2023-10-18T12:41:59.792958+0000","last_undegraded":"2023-10-18T12:41:59.792958+0000","last_fullsized":"2023-10-18T12:41:59.792958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:40:17.500932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":97,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-18T12:41:59.506746+0000","last_change":"2023-10-18T12:19:33.530766+0000","last_active":"2023-10-18T12:41:59.506746+0000","last_peered":"2023-10-18T12:41:59.506746+0000","last_clean":"2023-10-18T12:41:59.506746+0000","last_became_active":"2023-10-18T12:19:33.530346+0000","last_became_peered":"2023-10-18T12:19:33.530346+0000","last_unstale":"2023-10-18T12:41:59.506746+0000","last_undegraded":"2023-10-18T12:41:59.506746+0000","last_fullsized":"2023-10-18T12:41:59.506746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T15:52:04.972603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":100,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-18T12:41:59.733519+0000","last_change":"2023-10-18T12:19:33.528538+0000","last_active":"2023-10-18T12:41:59.733519+0000","last_peered":"2023-10-18T12:41:59.733519+0000","last_clean":"2023-10-18T12:41:59.733519+0000","last_became_active":"2023-10-18T12:19:33.528214+0000","last_became_peered":"2023-10-18T12:19:33.528214+0000","last_unstale":"2023-10-18T12:41:59.733519+0000","last_undegraded":"2023-10-18T12:41:59.733519+0000","last_fullsized":"2023-10-18T12:41:59.733519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:27:02.936664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":93,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-18T12:41:59.792933+0000","last_change":"2023-10-18T12:19:33.531214+0000","last_active":"2023-10-18T12:41:59.792933+0000","last_peered":"2023-10-18T12:41:59.792933+0000","last_clean":"2023-10-18T12:41:59.792933+0000","last_became_active":"2023-10-18T12:19:33.530795+0000","last_became_peered":"2023-10-18T12:19:33.530795+0000","last_unstale":"2023-10-18T12:41:59.792933+0000","last_undegraded":"2023-10-18T12:41:59.792933+0000","last_fullsized":"2023-10-18T12:41:59.792933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:09:42.796622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":270,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-10-18T12:41:59.733952+0000","last_change":"2023-10-18T12:29:30.706528+0000","last_active":"2023-10-18T12:41:59.733952+0000","last_peered":"2023-10-18T12:41:59.733952+0000","last_clean":"2023-10-18T12:41:59.733952+0000","last_became_active":"2023-10-18T12:29:30.706096+0000","last_became_peered":"2023-10-18T12:29:30.706096+0000","last_unstale":"2023-10-18T12:41:59.733952+0000","last_undegraded":"2023-10-18T12:41:59.733952+0000","last_fullsized":"2023-10-18T12:41:59.733952+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:27.318899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:27.318899+0000","last_clean_scrub_stamp":"2023-10-18T12:19:27.318899+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:43:54.628089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575123,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28304,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343536,"statfs":{"total":96636764160,"available":96607780864,"internally_reserved":0,"allocated":1314816,"data_stored":946434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.153,"15min":1.153},"min":{"1min":0.86399999999999999,"5min":0.56200000000000006,"15min":0.55000000000000004},"max":{"1min":1.3240000000000001,"5min":1.679,"15min":1.9179999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1859999999999999,"15min":1.159},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.61799999999999999},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.65700000000000003}]},{"osd":1,"last update":"Wed Oct 18 12:41:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1499999999999999,"15min":1.1579999999999999},"min":{"1min":0.83099999999999996,"5min":0.60999999999999999,"15min":0.48399999999999999},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.119},{"interface":"front","average":{"1min":1.226,"5min":1.1799999999999999,"15min":1.169},"min":{"1min":0.99199999999999999,"5min":0.79300000000000004,"15min":0.56000000000000005},"max":{"1min":1.599,"5min":1.6399999999999999,"15min":2.343},"last":0.84499999999999997}]},{"osd":2,"last update":"Wed Oct 18 12:41:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.3109999999999999,"15min":1.325},"min":{"1min":1.0569999999999999,"5min":0.69299999999999995,"15min":0.67000000000000004},"max":{"1min":1.5009999999999999,"5min":1.7350000000000001,"15min":2.198},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.238,"5min":1.29,"15min":1.2849999999999999},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.6220000000000001,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.998}]},{"osd":3,"last update":"Wed Oct 18 12:41:06 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.246,"15min":1.2569999999999999},"min":{"1min":0.94199999999999995,"5min":0.73799999999999999,"15min":0.55300000000000005},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.95},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.409,"15min":1.3999999999999999},"min":{"1min":1.0589999999999999,"5min":0.90400000000000003,"15min":0.78400000000000003},"max":{"1min":1.8420000000000001,"5min":1.8580000000000001,"15min":2.5710000000000002},"last":1.2989999999999999}]},{"osd":4,"last update":"Wed Oct 18 12:41:06 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.177,"15min":1.1739999999999999},"min":{"1min":0.84599999999999997,"5min":0.60399999999999998,"15min":0.57599999999999996},"max":{"1min":1.53,"5min":1.6830000000000001,"15min":2.0779999999999998},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.222,"5min":1.2390000000000001,"15min":1.2310000000000001},"min":{"1min":0.83899999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.5720000000000001,"5min":1.9570000000000001,"15min":2.0219999999999998},"last":1.2509999999999999}]},{"osd":5,"last update":"Wed Oct 18 12:41:06 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.3440000000000001,"15min":1.3129999999999999},"min":{"1min":0.89900000000000002,"5min":0.499,"15min":0.499},"max":{"1min":1.6859999999999999,"5min":2.0070000000000001,"15min":2.5150000000000001},"last":1.167},{"interface":"front","average":{"1min":1.355,"5min":1.3620000000000001,"15min":1.359},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.9159999999999999,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":1.341}]},{"osd":6,"last update":"Wed Oct 18 12:41:06 2023","interfaces":[{"interface":"back","average":{"1min":1.4259999999999999,"5min":1.4550000000000001,"15min":1.4419999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.67400000000000004},"max":{"1min":2.0070000000000001,"5min":2.1909999999999998,"15min":2.274},"last":1.425},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.3620000000000001,"15min":1.343},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.61699999999999999},"max":{"1min":1.778,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":1.708}]}]},{"osd":6,"up_from":13,"seq":55834575123,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":733184,"data_stored":358080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:41:48 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.1419999999999999,"15min":1.127},"min":{"1min":0.81999999999999995,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.3779999999999999,"5min":1.7250000000000001,"15min":1.7509999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.141,"5min":1.159,"15min":1.149},"min":{"1min":0.81599999999999995,"5min":0.752,"15min":0.752},"max":{"1min":1.462,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":1.2589999999999999}]},{"osd":1,"last update":"Wed Oct 18 12:41:17 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.131,"15min":1.179},"min":{"1min":0.86099999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.488,"5min":1.5660000000000001,"15min":1.7969999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.206,"15min":1.2050000000000001},"min":{"1min":0.94499999999999995,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.4930000000000001,"5min":1.7050000000000001,"15min":1.8480000000000001},"last":1.163}]},{"osd":2,"last update":"Wed Oct 18 12:41:17 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.214,"15min":1.2430000000000001},"min":{"1min":0.91000000000000003,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.6399999999999999,"5min":1.6699999999999999,"15min":1.958},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.21,"5min":1.2010000000000001,"15min":1.2170000000000001},"min":{"1min":0.84999999999999998,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.5720000000000001,"5min":1.585,"15min":1.645},"last":0.95099999999999996}]},{"osd":3,"last update":"Wed Oct 18 12:41:17 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.2869999999999999,"15min":1.29},"min":{"1min":0.92600000000000005,"5min":0.84699999999999998,"15min":0.76100000000000001},"max":{"1min":1.51,"5min":1.6879999999999999,"15min":1.7290000000000001},"last":1.613},{"interface":"front","average":{"1min":1.331,"5min":1.3600000000000001,"15min":1.397},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.83399999999999996},"max":{"1min":1.647,"5min":1.8300000000000001,"15min":1.952},"last":1.3959999999999999}]},{"osd":4,"last update":"Wed Oct 18 12:41:17 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.1870000000000001,"15min":1.1850000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.528,"5min":1.74,"15min":1.8480000000000001},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.28,"5min":1.25,"15min":1.248},"min":{"1min":0.82999999999999996,"5min":0.66700000000000004,"15min":0.60799999999999998},"max":{"1min":1.5700000000000001,"5min":1.8759999999999999,"15min":1.917},"last":1.4430000000000001}]},{"osd":5,"last update":"Wed Oct 18 12:41:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.266,"15min":1.3149999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.446,"5min":1.8160000000000001,"15min":2.0430000000000001},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.329,"15min":1.345},"min":{"1min":0.88500000000000001,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.528,"5min":1.8300000000000001,"15min":1.9970000000000001},"last":1.496}]},{"osd":7,"last update":"Wed Oct 18 12:41:17 2023","interfaces":[{"interface":"back","average":{"1min":1.427,"5min":1.363,"15min":1.373},"min":{"1min":1.099,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.6499999999999999,"5min":2.0059999999999998,"15min":2.0059999999999998},"last":1.6779999999999999},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.423,"15min":1.4570000000000001},"min":{"1min":0.79600000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.744,"5min":1.9379999999999999,"15min":2.105},"last":1.546}]}]},{"osd":5,"up_from":13,"seq":55834575124,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":724992,"data_stored":357377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.262,"15min":1.2709999999999999},"min":{"1min":1.1399999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.7150000000000001},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.278,"5min":1.2649999999999999,"15min":1.2909999999999999},"min":{"1min":0.89500000000000002,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":1.387}]},{"osd":1,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.1479999999999999,"15min":1.1759999999999999},"min":{"1min":0.90300000000000002,"5min":0.753,"15min":0.70499999999999996},"max":{"1min":1.3839999999999999,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":1.123},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.155,"15min":1.181},"min":{"1min":0.80600000000000005,"5min":0.72599999999999998,"15min":0.55200000000000005},"max":{"1min":1.6160000000000001,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.72099999999999997}]},{"osd":2,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.1779999999999999,"15min":1.1539999999999999},"min":{"1min":0.86599999999999999,"5min":0.81100000000000005,"15min":0.58799999999999997},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.228,"5min":1.2030000000000001,"15min":1.226},"min":{"1min":0.93500000000000005,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.73},"last":1.258}]},{"osd":3,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.282,"15min":1.298},"min":{"1min":0.94299999999999995,"5min":0.83999999999999997,"15min":0.80000000000000004},"max":{"1min":1.478,"5min":1.651,"15min":1.8169999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.373,"15min":1.339},"min":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":0.90300000000000002},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.90500000000000003}]},{"osd":4,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.1499999999999999,"15min":1.167},"min":{"1min":0.76000000000000001,"5min":0.52500000000000002,"15min":0.42999999999999999},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.77},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.2,"5min":1.244,"15min":1.2430000000000001},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.61899999999999999},"max":{"1min":1.639,"5min":1.6819999999999999,"15min":1.8700000000000001},"last":1.415}]},{"osd":6,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2310000000000001,"15min":1.218},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.66200000000000003},"max":{"1min":1.639,"5min":1.774,"15min":2.411},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.321,"15min":1.323},"min":{"1min":0.92500000000000004,"5min":0.80600000000000005,"15min":0.48199999999999998},"max":{"1min":1.6359999999999999,"5min":1.796,"15min":2.1629999999999998},"last":1.373}]},{"osd":7,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.369,"15min":1.3540000000000001},"min":{"1min":0.85899999999999999,"5min":0.83999999999999997,"15min":0.63600000000000001},"max":{"1min":1.7250000000000001,"5min":1.873,"15min":1.873},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.415,"5min":1.399,"15min":1.3799999999999999},"min":{"1min":0.96499999999999997,"5min":0.83599999999999997,"15min":0.52000000000000002},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":2.496},"last":1.5580000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575121,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":741376,"data_stored":369827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:41:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1439999999999999,"15min":1.169},"min":{"1min":0.77700000000000002,"5min":0.59499999999999997,"15min":0.46500000000000002},"max":{"1min":1.74,"5min":1.74,"15min":1.9419999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.123,"5min":1.1679999999999999,"15min":1.1779999999999999},"min":{"1min":0.84199999999999997,"5min":0.78100000000000003,"15min":0.58799999999999997},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.7609999999999999},"last":1.3720000000000001}]},{"osd":1,"last update":"Wed Oct 18 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1870000000000001,"15min":1.1819999999999999},"min":{"1min":0.625,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.661,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.046},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.2070000000000001,"15min":1.21},"min":{"1min":0.81200000000000006,"5min":0.76800000000000002,"15min":0.69099999999999995},"max":{"1min":1.462,"5min":1.601,"15min":1.786},"last":0.98399999999999999}]},{"osd":2,"last update":"Wed Oct 18 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.1399999999999999,"15min":1.1599999999999999},"min":{"1min":0.76200000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3129999999999999,"5min":1.6020000000000001,"15min":1.6619999999999999},"last":1.095},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2549999999999999,"15min":1.28},"min":{"1min":0.70699999999999996,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.8680000000000001},"last":1.3380000000000001}]},{"osd":3,"last update":"Wed Oct 18 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.3109999999999999,"15min":1.349},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.847,"5min":1.847,"15min":1.8799999999999999},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.25,"5min":1.2849999999999999,"15min":1.3069999999999999},"min":{"1min":0.76900000000000002,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.502,"5min":1.986,"15min":1.986},"last":1.2949999999999999}]},{"osd":5,"last update":"Wed Oct 18 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2250000000000001,"15min":1.2110000000000001},"min":{"1min":0.70899999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.8,"5min":1.8,"15min":2.1259999999999999},"last":1.476},{"interface":"front","average":{"1min":1.236,"5min":1.2729999999999999,"15min":1.25},"min":{"1min":0.84599999999999997,"5min":0.78700000000000003,"15min":0.499},"max":{"1min":1.752,"5min":1.855,"15min":1.855},"last":1.2569999999999999}]},{"osd":6,"last update":"Wed Oct 18 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.212,"15min":1.232},"min":{"1min":0.78100000000000003,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.5900000000000001,"5min":1.8700000000000001,"15min":1.9930000000000001},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.3660000000000001,"15min":1.373},"min":{"1min":1.0720000000000001,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.865,"5min":1.865,"15min":2.0579999999999998},"last":1.2070000000000001}]},{"osd":7,"last update":"Wed Oct 18 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3759999999999999,"15min":1.3779999999999999},"min":{"1min":1.0569999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":2.79},"last":1.512},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.3680000000000001,"15min":1.373},"min":{"1min":0.86399999999999999,"5min":0.747,"15min":0.67900000000000005},"max":{"1min":1.8200000000000001,"5min":2.1019999999999999,"15min":2.173},"last":1.4330000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575123,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":733184,"data_stored":357945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:41:01 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.77100000000000002,"15min":0.76100000000000001},"min":{"1min":0.61799999999999999,"5min":0.53400000000000003,"15min":0.51600000000000001},"max":{"1min":1.1080000000000001,"5min":1.1100000000000001,"15min":1.417},"last":0.63600000000000001},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.099,"15min":1.0740000000000001},"min":{"1min":0.88400000000000001,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.4399999999999999,"5min":1.486,"15min":1.508},"last":0.94199999999999995}]},{"osd":1,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.85599999999999998,"15min":0.86499999999999999},"min":{"1min":0.66300000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1830000000000001,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.999,"5min":0.95099999999999996,"15min":0.94599999999999995},"min":{"1min":0.74399999999999999,"5min":0.58299999999999996,"15min":0.53000000000000003},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.1579999999999999}]},{"osd":2,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.163,"15min":1.1379999999999999},"min":{"1min":0.75900000000000001,"5min":0.67100000000000004,"15min":0.55100000000000005},"max":{"1min":1.5229999999999999,"5min":1.5680000000000001,"15min":1.6970000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2110000000000001,"15min":1.204},"min":{"1min":1.018,"5min":0.80700000000000005,"15min":0.64300000000000002},"max":{"1min":1.5589999999999999,"5min":1.651,"15min":1.7410000000000001},"last":1.365}]},{"osd":4,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.1930000000000001,"15min":1.1919999999999999},"min":{"1min":0.85899999999999999,"5min":0.79700000000000004,"15min":0.70599999999999996},"max":{"1min":1.609,"5min":1.609,"15min":2.306},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.262,"15min":1.268},"min":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.872},"max":{"1min":1.355,"5min":1.7070000000000001,"15min":2.2509999999999999},"last":1.421}]},{"osd":5,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.331,"15min":1.323},"min":{"1min":1.0409999999999999,"5min":0.98199999999999998,"15min":0.80600000000000005},"max":{"1min":1.54,"5min":1.667,"15min":1.6739999999999999},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2889999999999999,"15min":1.286},"min":{"1min":1.0609999999999999,"5min":0.90300000000000002,"15min":0.73499999999999999},"max":{"1min":1.4930000000000001,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":1.5409999999999999}]},{"osd":6,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.3180000000000001,"15min":1.2849999999999999},"min":{"1min":1.085,"5min":0.90600000000000003,"15min":0.872},"max":{"1min":1.7250000000000001,"5min":1.7250000000000001,"15min":3.2280000000000002},"last":1.329},{"interface":"front","average":{"1min":1.353,"5min":1.371,"15min":1.3720000000000001},"min":{"1min":1.1859999999999999,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":1.651,"5min":1.663,"15min":2.02},"last":1.121}]},{"osd":7,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3480000000000001,"15min":1.3380000000000001},"min":{"1min":1.083,"5min":0.99299999999999999,"15min":0.83699999999999997},"max":{"1min":1.522,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":1.482},{"interface":"front","average":{"1min":1.397,"5min":1.375,"15min":1.3540000000000001},"min":{"1min":1.159,"5min":0.98099999999999998,"15min":0.95399999999999996},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":3.3679999999999999},"last":1.409}]}]},{"osd":2,"up_from":13,"seq":55834575121,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":745472,"data_stored":369849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.81000000000000005,"15min":0.80500000000000005},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.52100000000000002},"max":{"1min":1.47,"5min":1.47,"15min":1.5800000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.91800000000000004,"15min":0.93000000000000005},"min":{"1min":0.67200000000000004,"5min":0.57299999999999995,"15min":0.55200000000000005},"max":{"1min":1.214,"5min":1.639,"15min":1.639},"last":0.77200000000000002}]},{"osd":1,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0349999999999999,"15min":0.98999999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.40500000000000003},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.258},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.92800000000000005,"15min":0.95699999999999996},"min":{"1min":0.67400000000000004,"5min":0.60699999999999998,"15min":0.54800000000000004},"max":{"1min":1.452,"5min":1.452,"15min":1.4890000000000001},"last":1.1240000000000001}]},{"osd":3,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.2989999999999999,"15min":1.266},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.595,"5min":1.7589999999999999,"15min":1.821},"last":1.5229999999999999},{"interface":"front","average":{"1min":1.073,"5min":1.048,"15min":1.0760000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.4650000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":1.0609999999999999}]},{"osd":4,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.2170000000000001,"15min":1.236},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.55,"5min":1.631,"15min":1.7130000000000001},"last":1.169},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.21,"15min":1.2370000000000001},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.4279999999999999,"5min":1.5389999999999999,"15min":1.7470000000000001},"last":1.877}]},{"osd":5,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.3440000000000001,"15min":1.3540000000000001},"min":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.76100000000000001},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":1.986},{"interface":"front","average":{"1min":1.429,"5min":1.427,"15min":1.403},"min":{"1min":1.1240000000000001,"5min":1.034,"15min":0.98099999999999998},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.863},"last":1.6439999999999999}]},{"osd":6,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.355,"15min":1.337},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.579,"5min":1.6899999999999999,"15min":1.6970000000000001},"last":1.8},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.2969999999999999,"15min":1.298},"min":{"1min":0.873,"5min":0.873,"15min":0.873},"max":{"1min":1.6910000000000001,"5min":1.778,"15min":1.8029999999999999},"last":1.319}]},{"osd":7,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.323,"15min":1.3320000000000001},"min":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":0.95699999999999996},"max":{"1min":1.6040000000000001,"5min":1.631,"15min":1.8029999999999999},"last":1.756},{"interface":"front","average":{"1min":1.395,"5min":1.421,"15min":1.411},"min":{"1min":1.1499999999999999,"5min":1.099,"15min":0.97599999999999998},"max":{"1min":1.647,"5min":1.8680000000000001,"15min":1.9590000000000001},"last":1.944}]}]},{"osd":1,"up_from":13,"seq":55834575122,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":729088,"data_stored":357478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.83699999999999997,"15min":0.85899999999999999},"min":{"1min":0.56399999999999995,"5min":0.47499999999999998,"15min":0.45200000000000001},"max":{"1min":0.97199999999999998,"5min":1.6020000000000001,"15min":1.6559999999999999},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.012,"5min":1.004,"15min":1.034},"min":{"1min":0.621,"5min":0.621,"15min":0.54800000000000004},"max":{"1min":1.603,"5min":1.603,"15min":1.9830000000000001},"last":0.84399999999999997}]},{"osd":2,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.90100000000000002,"15min":0.90700000000000003},"min":{"1min":0.60399999999999998,"5min":0.55700000000000005,"15min":0.436},"max":{"1min":1.52,"5min":1.52,"15min":1.7310000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.073,"15min":1.111},"min":{"1min":0.875,"5min":0.59799999999999998,"15min":0.505},"max":{"1min":1.4830000000000001,"5min":1.714,"15min":1.714},"last":0.79800000000000004}]},{"osd":3,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.161,"15min":1.204},"min":{"1min":0.83899999999999997,"5min":0.69199999999999995,"15min":0.57299999999999995},"max":{"1min":1.373,"5min":1.595,"15min":1.603},"last":1.157},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.96999999999999997,"15min":1},"min":{"1min":0.68300000000000005,"5min":0.59899999999999998,"15min":0.56799999999999995},"max":{"1min":1.4510000000000001,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.69999999999999996}]},{"osd":4,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.25,"15min":1.25},"min":{"1min":0.98599999999999999,"5min":0.81000000000000005,"15min":0.72199999999999998},"max":{"1min":1.476,"5min":1.9450000000000001,"15min":2.0470000000000002},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.1950000000000001,"15min":1.1970000000000001},"min":{"1min":0.94199999999999995,"5min":0.748,"15min":0.58499999999999996},"max":{"1min":1.6060000000000001,"5min":1.708,"15min":1.708},"last":1.2789999999999999}]},{"osd":5,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.2470000000000001,"15min":1.2410000000000001},"min":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.77300000000000002},"max":{"1min":1.452,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.0309999999999999},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3,"15min":1.3080000000000001},"min":{"1min":1.0149999999999999,"5min":0.872,"15min":0.86899999999999999},"max":{"1min":1.4930000000000001,"5min":1.6060000000000001,"15min":1.7170000000000001},"last":1.448}]},{"osd":6,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.298,"15min":1.302},"min":{"1min":1.0580000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.5449999999999999,"5min":1.726,"15min":2.1240000000000001},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.264,"5min":1.2749999999999999,"15min":1.3009999999999999},"min":{"1min":1.1000000000000001,"5min":0.94199999999999995,"15min":0.82599999999999996},"max":{"1min":1.518,"5min":1.917,"15min":1.917},"last":1.133}]},{"osd":7,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.3560000000000001,"15min":1.3580000000000001},"min":{"1min":1.0660000000000001,"5min":0.80700000000000005,"15min":0.79900000000000004},"max":{"1min":1.5649999999999999,"5min":1.77,"15min":1.77},"last":1.516},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.3520000000000001,"15min":1.363},"min":{"1min":1.147,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.6399999999999999,"5min":1.8240000000000001,"15min":2.3199999999999998},"last":1.3340000000000001}]}]},{"osd":0,"up_from":56,"seq":240518168728,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28980,"kb_used_data":1316,"kb_used_omap":12,"kb_used_meta":27635,"kb_avail":94342860,"statfs":{"total":96636764160,"available":96607088640,"internally_reserved":0,"allocated":1347584,"data_stored":961135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13003,"internal_metadata":28298549},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 18 12:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.90100000000000002,"15min":0.95499999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.454,"5min":1.454,"15min":1.5109999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0649999999999999,"15min":1.073},"min":{"1min":0.68799999999999994,"5min":0.62,"15min":0.52000000000000002},"max":{"1min":1.46,"5min":1.577,"15min":1.577},"last":0.68000000000000005}]},{"osd":2,"last update":"Wed Oct 18 12:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.93600000000000005,"15min":0.99299999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.60799999999999998},"max":{"1min":1.321,"5min":1.496,"15min":1.6659999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.105,"5min":1.04,"15min":1.03},"min":{"1min":0.80300000000000005,"5min":0.59099999999999997,"15min":0.48899999999999999},"max":{"1min":1.468,"5min":1.673,"15min":1.673},"last":0.84699999999999998}]},{"osd":3,"last update":"Wed Oct 18 12:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.92800000000000005,"15min":0.94799999999999995},"min":{"1min":0.65800000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.2589999999999999,"5min":1.466,"15min":1.6060000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1080000000000001,"15min":1.169},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.48,"5min":1.589,"15min":1.589},"last":0.79000000000000004}]},{"osd":4,"last update":"Wed Oct 18 12:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.222,"15min":1.242},"min":{"1min":0.98999999999999999,"5min":0.87,"15min":0.87},"max":{"1min":1.5429999999999999,"5min":1.615,"15min":1.722},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3169999999999999,"15min":1.3839999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.756,"5min":1.756,"15min":2.1299999999999999},"last":1.111}]},{"osd":5,"last update":"Wed Oct 18 12:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.345,"15min":1.3720000000000001},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.84399999999999997},"max":{"1min":1.625,"5min":1.625,"15min":2.0960000000000001},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.347,"5min":1.2809999999999999,"15min":1.331},"min":{"1min":1.103,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":2.0819999999999999,"5min":2.0819999999999999,"15min":2.0819999999999999},"last":0.99399999999999999}]},{"osd":6,"last update":"Wed Oct 18 12:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.351,"15min":1.431},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":2.2200000000000002},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.367,"15min":1.415},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.89700000000000002},"max":{"1min":1.9279999999999999,"5min":1.9690000000000001,"15min":2.0329999999999999},"last":1.008}]},{"osd":7,"last update":"Wed Oct 18 12:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.399,"15min":1.4650000000000001},"min":{"1min":1.087,"5min":1.0169999999999999,"15min":1.0169999999999999},"max":{"1min":2.141,"5min":2.141,"15min":2.169},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3260000000000001,"15min":1.403},"min":{"1min":1.091,"5min":0.96599999999999997,"15min":0.92100000000000004},"max":{"1min":1.857,"5min":1.857,"15min":2.081},"last":1.393}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-18T12:42:07.088 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-18T12:42:07.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.260+0000 7fb81f59e700 1 Processor -- start 2023-10-18T12:42:07.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.260+0000 7fb81f59e700 1 -- start start 2023-10-18T12:42:07.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.260+0000 7fb81f59e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb82006e550 0x7fb82006f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:07.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.260+0000 7fb81f59e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb8200cb5c0 0x7fb82006fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:07.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.260+0000 7fb81f59e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8200cada0 con 0x7fb8200cd1b0 2023-10-18T12:42:07.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.260+0000 7fb81f59e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb82006e9e0 con 0x7fb8200cb5c0 2023-10-18T12:42:07.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.260+0000 7fb81f59e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8200caac0 con 0x7fb82006e550 2023-10-18T12:42:07.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.264+0000 7fb81ed9d700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb8200cb5c0 0x7fb82006fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:07.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.264+0000 7fb81ed9d700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fb8200cb5c0 0x7fb82006fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:34098/0 (socket says 172.21.15.114:34098) 2023-10-18T12:42:07.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.264+0000 7fb81ed9d700 1 -- 172.21.15.114:0/1909417949 learned_addr learned my addr 172.21.15.114:0/1909417949 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:42:07.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.264+0000 7fb815d9b700 1 --2- 172.21.15.114:0/1909417949 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb82006e550 0x7fb82006f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:07.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.264+0000 7fb81ed9d700 1 -- 172.21.15.114:0/1909417949 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb82006e550 msgr2=0x7fb82006f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:42:07.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.264+0000 7fb81ed9d700 1 --2- 172.21.15.114:0/1909417949 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb82006e550 0x7fb82006f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:07.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.264+0000 7fb81ed9d700 1 -- 172.21.15.114:0/1909417949 >> v1:172.21.15.172:6789/0 conn(0x7fb8200cd1b0 legacy=0x7fb8200cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:07.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.264+0000 7fb81ed9d700 1 -- 172.21.15.114:0/1909417949 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8200ccc50 con 0x7fb8200cb5c0 2023-10-18T12:42:07.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.264+0000 7fb81ed9d700 1 --2- 172.21.15.114:0/1909417949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8200cb5c0 0x7fb82006fc30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb818009e50 tx=0x7fb81800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6042e0d40ca06e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:07.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.264+0000 7fb81dd9b700 1 -- 172.21.15.114:0/1909417949 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81800e070 con 0x7fb8200cb5c0 2023-10-18T12:42:07.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.264+0000 7fb81dd9b700 1 -- 172.21.15.114:0/1909417949 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb81800b910 con 0x7fb8200cb5c0 2023-10-18T12:42:07.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.264+0000 7fb81dd9b700 1 -- 172.21.15.114:0/1909417949 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81800bcc0 con 0x7fb8200cb5c0 2023-10-18T12:42:07.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.264+0000 7fb81f59e700 1 -- 172.21.15.114:0/1909417949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8200cb5c0 msgr2=0x7fb82006fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:07.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.264+0000 7fb81f59e700 1 --2- 172.21.15.114:0/1909417949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8200cb5c0 0x7fb82006fc30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb818009e50 tx=0x7fb81800b330 comp rx=0 tx=0).stop 2023-10-18T12:42:07.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.264+0000 7fb81f59e700 1 -- 172.21.15.114:0/1909417949 shutdown_connections 2023-10-18T12:42:07.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.264+0000 7fb81f59e700 1 --2- 172.21.15.114:0/1909417949 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb82006e550 0x7fb82006f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:07.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.264+0000 7fb81f59e700 1 --2- 172.21.15.114:0/1909417949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8200cb5c0 0x7fb82006fc30 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:07.275 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.264+0000 7fb81f59e700 1 -- 172.21.15.114:0/1909417949 >> 172.21.15.114:0/1909417949 conn(0x7fb8200cb9f0 msgr2=0x7fb8200cbe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:07.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.264+0000 7fb81f59e700 1 -- 172.21.15.114:0/1909417949 shutdown_connections 2023-10-18T12:42:07.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.264+0000 7fb81f59e700 1 -- 172.21.15.114:0/1909417949 wait complete. 2023-10-18T12:42:07.276 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.272+0000 7fb81f59e700 1 Processor -- start 2023-10-18T12:42:07.277 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.272+0000 7fb81f59e700 1 -- start start 2023-10-18T12:42:07.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.272+0000 7fb81f59e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8200cb5c0 0x7fb8201f22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:07.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.272+0000 7fb81f59e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8200cd1b0 0x7fb8201f51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:07.278 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.272+0000 7fb81f59e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb820158cf0 0x7fb8201591a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:07.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.272+0000 7fb81f59e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8201499e0 con 0x7fb8200cb5c0 2023-10-18T12:42:07.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.272+0000 7fb81f59e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8201596e0 con 0x7fb8200cd1b0 2023-10-18T12:42:07.279 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.272+0000 7fb81f59e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb820148d60 con 0x7fb820158cf0 2023-10-18T12:42:07.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.272+0000 7fb81e59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8200cb5c0 0x7fb8201f22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:07.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.272+0000 7fb81e59c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8200cb5c0 0x7fb8201f22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36832/0 (socket says 172.21.15.114:36832) 2023-10-18T12:42:07.281 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.272+0000 7fb81e59c700 1 -- 172.21.15.114:0/1629245656 learned_addr learned my addr 172.21.15.114:0/1629245656 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:42:07.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.272+0000 7fb815d9b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8200cd1b0 0x7fb8201f51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:07.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.272+0000 7fb81ed9d700 1 --2- 172.21.15.114:0/1629245656 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb820158cf0 0x7fb8201591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:07.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.272+0000 7fb81e59c700 1 -- 172.21.15.114:0/1629245656 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb820158cf0 msgr2=0x7fb8201591a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:07.282 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.272+0000 7fb81e59c700 1 --2- 172.21.15.114:0/1629245656 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb820158cf0 0x7fb8201591a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:07.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.272+0000 7fb81e59c700 1 -- 172.21.15.114:0/1629245656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8200cd1b0 msgr2=0x7fb8201f51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:07.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.272+0000 7fb81e59c700 1 --2- 172.21.15.114:0/1629245656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8200cd1b0 0x7fb8201f51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:07.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.272+0000 7fb81e59c700 1 -- 172.21.15.114:0/1629245656 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb818009b30 con 0x7fb8200cb5c0 2023-10-18T12:42:07.283 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.272+0000 7fb815d9b700 1 --2- 172.21.15.114:0/1629245656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8200cd1b0 0x7fb8201f51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:42:07.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.272+0000 7fb81e59c700 1 --2- 172.21.15.114:0/1629245656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8200cb5c0 0x7fb8201f22a0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fb81000c410 tx=0x7fb81000c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:07.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.272+0000 7fb8177fe700 1 -- 172.21.15.114:0/1629245656 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8100052d0 con 0x7fb8200cb5c0 2023-10-18T12:42:07.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.276+0000 7fb8177fe700 1 -- 172.21.15.114:0/1629245656 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb810005430 con 0x7fb8200cb5c0 2023-10-18T12:42:07.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.276+0000 7fb81f59e700 1 -- 172.21.15.114:0/1629245656 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb820149040 con 0x7fb8200cb5c0 2023-10-18T12:42:07.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.276+0000 7fb8177fe700 1 -- 172.21.15.114:0/1629245656 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8100055a0 con 0x7fb8200cb5c0 2023-10-18T12:42:07.285 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.276+0000 7fb81f59e700 1 -- 172.21.15.114:0/1629245656 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb820149600 con 0x7fb8200cb5c0 2023-10-18T12:42:07.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.276+0000 7fb81f59e700 1 -- 172.21.15.114:0/1629245656 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8201497c0 con 0x7fb8200cb5c0 2023-10-18T12:42:07.286 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.280+0000 7fb8177fe700 1 -- 172.21.15.114:0/1629245656 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fb8100036a0 con 0x7fb8200cb5c0 2023-10-18T12:42:07.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.280+0000 7fb8177fe700 1 --2- 172.21.15.114:0/1629245656 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb800065720 0x7fb800067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:07.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.280+0000 7fb8177fe700 1 -- 172.21.15.114:0/1629245656 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5659+0+0 (secure 0 0 0) 0x7fb810081d60 con 0x7fb8200cb5c0 2023-10-18T12:42:07.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.284+0000 7fb815d9b700 1 --2- 172.21.15.114:0/1629245656 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb800065720 0x7fb800067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:07.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.284+0000 7fb815d9b700 1 --2- 172.21.15.114:0/1629245656 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb800065720 0x7fb800067be0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb82006fac0 tx=0x7fb808009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:07.293 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.288+0000 7fb8177fe700 1 -- 172.21.15.114:0/1629245656 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fb81004f910 con 0x7fb8200cb5c0 2023-10-18T12:42:07.470 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.464+0000 7fb81f59e700 1 -- 172.21.15.114:0/1629245656 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb820072e60 con 0x7fb8200cb5c0 2023-10-18T12:42:07.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.464+0000 7fb8177fe700 1 -- 172.21.15.114:0/1629245656 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+15089 (secure 0 0 0) 0x7fb810052f30 con 0x7fb8200cb5c0 2023-10-18T12:42:07.473 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:42:07.473 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":63,"fsid":"240ea340-5d3d-4f52-a4bc-af075aca3deb","created":"2023-10-18T12:19:12.512994+0000","modified":"2023-10-18T12:42:02.516664+0000","last_up_change":"2023-10-18T12:29:29.654825+0000","last_in_change":"2023-10-18T12:19:15.850693+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-18T12:19:27.040638+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-18T12:19:32.358094+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c3578978-1a03-4857-b9d2-34a5da3d7731","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":49,"up_from":56,"up_thru":57,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":1953670272},{"type":"v1","addr":"172.21.15.114:6817","nonce":1953670272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":1953670272},{"type":"v1","addr":"172.21.15.114:6820","nonce":1953670272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6828","nonce":1953670272},{"type":"v1","addr":"172.21.15.114:6830","nonce":1953670272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6823","nonce":1953670272},{"type":"v1","addr":"172.21.15.114:6825","nonce":1953670272}]},"public_addr":"172.21.15.114:6817/1953670272","cluster_addr":"172.21.15.114:6820/1953670272","heartbeat_back_addr":"172.21.15.114:6830/1953670272","heartbeat_front_addr":"172.21.15.114:6825/1953670272","state":["exists","up"]},{"osd":1,"uuid":"43eb26a6-e2b3-4670-9559-bd053b5140d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6801","nonce":3302727047}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6803","nonce":3302727047}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6807","nonce":3302727047}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3302727047},{"type":"v1","addr":"172.21.15.114:6805","nonce":3302727047}]},"public_addr":"172.21.15.114:6801/3302727047","cluster_addr":"172.21.15.114:6803/3302727047","heartbeat_back_addr":"172.21.15.114:6807/3302727047","heartbeat_front_addr":"172.21.15.114:6805/3302727047","state":["exists","up"]},{"osd":2,"uuid":"f3d4dbd5-521c-4dd2-b687-5768cc7d0938","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6809","nonce":2699151351}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6811","nonce":2699151351}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6815","nonce":2699151351}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":2699151351},{"type":"v1","addr":"172.21.15.114:6813","nonce":2699151351}]},"public_addr":"172.21.15.114:6809/2699151351","cluster_addr":"172.21.15.114:6811/2699151351","heartbeat_back_addr":"172.21.15.114:6815/2699151351","heartbeat_front_addr":"172.21.15.114:6813/2699151351","state":["exists","up"]},{"osd":3,"uuid":"823e5802-92b7-4f0d-b32d-a5748993f1b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6821","nonce":1361608073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6824","nonce":1361608073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6829","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6831","nonce":1361608073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":1361608073},{"type":"v1","addr":"172.21.15.114:6827","nonce":1361608073}]},"public_addr":"172.21.15.114:6821/1361608073","cluster_addr":"172.21.15.114:6824/1361608073","heartbeat_back_addr":"172.21.15.114:6831/1361608073","heartbeat_front_addr":"172.21.15.114:6827/1361608073","state":["exists","up"]},{"osd":4,"uuid":"e47fb93e-13b4-44a4-b084-8c4384ceb41e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6801","nonce":930839681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6803","nonce":930839681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6807","nonce":930839681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":930839681},{"type":"v1","addr":"172.21.15.172:6805","nonce":930839681}]},"public_addr":"172.21.15.172:6801/930839681","cluster_addr":"172.21.15.172:6803/930839681","heartbeat_back_addr":"172.21.15.172:6807/930839681","heartbeat_front_addr":"172.21.15.172:6805/930839681","state":["exists","up"]},{"osd":5,"uuid":"7561a973-f479-45a0-af40-f324728d622e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6814","nonce":571761850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6818","nonce":571761850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6824","nonce":571761850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":571761850},{"type":"v1","addr":"172.21.15.172:6821","nonce":571761850}]},"public_addr":"172.21.15.172:6814/571761850","cluster_addr":"172.21.15.172:6818/571761850","heartbeat_back_addr":"172.21.15.172:6824/571761850","heartbeat_front_addr":"172.21.15.172:6821/571761850","state":["exists","up"]},{"osd":6,"uuid":"51753f4b-7f06-4f1c-9ec7-6e18a66eb980","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6823","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6825","nonce":1680398853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6827","nonce":1680398853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6831","nonce":1680398853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1680398853},{"type":"v1","addr":"172.21.15.172:6829","nonce":1680398853}]},"public_addr":"172.21.15.172:6825/1680398853","cluster_addr":"172.21.15.172:6827/1680398853","heartbeat_back_addr":"172.21.15.172:6831/1680398853","heartbeat_front_addr":"172.21.15.172:6829/1680398853","state":["exists","up"]},{"osd":7,"uuid":"4d8b1e15-143d-4d17-9074-59d92f0f9af8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6809","nonce":349710101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6811","nonce":349710101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6817","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6819","nonce":349710101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6813","nonce":349710101},{"type":"v1","addr":"172.21.15.172:6815","nonce":349710101}]},"public_addr":"172.21.15.172:6809/349710101","cluster_addr":"172.21.15.172:6811/349710101","heartbeat_back_addr":"172.21.15.172:6819/349710101","heartbeat_front_addr":"172.21.15.172:6815/349710101","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"2023-10-18T12:21:50.537022+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.889460+0000","dead_epoch":50},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.475494+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.911473+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.648596+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.609994+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.636248+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.854589+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-18T12:19:21.885826+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.114:6835/1284474820":"2023-10-19T12:41:59.496400+0000","172.21.15.114:6834/1284474820":"2023-10-19T12:41:59.496400+0000","172.21.15.114:0/1817588655":"2023-10-18T13:29:19.822093+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-18T12:42:07.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.472+0000 7fb81f59e700 1 -- 172.21.15.114:0/1629245656 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb800065720 msgr2=0x7fb800067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:07.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.472+0000 7fb81f59e700 1 --2- 172.21.15.114:0/1629245656 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb800065720 0x7fb800067be0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb82006fac0 tx=0x7fb808009240 comp rx=0 tx=0).stop 2023-10-18T12:42:07.477 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.472+0000 7fb81f59e700 1 -- 172.21.15.114:0/1629245656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8200cb5c0 msgr2=0x7fb8201f22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:07.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.472+0000 7fb81f59e700 1 --2- 172.21.15.114:0/1629245656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8200cb5c0 0x7fb8201f22a0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fb81000c410 tx=0x7fb81000c720 comp rx=0 tx=0).stop 2023-10-18T12:42:07.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.472+0000 7fb81f59e700 1 -- 172.21.15.114:0/1629245656 shutdown_connections 2023-10-18T12:42:07.478 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.472+0000 7fb81f59e700 1 --2- 172.21.15.114:0/1629245656 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fb800065720 0x7fb800067be0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:07.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.472+0000 7fb81f59e700 1 --2- 172.21.15.114:0/1629245656 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fb820158cf0 0x7fb8201591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:07.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.472+0000 7fb81f59e700 1 --2- 172.21.15.114:0/1629245656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8200cd1b0 0x7fb8201f51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:07.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.472+0000 7fb81f59e700 1 --2- 172.21.15.114:0/1629245656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb8200cb5c0 0x7fb8201f22a0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:07.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.472+0000 7fb81f59e700 1 -- 172.21.15.114:0/1629245656 >> 172.21.15.114:0/1629245656 conn(0x7fb8200cb9f0 msgr2=0x7fb820157210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:07.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.472+0000 7fb81f59e700 1 -- 172.21.15.114:0/1629245656 shutdown_connections 2023-10-18T12:42:07.481 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:07.472+0000 7fb81f59e700 1 -- 172.21.15.114:0/1629245656 wait complete. 2023-10-18T12:42:08.499 INFO:tasks.ceph:Scrubbing osd.0 2023-10-18T12:42:08.500 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-18T12:42:08.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.676+0000 7fa0ebfff700 1 Processor -- start 2023-10-18T12:42:08.684 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.676+0000 7fa0ebfff700 1 -- start start 2023-10-18T12:42:08.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.680+0000 7fa0ebfff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa0ec1467a0 0x7fa0ec0b5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:08.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.680+0000 7fa0ebfff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa0ec0cf490 0x7fa0ec06fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:08.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.680+0000 7fa0ebfff700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0ec06f5f0 con 0x7fa0ec0b5560 2023-10-18T12:42:08.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.680+0000 7fa0ebfff700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0ec0cf9f0 con 0x7fa0ec1467a0 2023-10-18T12:42:08.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.680+0000 7fa0ebfff700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ec0d2200 con 0x7fa0ec0cf490 2023-10-18T12:42:08.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.680+0000 7fa0ea7fc700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fa0ec0b5560 0x7fa0ec0ced80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50790/0 (socket says 172.21.15.114:50790) 2023-10-18T12:42:08.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.680+0000 7fa0ea7fc700 1 -- 172.21.15.114:0/809039702 learned_addr learned my addr 172.21.15.114:0/809039702 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:42:08.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.680+0000 7fa0eaffd700 1 --2- 172.21.15.114:0/809039702 >> v2:172.21.15.114:3300/0 conn(0x7fa0ec1467a0 0x7fa0ec0b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:08.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.684+0000 7fa0eb7fe700 1 --2- 172.21.15.114:0/809039702 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa0ec0cf490 0x7fa0ec06fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:08.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.684+0000 7fa0e9ffb700 1 -- 172.21.15.114:0/809039702 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1834447316 0 0) 0x7fa0ec06f5f0 con 0x7fa0ec0b5560 2023-10-18T12:42:08.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.684+0000 7fa0e9ffb700 1 -- 172.21.15.114:0/809039702 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0d40035d0 con 0x7fa0ec0b5560 2023-10-18T12:42:08.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.684+0000 7fa0eaffd700 1 -- 172.21.15.114:0/809039702 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa0ec0cf490 msgr2=0x7fa0ec06fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:42:08.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.684+0000 7fa0eaffd700 1 --2- 172.21.15.114:0/809039702 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa0ec0cf490 0x7fa0ec06fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:08.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.684+0000 7fa0eaffd700 1 -- 172.21.15.114:0/809039702 >> v1:172.21.15.114:6789/0 conn(0x7fa0ec0b5560 legacy=0x7fa0ec0ced80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:08.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.684+0000 7fa0eaffd700 1 -- 172.21.15.114:0/809039702 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0ec0d1960 con 0x7fa0ec1467a0 2023-10-18T12:42:08.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.684+0000 7fa0eb7fe700 1 --2- 172.21.15.114:0/809039702 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa0ec0cf490 0x7fa0ec06fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:42:08.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.684+0000 7fa0eaffd700 1 --2- 172.21.15.114:0/809039702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0ec1467a0 0x7fa0ec0b5020 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc009850 tx=0x7fa0dc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cb9c7c45eedab6b server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:08.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.684+0000 7fa0e9ffb700 1 -- 172.21.15.114:0/809039702 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc011830 con 0x7fa0ec1467a0 2023-10-18T12:42:08.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.684+0000 7fa0e9ffb700 1 -- 172.21.15.114:0/809039702 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0dc011990 con 0x7fa0ec1467a0 2023-10-18T12:42:08.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.684+0000 7fa0e9ffb700 1 -- 172.21.15.114:0/809039702 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc011d40 con 0x7fa0ec1467a0 2023-10-18T12:42:08.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.684+0000 7fa0ebfff700 1 -- 172.21.15.114:0/809039702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0ec1467a0 msgr2=0x7fa0ec0b5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:08.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.684+0000 7fa0ebfff700 1 --2- 172.21.15.114:0/809039702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0ec1467a0 0x7fa0ec0b5020 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc009850 tx=0x7fa0dc009b60 comp rx=0 tx=0).stop 2023-10-18T12:42:08.696 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.684+0000 7fa0ebfff700 1 -- 172.21.15.114:0/809039702 shutdown_connections 2023-10-18T12:42:08.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.684+0000 7fa0ebfff700 1 --2- 172.21.15.114:0/809039702 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa0ec0cf490 0x7fa0ec06fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:08.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.684+0000 7fa0ebfff700 1 --2- 172.21.15.114:0/809039702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0ec1467a0 0x7fa0ec0b5020 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:08.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.684+0000 7fa0ebfff700 1 -- 172.21.15.114:0/809039702 >> 172.21.15.114:0/809039702 conn(0x7fa0ec06ce90 msgr2=0x7fa0ec0b7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:08.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.684+0000 7fa0ebfff700 1 -- 172.21.15.114:0/809039702 shutdown_connections 2023-10-18T12:42:08.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.684+0000 7fa0ebfff700 1 -- 172.21.15.114:0/809039702 wait complete. 2023-10-18T12:42:08.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.688+0000 7fa0ebfff700 1 Processor -- start 2023-10-18T12:42:08.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.688+0000 7fa0ebfff700 1 -- start start 2023-10-18T12:42:08.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.688+0000 7fa0ebfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0ec0b5560 0x7fa0ec15c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:08.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.688+0000 7fa0ebfff700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0ec0cf490 0x7fa0ec144dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:08.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.688+0000 7fa0ebfff700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa0ec1467a0 0x7fa0ec0aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:08.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.688+0000 7fa0ebfff700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ec15cc20 con 0x7fa0ec0b5560 2023-10-18T12:42:08.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.688+0000 7fa0ebfff700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ec0ac240 con 0x7fa0ec0cf490 2023-10-18T12:42:08.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.688+0000 7fa0ebfff700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ec0ad0a0 con 0x7fa0ec1467a0 2023-10-18T12:42:08.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.688+0000 7fa0eaffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0ec0b5560 0x7fa0ec15c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:08.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.688+0000 7fa0eaffd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0ec0b5560 0x7fa0ec15c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36848/0 (socket says 172.21.15.114:36848) 2023-10-18T12:42:08.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.688+0000 7fa0eaffd700 1 -- 172.21.15.114:0/1879938281 learned_addr learned my addr 172.21.15.114:0/1879938281 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:42:08.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.688+0000 7fa0eb7fe700 1 --2- 172.21.15.114:0/1879938281 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa0ec1467a0 0x7fa0ec0aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:08.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.688+0000 7fa0ea7fc700 1 --2- 172.21.15.114:0/1879938281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0ec0cf490 0x7fa0ec144dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:08.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.692+0000 7fa0eaffd700 1 -- 172.21.15.114:0/1879938281 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa0ec1467a0 msgr2=0x7fa0ec0aeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:08.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.692+0000 7fa0eaffd700 1 --2- 172.21.15.114:0/1879938281 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa0ec1467a0 0x7fa0ec0aeba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:08.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.692+0000 7fa0eaffd700 1 -- 172.21.15.114:0/1879938281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0ec0cf490 msgr2=0x7fa0ec144dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:08.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.692+0000 7fa0eaffd700 1 --2- 172.21.15.114:0/1879938281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0ec0cf490 0x7fa0ec144dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:08.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.692+0000 7fa0eaffd700 1 -- 172.21.15.114:0/1879938281 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0dc0094b0 con 0x7fa0ec0b5560 2023-10-18T12:42:08.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.692+0000 7fa0eaffd700 1 --2- 172.21.15.114:0/1879938281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0ec0b5560 0x7fa0ec15c6e0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec066f00 tx=0x7fa0dc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:08.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.692+0000 7fa0d3fff700 1 -- 172.21.15.114:0/1879938281 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc004400 con 0x7fa0ec0b5560 2023-10-18T12:42:08.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.692+0000 7fa0d3fff700 1 -- 172.21.15.114:0/1879938281 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0dc01f070 con 0x7fa0ec0b5560 2023-10-18T12:42:08.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.692+0000 7fa0ebfff700 1 -- 172.21.15.114:0/1879938281 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0ec141df0 con 0x7fa0ec0b5560 2023-10-18T12:42:08.706 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.692+0000 7fa0d3fff700 1 -- 172.21.15.114:0/1879938281 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc003900 con 0x7fa0ec0b5560 2023-10-18T12:42:08.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.692+0000 7fa0ebfff700 1 -- 172.21.15.114:0/1879938281 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0ec0ac770 con 0x7fa0ec0b5560 2023-10-18T12:42:08.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.692+0000 7fa0ebfff700 1 -- 172.21.15.114:0/1879938281 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa0ec0d1f20 con 0x7fa0ec0b5560 2023-10-18T12:42:08.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.696+0000 7fa0d3fff700 1 -- 172.21.15.114:0/1879938281 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fa0dc021030 con 0x7fa0ec0b5560 2023-10-18T12:42:08.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.696+0000 7fa0d3fff700 1 --2- 172.21.15.114:0/1879938281 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa0d80656f0 0x7fa0d8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:08.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.696+0000 7fa0d3fff700 1 -- 172.21.15.114:0/1879938281 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5659+0+0 (secure 0 0 0) 0x7fa0dc084560 con 0x7fa0ec0b5560 2023-10-18T12:42:08.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.696+0000 7fa0d3fff700 1 --2- 172.21.15.114:0/1879938281 >> [v2:172.21.15.114:6816/1953670272,v1:172.21.15.114:6817/1953670272] conn(0x7fa0d806c060 0x7fa0d806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:08.708 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.696+0000 7fa0d3fff700 1 -- 172.21.15.114:0/1879938281 --> [v2:172.21.15.114:6816/1953670272,v1:172.21.15.114:6817/1953670272] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa0d806eb70 con 0x7fa0d806c060 2023-10-18T12:42:08.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.696+0000 7fa0d3fff700 1 -- 172.21.15.114:0/1879938281 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa0dc0848d0 con 0x7fa0ec0b5560 2023-10-18T12:42:08.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.696+0000 7fa0ea7fc700 1 --2- 172.21.15.114:0/1879938281 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa0d80656f0 0x7fa0d8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:08.709 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.696+0000 7fa0eb7fe700 1 --2- 172.21.15.114:0/1879938281 >> [v2:172.21.15.114:6816/1953670272,v1:172.21.15.114:6817/1953670272] conn(0x7fa0d806c060 0x7fa0d806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:08.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.696+0000 7fa0eb7fe700 1 --2- 172.21.15.114:0/1879938281 >> [v2:172.21.15.114:6816/1953670272,v1:172.21.15.114:6817/1953670272] conn(0x7fa0d806c060 0x7fa0d806e4a0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:08.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.696+0000 7fa0ea7fc700 1 --2- 172.21.15.114:0/1879938281 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa0d80656f0 0x7fa0d8067bb0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec1f51a0 tx=0x7fa0e0007de0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:08.710 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.700+0000 7fa0d3fff700 1 -- 172.21.15.114:0/1879938281 <== osd.0 v2:172.21.15.114:6816/1953670272 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fa0d806eb70 con 0x7fa0d806c060 2023-10-18T12:42:08.726 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.720+0000 7fa0ebfff700 1 -- 172.21.15.114:0/1879938281 --> [v2:172.21.15.114:6816/1953670272,v1:172.21.15.114:6817/1953670272] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa0ec0d1c40 con 0x7fa0d806c060 2023-10-18T12:42:08.727 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.720+0000 7fa0d3fff700 1 -- 172.21.15.114:0/1879938281 <== osd.0 v2:172.21.15.114:6816/1953670272 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7fa0e400f040 con 0x7fa0d806c060 2023-10-18T12:42:08.728 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T12:42:08.728 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-10-18T12:42:08.728 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T12:42:08.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.724+0000 7fa0ebfff700 1 -- 172.21.15.114:0/1879938281 >> [v2:172.21.15.114:6816/1953670272,v1:172.21.15.114:6817/1953670272] conn(0x7fa0d806c060 msgr2=0x7fa0d806e4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:08.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.724+0000 7fa0ebfff700 1 --2- 172.21.15.114:0/1879938281 >> [v2:172.21.15.114:6816/1953670272,v1:172.21.15.114:6817/1953670272] conn(0x7fa0d806c060 0x7fa0d806e4a0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:08.730 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.724+0000 7fa0ebfff700 1 -- 172.21.15.114:0/1879938281 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa0d80656f0 msgr2=0x7fa0d8067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:08.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.724+0000 7fa0ebfff700 1 --2- 172.21.15.114:0/1879938281 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa0d80656f0 0x7fa0d8067bb0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec1f51a0 tx=0x7fa0e0007de0 comp rx=0 tx=0).stop 2023-10-18T12:42:08.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.724+0000 7fa0ebfff700 1 -- 172.21.15.114:0/1879938281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0ec0b5560 msgr2=0x7fa0ec15c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:08.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.724+0000 7fa0ebfff700 1 --2- 172.21.15.114:0/1879938281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0ec0b5560 0x7fa0ec15c6e0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec066f00 tx=0x7fa0dc004770 comp rx=0 tx=0).stop 2023-10-18T12:42:08.731 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.724+0000 7fa0eb7fe700 1 -- 172.21.15.114:0/1879938281 reap_dead start 2023-10-18T12:42:08.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.724+0000 7fa0ebfff700 1 -- 172.21.15.114:0/1879938281 shutdown_connections 2023-10-18T12:42:08.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.724+0000 7fa0ebfff700 1 -- 172.21.15.114:0/1879938281 >> 172.21.15.114:0/1879938281 conn(0x7fa0ec06ce90 msgr2=0x7fa0ec15f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:08.732 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.724+0000 7fa0ebfff700 1 -- 172.21.15.114:0/1879938281 shutdown_connections 2023-10-18T12:42:08.733 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.724+0000 7fa0ebfff700 1 -- 172.21.15.114:0/1879938281 wait complete. 2023-10-18T12:42:08.750 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-18T12:42:08.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.916+0000 7f5bc61ca700 1 Processor -- start 2023-10-18T12:42:08.925 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.920+0000 7f5bc61ca700 1 -- start start 2023-10-18T12:42:08.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.920+0000 7f5bc61ca700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5bc0144150 0x7f5bc00cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:08.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.920+0000 7f5bc61ca700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f5bc00ce1a0 0x7f5bc00cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:08.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.920+0000 7f5bc61ca700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5bc00cbde0 0x7f5bc015e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:08.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.920+0000 7f5bc61ca700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bc00cc290 con 0x7f5bc0144150 2023-10-18T12:42:08.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.920+0000 7f5bc61ca700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bc0070de0 con 0x7f5bc00ce1a0 2023-10-18T12:42:08.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.920+0000 7f5bc61ca700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc00701d0 con 0x7f5bc00cbde0 2023-10-18T12:42:08.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.920+0000 7f5bc51c8700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5bc0144150 0x7f5bc00cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:08.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.920+0000 7f5bc51c8700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f5bc0144150 0x7f5bc00cdc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36850/0 (socket says 172.21.15.114:36850) 2023-10-18T12:42:08.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.920+0000 7f5bc51c8700 1 -- 172.21.15.114:0/2170006478 learned_addr learned my addr 172.21.15.114:0/2170006478 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:42:08.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.920+0000 7f5bc49c7700 1 --2- 172.21.15.114:0/2170006478 >> v2:172.21.15.172:3300/0 conn(0x7f5bc00ce1a0 0x7f5bc00cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:08.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.920+0000 7f5bc59c9700 1 --2- 172.21.15.114:0/2170006478 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5bc00cbde0 0x7f5bc015e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:08.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.920+0000 7f5bc51c8700 1 -- 172.21.15.114:0/2170006478 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5bc00cbde0 msgr2=0x7f5bc015e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:42:08.931 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.920+0000 7f5bc51c8700 1 --2- 172.21.15.114:0/2170006478 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5bc00cbde0 0x7f5bc015e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:08.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.920+0000 7f5bc51c8700 1 -- 172.21.15.114:0/2170006478 >> v2:172.21.15.172:3300/0 conn(0x7f5bc00ce1a0 msgr2=0x7f5bc00cb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:42:08.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.920+0000 7f5bc51c8700 1 --2- 172.21.15.114:0/2170006478 >> v2:172.21.15.172:3300/0 conn(0x7f5bc00ce1a0 0x7f5bc00cb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:08.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.920+0000 7f5bc51c8700 1 -- 172.21.15.114:0/2170006478 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc00704b0 con 0x7f5bc0144150 2023-10-18T12:42:08.932 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.920+0000 7f5bc59c9700 1 --2- 172.21.15.114:0/2170006478 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5bc00cbde0 0x7f5bc015e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:42:08.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.920+0000 7f5bc49c7700 1 --2- 172.21.15.114:0/2170006478 >> v2:172.21.15.172:3300/0 conn(0x7f5bc00ce1a0 0x7f5bc00cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:42:08.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.920+0000 7f5bc51c8700 1 --2- 172.21.15.114:0/2170006478 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bc0144150 0x7f5bc00cdc60 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f5bc006adb0 tx=0x7f5bbc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbc4774f4fdbffde server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:08.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.920+0000 7f5bb7fff700 1 -- 172.21.15.114:0/2170006478 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc00e070 con 0x7f5bc0144150 2023-10-18T12:42:08.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.924+0000 7f5bb7fff700 1 -- 172.21.15.114:0/2170006478 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bbc00b9c0 con 0x7f5bc0144150 2023-10-18T12:42:08.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.924+0000 7f5bb7fff700 1 -- 172.21.15.114:0/2170006478 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc00bd70 con 0x7f5bc0144150 2023-10-18T12:42:08.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.924+0000 7f5bc61ca700 1 -- 172.21.15.114:0/2170006478 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bc0144150 msgr2=0x7f5bc00cdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:08.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.924+0000 7f5bc61ca700 1 --2- 172.21.15.114:0/2170006478 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bc0144150 0x7f5bc00cdc60 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f5bc006adb0 tx=0x7f5bbc00b330 comp rx=0 tx=0).stop 2023-10-18T12:42:08.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.924+0000 7f5bc61ca700 1 -- 172.21.15.114:0/2170006478 shutdown_connections 2023-10-18T12:42:08.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.924+0000 7f5bc61ca700 1 --2- 172.21.15.114:0/2170006478 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5bc00cbde0 0x7f5bc015e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:08.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.924+0000 7f5bc61ca700 1 --2- 172.21.15.114:0/2170006478 >> v2:172.21.15.172:3300/0 conn(0x7f5bc00ce1a0 0x7f5bc00cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:08.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.924+0000 7f5bc61ca700 1 --2- 172.21.15.114:0/2170006478 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bc0144150 0x7f5bc00cdc60 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:08.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.924+0000 7f5bc61ca700 1 -- 172.21.15.114:0/2170006478 >> 172.21.15.114:0/2170006478 conn(0x7f5bc00b0bf0 msgr2=0x7f5bc00ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:08.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.924+0000 7f5bc61ca700 1 -- 172.21.15.114:0/2170006478 shutdown_connections 2023-10-18T12:42:08.936 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.924+0000 7f5bc61ca700 1 -- 172.21.15.114:0/2170006478 wait complete. 2023-10-18T12:42:08.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.928+0000 7f5bc61ca700 1 Processor -- start 2023-10-18T12:42:08.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.928+0000 7f5bc61ca700 1 -- start start 2023-10-18T12:42:08.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.928+0000 7f5bc61ca700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bc00cbde0 0x7f5bc01f3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:08.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.928+0000 7f5bc61ca700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5bc00ce1a0 0x7f5bc013de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:08.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.928+0000 7f5bc61ca700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bc0144150 0x7f5bc015e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:08.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.928+0000 7f5bc61ca700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc01f4200 con 0x7f5bc0144150 2023-10-18T12:42:08.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.928+0000 7f5bc61ca700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc01f0c50 con 0x7f5bc00cbde0 2023-10-18T12:42:08.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.928+0000 7f5bc61ca700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc01f00d0 con 0x7f5bc00ce1a0 2023-10-18T12:42:08.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.928+0000 7f5bc59c9700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bc0144150 0x7f5bc015e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:08.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.928+0000 7f5bc59c9700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bc0144150 0x7f5bc015e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36854/0 (socket says 172.21.15.114:36854) 2023-10-18T12:42:08.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.928+0000 7f5bc59c9700 1 -- 172.21.15.114:0/994904776 learned_addr learned my addr 172.21.15.114:0/994904776 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:42:08.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.928+0000 7f5bc51c8700 1 --2- 172.21.15.114:0/994904776 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bc00cbde0 0x7f5bc01f3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:08.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.928+0000 7f5bc49c7700 1 --2- 172.21.15.114:0/994904776 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5bc00ce1a0 0x7f5bc013de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:08.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.928+0000 7f5bc59c9700 1 -- 172.21.15.114:0/994904776 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5bc00ce1a0 msgr2=0x7f5bc013de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:08.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.928+0000 7f5bc59c9700 1 --2- 172.21.15.114:0/994904776 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5bc00ce1a0 0x7f5bc013de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:08.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.928+0000 7f5bc59c9700 1 -- 172.21.15.114:0/994904776 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bc00cbde0 msgr2=0x7f5bc01f3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:08.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.928+0000 7f5bc59c9700 1 --2- 172.21.15.114:0/994904776 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bc00cbde0 0x7f5bc01f3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:08.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.928+0000 7f5bc59c9700 1 -- 172.21.15.114:0/994904776 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bbc009b30 con 0x7f5bc0144150 2023-10-18T12:42:08.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.928+0000 7f5bc59c9700 1 --2- 172.21.15.114:0/994904776 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bc0144150 0x7f5bc015e420 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f5bb800c7f0 tx=0x7f5bb800cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:08.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.928+0000 7f5bb5ffb700 1 -- 172.21.15.114:0/994904776 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb8011800 con 0x7f5bc0144150 2023-10-18T12:42:08.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.928+0000 7f5bb5ffb700 1 -- 172.21.15.114:0/994904776 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb8011980 con 0x7f5bc0144150 2023-10-18T12:42:08.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.932+0000 7f5bc61ca700 1 -- 172.21.15.114:0/994904776 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bc01f03b0 con 0x7f5bc0144150 2023-10-18T12:42:08.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.932+0000 7f5bb5ffb700 1 -- 172.21.15.114:0/994904776 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb8011d30 con 0x7f5bc0144150 2023-10-18T12:42:08.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.932+0000 7f5bc61ca700 1 -- 172.21.15.114:0/994904776 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bc01f0970 con 0x7f5bc0144150 2023-10-18T12:42:08.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.932+0000 7f5bc61ca700 1 -- 172.21.15.114:0/994904776 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bc0072e60 con 0x7f5bc0144150 2023-10-18T12:42:08.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.932+0000 7f5bb5ffb700 1 -- 172.21.15.114:0/994904776 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f5bb8022350 con 0x7f5bc0144150 2023-10-18T12:42:08.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.932+0000 7f5bb5ffb700 1 --2- 172.21.15.114:0/994904776 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5ba40656f0 0x7f5ba4067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:08.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.936+0000 7f5bb5ffb700 1 -- 172.21.15.114:0/994904776 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5659+0+0 (secure 0 0 0) 0x7f5bb8082ac0 con 0x7f5bc0144150 2023-10-18T12:42:08.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.936+0000 7f5bc51c8700 1 --2- 172.21.15.114:0/994904776 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5ba40656f0 0x7f5ba4067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:08.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.936+0000 7f5bc51c8700 1 --2- 172.21.15.114:0/994904776 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5ba40656f0 0x7f5ba4067bb0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc000f80 tx=0x7f5bbc009000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:08.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:08.940+0000 7f5bb5ffb700 1 -- 172.21.15.114:0/994904776 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f5bb8050700 con 0x7f5bc0144150 2023-10-18T12:42:09.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.224+0000 7f5bc61ca700 1 -- 172.21.15.114:0/994904776 --> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f5bc0070a70 con 0x7f5ba40656f0 2023-10-18T12:42:09.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.224+0000 7f5bb5ffb700 1 -- 172.21.15.114:0/994904776 <== mgr.4108 v2:172.21.15.172:6832/461408666 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5bbc003a40 con 0x7f5ba40656f0 2023-10-18T12:42:09.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.228+0000 7f5bc61ca700 1 -- 172.21.15.114:0/994904776 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5ba40656f0 msgr2=0x7f5ba4067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:09.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.228+0000 7f5bc61ca700 1 --2- 172.21.15.114:0/994904776 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5ba40656f0 0x7f5ba4067bb0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc000f80 tx=0x7f5bbc009000 comp rx=0 tx=0).stop 2023-10-18T12:42:09.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.228+0000 7f5bc61ca700 1 -- 172.21.15.114:0/994904776 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bc0144150 msgr2=0x7f5bc015e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:09.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.228+0000 7f5bc61ca700 1 --2- 172.21.15.114:0/994904776 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bc0144150 0x7f5bc015e420 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f5bb800c7f0 tx=0x7f5bb800cb00 comp rx=0 tx=0).stop 2023-10-18T12:42:09.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.228+0000 7f5bc61ca700 1 -- 172.21.15.114:0/994904776 shutdown_connections 2023-10-18T12:42:09.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.228+0000 7f5bc61ca700 1 --2- 172.21.15.114:0/994904776 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f5ba40656f0 0x7f5ba4067bb0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:09.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.228+0000 7f5bc61ca700 1 --2- 172.21.15.114:0/994904776 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f5bc00ce1a0 0x7f5bc013de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:09.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.228+0000 7f5bc61ca700 1 --2- 172.21.15.114:0/994904776 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bc0144150 0x7f5bc015e420 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:09.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.228+0000 7f5bc61ca700 1 --2- 172.21.15.114:0/994904776 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5bc00cbde0 0x7f5bc01f3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:09.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.228+0000 7f5bc61ca700 1 -- 172.21.15.114:0/994904776 >> 172.21.15.114:0/994904776 conn(0x7f5bc00b0bf0 msgr2=0x7f5bc00cb580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:09.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.228+0000 7f5bc61ca700 1 -- 172.21.15.114:0/994904776 shutdown_connections 2023-10-18T12:42:09.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.228+0000 7f5bc61ca700 1 -- 172.21.15.114:0/994904776 wait complete. 2023-10-18T12:42:09.239 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 0 to deep-scrub 2023-10-18T12:42:09.258 INFO:tasks.ceph:Scrubbing osd.1 2023-10-18T12:42:09.258 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-18T12:42:09.439 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.432+0000 7f9bc6f70700 1 Processor -- start 2023-10-18T12:42:09.440 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.432+0000 7f9bc6f70700 1 -- start start 2023-10-18T12:42:09.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.436+0000 7f9bc6f70700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bc01467a0 0x7f9bc00b5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:09.443 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.436+0000 7f9bc6f70700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bc006f5f0 con 0x7f9bc00cf490 2023-10-18T12:42:09.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.436+0000 7f9bc6f70700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bc00d1960 con 0x7f9bc00b5560 2023-10-18T12:42:09.444 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.436+0000 7f9bc6f70700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc00cf9f0 con 0x7f9bc01467a0 2023-10-18T12:42:09.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.436+0000 7f9bc676f700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f9bc00cf490 0x7f9bc006fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50806/0 (socket says 172.21.15.114:50806) 2023-10-18T12:42:09.445 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.436+0000 7f9bc676f700 1 -- 172.21.15.114:0/2036418508 learned_addr learned my addr 172.21.15.114:0/2036418508 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:42:09.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.436+0000 7f9bc5f6e700 1 --2- 172.21.15.114:0/2036418508 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bc01467a0 0x7f9bc00b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:09.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.440+0000 7f9bc5f6e700 1 -- 172.21.15.114:0/2036418508 >> v1:172.21.15.172:6789/0 conn(0x7f9bc00b5560 legacy=0x7f9bc00ced80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:09.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.440+0000 7f9bc5f6e700 1 -- 172.21.15.114:0/2036418508 >> v1:172.21.15.114:6789/0 conn(0x7f9bc00cf490 legacy=0x7f9bc006fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:09.446 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.440+0000 7f9bc5f6e700 1 -- 172.21.15.114:0/2036418508 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc00d1c40 con 0x7f9bc01467a0 2023-10-18T12:42:09.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.440+0000 7f9bc4f6c700 1 -- 172.21.15.114:0/2036418508 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 426435788 0 0) 0x7f9bc006f5f0 con 0x7f9bc00cf490 2023-10-18T12:42:09.447 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.440+0000 7f9bc5f6e700 1 --2- 172.21.15.114:0/2036418508 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bc01467a0 0x7f9bc00b5020 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc009880 tx=0x7f9bbc009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1aee18b79f7d834 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:09.448 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.440+0000 7f9bc4f6c700 1 -- 172.21.15.114:0/2036418508 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc011830 con 0x7f9bc01467a0 2023-10-18T12:42:09.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.440+0000 7f9bc4f6c700 1 -- 172.21.15.114:0/2036418508 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bbc011990 con 0x7f9bc01467a0 2023-10-18T12:42:09.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.440+0000 7f9bc4f6c700 1 -- 172.21.15.114:0/2036418508 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc011d20 con 0x7f9bc01467a0 2023-10-18T12:42:09.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.440+0000 7f9bc6f70700 1 -- 172.21.15.114:0/2036418508 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bc01467a0 msgr2=0x7f9bc00b5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:09.449 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.440+0000 7f9bc6f70700 1 --2- 172.21.15.114:0/2036418508 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bc01467a0 0x7f9bc00b5020 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc009880 tx=0x7f9bbc009b90 comp rx=0 tx=0).stop 2023-10-18T12:42:09.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.440+0000 7f9bc6f70700 1 -- 172.21.15.114:0/2036418508 shutdown_connections 2023-10-18T12:42:09.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.440+0000 7f9bc6f70700 1 --2- 172.21.15.114:0/2036418508 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bc01467a0 0x7f9bc00b5020 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:09.450 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.440+0000 7f9bc6f70700 1 -- 172.21.15.114:0/2036418508 >> 172.21.15.114:0/2036418508 conn(0x7f9bc006ce90 msgr2=0x7f9bc00b7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:09.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.440+0000 7f9bc6f70700 1 -- 172.21.15.114:0/2036418508 shutdown_connections 2023-10-18T12:42:09.451 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.440+0000 7f9bc6f70700 1 -- 172.21.15.114:0/2036418508 wait complete. 2023-10-18T12:42:09.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.444+0000 7f9bc6f70700 1 Processor -- start 2023-10-18T12:42:09.452 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.444+0000 7f9bc6f70700 1 -- start start 2023-10-18T12:42:09.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.448+0000 7f9bc6f70700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bc00b5560 0x7f9bc01f1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:09.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.448+0000 7f9bc6f70700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bc00cf490 0x7f9bc014f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:09.453 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.448+0000 7f9bc6f70700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bc01467a0 0x7f9bc0144100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:09.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.448+0000 7f9bc6f70700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc014ff10 con 0x7f9bc00b5560 2023-10-18T12:42:09.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.448+0000 7f9bc6f70700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc014f950 con 0x7f9bc00cf490 2023-10-18T12:42:09.454 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.448+0000 7f9bc6f70700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc014fc30 con 0x7f9bc01467a0 2023-10-18T12:42:09.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.448+0000 7f9bc5f6e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bc00b5560 0x7f9bc01f1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:09.456 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.448+0000 7f9bc5f6e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bc00b5560 0x7f9bc01f1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36864/0 (socket says 172.21.15.114:36864) 2023-10-18T12:42:09.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.448+0000 7f9bc5f6e700 1 -- 172.21.15.114:0/2132023406 learned_addr learned my addr 172.21.15.114:0/2132023406 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:42:09.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.448+0000 7f9bc576d700 1 --2- 172.21.15.114:0/2132023406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bc00cf490 0x7f9bc014f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:09.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.448+0000 7f9bc676f700 1 --2- 172.21.15.114:0/2132023406 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bc01467a0 0x7f9bc0144100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:09.457 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.448+0000 7f9bc5f6e700 1 -- 172.21.15.114:0/2132023406 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bc01467a0 msgr2=0x7f9bc0144100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:09.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.448+0000 7f9bc5f6e700 1 --2- 172.21.15.114:0/2132023406 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f9bc01467a0 0x7f9bc0144100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:09.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.448+0000 7f9bc5f6e700 1 -- 172.21.15.114:0/2132023406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bc00cf490 msgr2=0x7f9bc014f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:09.458 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.448+0000 7f9bc5f6e700 1 --2- 172.21.15.114:0/2132023406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9bc00cf490 0x7f9bc014f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:09.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.448+0000 7f9bc5f6e700 1 -- 172.21.15.114:0/2132023406 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bbc0094b0 con 0x7f9bc00b5560 2023-10-18T12:42:09.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.448+0000 7f9bc5f6e700 1 --2- 172.21.15.114:0/2132023406 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bc00b5560 0x7f9bc01f1f00 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc014040 tx=0x7f9bbc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:09.459 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.448+0000 7f9bb67fc700 1 -- 172.21.15.114:0/2132023406 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc00ba70 con 0x7f9bc00b5560 2023-10-18T12:42:09.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.448+0000 7f9bb67fc700 1 -- 172.21.15.114:0/2132023406 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bbc01e070 con 0x7f9bc00b5560 2023-10-18T12:42:09.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.448+0000 7f9bc6f70700 1 -- 172.21.15.114:0/2132023406 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bc0142500 con 0x7f9bc00b5560 2023-10-18T12:42:09.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.448+0000 7f9bb67fc700 1 -- 172.21.15.114:0/2132023406 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc00be10 con 0x7f9bc00b5560 2023-10-18T12:42:09.460 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.448+0000 7f9bc6f70700 1 -- 172.21.15.114:0/2132023406 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bc014f590 con 0x7f9bc00b5560 2023-10-18T12:42:09.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.452+0000 7f9bc6f70700 1 -- 172.21.15.114:0/2132023406 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9bc00d1f20 con 0x7f9bc00b5560 2023-10-18T12:42:09.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.452+0000 7f9bb67fc700 1 -- 172.21.15.114:0/2132023406 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f9bbc02d450 con 0x7f9bc00b5560 2023-10-18T12:42:09.462 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.452+0000 7f9bb67fc700 1 --2- 172.21.15.114:0/2132023406 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9ba40656f0 0x7f9ba4067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:09.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.452+0000 7f9bb67fc700 1 -- 172.21.15.114:0/2132023406 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5659+0+0 (secure 0 0 0) 0x7f9bbc083ca0 con 0x7f9bc00b5560 2023-10-18T12:42:09.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.456+0000 7f9bb67fc700 1 --2- 172.21.15.114:0/2132023406 >> [v2:172.21.15.114:6800/3302727047,v1:172.21.15.114:6801/3302727047] conn(0x7f9ba406c060 0x7f9ba406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:09.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.456+0000 7f9bb67fc700 1 -- 172.21.15.114:0/2132023406 --> [v2:172.21.15.114:6800/3302727047,v1:172.21.15.114:6801/3302727047] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9ba406eb70 con 0x7f9ba406c060 2023-10-18T12:42:09.463 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.456+0000 7f9bb67fc700 1 -- 172.21.15.114:0/2132023406 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9bbc086360 con 0x7f9bc00b5560 2023-10-18T12:42:09.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.456+0000 7f9bc576d700 1 --2- 172.21.15.114:0/2132023406 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9ba40656f0 0x7f9ba4067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:09.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.456+0000 7f9bc676f700 1 --2- 172.21.15.114:0/2132023406 >> [v2:172.21.15.114:6800/3302727047,v1:172.21.15.114:6801/3302727047] conn(0x7f9ba406c060 0x7f9ba406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:09.464 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.456+0000 7f9bc676f700 1 --2- 172.21.15.114:0/2132023406 >> [v2:172.21.15.114:6800/3302727047,v1:172.21.15.114:6801/3302727047] conn(0x7f9ba406c060 0x7f9ba406e4a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:09.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.456+0000 7f9bc576d700 1 --2- 172.21.15.114:0/2132023406 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9ba40656f0 0x7f9ba4067bb0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f9bc0144090 tx=0x7f9bb0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:09.465 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.456+0000 7f9bb67fc700 1 -- 172.21.15.114:0/2132023406 <== osd.1 v2:172.21.15.114:6800/3302727047 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f9ba406eb70 con 0x7f9ba406c060 2023-10-18T12:42:09.479 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.472+0000 7f9bc6f70700 1 -- 172.21.15.114:0/2132023406 --> [v2:172.21.15.114:6800/3302727047,v1:172.21.15.114:6801/3302727047] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9bc00d2200 con 0x7f9ba406c060 2023-10-18T12:42:09.480 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.472+0000 7f9bb67fc700 1 -- 172.21.15.114:0/2132023406 <== osd.1 v2:172.21.15.114:6800/3302727047 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f9bb8007240 con 0x7f9ba406c060 2023-10-18T12:42:09.480 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T12:42:09.481 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-18T12:42:09.481 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T12:42:09.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.472+0000 7f9bc6f70700 1 -- 172.21.15.114:0/2132023406 >> [v2:172.21.15.114:6800/3302727047,v1:172.21.15.114:6801/3302727047] conn(0x7f9ba406c060 msgr2=0x7f9ba406e4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:09.482 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.472+0000 7f9bc6f70700 1 --2- 172.21.15.114:0/2132023406 >> [v2:172.21.15.114:6800/3302727047,v1:172.21.15.114:6801/3302727047] conn(0x7f9ba406c060 0x7f9ba406e4a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:09.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.476+0000 7f9bc6f70700 1 -- 172.21.15.114:0/2132023406 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9ba40656f0 msgr2=0x7f9ba4067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:09.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.476+0000 7f9bc6f70700 1 --2- 172.21.15.114:0/2132023406 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f9ba40656f0 0x7f9ba4067bb0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f9bc0144090 tx=0x7f9bb0009040 comp rx=0 tx=0).stop 2023-10-18T12:42:09.483 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.476+0000 7f9bc6f70700 1 -- 172.21.15.114:0/2132023406 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bc00b5560 msgr2=0x7f9bc01f1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:09.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.476+0000 7f9bc6f70700 1 --2- 172.21.15.114:0/2132023406 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9bc00b5560 0x7f9bc01f1f00 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc014040 tx=0x7f9bbc004770 comp rx=0 tx=0).stop 2023-10-18T12:42:09.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.476+0000 7f9bc676f700 1 -- 172.21.15.114:0/2132023406 reap_dead start 2023-10-18T12:42:09.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.476+0000 7f9bc6f70700 1 -- 172.21.15.114:0/2132023406 shutdown_connections 2023-10-18T12:42:09.484 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.476+0000 7f9bc6f70700 1 -- 172.21.15.114:0/2132023406 >> 172.21.15.114:0/2132023406 conn(0x7f9bc006ce90 msgr2=0x7f9bc00b3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:09.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.476+0000 7f9bc6f70700 1 -- 172.21.15.114:0/2132023406 shutdown_connections 2023-10-18T12:42:09.485 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.476+0000 7f9bc6f70700 1 -- 172.21.15.114:0/2132023406 wait complete. 2023-10-18T12:42:09.501 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-18T12:42:09.681 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.676+0000 7f449b59e700 1 Processor -- start 2023-10-18T12:42:09.682 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.676+0000 7f449b59e700 1 -- start start 2023-10-18T12:42:09.685 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.680+0000 7f449b59e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f449c06dfc0 0x7f449c06e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:09.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.680+0000 7f449b59e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f449c06e960 con 0x7f449c159a60 2023-10-18T12:42:09.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.680+0000 7f449b59e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f449c15d630 con 0x7f449c0cd320 2023-10-18T12:42:09.686 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.680+0000 7f449b59e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f449c0cf5a0 con 0x7f449c06dfc0 2023-10-18T12:42:09.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.680+0000 7f449a59c700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f449c159a60 0x7f449c0ce800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50816/0 (socket says 172.21.15.114:50816) 2023-10-18T12:42:09.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.680+0000 7f449a59c700 1 -- 172.21.15.114:0/997952947 learned_addr learned my addr 172.21.15.114:0/997952947 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:42:09.687 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.680+0000 7f4499d9b700 1 --2- 172.21.15.114:0/997952947 >> v2:172.21.15.172:3300/0 conn(0x7f449c06dfc0 0x7f449c06e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:09.688 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.680+0000 7f449959a700 1 -- 172.21.15.114:0/997952947 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1056452645 0 0) 0x7f449c06e960 con 0x7f449c159a60 2023-10-18T12:42:09.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.680+0000 7f449959a700 1 -- 172.21.15.114:0/997952947 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44840035d0 con 0x7f449c159a60 2023-10-18T12:42:09.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.680+0000 7f4499d9b700 1 -- 172.21.15.114:0/997952947 >> v1:172.21.15.172:6789/0 conn(0x7f449c0cd320 legacy=0x7f449c0cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:09.689 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.680+0000 7f449959a700 1 -- 172.21.15.114:0/997952947 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4063492969 0 0) 0x7f449c15d630 con 0x7f449c0cd320 2023-10-18T12:42:09.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.680+0000 7f4499d9b700 1 -- 172.21.15.114:0/997952947 >> v1:172.21.15.114:6789/0 conn(0x7f449c159a60 legacy=0x7f449c0ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:09.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.680+0000 7f4499d9b700 1 -- 172.21.15.114:0/997952947 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449c15ded0 con 0x7f449c06dfc0 2023-10-18T12:42:09.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.680+0000 7f4499d9b700 1 --2- 172.21.15.114:0/997952947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f449c06dfc0 0x7f449c06e420 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4490009850 tx=0x7f4490009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5b107589bf33de server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:09.690 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.684+0000 7f449959a700 1 -- 172.21.15.114:0/997952947 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4490011830 con 0x7f449c06dfc0 2023-10-18T12:42:09.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.684+0000 7f449959a700 1 -- 172.21.15.114:0/997952947 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4490011990 con 0x7f449c06dfc0 2023-10-18T12:42:09.691 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.684+0000 7f449959a700 1 -- 172.21.15.114:0/997952947 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4490011d40 con 0x7f449c06dfc0 2023-10-18T12:42:09.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.684+0000 7f449b59e700 1 -- 172.21.15.114:0/997952947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f449c06dfc0 msgr2=0x7f449c06e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:09.692 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.684+0000 7f449b59e700 1 --2- 172.21.15.114:0/997952947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f449c06dfc0 0x7f449c06e420 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4490009850 tx=0x7f4490009b60 comp rx=0 tx=0).stop 2023-10-18T12:42:09.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.684+0000 7f449b59e700 1 -- 172.21.15.114:0/997952947 shutdown_connections 2023-10-18T12:42:09.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.684+0000 7f449b59e700 1 --2- 172.21.15.114:0/997952947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f449c06dfc0 0x7f449c06e420 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:09.693 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.684+0000 7f449b59e700 1 -- 172.21.15.114:0/997952947 >> 172.21.15.114:0/997952947 conn(0x7f449c0cc1d0 msgr2=0x7f449c0cc5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:09.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.684+0000 7f449b59e700 1 -- 172.21.15.114:0/997952947 shutdown_connections 2023-10-18T12:42:09.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.684+0000 7f449b59e700 1 -- 172.21.15.114:0/997952947 wait complete. 2023-10-18T12:42:09.694 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.684+0000 7f449b59e700 1 Processor -- start 2023-10-18T12:42:09.695 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.684+0000 7f449b59e700 1 -- start start 2023-10-18T12:42:09.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.688+0000 7f449b59e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f449c06dfc0 0x7f449c0c4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:09.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.688+0000 7f449b59e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f449c0cd320 0x7f449c154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:09.697 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.688+0000 7f449b59e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f449c159a60 0x7f449c0b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:09.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.688+0000 7f449b59e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449c0c5c50 con 0x7f449c159a60 2023-10-18T12:42:09.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.688+0000 7f449b59e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449c0c9630 con 0x7f449c06dfc0 2023-10-18T12:42:09.698 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.688+0000 7f449b59e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f449c0c9070 con 0x7f449c0cd320 2023-10-18T12:42:09.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.688+0000 7f449ad9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f449c159a60 0x7f449c0b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:09.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.688+0000 7f449ad9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f449c159a60 0x7f449c0b23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36874/0 (socket says 172.21.15.114:36874) 2023-10-18T12:42:09.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.688+0000 7f449ad9d700 1 -- 172.21.15.114:0/1234778301 learned_addr learned my addr 172.21.15.114:0/1234778301 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:42:09.699 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.688+0000 7f449a59c700 1 --2- 172.21.15.114:0/1234778301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f449c06dfc0 0x7f449c0c4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:09.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.688+0000 7f4499d9b700 1 --2- 172.21.15.114:0/1234778301 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f449c0cd320 0x7f449c154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:09.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.688+0000 7f449ad9d700 1 -- 172.21.15.114:0/1234778301 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f449c0cd320 msgr2=0x7f449c154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:09.700 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.688+0000 7f449ad9d700 1 --2- 172.21.15.114:0/1234778301 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f449c0cd320 0x7f449c154ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:09.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.688+0000 7f449ad9d700 1 -- 172.21.15.114:0/1234778301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f449c06dfc0 msgr2=0x7f449c0c4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:09.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.688+0000 7f449ad9d700 1 --2- 172.21.15.114:0/1234778301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f449c06dfc0 0x7f449c0c4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:09.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.688+0000 7f449ad9d700 1 -- 172.21.15.114:0/1234778301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44900094b0 con 0x7f449c159a60 2023-10-18T12:42:09.701 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.688+0000 7f449ad9d700 1 --2- 172.21.15.114:0/1234778301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f449c159a60 0x7f449c0b23f0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f449400cc70 tx=0x7f449400cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:09.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.688+0000 7f448affd700 1 -- 172.21.15.114:0/1234778301 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4494003e50 con 0x7f449c159a60 2023-10-18T12:42:09.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.688+0000 7f449b59e700 1 -- 172.21.15.114:0/1234778301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f449c0c9350 con 0x7f449c159a60 2023-10-18T12:42:09.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.688+0000 7f448affd700 1 -- 172.21.15.114:0/1234778301 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449400a6f0 con 0x7f449c159a60 2023-10-18T12:42:09.702 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.688+0000 7f448affd700 1 -- 172.21.15.114:0/1234778301 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449400aaa0 con 0x7f449c159a60 2023-10-18T12:42:09.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.688+0000 7f449b59e700 1 -- 172.21.15.114:0/1234778301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f449c0c60e0 con 0x7f449c159a60 2023-10-18T12:42:09.703 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.692+0000 7f449b59e700 1 -- 172.21.15.114:0/1234778301 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f449c072e60 con 0x7f449c159a60 2023-10-18T12:42:09.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.692+0000 7f448affd700 1 -- 172.21.15.114:0/1234778301 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f449400ac00 con 0x7f449c159a60 2023-10-18T12:42:09.704 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.692+0000 7f448affd700 1 --2- 172.21.15.114:0/1234778301 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f447c0656f0 0x7f447c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:09.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.696+0000 7f448affd700 1 -- 172.21.15.114:0/1234778301 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5659+0+0 (secure 0 0 0) 0x7f4494082740 con 0x7f449c159a60 2023-10-18T12:42:09.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.696+0000 7f449a59c700 1 --2- 172.21.15.114:0/1234778301 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f447c0656f0 0x7f447c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:09.705 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.696+0000 7f449a59c700 1 --2- 172.21.15.114:0/1234778301 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f447c0656f0 0x7f447c067bb0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f448c007fd0 tx=0x7f448c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:09.707 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:09.700+0000 7f448affd700 1 -- 172.21.15.114:0/1234778301 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f4494050300 con 0x7f449c159a60 2023-10-18T12:42:10.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.028+0000 7f449b59e700 1 -- 172.21.15.114:0/1234778301 --> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f449c15d880 con 0x7f447c0656f0 2023-10-18T12:42:10.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.032+0000 7f448affd700 1 -- 172.21.15.114:0/1234778301 <== mgr.4108 v2:172.21.15.172:6832/461408666 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f448c001d70 con 0x7f447c0656f0 2023-10-18T12:42:10.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.032+0000 7f449b59e700 1 -- 172.21.15.114:0/1234778301 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f447c0656f0 msgr2=0x7f447c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:10.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.032+0000 7f449b59e700 1 --2- 172.21.15.114:0/1234778301 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f447c0656f0 0x7f447c067bb0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f448c007fd0 tx=0x7f448c009040 comp rx=0 tx=0).stop 2023-10-18T12:42:10.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.032+0000 7f449b59e700 1 -- 172.21.15.114:0/1234778301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f449c159a60 msgr2=0x7f449c0b23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:10.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.032+0000 7f449b59e700 1 --2- 172.21.15.114:0/1234778301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f449c159a60 0x7f449c0b23f0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f449400cc70 tx=0x7f449400cf80 comp rx=0 tx=0).stop 2023-10-18T12:42:10.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.032+0000 7f449b59e700 1 -- 172.21.15.114:0/1234778301 shutdown_connections 2023-10-18T12:42:10.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.032+0000 7f449b59e700 1 --2- 172.21.15.114:0/1234778301 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f447c0656f0 0x7f447c067bb0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:10.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.032+0000 7f449b59e700 1 --2- 172.21.15.114:0/1234778301 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f449c0cd320 0x7f449c154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:10.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.032+0000 7f449b59e700 1 --2- 172.21.15.114:0/1234778301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f449c159a60 0x7f449c0b23f0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:10.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.032+0000 7f449b59e700 1 --2- 172.21.15.114:0/1234778301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f449c06dfc0 0x7f449c0c4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:10.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.032+0000 7f449b59e700 1 -- 172.21.15.114:0/1234778301 >> 172.21.15.114:0/1234778301 conn(0x7f449c0cc1d0 msgr2=0x7f449c0cd750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:10.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.032+0000 7f449b59e700 1 -- 172.21.15.114:0/1234778301 shutdown_connections 2023-10-18T12:42:10.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.032+0000 7f449b59e700 1 -- 172.21.15.114:0/1234778301 wait complete. 2023-10-18T12:42:10.043 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 1 to deep-scrub 2023-10-18T12:42:10.063 INFO:tasks.ceph:Scrubbing osd.2 2023-10-18T12:42:10.063 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-18T12:42:10.244 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.236+0000 7f450e3dc700 1 Processor -- start 2023-10-18T12:42:10.245 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.240+0000 7f450e3dc700 1 -- start start 2023-10-18T12:42:10.248 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.240+0000 7f450e3dc700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f450815de60 0x7f4508164930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:10.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.240+0000 7f450e3dc700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f450815e4c0 con 0x7f450806e5e0 2023-10-18T12:42:10.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.244+0000 7f450e3dc700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45080ce370 con 0x7f4508159a30 2023-10-18T12:42:10.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.244+0000 7f450e3dc700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4508070600 con 0x7f450815de60 2023-10-18T12:42:10.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.244+0000 7f450cbd9700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f450806e5e0 0x7f450815d750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50818/0 (socket says 172.21.15.114:50818) 2023-10-18T12:42:10.250 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.244+0000 7f450cbd9700 1 -- 172.21.15.114:0/1611633107 learned_addr learned my addr 172.21.15.114:0/1611633107 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:42:10.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.244+0000 7f450dbdb700 1 --2- 172.21.15.114:0/1611633107 >> v2:172.21.15.114:3300/0 conn(0x7f450815de60 0x7f4508164930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:10.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.244+0000 7f44fffff700 1 -- 172.21.15.114:0/1611633107 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2790431017 0 0) 0x7f450815e4c0 con 0x7f450806e5e0 2023-10-18T12:42:10.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.244+0000 7f44fffff700 1 -- 172.21.15.114:0/1611633107 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44f40035d0 con 0x7f450806e5e0 2023-10-18T12:42:10.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.244+0000 7f44fffff700 1 -- 172.21.15.114:0/1611633107 <== mon.1 v1:172.21.15.172:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1000738308 0 0) 0x7f45080ce370 con 0x7f4508159a30 2023-10-18T12:42:10.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.244+0000 7f44fffff700 1 -- 172.21.15.114:0/1611633107 --> v1:172.21.15.172:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f450815e4c0 con 0x7f4508159a30 2023-10-18T12:42:10.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.244+0000 7f450dbdb700 1 -- 172.21.15.114:0/1611633107 >> v1:172.21.15.172:6789/0 conn(0x7f4508159a30 legacy=0x7f450806ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:10.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.244+0000 7f450dbdb700 1 -- 172.21.15.114:0/1611633107 >> v1:172.21.15.114:6789/0 conn(0x7f450806e5e0 legacy=0x7f450815d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:10.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.244+0000 7f450dbdb700 1 -- 172.21.15.114:0/1611633107 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45080708e0 con 0x7f450815de60 2023-10-18T12:42:10.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.244+0000 7f450dbdb700 1 --2- 172.21.15.114:0/1611633107 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f450815de60 0x7f4508164930 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f4500009d90 tx=0x7f450000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf4a24383c23fff server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:10.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.244+0000 7f44fffff700 1 -- 172.21.15.114:0/1611633107 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450000e070 con 0x7f450815de60 2023-10-18T12:42:10.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.244+0000 7f44fffff700 1 -- 172.21.15.114:0/1611633107 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450000bb20 con 0x7f450815de60 2023-10-18T12:42:10.255 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.244+0000 7f44fffff700 1 -- 172.21.15.114:0/1611633107 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4500012430 con 0x7f450815de60 2023-10-18T12:42:10.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.248+0000 7f450e3dc700 1 -- 172.21.15.114:0/1611633107 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f450815de60 msgr2=0x7f4508164930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:10.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.248+0000 7f450e3dc700 1 --2- 172.21.15.114:0/1611633107 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f450815de60 0x7f4508164930 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f4500009d90 tx=0x7f450000b330 comp rx=0 tx=0).stop 2023-10-18T12:42:10.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.248+0000 7f450e3dc700 1 -- 172.21.15.114:0/1611633107 shutdown_connections 2023-10-18T12:42:10.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.248+0000 7f450e3dc700 1 --2- 172.21.15.114:0/1611633107 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f450815de60 0x7f4508164930 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:10.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.248+0000 7f450e3dc700 1 -- 172.21.15.114:0/1611633107 >> 172.21.15.114:0/1611633107 conn(0x7f45080cf790 msgr2=0x7f45080cfba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:10.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.248+0000 7f450e3dc700 1 -- 172.21.15.114:0/1611633107 shutdown_connections 2023-10-18T12:42:10.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.248+0000 7f450e3dc700 1 -- 172.21.15.114:0/1611633107 wait complete. 2023-10-18T12:42:10.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.248+0000 7f450e3dc700 1 Processor -- start 2023-10-18T12:42:10.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.248+0000 7f450e3dc700 1 -- start start 2023-10-18T12:42:10.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.252+0000 7f450e3dc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f450806e5e0 0x7f4508150f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:10.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.252+0000 7f450e3dc700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4508159a30 0x7f450806f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:10.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.252+0000 7f450e3dc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f450815de60 0x7f450806f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:10.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.252+0000 7f450e3dc700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45081514a0 con 0x7f450815de60 2023-10-18T12:42:10.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.252+0000 7f450e3dc700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45080cc1b0 con 0x7f450806e5e0 2023-10-18T12:42:10.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.252+0000 7f450e3dc700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45080cc490 con 0x7f4508159a30 2023-10-18T12:42:10.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.252+0000 7f450dbdb700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f450815de60 0x7f450806f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:10.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.252+0000 7f450dbdb700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f450815de60 0x7f450806f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36888/0 (socket says 172.21.15.114:36888) 2023-10-18T12:42:10.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.252+0000 7f450dbdb700 1 -- 172.21.15.114:0/1066103125 learned_addr learned my addr 172.21.15.114:0/1066103125 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:42:10.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.252+0000 7f450d3da700 1 --2- 172.21.15.114:0/1066103125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f450806e5e0 0x7f4508150f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:10.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.252+0000 7f450cbd9700 1 --2- 172.21.15.114:0/1066103125 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4508159a30 0x7f450806f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:10.263 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.252+0000 7f450dbdb700 1 -- 172.21.15.114:0/1066103125 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4508159a30 msgr2=0x7f450806f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:10.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.252+0000 7f450dbdb700 1 --2- 172.21.15.114:0/1066103125 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4508159a30 0x7f450806f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:10.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.252+0000 7f450dbdb700 1 -- 172.21.15.114:0/1066103125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f450806e5e0 msgr2=0x7f4508150f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:10.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.252+0000 7f450dbdb700 1 --2- 172.21.15.114:0/1066103125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f450806e5e0 0x7f4508150f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:10.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.252+0000 7f450dbdb700 1 -- 172.21.15.114:0/1066103125 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4500009a70 con 0x7f450815de60 2023-10-18T12:42:10.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.252+0000 7f450dbdb700 1 --2- 172.21.15.114:0/1066103125 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f450815de60 0x7f450806f990 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f450806b420 tx=0x7f4500004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:10.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.252+0000 7f44fdffb700 1 -- 172.21.15.114:0/1066103125 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450001b810 con 0x7f450815de60 2023-10-18T12:42:10.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.252+0000 7f44fdffb700 1 -- 172.21.15.114:0/1066103125 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4500020070 con 0x7f450815de60 2023-10-18T12:42:10.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.252+0000 7f44fdffb700 1 -- 172.21.15.114:0/1066103125 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450001bbb0 con 0x7f450815de60 2023-10-18T12:42:10.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.252+0000 7f450e3dc700 1 -- 172.21.15.114:0/1066103125 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45080cc770 con 0x7f450815de60 2023-10-18T12:42:10.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.252+0000 7f450e3dc700 1 -- 172.21.15.114:0/1066103125 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45080ccd30 con 0x7f450815de60 2023-10-18T12:42:10.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.256+0000 7f450e3dc700 1 -- 172.21.15.114:0/1066103125 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f45080cc320 con 0x7f450815de60 2023-10-18T12:42:10.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.256+0000 7f44fdffb700 1 -- 172.21.15.114:0/1066103125 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f450001bd10 con 0x7f450815de60 2023-10-18T12:42:10.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.256+0000 7f44fdffb700 1 --2- 172.21.15.114:0/1066103125 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f44ec065720 0x7f44ec067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:10.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.256+0000 7f44fdffb700 1 -- 172.21.15.114:0/1066103125 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5659+0+0 (secure 0 0 0) 0x7f4500022070 con 0x7f450815de60 2023-10-18T12:42:10.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.256+0000 7f44fdffb700 1 --2- 172.21.15.114:0/1066103125 >> [v2:172.21.15.114:6808/2699151351,v1:172.21.15.114:6809/2699151351] conn(0x7f44ec06c090 0x7f44ec06e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:10.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.256+0000 7f44fdffb700 1 -- 172.21.15.114:0/1066103125 --> [v2:172.21.15.114:6808/2699151351,v1:172.21.15.114:6809/2699151351] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f44ec06eba0 con 0x7f44ec06c090 2023-10-18T12:42:10.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.256+0000 7f44fdffb700 1 -- 172.21.15.114:0/1066103125 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4500089030 con 0x7f450815de60 2023-10-18T12:42:10.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.256+0000 7f450d3da700 1 --2- 172.21.15.114:0/1066103125 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f44ec065720 0x7f44ec067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:10.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.256+0000 7f450cbd9700 1 --2- 172.21.15.114:0/1066103125 >> [v2:172.21.15.114:6808/2699151351,v1:172.21.15.114:6809/2699151351] conn(0x7f44ec06c090 0x7f44ec06e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:10.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.260+0000 7f450cbd9700 1 --2- 172.21.15.114:0/1066103125 >> [v2:172.21.15.114:6808/2699151351,v1:172.21.15.114:6809/2699151351] conn(0x7f44ec06c090 0x7f44ec06e4d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:10.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.260+0000 7f450d3da700 1 --2- 172.21.15.114:0/1066103125 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f44ec065720 0x7f44ec067be0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f4504007fd0 tx=0x7f4504009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:10.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.260+0000 7f44fdffb700 1 -- 172.21.15.114:0/1066103125 <== osd.2 v2:172.21.15.114:6808/2699151351 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f44ec06eba0 con 0x7f44ec06c090 2023-10-18T12:42:10.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.276+0000 7f450e3dc700 1 -- 172.21.15.114:0/1066103125 --> [v2:172.21.15.114:6808/2699151351,v1:172.21.15.114:6809/2699151351] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4508070ea0 con 0x7f44ec06c090 2023-10-18T12:42:10.284 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.280+0000 7f44fdffb700 1 -- 172.21.15.114:0/1066103125 <== osd.2 v2:172.21.15.114:6808/2699151351 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f44f8001890 con 0x7f44ec06c090 2023-10-18T12:42:10.285 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T12:42:10.285 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-18T12:42:10.285 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T12:42:10.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.280+0000 7f450e3dc700 1 -- 172.21.15.114:0/1066103125 >> [v2:172.21.15.114:6808/2699151351,v1:172.21.15.114:6809/2699151351] conn(0x7f44ec06c090 msgr2=0x7f44ec06e4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:10.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.280+0000 7f450e3dc700 1 --2- 172.21.15.114:0/1066103125 >> [v2:172.21.15.114:6808/2699151351,v1:172.21.15.114:6809/2699151351] conn(0x7f44ec06c090 0x7f44ec06e4d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:10.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.280+0000 7f450e3dc700 1 -- 172.21.15.114:0/1066103125 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f44ec065720 msgr2=0x7f44ec067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:10.287 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.280+0000 7f450e3dc700 1 --2- 172.21.15.114:0/1066103125 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f44ec065720 0x7f44ec067be0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f4504007fd0 tx=0x7f4504009040 comp rx=0 tx=0).stop 2023-10-18T12:42:10.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.280+0000 7f450e3dc700 1 -- 172.21.15.114:0/1066103125 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f450815de60 msgr2=0x7f450806f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:10.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.280+0000 7f450e3dc700 1 --2- 172.21.15.114:0/1066103125 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f450815de60 0x7f450806f990 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f450806b420 tx=0x7f4500004af0 comp rx=0 tx=0).stop 2023-10-18T12:42:10.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.280+0000 7f450dbdb700 1 -- 172.21.15.114:0/1066103125 reap_dead start 2023-10-18T12:42:10.288 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.280+0000 7f450e3dc700 1 -- 172.21.15.114:0/1066103125 shutdown_connections 2023-10-18T12:42:10.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.280+0000 7f450e3dc700 1 -- 172.21.15.114:0/1066103125 >> 172.21.15.114:0/1066103125 conn(0x7f45080cf790 msgr2=0x7f450815d750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:10.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.280+0000 7f450e3dc700 1 -- 172.21.15.114:0/1066103125 shutdown_connections 2023-10-18T12:42:10.289 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.280+0000 7f450e3dc700 1 -- 172.21.15.114:0/1066103125 wait complete. 2023-10-18T12:42:10.311 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-18T12:42:10.486 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.480+0000 7f1634f3a700 1 Processor -- start 2023-10-18T12:42:10.487 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.480+0000 7f1634f3a700 1 -- start start 2023-10-18T12:42:10.489 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.484+0000 7f1634f3a700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1630146800 0x7f16300b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:10.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.484+0000 7f1634f3a700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f163015dd30 0x7f163006f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:10.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.484+0000 7f1634f3a700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f163015e680 con 0x7f163006fee0 2023-10-18T12:42:10.490 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.484+0000 7f1634f3a700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1630070370 con 0x7f163015dd30 2023-10-18T12:42:10.491 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.484+0000 7f1634f3a700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16300b6180 con 0x7f1630146800 2023-10-18T12:42:10.492 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.484+0000 7f1627fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f163015dd30 0x7f163006f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:10.492 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.484+0000 7f1627fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f163015dd30 0x7f163006f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36898/0 (socket says 172.21.15.114:36898) 2023-10-18T12:42:10.493 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.484+0000 7f1627fff700 1 -- 172.21.15.114:0/6934156 learned_addr learned my addr 172.21.15.114:0/6934156 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:42:10.493 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.484+0000 7f162e59c700 1 --2- 172.21.15.114:0/6934156 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1630146800 0x7f16300b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:10.493 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.484+0000 7f1627fff700 1 -- 172.21.15.114:0/6934156 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1630146800 msgr2=0x7f16300b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:42:10.494 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.484+0000 7f1627fff700 1 --2- 172.21.15.114:0/6934156 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1630146800 0x7f16300b5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:10.494 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.484+0000 7f1627fff700 1 -- 172.21.15.114:0/6934156 >> v1:172.21.15.172:6789/0 conn(0x7f163006fee0 legacy=0x7f16301608a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:10.494 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.484+0000 7f1627fff700 1 -- 172.21.15.114:0/6934156 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16300b6460 con 0x7f163015dd30 2023-10-18T12:42:10.495 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.484+0000 7f1627fff700 1 --2- 172.21.15.114:0/6934156 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f163015dd30 0x7f163006f9a0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f1618009910 tx=0x7f1618009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81cf74b22eb12226 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:10.495 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.484+0000 7f162dd9b700 1 -- 172.21.15.114:0/6934156 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1618011830 con 0x7f163015dd30 2023-10-18T12:42:10.495 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.488+0000 7f162dd9b700 1 -- 172.21.15.114:0/6934156 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1618011990 con 0x7f163015dd30 2023-10-18T12:42:10.495 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.488+0000 7f162dd9b700 1 -- 172.21.15.114:0/6934156 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1618011d40 con 0x7f163015dd30 2023-10-18T12:42:10.497 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.488+0000 7f1634f3a700 1 -- 172.21.15.114:0/6934156 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f163015dd30 msgr2=0x7f163006f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:10.497 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.488+0000 7f1634f3a700 1 --2- 172.21.15.114:0/6934156 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f163015dd30 0x7f163006f9a0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f1618009910 tx=0x7f1618009c20 comp rx=0 tx=0).stop 2023-10-18T12:42:10.497 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.488+0000 7f1634f3a700 1 -- 172.21.15.114:0/6934156 shutdown_connections 2023-10-18T12:42:10.497 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.488+0000 7f1634f3a700 1 --2- 172.21.15.114:0/6934156 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f163015dd30 0x7f163006f9a0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:10.498 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.488+0000 7f1634f3a700 1 --2- 172.21.15.114:0/6934156 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1630146800 0x7f16300b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:10.498 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.488+0000 7f1634f3a700 1 -- 172.21.15.114:0/6934156 >> 172.21.15.114:0/6934156 conn(0x7f163006a130 msgr2=0x7f163006a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:10.498 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.488+0000 7f1634f3a700 1 -- 172.21.15.114:0/6934156 shutdown_connections 2023-10-18T12:42:10.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.488+0000 7f1634f3a700 1 -- 172.21.15.114:0/6934156 wait complete. 2023-10-18T12:42:10.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.492+0000 7f1634f3a700 1 Processor -- start 2023-10-18T12:42:10.499 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.492+0000 7f1634f3a700 1 -- start start 2023-10-18T12:42:10.501 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.492+0000 7f1634f3a700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f163006fee0 0x7f163015c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:10.501 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.492+0000 7f1634f3a700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1630146800 0x7f16300b3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:10.502 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.492+0000 7f1634f3a700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f163015dd30 0x7f16300c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:10.502 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.492+0000 7f1634f3a700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16300b38a0 con 0x7f163015dd30 2023-10-18T12:42:10.502 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.492+0000 7f1634f3a700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163015cc60 con 0x7f163006fee0 2023-10-18T12:42:10.503 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.492+0000 7f1634f3a700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1630143dd0 con 0x7f1630146800 2023-10-18T12:42:10.503 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.492+0000 7f162ed9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f163015dd30 0x7f16300c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:10.503 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.492+0000 7f162ed9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f163015dd30 0x7f16300c7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36906/0 (socket says 172.21.15.114:36906) 2023-10-18T12:42:10.503 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.492+0000 7f162ed9d700 1 -- 172.21.15.114:0/3532393044 learned_addr learned my addr 172.21.15.114:0/3532393044 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:42:10.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.492+0000 7f1627fff700 1 --2- 172.21.15.114:0/3532393044 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1630146800 0x7f16300b3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:10.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.492+0000 7f162e59c700 1 --2- 172.21.15.114:0/3532393044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f163006fee0 0x7f163015c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:10.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.492+0000 7f162ed9d700 1 -- 172.21.15.114:0/3532393044 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1630146800 msgr2=0x7f16300b3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:10.504 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.492+0000 7f162ed9d700 1 --2- 172.21.15.114:0/3532393044 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1630146800 0x7f16300b3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:10.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.492+0000 7f162ed9d700 1 -- 172.21.15.114:0/3532393044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f163006fee0 msgr2=0x7f163015c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:10.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.492+0000 7f162ed9d700 1 --2- 172.21.15.114:0/3532393044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f163006fee0 0x7f163015c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:10.505 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.492+0000 7f162ed9d700 1 -- 172.21.15.114:0/3532393044 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1618009570 con 0x7f163015dd30 2023-10-18T12:42:10.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.492+0000 7f162e59c700 1 --2- 172.21.15.114:0/3532393044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f163006fee0 0x7f163015c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:42:10.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.492+0000 7f162ed9d700 1 --2- 172.21.15.114:0/3532393044 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f163015dd30 0x7f16300c7fc0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f162800ccb0 tx=0x7f162800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:10.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.496+0000 7f1626ffd700 1 -- 172.21.15.114:0/3532393044 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162800ad00 con 0x7f163015dd30 2023-10-18T12:42:10.506 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.496+0000 7f1626ffd700 1 -- 172.21.15.114:0/3532393044 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f162800ae60 con 0x7f163015dd30 2023-10-18T12:42:10.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.496+0000 7f1634f3a700 1 -- 172.21.15.114:0/3532393044 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16300b2c90 con 0x7f163015dd30 2023-10-18T12:42:10.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.496+0000 7f1626ffd700 1 -- 172.21.15.114:0/3532393044 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1628003c60 con 0x7f163015dd30 2023-10-18T12:42:10.507 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.496+0000 7f1634f3a700 1 -- 172.21.15.114:0/3532393044 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16300b3250 con 0x7f163015dd30 2023-10-18T12:42:10.508 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.496+0000 7f1634f3a700 1 -- 172.21.15.114:0/3532393044 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16300d1a60 con 0x7f163015dd30 2023-10-18T12:42:10.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.496+0000 7f1626ffd700 1 -- 172.21.15.114:0/3532393044 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f16280050d0 con 0x7f163015dd30 2023-10-18T12:42:10.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.500+0000 7f1626ffd700 1 --2- 172.21.15.114:0/3532393044 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f16100656f0 0x7f1610067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:10.509 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.500+0000 7f1626ffd700 1 -- 172.21.15.114:0/3532393044 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5659+0+0 (secure 0 0 0) 0x7f1628082de0 con 0x7f163015dd30 2023-10-18T12:42:10.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.500+0000 7f162e59c700 1 --2- 172.21.15.114:0/3532393044 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f16100656f0 0x7f1610067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:10.510 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.500+0000 7f162e59c700 1 --2- 172.21.15.114:0/3532393044 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f16100656f0 0x7f1610067bb0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f1620009b70 tx=0x7f1620008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:10.512 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.508+0000 7f1626ffd700 1 -- 172.21.15.114:0/3532393044 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f16280509a0 con 0x7f163015dd30 2023-10-18T12:42:10.799 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.792+0000 7f1634f3a700 1 -- 172.21.15.114:0/3532393044 --> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f16300b6a20 con 0x7f16100656f0 2023-10-18T12:42:10.800 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.796+0000 7f1626ffd700 1 -- 172.21.15.114:0/3532393044 <== mgr.4108 v2:172.21.15.172:6832/461408666 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1620004020 con 0x7f16100656f0 2023-10-18T12:42:10.803 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.796+0000 7f1634f3a700 1 -- 172.21.15.114:0/3532393044 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f16100656f0 msgr2=0x7f1610067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:10.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.796+0000 7f1634f3a700 1 --2- 172.21.15.114:0/3532393044 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f16100656f0 0x7f1610067bb0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f1620009b70 tx=0x7f1620008040 comp rx=0 tx=0).stop 2023-10-18T12:42:10.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.796+0000 7f1634f3a700 1 -- 172.21.15.114:0/3532393044 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f163015dd30 msgr2=0x7f16300c7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:10.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.796+0000 7f1634f3a700 1 --2- 172.21.15.114:0/3532393044 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f163015dd30 0x7f16300c7fc0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f162800ccb0 tx=0x7f162800a340 comp rx=0 tx=0).stop 2023-10-18T12:42:10.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.796+0000 7f1634f3a700 1 -- 172.21.15.114:0/3532393044 shutdown_connections 2023-10-18T12:42:10.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.796+0000 7f1634f3a700 1 --2- 172.21.15.114:0/3532393044 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f16100656f0 0x7f1610067bb0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:10.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.796+0000 7f1634f3a700 1 --2- 172.21.15.114:0/3532393044 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1630146800 0x7f16300b3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:10.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.796+0000 7f1634f3a700 1 --2- 172.21.15.114:0/3532393044 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f163015dd30 0x7f16300c7fc0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:10.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.796+0000 7f1634f3a700 1 --2- 172.21.15.114:0/3532393044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f163006fee0 0x7f163015c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:10.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.796+0000 7f1634f3a700 1 -- 172.21.15.114:0/3532393044 >> 172.21.15.114:0/3532393044 conn(0x7f163006a130 msgr2=0x7f1630145b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:10.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.796+0000 7f1634f3a700 1 -- 172.21.15.114:0/3532393044 shutdown_connections 2023-10-18T12:42:10.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:10.796+0000 7f1634f3a700 1 -- 172.21.15.114:0/3532393044 wait complete. 2023-10-18T12:42:10.807 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 2 to deep-scrub 2023-10-18T12:42:10.827 INFO:tasks.ceph:Scrubbing osd.3 2023-10-18T12:42:10.828 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-18T12:42:11.012 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.008+0000 7f7fa7333700 1 Processor -- start 2023-10-18T12:42:11.013 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.008+0000 7f7fa7333700 1 -- start start 2023-10-18T12:42:11.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.008+0000 7f7fa7333700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7fa006e360 0x7f7fa006ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:11.016 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.008+0000 7f7fa7333700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7fa0070460 0x7f7fa00cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:11.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.012+0000 7f7fa7333700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fa00aea80 con 0x7f7fa006e740 2023-10-18T12:42:11.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.012+0000 7f7fa7333700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fa00ca900 con 0x7f7fa0070460 2023-10-18T12:42:11.017 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.012+0000 7f7fa7333700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa00cf310 con 0x7f7fa006e360 2023-10-18T12:42:11.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.012+0000 7f7fa48ce700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7fa0070460 0x7f7fa00cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:11.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.012+0000 7f7fa48ce700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f7fa0070460 0x7f7fa00cad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:34156/0 (socket says 172.21.15.114:34156) 2023-10-18T12:42:11.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.012+0000 7f7fa48ce700 1 -- 172.21.15.114:0/456250118 learned_addr learned my addr 172.21.15.114:0/456250118 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:42:11.019 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.012+0000 7f7fa50cf700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7fa006e360 0x7f7fa006ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:11.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.012+0000 7f7fa48ce700 1 -- 172.21.15.114:0/456250118 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7fa006e360 msgr2=0x7f7fa006ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:42:11.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.012+0000 7f7fa48ce700 1 --2- 172.21.15.114:0/456250118 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7fa006e360 0x7f7fa006ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:11.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.012+0000 7f7fa48ce700 1 -- 172.21.15.114:0/456250118 >> v1:172.21.15.172:6789/0 conn(0x7f7fa006e740 legacy=0x7f7fa0165950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:11.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.012+0000 7f7fa48ce700 1 -- 172.21.15.114:0/456250118 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa00aecd0 con 0x7f7fa0070460 2023-10-18T12:42:11.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.012+0000 7f7fa50cf700 1 --2- 172.21.15.114:0/456250118 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7fa006e360 0x7f7fa006ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:42:11.021 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.012+0000 7f7fa48ce700 1 --2- 172.21.15.114:0/456250118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fa0070460 0x7f7fa00cad90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7f90009910 tx=0x7f7f90009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7643233e8a72ed1e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:11.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.012+0000 7f7f97fff700 1 -- 172.21.15.114:0/456250118 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f90011830 con 0x7f7fa0070460 2023-10-18T12:42:11.022 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.012+0000 7f7f97fff700 1 -- 172.21.15.114:0/456250118 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f90011990 con 0x7f7fa0070460 2023-10-18T12:42:11.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.012+0000 7f7f97fff700 1 -- 172.21.15.114:0/456250118 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f90011d40 con 0x7f7fa0070460 2023-10-18T12:42:11.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.016+0000 7f7fa7333700 1 -- 172.21.15.114:0/456250118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fa0070460 msgr2=0x7f7fa00cad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:11.023 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.016+0000 7f7fa7333700 1 --2- 172.21.15.114:0/456250118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fa0070460 0x7f7fa00cad90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7f90009910 tx=0x7f7f90009c20 comp rx=0 tx=0).stop 2023-10-18T12:42:11.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.016+0000 7f7fa7333700 1 -- 172.21.15.114:0/456250118 shutdown_connections 2023-10-18T12:42:11.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.016+0000 7f7fa7333700 1 --2- 172.21.15.114:0/456250118 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fa0070460 0x7f7fa00cad90 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:11.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.016+0000 7f7fa7333700 1 --2- 172.21.15.114:0/456250118 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7fa006e360 0x7f7fa006ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:11.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.016+0000 7f7fa7333700 1 -- 172.21.15.114:0/456250118 >> 172.21.15.114:0/456250118 conn(0x7f7fa00cc320 msgr2=0x7f7fa00cc730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:11.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.016+0000 7f7fa7333700 1 -- 172.21.15.114:0/456250118 shutdown_connections 2023-10-18T12:42:11.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.016+0000 7f7fa7333700 1 -- 172.21.15.114:0/456250118 wait complete. 2023-10-18T12:42:11.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.020+0000 7f7fa7333700 1 Processor -- start 2023-10-18T12:42:11.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.020+0000 7f7fa7333700 1 -- start start 2023-10-18T12:42:11.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.020+0000 7f7fa7333700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7fa006e360 0x7f7fa01ea5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:11.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.020+0000 7f7fa7333700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fa006e740 0x7f7fa00c54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:11.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.020+0000 7f7fa7333700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fa0070460 0x7f7fa01643a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:11.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.020+0000 7f7fa7333700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa00c5a00 con 0x7f7fa0070460 2023-10-18T12:42:11.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.020+0000 7f7fa7333700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa01eacf0 con 0x7f7fa006e740 2023-10-18T12:42:11.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.020+0000 7f7fa7333700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa01eafd0 con 0x7f7fa006e360 2023-10-18T12:42:11.029 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.020+0000 7f7fa58d0700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fa0070460 0x7f7fa01643a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:11.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.020+0000 7f7fa58d0700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fa0070460 0x7f7fa01643a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36914/0 (socket says 172.21.15.114:36914) 2023-10-18T12:42:11.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.020+0000 7f7fa58d0700 1 -- 172.21.15.114:0/1267107151 learned_addr learned my addr 172.21.15.114:0/1267107151 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:42:11.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.020+0000 7f7fa50cf700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7fa006e360 0x7f7fa01ea5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:11.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.020+0000 7f7fa48ce700 1 --2- 172.21.15.114:0/1267107151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fa006e740 0x7f7fa00c54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:11.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.020+0000 7f7fa58d0700 1 -- 172.21.15.114:0/1267107151 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7fa006e360 msgr2=0x7f7fa01ea5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:11.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.020+0000 7f7fa58d0700 1 --2- 172.21.15.114:0/1267107151 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f7fa006e360 0x7f7fa01ea5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:11.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.020+0000 7f7fa58d0700 1 -- 172.21.15.114:0/1267107151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fa006e740 msgr2=0x7f7fa00c54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:11.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.020+0000 7f7fa58d0700 1 --2- 172.21.15.114:0/1267107151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7fa006e740 0x7f7fa00c54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:11.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.020+0000 7f7fa58d0700 1 -- 172.21.15.114:0/1267107151 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f9c0094b0 con 0x7f7fa0070460 2023-10-18T12:42:11.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.020+0000 7f7fa58d0700 1 --2- 172.21.15.114:0/1267107151 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fa0070460 0x7f7fa01643a0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f7f9800cc50 tx=0x7f7f9800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:11.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.024+0000 7f7f95ffb700 1 -- 172.21.15.114:0/1267107151 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f98003c20 con 0x7f7fa0070460 2023-10-18T12:42:11.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.024+0000 7f7f95ffb700 1 -- 172.21.15.114:0/1267107151 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f98003d80 con 0x7f7fa0070460 2023-10-18T12:42:11.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.024+0000 7f7fa7333700 1 -- 172.21.15.114:0/1267107151 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f90009570 con 0x7f7fa0070460 2023-10-18T12:42:11.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.024+0000 7f7f95ffb700 1 -- 172.21.15.114:0/1267107151 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9800aab0 con 0x7f7fa0070460 2023-10-18T12:42:11.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.024+0000 7f7fa7333700 1 -- 172.21.15.114:0/1267107151 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fa01eb590 con 0x7f7fa0070460 2023-10-18T12:42:11.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.024+0000 7f7fa7333700 1 -- 172.21.15.114:0/1267107151 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7fa00ccf90 con 0x7f7fa0070460 2023-10-18T12:42:11.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.024+0000 7f7f95ffb700 1 -- 172.21.15.114:0/1267107151 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f7f9800ac10 con 0x7f7fa0070460 2023-10-18T12:42:11.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.028+0000 7f7f95ffb700 1 --2- 172.21.15.114:0/1267107151 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7f840656f0 0x7f7f84067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:11.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.028+0000 7f7f95ffb700 1 -- 172.21.15.114:0/1267107151 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5659+0+0 (secure 0 0 0) 0x7f7f98082ba0 con 0x7f7fa0070460 2023-10-18T12:42:11.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.028+0000 7f7f95ffb700 1 --2- 172.21.15.114:0/1267107151 >> [v2:172.21.15.114:6819/1361608073,v1:172.21.15.114:6821/1361608073] conn(0x7f7f8406c060 0x7f7f8406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:11.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.028+0000 7f7f95ffb700 1 -- 172.21.15.114:0/1267107151 --> [v2:172.21.15.114:6819/1361608073,v1:172.21.15.114:6821/1361608073] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7f8406eb70 con 0x7f7f8406c060 2023-10-18T12:42:11.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.028+0000 7f7f95ffb700 1 -- 172.21.15.114:0/1267107151 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f980872c0 con 0x7f7fa0070460 2023-10-18T12:42:11.039 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.028+0000 7f7fa50cf700 1 --2- 172.21.15.114:0/1267107151 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7f840656f0 0x7f7f84067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:11.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.028+0000 7f7fa48ce700 1 --2- 172.21.15.114:0/1267107151 >> [v2:172.21.15.114:6819/1361608073,v1:172.21.15.114:6821/1361608073] conn(0x7f7f8406c060 0x7f7f8406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:11.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.028+0000 7f7fa48ce700 1 --2- 172.21.15.114:0/1267107151 >> [v2:172.21.15.114:6819/1361608073,v1:172.21.15.114:6821/1361608073] conn(0x7f7f8406c060 0x7f7f8406e4a0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:11.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.028+0000 7f7fa50cf700 1 --2- 172.21.15.114:0/1267107151 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7f840656f0 0x7f7f84067bb0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f7fa00ca010 tx=0x7f7f9c009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:11.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.028+0000 7f7f95ffb700 1 -- 172.21.15.114:0/1267107151 <== osd.3 v2:172.21.15.114:6819/1361608073 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f7f8406eb70 con 0x7f7f8406c060 2023-10-18T12:42:11.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.048+0000 7f7fa7333700 1 -- 172.21.15.114:0/1267107151 --> [v2:172.21.15.114:6819/1361608073,v1:172.21.15.114:6821/1361608073] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7fa00aefb0 con 0x7f7f8406c060 2023-10-18T12:42:11.053 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.048+0000 7f7f95ffb700 1 -- 172.21.15.114:0/1267107151 <== osd.3 v2:172.21.15.114:6819/1361608073 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f7f90011630 con 0x7f7f8406c060 2023-10-18T12:42:11.054 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T12:42:11.054 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-18T12:42:11.054 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T12:42:11.055 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.048+0000 7f7fa7333700 1 -- 172.21.15.114:0/1267107151 >> [v2:172.21.15.114:6819/1361608073,v1:172.21.15.114:6821/1361608073] conn(0x7f7f8406c060 msgr2=0x7f7f8406e4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:11.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.048+0000 7f7fa7333700 1 --2- 172.21.15.114:0/1267107151 >> [v2:172.21.15.114:6819/1361608073,v1:172.21.15.114:6821/1361608073] conn(0x7f7f8406c060 0x7f7f8406e4a0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:11.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.048+0000 7f7fa7333700 1 -- 172.21.15.114:0/1267107151 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7f840656f0 msgr2=0x7f7f84067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:11.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.048+0000 7f7fa7333700 1 --2- 172.21.15.114:0/1267107151 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7f840656f0 0x7f7f84067bb0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f7fa00ca010 tx=0x7f7f9c009240 comp rx=0 tx=0).stop 2023-10-18T12:42:11.056 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.048+0000 7f7fa7333700 1 -- 172.21.15.114:0/1267107151 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fa0070460 msgr2=0x7f7fa01643a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:11.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.048+0000 7f7fa7333700 1 --2- 172.21.15.114:0/1267107151 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7fa0070460 0x7f7fa01643a0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f7f9800cc50 tx=0x7f7f9800cf60 comp rx=0 tx=0).stop 2023-10-18T12:42:11.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.048+0000 7f7fa58d0700 1 -- 172.21.15.114:0/1267107151 reap_dead start 2023-10-18T12:42:11.057 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.048+0000 7f7fa7333700 1 -- 172.21.15.114:0/1267107151 shutdown_connections 2023-10-18T12:42:11.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.048+0000 7f7fa7333700 1 -- 172.21.15.114:0/1267107151 >> 172.21.15.114:0/1267107151 conn(0x7f7fa00cc320 msgr2=0x7f7fa00b08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:11.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.048+0000 7f7fa7333700 1 -- 172.21.15.114:0/1267107151 shutdown_connections 2023-10-18T12:42:11.058 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.048+0000 7f7fa7333700 1 -- 172.21.15.114:0/1267107151 wait complete. 2023-10-18T12:42:11.076 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-18T12:42:11.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.244+0000 7f953c912700 1 Processor -- start 2023-10-18T12:42:11.249 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.244+0000 7f953c912700 1 -- start start 2023-10-18T12:42:11.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.244+0000 7f953c912700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f9538144150 0x7f95380cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:11.251 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.244+0000 7f953c912700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f95380ce1a0 0x7f95380cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:11.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.244+0000 7f953c912700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9538070de0 con 0x7f95380cbde0 2023-10-18T12:42:11.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.244+0000 7f953c912700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95380cc270 con 0x7f9538144150 2023-10-18T12:42:11.252 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.244+0000 7f953c912700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95380701d0 con 0x7f95380ce1a0 2023-10-18T12:42:11.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.244+0000 7f953759e700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f95380cbde0 0x7f953815e490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50824/0 (socket says 172.21.15.114:50824) 2023-10-18T12:42:11.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.244+0000 7f953759e700 1 -- 172.21.15.114:0/3343225169 learned_addr learned my addr 172.21.15.114:0/3343225169 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:42:11.253 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.244+0000 7f9536d9d700 1 --2- 172.21.15.114:0/3343225169 >> v2:172.21.15.114:3300/0 conn(0x7f9538144150 0x7f95380cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:11.254 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.244+0000 7f953659c700 1 --2- 172.21.15.114:0/3343225169 >> v2:172.21.15.172:3300/0 conn(0x7f95380ce1a0 0x7f95380cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:11.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.244+0000 7f9535d9b700 1 -- 172.21.15.114:0/3343225169 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 590281358 0 0) 0x7f9538070de0 con 0x7f95380cbde0 2023-10-18T12:42:11.256 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.244+0000 7f9535d9b700 1 -- 172.21.15.114:0/3343225169 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95200035d0 con 0x7f95380cbde0 2023-10-18T12:42:11.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.244+0000 7f953659c700 1 -- 172.21.15.114:0/3343225169 >> v2:172.21.15.114:3300/0 conn(0x7f9538144150 msgr2=0x7f95380cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:42:11.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.244+0000 7f953659c700 1 --2- 172.21.15.114:0/3343225169 >> v2:172.21.15.114:3300/0 conn(0x7f9538144150 0x7f95380cdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:11.257 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.244+0000 7f953659c700 1 -- 172.21.15.114:0/3343225169 >> v1:172.21.15.114:6789/0 conn(0x7f95380cbde0 legacy=0x7f953815e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:11.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.244+0000 7f953659c700 1 -- 172.21.15.114:0/3343225169 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95380704b0 con 0x7f95380ce1a0 2023-10-18T12:42:11.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.244+0000 7f9536d9d700 1 --2- 172.21.15.114:0/3343225169 >> v2:172.21.15.114:3300/0 conn(0x7f9538144150 0x7f95380cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:42:11.258 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.248+0000 7f953659c700 1 --2- 172.21.15.114:0/3343225169 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95380ce1a0 0x7f95380cb8a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f953806adb0 tx=0x7f952c009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=574853c4bdc76613 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:11.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.248+0000 7f9535d9b700 1 -- 172.21.15.114:0/3343225169 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952c011830 con 0x7f95380ce1a0 2023-10-18T12:42:11.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.248+0000 7f9535d9b700 1 -- 172.21.15.114:0/3343225169 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f952c011990 con 0x7f95380ce1a0 2023-10-18T12:42:11.259 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.248+0000 7f9535d9b700 1 -- 172.21.15.114:0/3343225169 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952c011d20 con 0x7f95380ce1a0 2023-10-18T12:42:11.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.248+0000 7f953c912700 1 -- 172.21.15.114:0/3343225169 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95380ce1a0 msgr2=0x7f95380cb8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:11.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.248+0000 7f953c912700 1 --2- 172.21.15.114:0/3343225169 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95380ce1a0 0x7f95380cb8a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f953806adb0 tx=0x7f952c009b30 comp rx=0 tx=0).stop 2023-10-18T12:42:11.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.248+0000 7f953c912700 1 -- 172.21.15.114:0/3343225169 shutdown_connections 2023-10-18T12:42:11.260 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.248+0000 7f953c912700 1 --2- 172.21.15.114:0/3343225169 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95380ce1a0 0x7f95380cb8a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:11.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.248+0000 7f953c912700 1 --2- 172.21.15.114:0/3343225169 >> v2:172.21.15.114:3300/0 conn(0x7f9538144150 0x7f95380cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:11.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.248+0000 7f953c912700 1 -- 172.21.15.114:0/3343225169 >> 172.21.15.114:0/3343225169 conn(0x7f95380b0bf0 msgr2=0x7f95380ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:11.261 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.248+0000 7f953c912700 1 -- 172.21.15.114:0/3343225169 shutdown_connections 2023-10-18T12:42:11.262 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.248+0000 7f953c912700 1 -- 172.21.15.114:0/3343225169 wait complete. 2023-10-18T12:42:11.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.252+0000 7f953c912700 1 Processor -- start 2023-10-18T12:42:11.264 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.252+0000 7f953c912700 1 -- start start 2023-10-18T12:42:11.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.252+0000 7f953c912700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95380cbde0 0x7f953813d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:11.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.252+0000 7f953c912700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f95380ce1a0 0x7f95381f1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:11.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.252+0000 7f953c912700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9538144150 0x7f95381ede20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:11.265 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.252+0000 7f953c912700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95381eedf0 con 0x7f95380cbde0 2023-10-18T12:42:11.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.252+0000 7f953c912700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95381f1950 con 0x7f9538144150 2023-10-18T12:42:11.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.252+0000 7f953c912700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95381f2320 con 0x7f95380ce1a0 2023-10-18T12:42:11.266 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.252+0000 7f9536d9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95380cbde0 0x7f953813d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:11.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.252+0000 7f9536d9d700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95380cbde0 0x7f953813d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36934/0 (socket says 172.21.15.114:36934) 2023-10-18T12:42:11.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.252+0000 7f9536d9d700 1 -- 172.21.15.114:0/3562051711 learned_addr learned my addr 172.21.15.114:0/3562051711 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:42:11.267 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.252+0000 7f953659c700 1 --2- 172.21.15.114:0/3562051711 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f95380ce1a0 0x7f95381f1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:11.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.252+0000 7f953759e700 1 --2- 172.21.15.114:0/3562051711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9538144150 0x7f95381ede20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:11.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.252+0000 7f9536d9d700 1 -- 172.21.15.114:0/3562051711 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f95380ce1a0 msgr2=0x7f95381f1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:11.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.252+0000 7f9536d9d700 1 --2- 172.21.15.114:0/3562051711 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f95380ce1a0 0x7f95381f1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:11.268 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.252+0000 7f9536d9d700 1 -- 172.21.15.114:0/3562051711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9538144150 msgr2=0x7f95381ede20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:11.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.252+0000 7f9536d9d700 1 --2- 172.21.15.114:0/3562051711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9538144150 0x7f95381ede20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:11.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.252+0000 7f9536d9d700 1 -- 172.21.15.114:0/3562051711 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95280094b0 con 0x7f95380cbde0 2023-10-18T12:42:11.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.252+0000 7f953759e700 1 --2- 172.21.15.114:0/3562051711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9538144150 0x7f95381ede20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:42:11.269 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.256+0000 7f9536d9d700 1 --2- 172.21.15.114:0/3562051711 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95380cbde0 0x7f953813d490 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f952800ec10 tx=0x7f9528009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:11.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.256+0000 7f951f7fe700 1 -- 172.21.15.114:0/3562051711 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952800c8e0 con 0x7f95380cbde0 2023-10-18T12:42:11.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.256+0000 7f951f7fe700 1 -- 172.21.15.114:0/3562051711 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f952800ca40 con 0x7f95380cbde0 2023-10-18T12:42:11.270 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.256+0000 7f951f7fe700 1 -- 172.21.15.114:0/3562051711 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952800cdd0 con 0x7f95380cbde0 2023-10-18T12:42:11.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.256+0000 7f953c912700 1 -- 172.21.15.114:0/3562051711 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f952c0094b0 con 0x7f95380cbde0 2023-10-18T12:42:11.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.256+0000 7f953c912700 1 -- 172.21.15.114:0/3562051711 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95381eeb10 con 0x7f95380cbde0 2023-10-18T12:42:11.271 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.256+0000 7f953c912700 1 -- 172.21.15.114:0/3562051711 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9538072e60 con 0x7f95380cbde0 2023-10-18T12:42:11.272 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.256+0000 7f951f7fe700 1 -- 172.21.15.114:0/3562051711 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f9528013470 con 0x7f95380cbde0 2023-10-18T12:42:11.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.260+0000 7f951f7fe700 1 --2- 172.21.15.114:0/3562051711 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f95240656f0 0x7f9524067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:11.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.260+0000 7f951f7fe700 1 -- 172.21.15.114:0/3562051711 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5659+0+0 (secure 0 0 0) 0x7f9528082e20 con 0x7f95380cbde0 2023-10-18T12:42:11.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.260+0000 7f953659c700 1 --2- 172.21.15.114:0/3562051711 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f95240656f0 0x7f9524067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:11.273 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.260+0000 7f953659c700 1 --2- 172.21.15.114:0/3562051711 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f95240656f0 0x7f9524067bb0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f953806adb0 tx=0x7f952c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:11.274 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.264+0000 7f951f7fe700 1 -- 172.21.15.114:0/3562051711 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f95280509d0 con 0x7f95380cbde0 2023-10-18T12:42:11.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.552+0000 7f953c912700 1 -- 172.21.15.114:0/3562051711 --> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f9538070a70 con 0x7f95240656f0 2023-10-18T12:42:11.558 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.552+0000 7f951f7fe700 1 -- 172.21.15.114:0/3562051711 <== mgr.4108 v2:172.21.15.172:6832/461408666 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f952c011630 con 0x7f95240656f0 2023-10-18T12:42:11.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.556+0000 7f953c912700 1 -- 172.21.15.114:0/3562051711 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f95240656f0 msgr2=0x7f9524067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:11.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.556+0000 7f953c912700 1 --2- 172.21.15.114:0/3562051711 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f95240656f0 0x7f9524067bb0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f953806adb0 tx=0x7f952c008030 comp rx=0 tx=0).stop 2023-10-18T12:42:11.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.556+0000 7f953c912700 1 -- 172.21.15.114:0/3562051711 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95380cbde0 msgr2=0x7f953813d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:11.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.556+0000 7f953c912700 1 --2- 172.21.15.114:0/3562051711 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95380cbde0 0x7f953813d490 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f952800ec10 tx=0x7f9528009e30 comp rx=0 tx=0).stop 2023-10-18T12:42:11.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.556+0000 7f953c912700 1 -- 172.21.15.114:0/3562051711 shutdown_connections 2023-10-18T12:42:11.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.556+0000 7f953c912700 1 --2- 172.21.15.114:0/3562051711 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f95240656f0 0x7f9524067bb0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:11.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.556+0000 7f953c912700 1 --2- 172.21.15.114:0/3562051711 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f95380ce1a0 0x7f95381f1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:11.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.556+0000 7f953c912700 1 --2- 172.21.15.114:0/3562051711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9538144150 0x7f95381ede20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:11.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.556+0000 7f953c912700 1 --2- 172.21.15.114:0/3562051711 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95380cbde0 0x7f953813d490 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:11.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.556+0000 7f953c912700 1 -- 172.21.15.114:0/3562051711 >> 172.21.15.114:0/3562051711 conn(0x7f95380b0bf0 msgr2=0x7f9538143410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:11.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.556+0000 7f953c912700 1 -- 172.21.15.114:0/3562051711 shutdown_connections 2023-10-18T12:42:11.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.556+0000 7f953c912700 1 -- 172.21.15.114:0/3562051711 wait complete. 2023-10-18T12:42:11.567 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 3 to deep-scrub 2023-10-18T12:42:11.585 INFO:tasks.ceph:Scrubbing osd.4 2023-10-18T12:42:11.586 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-18T12:42:11.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.756+0000 7fdb4a564700 1 Processor -- start 2023-10-18T12:42:11.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.756+0000 7fdb4a564700 1 -- start start 2023-10-18T12:42:11.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.760+0000 7fdb4a564700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdb4415cde0 0x7fdb440708b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:11.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.760+0000 7fdb4a564700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fdb4406e440 0x7fdb440b64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:11.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.760+0000 7fdb4a564700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdb4406e8a0 0x7fdb440b6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:11.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.760+0000 7fdb4a564700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb4415d1c0 con 0x7fdb4406e8a0 2023-10-18T12:42:11.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.760+0000 7fdb4a564700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb44070df0 con 0x7fdb4406e440 2023-10-18T12:42:11.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.760+0000 7fdb4a564700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4406f810 con 0x7fdb4415cde0 2023-10-18T12:42:11.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.760+0000 7fdb48b01700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fdb4406e8a0 0x7fdb440b6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:11.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.760+0000 7fdb3bfff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fdb4406e440 0x7fdb440b64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:11.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.760+0000 7fdb3bfff700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fdb4406e440 0x7fdb440b64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:34182/0 (socket says 172.21.15.114:34182) 2023-10-18T12:42:11.769 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.760+0000 7fdb3bfff700 1 -- 172.21.15.114:0/3901624439 learned_addr learned my addr 172.21.15.114:0/3901624439 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:42:11.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.760+0000 7fdb43fff700 1 --2- 172.21.15.114:0/3901624439 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdb4415cde0 0x7fdb440708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:11.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.760+0000 7fdb3bfff700 1 -- 172.21.15.114:0/3901624439 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdb4415cde0 msgr2=0x7fdb440708b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:42:11.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.760+0000 7fdb3bfff700 1 --2- 172.21.15.114:0/3901624439 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdb4415cde0 0x7fdb440708b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:11.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.760+0000 7fdb3bfff700 1 -- 172.21.15.114:0/3901624439 >> v2:172.21.15.114:3300/0 conn(0x7fdb4406e8a0 msgr2=0x7fdb440b6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:42:11.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.760+0000 7fdb3bfff700 1 --2- 172.21.15.114:0/3901624439 >> v2:172.21.15.114:3300/0 conn(0x7fdb4406e8a0 0x7fdb440b6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:11.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.760+0000 7fdb3bfff700 1 -- 172.21.15.114:0/3901624439 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb4406faf0 con 0x7fdb4406e440 2023-10-18T12:42:11.771 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.760+0000 7fdb3bfff700 1 --2- 172.21.15.114:0/3901624439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb4406e440 0x7fdb440b64d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdb4406ba20 tx=0x7fdb2c009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4015de6937234daf server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:11.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.760+0000 7fdb437fe700 1 -- 172.21.15.114:0/3901624439 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c011830 con 0x7fdb4406e440 2023-10-18T12:42:11.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.760+0000 7fdb437fe700 1 -- 172.21.15.114:0/3901624439 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2c011990 con 0x7fdb4406e440 2023-10-18T12:42:11.772 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.760+0000 7fdb437fe700 1 -- 172.21.15.114:0/3901624439 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c011d20 con 0x7fdb4406e440 2023-10-18T12:42:11.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.764+0000 7fdb4a564700 1 -- 172.21.15.114:0/3901624439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb4406e440 msgr2=0x7fdb440b64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:11.773 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.764+0000 7fdb4a564700 1 --2- 172.21.15.114:0/3901624439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb4406e440 0x7fdb440b64d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdb4406ba20 tx=0x7fdb2c009bf0 comp rx=0 tx=0).stop 2023-10-18T12:42:11.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.764+0000 7fdb4a564700 1 -- 172.21.15.114:0/3901624439 shutdown_connections 2023-10-18T12:42:11.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.764+0000 7fdb4a564700 1 --2- 172.21.15.114:0/3901624439 >> v2:172.21.15.114:3300/0 conn(0x7fdb4406e8a0 0x7fdb440b6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:11.774 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.764+0000 7fdb4a564700 1 --2- 172.21.15.114:0/3901624439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb4406e440 0x7fdb440b64d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:11.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.764+0000 7fdb4a564700 1 --2- 172.21.15.114:0/3901624439 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdb4415cde0 0x7fdb440708b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:11.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.764+0000 7fdb4a564700 1 -- 172.21.15.114:0/3901624439 >> 172.21.15.114:0/3901624439 conn(0x7fdb4406a130 msgr2=0x7fdb4406a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:11.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.764+0000 7fdb4a564700 1 -- 172.21.15.114:0/3901624439 shutdown_connections 2023-10-18T12:42:11.775 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.764+0000 7fdb4a564700 1 -- 172.21.15.114:0/3901624439 wait complete. 2023-10-18T12:42:11.776 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.768+0000 7fdb4a564700 1 Processor -- start 2023-10-18T12:42:11.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.768+0000 7fdb4a564700 1 -- start start 2023-10-18T12:42:11.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.768+0000 7fdb4a564700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdb4406e440 0x7fdb4413e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:11.778 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.768+0000 7fdb4a564700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb4406e8a0 0x7fdb44152de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:11.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.768+0000 7fdb4a564700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb4415cde0 0x7fdb440d1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:11.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.768+0000 7fdb4a564700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb441411a0 con 0x7fdb4406e8a0 2023-10-18T12:42:11.779 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.768+0000 7fdb4a564700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb44141480 con 0x7fdb4415cde0 2023-10-18T12:42:11.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.768+0000 7fdb4a564700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb44141760 con 0x7fdb4406e440 2023-10-18T12:42:11.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.768+0000 7fdb3bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb4406e8a0 0x7fdb44152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:11.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.768+0000 7fdb3bfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb4406e8a0 0x7fdb44152de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36964/0 (socket says 172.21.15.114:36964) 2023-10-18T12:42:11.780 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.768+0000 7fdb3bfff700 1 -- 172.21.15.114:0/1406098419 learned_addr learned my addr 172.21.15.114:0/1406098419 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:42:11.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.768+0000 7fdb43fff700 1 --2- 172.21.15.114:0/1406098419 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdb4406e440 0x7fdb4413e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:11.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.768+0000 7fdb48b01700 1 --2- 172.21.15.114:0/1406098419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb4415cde0 0x7fdb440d1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:11.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.768+0000 7fdb3bfff700 1 -- 172.21.15.114:0/1406098419 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdb4406e440 msgr2=0x7fdb4413e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:11.781 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.768+0000 7fdb3bfff700 1 --2- 172.21.15.114:0/1406098419 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fdb4406e440 0x7fdb4413e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:11.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.768+0000 7fdb3bfff700 1 -- 172.21.15.114:0/1406098419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb4415cde0 msgr2=0x7fdb440d1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:11.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.768+0000 7fdb3bfff700 1 --2- 172.21.15.114:0/1406098419 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb4415cde0 0x7fdb440d1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:11.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.768+0000 7fdb3bfff700 1 -- 172.21.15.114:0/1406098419 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb2c009570 con 0x7fdb4406e8a0 2023-10-18T12:42:11.782 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.772+0000 7fdb3bfff700 1 --2- 172.21.15.114:0/1406098419 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb4406e8a0 0x7fdb44152de0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fdb44070f30 tx=0x7fdb2c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:11.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.772+0000 7fdb417fa700 1 -- 172.21.15.114:0/1406098419 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c004240 con 0x7fdb4406e8a0 2023-10-18T12:42:11.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.772+0000 7fdb417fa700 1 -- 172.21.15.114:0/1406098419 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2c01f070 con 0x7fdb4406e8a0 2023-10-18T12:42:11.783 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.772+0000 7fdb4a564700 1 -- 172.21.15.114:0/1406098419 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb44141a40 con 0x7fdb4406e8a0 2023-10-18T12:42:11.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.772+0000 7fdb417fa700 1 -- 172.21.15.114:0/1406098419 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c0045e0 con 0x7fdb4406e8a0 2023-10-18T12:42:11.784 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.772+0000 7fdb4a564700 1 -- 172.21.15.114:0/1406098419 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb4413ec80 con 0x7fdb4406e8a0 2023-10-18T12:42:11.785 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.772+0000 7fdb4a564700 1 -- 172.21.15.114:0/1406098419 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdb440700b0 con 0x7fdb4406e8a0 2023-10-18T12:42:11.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.776+0000 7fdb417fa700 1 -- 172.21.15.114:0/1406098419 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fdb2c021030 con 0x7fdb4406e8a0 2023-10-18T12:42:11.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.776+0000 7fdb417fa700 1 --2- 172.21.15.114:0/1406098419 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdb280656f0 0x7fdb28067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:11.786 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.776+0000 7fdb417fa700 1 -- 172.21.15.114:0/1406098419 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5659+0+0 (secure 0 0 0) 0x7fdb2c083bf0 con 0x7fdb4406e8a0 2023-10-18T12:42:11.787 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.776+0000 7fdb417fa700 1 --2- 172.21.15.114:0/1406098419 >> [v2:172.21.15.172:6800/930839681,v1:172.21.15.172:6801/930839681] conn(0x7fdb2806c060 0x7fdb2806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:11.787 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.776+0000 7fdb417fa700 1 -- 172.21.15.114:0/1406098419 --> [v2:172.21.15.172:6800/930839681,v1:172.21.15.172:6801/930839681] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdb2806eb70 con 0x7fdb2806c060 2023-10-18T12:42:11.787 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.776+0000 7fdb417fa700 1 -- 172.21.15.114:0/1406098419 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb2c0882a0 con 0x7fdb4406e8a0 2023-10-18T12:42:11.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.776+0000 7fdb43fff700 1 --2- 172.21.15.114:0/1406098419 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdb280656f0 0x7fdb28067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:11.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.776+0000 7fdb48b01700 1 --2- 172.21.15.114:0/1406098419 >> [v2:172.21.15.172:6800/930839681,v1:172.21.15.172:6801/930839681] conn(0x7fdb2806c060 0x7fdb2806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:11.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.780+0000 7fdb43fff700 1 --2- 172.21.15.114:0/1406098419 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdb280656f0 0x7fdb28067bb0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fdb34009b50 tx=0x7fdb34009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:11.788 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.780+0000 7fdb48b01700 1 --2- 172.21.15.114:0/1406098419 >> [v2:172.21.15.172:6800/930839681,v1:172.21.15.172:6801/930839681] conn(0x7fdb2806c060 0x7fdb2806e4a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:11.789 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.780+0000 7fdb417fa700 1 -- 172.21.15.114:0/1406098419 <== osd.4 v2:172.21.15.172:6800/930839681 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fdb2806eb70 con 0x7fdb2806c060 2023-10-18T12:42:11.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.800+0000 7fdb4a564700 1 -- 172.21.15.114:0/1406098419 --> [v2:172.21.15.172:6800/930839681,v1:172.21.15.172:6801/930839681] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fdb4406fdd0 con 0x7fdb2806c060 2023-10-18T12:42:11.807 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.800+0000 7fdb417fa700 1 -- 172.21.15.114:0/1406098419 <== osd.4 v2:172.21.15.172:6800/930839681 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fdb3c007510 con 0x7fdb2806c060 2023-10-18T12:42:11.808 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T12:42:11.808 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-18T12:42:11.808 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T12:42:11.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.800+0000 7fdb4a564700 1 -- 172.21.15.114:0/1406098419 >> [v2:172.21.15.172:6800/930839681,v1:172.21.15.172:6801/930839681] conn(0x7fdb2806c060 msgr2=0x7fdb2806e4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:11.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.800+0000 7fdb4a564700 1 --2- 172.21.15.114:0/1406098419 >> [v2:172.21.15.172:6800/930839681,v1:172.21.15.172:6801/930839681] conn(0x7fdb2806c060 0x7fdb2806e4a0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:11.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.800+0000 7fdb4a564700 1 -- 172.21.15.114:0/1406098419 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdb280656f0 msgr2=0x7fdb28067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:11.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.800+0000 7fdb4a564700 1 --2- 172.21.15.114:0/1406098419 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fdb280656f0 0x7fdb28067bb0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fdb34009b50 tx=0x7fdb34009240 comp rx=0 tx=0).stop 2023-10-18T12:42:11.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.800+0000 7fdb4a564700 1 -- 172.21.15.114:0/1406098419 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb4406e8a0 msgr2=0x7fdb44152de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:11.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.800+0000 7fdb4a564700 1 --2- 172.21.15.114:0/1406098419 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb4406e8a0 0x7fdb44152de0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fdb44070f30 tx=0x7fdb2c004770 comp rx=0 tx=0).stop 2023-10-18T12:42:11.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.800+0000 7fdb48b01700 1 -- 172.21.15.114:0/1406098419 reap_dead start 2023-10-18T12:42:11.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.804+0000 7fdb4a564700 1 -- 172.21.15.114:0/1406098419 shutdown_connections 2023-10-18T12:42:11.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.804+0000 7fdb4a564700 1 -- 172.21.15.114:0/1406098419 >> 172.21.15.114:0/1406098419 conn(0x7fdb4406a130 msgr2=0x7fdb440d0120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:11.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.804+0000 7fdb4a564700 1 -- 172.21.15.114:0/1406098419 shutdown_connections 2023-10-18T12:42:11.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:11.804+0000 7fdb4a564700 1 -- 172.21.15.114:0/1406098419 wait complete. 2023-10-18T12:42:11.832 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-18T12:42:12.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.020+0000 7fc2f6e25700 1 Processor -- start 2023-10-18T12:42:12.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.020+0000 7fc2f6e25700 1 -- start start 2023-10-18T12:42:12.030 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.024+0000 7fc2f6e25700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc2f00adb60 0x7fc2f00cb190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:12.031 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.024+0000 7fc2f6e25700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f0165770 con 0x7fc2f00cb6d0 2023-10-18T12:42:12.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.024+0000 7fc2f6e25700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f00cbb00 con 0x7fc2f0161230 2023-10-18T12:42:12.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.024+0000 7fc2f6e25700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2f006ea40 con 0x7fc2f00adb60 2023-10-18T12:42:12.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.024+0000 7fc2effff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc2f00adb60 0x7fc2f00cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:12.032 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.024+0000 7fc2effff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fc2f00adb60 0x7fc2f00cb190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36968/0 (socket says 172.21.15.114:36968) 2023-10-18T12:42:12.033 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.024+0000 7fc2effff700 1 -- 172.21.15.114:0/1051150390 learned_addr learned my addr 172.21.15.114:0/1051150390 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:42:12.034 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.024+0000 7fc2effff700 1 -- 172.21.15.114:0/1051150390 >> v1:172.21.15.172:6789/0 conn(0x7fc2f0161230 legacy=0x7fc2f006ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:12.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.024+0000 7fc2effff700 1 -- 172.21.15.114:0/1051150390 >> v1:172.21.15.114:6789/0 conn(0x7fc2f00cb6d0 legacy=0x7fc2f00cc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:12.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.024+0000 7fc2effff700 1 -- 172.21.15.114:0/1051150390 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f0161610 con 0x7fc2f00adb60 2023-10-18T12:42:12.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.028+0000 7fc2effff700 1 --2- 172.21.15.114:0/1051150390 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2f00adb60 0x7fc2f00cb190 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0009910 tx=0x7fc2e0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d2c4bf0f9aca304 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:12.035 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.028+0000 7fc2ef7fe700 1 -- 172.21.15.114:0/1051150390 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e000ba60 con 0x7fc2f00adb60 2023-10-18T12:42:12.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.028+0000 7fc2ef7fe700 1 -- 172.21.15.114:0/1051150390 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e000bbc0 con 0x7fc2f00adb60 2023-10-18T12:42:12.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.028+0000 7fc2ef7fe700 1 -- 172.21.15.114:0/1051150390 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e0009e60 con 0x7fc2f00adb60 2023-10-18T12:42:12.036 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.028+0000 7fc2f6e25700 1 -- 172.21.15.114:0/1051150390 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2f00adb60 msgr2=0x7fc2f00cb190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:12.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.028+0000 7fc2f6e25700 1 --2- 172.21.15.114:0/1051150390 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2f00adb60 0x7fc2f00cb190 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0009910 tx=0x7fc2e0009c20 comp rx=0 tx=0).stop 2023-10-18T12:42:12.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.028+0000 7fc2f6e25700 1 -- 172.21.15.114:0/1051150390 shutdown_connections 2023-10-18T12:42:12.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.028+0000 7fc2f6e25700 1 --2- 172.21.15.114:0/1051150390 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2f00adb60 0x7fc2f00cb190 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:12.037 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.028+0000 7fc2f6e25700 1 -- 172.21.15.114:0/1051150390 >> 172.21.15.114:0/1051150390 conn(0x7fc2f006a340 msgr2=0x7fc2f00b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:12.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.028+0000 7fc2f6e25700 1 -- 172.21.15.114:0/1051150390 shutdown_connections 2023-10-18T12:42:12.038 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.028+0000 7fc2f6e25700 1 -- 172.21.15.114:0/1051150390 wait complete. 2023-10-18T12:42:12.040 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.032+0000 7fc2f6e25700 1 Processor -- start 2023-10-18T12:42:12.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.032+0000 7fc2f6e25700 1 -- start start 2023-10-18T12:42:12.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.032+0000 7fc2f6e25700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2f00adb60 0x7fc2f00cdad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:12.041 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.032+0000 7fc2f6e25700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc2f00cb6d0 0x7fc2f00ce010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:12.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.032+0000 7fc2f6e25700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2f0161230 0x7fc2f01fa1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:12.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.032+0000 7fc2f6e25700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f015cf50 con 0x7fc2f00adb60 2023-10-18T12:42:12.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.032+0000 7fc2f6e25700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f01f7960 con 0x7fc2f0161230 2023-10-18T12:42:12.042 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.032+0000 7fc2f6e25700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f015d160 con 0x7fc2f00cb6d0 2023-10-18T12:42:12.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.032+0000 7fc2f4bc1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2f00adb60 0x7fc2f00cdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:12.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.032+0000 7fc2f4bc1700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2f00adb60 0x7fc2f00cdad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36980/0 (socket says 172.21.15.114:36980) 2023-10-18T12:42:12.043 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.032+0000 7fc2f4bc1700 1 -- 172.21.15.114:0/1267271193 learned_addr learned my addr 172.21.15.114:0/1267271193 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:42:12.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.032+0000 7fc2f53c2700 1 --2- 172.21.15.114:0/1267271193 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2f0161230 0x7fc2f01fa1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:12.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.032+0000 7fc2effff700 1 --2- 172.21.15.114:0/1267271193 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc2f00cb6d0 0x7fc2f00ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:12.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.032+0000 7fc2f4bc1700 1 -- 172.21.15.114:0/1267271193 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc2f00cb6d0 msgr2=0x7fc2f00ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:12.044 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.032+0000 7fc2f4bc1700 1 --2- 172.21.15.114:0/1267271193 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc2f00cb6d0 0x7fc2f00ce010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:12.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.032+0000 7fc2f4bc1700 1 -- 172.21.15.114:0/1267271193 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2f0161230 msgr2=0x7fc2f01fa1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:12.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.032+0000 7fc2f4bc1700 1 --2- 172.21.15.114:0/1267271193 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2f0161230 0x7fc2f01fa1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:12.045 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.032+0000 7fc2f4bc1700 1 -- 172.21.15.114:0/1267271193 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e0009570 con 0x7fc2f00adb60 2023-10-18T12:42:12.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.032+0000 7fc2f53c2700 1 --2- 172.21.15.114:0/1267271193 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2f0161230 0x7fc2f01fa1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:42:12.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.036+0000 7fc2f4bc1700 1 --2- 172.21.15.114:0/1267271193 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2f00adb60 0x7fc2f00cdad0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fc2e400c500 tx=0x7fc2e400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:12.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.036+0000 7fc2ed7fa700 1 -- 172.21.15.114:0/1267271193 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e40052d0 con 0x7fc2f00adb60 2023-10-18T12:42:12.046 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.036+0000 7fc2ed7fa700 1 -- 172.21.15.114:0/1267271193 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e4005430 con 0x7fc2f00adb60 2023-10-18T12:42:12.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.036+0000 7fc2ed7fa700 1 -- 172.21.15.114:0/1267271193 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e40055a0 con 0x7fc2f00adb60 2023-10-18T12:42:12.047 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.036+0000 7fc2f6e25700 1 -- 172.21.15.114:0/1267271193 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2f015d440 con 0x7fc2f00adb60 2023-10-18T12:42:12.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.036+0000 7fc2f6e25700 1 -- 172.21.15.114:0/1267271193 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f015dc40 con 0x7fc2f00adb60 2023-10-18T12:42:12.048 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.036+0000 7fc2f6e25700 1 -- 172.21.15.114:0/1267271193 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f0072e60 con 0x7fc2f00adb60 2023-10-18T12:42:12.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.040+0000 7fc2ed7fa700 1 -- 172.21.15.114:0/1267271193 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fc2e40038e0 con 0x7fc2f00adb60 2023-10-18T12:42:12.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.040+0000 7fc2ed7fa700 1 --2- 172.21.15.114:0/1267271193 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc2dc065720 0x7fc2dc067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:12.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.040+0000 7fc2ed7fa700 1 -- 172.21.15.114:0/1267271193 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5659+0+0 (secure 0 0 0) 0x7fc2e40820a0 con 0x7fc2f00adb60 2023-10-18T12:42:12.049 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.040+0000 7fc2effff700 1 --2- 172.21.15.114:0/1267271193 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc2dc065720 0x7fc2dc067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:12.050 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.040+0000 7fc2effff700 1 --2- 172.21.15.114:0/1267271193 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc2dc065720 0x7fc2dc067be0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0006f80 tx=0x7fc2e0008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:12.052 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.044+0000 7fc2ed7fa700 1 -- 172.21.15.114:0/1267271193 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fc2e404fce0 con 0x7fc2f00adb60 2023-10-18T12:42:12.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.332+0000 7fc2f6e25700 1 -- 172.21.15.114:0/1267271193 --> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fc2f006ecb0 con 0x7fc2dc065720 2023-10-18T12:42:12.338 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.332+0000 7fc2ed7fa700 1 -- 172.21.15.114:0/1267271193 <== mgr.4108 v2:172.21.15.172:6832/461408666 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc2e000b960 con 0x7fc2dc065720 2023-10-18T12:42:12.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.336+0000 7fc2f6e25700 1 -- 172.21.15.114:0/1267271193 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc2dc065720 msgr2=0x7fc2dc067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:12.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.336+0000 7fc2f6e25700 1 --2- 172.21.15.114:0/1267271193 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc2dc065720 0x7fc2dc067be0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0006f80 tx=0x7fc2e0008030 comp rx=0 tx=0).stop 2023-10-18T12:42:12.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.336+0000 7fc2f6e25700 1 -- 172.21.15.114:0/1267271193 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2f00adb60 msgr2=0x7fc2f00cdad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:12.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.336+0000 7fc2f6e25700 1 --2- 172.21.15.114:0/1267271193 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2f00adb60 0x7fc2f00cdad0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fc2e400c500 tx=0x7fc2e400c810 comp rx=0 tx=0).stop 2023-10-18T12:42:12.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.336+0000 7fc2f6e25700 1 -- 172.21.15.114:0/1267271193 shutdown_connections 2023-10-18T12:42:12.343 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.336+0000 7fc2f6e25700 1 --2- 172.21.15.114:0/1267271193 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fc2dc065720 0x7fc2dc067be0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:12.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.336+0000 7fc2f6e25700 1 --2- 172.21.15.114:0/1267271193 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fc2f00cb6d0 0x7fc2f00ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:12.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.336+0000 7fc2f6e25700 1 --2- 172.21.15.114:0/1267271193 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2f0161230 0x7fc2f01fa1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:12.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.336+0000 7fc2f6e25700 1 --2- 172.21.15.114:0/1267271193 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc2f00adb60 0x7fc2f00cdad0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:12.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.336+0000 7fc2f6e25700 1 -- 172.21.15.114:0/1267271193 >> 172.21.15.114:0/1267271193 conn(0x7fc2f006a340 msgr2=0x7fc2f00aed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:12.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.336+0000 7fc2f6e25700 1 -- 172.21.15.114:0/1267271193 shutdown_connections 2023-10-18T12:42:12.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.336+0000 7fc2f6e25700 1 -- 172.21.15.114:0/1267271193 wait complete. 2023-10-18T12:42:12.346 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 4 to deep-scrub 2023-10-18T12:42:12.364 INFO:tasks.ceph:Scrubbing osd.5 2023-10-18T12:42:12.364 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-18T12:42:12.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.548+0000 7f1444f9e700 1 Processor -- start 2023-10-18T12:42:12.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.548+0000 7f1444f9e700 1 -- start start 2023-10-18T12:42:12.557 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.552+0000 7f1444f9e700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f14401467a0 0x7f14400b5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:12.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.552+0000 7f1444f9e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f144006f5f0 con 0x7f14400cf490 2023-10-18T12:42:12.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.552+0000 7f1444f9e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14400d1960 con 0x7f14400b5560 2023-10-18T12:42:12.559 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.552+0000 7f1444f9e700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14400cf9f0 con 0x7f14401467a0 2023-10-18T12:42:12.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.552+0000 7f143ffff700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f14400cf490 0x7f144006fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50842/0 (socket says 172.21.15.114:50842) 2023-10-18T12:42:12.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.552+0000 7f143ffff700 1 -- 172.21.15.114:0/3787314886 learned_addr learned my addr 172.21.15.114:0/3787314886 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:42:12.560 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.552+0000 7f143f7fe700 1 --2- 172.21.15.114:0/3787314886 >> v2:172.21.15.172:3300/0 conn(0x7f14401467a0 0x7f14400b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:12.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.552+0000 7f143e7fc700 1 -- 172.21.15.114:0/3787314886 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4093398047 0 0) 0x7f144006f5f0 con 0x7f14400cf490 2023-10-18T12:42:12.561 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.552+0000 7f143e7fc700 1 -- 172.21.15.114:0/3787314886 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14280035d0 con 0x7f14400cf490 2023-10-18T12:42:12.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.552+0000 7f143e7fc700 1 -- 172.21.15.114:0/3787314886 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2228358540 0 0) 0x7f14280035d0 con 0x7f14400cf490 2023-10-18T12:42:12.563 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.552+0000 7f143e7fc700 1 -- 172.21.15.114:0/3787314886 >> v2:172.21.15.172:3300/0 conn(0x7f14401467a0 msgr2=0x7f14400b5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:42:12.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.552+0000 7f143e7fc700 1 --2- 172.21.15.114:0/3787314886 >> v2:172.21.15.172:3300/0 conn(0x7f14401467a0 0x7f14400b5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:12.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.552+0000 7f143e7fc700 1 -- 172.21.15.114:0/3787314886 >> v1:172.21.15.172:6789/0 conn(0x7f14400b5560 legacy=0x7f14400ced80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:12.564 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.552+0000 7f143e7fc700 1 -- 172.21.15.114:0/3787314886 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14400d1c40 con 0x7f14400cf490 2023-10-18T12:42:12.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.552+0000 7f143e7fc700 1 -- 172.21.15.114:0/3787314886 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3368469509 0 0) 0x7f14380019f0 con 0x7f14400cf490 2023-10-18T12:42:12.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.552+0000 7f143e7fc700 1 -- 172.21.15.114:0/3787314886 >> v1:172.21.15.114:6789/0 conn(0x7f14400cf490 legacy=0x7f144006fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:12.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.552+0000 7f143e7fc700 1 --2- 172.21.15.114:0/3787314886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1428003a20 0x7f1428003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:12.565 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.552+0000 7f143e7fc700 1 --2- 172.21.15.114:0/3787314886 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1428004870 0x7f1428004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:12.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.552+0000 7f143e7fc700 1 --2- 172.21.15.114:0/3787314886 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1428005230 0x7f142800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:12.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.552+0000 7f143e7fc700 1 -- 172.21.15.114:0/3787314886 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14400cf9f0 con 0x7f1428005230 2023-10-18T12:42:12.566 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.552+0000 7f143e7fc700 1 -- 172.21.15.114:0/3787314886 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142800c0d0 con 0x7f1428003a20 2023-10-18T12:42:12.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.552+0000 7f143e7fc700 1 -- 172.21.15.114:0/3787314886 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f142800c290 con 0x7f1428004870 2023-10-18T12:42:12.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.556+0000 7f143f7fe700 1 --2- 172.21.15.114:0/3787314886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1428003a20 0x7f1428003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:12.567 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.556+0000 7f143ffff700 1 --2- 172.21.15.114:0/3787314886 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1428005230 0x7f142800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:12.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.556+0000 7f143effd700 1 --2- 172.21.15.114:0/3787314886 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1428004870 0x7f1428004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:12.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.556+0000 7f143ffff700 1 -- 172.21.15.114:0/3787314886 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1428004870 msgr2=0x7f1428004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:42:12.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.556+0000 7f143ffff700 1 --2- 172.21.15.114:0/3787314886 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1428004870 0x7f1428004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:12.568 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.556+0000 7f143ffff700 1 -- 172.21.15.114:0/3787314886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1428003a20 msgr2=0x7f1428003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:42:12.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.556+0000 7f143ffff700 1 --2- 172.21.15.114:0/3787314886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1428003a20 0x7f1428003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:12.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.556+0000 7f143ffff700 1 -- 172.21.15.114:0/3787314886 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14280035d0 con 0x7f1428005230 2023-10-18T12:42:12.569 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.556+0000 7f143f7fe700 1 --2- 172.21.15.114:0/3787314886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1428003a20 0x7f1428003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:42:12.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.556+0000 7f143ffff700 1 -- 172.21.15.114:0/3787314886 reap_dead start 2023-10-18T12:42:12.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.556+0000 7f143ffff700 1 --2- 172.21.15.114:0/3787314886 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1428005230 0x7f142800ba30 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f1440072a60 tx=0x7f14280058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2573f23ca879a4b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:12.570 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.556+0000 7f143e7fc700 1 -- 172.21.15.114:0/3787314886 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143800a2f0 con 0x7f1428005230 2023-10-18T12:42:12.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.556+0000 7f143e7fc700 1 -- 172.21.15.114:0/3787314886 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f143800ae90 con 0x7f1428005230 2023-10-18T12:42:12.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.556+0000 7f143e7fc700 1 -- 172.21.15.114:0/3787314886 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1438007530 con 0x7f1428005230 2023-10-18T12:42:12.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.556+0000 7f1444f9e700 1 -- 172.21.15.114:0/3787314886 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1428005230 msgr2=0x7f142800ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:12.571 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.556+0000 7f1444f9e700 1 --2- 172.21.15.114:0/3787314886 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1428005230 0x7f142800ba30 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f1440072a60 tx=0x7f14280058a0 comp rx=0 tx=0).stop 2023-10-18T12:42:12.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.556+0000 7f1444f9e700 1 -- 172.21.15.114:0/3787314886 shutdown_connections 2023-10-18T12:42:12.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.556+0000 7f1444f9e700 1 --2- 172.21.15.114:0/3787314886 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1428005230 0x7f142800ba30 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:12.574 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.556+0000 7f1444f9e700 1 -- 172.21.15.114:0/3787314886 >> 172.21.15.114:0/3787314886 conn(0x7f144006ce90 msgr2=0x7f14400b7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:12.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.556+0000 7f1444f9e700 1 -- 172.21.15.114:0/3787314886 shutdown_connections 2023-10-18T12:42:12.575 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.556+0000 7f1444f9e700 1 -- 172.21.15.114:0/3787314886 wait complete. 2023-10-18T12:42:12.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.560+0000 7f1444f9e700 1 Processor -- start 2023-10-18T12:42:12.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.560+0000 7f1444f9e700 1 -- start start 2023-10-18T12:42:12.576 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.564+0000 7f1444f9e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1428005230 0x7f144013ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:12.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.564+0000 7f1444f9e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f144013ed60 0x7f144015c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:12.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.564+0000 7f1444f9e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f144013f1e0 0x7f144015c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:12.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.564+0000 7f1444f9e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144013f7b0 con 0x7f144013ed60 2023-10-18T12:42:12.577 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.564+0000 7f1444f9e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144013c590 con 0x7f144013f1e0 2023-10-18T12:42:12.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.564+0000 7f1444f9e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f144013c870 con 0x7f1428005230 2023-10-18T12:42:12.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.564+0000 7f143effd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f144013ed60 0x7f144015c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:12.578 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.564+0000 7f143effd700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f144013ed60 0x7f144015c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36988/0 (socket says 172.21.15.114:36988) 2023-10-18T12:42:12.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.564+0000 7f143effd700 1 -- 172.21.15.114:0/908943015 learned_addr learned my addr 172.21.15.114:0/908943015 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:42:12.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.564+0000 7f143ffff700 1 --2- 172.21.15.114:0/908943015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f144013f1e0 0x7f144015c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:12.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.564+0000 7f143f7fe700 1 --2- 172.21.15.114:0/908943015 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1428005230 0x7f144013ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:12.579 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.564+0000 7f143effd700 1 -- 172.21.15.114:0/908943015 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1428005230 msgr2=0x7f144013ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:12.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.564+0000 7f143effd700 1 --2- 172.21.15.114:0/908943015 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f1428005230 0x7f144013ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:12.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.564+0000 7f143effd700 1 -- 172.21.15.114:0/908943015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f144013f1e0 msgr2=0x7f144015c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:12.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.564+0000 7f143effd700 1 --2- 172.21.15.114:0/908943015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f144013f1e0 0x7f144015c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:12.580 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.564+0000 7f143effd700 1 -- 172.21.15.114:0/908943015 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f144013cb50 con 0x7f144013ed60 2023-10-18T12:42:12.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.564+0000 7f143ffff700 1 --2- 172.21.15.114:0/908943015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f144013f1e0 0x7f144015c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:42:12.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.564+0000 7f143effd700 1 --2- 172.21.15.114:0/908943015 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f144013ed60 0x7f144015c040 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f143400f7f0 tx=0x7f143400fbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:12.581 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.564+0000 7f1427fff700 1 -- 172.21.15.114:0/908943015 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1434005320 con 0x7f144013ed60 2023-10-18T12:42:12.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.564+0000 7f1427fff700 1 -- 172.21.15.114:0/908943015 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1434005480 con 0x7f144013ed60 2023-10-18T12:42:12.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.564+0000 7f1444f9e700 1 -- 172.21.15.114:0/908943015 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f144013ce30 con 0x7f144013ed60 2023-10-18T12:42:12.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.564+0000 7f1427fff700 1 -- 172.21.15.114:0/908943015 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1434006aa0 con 0x7f144013ed60 2023-10-18T12:42:12.582 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.564+0000 7f1444f9e700 1 -- 172.21.15.114:0/908943015 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f144013b370 con 0x7f144013ed60 2023-10-18T12:42:12.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.568+0000 7f1444f9e700 1 -- 172.21.15.114:0/908943015 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1440139fc0 con 0x7f144013ed60 2023-10-18T12:42:12.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.568+0000 7f1427fff700 1 -- 172.21.15.114:0/908943015 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f1434006c00 con 0x7f144013ed60 2023-10-18T12:42:12.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.568+0000 7f1427fff700 1 --2- 172.21.15.114:0/908943015 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f142c065720 0x7f142c067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:12.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.568+0000 7f1427fff700 1 -- 172.21.15.114:0/908943015 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5659+0+0 (secure 0 0 0) 0x7f14340825a0 con 0x7f144013ed60 2023-10-18T12:42:12.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.568+0000 7f1427fff700 1 --2- 172.21.15.114:0/908943015 >> [v2:172.21.15.172:6812/571761850,v1:172.21.15.172:6814/571761850] conn(0x7f142c06c090 0x7f142c06e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:12.585 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.568+0000 7f1427fff700 1 -- 172.21.15.114:0/908943015 --> [v2:172.21.15.172:6812/571761850,v1:172.21.15.172:6814/571761850] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f142c06eba0 con 0x7f142c06c090 2023-10-18T12:42:12.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.568+0000 7f143f7fe700 1 --2- 172.21.15.114:0/908943015 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f142c065720 0x7f142c067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:12.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.568+0000 7f1427fff700 1 -- 172.21.15.114:0/908943015 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1434084b80 con 0x7f144013ed60 2023-10-18T12:42:12.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.572+0000 7f143ffff700 1 --2- 172.21.15.114:0/908943015 >> [v2:172.21.15.172:6812/571761850,v1:172.21.15.172:6814/571761850] conn(0x7f142c06c090 0x7f142c06e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:12.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.572+0000 7f143f7fe700 1 --2- 172.21.15.114:0/908943015 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f142c065720 0x7f142c067be0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1440138de0 tx=0x7f1430008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:12.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.572+0000 7f143ffff700 1 --2- 172.21.15.114:0/908943015 >> [v2:172.21.15.172:6812/571761850,v1:172.21.15.172:6814/571761850] conn(0x7f142c06c090 0x7f142c06e4d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:12.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.572+0000 7f1427fff700 1 -- 172.21.15.114:0/908943015 <== osd.5 v2:172.21.15.172:6812/571761850 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f142c06eba0 con 0x7f142c06c090 2023-10-18T12:42:12.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.592+0000 7f1444f9e700 1 -- 172.21.15.114:0/908943015 --> [v2:172.21.15.172:6812/571761850,v1:172.21.15.172:6814/571761850] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f14400d1f20 con 0x7f142c06c090 2023-10-18T12:42:12.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.592+0000 7f1427fff700 1 -- 172.21.15.114:0/908943015 <== osd.5 v2:172.21.15.172:6812/571761850 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f14380017b0 con 0x7f142c06c090 2023-10-18T12:42:12.599 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T12:42:12.599 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-18T12:42:12.599 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T12:42:12.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.592+0000 7f1444f9e700 1 -- 172.21.15.114:0/908943015 >> [v2:172.21.15.172:6812/571761850,v1:172.21.15.172:6814/571761850] conn(0x7f142c06c090 msgr2=0x7f142c06e4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:12.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.592+0000 7f1444f9e700 1 --2- 172.21.15.114:0/908943015 >> [v2:172.21.15.172:6812/571761850,v1:172.21.15.172:6814/571761850] conn(0x7f142c06c090 0x7f142c06e4d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:12.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.592+0000 7f1444f9e700 1 -- 172.21.15.114:0/908943015 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f142c065720 msgr2=0x7f142c067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:12.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.592+0000 7f1444f9e700 1 --2- 172.21.15.114:0/908943015 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f142c065720 0x7f142c067be0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1440138de0 tx=0x7f1430008040 comp rx=0 tx=0).stop 2023-10-18T12:42:12.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.592+0000 7f1444f9e700 1 -- 172.21.15.114:0/908943015 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f144013ed60 msgr2=0x7f144015c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:12.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.592+0000 7f1444f9e700 1 --2- 172.21.15.114:0/908943015 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f144013ed60 0x7f144015c040 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f143400f7f0 tx=0x7f143400fbb0 comp rx=0 tx=0).stop 2023-10-18T12:42:12.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.592+0000 7f143ffff700 1 -- 172.21.15.114:0/908943015 reap_dead start 2023-10-18T12:42:12.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.592+0000 7f1444f9e700 1 -- 172.21.15.114:0/908943015 shutdown_connections 2023-10-18T12:42:12.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.592+0000 7f1444f9e700 1 -- 172.21.15.114:0/908943015 >> 172.21.15.114:0/908943015 conn(0x7f144006ce90 msgr2=0x7f14401415c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:12.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.592+0000 7f1444f9e700 1 -- 172.21.15.114:0/908943015 shutdown_connections 2023-10-18T12:42:12.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.596+0000 7f1444f9e700 1 -- 172.21.15.114:0/908943015 wait complete. 2023-10-18T12:42:12.623 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-18T12:42:12.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.796+0000 7ff0f8948700 1 Processor -- start 2023-10-18T12:42:12.801 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.796+0000 7ff0f8948700 1 -- start start 2023-10-18T12:42:12.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.796+0000 7ff0f8948700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0f4160e50 0x7ff0f406e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:12.804 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.796+0000 7ff0f8948700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7ff0f40cb500 0x7ff0f40b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:12.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.796+0000 7ff0f8948700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff0f40b2720 0x7ff0f4164af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:12.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.796+0000 7ff0f8948700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0f40b1ee0 con 0x7ff0f40b2720 2023-10-18T12:42:12.805 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.800+0000 7ff0f8948700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0f40b2b90 con 0x7ff0f40cb500 2023-10-18T12:42:12.806 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.800+0000 7ff0f8948700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f40b16d0 con 0x7ff0f4160e50 2023-10-18T12:42:12.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.800+0000 7ff0f3fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff0f40b2720 0x7ff0f4164af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:12.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.800+0000 7ff0f3fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7ff0f40b2720 0x7ff0f4164af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:36996/0 (socket says 172.21.15.114:36996) 2023-10-18T12:42:12.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.800+0000 7ff0f3fff700 1 -- 172.21.15.114:0/4133121424 learned_addr learned my addr 172.21.15.114:0/4133121424 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:42:12.808 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.800+0000 7ff0f37fe700 1 --2- 172.21.15.114:0/4133121424 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0f4160e50 0x7ff0f406e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:12.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.800+0000 7ff0eaffd700 1 --2- 172.21.15.114:0/4133121424 >> v2:172.21.15.172:3300/0 conn(0x7ff0f40cb500 0x7ff0f40b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:12.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.800+0000 7ff0f3fff700 1 -- 172.21.15.114:0/4133121424 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0f4160e50 msgr2=0x7ff0f406e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:42:12.809 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.800+0000 7ff0f3fff700 1 --2- 172.21.15.114:0/4133121424 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0f4160e50 0x7ff0f406e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:12.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.800+0000 7ff0f3fff700 1 -- 172.21.15.114:0/4133121424 >> v2:172.21.15.172:3300/0 conn(0x7ff0f40cb500 msgr2=0x7ff0f40b21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:42:12.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.800+0000 7ff0f3fff700 1 --2- 172.21.15.114:0/4133121424 >> v2:172.21.15.172:3300/0 conn(0x7ff0f40cb500 0x7ff0f40b21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:12.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.800+0000 7ff0f3fff700 1 -- 172.21.15.114:0/4133121424 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f40ae0f0 con 0x7ff0f40b2720 2023-10-18T12:42:12.810 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.800+0000 7ff0eaffd700 1 --2- 172.21.15.114:0/4133121424 >> v2:172.21.15.172:3300/0 conn(0x7ff0f40cb500 0x7ff0f40b21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:42:12.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.800+0000 7ff0f3fff700 1 --2- 172.21.15.114:0/4133121424 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0f40b2720 0x7ff0f4164af0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7ff0f406af10 tx=0x7ff0ec009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6ea9c7c2de85e6e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:12.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.800+0000 7ff0f2ffd700 1 -- 172.21.15.114:0/4133121424 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec00ba20 con 0x7ff0f40b2720 2023-10-18T12:42:12.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.800+0000 7ff0f2ffd700 1 -- 172.21.15.114:0/4133121424 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0ec00bb80 con 0x7ff0f40b2720 2023-10-18T12:42:12.811 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.800+0000 7ff0f2ffd700 1 -- 172.21.15.114:0/4133121424 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec009e60 con 0x7ff0f40b2720 2023-10-18T12:42:12.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.800+0000 7ff0f8948700 1 -- 172.21.15.114:0/4133121424 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0f40b2720 msgr2=0x7ff0f4164af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:12.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.800+0000 7ff0f8948700 1 --2- 172.21.15.114:0/4133121424 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0f40b2720 0x7ff0f4164af0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7ff0f406af10 tx=0x7ff0ec009c20 comp rx=0 tx=0).stop 2023-10-18T12:42:12.812 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.800+0000 7ff0f8948700 1 -- 172.21.15.114:0/4133121424 shutdown_connections 2023-10-18T12:42:12.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.800+0000 7ff0f8948700 1 --2- 172.21.15.114:0/4133121424 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0f40b2720 0x7ff0f4164af0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:12.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.800+0000 7ff0f8948700 1 --2- 172.21.15.114:0/4133121424 >> v2:172.21.15.172:3300/0 conn(0x7ff0f40cb500 0x7ff0f40b21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:12.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.800+0000 7ff0f8948700 1 --2- 172.21.15.114:0/4133121424 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0f4160e50 0x7ff0f406e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:12.813 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.800+0000 7ff0f8948700 1 -- 172.21.15.114:0/4133121424 >> 172.21.15.114:0/4133121424 conn(0x7ff0f40b0bf0 msgr2=0x7ff0f40ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:12.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.800+0000 7ff0f8948700 1 -- 172.21.15.114:0/4133121424 shutdown_connections 2023-10-18T12:42:12.814 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.800+0000 7ff0f8948700 1 -- 172.21.15.114:0/4133121424 wait complete. 2023-10-18T12:42:12.816 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.804+0000 7ff0f8948700 1 Processor -- start 2023-10-18T12:42:12.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.804+0000 7ff0f8948700 1 -- start start 2023-10-18T12:42:12.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.808+0000 7ff0f8948700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0f40b2720 0x7ff0f4149830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:12.817 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.808+0000 7ff0f8948700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0f40cb500 0x7ff0f415f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:12.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.808+0000 7ff0f8948700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0f4160e50 0x7ff0f415f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:12.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.808+0000 7ff0f8948700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f4149d70 con 0x7ff0f40b2720 2023-10-18T12:42:12.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.808+0000 7ff0f8948700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f4161730 con 0x7ff0f4160e50 2023-10-18T12:42:12.818 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.808+0000 7ff0f8948700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f4161a10 con 0x7ff0f40cb500 2023-10-18T12:42:12.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.808+0000 7ff0f37fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0f40b2720 0x7ff0f4149830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:12.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.808+0000 7ff0f37fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0f40b2720 0x7ff0f4149830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37010/0 (socket says 172.21.15.114:37010) 2023-10-18T12:42:12.819 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.808+0000 7ff0f37fe700 1 -- 172.21.15.114:0/4213410955 learned_addr learned my addr 172.21.15.114:0/4213410955 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:42:12.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.808+0000 7ff0f3fff700 1 --2- 172.21.15.114:0/4213410955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0f4160e50 0x7ff0f415f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:12.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.808+0000 7ff0eaffd700 1 --2- 172.21.15.114:0/4213410955 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0f40cb500 0x7ff0f415f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:12.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.808+0000 7ff0f37fe700 1 -- 172.21.15.114:0/4213410955 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0f40cb500 msgr2=0x7ff0f415f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:12.820 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.808+0000 7ff0f37fe700 1 --2- 172.21.15.114:0/4213410955 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0f40cb500 0x7ff0f415f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:12.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.808+0000 7ff0f37fe700 1 -- 172.21.15.114:0/4213410955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0f4160e50 msgr2=0x7ff0f415f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:12.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.808+0000 7ff0f37fe700 1 --2- 172.21.15.114:0/4213410955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0f4160e50 0x7ff0f415f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:12.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.808+0000 7ff0f37fe700 1 -- 172.21.15.114:0/4213410955 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0ec009570 con 0x7ff0f40b2720 2023-10-18T12:42:12.821 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.808+0000 7ff0f37fe700 1 --2- 172.21.15.114:0/4213410955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0f40b2720 0x7ff0f4149830 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4007e60 tx=0x7ff0e400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:12.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.808+0000 7ff0f0ff9700 1 -- 172.21.15.114:0/4213410955 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e400ed30 con 0x7ff0f40b2720 2023-10-18T12:42:12.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.808+0000 7ff0f0ff9700 1 -- 172.21.15.114:0/4213410955 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e4014420 con 0x7ff0f40b2720 2023-10-18T12:42:12.822 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.808+0000 7ff0f8948700 1 -- 172.21.15.114:0/4213410955 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0f4161cf0 con 0x7ff0f40b2720 2023-10-18T12:42:12.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.808+0000 7ff0f0ff9700 1 -- 172.21.15.114:0/4213410955 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e40147d0 con 0x7ff0f40b2720 2023-10-18T12:42:12.823 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.808+0000 7ff0f8948700 1 -- 172.21.15.114:0/4213410955 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0f41622b0 con 0x7ff0f40b2720 2023-10-18T12:42:12.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.812+0000 7ff0f8948700 1 -- 172.21.15.114:0/4213410955 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0f41624d0 con 0x7ff0f40b2720 2023-10-18T12:42:12.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.812+0000 7ff0f0ff9700 1 -- 172.21.15.114:0/4213410955 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7ff0e4014930 con 0x7ff0f40b2720 2023-10-18T12:42:12.824 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.816+0000 7ff0f0ff9700 1 --2- 172.21.15.114:0/4213410955 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff0d4065720 0x7ff0d4067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:12.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.816+0000 7ff0f0ff9700 1 -- 172.21.15.114:0/4213410955 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5659+0+0 (secure 0 0 0) 0x7ff0e40833c0 con 0x7ff0f40b2720 2023-10-18T12:42:12.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.816+0000 7ff0eaffd700 1 --2- 172.21.15.114:0/4213410955 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff0d4065720 0x7ff0d4067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:12.825 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.816+0000 7ff0eaffd700 1 --2- 172.21.15.114:0/4213410955 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff0d4065720 0x7ff0d4067be0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff0f4164280 tx=0x7ff0dc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:12.827 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:12.820+0000 7ff0f0ff9700 1 -- 172.21.15.114:0/4213410955 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7ff0e4050ef0 con 0x7ff0f40b2720 2023-10-18T12:42:13.126 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.120+0000 7ff0f8948700 1 -- 172.21.15.114:0/4213410955 --> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7ff0f40b1c00 con 0x7ff0d4065720 2023-10-18T12:42:13.127 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.120+0000 7ff0f0ff9700 1 -- 172.21.15.114:0/4213410955 <== mgr.4108 v2:172.21.15.172:6832/461408666 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff0dc009e30 con 0x7ff0d4065720 2023-10-18T12:42:13.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.124+0000 7ff0f8948700 1 -- 172.21.15.114:0/4213410955 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff0d4065720 msgr2=0x7ff0d4067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:13.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.124+0000 7ff0f8948700 1 --2- 172.21.15.114:0/4213410955 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff0d4065720 0x7ff0d4067be0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff0f4164280 tx=0x7ff0dc008040 comp rx=0 tx=0).stop 2023-10-18T12:42:13.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.124+0000 7ff0f8948700 1 -- 172.21.15.114:0/4213410955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0f40b2720 msgr2=0x7ff0f4149830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:13.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.124+0000 7ff0f8948700 1 --2- 172.21.15.114:0/4213410955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0f40b2720 0x7ff0f4149830 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4007e60 tx=0x7ff0e400e3c0 comp rx=0 tx=0).stop 2023-10-18T12:42:13.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.124+0000 7ff0f8948700 1 -- 172.21.15.114:0/4213410955 shutdown_connections 2023-10-18T12:42:13.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.124+0000 7ff0f8948700 1 --2- 172.21.15.114:0/4213410955 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7ff0d4065720 0x7ff0d4067be0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:13.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.124+0000 7ff0f8948700 1 --2- 172.21.15.114:0/4213410955 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7ff0f40cb500 0x7ff0f415f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:13.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.124+0000 7ff0f8948700 1 --2- 172.21.15.114:0/4213410955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0f4160e50 0x7ff0f415f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:13.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.124+0000 7ff0f8948700 1 --2- 172.21.15.114:0/4213410955 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff0f40b2720 0x7ff0f4149830 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:13.132 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.124+0000 7ff0f8948700 1 -- 172.21.15.114:0/4213410955 >> 172.21.15.114:0/4213410955 conn(0x7ff0f40b0bf0 msgr2=0x7ff0f406fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:13.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.124+0000 7ff0f8948700 1 -- 172.21.15.114:0/4213410955 shutdown_connections 2023-10-18T12:42:13.133 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.124+0000 7ff0f8948700 1 -- 172.21.15.114:0/4213410955 wait complete. 2023-10-18T12:42:13.134 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 5 to deep-scrub 2023-10-18T12:42:13.155 INFO:tasks.ceph:Scrubbing osd.6 2023-10-18T12:42:13.156 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-18T12:42:13.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.332+0000 7fa68ec2c700 1 Processor -- start 2023-10-18T12:42:13.337 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.332+0000 7fa68ec2c700 1 -- start start 2023-10-18T12:42:13.340 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.332+0000 7fa68ec2c700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fa68815cde0 0x7fa6880708b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:13.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.336+0000 7fa68ec2c700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa68806e440 0x7fa6880b64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:13.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.336+0000 7fa68ec2c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa68806e8d0 0x7fa6880b6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:13.341 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.336+0000 7fa68ec2c700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa68815d1c0 con 0x7fa68806e440 2023-10-18T12:42:13.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.336+0000 7fa68ec2c700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa688070df0 con 0x7fa68815cde0 2023-10-18T12:42:13.342 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.336+0000 7fa68ec2c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa68806f810 con 0x7fa68806e8d0 2023-10-18T12:42:13.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.336+0000 7fa687fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa68806e440 0x7fa6880b64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:13.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.336+0000 7fa687fff700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fa68806e440 0x7fa6880b64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37022/0 (socket says 172.21.15.114:37022) 2023-10-18T12:42:13.344 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.336+0000 7fa687fff700 1 -- 172.21.15.114:0/459252594 learned_addr learned my addr 172.21.15.114:0/459252594 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:42:13.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.336+0000 7fa68c9c8700 1 --2- 172.21.15.114:0/459252594 >> v2:172.21.15.172:3300/0 conn(0x7fa68815cde0 0x7fa6880708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:13.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.336+0000 7fa68d1c9700 1 --2- 172.21.15.114:0/459252594 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa68806e8d0 0x7fa6880b6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:13.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.336+0000 7fa687fff700 1 -- 172.21.15.114:0/459252594 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa68806e8d0 msgr2=0x7fa6880b6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:42:13.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.336+0000 7fa687fff700 1 --2- 172.21.15.114:0/459252594 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa68806e8d0 0x7fa6880b6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:13.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.336+0000 7fa687fff700 1 -- 172.21.15.114:0/459252594 >> v2:172.21.15.172:3300/0 conn(0x7fa68815cde0 msgr2=0x7fa6880708b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:42:13.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.336+0000 7fa687fff700 1 --2- 172.21.15.114:0/459252594 >> v2:172.21.15.172:3300/0 conn(0x7fa68815cde0 0x7fa6880708b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:13.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.336+0000 7fa687fff700 1 -- 172.21.15.114:0/459252594 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa68806faf0 con 0x7fa68806e440 2023-10-18T12:42:13.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.336+0000 7fa687fff700 1 --2- 172.21.15.114:0/459252594 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa68806e440 0x7fa6880b64d0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fa6880d3c70 tx=0x7fa674009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9d28cfc7504c249 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:13.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.336+0000 7fa6877fe700 1 -- 172.21.15.114:0/459252594 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa674011830 con 0x7fa68806e440 2023-10-18T12:42:13.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.336+0000 7fa6877fe700 1 -- 172.21.15.114:0/459252594 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa674011990 con 0x7fa68806e440 2023-10-18T12:42:13.347 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.336+0000 7fa6877fe700 1 -- 172.21.15.114:0/459252594 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa674011d20 con 0x7fa68806e440 2023-10-18T12:42:13.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.336+0000 7fa68ec2c700 1 -- 172.21.15.114:0/459252594 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa68806e440 msgr2=0x7fa6880b64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:13.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.336+0000 7fa68ec2c700 1 --2- 172.21.15.114:0/459252594 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa68806e440 0x7fa6880b64d0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fa6880d3c70 tx=0x7fa674009bf0 comp rx=0 tx=0).stop 2023-10-18T12:42:13.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.340+0000 7fa68ec2c700 1 -- 172.21.15.114:0/459252594 shutdown_connections 2023-10-18T12:42:13.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.340+0000 7fa68ec2c700 1 --2- 172.21.15.114:0/459252594 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa68806e8d0 0x7fa6880b6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:13.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.340+0000 7fa68ec2c700 1 --2- 172.21.15.114:0/459252594 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa68806e440 0x7fa6880b64d0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:13.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.340+0000 7fa68ec2c700 1 --2- 172.21.15.114:0/459252594 >> v2:172.21.15.172:3300/0 conn(0x7fa68815cde0 0x7fa6880708b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:13.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.340+0000 7fa68ec2c700 1 -- 172.21.15.114:0/459252594 >> 172.21.15.114:0/459252594 conn(0x7fa68806a130 msgr2=0x7fa68806a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:13.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.340+0000 7fa68ec2c700 1 -- 172.21.15.114:0/459252594 shutdown_connections 2023-10-18T12:42:13.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.340+0000 7fa68ec2c700 1 -- 172.21.15.114:0/459252594 wait complete. 2023-10-18T12:42:13.352 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.340+0000 7fa68ec2c700 1 Processor -- start 2023-10-18T12:42:13.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.340+0000 7fa68ec2c700 1 -- start start 2023-10-18T12:42:13.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.340+0000 7fa68ec2c700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa68806e440 0x7fa6880acee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:13.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.340+0000 7fa68ec2c700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa68806e8d0 0x7fa6881578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:13.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.340+0000 7fa68ec2c700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa68815cde0 0x7fa68815d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:13.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.340+0000 7fa68ec2c700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6880acc70 con 0x7fa68806e8d0 2023-10-18T12:42:13.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.340+0000 7fa68ec2c700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6880ad420 con 0x7fa68815cde0 2023-10-18T12:42:13.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.340+0000 7fa68ec2c700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6881f6250 con 0x7fa68806e440 2023-10-18T12:42:13.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.340+0000 7fa687fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa68806e8d0 0x7fa6881578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:13.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.340+0000 7fa687fff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa68806e8d0 0x7fa6881578f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37030/0 (socket says 172.21.15.114:37030) 2023-10-18T12:42:13.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.340+0000 7fa687fff700 1 -- 172.21.15.114:0/3751791680 learned_addr learned my addr 172.21.15.114:0/3751791680 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:42:13.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.344+0000 7fa68c9c8700 1 --2- 172.21.15.114:0/3751791680 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa68806e440 0x7fa6880acee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:13.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.344+0000 7fa68d1c9700 1 --2- 172.21.15.114:0/3751791680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa68815cde0 0x7fa68815d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:13.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.344+0000 7fa687fff700 1 -- 172.21.15.114:0/3751791680 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa68806e440 msgr2=0x7fa6880acee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:13.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.344+0000 7fa687fff700 1 --2- 172.21.15.114:0/3751791680 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fa68806e440 0x7fa6880acee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:13.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.344+0000 7fa687fff700 1 -- 172.21.15.114:0/3751791680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa68815cde0 msgr2=0x7fa68815d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:13.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.344+0000 7fa687fff700 1 --2- 172.21.15.114:0/3751791680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa68815cde0 0x7fa68815d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:13.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.344+0000 7fa687fff700 1 -- 172.21.15.114:0/3751791680 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa674009570 con 0x7fa68806e8d0 2023-10-18T12:42:13.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.344+0000 7fa687fff700 1 --2- 172.21.15.114:0/3751791680 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa68806e8d0 0x7fa6881578f0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fa68806baf0 tx=0x7fa674004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:13.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.344+0000 7fa6857fa700 1 -- 172.21.15.114:0/3751791680 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa674004240 con 0x7fa68806e8d0 2023-10-18T12:42:13.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.344+0000 7fa6857fa700 1 -- 172.21.15.114:0/3751791680 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67401f070 con 0x7fa68806e8d0 2023-10-18T12:42:13.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.344+0000 7fa6857fa700 1 -- 172.21.15.114:0/3751791680 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa674004600 con 0x7fa68806e8d0 2023-10-18T12:42:13.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.344+0000 7fa68ec2c700 1 -- 172.21.15.114:0/3751791680 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6881f6530 con 0x7fa68806e8d0 2023-10-18T12:42:13.359 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.344+0000 7fa68ec2c700 1 -- 172.21.15.114:0/3751791680 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6881f6af0 con 0x7fa68806e8d0 2023-10-18T12:42:13.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.344+0000 7fa68ec2c700 1 -- 172.21.15.114:0/3751791680 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa6880700b0 con 0x7fa68806e8d0 2023-10-18T12:42:13.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.348+0000 7fa6857fa700 1 -- 172.21.15.114:0/3751791680 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fa674021030 con 0x7fa68806e8d0 2023-10-18T12:42:13.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.348+0000 7fa6857fa700 1 --2- 172.21.15.114:0/3751791680 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa66c0656f0 0x7fa66c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:13.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.348+0000 7fa6857fa700 1 -- 172.21.15.114:0/3751791680 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5659+0+0 (secure 0 0 0) 0x7fa674083b40 con 0x7fa68806e8d0 2023-10-18T12:42:13.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.348+0000 7fa6857fa700 1 --2- 172.21.15.114:0/3751791680 >> [v2:172.21.15.172:6823/1680398853,v1:172.21.15.172:6825/1680398853] conn(0x7fa66c06bef0 0x7fa66c06e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:13.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.348+0000 7fa6857fa700 1 -- 172.21.15.114:0/3751791680 --> [v2:172.21.15.172:6823/1680398853,v1:172.21.15.172:6825/1680398853] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa66c06ea00 con 0x7fa66c06bef0 2023-10-18T12:42:13.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.348+0000 7fa6857fa700 1 -- 172.21.15.114:0/3751791680 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa674085ea0 con 0x7fa68806e8d0 2023-10-18T12:42:13.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.348+0000 7fa68c9c8700 1 --2- 172.21.15.114:0/3751791680 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa66c0656f0 0x7fa66c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:13.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.348+0000 7fa68d1c9700 1 --2- 172.21.15.114:0/3751791680 >> [v2:172.21.15.172:6823/1680398853,v1:172.21.15.172:6825/1680398853] conn(0x7fa66c06bef0 0x7fa66c06e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:13.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.348+0000 7fa68c9c8700 1 --2- 172.21.15.114:0/3751791680 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa66c0656f0 0x7fa66c067bb0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa6881f02c0 tx=0x7fa67c009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:13.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.348+0000 7fa68d1c9700 1 --2- 172.21.15.114:0/3751791680 >> [v2:172.21.15.172:6823/1680398853,v1:172.21.15.172:6825/1680398853] conn(0x7fa66c06bef0 0x7fa66c06e330 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:13.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.352+0000 7fa6857fa700 1 -- 172.21.15.114:0/3751791680 <== osd.6 v2:172.21.15.172:6823/1680398853 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fa66c06ea00 con 0x7fa66c06bef0 2023-10-18T12:42:13.377 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.372+0000 7fa68ec2c700 1 -- 172.21.15.114:0/3751791680 --> [v2:172.21.15.172:6823/1680398853,v1:172.21.15.172:6825/1680398853] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa68806fdd0 con 0x7fa66c06bef0 2023-10-18T12:42:13.378 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.372+0000 7fa6857fa700 1 -- 172.21.15.114:0/3751791680 <== osd.6 v2:172.21.15.172:6823/1680398853 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa6800113d0 con 0x7fa66c06bef0 2023-10-18T12:42:13.378 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T12:42:13.378 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-18T12:42:13.379 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T12:42:13.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.372+0000 7fa68ec2c700 1 -- 172.21.15.114:0/3751791680 >> [v2:172.21.15.172:6823/1680398853,v1:172.21.15.172:6825/1680398853] conn(0x7fa66c06bef0 msgr2=0x7fa66c06e330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:13.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.372+0000 7fa68ec2c700 1 --2- 172.21.15.114:0/3751791680 >> [v2:172.21.15.172:6823/1680398853,v1:172.21.15.172:6825/1680398853] conn(0x7fa66c06bef0 0x7fa66c06e330 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:13.380 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.372+0000 7fa68ec2c700 1 -- 172.21.15.114:0/3751791680 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa66c0656f0 msgr2=0x7fa66c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:13.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.372+0000 7fa68ec2c700 1 --2- 172.21.15.114:0/3751791680 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fa66c0656f0 0x7fa66c067bb0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa6881f02c0 tx=0x7fa67c009240 comp rx=0 tx=0).stop 2023-10-18T12:42:13.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.372+0000 7fa68ec2c700 1 -- 172.21.15.114:0/3751791680 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa68806e8d0 msgr2=0x7fa6881578f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:13.381 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.372+0000 7fa68ec2c700 1 --2- 172.21.15.114:0/3751791680 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa68806e8d0 0x7fa6881578f0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fa68806baf0 tx=0x7fa674004770 comp rx=0 tx=0).stop 2023-10-18T12:42:13.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.372+0000 7fa68d1c9700 1 -- 172.21.15.114:0/3751791680 reap_dead start 2023-10-18T12:42:13.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.372+0000 7fa68ec2c700 1 -- 172.21.15.114:0/3751791680 shutdown_connections 2023-10-18T12:42:13.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.372+0000 7fa68ec2c700 1 -- 172.21.15.114:0/3751791680 >> 172.21.15.114:0/3751791680 conn(0x7fa68806a130 msgr2=0x7fa6880d2360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:13.382 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.372+0000 7fa68ec2c700 1 -- 172.21.15.114:0/3751791680 shutdown_connections 2023-10-18T12:42:13.383 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.372+0000 7fa68ec2c700 1 -- 172.21.15.114:0/3751791680 wait complete. 2023-10-18T12:42:13.397 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-18T12:42:13.583 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.576+0000 7fe0fb137700 1 Processor -- start 2023-10-18T12:42:13.584 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.576+0000 7fe0fb137700 1 -- start start 2023-10-18T12:42:13.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.580+0000 7fe0fb137700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe0f40cfa90 0x7fe0f406e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:13.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.580+0000 7fe0fb137700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe0f406f780 0x7fe0f406fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:13.586 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.580+0000 7fe0fb137700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0f406d330 con 0x7fe0f415cd80 2023-10-18T12:42:13.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.580+0000 7fe0fb137700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0f4070540 con 0x7fe0f406f780 2023-10-18T12:42:13.587 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.580+0000 7fe0fb137700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0f406de90 con 0x7fe0f40cfa90 2023-10-18T12:42:13.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.580+0000 7fe0fa135700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fe0f415cd80 0x7fe0f40cf380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50858/0 (socket says 172.21.15.114:50858) 2023-10-18T12:42:13.589 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.580+0000 7fe0fa135700 1 -- 172.21.15.114:0/2254778019 learned_addr learned my addr 172.21.15.114:0/2254778019 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:42:13.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.580+0000 7fe0f9934700 1 --2- 172.21.15.114:0/2254778019 >> v2:172.21.15.172:3300/0 conn(0x7fe0f40cfa90 0x7fe0f406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:13.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.580+0000 7fe0fa936700 1 --2- 172.21.15.114:0/2254778019 >> v2:172.21.15.114:3300/0 conn(0x7fe0f406f780 0x7fe0f406fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:13.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.580+0000 7fe0f9133700 1 -- 172.21.15.114:0/2254778019 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3403996747 0 0) 0x7fe0f406d330 con 0x7fe0f415cd80 2023-10-18T12:42:13.590 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.580+0000 7fe0f9133700 1 -- 172.21.15.114:0/2254778019 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0e00035d0 con 0x7fe0f415cd80 2023-10-18T12:42:13.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.580+0000 7fe0fa936700 1 -- 172.21.15.114:0/2254778019 >> v2:172.21.15.172:3300/0 conn(0x7fe0f40cfa90 msgr2=0x7fe0f406e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:42:13.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.580+0000 7fe0fa936700 1 --2- 172.21.15.114:0/2254778019 >> v2:172.21.15.172:3300/0 conn(0x7fe0f40cfa90 0x7fe0f406e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:13.591 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.580+0000 7fe0fa936700 1 -- 172.21.15.114:0/2254778019 >> v1:172.21.15.114:6789/0 conn(0x7fe0f415cd80 legacy=0x7fe0f40cf380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:13.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.580+0000 7fe0fa936700 1 -- 172.21.15.114:0/2254778019 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f406d560 con 0x7fe0f406f780 2023-10-18T12:42:13.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.580+0000 7fe0f9934700 1 --2- 172.21.15.114:0/2254778019 >> v2:172.21.15.172:3300/0 conn(0x7fe0f40cfa90 0x7fe0f406e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-18T12:42:13.592 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.580+0000 7fe0fa936700 1 --2- 172.21.15.114:0/2254778019 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0f406f780 0x7fe0f406fbd0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec009d90 tx=0x7fe0ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92eff0094132a183 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:13.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.584+0000 7fe0f9133700 1 -- 172.21.15.114:0/2254778019 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec00e070 con 0x7fe0f406f780 2023-10-18T12:42:13.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.584+0000 7fe0f9133700 1 -- 172.21.15.114:0/2254778019 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0ec00bae0 con 0x7fe0f406f780 2023-10-18T12:42:13.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.584+0000 7fe0f9133700 1 -- 172.21.15.114:0/2254778019 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec00be50 con 0x7fe0f406f780 2023-10-18T12:42:13.593 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.584+0000 7fe0fb137700 1 -- 172.21.15.114:0/2254778019 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0f406f780 msgr2=0x7fe0f406fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:13.594 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.584+0000 7fe0fb137700 1 --2- 172.21.15.114:0/2254778019 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0f406f780 0x7fe0f406fbd0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec009d90 tx=0x7fe0ec00b330 comp rx=0 tx=0).stop 2023-10-18T12:42:13.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.584+0000 7fe0fb137700 1 -- 172.21.15.114:0/2254778019 shutdown_connections 2023-10-18T12:42:13.596 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.584+0000 7fe0fb137700 1 --2- 172.21.15.114:0/2254778019 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0f406f780 0x7fe0f406fbd0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:13.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.584+0000 7fe0fb137700 1 --2- 172.21.15.114:0/2254778019 >> v2:172.21.15.172:3300/0 conn(0x7fe0f40cfa90 0x7fe0f406e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:13.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.584+0000 7fe0fb137700 1 -- 172.21.15.114:0/2254778019 >> 172.21.15.114:0/2254778019 conn(0x7fe0f40b4540 msgr2=0x7fe0f40b4920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:13.597 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.584+0000 7fe0fb137700 1 -- 172.21.15.114:0/2254778019 shutdown_connections 2023-10-18T12:42:13.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.584+0000 7fe0fb137700 1 -- 172.21.15.114:0/2254778019 wait complete. 2023-10-18T12:42:13.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.588+0000 7fe0fb137700 1 Processor -- start 2023-10-18T12:42:13.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.588+0000 7fe0fb137700 1 -- start start 2023-10-18T12:42:13.598 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.588+0000 7fe0fb137700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0f406f780 0x7fe0f4155d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:13.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.588+0000 7fe0fb137700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0f40cfa90 0x7fe0f40c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:13.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.588+0000 7fe0fb137700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0f415cd80 0x7fe0f40c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:13.599 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.588+0000 7fe0fb137700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f40b3b60 con 0x7fe0f415cd80 2023-10-18T12:42:13.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.588+0000 7fe0fb137700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f40b3f80 con 0x7fe0f406f780 2023-10-18T12:42:13.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.588+0000 7fe0fb137700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f40b2ee0 con 0x7fe0f40cfa90 2023-10-18T12:42:13.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.588+0000 7fe0fa936700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0f415cd80 0x7fe0f40c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:13.600 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.588+0000 7fe0fa135700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0f406f780 0x7fe0f4155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:13.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.588+0000 7fe0f9934700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0f40cfa90 0x7fe0f40c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:13.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.588+0000 7fe0fa936700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0f415cd80 0x7fe0f40c9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37036/0 (socket says 172.21.15.114:37036) 2023-10-18T12:42:13.601 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.588+0000 7fe0fa936700 1 -- 172.21.15.114:0/934345661 learned_addr learned my addr 172.21.15.114:0/934345661 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:42:13.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.588+0000 7fe0fa936700 1 -- 172.21.15.114:0/934345661 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0f40cfa90 msgr2=0x7fe0f40c9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:13.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.588+0000 7fe0fa936700 1 --2- 172.21.15.114:0/934345661 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0f40cfa90 0x7fe0f40c9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:13.602 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.588+0000 7fe0fa936700 1 -- 172.21.15.114:0/934345661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0f406f780 msgr2=0x7fe0f4155d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:13.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.588+0000 7fe0fa936700 1 --2- 172.21.15.114:0/934345661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0f406f780 0x7fe0f4155d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:13.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.588+0000 7fe0fa936700 1 -- 172.21.15.114:0/934345661 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e40094b0 con 0x7fe0f415cd80 2023-10-18T12:42:13.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.588+0000 7fe0fa936700 1 --2- 172.21.15.114:0/934345661 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0f415cd80 0x7fe0f40c9f80 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec014040 tx=0x7fe0ec004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:13.603 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.588+0000 7fe0eaffd700 1 -- 172.21.15.114:0/934345661 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec004800 con 0x7fe0f415cd80 2023-10-18T12:42:13.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.588+0000 7fe0eaffd700 1 -- 172.21.15.114:0/934345661 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0ec020070 con 0x7fe0f415cd80 2023-10-18T12:42:13.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.592+0000 7fe0fb137700 1 -- 172.21.15.114:0/934345661 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0ec009a70 con 0x7fe0f415cd80 2023-10-18T12:42:13.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.592+0000 7fe0eaffd700 1 -- 172.21.15.114:0/934345661 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec0276c0 con 0x7fe0f415cd80 2023-10-18T12:42:13.604 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.592+0000 7fe0fb137700 1 -- 172.21.15.114:0/934345661 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0f40b34a0 con 0x7fe0f415cd80 2023-10-18T12:42:13.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.592+0000 7fe0fb137700 1 -- 172.21.15.114:0/934345661 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0f40b3ca0 con 0x7fe0f415cd80 2023-10-18T12:42:13.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.592+0000 7fe0eaffd700 1 -- 172.21.15.114:0/934345661 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fe0ec012430 con 0x7fe0f415cd80 2023-10-18T12:42:13.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.596+0000 7fe0eaffd700 1 --2- 172.21.15.114:0/934345661 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe0d80656f0 0x7fe0d8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:13.606 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.596+0000 7fe0eaffd700 1 -- 172.21.15.114:0/934345661 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5659+0+0 (secure 0 0 0) 0x7fe0ec022070 con 0x7fe0f415cd80 2023-10-18T12:42:13.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.596+0000 7fe0fa135700 1 --2- 172.21.15.114:0/934345661 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe0d80656f0 0x7fe0d8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:13.607 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.596+0000 7fe0fa135700 1 --2- 172.21.15.114:0/934345661 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe0d80656f0 0x7fe0d8067bb0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe0f0007fd0 tx=0x7fe0f0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:13.610 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.604+0000 7fe0eaffd700 1 -- 172.21.15.114:0/934345661 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fe0f40b3ca0 con 0x7fe0f415cd80 2023-10-18T12:42:13.933 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.928+0000 7fe0fb137700 1 -- 172.21.15.114:0/934345661 --> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0f406db20 con 0x7fe0d80656f0 2023-10-18T12:42:13.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.928+0000 7fe0eaffd700 1 -- 172.21.15.114:0/934345661 <== mgr.4108 v2:172.21.15.172:6832/461408666 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe0f0001d70 con 0x7fe0d80656f0 2023-10-18T12:42:13.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.932+0000 7fe0fb137700 1 -- 172.21.15.114:0/934345661 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe0d80656f0 msgr2=0x7fe0d8067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:13.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.932+0000 7fe0fb137700 1 --2- 172.21.15.114:0/934345661 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe0d80656f0 0x7fe0d8067bb0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe0f0007fd0 tx=0x7fe0f0009040 comp rx=0 tx=0).stop 2023-10-18T12:42:13.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.932+0000 7fe0fb137700 1 -- 172.21.15.114:0/934345661 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0f415cd80 msgr2=0x7fe0f40c9f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:13.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.932+0000 7fe0fb137700 1 --2- 172.21.15.114:0/934345661 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0f415cd80 0x7fe0f40c9f80 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec014040 tx=0x7fe0ec004af0 comp rx=0 tx=0).stop 2023-10-18T12:42:13.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.932+0000 7fe0fb137700 1 -- 172.21.15.114:0/934345661 shutdown_connections 2023-10-18T12:42:13.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.932+0000 7fe0fb137700 1 --2- 172.21.15.114:0/934345661 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe0d80656f0 0x7fe0d8067bb0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:13.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.932+0000 7fe0fb137700 1 --2- 172.21.15.114:0/934345661 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe0f40cfa90 0x7fe0f40c9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:13.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.932+0000 7fe0fb137700 1 --2- 172.21.15.114:0/934345661 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe0f415cd80 0x7fe0f40c9f80 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:13.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.932+0000 7fe0fb137700 1 --2- 172.21.15.114:0/934345661 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0f406f780 0x7fe0f4155d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:13.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.932+0000 7fe0fb137700 1 -- 172.21.15.114:0/934345661 >> 172.21.15.114:0/934345661 conn(0x7fe0f40b4540 msgr2=0x7fe0f40c7f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:13.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.932+0000 7fe0fb137700 1 -- 172.21.15.114:0/934345661 shutdown_connections 2023-10-18T12:42:13.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:13.932+0000 7fe0fb137700 1 -- 172.21.15.114:0/934345661 wait complete. 2023-10-18T12:42:13.941 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 6 to deep-scrub 2023-10-18T12:42:13.961 INFO:tasks.ceph:Scrubbing osd.7 2023-10-18T12:42:13.961 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-18T12:42:14.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.132+0000 7f471b63e700 1 Processor -- start 2023-10-18T12:42:14.138 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.132+0000 7f471b63e700 1 -- start start 2023-10-18T12:42:14.141 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.136+0000 7f471b63e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f47141468c0 0x7f471406f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:14.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.136+0000 7f471b63e700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4714070340 con 0x7f471406fee0 2023-10-18T12:42:14.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.136+0000 7f471b63e700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47140b5b80 con 0x7f47140b7dd0 2023-10-18T12:42:14.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.136+0000 7f471b63e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47140b5dd0 con 0x7f47141468c0 2023-10-18T12:42:14.142 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.136+0000 7f4718bd9700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7f471406fee0 0x7f47140b76c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50874/0 (socket says 172.21.15.114:50874) 2023-10-18T12:42:14.143 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.136+0000 7f4718bd9700 1 -- 172.21.15.114:0/133732657 learned_addr learned my addr 172.21.15.114:0/133732657 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:42:14.144 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.136+0000 7f47193da700 1 --2- 172.21.15.114:0/133732657 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f47141468c0 0x7f471406f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:14.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.136+0000 7f470bfff700 1 -- 172.21.15.114:0/133732657 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1598204074 0 0) 0x7f4714070340 con 0x7f471406fee0 2023-10-18T12:42:14.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.136+0000 7f470bfff700 1 -- 172.21.15.114:0/133732657 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47000035d0 con 0x7f471406fee0 2023-10-18T12:42:14.145 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.136+0000 7f470bfff700 1 -- 172.21.15.114:0/133732657 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1586098002 0 0) 0x7f47000035d0 con 0x7f471406fee0 2023-10-18T12:42:14.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.136+0000 7f470bfff700 1 -- 172.21.15.114:0/133732657 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f47141468c0 msgr2=0x7f471406f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:42:14.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.136+0000 7f470bfff700 1 --2- 172.21.15.114:0/133732657 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f47141468c0 0x7f471406f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:14.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.136+0000 7f470bfff700 1 -- 172.21.15.114:0/133732657 >> v1:172.21.15.172:6789/0 conn(0x7f47140b7dd0 legacy=0x7f47140d0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:14.146 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.136+0000 7f470bfff700 1 -- 172.21.15.114:0/133732657 --> v1:172.21.15.114:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47140b60b0 con 0x7f471406fee0 2023-10-18T12:42:14.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.136+0000 7f470bfff700 1 -- 172.21.15.114:0/133732657 <== mon.0 v1:172.21.15.114:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3368469509 0 0) 0x7f4704001670 con 0x7f471406fee0 2023-10-18T12:42:14.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.136+0000 7f470bfff700 1 -- 172.21.15.114:0/133732657 >> v1:172.21.15.114:6789/0 conn(0x7f471406fee0 legacy=0x7f47140b76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:14.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.136+0000 7f470bfff700 1 --2- 172.21.15.114:0/133732657 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4700003a50 0x7f4700003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:14.147 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.136+0000 7f470bfff700 1 --2- 172.21.15.114:0/133732657 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f47141468c0 0x7f4700004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:14.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.136+0000 7f470bfff700 1 --2- 172.21.15.114:0/133732657 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4700004db0 0x7f4700005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:14.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.136+0000 7f470bfff700 1 -- 172.21.15.114:0/133732657 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47140b5dd0 con 0x7f4700004db0 2023-10-18T12:42:14.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.136+0000 7f470bfff700 1 -- 172.21.15.114:0/133732657 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470000bb10 con 0x7f4700003a50 2023-10-18T12:42:14.148 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.136+0000 7f470bfff700 1 -- 172.21.15.114:0/133732657 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f470000bcd0 con 0x7f47141468c0 2023-10-18T12:42:14.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.136+0000 7f4718bd9700 1 --2- 172.21.15.114:0/133732657 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f47141468c0 0x7f4700004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:14.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.136+0000 7f47193da700 1 --2- 172.21.15.114:0/133732657 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4700003a50 0x7f4700003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:14.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.136+0000 7f4719bdb700 1 --2- 172.21.15.114:0/133732657 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4700004db0 0x7f4700005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:14.149 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.136+0000 7f4718bd9700 1 -- 172.21.15.114:0/133732657 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4700003a50 msgr2=0x7f4700003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:42:14.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.136+0000 7f4718bd9700 1 --2- 172.21.15.114:0/133732657 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4700003a50 0x7f4700003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:14.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.136+0000 7f4718bd9700 1 -- 172.21.15.114:0/133732657 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4700004db0 msgr2=0x7f4700005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:42:14.150 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.136+0000 7f4718bd9700 1 --2- 172.21.15.114:0/133732657 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4700004db0 0x7f4700005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:14.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.136+0000 7f4718bd9700 1 -- 172.21.15.114:0/133732657 --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47000035d0 con 0x7f47141468c0 2023-10-18T12:42:14.151 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.140+0000 7f4718bd9700 1 --2- 172.21.15.114:0/133732657 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f47141468c0 0x7f4700004870 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4704001eb0 tx=0x7f47000058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b322b6b48b94f98 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:14.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.140+0000 7f470bfff700 1 -- 172.21.15.114:0/133732657 <== mon.2 v2:172.21.15.172:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4704007b90 con 0x7f47141468c0 2023-10-18T12:42:14.152 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.140+0000 7f470bfff700 1 -- 172.21.15.114:0/133732657 <== mon.2 v2:172.21.15.172:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f470400cd40 con 0x7f47141468c0 2023-10-18T12:42:14.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.140+0000 7f470bfff700 1 -- 172.21.15.114:0/133732657 <== mon.2 v2:172.21.15.172:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4704005bc0 con 0x7f47141468c0 2023-10-18T12:42:14.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.140+0000 7f471b63e700 1 -- 172.21.15.114:0/133732657 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f47141468c0 msgr2=0x7f4700004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:14.153 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.140+0000 7f471b63e700 1 --2- 172.21.15.114:0/133732657 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f47141468c0 0x7f4700004870 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4704001eb0 tx=0x7f47000058a0 comp rx=0 tx=0).stop 2023-10-18T12:42:14.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.140+0000 7f4719bdb700 1 -- 172.21.15.114:0/133732657 reap_dead start 2023-10-18T12:42:14.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.140+0000 7f471b63e700 1 -- 172.21.15.114:0/133732657 shutdown_connections 2023-10-18T12:42:14.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.140+0000 7f471b63e700 1 -- 172.21.15.114:0/133732657 >> 172.21.15.114:0/133732657 conn(0x7f471406a130 msgr2=0x7f471406a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:14.154 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.140+0000 7f471b63e700 1 -- 172.21.15.114:0/133732657 shutdown_connections 2023-10-18T12:42:14.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.140+0000 7f471b63e700 1 -- 172.21.15.114:0/133732657 wait complete. 2023-10-18T12:42:14.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.144+0000 7f471b63e700 1 Processor -- start 2023-10-18T12:42:14.155 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.144+0000 7f471b63e700 1 -- start start 2023-10-18T12:42:14.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.148+0000 7f471b63e700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47141468c0 0x7f471413f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:14.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.148+0000 7f471b63e700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4714140df0 0x7f4714141270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:14.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.148+0000 7f471b63e700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4714159520 0x7f47141599a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:14.157 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.148+0000 7f471b63e700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47141f31d0 con 0x7f47141468c0 2023-10-18T12:42:14.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.148+0000 7f471b63e700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47141417b0 con 0x7f4714159520 2023-10-18T12:42:14.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.148+0000 7f471b63e700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4714159ee0 con 0x7f4714140df0 2023-10-18T12:42:14.158 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.148+0000 7f47193da700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47141468c0 0x7f471413f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:14.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.148+0000 7f47193da700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47141468c0 0x7f471413f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37052/0 (socket says 172.21.15.114:37052) 2023-10-18T12:42:14.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.148+0000 7f47193da700 1 -- 172.21.15.114:0/1818598538 learned_addr learned my addr 172.21.15.114:0/1818598538 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:42:14.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.148+0000 7f4718bd9700 1 --2- 172.21.15.114:0/1818598538 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4714140df0 0x7f4714141270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:14.159 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.148+0000 7f4719bdb700 1 --2- 172.21.15.114:0/1818598538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4714159520 0x7f47141599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:14.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.148+0000 7f47193da700 1 -- 172.21.15.114:0/1818598538 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4714140df0 msgr2=0x7f4714141270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:14.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.148+0000 7f47193da700 1 --2- 172.21.15.114:0/1818598538 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4714140df0 0x7f4714141270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:14.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.148+0000 7f47193da700 1 -- 172.21.15.114:0/1818598538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4714159520 msgr2=0x7f47141599a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:14.160 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.148+0000 7f47193da700 1 --2- 172.21.15.114:0/1818598538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4714159520 0x7f47141599a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:14.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.148+0000 7f47193da700 1 -- 172.21.15.114:0/1818598538 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47141f21e0 con 0x7f47141468c0 2023-10-18T12:42:14.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.148+0000 7f4718bd9700 1 --2- 172.21.15.114:0/1818598538 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f4714140df0 0x7f4714141270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:42:14.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.148+0000 7f47193da700 1 --2- 172.21.15.114:0/1818598538 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47141468c0 0x7f471413f530 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f4710011a80 tx=0x7f4710011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:14.161 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.148+0000 7f4709ffb700 1 -- 172.21.15.114:0/1818598538 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471000f940 con 0x7f47141468c0 2023-10-18T12:42:14.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.148+0000 7f4709ffb700 1 -- 172.21.15.114:0/1818598538 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f471000faa0 con 0x7f47141468c0 2023-10-18T12:42:14.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.148+0000 7f471b63e700 1 -- 172.21.15.114:0/1818598538 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f471415b540 con 0x7f47141468c0 2023-10-18T12:42:14.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.148+0000 7f4709ffb700 1 -- 172.21.15.114:0/1818598538 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471000fe30 con 0x7f47141468c0 2023-10-18T12:42:14.162 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.148+0000 7f471b63e700 1 -- 172.21.15.114:0/1818598538 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47140cfac0 con 0x7f47141468c0 2023-10-18T12:42:14.163 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.152+0000 7f471b63e700 1 -- 172.21.15.114:0/1818598538 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f47140b6670 con 0x7f47141468c0 2023-10-18T12:42:14.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.152+0000 7f4709ffb700 1 -- 172.21.15.114:0/1818598538 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f4710014440 con 0x7f47141468c0 2023-10-18T12:42:14.164 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.152+0000 7f4709ffb700 1 --2- 172.21.15.114:0/1818598538 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f46f80656f0 0x7f46f8067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:14.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.152+0000 7f4709ffb700 1 -- 172.21.15.114:0/1818598538 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5659+0+0 (secure 0 0 0) 0x7f4710083350 con 0x7f47141468c0 2023-10-18T12:42:14.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.152+0000 7f4709ffb700 1 --2- 172.21.15.114:0/1818598538 >> [v2:172.21.15.172:6808/349710101,v1:172.21.15.172:6809/349710101] conn(0x7f46f806c060 0x7f46f806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:14.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.156+0000 7f4709ffb700 1 -- 172.21.15.114:0/1818598538 --> [v2:172.21.15.172:6808/349710101,v1:172.21.15.172:6809/349710101] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f46f806eb70 con 0x7f46f806c060 2023-10-18T12:42:14.165 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.156+0000 7f4709ffb700 1 -- 172.21.15.114:0/1818598538 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4710085a10 con 0x7f47141468c0 2023-10-18T12:42:14.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.156+0000 7f4718bd9700 1 --2- 172.21.15.114:0/1818598538 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f46f80656f0 0x7f46f8067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:14.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.156+0000 7f4719bdb700 1 --2- 172.21.15.114:0/1818598538 >> [v2:172.21.15.172:6808/349710101,v1:172.21.15.172:6809/349710101] conn(0x7f46f806c060 0x7f46f806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:14.166 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.156+0000 7f4718bd9700 1 --2- 172.21.15.114:0/1818598538 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f46f80656f0 0x7f46f8067bb0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f4714160ba0 tx=0x7f4704007000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:14.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.156+0000 7f4719bdb700 1 --2- 172.21.15.114:0/1818598538 >> [v2:172.21.15.172:6808/349710101,v1:172.21.15.172:6809/349710101] conn(0x7f46f806c060 0x7f46f806e4a0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:14.167 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.156+0000 7f4709ffb700 1 -- 172.21.15.114:0/1818598538 <== osd.7 v2:172.21.15.172:6808/349710101 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f46f806eb70 con 0x7f46f806c060 2023-10-18T12:42:14.182 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.176+0000 7f471b63e700 1 -- 172.21.15.114:0/1818598538 --> [v2:172.21.15.172:6808/349710101,v1:172.21.15.172:6809/349710101] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f47140b6390 con 0x7f46f806c060 2023-10-18T12:42:14.183 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.176+0000 7f4709ffb700 1 -- 172.21.15.114:0/1818598538 <== osd.7 v2:172.21.15.172:6808/349710101 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f470c001e50 con 0x7f46f806c060 2023-10-18T12:42:14.184 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2023-10-18T12:42:14.184 INFO:teuthology.orchestra.run.smithi114.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-18T12:42:14.185 INFO:teuthology.orchestra.run.smithi114.stdout:} 2023-10-18T12:42:14.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.180+0000 7f471b63e700 1 -- 172.21.15.114:0/1818598538 >> [v2:172.21.15.172:6808/349710101,v1:172.21.15.172:6809/349710101] conn(0x7f46f806c060 msgr2=0x7f46f806e4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:14.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.180+0000 7f471b63e700 1 --2- 172.21.15.114:0/1818598538 >> [v2:172.21.15.172:6808/349710101,v1:172.21.15.172:6809/349710101] conn(0x7f46f806c060 0x7f46f806e4a0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:14.186 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.180+0000 7f471b63e700 1 -- 172.21.15.114:0/1818598538 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f46f80656f0 msgr2=0x7f46f8067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:14.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.180+0000 7f471b63e700 1 --2- 172.21.15.114:0/1818598538 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f46f80656f0 0x7f46f8067bb0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f4714160ba0 tx=0x7f4704007000 comp rx=0 tx=0).stop 2023-10-18T12:42:14.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.180+0000 7f471b63e700 1 -- 172.21.15.114:0/1818598538 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47141468c0 msgr2=0x7f471413f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:14.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.180+0000 7f471b63e700 1 --2- 172.21.15.114:0/1818598538 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47141468c0 0x7f471413f530 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f4710011a80 tx=0x7f4710011d90 comp rx=0 tx=0).stop 2023-10-18T12:42:14.187 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.180+0000 7f4719bdb700 1 -- 172.21.15.114:0/1818598538 reap_dead start 2023-10-18T12:42:14.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.180+0000 7f471b63e700 1 -- 172.21.15.114:0/1818598538 shutdown_connections 2023-10-18T12:42:14.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.180+0000 7f471b63e700 1 -- 172.21.15.114:0/1818598538 >> 172.21.15.114:0/1818598538 conn(0x7f471406a130 msgr2=0x7f4714143460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:14.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.180+0000 7f471b63e700 1 -- 172.21.15.114:0/1818598538 shutdown_connections 2023-10-18T12:42:14.188 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.180+0000 7f471b63e700 1 -- 172.21.15.114:0/1818598538 wait complete. 2023-10-18T12:42:14.205 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-18T12:42:14.384 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.376+0000 7fe40bb2b700 1 Processor -- start 2023-10-18T12:42:14.385 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.380+0000 7fe40bb2b700 1 -- start start 2023-10-18T12:42:14.386 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.380+0000 7fe40bb2b700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe4040ceab0 0x7fe4040b2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:14.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.380+0000 7fe40bb2b700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe4040cee90 0x7fe4040b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:14.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.380+0000 7fe40bb2b700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe404071c40 con 0x7fe4040b5510 2023-10-18T12:42:14.387 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.380+0000 7fe40bb2b700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe404071310 con 0x7fe4040cee90 2023-10-18T12:42:14.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.380+0000 7fe40bb2b700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe404070690 con 0x7fe4040ceab0 2023-10-18T12:42:14.388 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.380+0000 7fe4090c6700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe4040cee90 0x7fe4040b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:14.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.380+0000 7fe4098c7700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe4040ceab0 0x7fe4040b2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:14.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.380+0000 7fe4098c7700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fe4040ceab0 0x7fe4040b2720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.114:34304/0 (socket says 172.21.15.114:34304) 2023-10-18T12:42:14.389 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.380+0000 7fe4098c7700 1 -- 172.21.15.114:0/1808322505 learned_addr learned my addr 172.21.15.114:0/1808322505 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:42:14.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.380+0000 7fe4090c6700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fe4040cee90 0x7fe4040b4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37058/0 (socket says 172.21.15.114:37058) 2023-10-18T12:42:14.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.380+0000 7fe4098c7700 1 -- 172.21.15.114:0/1808322505 >> v2:172.21.15.114:3300/0 conn(0x7fe4040cee90 msgr2=0x7fe4040b4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:42:14.390 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.380+0000 7fe4098c7700 1 --2- 172.21.15.114:0/1808322505 >> v2:172.21.15.114:3300/0 conn(0x7fe4040cee90 0x7fe4040b4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:14.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.380+0000 7fe4098c7700 1 -- 172.21.15.114:0/1808322505 >> v1:172.21.15.172:6789/0 conn(0x7fe4040b5510 legacy=0x7fe4040cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:14.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.384+0000 7fe4098c7700 1 -- 172.21.15.114:0/1808322505 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe404070970 con 0x7fe4040ceab0 2023-10-18T12:42:14.391 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.384+0000 7fe4098c7700 1 --2- 172.21.15.114:0/1808322505 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4040ceab0 0x7fe4040b2720 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe4040cd0a0 tx=0x7fe400009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=700c806bc9561e66 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:14.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.384+0000 7fe4088c5700 1 -- 172.21.15.114:0/1808322505 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe400011830 con 0x7fe4040ceab0 2023-10-18T12:42:14.392 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.384+0000 7fe4088c5700 1 -- 172.21.15.114:0/1808322505 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe400011990 con 0x7fe4040ceab0 2023-10-18T12:42:14.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.384+0000 7fe4088c5700 1 -- 172.21.15.114:0/1808322505 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe400011d20 con 0x7fe4040ceab0 2023-10-18T12:42:14.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.384+0000 7fe40bb2b700 1 -- 172.21.15.114:0/1808322505 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4040ceab0 msgr2=0x7fe4040b2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:14.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.384+0000 7fe40bb2b700 1 --2- 172.21.15.114:0/1808322505 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4040ceab0 0x7fe4040b2720 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe4040cd0a0 tx=0x7fe400009bf0 comp rx=0 tx=0).stop 2023-10-18T12:42:14.393 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.384+0000 7fe40bb2b700 1 -- 172.21.15.114:0/1808322505 shutdown_connections 2023-10-18T12:42:14.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.384+0000 7fe40bb2b700 1 --2- 172.21.15.114:0/1808322505 >> v2:172.21.15.114:3300/0 conn(0x7fe4040cee90 0x7fe4040b4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:14.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.384+0000 7fe40bb2b700 1 --2- 172.21.15.114:0/1808322505 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4040ceab0 0x7fe4040b2720 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:14.394 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.384+0000 7fe40bb2b700 1 -- 172.21.15.114:0/1808322505 >> 172.21.15.114:0/1808322505 conn(0x7fe4040cc350 msgr2=0x7fe4040cc730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:14.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.384+0000 7fe40bb2b700 1 -- 172.21.15.114:0/1808322505 shutdown_connections 2023-10-18T12:42:14.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.384+0000 7fe40bb2b700 1 -- 172.21.15.114:0/1808322505 wait complete. 2023-10-18T12:42:14.395 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.388+0000 7fe40bb2b700 1 Processor -- start 2023-10-18T12:42:14.396 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.388+0000 7fe40bb2b700 1 -- start start 2023-10-18T12:42:14.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.388+0000 7fe40bb2b700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4040b5510 0x7fe4040b4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:14.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.392+0000 7fe40bb2b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4040ceab0 0x7fe40414ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:14.397 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.392+0000 7fe40bb2b700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe4040cee90 0x7fe40415c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:14.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.392+0000 7fe40bb2b700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe40414d210 con 0x7fe4040ceab0 2023-10-18T12:42:14.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.392+0000 7fe40bb2b700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4040b5330 con 0x7fe4040b5510 2023-10-18T12:42:14.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.392+0000 7fe40bb2b700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4040c6010 con 0x7fe4040cee90 2023-10-18T12:42:14.398 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.392+0000 7fe4090c6700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4040ceab0 0x7fe40414ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:14.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.392+0000 7fe4090c6700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4040ceab0 0x7fe40414ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37068/0 (socket says 172.21.15.114:37068) 2023-10-18T12:42:14.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.392+0000 7fe4090c6700 1 -- 172.21.15.114:0/2056162927 learned_addr learned my addr 172.21.15.114:0/2056162927 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:42:14.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.392+0000 7fe4098c7700 1 --2- 172.21.15.114:0/2056162927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4040b5510 0x7fe4040b4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:14.399 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.392+0000 7fe40a0c8700 1 --2- 172.21.15.114:0/2056162927 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe4040cee90 0x7fe40415c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:14.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.392+0000 7fe4090c6700 1 -- 172.21.15.114:0/2056162927 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe4040cee90 msgr2=0x7fe40415c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:14.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.392+0000 7fe4090c6700 1 --2- 172.21.15.114:0/2056162927 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe4040cee90 0x7fe40415c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:14.401 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.392+0000 7fe4090c6700 1 -- 172.21.15.114:0/2056162927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4040b5510 msgr2=0x7fe4040b4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:14.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.392+0000 7fe4090c6700 1 --2- 172.21.15.114:0/2056162927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4040b5510 0x7fe4040b4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:14.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.392+0000 7fe4090c6700 1 -- 172.21.15.114:0/2056162927 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe400009570 con 0x7fe4040ceab0 2023-10-18T12:42:14.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.392+0000 7fe4098c7700 1 --2- 172.21.15.114:0/2056162927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4040b5510 0x7fe4040b4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-18T12:42:14.402 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.392+0000 7fe4090c6700 1 --2- 172.21.15.114:0/2056162927 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4040ceab0 0x7fe40414ccd0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fe3f400e840 tx=0x7fe3f400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:14.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.392+0000 7fe3fa7fc700 1 -- 172.21.15.114:0/2056162927 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f40095a0 con 0x7fe4040ceab0 2023-10-18T12:42:14.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.392+0000 7fe3fa7fc700 1 -- 172.21.15.114:0/2056162927 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f400c690 con 0x7fe4040ceab0 2023-10-18T12:42:14.403 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.392+0000 7fe40bb2b700 1 -- 172.21.15.114:0/2056162927 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4040c56e0 con 0x7fe4040ceab0 2023-10-18T12:42:14.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.392+0000 7fe3fa7fc700 1 -- 172.21.15.114:0/2056162927 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f400ca00 con 0x7fe4040ceab0 2023-10-18T12:42:14.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.392+0000 7fe40bb2b700 1 -- 172.21.15.114:0/2056162927 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4040c5ca0 con 0x7fe4040ceab0 2023-10-18T12:42:14.404 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.396+0000 7fe40bb2b700 1 -- 172.21.15.114:0/2056162927 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe404072e60 con 0x7fe4040ceab0 2023-10-18T12:42:14.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.396+0000 7fe3fa7fc700 1 -- 172.21.15.114:0/2056162927 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fe3f400cb60 con 0x7fe4040ceab0 2023-10-18T12:42:14.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.396+0000 7fe3fa7fc700 1 --2- 172.21.15.114:0/2056162927 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe3e8065720 0x7fe3e8067be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:14.405 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.396+0000 7fe3fa7fc700 1 -- 172.21.15.114:0/2056162927 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5659+0+0 (secure 0 0 0) 0x7fe3f4082d20 con 0x7fe4040ceab0 2023-10-18T12:42:14.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.400+0000 7fe4098c7700 1 --2- 172.21.15.114:0/2056162927 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe3e8065720 0x7fe3e8067be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:14.406 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.400+0000 7fe4098c7700 1 --2- 172.21.15.114:0/2056162927 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe3e8065720 0x7fe3e8067be0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe400000c00 tx=0x7fe400008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:14.408 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.404+0000 7fe3fa7fc700 1 -- 172.21.15.114:0/2056162927 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fe3f4050850 con 0x7fe4040ceab0 2023-10-18T12:42:14.712 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.704+0000 7fe40bb2b700 1 -- 172.21.15.114:0/2056162927 --> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fe404070f30 con 0x7fe3e8065720 2023-10-18T12:42:14.713 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.708+0000 7fe3fa7fc700 1 -- 172.21.15.114:0/2056162927 <== mgr.4108 v2:172.21.15.172:6832/461408666 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe400011c00 con 0x7fe3e8065720 2023-10-18T12:42:14.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.708+0000 7fe40bb2b700 1 -- 172.21.15.114:0/2056162927 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe3e8065720 msgr2=0x7fe3e8067be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:14.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.708+0000 7fe40bb2b700 1 --2- 172.21.15.114:0/2056162927 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe3e8065720 0x7fe3e8067be0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe400000c00 tx=0x7fe400008030 comp rx=0 tx=0).stop 2023-10-18T12:42:14.717 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.712+0000 7fe40bb2b700 1 -- 172.21.15.114:0/2056162927 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4040ceab0 msgr2=0x7fe40414ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:14.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.712+0000 7fe40bb2b700 1 --2- 172.21.15.114:0/2056162927 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4040ceab0 0x7fe40414ccd0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fe3f400e840 tx=0x7fe3f400ec00 comp rx=0 tx=0).stop 2023-10-18T12:42:14.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.712+0000 7fe40bb2b700 1 -- 172.21.15.114:0/2056162927 shutdown_connections 2023-10-18T12:42:14.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.712+0000 7fe40bb2b700 1 --2- 172.21.15.114:0/2056162927 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fe3e8065720 0x7fe3e8067be0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:14.718 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.712+0000 7fe40bb2b700 1 --2- 172.21.15.114:0/2056162927 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fe4040cee90 0x7fe40415c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:14.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.712+0000 7fe40bb2b700 1 --2- 172.21.15.114:0/2056162927 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe4040ceab0 0x7fe40414ccd0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:14.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.712+0000 7fe40bb2b700 1 --2- 172.21.15.114:0/2056162927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4040b5510 0x7fe4040b4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:14.719 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.712+0000 7fe40bb2b700 1 -- 172.21.15.114:0/2056162927 >> 172.21.15.114:0/2056162927 conn(0x7fe4040cc350 msgr2=0x7fe4040b17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:14.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.712+0000 7fe40bb2b700 1 -- 172.21.15.114:0/2056162927 shutdown_connections 2023-10-18T12:42:14.720 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.712+0000 7fe40bb2b700 1 -- 172.21.15.114:0/2056162927 wait complete. 2023-10-18T12:42:14.721 INFO:teuthology.orchestra.run.smithi114.stderr:instructed osd(s) 7 to deep-scrub 2023-10-18T12:42:14.737 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-18T12:42:14.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.916+0000 7fcf40f64700 1 Processor -- start 2023-10-18T12:42:14.924 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.916+0000 7fcf40f64700 1 -- start start 2023-10-18T12:42:14.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.920+0000 7fcf40f64700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fcf3c146800 0x7fcf3c0b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:14.926 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.920+0000 7fcf40f64700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcf3c0700b0 0x7fcf3c15eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:14.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.920+0000 7fcf40f64700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf3c15e680 con 0x7fcf3c15dd30 2023-10-18T12:42:14.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.920+0000 7fcf40f64700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf3c0b6180 con 0x7fcf3c0700b0 2023-10-18T12:42:14.927 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.920+0000 7fcf40f64700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf3c0b6460 con 0x7fcf3c146800 2023-10-18T12:42:14.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.920+0000 7fcf3ad9d700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7fcf3c0700b0 0x7fcf3c15eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:14.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.920+0000 7fcf39d9b700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fcf3c15dd30 0x7fcf3c06f9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:50890/0 (socket says 172.21.15.114:50890) 2023-10-18T12:42:14.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.920+0000 7fcf39d9b700 1 -- 172.21.15.114:0/1353839090 learned_addr learned my addr 172.21.15.114:0/1353839090 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:42:14.929 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.920+0000 7fcf3a59c700 1 --2- 172.21.15.114:0/1353839090 >> v2:172.21.15.172:3300/0 conn(0x7fcf3c146800 0x7fcf3c0b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:14.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.920+0000 7fcf3ad9d700 1 -- 172.21.15.114:0/1353839090 >> v2:172.21.15.172:3300/0 conn(0x7fcf3c146800 msgr2=0x7fcf3c0b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:42:14.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.920+0000 7fcf3ad9d700 1 --2- 172.21.15.114:0/1353839090 >> v2:172.21.15.172:3300/0 conn(0x7fcf3c146800 0x7fcf3c0b5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:14.930 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.920+0000 7fcf3ad9d700 1 -- 172.21.15.114:0/1353839090 >> v1:172.21.15.114:6789/0 conn(0x7fcf3c15dd30 legacy=0x7fcf3c06f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:14.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.920+0000 7fcf3ad9d700 1 -- 172.21.15.114:0/1353839090 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf3c0b6740 con 0x7fcf3c0700b0 2023-10-18T12:42:14.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.920+0000 7fcf3959a700 1 -- 172.21.15.114:0/1353839090 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1484317757 0 0) 0x7fcf3c15e680 con 0x7fcf3c15dd30 2023-10-18T12:42:14.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.924+0000 7fcf3ad9d700 1 --2- 172.21.15.114:0/1353839090 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf3c0700b0 0x7fcf3c15eb10 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c0706b0 tx=0x7fcf3400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a27fc14c58f629e server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:14.934 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.924+0000 7fcf3959a700 1 -- 172.21.15.114:0/1353839090 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3400e070 con 0x7fcf3c0700b0 2023-10-18T12:42:14.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.924+0000 7fcf3959a700 1 -- 172.21.15.114:0/1353839090 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3400bb20 con 0x7fcf3c0700b0 2023-10-18T12:42:14.935 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.924+0000 7fcf3959a700 1 -- 172.21.15.114:0/1353839090 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf34012430 con 0x7fcf3c0700b0 2023-10-18T12:42:14.937 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.924+0000 7fcf40f64700 1 -- 172.21.15.114:0/1353839090 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf3c0700b0 msgr2=0x7fcf3c15eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:14.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.924+0000 7fcf40f64700 1 --2- 172.21.15.114:0/1353839090 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf3c0700b0 0x7fcf3c15eb10 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c0706b0 tx=0x7fcf3400b330 comp rx=0 tx=0).stop 2023-10-18T12:42:14.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.924+0000 7fcf40f64700 1 -- 172.21.15.114:0/1353839090 shutdown_connections 2023-10-18T12:42:14.938 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.924+0000 7fcf40f64700 1 --2- 172.21.15.114:0/1353839090 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf3c0700b0 0x7fcf3c15eb10 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:14.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.924+0000 7fcf40f64700 1 --2- 172.21.15.114:0/1353839090 >> v2:172.21.15.172:3300/0 conn(0x7fcf3c146800 0x7fcf3c0b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:14.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.924+0000 7fcf40f64700 1 -- 172.21.15.114:0/1353839090 >> 172.21.15.114:0/1353839090 conn(0x7fcf3c06a130 msgr2=0x7fcf3c06a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:14.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.924+0000 7fcf40f64700 1 -- 172.21.15.114:0/1353839090 shutdown_connections 2023-10-18T12:42:14.939 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.924+0000 7fcf40f64700 1 -- 172.21.15.114:0/1353839090 wait complete. 2023-10-18T12:42:14.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.928+0000 7fcf40f64700 1 Processor -- start 2023-10-18T12:42:14.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.928+0000 7fcf40f64700 1 -- start start 2023-10-18T12:42:14.940 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.928+0000 7fcf40f64700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf3c0700b0 0x7fcf3c06d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:14.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.928+0000 7fcf40f64700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf3c146800 0x7fcf3c1f3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:14.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.928+0000 7fcf40f64700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcf3c15dd30 0x7fcf3c15c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:14.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.928+0000 7fcf40f64700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c13c0b0 con 0x7fcf3c146800 2023-10-18T12:42:14.941 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.928+0000 7fcf40f64700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c13c390 con 0x7fcf3c0700b0 2023-10-18T12:42:14.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.928+0000 7fcf40f64700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c13c670 con 0x7fcf3c15dd30 2023-10-18T12:42:14.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.928+0000 7fcf39d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf3c146800 0x7fcf3c1f3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:14.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.928+0000 7fcf39d9b700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf3c146800 0x7fcf3c1f3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:37100/0 (socket says 172.21.15.114:37100) 2023-10-18T12:42:14.942 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.928+0000 7fcf39d9b700 1 -- 172.21.15.114:0/2470753963 learned_addr learned my addr 172.21.15.114:0/2470753963 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:42:14.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.932+0000 7fcf3ad9d700 1 --2- 172.21.15.114:0/2470753963 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcf3c15dd30 0x7fcf3c15c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:14.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.932+0000 7fcf3a59c700 1 --2- 172.21.15.114:0/2470753963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf3c0700b0 0x7fcf3c06d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:14.943 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.932+0000 7fcf39d9b700 1 -- 172.21.15.114:0/2470753963 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcf3c15dd30 msgr2=0x7fcf3c15c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:14.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.932+0000 7fcf39d9b700 1 --2- 172.21.15.114:0/2470753963 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcf3c15dd30 0x7fcf3c15c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:14.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.932+0000 7fcf39d9b700 1 -- 172.21.15.114:0/2470753963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf3c0700b0 msgr2=0x7fcf3c06d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:14.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.932+0000 7fcf39d9b700 1 --2- 172.21.15.114:0/2470753963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf3c0700b0 0x7fcf3c06d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:14.944 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.932+0000 7fcf39d9b700 1 -- 172.21.15.114:0/2470753963 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf34009a70 con 0x7fcf3c146800 2023-10-18T12:42:14.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.932+0000 7fcf39d9b700 1 --2- 172.21.15.114:0/2470753963 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf3c146800 0x7fcf3c1f3b00 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fcf3000c4e0 tx=0x7fcf3000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:14.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.932+0000 7fcf2affd700 1 -- 172.21.15.114:0/2470753963 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf30004ca0 con 0x7fcf3c146800 2023-10-18T12:42:14.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.932+0000 7fcf2affd700 1 -- 172.21.15.114:0/2470753963 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf30004e20 con 0x7fcf3c146800 2023-10-18T12:42:14.945 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.932+0000 7fcf40f64700 1 -- 172.21.15.114:0/2470753963 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf3c13c950 con 0x7fcf3c146800 2023-10-18T12:42:14.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.932+0000 7fcf2affd700 1 -- 172.21.15.114:0/2470753963 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf30007310 con 0x7fcf3c146800 2023-10-18T12:42:14.946 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.932+0000 7fcf40f64700 1 -- 172.21.15.114:0/2470753963 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf3c06d760 con 0x7fcf3c146800 2023-10-18T12:42:14.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.932+0000 7fcf40f64700 1 -- 172.21.15.114:0/2470753963 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf3c13ce70 con 0x7fcf3c146800 2023-10-18T12:42:14.947 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.936+0000 7fcf2affd700 1 -- 172.21.15.114:0/2470753963 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fcf30007470 con 0x7fcf3c146800 2023-10-18T12:42:14.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.936+0000 7fcf2affd700 1 --2- 172.21.15.114:0/2470753963 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fcf1c0656f0 0x7fcf1c067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:14.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.936+0000 7fcf2affd700 1 -- 172.21.15.114:0/2470753963 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5659+0+0 (secure 0 0 0) 0x7fcf300828b0 con 0x7fcf3c146800 2023-10-18T12:42:14.948 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.936+0000 7fcf3a59c700 1 --2- 172.21.15.114:0/2470753963 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fcf1c0656f0 0x7fcf1c067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:14.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.936+0000 7fcf3a59c700 1 --2- 172.21.15.114:0/2470753963 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fcf1c0656f0 0x7fcf1c067bb0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c009b80 tx=0x7fcf2c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:14.949 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:14.940+0000 7fcf2affd700 1 -- 172.21.15.114:0/2470753963 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fcf3c13ce70 con 0x7fcf3c146800 2023-10-18T12:42:15.118 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:15.112+0000 7fcf40f64700 1 -- 172.21.15.114:0/2470753963 --> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcf3c13c500 con 0x7fcf1c0656f0 2023-10-18T12:42:15.125 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:15.120+0000 7fcf2affd700 1 -- 172.21.15.114:0/2470753963 <== mgr.4108 v2:172.21.15.172:6832/461408666 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+69625 (secure 0 0 0) 0x7fcf3c13c500 con 0x7fcf1c0656f0 2023-10-18T12:42:15.126 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:42:15.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:15.120+0000 7fcf40f64700 1 -- 172.21.15.114:0/2470753963 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fcf1c0656f0 msgr2=0x7fcf1c067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:15.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:15.120+0000 7fcf40f64700 1 --2- 172.21.15.114:0/2470753963 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fcf1c0656f0 0x7fcf1c067bb0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c009b80 tx=0x7fcf2c008040 comp rx=0 tx=0).stop 2023-10-18T12:42:15.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:15.120+0000 7fcf40f64700 1 -- 172.21.15.114:0/2470753963 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf3c146800 msgr2=0x7fcf3c1f3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:15.128 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:15.120+0000 7fcf40f64700 1 --2- 172.21.15.114:0/2470753963 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf3c146800 0x7fcf3c1f3b00 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fcf3000c4e0 tx=0x7fcf3000c8a0 comp rx=0 tx=0).stop 2023-10-18T12:42:15.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:15.120+0000 7fcf40f64700 1 -- 172.21.15.114:0/2470753963 shutdown_connections 2023-10-18T12:42:15.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:15.120+0000 7fcf40f64700 1 --2- 172.21.15.114:0/2470753963 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fcf1c0656f0 0x7fcf1c067bb0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:15.129 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:15.120+0000 7fcf40f64700 1 --2- 172.21.15.114:0/2470753963 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcf3c15dd30 0x7fcf3c15c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:15.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:15.120+0000 7fcf40f64700 1 --2- 172.21.15.114:0/2470753963 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf3c146800 0x7fcf3c1f3b00 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:15.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:15.120+0000 7fcf40f64700 1 --2- 172.21.15.114:0/2470753963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf3c0700b0 0x7fcf3c06d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:15.130 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:15.120+0000 7fcf40f64700 1 -- 172.21.15.114:0/2470753963 >> 172.21.15.114:0/2470753963 conn(0x7fcf3c06a130 msgr2=0x7fcf3c15d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:15.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:15.120+0000 7fcf40f64700 1 -- 172.21.15.114:0/2470753963 shutdown_connections 2023-10-18T12:42:15.131 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:15.124+0000 7fcf40f64700 1 -- 172.21.15.114:0/2470753963 wait complete. 2023-10-18T12:42:15.132 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2023-10-18T12:42:15.153 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":740,"stamp":"2023-10-18T12:42:13.506948+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":223876,"kb_used_data":7044,"kb_used_omap":24,"kb_used_meta":216679,"kb_avail":754750844,"statfs":{"total":773094113280,"available":772864864256,"internally_reserved":0,"allocated":7213056,"data_stored":4145541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25470,"internal_metadata":221879426},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.981811"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":99,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-18T12:42:02.534714+0000","last_change":"2023-10-18T12:19:33.531672+0000","last_active":"2023-10-18T12:42:02.534714+0000","last_peered":"2023-10-18T12:42:02.534714+0000","last_clean":"2023-10-18T12:42:02.534714+0000","last_became_active":"2023-10-18T12:19:33.530907+0000","last_became_peered":"2023-10-18T12:19:33.530907+0000","last_unstale":"2023-10-18T12:42:02.534714+0000","last_undegraded":"2023-10-18T12:42:02.534714+0000","last_fullsized":"2023-10-18T12:42:02.534714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:31:18.374518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":100,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-18T12:42:03.106391+0000","last_change":"2023-10-18T12:19:33.529329+0000","last_active":"2023-10-18T12:42:03.106391+0000","last_peered":"2023-10-18T12:42:03.106391+0000","last_clean":"2023-10-18T12:42:03.106391+0000","last_became_active":"2023-10-18T12:19:33.528930+0000","last_became_peered":"2023-10-18T12:19:33.528930+0000","last_unstale":"2023-10-18T12:42:03.106391+0000","last_undegraded":"2023-10-18T12:42:03.106391+0000","last_fullsized":"2023-10-18T12:42:03.106391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":117,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-18T12:42:02.533844+0000","last_change":"2023-10-18T12:29:30.706360+0000","last_active":"2023-10-18T12:42:02.533844+0000","last_peered":"2023-10-18T12:42:02.533844+0000","last_clean":"2023-10-18T12:42:02.533844+0000","last_became_active":"2023-10-18T12:29:30.706091+0000","last_became_peered":"2023-10-18T12:29:30.706091+0000","last_unstale":"2023-10-18T12:42:02.533844+0000","last_undegraded":"2023-10-18T12:42:02.533844+0000","last_fullsized":"2023-10-18T12:42:02.533844+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T19:03:15.789429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":114,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-18T12:42:03.104725+0000","last_change":"2023-10-18T12:29:30.707576+0000","last_active":"2023-10-18T12:42:03.104725+0000","last_peered":"2023-10-18T12:42:03.104725+0000","last_clean":"2023-10-18T12:42:03.104725+0000","last_became_active":"2023-10-18T12:29:30.707304+0000","last_became_peered":"2023-10-18T12:29:30.707304+0000","last_unstale":"2023-10-18T12:42:03.104725+0000","last_undegraded":"2023-10-18T12:42:03.104725+0000","last_fullsized":"2023-10-18T12:42:03.104725+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":97,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-18T12:42:03.101790+0000","last_change":"2023-10-18T12:19:33.533449+0000","last_active":"2023-10-18T12:42:03.101790+0000","last_peered":"2023-10-18T12:42:03.101790+0000","last_clean":"2023-10-18T12:42:03.101790+0000","last_became_active":"2023-10-18T12:19:33.533051+0000","last_became_peered":"2023-10-18T12:19:33.533051+0000","last_unstale":"2023-10-18T12:42:03.101790+0000","last_undegraded":"2023-10-18T12:42:03.101790+0000","last_fullsized":"2023-10-18T12:42:03.101790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:57:33.363468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":102,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-18T12:42:03.101230+0000","last_change":"2023-10-18T12:19:33.530766+0000","last_active":"2023-10-18T12:42:03.101230+0000","last_peered":"2023-10-18T12:42:03.101230+0000","last_clean":"2023-10-18T12:42:03.101230+0000","last_became_active":"2023-10-18T12:19:33.530346+0000","last_became_peered":"2023-10-18T12:19:33.530346+0000","last_unstale":"2023-10-18T12:42:03.101230+0000","last_undegraded":"2023-10-18T12:42:03.101230+0000","last_fullsized":"2023-10-18T12:42:03.101230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":104,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-18T12:42:02.529917+0000","last_change":"2023-10-18T12:19:33.528538+0000","last_active":"2023-10-18T12:42:02.529917+0000","last_peered":"2023-10-18T12:42:02.529917+0000","last_clean":"2023-10-18T12:42:02.529917+0000","last_became_active":"2023-10-18T12:19:33.528214+0000","last_became_peered":"2023-10-18T12:19:33.528214+0000","last_unstale":"2023-10-18T12:42:02.529917+0000","last_undegraded":"2023-10-18T12:42:02.529917+0000","last_fullsized":"2023-10-18T12:42:02.529917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T17:03:21.542187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":97,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-18T12:42:03.103519+0000","last_change":"2023-10-18T12:19:33.531214+0000","last_active":"2023-10-18T12:42:03.103519+0000","last_peered":"2023-10-18T12:42:03.103519+0000","last_clean":"2023-10-18T12:42:03.103519+0000","last_became_active":"2023-10-18T12:19:33.530795+0000","last_became_peered":"2023-10-18T12:19:33.530795+0000","last_unstale":"2023-10-18T12:42:03.103519+0000","last_undegraded":"2023-10-18T12:42:03.103519+0000","last_fullsized":"2023-10-18T12:42:03.103519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:32.494936+0000","last_clean_scrub_stamp":"2023-10-18T12:19:32.494936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T22:33:38.568081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":274,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-18T12:42:02.530125+0000","last_change":"2023-10-18T12:29:30.706528+0000","last_active":"2023-10-18T12:42:02.530125+0000","last_peered":"2023-10-18T12:42:02.530125+0000","last_clean":"2023-10-18T12:42:02.530125+0000","last_became_active":"2023-10-18T12:29:30.706096+0000","last_became_peered":"2023-10-18T12:29:30.706096+0000","last_unstale":"2023-10-18T12:42:02.530125+0000","last_undegraded":"2023-10-18T12:42:02.530125+0000","last_fullsized":"2023-10-18T12:42:02.530125+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:19:27.318899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:19:27.318899+0000","last_clean_scrub_stamp":"2023-10-18T12:19:27.318899+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T12:43:13.181655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575125,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28336,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343504,"statfs":{"total":96636764160,"available":96607748096,"internally_reserved":0,"allocated":1343488,"data_stored":959804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.153,"15min":1.153},"min":{"1min":0.86399999999999999,"5min":0.56200000000000006,"15min":0.55000000000000004},"max":{"1min":1.3240000000000001,"5min":1.679,"15min":1.9179999999999999},"last":1.222},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1859999999999999,"15min":1.159},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.61799999999999999},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.69699999999999995}]},{"osd":1,"last update":"Wed Oct 18 12:42:07 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.151,"15min":1.151},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.48399999999999999},"max":{"1min":1.403,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.125},{"interface":"front","average":{"1min":1.123,"5min":1.1739999999999999,"15min":1.1659999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.56000000000000005},"max":{"1min":1.4850000000000001,"5min":1.599,"15min":2.343},"last":1.4970000000000001}]},{"osd":2,"last update":"Wed Oct 18 12:42:07 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.3360000000000001,"15min":1.3360000000000001},"min":{"1min":0.98199999999999998,"5min":0.81399999999999995,"15min":0.67000000000000004},"max":{"1min":2.3140000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.319,"15min":1.29},"min":{"1min":0.89300000000000002,"5min":0.747,"15min":0.747},"max":{"1min":2.2810000000000001,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":1.177}]},{"osd":3,"last update":"Wed Oct 18 12:42:07 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.2729999999999999,"15min":1.2589999999999999},"min":{"1min":0.98299999999999998,"5min":0.90600000000000003,"15min":0.55300000000000005},"max":{"1min":1.6899999999999999,"5min":1.8540000000000001,"15min":1.95},"last":1.45},{"interface":"front","average":{"1min":1.417,"5min":1.419,"15min":1.403},"min":{"1min":1.038,"5min":0.90400000000000003,"15min":0.81599999999999995},"max":{"1min":1.595,"5min":1.8580000000000001,"15min":2.5710000000000002},"last":1.3740000000000001}]},{"osd":4,"last update":"Wed Oct 18 12:42:07 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2050000000000001,"15min":1.177},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.57599999999999996},"max":{"1min":1.659,"5min":1.679,"15min":2.0779999999999998},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.2430000000000001,"15min":1.228},"min":{"1min":0.94399999999999995,"5min":0.83899999999999997,"15min":0.58599999999999997},"max":{"1min":1.589,"5min":1.9570000000000001,"15min":2.0219999999999998},"last":1.258}]},{"osd":5,"last update":"Wed Oct 18 12:42:07 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.3580000000000001,"15min":1.3109999999999999},"min":{"1min":0.85199999999999998,"5min":0.83999999999999997,"15min":0.499},"max":{"1min":1.704,"5min":2.0070000000000001,"15min":2.5150000000000001},"last":1.5640000000000001},{"interface":"front","average":{"1min":1.333,"5min":1.371,"15min":1.3560000000000001},"min":{"1min":1.137,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.615,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":1.413}]},{"osd":6,"last update":"Wed Oct 18 12:42:07 2023","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.454,"15min":1.4399999999999999},"min":{"1min":0.83199999999999996,"5min":0.72199999999999998,"15min":0.67400000000000004},"max":{"1min":1.7210000000000001,"5min":2.1909999999999998,"15min":2.274},"last":1.48},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.367,"15min":1.347},"min":{"1min":1.155,"5min":0.79800000000000004,"15min":0.61699999999999999},"max":{"1min":1.784,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":1.341}]}]},{"osd":6,"up_from":13,"seq":55834575125,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":753664,"data_stored":370767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:41:48 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.1419999999999999,"15min":1.127},"min":{"1min":0.81999999999999995,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.3779999999999999,"5min":1.7250000000000001,"15min":1.7509999999999999},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.141,"5min":1.159,"15min":1.149},"min":{"1min":0.81599999999999995,"5min":0.752,"15min":0.752},"max":{"1min":1.462,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.81899999999999995}]},{"osd":1,"last update":"Wed Oct 18 12:41:17 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.131,"15min":1.179},"min":{"1min":0.86099999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.488,"5min":1.5660000000000001,"15min":1.7969999999999999},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.206,"15min":1.2050000000000001},"min":{"1min":0.94499999999999995,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.4930000000000001,"5min":1.7050000000000001,"15min":1.8480000000000001},"last":0.93000000000000005}]},{"osd":2,"last update":"Wed Oct 18 12:41:17 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.214,"15min":1.2430000000000001},"min":{"1min":0.91000000000000003,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.6399999999999999,"5min":1.6699999999999999,"15min":1.958},"last":1.327},{"interface":"front","average":{"1min":1.21,"5min":1.2010000000000001,"15min":1.2170000000000001},"min":{"1min":0.84999999999999998,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.5720000000000001,"5min":1.585,"15min":1.645},"last":0.76100000000000001}]},{"osd":3,"last update":"Wed Oct 18 12:41:17 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.2869999999999999,"15min":1.29},"min":{"1min":0.92600000000000005,"5min":0.84699999999999998,"15min":0.76100000000000001},"max":{"1min":1.51,"5min":1.6879999999999999,"15min":1.7290000000000001},"last":1.421},{"interface":"front","average":{"1min":1.331,"5min":1.3600000000000001,"15min":1.397},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.83399999999999996},"max":{"1min":1.647,"5min":1.8300000000000001,"15min":1.952},"last":1.456}]},{"osd":4,"last update":"Wed Oct 18 12:41:17 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.1870000000000001,"15min":1.1850000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.528,"5min":1.74,"15min":1.8480000000000001},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.28,"5min":1.25,"15min":1.248},"min":{"1min":0.82999999999999996,"5min":0.66700000000000004,"15min":0.60799999999999998},"max":{"1min":1.5700000000000001,"5min":1.8759999999999999,"15min":1.917},"last":1.1399999999999999}]},{"osd":5,"last update":"Wed Oct 18 12:41:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.266,"15min":1.3149999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.446,"5min":1.8160000000000001,"15min":2.0430000000000001},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.329,"15min":1.345},"min":{"1min":0.88500000000000001,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.528,"5min":1.8300000000000001,"15min":1.9970000000000001},"last":0.90900000000000003}]},{"osd":7,"last update":"Wed Oct 18 12:41:17 2023","interfaces":[{"interface":"back","average":{"1min":1.427,"5min":1.363,"15min":1.373},"min":{"1min":1.099,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.6499999999999999,"5min":2.0059999999999998,"15min":2.0059999999999998},"last":1.367},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.423,"15min":1.4570000000000001},"min":{"1min":0.79600000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.744,"5min":1.9379999999999999,"15min":2.105},"last":1.508}]}]},{"osd":5,"up_from":13,"seq":55834575126,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":753664,"data_stored":370767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.262,"15min":1.2709999999999999},"min":{"1min":1.1399999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.7150000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.278,"5min":1.2649999999999999,"15min":1.2909999999999999},"min":{"1min":0.89500000000000002,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":0.86699999999999999}]},{"osd":1,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.1479999999999999,"15min":1.1759999999999999},"min":{"1min":0.90300000000000002,"5min":0.753,"15min":0.70499999999999996},"max":{"1min":1.3839999999999999,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.155,"15min":1.181},"min":{"1min":0.80600000000000005,"5min":0.72599999999999998,"15min":0.55200000000000005},"max":{"1min":1.6160000000000001,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.2989999999999999}]},{"osd":2,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.1779999999999999,"15min":1.1539999999999999},"min":{"1min":0.86599999999999999,"5min":0.81100000000000005,"15min":0.58799999999999997},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.228,"5min":1.2030000000000001,"15min":1.226},"min":{"1min":0.93500000000000005,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.73},"last":1.071}]},{"osd":3,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.282,"15min":1.298},"min":{"1min":0.94299999999999995,"5min":0.83999999999999997,"15min":0.80000000000000004},"max":{"1min":1.478,"5min":1.651,"15min":1.8169999999999999},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.373,"15min":1.339},"min":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":0.90300000000000002},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.202}]},{"osd":4,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.1499999999999999,"15min":1.167},"min":{"1min":0.76000000000000001,"5min":0.52500000000000002,"15min":0.42999999999999999},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.77},"last":1.24},{"interface":"front","average":{"1min":1.2,"5min":1.244,"15min":1.2430000000000001},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.61899999999999999},"max":{"1min":1.639,"5min":1.6819999999999999,"15min":1.8700000000000001},"last":1.446}]},{"osd":6,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2310000000000001,"15min":1.218},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.66200000000000003},"max":{"1min":1.639,"5min":1.774,"15min":2.411},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.321,"15min":1.323},"min":{"1min":0.92500000000000004,"5min":0.80600000000000005,"15min":0.48199999999999998},"max":{"1min":1.6359999999999999,"5min":1.796,"15min":2.1629999999999998},"last":1.169}]},{"osd":7,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.369,"15min":1.3540000000000001},"min":{"1min":0.85899999999999999,"5min":0.83999999999999997,"15min":0.63600000000000001},"max":{"1min":1.7250000000000001,"5min":1.873,"15min":1.873},"last":1.526},{"interface":"front","average":{"1min":1.415,"5min":1.399,"15min":1.3799999999999999},"min":{"1min":0.96499999999999997,"5min":0.83599999999999997,"15min":0.52000000000000002},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":2.496},"last":1.272}]}]},{"osd":4,"up_from":13,"seq":55834575123,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27760,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":753664,"data_stored":370767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:41:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1439999999999999,"15min":1.169},"min":{"1min":0.77700000000000002,"5min":0.59499999999999997,"15min":0.46500000000000002},"max":{"1min":1.74,"5min":1.74,"15min":1.9419999999999999},"last":1.399},{"interface":"front","average":{"1min":1.123,"5min":1.1679999999999999,"15min":1.1779999999999999},"min":{"1min":0.84199999999999997,"5min":0.78100000000000003,"15min":0.58799999999999997},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.7609999999999999},"last":0.78800000000000003}]},{"osd":1,"last update":"Wed Oct 18 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1870000000000001,"15min":1.1819999999999999},"min":{"1min":0.625,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.661,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.2070000000000001,"15min":1.21},"min":{"1min":0.81200000000000006,"5min":0.76800000000000002,"15min":0.69099999999999995},"max":{"1min":1.462,"5min":1.601,"15min":1.786},"last":1.3360000000000001}]},{"osd":2,"last update":"Wed Oct 18 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.1399999999999999,"15min":1.1599999999999999},"min":{"1min":0.76200000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3129999999999999,"5min":1.6020000000000001,"15min":1.6619999999999999},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2549999999999999,"15min":1.28},"min":{"1min":0.70699999999999996,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.8680000000000001},"last":1.028}]},{"osd":3,"last update":"Wed Oct 18 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.296,"5min":1.3109999999999999,"15min":1.349},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.847,"5min":1.847,"15min":1.8799999999999999},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.25,"5min":1.2849999999999999,"15min":1.3069999999999999},"min":{"1min":0.76900000000000002,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.502,"5min":1.986,"15min":1.986},"last":1.476}]},{"osd":5,"last update":"Wed Oct 18 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2250000000000001,"15min":1.2110000000000001},"min":{"1min":0.70899999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.8,"5min":1.8,"15min":2.1259999999999999},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.236,"5min":1.2729999999999999,"15min":1.25},"min":{"1min":0.84599999999999997,"5min":0.78700000000000003,"15min":0.499},"max":{"1min":1.752,"5min":1.855,"15min":1.855},"last":1.206}]},{"osd":6,"last update":"Wed Oct 18 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.212,"15min":1.232},"min":{"1min":0.78100000000000003,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.5900000000000001,"5min":1.8700000000000001,"15min":1.9930000000000001},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.3660000000000001,"15min":1.373},"min":{"1min":1.0720000000000001,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.865,"5min":1.865,"15min":2.0579999999999998},"last":1.5209999999999999}]},{"osd":7,"last update":"Wed Oct 18 12:41:15 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3759999999999999,"15min":1.3779999999999999},"min":{"1min":1.0569999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":2.79},"last":1.5569999999999999},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.3680000000000001,"15min":1.373},"min":{"1min":0.86399999999999999,"5min":0.747,"15min":0.67900000000000005},"max":{"1min":1.8200000000000001,"5min":2.1019999999999999,"15min":2.173},"last":1.601}]}]},{"osd":3,"up_from":13,"seq":55834575125,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":753664,"data_stored":370767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.76300000000000001,"15min":0.76200000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.157,"5min":1.157,"15min":1.417},"last":0.69499999999999995},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.1020000000000001,"15min":1.0760000000000001},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.127}]},{"osd":1,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.85599999999999998,"15min":0.86499999999999999},"min":{"1min":0.66300000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1830000000000001,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.999,"5min":0.95099999999999996,"15min":0.94599999999999995},"min":{"1min":0.74399999999999999,"5min":0.58299999999999996,"15min":0.53000000000000003},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.61799999999999999}]},{"osd":2,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.163,"15min":1.1379999999999999},"min":{"1min":0.75900000000000001,"5min":0.67100000000000004,"15min":0.55100000000000005},"max":{"1min":1.5229999999999999,"5min":1.5680000000000001,"15min":1.6970000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2110000000000001,"15min":1.204},"min":{"1min":1.018,"5min":0.80700000000000005,"15min":0.64300000000000002},"max":{"1min":1.5589999999999999,"5min":1.651,"15min":1.7410000000000001},"last":1.0089999999999999}]},{"osd":4,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.1930000000000001,"15min":1.1919999999999999},"min":{"1min":0.85899999999999999,"5min":0.79700000000000004,"15min":0.70599999999999996},"max":{"1min":1.609,"5min":1.609,"15min":2.306},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.262,"15min":1.268},"min":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.872},"max":{"1min":1.355,"5min":1.7070000000000001,"15min":2.2509999999999999},"last":1.0920000000000001}]},{"osd":5,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.331,"15min":1.323},"min":{"1min":1.0409999999999999,"5min":0.98199999999999998,"15min":0.80600000000000005},"max":{"1min":1.54,"5min":1.667,"15min":1.6739999999999999},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2889999999999999,"15min":1.286},"min":{"1min":1.0609999999999999,"5min":0.90300000000000002,"15min":0.73499999999999999},"max":{"1min":1.4930000000000001,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":1.0700000000000001}]},{"osd":6,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.3180000000000001,"15min":1.2849999999999999},"min":{"1min":1.085,"5min":0.90600000000000003,"15min":0.872},"max":{"1min":1.7250000000000001,"5min":1.7250000000000001,"15min":3.2280000000000002},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.353,"5min":1.371,"15min":1.3720000000000001},"min":{"1min":1.1859999999999999,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":1.651,"5min":1.663,"15min":2.02},"last":1.169}]},{"osd":7,"last update":"Wed Oct 18 12:41:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.3480000000000001,"15min":1.3380000000000001},"min":{"1min":1.083,"5min":0.99299999999999999,"15min":0.83699999999999997},"max":{"1min":1.522,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.397,"5min":1.375,"15min":1.3540000000000001},"min":{"1min":1.159,"5min":0.98099999999999998,"15min":0.95399999999999996},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":3.3679999999999999},"last":1.208}]}]},{"osd":2,"up_from":13,"seq":55834575123,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":753664,"data_stored":370767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.81000000000000005,"15min":0.80500000000000005},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.52100000000000002},"max":{"1min":1.47,"5min":1.47,"15min":1.5800000000000001},"last":0.626},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.91800000000000004,"15min":0.93000000000000005},"min":{"1min":0.67200000000000004,"5min":0.57299999999999995,"15min":0.55200000000000005},"max":{"1min":1.214,"5min":1.639,"15min":1.639},"last":0.67800000000000005}]},{"osd":1,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0349999999999999,"15min":0.98999999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.40500000000000003},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.999},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.92800000000000005,"15min":0.95699999999999996},"min":{"1min":0.67400000000000004,"5min":0.60699999999999998,"15min":0.54800000000000004},"max":{"1min":1.452,"5min":1.452,"15min":1.4890000000000001},"last":0.78900000000000003}]},{"osd":3,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.2989999999999999,"15min":1.266},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.595,"5min":1.7589999999999999,"15min":1.821},"last":1.175},{"interface":"front","average":{"1min":1.073,"5min":1.048,"15min":1.0760000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.4650000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.871}]},{"osd":4,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.2170000000000001,"15min":1.236},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.55,"5min":1.631,"15min":1.7130000000000001},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.21,"15min":1.2370000000000001},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.4279999999999999,"5min":1.5389999999999999,"15min":1.7470000000000001},"last":1.3779999999999999}]},{"osd":5,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.363,"5min":1.3440000000000001,"15min":1.3540000000000001},"min":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.76100000000000001},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.429,"5min":1.427,"15min":1.403},"min":{"1min":1.1240000000000001,"5min":1.034,"15min":0.98099999999999998},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.863},"last":1.2629999999999999}]},{"osd":6,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.355,"15min":1.337},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.579,"5min":1.6899999999999999,"15min":1.6970000000000001},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.2969999999999999,"15min":1.298},"min":{"1min":0.873,"5min":0.873,"15min":0.873},"max":{"1min":1.6910000000000001,"5min":1.778,"15min":1.8029999999999999},"last":1.417}]},{"osd":7,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.323,"15min":1.3320000000000001},"min":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":0.95699999999999996},"max":{"1min":1.6040000000000001,"5min":1.631,"15min":1.8029999999999999},"last":1.5149999999999999},{"interface":"front","average":{"1min":1.395,"5min":1.421,"15min":1.411},"min":{"1min":1.1499999999999999,"5min":1.099,"15min":0.97599999999999998},"max":{"1min":1.647,"5min":1.8680000000000001,"15min":1.9590000000000001},"last":1.6080000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575124,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":753664,"data_stored":370767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.83699999999999997,"15min":0.85899999999999999},"min":{"1min":0.56399999999999995,"5min":0.47499999999999998,"15min":0.45200000000000001},"max":{"1min":0.97199999999999998,"5min":1.6020000000000001,"15min":1.6559999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.012,"5min":1.004,"15min":1.034},"min":{"1min":0.621,"5min":0.621,"15min":0.54800000000000004},"max":{"1min":1.603,"5min":1.603,"15min":1.9830000000000001},"last":0.89300000000000002}]},{"osd":2,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.90100000000000002,"15min":0.90700000000000003},"min":{"1min":0.60399999999999998,"5min":0.55700000000000005,"15min":0.436},"max":{"1min":1.52,"5min":1.52,"15min":1.7310000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.073,"15min":1.111},"min":{"1min":0.875,"5min":0.59799999999999998,"15min":0.505},"max":{"1min":1.4830000000000001,"5min":1.714,"15min":1.714},"last":0.69199999999999995}]},{"osd":3,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.161,"15min":1.204},"min":{"1min":0.83899999999999997,"5min":0.69199999999999995,"15min":0.57299999999999995},"max":{"1min":1.373,"5min":1.595,"15min":1.603},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.96999999999999997,"15min":1},"min":{"1min":0.68300000000000005,"5min":0.59899999999999998,"15min":0.56799999999999995},"max":{"1min":1.4510000000000001,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.73399999999999999}]},{"osd":4,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.25,"15min":1.25},"min":{"1min":0.98599999999999999,"5min":0.81000000000000005,"15min":0.72199999999999998},"max":{"1min":1.476,"5min":1.9450000000000001,"15min":2.0470000000000002},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.1950000000000001,"15min":1.1970000000000001},"min":{"1min":0.94199999999999995,"5min":0.748,"15min":0.58499999999999996},"max":{"1min":1.6060000000000001,"5min":1.708,"15min":1.708},"last":1.016}]},{"osd":5,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.2470000000000001,"15min":1.2410000000000001},"min":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.77300000000000002},"max":{"1min":1.452,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.083},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.3,"15min":1.3080000000000001},"min":{"1min":1.0149999999999999,"5min":0.872,"15min":0.86899999999999999},"max":{"1min":1.4930000000000001,"5min":1.6060000000000001,"15min":1.7170000000000001},"last":1.292}]},{"osd":6,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.298,"15min":1.302},"min":{"1min":1.0580000000000001,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.5449999999999999,"5min":1.726,"15min":2.1240000000000001},"last":1.373},{"interface":"front","average":{"1min":1.264,"5min":1.2749999999999999,"15min":1.3009999999999999},"min":{"1min":1.1000000000000001,"5min":0.94199999999999995,"15min":0.82599999999999996},"max":{"1min":1.518,"5min":1.917,"15min":1.917},"last":1.2589999999999999}]},{"osd":7,"last update":"Wed Oct 18 12:41:13 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.3560000000000001,"15min":1.3580000000000001},"min":{"1min":1.0660000000000001,"5min":0.80700000000000005,"15min":0.79900000000000004},"max":{"1min":1.5649999999999999,"5min":1.77,"15min":1.77},"last":1.353},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.3520000000000001,"15min":1.363},"min":{"1min":1.147,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.6399999999999999,"5min":1.8240000000000001,"15min":2.3199999999999998},"last":1.3069999999999999}]}]},{"osd":0,"up_from":56,"seq":240518168729,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28980,"kb_used_data":1316,"kb_used_omap":12,"kb_used_meta":27635,"kb_avail":94342860,"statfs":{"total":96636764160,"available":96607088640,"internally_reserved":0,"allocated":1347584,"data_stored":961135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13003,"internal_metadata":28298549},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 18 12:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.90100000000000002,"15min":0.95499999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.454,"5min":1.454,"15min":1.5109999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0649999999999999,"15min":1.073},"min":{"1min":0.68799999999999994,"5min":0.62,"15min":0.52000000000000002},"max":{"1min":1.46,"5min":1.577,"15min":1.577},"last":0.876}]},{"osd":2,"last update":"Wed Oct 18 12:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.93600000000000005,"15min":0.99299999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.60799999999999998},"max":{"1min":1.321,"5min":1.496,"15min":1.6659999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":1.105,"5min":1.04,"15min":1.03},"min":{"1min":0.80300000000000005,"5min":0.59099999999999997,"15min":0.48899999999999999},"max":{"1min":1.468,"5min":1.673,"15min":1.673},"last":0.95999999999999996}]},{"osd":3,"last update":"Wed Oct 18 12:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.92800000000000005,"15min":0.94799999999999995},"min":{"1min":0.65800000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.2589999999999999,"5min":1.466,"15min":1.6060000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1080000000000001,"15min":1.169},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.48,"5min":1.589,"15min":1.589},"last":1.1220000000000001}]},{"osd":4,"last update":"Wed Oct 18 12:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.222,"15min":1.242},"min":{"1min":0.98999999999999999,"5min":0.87,"15min":0.87},"max":{"1min":1.5429999999999999,"5min":1.615,"15min":1.722},"last":1.075},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3169999999999999,"15min":1.3839999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.756,"5min":1.756,"15min":2.1299999999999999},"last":1.5169999999999999}]},{"osd":5,"last update":"Wed Oct 18 12:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.345,"15min":1.3720000000000001},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.84399999999999997},"max":{"1min":1.625,"5min":1.625,"15min":2.0960000000000001},"last":1.206},{"interface":"front","average":{"1min":1.347,"5min":1.2809999999999999,"15min":1.331},"min":{"1min":1.103,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":2.0819999999999999,"5min":2.0819999999999999,"15min":2.0819999999999999},"last":1.466}]},{"osd":6,"last update":"Wed Oct 18 12:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.351,"15min":1.431},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":2.2200000000000002},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.367,"15min":1.415},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.89700000000000002},"max":{"1min":1.9279999999999999,"5min":1.9690000000000001,"15min":2.0329999999999999},"last":1.0309999999999999}]},{"osd":7,"last update":"Wed Oct 18 12:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.399,"15min":1.4650000000000001},"min":{"1min":1.087,"5min":1.0169999999999999,"15min":1.0169999999999999},"max":{"1min":2.141,"5min":2.141,"15min":2.169},"last":1.099},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3260000000000001,"15min":1.403},"min":{"1min":1.091,"5min":0.96599999999999997,"15min":0.92100000000000004},"max":{"1min":1.857,"5min":1.857,"15min":2.081},"last":1.167}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-18T12:42:15.157 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-18T12:19:32.494936+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=12, tm_min=19, tm_sec=32, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=12, tm_min=42, tm_sec=7, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T12:42:15.158 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-18T12:19:32.494936+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=12, tm_min=19, tm_sec=32, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=12, tm_min=42, tm_sec=7, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T12:42:15.158 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-18T12:19:32.494936+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=12, tm_min=19, tm_sec=32, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=12, tm_min=42, tm_sec=7, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T12:42:15.159 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-18T12:19:32.494936+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=12, tm_min=19, tm_sec=32, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=12, tm_min=42, tm_sec=7, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T12:42:15.159 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-18T12:19:32.494936+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=12, tm_min=19, tm_sec=32, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=12, tm_min=42, tm_sec=7, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T12:42:15.159 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-10-18T12:19:32.494936+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=12, tm_min=19, tm_sec=32, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=12, tm_min=42, tm_sec=7, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T12:42:15.160 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-18T12:19:32.494936+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=12, tm_min=19, tm_sec=32, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=12, tm_min=42, tm_sec=7, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T12:42:15.160 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-18T12:19:32.494936+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=12, tm_min=19, tm_sec=32, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=12, tm_min=42, tm_sec=7, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T12:42:15.160 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-18T12:19:27.318899+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=12, tm_min=19, tm_sec=27, tm_wday=2, tm_yday=291, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=18, tm_hour=12, tm_min=42, tm_sec=7, tm_wday=2, tm_yday=291, tm_isdst=0) 2023-10-18T12:42:15.161 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-18T12:42:35.162 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-18T12:42:35.345 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.340+0000 7f7132816700 1 Processor -- start 2023-10-18T12:42:35.346 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.340+0000 7f7132816700 1 -- start start 2023-10-18T12:42:35.348 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.344+0000 7f7132816700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f712c0cdd90 0x7f712c0cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:35.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.344+0000 7f7132816700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7f712c06d060 0x7f712c06d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:35.349 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.344+0000 7f7132816700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f712c15e000 con 0x7f712c0b3c00 2023-10-18T12:42:35.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.344+0000 7f7132816700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f712c0ce170 con 0x7f712c0cdd90 2023-10-18T12:42:35.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.344+0000 7f7132816700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f712c15d3f0 con 0x7f712c06d060 2023-10-18T12:42:35.350 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.344+0000 7f7131814700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f712c0cdd90 0x7f712c0cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:35.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.344+0000 7f7131814700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7f712c0cdd90 0x7f712c0cc190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33816/0 (socket says 172.21.15.114:33816) 2023-10-18T12:42:35.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.344+0000 7f7131814700 1 -- 172.21.15.114:0/4148839473 learned_addr learned my addr 172.21.15.114:0/4148839473 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:42:35.351 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.344+0000 7f7131013700 1 --2- 172.21.15.114:0/4148839473 >> v2:172.21.15.172:3300/0 conn(0x7f712c06d060 0x7f712c06d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:35.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.344+0000 7f7131814700 1 -- 172.21.15.114:0/4148839473 >> v2:172.21.15.172:3300/0 conn(0x7f712c06d060 msgr2=0x7f712c06d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:42:35.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.344+0000 7f7131814700 1 --2- 172.21.15.114:0/4148839473 >> v2:172.21.15.172:3300/0 conn(0x7f712c06d060 0x7f712c06d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:35.353 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.344+0000 7f7131814700 1 -- 172.21.15.114:0/4148839473 >> v1:172.21.15.114:6789/0 conn(0x7f712c0b3c00 legacy=0x7f712c0ca0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:35.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.344+0000 7f7131814700 1 -- 172.21.15.114:0/4148839473 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f712c15d6d0 con 0x7f712c0cdd90 2023-10-18T12:42:35.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.344+0000 7f7131814700 1 --2- 172.21.15.114:0/4148839473 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f712c0cdd90 0x7f712c0cc190 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f712c0c8b70 tx=0x7f7128009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa4d8f4d0ac3a624 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:35.354 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.344+0000 7f7130812700 1 -- 172.21.15.114:0/4148839473 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7128011830 con 0x7f712c0cdd90 2023-10-18T12:42:35.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.344+0000 7f7130812700 1 -- 172.21.15.114:0/4148839473 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7128011990 con 0x7f712c0cdd90 2023-10-18T12:42:35.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.344+0000 7f7130812700 1 -- 172.21.15.114:0/4148839473 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7128011d20 con 0x7f712c0cdd90 2023-10-18T12:42:35.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.348+0000 7f7132816700 1 -- 172.21.15.114:0/4148839473 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f712c0cdd90 msgr2=0x7f712c0cc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:35.355 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.348+0000 7f7132816700 1 --2- 172.21.15.114:0/4148839473 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f712c0cdd90 0x7f712c0cc190 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f712c0c8b70 tx=0x7f7128009bf0 comp rx=0 tx=0).stop 2023-10-18T12:42:35.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.348+0000 7f7132816700 1 -- 172.21.15.114:0/4148839473 shutdown_connections 2023-10-18T12:42:35.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.348+0000 7f7132816700 1 --2- 172.21.15.114:0/4148839473 >> v2:172.21.15.172:3300/0 conn(0x7f712c06d060 0x7f712c06d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:35.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.348+0000 7f7132816700 1 --2- 172.21.15.114:0/4148839473 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f712c0cdd90 0x7f712c0cc190 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:35.356 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.348+0000 7f7132816700 1 -- 172.21.15.114:0/4148839473 >> 172.21.15.114:0/4148839473 conn(0x7f712c0ce5c0 msgr2=0x7f712c0ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:35.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.348+0000 7f7132816700 1 -- 172.21.15.114:0/4148839473 shutdown_connections 2023-10-18T12:42:35.357 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.348+0000 7f7132816700 1 -- 172.21.15.114:0/4148839473 wait complete. 2023-10-18T12:42:35.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.352+0000 7f7132816700 1 Processor -- start 2023-10-18T12:42:35.358 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.352+0000 7f7132816700 1 -- start start 2023-10-18T12:42:35.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.352+0000 7f7132816700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f712c06d060 0x7f712c14c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:35.360 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.352+0000 7f7132816700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f712c0b3c00 0x7f712c0c5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:35.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.352+0000 7f7132816700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f712c0cdd90 0x7f712c0c7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:35.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.352+0000 7f7132816700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712c0b12e0 con 0x7f712c06d060 2023-10-18T12:42:35.361 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.352+0000 7f7132816700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712c0c6070 con 0x7f712c0b3c00 2023-10-18T12:42:35.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.352+0000 7f7132816700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f712c0c6350 con 0x7f712c0cdd90 2023-10-18T12:42:35.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.352+0000 7f7131814700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f712c06d060 0x7f712c14c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:35.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.352+0000 7f7131814700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f712c06d060 0x7f712c14c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33820/0 (socket says 172.21.15.114:33820) 2023-10-18T12:42:35.362 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.352+0000 7f7131814700 1 -- 172.21.15.114:0/3670512485 learned_addr learned my addr 172.21.15.114:0/3670512485 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:42:35.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.352+0000 7f7131013700 1 --2- 172.21.15.114:0/3670512485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f712c0b3c00 0x7f712c0c5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:35.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.352+0000 7f7131814700 1 -- 172.21.15.114:0/3670512485 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f712c0cdd90 msgr2=0x7f712c0c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:35.363 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.352+0000 7f7131814700 1 --2- 172.21.15.114:0/3670512485 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f712c0cdd90 0x7f712c0c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:35.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.352+0000 7f7131814700 1 -- 172.21.15.114:0/3670512485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f712c0b3c00 msgr2=0x7f712c0c5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:35.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.352+0000 7f7131814700 1 --2- 172.21.15.114:0/3670512485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f712c0b3c00 0x7f712c0c5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:35.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.352+0000 7f7131814700 1 -- 172.21.15.114:0/3670512485 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7128009570 con 0x7f712c06d060 2023-10-18T12:42:35.364 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.352+0000 7f7131013700 1 --2- 172.21.15.114:0/3670512485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f712c0b3c00 0x7f712c0c5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:42:35.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.352+0000 7f7131814700 1 --2- 172.21.15.114:0/3670512485 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f712c06d060 0x7f712c14c4c0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f7128009c30 tx=0x7f7128004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:35.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.352+0000 7f71227fc700 1 -- 172.21.15.114:0/3670512485 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71280043c0 con 0x7f712c06d060 2023-10-18T12:42:35.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.352+0000 7f71227fc700 1 -- 172.21.15.114:0/3670512485 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f712801f070 con 0x7f712c06d060 2023-10-18T12:42:35.365 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.352+0000 7f71227fc700 1 -- 172.21.15.114:0/3670512485 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71280036c0 con 0x7f712c06d060 2023-10-18T12:42:35.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.352+0000 7f7132816700 1 -- 172.21.15.114:0/3670512485 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f712c0b1580 con 0x7f712c06d060 2023-10-18T12:42:35.366 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.352+0000 7f7132816700 1 -- 172.21.15.114:0/3670512485 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f712c14ca00 con 0x7f712c06d060 2023-10-18T12:42:35.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.356+0000 7f7132816700 1 -- 172.21.15.114:0/3670512485 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f712c0c90b0 con 0x7f712c06d060 2023-10-18T12:42:35.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.356+0000 7f71227fc700 1 -- 172.21.15.114:0/3670512485 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7f7128021030 con 0x7f712c06d060 2023-10-18T12:42:35.367 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.360+0000 7f71227fc700 1 --2- 172.21.15.114:0/3670512485 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7110065740 0x7f7110067c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:35.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.360+0000 7f71227fc700 1 -- 172.21.15.114:0/3670512485 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5659+0+0 (secure 0 0 0) 0x7f71280841d0 con 0x7f712c06d060 2023-10-18T12:42:35.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.360+0000 7f7131013700 1 --2- 172.21.15.114:0/3670512485 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7110065740 0x7f7110067c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:35.368 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.360+0000 7f7131013700 1 --2- 172.21.15.114:0/3670512485 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7110065740 0x7f7110067c00 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f712c159480 tx=0x7f711c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:35.371 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.364+0000 7f71227fc700 1 -- 172.21.15.114:0/3670512485 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7f7128051e90 con 0x7f712c06d060 2023-10-18T12:42:35.541 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.536+0000 7f7132816700 1 -- 172.21.15.114:0/3670512485 --> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f712c15dc90 con 0x7f7110065740 2023-10-18T12:42:35.548 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.540+0000 7f71227fc700 1 -- 172.21.15.114:0/3670512485 <== mgr.4108 v2:172.21.15.172:6832/461408666 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+69945 (secure 0 0 0) 0x7f711c0106b0 con 0x7f7110065740 2023-10-18T12:42:35.549 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:42:35.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.544+0000 7f7132816700 1 -- 172.21.15.114:0/3670512485 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7110065740 msgr2=0x7f7110067c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:35.552 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.544+0000 7f7132816700 1 --2- 172.21.15.114:0/3670512485 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7110065740 0x7f7110067c00 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f712c159480 tx=0x7f711c008040 comp rx=0 tx=0).stop 2023-10-18T12:42:35.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.544+0000 7f7132816700 1 -- 172.21.15.114:0/3670512485 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f712c06d060 msgr2=0x7f712c14c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:35.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.544+0000 7f7132816700 1 --2- 172.21.15.114:0/3670512485 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f712c06d060 0x7f712c14c4c0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f7128009c30 tx=0x7f7128004770 comp rx=0 tx=0).stop 2023-10-18T12:42:35.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.544+0000 7f7132816700 1 -- 172.21.15.114:0/3670512485 shutdown_connections 2023-10-18T12:42:35.553 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.544+0000 7f7132816700 1 --2- 172.21.15.114:0/3670512485 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7f7110065740 0x7f7110067c00 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:35.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.544+0000 7f7132816700 1 --2- 172.21.15.114:0/3670512485 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7f712c0cdd90 0x7f712c0c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:35.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.544+0000 7f7132816700 1 --2- 172.21.15.114:0/3670512485 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f712c0b3c00 0x7f712c0c5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:35.554 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.544+0000 7f7132816700 1 --2- 172.21.15.114:0/3670512485 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f712c06d060 0x7f712c14c4c0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:35.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.544+0000 7f7132816700 1 -- 172.21.15.114:0/3670512485 >> 172.21.15.114:0/3670512485 conn(0x7f712c0ce5c0 msgr2=0x7f712c0ca3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:35.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.548+0000 7f7132816700 1 -- 172.21.15.114:0/3670512485 shutdown_connections 2023-10-18T12:42:35.555 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.548+0000 7f7132816700 1 -- 172.21.15.114:0/3670512485 wait complete. 2023-10-18T12:42:35.556 INFO:teuthology.orchestra.run.smithi114.stderr:dumped all 2023-10-18T12:42:35.574 INFO:teuthology.orchestra.run.smithi114.stdout:{"pg_ready":true,"pg_map":{"version":751,"stamp":"2023-10-18T12:42:35.513454+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":223828,"kb_used_data":7044,"kb_used_omap":24,"kb_used_meta":216679,"kb_avail":754750892,"statfs":{"total":773094113280,"available":772864913408,"internally_reserved":0,"allocated":7213056,"data_stored":4145541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25470,"internal_metadata":221879426},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003549"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":108,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-18T12:42:17.252383+0000","last_change":"2023-10-18T12:42:17.252550+0000","last_active":"2023-10-18T12:42:17.252383+0000","last_peered":"2023-10-18T12:42:17.252383+0000","last_clean":"2023-10-18T12:42:17.252383+0000","last_became_active":"2023-10-18T12:19:33.530907+0000","last_became_peered":"2023-10-18T12:19:33.530907+0000","last_unstale":"2023-10-18T12:42:17.252383+0000","last_undegraded":"2023-10-18T12:42:17.252383+0000","last_fullsized":"2023-10-18T12:42:17.252383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:42:17.252134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:42:17.252134+0000","last_clean_scrub_stamp":"2023-10-18T12:42:17.252134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T21:00:45.553573+0000","scrub_duration":0.0045403240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":108,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-18T12:42:15.326123+0000","last_change":"2023-10-18T12:42:15.326227+0000","last_active":"2023-10-18T12:42:15.326123+0000","last_peered":"2023-10-18T12:42:15.326123+0000","last_clean":"2023-10-18T12:42:15.326123+0000","last_became_active":"2023-10-18T12:19:33.528930+0000","last_became_peered":"2023-10-18T12:19:33.528930+0000","last_unstale":"2023-10-18T12:42:15.326123+0000","last_undegraded":"2023-10-18T12:42:15.326123+0000","last_fullsized":"2023-10-18T12:42:15.326123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:42:15.325922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:42:15.325922+0000","last_clean_scrub_stamp":"2023-10-18T12:42:15.325922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:14:39.007072+0000","scrub_duration":0.004895651,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":126,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-18T12:42:23.135551+0000","last_change":"2023-10-18T12:42:23.135643+0000","last_active":"2023-10-18T12:42:23.135551+0000","last_peered":"2023-10-18T12:42:23.135551+0000","last_clean":"2023-10-18T12:42:23.135551+0000","last_became_active":"2023-10-18T12:29:30.706091+0000","last_became_peered":"2023-10-18T12:29:30.706091+0000","last_unstale":"2023-10-18T12:42:23.135551+0000","last_undegraded":"2023-10-18T12:42:23.135551+0000","last_fullsized":"2023-10-18T12:42:23.135551+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:42:23.135359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:42:23.135359+0000","last_clean_scrub_stamp":"2023-10-18T12:42:23.135359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:20:04.848661+0000","scrub_duration":0.0053817939999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":123,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-18T12:42:16.299824+0000","last_change":"2023-10-18T12:42:16.299824+0000","last_active":"2023-10-18T12:42:16.299824+0000","last_peered":"2023-10-18T12:42:16.299824+0000","last_clean":"2023-10-18T12:42:16.299824+0000","last_became_active":"2023-10-18T12:29:30.707304+0000","last_became_peered":"2023-10-18T12:29:30.707304+0000","last_unstale":"2023-10-18T12:42:16.299824+0000","last_undegraded":"2023-10-18T12:42:16.299824+0000","last_fullsized":"2023-10-18T12:42:16.299824+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:42:16.299462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:42:16.299462+0000","last_clean_scrub_stamp":"2023-10-18T12:42:16.299462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:28:02.919891+0000","scrub_duration":0.0047549879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":107,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-18T12:42:13.372848+0000","last_change":"2023-10-18T12:42:13.372848+0000","last_active":"2023-10-18T12:42:13.372848+0000","last_peered":"2023-10-18T12:42:13.372848+0000","last_clean":"2023-10-18T12:42:13.372848+0000","last_became_active":"2023-10-18T12:19:33.533051+0000","last_became_peered":"2023-10-18T12:19:33.533051+0000","last_unstale":"2023-10-18T12:42:13.372848+0000","last_undegraded":"2023-10-18T12:42:13.372848+0000","last_fullsized":"2023-10-18T12:42:13.372848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:42:13.372653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:42:13.372653+0000","last_clean_scrub_stamp":"2023-10-18T12:42:13.372653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:02:49.065910+0000","scrub_duration":0.0043563719999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":111,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-18T12:42:13.372639+0000","last_change":"2023-10-18T12:42:13.372639+0000","last_active":"2023-10-18T12:42:13.372639+0000","last_peered":"2023-10-18T12:42:13.372639+0000","last_clean":"2023-10-18T12:42:13.372639+0000","last_became_active":"2023-10-18T12:19:33.530346+0000","last_became_peered":"2023-10-18T12:19:33.530346+0000","last_unstale":"2023-10-18T12:42:13.372639+0000","last_undegraded":"2023-10-18T12:42:13.372639+0000","last_fullsized":"2023-10-18T12:42:13.372639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:42:13.372365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:42:13.372365+0000","last_clean_scrub_stamp":"2023-10-18T12:42:13.372365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T20:16:41.745092+0000","scrub_duration":0.0040119830000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":113,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-18T12:42:20.173663+0000","last_change":"2023-10-18T12:42:20.173776+0000","last_active":"2023-10-18T12:42:20.173663+0000","last_peered":"2023-10-18T12:42:20.173663+0000","last_clean":"2023-10-18T12:42:20.173663+0000","last_became_active":"2023-10-18T12:19:33.528214+0000","last_became_peered":"2023-10-18T12:19:33.528214+0000","last_unstale":"2023-10-18T12:42:20.173663+0000","last_undegraded":"2023-10-18T12:42:20.173663+0000","last_fullsized":"2023-10-18T12:42:20.173663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:42:20.173468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:42:20.173468+0000","last_clean_scrub_stamp":"2023-10-18T12:42:20.173468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T16:52:27.091413+0000","scrub_duration":0.0052171850000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":107,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-18T12:42:15.389395+0000","last_change":"2023-10-18T12:42:15.389395+0000","last_active":"2023-10-18T12:42:15.389395+0000","last_peered":"2023-10-18T12:42:15.389395+0000","last_clean":"2023-10-18T12:42:15.389395+0000","last_became_active":"2023-10-18T12:19:33.530795+0000","last_became_peered":"2023-10-18T12:19:33.530795+0000","last_unstale":"2023-10-18T12:42:15.389395+0000","last_undegraded":"2023-10-18T12:42:15.389395+0000","last_fullsized":"2023-10-18T12:42:15.389395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-18T12:42:15.389085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-18T12:42:15.389085+0000","last_clean_scrub_stamp":"2023-10-18T12:42:15.389085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T14:40:10.268196+0000","scrub_duration":0.0042411740000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"63'119","reported_seq":285,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-10-18T12:42:22.174818+0000","last_change":"2023-10-18T12:42:22.174909+0000","last_active":"2023-10-18T12:42:22.174818+0000","last_peered":"2023-10-18T12:42:22.174818+0000","last_clean":"2023-10-18T12:42:22.174818+0000","last_became_active":"2023-10-18T12:29:30.706096+0000","last_became_peered":"2023-10-18T12:29:30.706096+0000","last_unstale":"2023-10-18T12:42:22.174818+0000","last_undegraded":"2023-10-18T12:42:22.174818+0000","last_fullsized":"2023-10-18T12:42:22.174818+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'119","last_scrub_stamp":"2023-10-18T12:42:22.174697+0000","last_deep_scrub":"63'119","last_deep_scrub_stamp":"2023-10-18T12:42:22.174697+0000","last_clean_scrub_stamp":"2023-10-18T12:42:22.174697+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-19T13:51:01.279112+0000","scrub_duration":0.012548907999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575129,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28328,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343512,"statfs":{"total":96636764160,"available":96607756288,"internally_reserved":0,"allocated":1343488,"data_stored":959804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.153,"15min":1.153},"min":{"1min":0.86399999999999999,"5min":0.56200000000000006,"15min":0.55000000000000004},"max":{"1min":1.3240000000000001,"5min":1.679,"15min":1.9179999999999999},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1859999999999999,"15min":1.159},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.61799999999999999},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":1.1519999999999999}]},{"osd":1,"last update":"Wed Oct 18 12:42:07 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.151,"15min":1.151},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.48399999999999999},"max":{"1min":1.403,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.123,"5min":1.1739999999999999,"15min":1.1659999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.56000000000000005},"max":{"1min":1.4850000000000001,"5min":1.599,"15min":2.343},"last":1.202}]},{"osd":2,"last update":"Wed Oct 18 12:42:07 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.3360000000000001,"15min":1.3360000000000001},"min":{"1min":0.98199999999999998,"5min":0.81399999999999995,"15min":0.67000000000000004},"max":{"1min":2.3140000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.319,"15min":1.29},"min":{"1min":0.89300000000000002,"5min":0.747,"15min":0.747},"max":{"1min":2.2810000000000001,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":1.0409999999999999}]},{"osd":3,"last update":"Wed Oct 18 12:42:07 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.2729999999999999,"15min":1.2589999999999999},"min":{"1min":0.98299999999999998,"5min":0.90600000000000003,"15min":0.55300000000000005},"max":{"1min":1.6899999999999999,"5min":1.8540000000000001,"15min":1.95},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.417,"5min":1.419,"15min":1.403},"min":{"1min":1.038,"5min":0.90400000000000003,"15min":0.81599999999999995},"max":{"1min":1.595,"5min":1.8580000000000001,"15min":2.5710000000000002},"last":1.452}]},{"osd":4,"last update":"Wed Oct 18 12:42:07 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2050000000000001,"15min":1.177},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.57599999999999996},"max":{"1min":1.659,"5min":1.679,"15min":2.0779999999999998},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.2430000000000001,"15min":1.228},"min":{"1min":0.94399999999999995,"5min":0.83899999999999997,"15min":0.58599999999999997},"max":{"1min":1.589,"5min":1.9570000000000001,"15min":2.0219999999999998},"last":1.5089999999999999}]},{"osd":5,"last update":"Wed Oct 18 12:42:07 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.3580000000000001,"15min":1.3109999999999999},"min":{"1min":0.85199999999999998,"5min":0.83999999999999997,"15min":0.499},"max":{"1min":1.704,"5min":2.0070000000000001,"15min":2.5150000000000001},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.333,"5min":1.371,"15min":1.3560000000000001},"min":{"1min":1.137,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.615,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":1.415}]},{"osd":6,"last update":"Wed Oct 18 12:42:07 2023","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.454,"15min":1.4399999999999999},"min":{"1min":0.83199999999999996,"5min":0.72199999999999998,"15min":0.67400000000000004},"max":{"1min":1.7210000000000001,"5min":2.1909999999999998,"15min":2.274},"last":1.482},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.367,"15min":1.347},"min":{"1min":1.155,"5min":0.79800000000000004,"15min":0.61699999999999999},"max":{"1min":1.784,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":1.6259999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575129,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":753664,"data_stored":370767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:41:48 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.1419999999999999,"15min":1.127},"min":{"1min":0.81999999999999995,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.3779999999999999,"5min":1.7250000000000001,"15min":1.7509999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.141,"5min":1.159,"15min":1.149},"min":{"1min":0.81599999999999995,"5min":0.752,"15min":0.752},"max":{"1min":1.462,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":1.21}]},{"osd":1,"last update":"Wed Oct 18 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.1220000000000001,"15min":1.1699999999999999},"min":{"1min":0.73399999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.4870000000000001,"5min":1.5369999999999999,"15min":1.7969999999999999},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.196,"15min":1.198},"min":{"1min":0.68999999999999995,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.4079999999999999,"5min":1.7050000000000001,"15min":1.8480000000000001},"last":0.997}]},{"osd":2,"last update":"Wed Oct 18 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.2330000000000001,"15min":1.2350000000000001},"min":{"1min":0.88100000000000001,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.45,"5min":1.6699999999999999,"15min":1.958},"last":1.042},{"interface":"front","average":{"1min":1.145,"5min":1.1779999999999999,"15min":1.216},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.645},"last":1.4450000000000001}]},{"osd":3,"last update":"Wed Oct 18 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.302,"15min":1.2989999999999999},"min":{"1min":0.93799999999999994,"5min":0.84699999999999998,"15min":0.76100000000000001},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.351,"5min":1.355,"15min":1.391},"min":{"1min":1.083,"5min":0.86799999999999999,"15min":0.83399999999999996},"max":{"1min":1.798,"5min":1.8300000000000001,"15min":1.952},"last":1.1379999999999999}]},{"osd":4,"last update":"Wed Oct 18 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.1910000000000001,"15min":1.1910000000000001},"min":{"1min":0.72699999999999998,"5min":0.627,"15min":0.627},"max":{"1min":1.744,"5min":1.744,"15min":1.8480000000000001},"last":1.284},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.2569999999999999,"15min":1.26},"min":{"1min":0.82499999999999996,"5min":0.66700000000000004,"15min":0.60799999999999998},"max":{"1min":1.6739999999999999,"5min":1.752,"15min":1.917},"last":1.244}]},{"osd":5,"last update":"Wed Oct 18 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.2569999999999999,"15min":1.3069999999999999},"min":{"1min":0.76500000000000001,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":2.214,"5min":2.214,"15min":2.214},"last":1.26},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.333,"15min":1.3500000000000001},"min":{"1min":0.90900000000000003,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9970000000000001},"last":1.3839999999999999}]},{"osd":7,"last update":"Wed Oct 18 12:42:22 2023","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.375,"15min":1.383},"min":{"1min":1.036,"5min":0.95399999999999996,"15min":0.81399999999999995},"max":{"1min":1.712,"5min":1.881,"15min":2.0059999999999998},"last":1.171},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.4430000000000001,"15min":1.4590000000000001},"min":{"1min":0.93500000000000005,"5min":0.79600000000000004,"15min":0.79500000000000004},"max":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":2.105},"last":1.349}]}]},{"osd":5,"up_from":13,"seq":55834575130,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":753664,"data_stored":370767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.262,"15min":1.2709999999999999},"min":{"1min":1.1399999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.7150000000000001},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.278,"5min":1.2649999999999999,"15min":1.2909999999999999},"min":{"1min":0.89500000000000002,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":0.93500000000000005}]},{"osd":1,"last update":"Wed Oct 18 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.1319999999999999,"15min":1.165},"min":{"1min":0.78100000000000003,"5min":0.753,"15min":0.70499999999999996},"max":{"1min":1.643,"5min":1.643,"15min":1.7310000000000001},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.113,"5min":1.1579999999999999,"15min":1.1739999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.55200000000000005},"max":{"1min":1.4399999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.1279999999999999}]},{"osd":2,"last update":"Wed Oct 18 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.1739999999999999,"15min":1.151},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.58799999999999997},"max":{"1min":1.5569999999999999,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":1.4870000000000001},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.175,"15min":1.2170000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.69199999999999995},"max":{"1min":1.3620000000000001,"5min":1.7230000000000001,"15min":1.73},"last":1.262}]},{"osd":3,"last update":"Wed Oct 18 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.268,"15min":1.296},"min":{"1min":0.85599999999999998,"5min":0.83999999999999997,"15min":0.80000000000000004},"max":{"1min":1.5589999999999999,"5min":1.635,"15min":1.8169999999999999},"last":1.393},{"interface":"front","average":{"1min":1.26,"5min":1.347,"15min":1.3400000000000001},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.6679999999999999,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.425}]},{"osd":4,"last update":"Wed Oct 18 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.137,"15min":1.1679999999999999},"min":{"1min":0.78500000000000003,"5min":0.76000000000000001,"15min":0.52500000000000002},"max":{"1min":1.5640000000000001,"5min":1.7450000000000001,"15min":1.77},"last":1.371},{"interface":"front","average":{"1min":1.331,"5min":1.2470000000000001,"15min":1.2529999999999999},"min":{"1min":0.69899999999999995,"5min":0.65300000000000002,"15min":0.61899999999999999},"max":{"1min":1.581,"5min":1.6819999999999999,"15min":1.8700000000000001},"last":0.99199999999999999}]},{"osd":6,"last update":"Wed Oct 18 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.224,"15min":1.232},"min":{"1min":0.746,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":2.411},"last":1.226},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.302,"15min":1.3260000000000001},"min":{"1min":0.90300000000000002,"5min":0.80600000000000005,"15min":0.70499999999999996},"max":{"1min":1.708,"5min":1.708,"15min":2.1629999999999998},"last":1.46}]},{"osd":7,"last update":"Wed Oct 18 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.385,"15min":1.365},"min":{"1min":1.0900000000000001,"5min":0.85899999999999999,"15min":0.754},"max":{"1min":1.7210000000000001,"5min":1.873,"15min":1.873},"last":1.514},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3819999999999999,"15min":1.3859999999999999},"min":{"1min":0.98299999999999998,"5min":0.83599999999999997,"15min":0.52000000000000002},"max":{"1min":1.6910000000000001,"5min":1.7989999999999999,"15min":2.496},"last":1.341}]}]},{"osd":4,"up_from":13,"seq":55834575127,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27760,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":753664,"data_stored":370767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:41:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1439999999999999,"15min":1.169},"min":{"1min":0.77700000000000002,"5min":0.59499999999999997,"15min":0.46500000000000002},"max":{"1min":1.74,"5min":1.74,"15min":1.9419999999999999},"last":1.214},{"interface":"front","average":{"1min":1.123,"5min":1.1679999999999999,"15min":1.1779999999999999},"min":{"1min":0.84199999999999997,"5min":0.78100000000000003,"15min":0.58799999999999997},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.7609999999999999},"last":1.1120000000000001}]},{"osd":1,"last update":"Wed Oct 18 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.1870000000000001,"15min":1.177},"min":{"1min":0.78400000000000003,"5min":0.625,"15min":0.53200000000000003},"max":{"1min":1.5740000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.226,"5min":1.208,"15min":1.2130000000000001},"min":{"1min":0.96499999999999997,"5min":0.80500000000000005,"15min":0.73899999999999999},"max":{"1min":1.4430000000000001,"5min":1.601,"15min":1.786},"last":1.0289999999999999}]},{"osd":2,"last update":"Wed Oct 18 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.1659999999999999,"15min":1.163},"min":{"1min":0.85799999999999998,"5min":0.70899999999999996,"15min":0.63300000000000001},"max":{"1min":1.486,"5min":1.6020000000000001,"15min":1.6619999999999999},"last":1.339},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.254,"15min":1.272},"min":{"1min":0.88200000000000001,"5min":0.70699999999999996,"15min":0.66000000000000003},"max":{"1min":1.7569999999999999,"5min":1.7889999999999999,"15min":1.8680000000000001},"last":1.3660000000000001}]},{"osd":3,"last update":"Wed Oct 18 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.321,"15min":1.3480000000000001},"min":{"1min":1.121,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.5740000000000001,"5min":1.847,"15min":1.8799999999999999},"last":1.266},{"interface":"front","average":{"1min":1.3,"5min":1.294,"15min":1.306},"min":{"1min":0.96499999999999997,"5min":0.76900000000000002,"15min":0.68899999999999995},"max":{"1min":1.5880000000000001,"5min":1.986,"15min":1.986},"last":1.389}]},{"osd":5,"last update":"Wed Oct 18 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.2410000000000001,"15min":1.2110000000000001},"min":{"1min":0.76700000000000002,"5min":0.65100000000000002,"15min":0.57499999999999996},"max":{"1min":1.669,"5min":1.8,"15min":2.1259999999999999},"last":1.468},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.2889999999999999,"15min":1.256},"min":{"1min":1.107,"5min":0.84599999999999997,"15min":0.499},"max":{"1min":1.548,"5min":1.855,"15min":1.855},"last":0.93899999999999995}]},{"osd":6,"last update":"Wed Oct 18 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.2410000000000001,"15min":1.2370000000000001},"min":{"1min":0.91400000000000003,"5min":0.76500000000000001,"15min":0.56100000000000005},"max":{"1min":1.6120000000000001,"5min":1.8700000000000001,"15min":1.9930000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.419,"5min":1.385,"15min":1.369},"min":{"1min":1.1519999999999999,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.8260000000000001,"5min":1.865,"15min":2.0579999999999998},"last":1.4159999999999999}]},{"osd":7,"last update":"Wed Oct 18 12:42:15 2023","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":1.4099999999999999,"15min":1.385},"min":{"1min":1.1839999999999999,"5min":0.83199999999999996,"15min":0.61599999999999999},"max":{"1min":1.744,"5min":1.9179999999999999,"15min":2.79},"last":1.181},{"interface":"front","average":{"1min":1.532,"5min":1.4099999999999999,"15min":1.383},"min":{"1min":1.3080000000000001,"5min":0.80900000000000005,"15min":0.67900000000000005},"max":{"1min":1.7470000000000001,"5min":2.1019999999999999,"15min":2.173},"last":1.141}]}]},{"osd":3,"up_from":13,"seq":55834575129,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":753664,"data_stored":370767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.76300000000000001,"15min":0.76200000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.157,"5min":1.157,"15min":1.417},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.1020000000000001,"15min":1.0760000000000001},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.0429999999999999}]},{"osd":1,"last update":"Wed Oct 18 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.85899999999999999,"15min":0.85799999999999998},"min":{"1min":0.625,"5min":0.59499999999999997,"15min":0.49399999999999999},"max":{"1min":1.806,"5min":1.806,"15min":1.806},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.93100000000000005,"15min":0.93400000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.53000000000000003},"max":{"1min":1.208,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.91200000000000003}]},{"osd":2,"last update":"Wed Oct 18 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.1479999999999999,"15min":1.1259999999999999},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.55100000000000005},"max":{"1min":1.3839999999999999,"5min":1.5680000000000001,"15min":1.6040000000000001},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.05,"5min":1.2,"15min":1.1919999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.427,"5min":1.651,"15min":1.7410000000000001},"last":1.0820000000000001}]},{"osd":4,"last update":"Wed Oct 18 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.1910000000000001,"15min":1.1910000000000001},"min":{"1min":0.755,"5min":0.755,"15min":0.70599999999999996},"max":{"1min":1.5309999999999999,"5min":1.609,"15min":1.6659999999999999},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.214,"5min":1.248,"15min":1.266},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.9590000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.131}]},{"osd":5,"last update":"Wed Oct 18 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.3240000000000001,"15min":1.319},"min":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.80600000000000005},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":1.45},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.274,"15min":1.28},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.73499999999999999},"max":{"1min":1.613,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.997}]},{"osd":6,"last update":"Wed Oct 18 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.323,"15min":1.2889999999999999},"min":{"1min":0.95499999999999996,"5min":0.90600000000000003,"15min":0.872},"max":{"1min":1.6240000000000001,"5min":1.7250000000000001,"15min":3.2280000000000002},"last":1.107},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3600000000000001,"15min":1.369},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":2.1659999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":1.3779999999999999}]},{"osd":7,"last update":"Wed Oct 18 12:42:16 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.341,"15min":1.3320000000000001},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.83699999999999997},"max":{"1min":1.6040000000000001,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":1.167},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.355,"15min":1.355},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":1.748,"5min":1.8220000000000001,"15min":3.3679999999999999},"last":1.2569999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575127,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":753664,"data_stored":370767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:41:58 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.81000000000000005,"15min":0.80500000000000005},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.52100000000000002},"max":{"1min":1.47,"5min":1.47,"15min":1.5800000000000001},"last":1.1990000000000001},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.91800000000000004,"15min":0.93000000000000005},"min":{"1min":0.67200000000000004,"5min":0.57299999999999995,"15min":0.55200000000000005},"max":{"1min":1.214,"5min":1.639,"15min":1.639},"last":0.76500000000000001}]},{"osd":1,"last update":"Wed Oct 18 12:42:14 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.034,"15min":1.006},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.40500000000000003},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.94999999999999996},"min":{"1min":0.72099999999999997,"5min":0.60699999999999998,"15min":0.54800000000000004},"max":{"1min":1.171,"5min":1.452,"15min":1.4890000000000001},"last":1.389}]},{"osd":3,"last update":"Wed Oct 18 12:42:14 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.286,"15min":1.2649999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.5229999999999999,"5min":1.7589999999999999,"15min":1.821},"last":1.071},{"interface":"front","average":{"1min":0.97799999999999998,"5min":1.038,"15min":1.0669999999999999},"min":{"1min":0.73699999999999999,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.2470000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":1.022}]},{"osd":4,"last update":"Wed Oct 18 12:42:14 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.202,"15min":1.2310000000000001},"min":{"1min":1.016,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.4079999999999999,"5min":1.631,"15min":1.7130000000000001},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.274,"5min":1.2190000000000001,"15min":1.2350000000000001},"min":{"1min":0.94699999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.877,"5min":1.877,"15min":1.877},"last":1.47}]},{"osd":5,"last update":"Wed Oct 18 12:42:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.343,"15min":1.3460000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.76100000000000001},"max":{"1min":1.986,"5min":1.986,"15min":1.986},"last":1.518},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.4079999999999999,"15min":1.4039999999999999},"min":{"1min":1,"5min":1,"15min":0.98099999999999998},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.863},"last":1.4450000000000001}]},{"osd":6,"last update":"Wed Oct 18 12:42:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.3560000000000001,"15min":1.3460000000000001},"min":{"1min":1,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.238,"5min":1.2789999999999999,"15min":1.292},"min":{"1min":0.97799999999999998,"5min":0.873,"15min":0.873},"max":{"1min":1.4730000000000001,"5min":1.6910000000000001,"15min":1.8029999999999999},"last":1.284}]},{"osd":7,"last update":"Wed Oct 18 12:42:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.323,"15min":1.3300000000000001},"min":{"1min":1.071,"5min":1.0049999999999999,"15min":0.95699999999999996},"max":{"1min":1.756,"5min":1.756,"15min":1.8029999999999999},"last":1.5669999999999999},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.413,"15min":1.4199999999999999},"min":{"1min":1.1000000000000001,"5min":1.099,"15min":0.97599999999999998},"max":{"1min":1.9470000000000001,"5min":1.9470000000000001,"15min":1.9590000000000001},"last":1.2549999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575128,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":753664,"data_stored":370767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Oct 18 12:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.83699999999999997,"15min":0.85899999999999999},"min":{"1min":0.56399999999999995,"5min":0.47499999999999998,"15min":0.45200000000000001},"max":{"1min":0.97199999999999998,"5min":1.6020000000000001,"15min":1.6559999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":1.012,"5min":1.004,"15min":1.034},"min":{"1min":0.621,"5min":0.621,"15min":0.54800000000000004},"max":{"1min":1.603,"5min":1.603,"15min":1.9830000000000001},"last":0.96099999999999997}]},{"osd":2,"last update":"Wed Oct 18 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.89000000000000001,"15min":0.90300000000000002},"min":{"1min":0.64000000000000001,"5min":0.55700000000000005,"15min":0.436},"max":{"1min":1.0329999999999999,"5min":1.52,"15min":1.7310000000000001},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.038,"5min":1.0740000000000001,"15min":1.103},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.505},"max":{"1min":1.462,"5min":1.4830000000000001,"15min":1.714},"last":1.056}]},{"osd":3,"last update":"Wed Oct 18 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.143,"15min":1.194},"min":{"1min":0.76600000000000001,"5min":0.69199999999999995,"15min":0.57299999999999995},"max":{"1min":1.4490000000000001,"5min":1.5920000000000001,"15min":1.603},"last":1.2070000000000001},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.95399999999999996,"15min":1.0009999999999999},"min":{"1min":0.69999999999999996,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4299999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":1.1060000000000001}]},{"osd":4,"last update":"Wed Oct 18 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.2470000000000001,"15min":1.25},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72199999999999998},"max":{"1min":1.5329999999999999,"5min":1.9450000000000001,"15min":2.0470000000000002},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1719999999999999,"15min":1.1890000000000001},"min":{"1min":0.75900000000000001,"5min":0.748,"15min":0.58499999999999996},"max":{"1min":1.4790000000000001,"5min":1.708,"15min":1.708},"last":1.181}]},{"osd":5,"last update":"Wed Oct 18 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.2330000000000001,"15min":1.238},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.369,"5min":1.8260000000000001,"15min":1.8260000000000001},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.306,"15min":1.3049999999999999},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.5669999999999999,"5min":1.6060000000000001,"15min":1.7170000000000001},"last":1.1519999999999999}]},{"osd":6,"last update":"Wed Oct 18 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.288,"15min":1.302},"min":{"1min":0.83299999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.611,"5min":1.726,"15min":2.1240000000000001},"last":1.321},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.278,"15min":1.296},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.82599999999999996},"max":{"1min":1.7370000000000001,"5min":1.917,"15min":1.917},"last":1.028}]},{"osd":7,"last update":"Wed Oct 18 12:42:18 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.3540000000000001,"15min":1.353},"min":{"1min":1.046,"5min":0.80700000000000005,"15min":0.79900000000000004},"max":{"1min":1.673,"5min":1.7190000000000001,"15min":1.77},"last":1.387},{"interface":"front","average":{"1min":1.365,"5min":1.3680000000000001,"15min":1.3620000000000001},"min":{"1min":1.038,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":1.6950000000000001,"5min":1.8240000000000001,"15min":2.3199999999999998},"last":1.2270000000000001}]}]},{"osd":0,"up_from":56,"seq":240518168734,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28972,"kb_used_data":1316,"kb_used_omap":12,"kb_used_meta":27635,"kb_avail":94342868,"statfs":{"total":96636764160,"available":96607096832,"internally_reserved":0,"allocated":1347584,"data_stored":961135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13003,"internal_metadata":28298549},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Oct 18 12:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.90100000000000002,"15min":0.95499999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.454,"5min":1.454,"15min":1.5109999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0649999999999999,"15min":1.073},"min":{"1min":0.68799999999999994,"5min":0.62,"15min":0.52000000000000002},"max":{"1min":1.46,"5min":1.577,"15min":1.577},"last":1.3340000000000001}]},{"osd":2,"last update":"Wed Oct 18 12:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.93600000000000005,"15min":0.99299999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.60799999999999998},"max":{"1min":1.321,"5min":1.496,"15min":1.6659999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.105,"5min":1.04,"15min":1.03},"min":{"1min":0.80300000000000005,"5min":0.59099999999999997,"15min":0.48899999999999999},"max":{"1min":1.468,"5min":1.673,"15min":1.673},"last":1.1899999999999999}]},{"osd":3,"last update":"Wed Oct 18 12:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.92800000000000005,"15min":0.94799999999999995},"min":{"1min":0.65800000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.2589999999999999,"5min":1.466,"15min":1.6060000000000001},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1080000000000001,"15min":1.169},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.48,"5min":1.589,"15min":1.589},"last":1.2470000000000001}]},{"osd":4,"last update":"Wed Oct 18 12:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.222,"15min":1.242},"min":{"1min":0.98999999999999999,"5min":0.87,"15min":0.87},"max":{"1min":1.5429999999999999,"5min":1.615,"15min":1.722},"last":1.298},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.3169999999999999,"15min":1.3839999999999999},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.756,"5min":1.756,"15min":2.1299999999999999},"last":1.5589999999999999}]},{"osd":5,"last update":"Wed Oct 18 12:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.345,"15min":1.3720000000000001},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.84399999999999997},"max":{"1min":1.625,"5min":1.625,"15min":2.0960000000000001},"last":1.6899999999999999},{"interface":"front","average":{"1min":1.347,"5min":1.2809999999999999,"15min":1.331},"min":{"1min":1.103,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":2.0819999999999999,"5min":2.0819999999999999,"15min":2.0819999999999999},"last":1.397}]},{"osd":6,"last update":"Wed Oct 18 12:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.351,"15min":1.431},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":2.2200000000000002},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.367,"15min":1.415},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.89700000000000002},"max":{"1min":1.9279999999999999,"5min":1.9690000000000001,"15min":2.0329999999999999},"last":1.4830000000000001}]},{"osd":7,"last update":"Wed Oct 18 12:41:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.399,"15min":1.4650000000000001},"min":{"1min":1.087,"5min":1.0169999999999999,"15min":1.0169999999999999},"max":{"1min":2.141,"5min":2.141,"15min":2.169},"last":1.6160000000000001},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3260000000000001,"15min":1.403},"min":{"1min":1.091,"5min":0.96599999999999997,"15min":0.92100000000000004},"max":{"1min":1.857,"5min":1.857,"15min":2.081},"last":1.524}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-18T12:42:35.577 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-18T12:42:35.745 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.740+0000 7faeb2b18700 1 Processor -- start 2023-10-18T12:42:35.746 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.740+0000 7faeb2b18700 1 -- start start 2023-10-18T12:42:35.747 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.740+0000 7faeb2b18700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7faeac15adf0 0x7faeac0cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:35.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.740+0000 7faeb2b18700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faeac070460 0x7faeac0708b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:35.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.740+0000 7faeb2b18700 1 -- --> v1:172.21.15.172:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeac15b1d0 con 0x7faeac0cce10 2023-10-18T12:42:35.748 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.740+0000 7faeb2b18700 1 -- --> v2:172.21.15.114:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeac0ca590 con 0x7faeac15adf0 2023-10-18T12:42:35.749 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.740+0000 7faeb2b18700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeac070df0 con 0x7faeac070460 2023-10-18T12:42:35.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.740+0000 7faeb08b4700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7faeac15adf0 0x7faeac0cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:35.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.744+0000 7faeb08b4700 1 --2- >> v2:172.21.15.114:3300/0 conn(0x7faeac15adf0 0x7faeac0cc8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33828/0 (socket says 172.21.15.114:33828) 2023-10-18T12:42:35.750 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.744+0000 7faeb08b4700 1 -- 172.21.15.114:0/1247882274 learned_addr learned my addr 172.21.15.114:0/1247882274 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:42:35.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.744+0000 7faeb10b5700 1 --2- 172.21.15.114:0/1247882274 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faeac070460 0x7faeac0708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:35.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.744+0000 7faeb08b4700 1 -- 172.21.15.114:0/1247882274 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faeac070460 msgr2=0x7faeac0708b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:42:35.751 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.744+0000 7faeb08b4700 1 --2- 172.21.15.114:0/1247882274 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faeac070460 0x7faeac0708b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:35.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.744+0000 7faeb08b4700 1 -- 172.21.15.114:0/1247882274 >> v1:172.21.15.172:6789/0 conn(0x7faeac0cce10 legacy=0x7faeac0b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:35.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.744+0000 7faeb08b4700 1 -- 172.21.15.114:0/1247882274 --> v2:172.21.15.114:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeac0ce600 con 0x7faeac15adf0 2023-10-18T12:42:35.752 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.744+0000 7faeb08b4700 1 --2- 172.21.15.114:0/1247882274 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faeac15adf0 0x7faeac0cc8d0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7faea0009910 tx=0x7faea0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=876e293004edce56 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:35.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.744+0000 7faeab7fe700 1 -- 172.21.15.114:0/1247882274 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea0011830 con 0x7faeac15adf0 2023-10-18T12:42:35.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.744+0000 7faeab7fe700 1 -- 172.21.15.114:0/1247882274 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea0011990 con 0x7faeac15adf0 2023-10-18T12:42:35.753 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.744+0000 7faeab7fe700 1 -- 172.21.15.114:0/1247882274 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea0011d40 con 0x7faeac15adf0 2023-10-18T12:42:35.754 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.744+0000 7faeb2b18700 1 -- 172.21.15.114:0/1247882274 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faeac15adf0 msgr2=0x7faeac0cc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:35.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.744+0000 7faeb2b18700 1 --2- 172.21.15.114:0/1247882274 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faeac15adf0 0x7faeac0cc8d0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7faea0009910 tx=0x7faea0009c20 comp rx=0 tx=0).stop 2023-10-18T12:42:35.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.744+0000 7faeb2b18700 1 -- 172.21.15.114:0/1247882274 shutdown_connections 2023-10-18T12:42:35.755 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.744+0000 7faeb2b18700 1 --2- 172.21.15.114:0/1247882274 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faeac070460 0x7faeac0708b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:35.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.744+0000 7faeb2b18700 1 --2- 172.21.15.114:0/1247882274 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faeac15adf0 0x7faeac0cc8d0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:35.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.744+0000 7faeb2b18700 1 -- 172.21.15.114:0/1247882274 >> 172.21.15.114:0/1247882274 conn(0x7faeac0ce820 msgr2=0x7faeac0cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:35.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.744+0000 7faeb2b18700 1 -- 172.21.15.114:0/1247882274 shutdown_connections 2023-10-18T12:42:35.756 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.744+0000 7faeb2b18700 1 -- 172.21.15.114:0/1247882274 wait complete. 2023-10-18T12:42:35.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.748+0000 7faeb2b18700 1 Processor -- start 2023-10-18T12:42:35.757 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.748+0000 7faeb2b18700 1 -- start start 2023-10-18T12:42:35.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.748+0000 7faeb2b18700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faeac070460 0x7faeac1592b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:35.759 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.748+0000 7faeb2b18700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faeac0cce10 0x7faeac15dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:35.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.748+0000 7faeb2b18700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faeac15adf0 0x7faeac0c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:35.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.748+0000 7faeb2b18700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeac0c3550 con 0x7faeac0cce10 2023-10-18T12:42:35.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.748+0000 7faeb2b18700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeac1597f0 con 0x7faeac15adf0 2023-10-18T12:42:35.760 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.748+0000 7faeb2b18700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeac15e200 con 0x7faeac070460 2023-10-18T12:42:35.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.752+0000 7faeabfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faeac0cce10 0x7faeac15dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:35.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.752+0000 7faeabfff700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faeac0cce10 0x7faeac15dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33832/0 (socket says 172.21.15.114:33832) 2023-10-18T12:42:35.761 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.752+0000 7faeabfff700 1 -- 172.21.15.114:0/2424007010 learned_addr learned my addr 172.21.15.114:0/2424007010 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:42:35.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.752+0000 7faeb08b4700 1 --2- 172.21.15.114:0/2424007010 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faeac070460 0x7faeac1592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:35.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.752+0000 7faeb10b5700 1 --2- 172.21.15.114:0/2424007010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faeac15adf0 0x7faeac0c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:35.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.752+0000 7faeabfff700 1 -- 172.21.15.114:0/2424007010 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faeac070460 msgr2=0x7faeac1592b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:35.762 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.752+0000 7faeabfff700 1 --2- 172.21.15.114:0/2424007010 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faeac070460 0x7faeac1592b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:35.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.752+0000 7faeabfff700 1 -- 172.21.15.114:0/2424007010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faeac15adf0 msgr2=0x7faeac0c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:35.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.752+0000 7faeabfff700 1 --2- 172.21.15.114:0/2424007010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faeac15adf0 0x7faeac0c3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:35.763 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.752+0000 7faeabfff700 1 -- 172.21.15.114:0/2424007010 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea0009570 con 0x7faeac0cce10 2023-10-18T12:42:35.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.752+0000 7faeabfff700 1 --2- 172.21.15.114:0/2424007010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faeac0cce10 0x7faeac15dcc0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fae9800c500 tx=0x7fae9800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:35.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.752+0000 7faea97fa700 1 -- 172.21.15.114:0/2424007010 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae980052d0 con 0x7faeac0cce10 2023-10-18T12:42:35.764 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.752+0000 7faea97fa700 1 -- 172.21.15.114:0/2424007010 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae98005430 con 0x7faeac0cce10 2023-10-18T12:42:35.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.752+0000 7faeb2b18700 1 -- 172.21.15.114:0/2424007010 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeac0c28d0 con 0x7faeac0cce10 2023-10-18T12:42:35.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.752+0000 7faea97fa700 1 -- 172.21.15.114:0/2424007010 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae980055a0 con 0x7faeac0cce10 2023-10-18T12:42:35.765 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.752+0000 7faeb2b18700 1 -- 172.21.15.114:0/2424007010 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeac0c2e90 con 0x7faeac0cce10 2023-10-18T12:42:35.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.752+0000 7faeb2b18700 1 -- 172.21.15.114:0/2424007010 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeac0c6520 con 0x7faeac0cce10 2023-10-18T12:42:35.766 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.756+0000 7faea97fa700 1 -- 172.21.15.114:0/2424007010 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fae980038e0 con 0x7faeac0cce10 2023-10-18T12:42:35.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.756+0000 7faea97fa700 1 --2- 172.21.15.114:0/2424007010 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fae900656f0 0x7fae90067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:35.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.756+0000 7faea97fa700 1 -- 172.21.15.114:0/2424007010 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5659+0+0 (secure 0 0 0) 0x7fae98081ea0 con 0x7faeac0cce10 2023-10-18T12:42:35.767 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.756+0000 7faeb08b4700 1 --2- 172.21.15.114:0/2424007010 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fae900656f0 0x7fae90067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:35.768 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.760+0000 7faeb08b4700 1 --2- 172.21.15.114:0/2424007010 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fae900656f0 0x7fae90067bb0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7faea0000c00 tx=0x7faea0008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:35.770 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:35.764+0000 7faea97fa700 1 -- 172.21.15.114:0/2424007010 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fae9804fae0 con 0x7faeac0cce10 2023-10-18T12:42:36.008 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.000+0000 7faeb2b18700 1 -- 172.21.15.114:0/2424007010 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7faeac072e60 con 0x7faeac0cce10 2023-10-18T12:42:36.018 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.012+0000 7faea97fa700 1 -- 172.21.15.114:0/2424007010 <== mon.0 v2:172.21.15.114:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fae98001260 con 0x7faeac0cce10 2023-10-18T12:42:36.020 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.016+0000 7faea97fa700 1 -- 172.21.15.114:0/2424007010 <== mon.0 v2:172.21.15.114:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v17)=0 v17) v1 ==== 123+0+0 (secure 0 0 0) 0x7fae98053100 con 0x7faeac0cce10 2023-10-18T12:42:36.024 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.020+0000 7faeb2b18700 1 -- 172.21.15.114:0/2424007010 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fae900656f0 msgr2=0x7fae90067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:36.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.020+0000 7faeb2b18700 1 --2- 172.21.15.114:0/2424007010 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fae900656f0 0x7fae90067bb0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7faea0000c00 tx=0x7faea0008030 comp rx=0 tx=0).stop 2023-10-18T12:42:36.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.020+0000 7faeb2b18700 1 -- 172.21.15.114:0/2424007010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faeac0cce10 msgr2=0x7faeac15dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:36.025 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.020+0000 7faeb2b18700 1 --2- 172.21.15.114:0/2424007010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faeac0cce10 0x7faeac15dcc0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fae9800c500 tx=0x7fae9800c810 comp rx=0 tx=0).stop 2023-10-18T12:42:36.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.020+0000 7faeb2b18700 1 -- 172.21.15.114:0/2424007010 shutdown_connections 2023-10-18T12:42:36.026 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.020+0000 7faeb2b18700 1 --2- 172.21.15.114:0/2424007010 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fae900656f0 0x7fae90067bb0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:36.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.020+0000 7faeb2b18700 1 --2- 172.21.15.114:0/2424007010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faeac15adf0 0x7faeac0c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:36.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.020+0000 7faeb2b18700 1 --2- 172.21.15.114:0/2424007010 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7faeac0cce10 0x7faeac15dcc0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:36.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.020+0000 7faeb2b18700 1 --2- 172.21.15.114:0/2424007010 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7faeac070460 0x7faeac1592b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:36.027 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.020+0000 7faeb2b18700 1 -- 172.21.15.114:0/2424007010 >> 172.21.15.114:0/2424007010 conn(0x7faeac0ce820 msgr2=0x7faeac0caf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:36.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.020+0000 7faeb2b18700 1 -- 172.21.15.114:0/2424007010 shutdown_connections 2023-10-18T12:42:36.028 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.020+0000 7faeb2b18700 1 -- 172.21.15.114:0/2424007010 wait complete. 2023-10-18T12:42:36.045 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-18T12:42:36.046 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-18T12:42:36.165 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:42:36.173 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:42:36.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.208+0000 7fcf0cbdc700 1 Processor -- start 2023-10-18T12:42:36.215 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.208+0000 7fcf0cbdc700 1 -- start start 2023-10-18T12:42:36.216 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.212+0000 7fcf0cbdc700 1 --2- >> v2:172.21.15.172:3300/0 conn(0x7fcf0806d470 0x7fcf08070a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:36.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.212+0000 7fcf0cbdc700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcf08070f50 0x7fcf0815a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:36.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.212+0000 7fcf0cbdc700 1 -- --> v1:172.21.15.114:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf0815e990 con 0x7fcf0806d090 2023-10-18T12:42:36.217 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.212+0000 7fcf0cbdc700 1 -- --> v2:172.21.15.172:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf0815f4f0 con 0x7fcf0806d470 2023-10-18T12:42:36.218 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.212+0000 7fcf0cbdc700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf080b2ca0 con 0x7fcf08070f50 2023-10-18T12:42:36.219 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.212+0000 7fcf077fe700 1 --1- >> v1:172.21.15.114:6789/0 conn(0x7fcf0806d090 0x7fcf080b2590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.114:6789/0 says I am v1:172.21.15.114:48530/0 (socket says 172.21.15.114:48530) 2023-10-18T12:42:36.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.212+0000 7fcf077fe700 1 -- 172.21.15.114:0/825301390 learned_addr learned my addr 172.21.15.114:0/825301390 (peer_addr_for_me v1:172.21.15.114:0/0) 2023-10-18T12:42:36.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.212+0000 7fcf06ffd700 1 --2- 172.21.15.114:0/825301390 >> v2:172.21.15.172:3300/0 conn(0x7fcf0806d470 0x7fcf08070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:36.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.212+0000 7fcf07fff700 1 --2- 172.21.15.114:0/825301390 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcf08070f50 0x7fcf0815a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:36.220 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.212+0000 7fcf067fc700 1 -- 172.21.15.114:0/825301390 <== mon.0 v1:172.21.15.114:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1396957520 0 0) 0x7fcf0815e990 con 0x7fcf0806d090 2023-10-18T12:42:36.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.212+0000 7fcf067fc700 1 -- 172.21.15.114:0/825301390 --> v1:172.21.15.114:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcef00035d0 con 0x7fcf0806d090 2023-10-18T12:42:36.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.212+0000 7fcf06ffd700 1 -- 172.21.15.114:0/825301390 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcf08070f50 msgr2=0x7fcf0815a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-18T12:42:36.221 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.212+0000 7fcf06ffd700 1 --2- 172.21.15.114:0/825301390 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcf08070f50 0x7fcf0815a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:36.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.212+0000 7fcf06ffd700 1 -- 172.21.15.114:0/825301390 >> v1:172.21.15.114:6789/0 conn(0x7fcf0806d090 legacy=0x7fcf080b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:36.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.212+0000 7fcf067fc700 1 -- 172.21.15.114:0/825301390 <== mon.0 v1:172.21.15.114:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3632832065 0 0) 0x7fcef00035d0 con 0x7fcf0806d090 2023-10-18T12:42:36.222 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.212+0000 7fcf06ffd700 1 -- 172.21.15.114:0/825301390 --> v2:172.21.15.172:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf0815ec50 con 0x7fcf0806d470 2023-10-18T12:42:36.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.212+0000 7fcf06ffd700 1 --2- 172.21.15.114:0/825301390 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf0806d470 0x7fcf08070a10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fcefc009850 tx=0x7fcefc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79d8923a0b6fb7fe server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:36.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.212+0000 7fcf067fc700 1 -- 172.21.15.114:0/825301390 <== mon.1 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef80019f0 con 0x7fcf0806d470 2023-10-18T12:42:36.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.212+0000 7fcf067fc700 1 -- 172.21.15.114:0/825301390 <== mon.1 v2:172.21.15.172:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fcefc004030 con 0x7fcf0806d470 2023-10-18T12:42:36.223 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.212+0000 7fcf067fc700 1 -- 172.21.15.114:0/825301390 <== mon.1 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcefc004400 con 0x7fcf0806d470 2023-10-18T12:42:36.226 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.212+0000 7fcf0cbdc700 1 -- 172.21.15.114:0/825301390 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf0806d470 msgr2=0x7fcf08070a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:36.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.212+0000 7fcf0cbdc700 1 --2- 172.21.15.114:0/825301390 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf0806d470 0x7fcf08070a10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fcefc009850 tx=0x7fcefc009b60 comp rx=0 tx=0).stop 2023-10-18T12:42:36.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.216+0000 7fcf0cbdc700 1 -- 172.21.15.114:0/825301390 shutdown_connections 2023-10-18T12:42:36.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.216+0000 7fcf0cbdc700 1 --2- 172.21.15.114:0/825301390 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcf08070f50 0x7fcf0815a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:36.227 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.216+0000 7fcf0cbdc700 1 --2- 172.21.15.114:0/825301390 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf0806d470 0x7fcf08070a10 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:36.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.216+0000 7fcf0cbdc700 1 -- 172.21.15.114:0/825301390 >> 172.21.15.114:0/825301390 conn(0x7fcf080ce5c0 msgr2=0x7fcf080ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:36.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.216+0000 7fcf0cbdc700 1 -- 172.21.15.114:0/825301390 shutdown_connections 2023-10-18T12:42:36.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.216+0000 7fcf0cbdc700 1 -- 172.21.15.114:0/825301390 wait complete. 2023-10-18T12:42:36.228 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.216+0000 7fcf0cbdc700 1 Processor -- start 2023-10-18T12:42:36.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.216+0000 7fcf0cbdc700 1 -- start start 2023-10-18T12:42:36.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.216+0000 7fcf0cbdc700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf0806d090 0x7fcf0815ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:36.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.216+0000 7fcf0cbdc700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf0806d470 0x7fcf08153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:36.229 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.216+0000 7fcf0cbdc700 1 --2- >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcf08070f50 0x7fcf08153fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:36.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.216+0000 7fcf0cbdc700 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf08144910 con 0x7fcf0806d090 2023-10-18T12:42:36.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.216+0000 7fcf0cbdc700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0815d370 con 0x7fcf0806d470 2023-10-18T12:42:36.230 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.216+0000 7fcf0cbdc700 1 -- --> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf08146940 con 0x7fcf08070f50 2023-10-18T12:42:36.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.216+0000 7fcf077fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf0806d090 0x7fcf0815ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:36.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.216+0000 7fcf077fe700 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf0806d090 0x7fcf0815ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:33834/0 (socket says 172.21.15.114:33834) 2023-10-18T12:42:36.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.216+0000 7fcf077fe700 1 -- 172.21.15.114:0/306887341 learned_addr learned my addr 172.21.15.114:0/306887341 (peer_addr_for_me v2:172.21.15.114:0/0) 2023-10-18T12:42:36.231 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.220+0000 7fcf07fff700 1 --2- 172.21.15.114:0/306887341 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcf08070f50 0x7fcf08153fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:36.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.220+0000 7fcf077fe700 1 -- 172.21.15.114:0/306887341 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcf08070f50 msgr2=0x7fcf08153fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:36.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.220+0000 7fcf077fe700 1 --2- 172.21.15.114:0/306887341 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcf08070f50 0x7fcf08153fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:36.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.220+0000 7fcf06ffd700 1 --2- 172.21.15.114:0/306887341 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf0806d470 0x7fcf08153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:36.232 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.220+0000 7fcf077fe700 1 -- 172.21.15.114:0/306887341 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf0806d470 msgr2=0x7fcf08153a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:36.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.220+0000 7fcf077fe700 1 --2- 172.21.15.114:0/306887341 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf0806d470 0x7fcf08153a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:36.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.220+0000 7fcf077fe700 1 -- 172.21.15.114:0/306887341 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcefc0094b0 con 0x7fcf0806d090 2023-10-18T12:42:36.233 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.220+0000 7fcf07fff700 1 --2- 172.21.15.114:0/306887341 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcf08070f50 0x7fcf08153fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:42:36.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.220+0000 7fcf06ffd700 1 --2- 172.21.15.114:0/306887341 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf0806d470 0x7fcf08153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-18T12:42:36.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.220+0000 7fcf077fe700 1 --2- 172.21.15.114:0/306887341 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf0806d090 0x7fcf0815ce30 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fcef80018e0 tx=0x7fcef800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:36.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.220+0000 7fceeffff700 1 -- 172.21.15.114:0/306887341 <== mon.0 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef800ada0 con 0x7fcf0806d090 2023-10-18T12:42:36.234 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.220+0000 7fcf0cbdc700 1 -- 172.21.15.114:0/306887341 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf081458a0 con 0x7fcf0806d090 2023-10-18T12:42:36.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.220+0000 7fceeffff700 1 -- 172.21.15.114:0/306887341 <== mon.0 v2:172.21.15.114:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fcef80070d0 con 0x7fcf0806d090 2023-10-18T12:42:36.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.220+0000 7fceeffff700 1 -- 172.21.15.114:0/306887341 <== mon.0 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef8007480 con 0x7fcf0806d090 2023-10-18T12:42:36.235 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.220+0000 7fcf0cbdc700 1 -- 172.21.15.114:0/306887341 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf08145e60 con 0x7fcf0806d090 2023-10-18T12:42:36.236 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.220+0000 7fcf0cbdc700 1 -- 172.21.15.114:0/306887341 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf08072e60 con 0x7fcf0806d090 2023-10-18T12:42:36.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.224+0000 7fceeffff700 1 -- 172.21.15.114:0/306887341 <== mon.0 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 5) v1 ==== 84962+0+0 (secure 0 0 0) 0x7fcef80075e0 con 0x7fcf0806d090 2023-10-18T12:42:36.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.224+0000 7fceeffff700 1 --2- 172.21.15.114:0/306887341 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fcef40656f0 0x7fcef4067bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-18T12:42:36.237 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.224+0000 7fceeffff700 1 -- 172.21.15.114:0/306887341 <== mon.0 v2:172.21.15.114:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5659+0+0 (secure 0 0 0) 0x7fcef8082b10 con 0x7fcf0806d090 2023-10-18T12:42:36.238 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.224+0000 7fcf06ffd700 1 --2- 172.21.15.114:0/306887341 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fcef40656f0 0x7fcef4067bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-18T12:42:36.239 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.224+0000 7fcf06ffd700 1 --2- 172.21.15.114:0/306887341 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fcef40656f0 0x7fcef4067bb0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fcf08153980 tx=0x7fcefc008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-18T12:42:36.240 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.232+0000 7fceeffff700 1 -- 172.21.15.114:0/306887341 <== mon.0 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+171304 (secure 0 0 0) 0x7fcef80505b0 con 0x7fcf0806d090 2023-10-18T12:42:36.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.460+0000 7fcf0cbdc700 1 -- 172.21.15.114:0/306887341 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf0806e030 con 0x7fcf0806d090 2023-10-18T12:42:36.468 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.464+0000 7fceeffff700 1 -- 172.21.15.114:0/306887341 <== mon.0 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+3708 (secure 0 0 0) 0x7fcef8018020 con 0x7fcf0806d090 2023-10-18T12:42:36.469 INFO:teuthology.orchestra.run.smithi114.stdout: 2023-10-18T12:42:36.469 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":22,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6836/2034957068","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":2034957068},{"type":"v1","addr":"172.21.15.172:6836","nonce":2034957068}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5039,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/4215710360","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6835","nonce":4215710360},{"type":"v1","addr":"172.21.15.172:6837","nonce":4215710360}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5532,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6833/2387835210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6832","nonce":2387835210},{"type":"v1","addr":"172.21.15.114:6833","nonce":2387835210}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":6321,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6835/511863662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6834","nonce":511863662},{"type":"v1","addr":"172.21.15.114:6835","nonce":511863662}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[]} 2023-10-18T12:42:36.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.464+0000 7fcf0cbdc700 1 -- 172.21.15.114:0/306887341 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fcef40656f0 msgr2=0x7fcef4067bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:36.472 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.464+0000 7fcf0cbdc700 1 --2- 172.21.15.114:0/306887341 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fcef40656f0 0x7fcef4067bb0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fcf08153980 tx=0x7fcefc008030 comp rx=0 tx=0).stop 2023-10-18T12:42:36.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.464+0000 7fcf0cbdc700 1 -- 172.21.15.114:0/306887341 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf0806d090 msgr2=0x7fcf0815ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-18T12:42:36.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.464+0000 7fcf0cbdc700 1 --2- 172.21.15.114:0/306887341 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf0806d090 0x7fcf0815ce30 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fcef80018e0 tx=0x7fcef800a340 comp rx=0 tx=0).stop 2023-10-18T12:42:36.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.464+0000 7fcf0cbdc700 1 -- 172.21.15.114:0/306887341 shutdown_connections 2023-10-18T12:42:36.473 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.464+0000 7fcf0cbdc700 1 --2- 172.21.15.114:0/306887341 >> [v2:172.21.15.172:6832/461408666,v1:172.21.15.172:6833/461408666] conn(0x7fcef40656f0 0x7fcef4067bb0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:36.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.464+0000 7fcf0cbdc700 1 --2- 172.21.15.114:0/306887341 >> [v2:172.21.15.172:3301/0,v1:172.21.15.172:6790/0] conn(0x7fcf08070f50 0x7fcf08153fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:36.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.464+0000 7fcf0cbdc700 1 --2- 172.21.15.114:0/306887341 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf0806d470 0x7fcf08153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:36.474 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.464+0000 7fcf0cbdc700 1 --2- 172.21.15.114:0/306887341 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcf0806d090 0x7fcf0815ce30 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-18T12:42:36.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.464+0000 7fcf0cbdc700 1 -- 172.21.15.114:0/306887341 >> 172.21.15.114:0/306887341 conn(0x7fcf080ce5c0 msgr2=0x7fcf080ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-18T12:42:36.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.464+0000 7fcf0cbdc700 1 -- 172.21.15.114:0/306887341 shutdown_connections 2023-10-18T12:42:36.475 INFO:teuthology.orchestra.run.smithi114.stderr:2023-10-18T12:42:36.464+0000 7fcf0cbdc700 1 -- 172.21.15.114:0/306887341 wait complete. 2023-10-18T12:42:36.476 INFO:teuthology.orchestra.run.smithi114.stderr:dumped fsmap epoch 22 2023-10-18T12:42:36.495 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-18T12:42:36.495 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-18T12:42:36.496 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-18T12:42:36.496 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T12:42:36.515 INFO:tasks.ceph.mds.a:Stopped 2023-10-18T12:42:36.516 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-18T12:42:36.516 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T12:42:36.582 INFO:tasks.ceph.mds.c:Stopped 2023-10-18T12:42:36.583 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-18T12:42:36.583 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T12:42:36.606 INFO:tasks.ceph.mds.b:Stopped 2023-10-18T12:42:36.607 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-18T12:42:36.607 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T12:42:36.676 INFO:tasks.ceph.mds.d:Stopped 2023-10-18T12:42:36.677 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-18T12:42:36.677 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-18T12:42:36.677 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T12:42:36.757 INFO:tasks.ceph.osd.0:Stopped 2023-10-18T12:42:36.758 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-18T12:42:36.758 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T12:42:36.845 INFO:tasks.ceph.osd.1:Stopped 2023-10-18T12:42:36.845 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-18T12:42:36.846 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T12:42:36.938 INFO:tasks.ceph.osd.2:Stopped 2023-10-18T12:42:36.938 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-18T12:42:36.939 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T12:42:39.964 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-10-18T12:42:43.041 INFO:tasks.ceph.osd.3:Stopped 2023-10-18T12:42:43.042 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-18T12:42:43.042 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T12:42:43.119 INFO:tasks.ceph.osd.4:Stopped 2023-10-18T12:42:43.120 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-18T12:42:43.120 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T12:42:45.670 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-10-18T12:42:45.671 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-10-18T12:42:49.222 INFO:tasks.ceph.osd.5:Stopped 2023-10-18T12:42:49.223 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-18T12:42:49.224 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T12:42:49.319 INFO:tasks.ceph.osd.6:Stopped 2023-10-18T12:42:49.320 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-18T12:42:49.320 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T12:42:51.175 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-10-18T12:42:51.175 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-10-18T12:42:55.422 INFO:tasks.ceph.osd.7:Stopped 2023-10-18T12:42:55.423 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-18T12:42:55.424 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-18T12:42:55.424 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T12:42:55.493 INFO:tasks.ceph.mgr.y:Stopped 2023-10-18T12:42:55.494 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-18T12:42:55.494 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T12:42:55.581 INFO:tasks.ceph.mgr.x:Stopped 2023-10-18T12:42:55.582 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-18T12:42:55.583 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-18T12:42:55.583 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T12:42:55.619 INFO:tasks.ceph.mon.a:Stopped 2023-10-18T12:42:55.620 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-18T12:42:55.621 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T12:42:55.651 INFO:tasks.ceph.mon.b:Stopped 2023-10-18T12:42:55.652 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-18T12:42:55.652 INFO:teuthology.orchestra.run:waiting for 300 2023-10-18T12:42:55.727 INFO:tasks.ceph.mon.c:Stopped 2023-10-18T12:42:55.728 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-18T12:42:55.729 DEBUG:teuthology.orchestra.run.smithi114:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'evicting unresponsive client' | egrep -v 'but it is still running' | egrep -v 'slow request' | egrep -v MDS_CLIENT_LATE_RELEASE | egrep -v 't responding to mclientcaps' | egrep -v 'file system flag refuse_client_session is set' | egrep -v 'Degraded data redundancy' | egrep -v MDS_CLIENTS_LAGGY | egrep -v 'Reduced data availability' | head -n 1 2023-10-18T12:42:55.778 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi114.front.sepia.ceph.com 2023-10-18T12:42:55.779 DEBUG:teuthology.orchestra.run.smithi114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-18T12:42:56.154 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi114.front.sepia.ceph.com 2023-10-18T12:42:56.155 DEBUG:teuthology.orchestra.run.smithi114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-18T12:42:56.176 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-10-18T12:42:56.402 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi114.front.sepia.ceph.com 2023-10-18T12:42:56.403 DEBUG:teuthology.orchestra.run.smithi114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-18T12:42:56.608 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi114.front.sepia.ceph.com 2023-10-18T12:42:56.609 DEBUG:teuthology.orchestra.run.smithi114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-18T12:42:56.880 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi172.front.sepia.ceph.com 2023-10-18T12:42:56.881 DEBUG:teuthology.orchestra.run.smithi172:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-18T12:42:57.202 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi172.front.sepia.ceph.com 2023-10-18T12:42:57.203 DEBUG:teuthology.orchestra.run.smithi172:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-18T12:42:57.412 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi172.front.sepia.ceph.com 2023-10-18T12:42:57.413 DEBUG:teuthology.orchestra.run.smithi172:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-18T12:42:57.608 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi172.front.sepia.ceph.com 2023-10-18T12:42:57.609 DEBUG:teuthology.orchestra.run.smithi172:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-18T12:42:57.842 INFO:tasks.ceph:Archiving mon data... 2023-10-18T12:42:57.844 DEBUG:teuthology.misc:Transferring archived files from smithi114:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/dparmar-2023-10-18_11:50:16-fs:functional-wip-63105-distro-default-smithi/7431514/data/mon.a.tgz 2023-10-18T12:42:57.845 DEBUG:teuthology.orchestra.run.smithi114:> mktemp 2023-10-18T12:42:57.863 INFO:teuthology.orchestra.run.smithi114.stdout:/tmp/tmp.S2ciyfuAqh 2023-10-18T12:42:57.864 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.S2ciyfuAqh 2023-10-18T12:42:58.021 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0666 /tmp/tmp.S2ciyfuAqh 2023-10-18T12:42:58.123 DEBUG:teuthology.orchestra.remote:smithi114:/tmp/tmp.S2ciyfuAqh is 267KB 2023-10-18T12:42:58.201 DEBUG:teuthology.orchestra.run.smithi114:> rm -fr /tmp/tmp.S2ciyfuAqh 2023-10-18T12:42:58.221 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/dparmar-2023-10-18_11:50:16-fs:functional-wip-63105-distro-default-smithi/7431514/data/mon.b.tgz 2023-10-18T12:42:58.222 DEBUG:teuthology.orchestra.run.smithi172:> mktemp 2023-10-18T12:42:58.240 INFO:teuthology.orchestra.run.smithi172.stdout:/tmp/tmp.SlTycL2Bbi 2023-10-18T12:42:58.241 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.SlTycL2Bbi 2023-10-18T12:42:58.399 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0666 /tmp/tmp.SlTycL2Bbi 2023-10-18T12:42:58.495 DEBUG:teuthology.orchestra.remote:smithi172:/tmp/tmp.SlTycL2Bbi is 276KB 2023-10-18T12:42:58.568 DEBUG:teuthology.orchestra.run.smithi172:> rm -fr /tmp/tmp.SlTycL2Bbi 2023-10-18T12:42:58.587 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/dparmar-2023-10-18_11:50:16-fs:functional-wip-63105-distro-default-smithi/7431514/data/mon.c.tgz 2023-10-18T12:42:58.587 DEBUG:teuthology.orchestra.run.smithi172:> mktemp 2023-10-18T12:42:58.648 INFO:teuthology.orchestra.run.smithi172.stdout:/tmp/tmp.QfdiRyoh6T 2023-10-18T12:42:58.648 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.QfdiRyoh6T 2023-10-18T12:42:58.801 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0666 /tmp/tmp.QfdiRyoh6T 2023-10-18T12:42:58.909 DEBUG:teuthology.orchestra.remote:smithi172:/tmp/tmp.QfdiRyoh6T is 276KB 2023-10-18T12:42:58.984 DEBUG:teuthology.orchestra.run.smithi172:> rm -fr /tmp/tmp.QfdiRyoh6T 2023-10-18T12:42:59.001 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-18T12:42:59.002 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-18T12:42:59.010 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-18T12:42:59.078 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-18T12:42:59.079 DEBUG:teuthology.orchestra.run.smithi114:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-18T12:42:59.090 DEBUG:teuthology.orchestra.run.smithi172:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-18T12:42:59.133 INFO:teuthology.orchestra.run.smithi114.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-18T12:42:59.174 INFO:teuthology.orchestra.run.smithi172.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-18T12:42:59.190 INFO:tasks.ceph:Archiving crash dumps... 2023-10-18T12:42:59.192 DEBUG:teuthology.misc:Transferring archived files from smithi114:/var/lib/ceph/crash to /home/teuthworker/archive/dparmar-2023-10-18_11:50:16-fs:functional-wip-63105-distro-default-smithi/7431514/remote/smithi114/crash 2023-10-18T12:42:59.194 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-18T12:42:59.228 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/lib/ceph/crash to /home/teuthworker/archive/dparmar-2023-10-18_11:50:16-fs:functional-wip-63105-distro-default-smithi/7431514/remote/smithi172/crash 2023-10-18T12:42:59.230 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-18T12:42:59.266 INFO:tasks.ceph:Shutting down logrotate 2023-10-18T12:42:59.266 DEBUG:teuthology.orchestra.run.smithi114:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:42:59.278 DEBUG:teuthology.orchestra.run.smithi172:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-18T12:42:59.378 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-18T12:42:59.411 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-18T12:42:59.449 INFO:tasks.ceph:Compressing logs... 2023-10-18T12:42:59.449 DEBUG:teuthology.orchestra.run.smithi114:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-18T12:42:59.462 DEBUG:teuthology.orchestra.run.smithi172:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-18T12:42:59.510 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42208.log 2023-10-18T12:42:59.512 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43985.log 2023-10-18T12:42:59.514 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41906.log 2023-10-18T12:42:59.515 INFO:teuthology.orchestra.run.smithi114.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.42208.log.gz 2023-10-18T12:42:59.516 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42265.log 2023-10-18T12:42:59.517 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43985.log.gz 2023-10-18T12:42:59.517 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45081.log 2023-10-18T12:42:59.518 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41906.log: /var/log/ceph/ceph-client.admin.42265.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42265.log.gz 2023-10-18T12:42:59.519 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41906.log.gz 2023-10-18T12:42:59.519 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46191.log 2023-10-18T12:42:59.522 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45081.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45081.log.gz 2023-10-18T12:42:59.522 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44717.log 2023-10-18T12:42:59.524 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45548.log 2023-10-18T12:42:59.525 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46191.log.gz 2023-10-18T12:42:59.525 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44717.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44717.log.gz 2023-10-18T12:42:59.527 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.43609.log 2023-10-18T12:42:59.529 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46409.log 2023-10-18T12:42:59.529 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45548.log.gz 2023-10-18T12:42:59.530 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.2.43609.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.43609.log.gz 2023-10-18T12:42:59.531 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47320.log 2023-10-18T12:42:59.532 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50777.log 2023-10-18T12:42:59.533 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46409.log: /var/log/ceph/ceph-client.admin.47320.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47320.log.gz 2023-10-18T12:42:59.534 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51020.log 2023-10-18T12:42:59.534 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46409.log.gz 2023-10-18T12:42:59.535 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46664.log 2023-10-18T12:42:59.535 INFO:teuthology.orchestra.run.smithi114.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50777.log.gz 2023-10-18T12:42:59.536 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51020.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51020.log.gz 2023-10-18T12:42:59.537 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40728.log 2023-10-18T12:42:59.537 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.41152.log 2023-10-18T12:42:59.538 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46664.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46664.log.gz 2023-10-18T12:42:59.539 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49858.log 2023-10-18T12:42:59.540 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-10-18T12:42:59.541 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.3.41152.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-18T12:42:59.541 INFO:teuthology.orchestra.run.smithi172.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.41152.log.gz 2023-10-18T12:42:59.542 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40728.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-18T12:42:59.542 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40728.log.gz 2023-10-18T12:42:59.543 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49858.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49858.log.gz 2023-10-18T12:42:59.543 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44012.log 2023-10-18T12:42:59.545 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35788.log 2023-10-18T12:42:59.545 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41067.log 2023-10-18T12:42:59.545 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.35788.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-10-18T12:42:59.546 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48599.log 2023-10-18T12:42:59.546 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49750.log 2023-10-18T12:42:59.546 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44012.log.gz 2023-10-18T12:42:59.549 INFO:teuthology.orchestra.run.smithi172.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35788.log.gz 2023-10-18T12:42:59.549 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.1.41067.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.41067.log.gz 2023-10-18T12:42:59.550 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-18T12:42:59.550 INFO:teuthology.orchestra.run.smithi172.stderr: 94.1% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-10-18T12:42:59.550 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-18T12:42:59.552 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48599.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48599.log.gz 2023-10-18T12:42:59.552 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50885.log 2023-10-18T12:42:59.552 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45983.log 2023-10-18T12:42:59.553 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49750.log.gz 2023-10-18T12:42:59.553 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50885.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50885.log.gz 2023-10-18T12:42:59.553 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43715.log 2023-10-18T12:42:59.554 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50723.log 2023-10-18T12:42:59.554 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45983.log.gz 2023-10-18T12:42:59.554 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45165.log 2023-10-18T12:42:59.554 INFO:teuthology.orchestra.run.smithi114.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43715.log.gz 2023-10-18T12:42:59.557 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41076.log 2023-10-18T12:42:59.557 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-18T12:42:59.557 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.1.41076.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.41076.log.gz 2023-10-18T12:42:59.558 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41292.log 2023-10-18T12:42:59.558 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35679.log 2023-10-18T12:42:59.560 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50723.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50723.log.gz 2023-10-18T12:42:59.560 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45926.log 2023-10-18T12:42:59.560 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49916.log 2023-10-18T12:42:59.561 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45165.log.gz 2023-10-18T12:42:59.561 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45926.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45926.log.gz 2023-10-18T12:42:59.561 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49207.log 2023-10-18T12:42:59.561 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50133.log 2023-10-18T12:42:59.562 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49916.log.gz 2023-10-18T12:42:59.562 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49207.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.49207.log.gz 2023-10-18T12:42:59.562 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41214.log 2023-10-18T12:42:59.563 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50133.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50133.log.gz 2023-10-18T12:42:59.563 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50585.log 2023-10-18T12:42:59.566 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.1.41292.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.41292.log.gz 2023-10-18T12:42:59.567 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-10-18T12:42:59.567 INFO:teuthology.orchestra.run.smithi172.stderr: 93.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-18T12:42:59.567 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.35679.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-10-18T12:42:59.568 INFO:teuthology.orchestra.run.smithi172.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35679.log.gz 2023-10-18T12:42:59.568 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35706.log 2023-10-18T12:42:59.568 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35761.log 2023-10-18T12:42:59.568 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.35706.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.35706.log.gz 2023-10-18T12:42:59.569 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35815.log 2023-10-18T12:42:59.572 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41214.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41214.log.gz 2023-10-18T12:42:59.573 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43075.log 2023-10-18T12:42:59.573 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50585.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50585.log.gz 2023-10-18T12:42:59.573 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44663.log 2023-10-18T12:42:59.574 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43075.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43075.log.gz 2023-10-18T12:42:59.574 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43048.log 2023-10-18T12:42:59.574 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44663.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44663.log.gz 2023-10-18T12:42:59.575 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47091.log 2023-10-18T12:42:59.575 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43048.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43048.log.gz 2023-10-18T12:42:59.575 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50503.log 2023-10-18T12:42:59.576 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47091.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47091.log.gz 2023-10-18T12:42:59.576 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46473.log 2023-10-18T12:42:59.576 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50503.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50503.log.gz 2023-10-18T12:42:59.577 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50640.log 2023-10-18T12:42:59.577 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46473.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46473.log.gz 2023-10-18T12:42:59.577 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50268.log 2023-10-18T12:42:59.578 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50640.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50640.log.gz 2023-10-18T12:42:59.578 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41879.log 2023-10-18T12:42:59.578 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50268.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50268.log.gz 2023-10-18T12:42:59.578 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49085.log 2023-10-18T12:42:59.581 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.35761.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.35761.log.gz 2023-10-18T12:42:59.581 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.35815.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35815.log.gz 2023-10-18T12:42:59.581 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35625.log 2023-10-18T12:42:59.582 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-18T12:42:59.582 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.35625.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35625.log.gz 2023-10-18T12:42:59.582 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41297.log 2023-10-18T12:42:59.583 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-10-18T12:42:59.583 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.1.41297.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.41297.log.gz 2023-10-18T12:42:59.583 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35651.log 2023-10-18T12:42:59.587 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35734.log 2023-10-18T12:42:59.587 INFO:teuthology.orchestra.run.smithi172.stderr: 93.7% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-18T12:42:59.588 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.41157.log 2023-10-18T12:42:59.588 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.35651.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35651.log.gz 2023-10-18T12:42:59.589 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41879.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41879.log.gz 2023-10-18T12:42:59.590 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-10-18T12:42:59.590 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43237.log 2023-10-18T12:42:59.591 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49085.log.gz 2023-10-18T12:42:59.591 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49206.log 2023-10-18T12:42:59.591 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43237.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43237.log.gz 2023-10-18T12:42:59.591 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41689.log 2023-10-18T12:42:59.592 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49206.log: 94.4% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-10-18T12:42:59.592 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50295.log 2023-10-18T12:42:59.592 INFO:teuthology.orchestra.run.smithi114.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49206.log.gz 2023-10-18T12:42:59.593 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41689.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41689.log.gz 2023-10-18T12:42:59.593 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48357.log 2023-10-18T12:42:59.593 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50295.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50295.log.gz 2023-10-18T12:42:59.594 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50187.log 2023-10-18T12:42:59.594 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48780.log 2023-10-18T12:42:59.594 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48357.log: /var/log/ceph/ceph-client.admin.50187.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50187.log.gz 2023-10-18T12:42:59.595 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49025.log 2023-10-18T12:42:59.595 INFO:teuthology.orchestra.run.smithi114.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48357.log.gz 2023-10-18T12:42:59.595 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48780.log: gzip 87.5%-5 -- replaced with /var/log/ceph/ceph-client.admin.48780.log.gz--verbose 2023-10-18T12:42:59.596 INFO:teuthology.orchestra.run.smithi114.stderr:-- /var/log/ceph/ceph-client.admin.47380.log 2023-10-18T12:42:59.596 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49025.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.49025.log.gz 2023-10-18T12:42:59.596 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46500.log 2023-10-18T12:42:59.596 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47380.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47380.log.gz 2023-10-18T12:42:59.598 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.admin.35734.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35734.log.gz 2023-10-18T12:42:59.599 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-10-18T12:42:59.599 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-client.3.41157.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.41157.log.gz 2023-10-18T12:42:59.601 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45656.log 2023-10-18T12:42:59.601 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42319.log 2023-10-18T12:42:59.602 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46500.log: /var/log/ceph/ceph-client.admin.45656.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45656.log.gz 2023-10-18T12:42:59.602 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41075.log 2023-10-18T12:42:59.602 INFO:teuthology.orchestra.run.smithi114.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46500.log.gz 2023-10-18T12:42:59.603 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42319.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42319.log.gz 2023-10-18T12:42:59.603 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46137.log 2023-10-18T12:42:59.603 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-10-18T12:42:59.604 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41075.log: /var/log/ceph/ceph-client.admin.46137.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41075.log.gz 2023-10-18T12:42:59.604 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46137.log.gz 2023-10-18T12:42:59.604 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42401.log 2023-10-18T12:42:59.605 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41960.log 2023-10-18T12:42:59.605 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42401.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42401.log.gz 2023-10-18T12:42:59.605 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46718.log 2023-10-18T12:42:59.607 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41960.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41960.log.gz 2023-10-18T12:42:59.607 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50376.log 2023-10-18T12:42:59.608 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46718.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46718.log.gz 2023-10-18T12:42:59.608 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47125.log 2023-10-18T12:42:59.608 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50376.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50376.log.gz 2023-10-18T12:42:59.609 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51182.log 2023-10-18T12:42:59.610 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47125.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47125.log.gz 2023-10-18T12:42:59.610 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49726.log 2023-10-18T12:42:59.610 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51182.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51182.log.gz 2023-10-18T12:42:59.611 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44474.log 2023-10-18T12:42:59.612 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/ceph-osd.7.log: 92.5% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-10-18T12:42:59.613 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.49726.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.49726.log.gz 2023-10-18T12:42:59.613 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44690.log 2023-10-18T12:42:59.613 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44474.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44474.log.gz 2023-10-18T12:42:59.614 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42381.log 2023-10-18T12:42:59.615 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44366.log 2023-10-18T12:42:59.615 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44690.log.gz 2023-10-18T12:42:59.616 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42381.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42381.log.gz 2023-10-18T12:42:59.616 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46637.log 2023-10-18T12:42:59.617 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46691.log 2023-10-18T12:42:59.617 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44366.log.gz 2023-10-18T12:42:59.618 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46637.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46637.log.gz 2023-10-18T12:42:59.618 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41187.log 2023-10-18T12:42:59.619 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46691.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46691.log.gz 2023-10-18T12:42:59.620 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44609.log 2023-10-18T12:42:59.621 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40785.log 2023-10-18T12:42:59.622 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41187.log.gz 2023-10-18T12:42:59.623 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44609.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44609.log.gz 2023-10-18T12:42:59.623 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48839.log 2023-10-18T12:42:59.624 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45872.log 2023-10-18T12:42:59.624 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40785.log.gz 2023-10-18T12:42:59.625 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48839.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48839.log.gz 2023-10-18T12:42:59.626 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42073.log 2023-10-18T12:42:59.627 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43769.log 2023-10-18T12:42:59.627 INFO:teuthology.orchestra.run.smithi114.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45872.log.gz 2023-10-18T12:42:59.628 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42073.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42073.log.gz 2023-10-18T12:42:59.629 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42292.log 2023-10-18T12:42:59.630 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46299.log 2023-10-18T12:42:59.630 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43769.log.gz 2023-10-18T12:42:59.631 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42292.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42292.log.gz 2023-10-18T12:42:59.631 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41933.log 2023-10-18T12:42:59.632 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46299.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46299.log.gz 2023-10-18T12:42:59.633 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45791.log 2023-10-18T12:42:59.634 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41933.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41933.log.gz 2023-10-18T12:42:59.634 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50079.log 2023-10-18T12:42:59.635 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45791.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45791.log.gz 2023-10-18T12:42:59.636 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48905.log 2023-10-18T12:42:59.637 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46923.log 2023-10-18T12:42:59.637 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50079.log.gz 2023-10-18T12:42:59.637 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48905.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48905.log.gz 2023-10-18T12:42:59.638 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41351.log 2023-10-18T12:42:59.639 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46923.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46923.log.gz 2023-10-18T12:42:59.639 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51209.log 2023-10-18T12:42:59.640 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41351.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41351.log.gz 2023-10-18T12:42:59.640 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44973.log 2023-10-18T12:42:59.641 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51209.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51209.log.gz 2023-10-18T12:42:59.641 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42014.log 2023-10-18T12:42:59.642 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44973.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44973.log.gz 2023-10-18T12:42:59.643 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45440.log 2023-10-18T12:42:59.647 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42014.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42014.log.gz 2023-10-18T12:42:59.647 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40966.log 2023-10-18T12:42:59.647 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45440.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45440.log.gz 2023-10-18T12:42:59.648 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-10-18T12:42:59.648 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40966.log: gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40966.log.gz 2023-10-18T12:42:59.648 INFO:teuthology.orchestra.run.smithi114.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.47195.log 2023-10-18T12:42:59.648 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45575.log 2023-10-18T12:42:59.650 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47195.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47195.log.gz 2023-10-18T12:42:59.650 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44174.log 2023-10-18T12:42:59.650 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43183.log 2023-10-18T12:42:59.651 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45575.log.gz 2023-10-18T12:42:59.652 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44174.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44174.log.gz 2023-10-18T12:42:59.652 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45845.log 2023-10-18T12:42:59.652 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43183.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43183.log.gz 2023-10-18T12:42:59.653 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50449.log 2023-10-18T12:42:59.654 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42237.log 2023-10-18T12:42:59.654 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45845.log.gz 2023-10-18T12:42:59.655 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49024.log 2023-10-18T12:42:59.656 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50449.log.gz 2023-10-18T12:42:59.657 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50476.log 2023-10-18T12:42:59.657 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42237.log.gz 2023-10-18T12:42:59.658 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49266.log 2023-10-18T12:42:59.658 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49024.log.gz 2023-10-18T12:42:59.659 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50476.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.50476.log.gz 2023-10-18T12:42:59.660 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46891.log 2023-10-18T12:42:59.661 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42617.log 2023-10-18T12:42:59.661 INFO:teuthology.orchestra.run.smithi114.stderr: 95.0% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-10-18T12:42:59.662 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49266.log.gz 2023-10-18T12:42:59.663 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46245.log 2023-10-18T12:42:59.663 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46891.log.gz 2023-10-18T12:42:59.664 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42617.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42617.log.gz 2023-10-18T12:42:59.664 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45710.log 2023-10-18T12:42:59.665 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49721.log 2023-10-18T12:42:59.665 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46245.log.gz 2023-10-18T12:42:59.666 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45710.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45710.log.gz 2023-10-18T12:42:59.666 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45413.log 2023-10-18T12:42:59.667 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.49721.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.49721.log.gz 2023-10-18T12:42:59.667 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50024.log 2023-10-18T12:42:59.669 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49885.log 2023-10-18T12:42:59.669 INFO:teuthology.orchestra.run.smithi114.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45413.log.gz 2023-10-18T12:42:59.670 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48779.log 2023-10-18T12:42:59.670 INFO:teuthology.orchestra.run.smithi114.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50024.log.gz 2023-10-18T12:42:59.671 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49885.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49885.log.gz 2023-10-18T12:42:59.671 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49146.log 2023-10-18T12:42:59.672 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48779.log: gzip -5 --verbose -- 88.5%/var/log/ceph/ceph-client.admin.45135.log -- replaced with /var/log/ceph/ceph-client.admin.48779.log.gz 2023-10-18T12:42:59.673 INFO:teuthology.orchestra.run.smithi114.stderr: 2023-10-18T12:42:59.673 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49146.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.49146.log.gz 2023-10-18T12:42:59.674 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43318.log 2023-10-18T12:42:59.675 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48838.log 2023-10-18T12:42:59.675 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45135.log.gz 2023-10-18T12:42:59.676 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43210.log 2023-10-18T12:42:59.676 INFO:teuthology.orchestra.run.smithi114.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.43318.log.gz 2023-10-18T12:42:59.677 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50858.log 2023-10-18T12:42:59.678 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48838.log.gz 2023-10-18T12:42:59.679 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43210.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43210.log.gz 2023-10-18T12:42:59.679 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48660.log 2023-10-18T12:42:59.680 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49084.log 2023-10-18T12:42:59.680 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50858.log.gz 2023-10-18T12:42:59.681 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48660.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48660.log.gz 2023-10-18T12:42:59.681 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41824.log 2023-10-18T12:42:59.682 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49615.log 2023-10-18T12:42:59.682 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49084.log.gz 2023-10-18T12:42:59.683 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41824.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41824.log.gz 2023-10-18T12:42:59.684 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45737.log 2023-10-18T12:42:59.684 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45629.log 2023-10-18T12:42:59.685 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49615.log.gz 2023-10-18T12:42:59.686 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45737.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45737.log.gz 2023-10-18T12:42:59.686 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49777.log 2023-10-18T12:42:59.687 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41987.log 2023-10-18T12:42:59.687 INFO:teuthology.orchestra.run.smithi114.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45629.log.gz 2023-10-18T12:42:59.688 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49777.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49777.log.gz 2023-10-18T12:42:59.689 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46164.log 2023-10-18T12:42:59.689 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45955.log 2023-10-18T12:42:59.690 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41987.log.gz 2023-10-18T12:42:59.691 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46164.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46164.log.gz 2023-10-18T12:42:59.691 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50241.log 2023-10-18T12:42:59.692 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46556.log 2023-10-18T12:42:59.692 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45955.log.gz 2023-10-18T12:42:59.693 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50241.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50241.log.gz 2023-10-18T12:42:59.693 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49642.log 2023-10-18T12:42:59.694 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43021.log 2023-10-18T12:42:59.694 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46556.log.gz 2023-10-18T12:42:59.695 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49642.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49642.log.gz 2023-10-18T12:42:59.696 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41770.log 2023-10-18T12:42:59.697 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43021.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-18T12:42:59.697 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43021.log.gz 2023-10-18T12:42:59.698 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41770.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41770.log.gz 2023-10-18T12:42:59.698 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44066.log 2023-10-18T12:42:59.699 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45027.log 2023-10-18T12:42:59.700 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44066.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44066.log.gz 2023-10-18T12:42:59.700 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-18T12:42:59.701 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44147.log 2023-10-18T12:42:59.702 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45027.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45027.log.gz 2023-10-18T12:42:59.702 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44887.log 2023-10-18T12:42:59.703 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44147.log: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.44147.log.gz 2023-10-18T12:42:59.703 INFO:teuthology.orchestra.run.smithi114.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.44311.log 2023-10-18T12:42:59.704 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44887.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44887.log.gz 2023-10-18T12:42:59.704 INFO:teuthology.orchestra.run.smithi114.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-18T12:42:59.705 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44528.log 2023-10-18T12:42:59.706 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44093.log 2023-10-18T12:42:59.706 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44311.log.gz 2023-10-18T12:42:59.707 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44528.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44528.log.gz 2023-10-18T12:42:59.707 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42346.log 2023-10-18T12:42:59.708 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44093.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44093.log.gz 2023-10-18T12:42:59.708 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45467.log 2023-10-18T12:42:59.710 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42615.log 2023-10-18T12:42:59.710 INFO:teuthology.orchestra.run.smithi114.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42346.log.gz 2023-10-18T12:42:59.711 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46845.log 2023-10-18T12:42:59.711 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45467.log.gz 2023-10-18T12:42:59.712 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42615.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42615.log.gz 2023-10-18T12:42:59.712 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49534.log 2023-10-18T12:42:59.713 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.46845.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46845.log.gz 2023-10-18T12:42:59.714 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41297.log 2023-10-18T12:42:59.714 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40994.log 2023-10-18T12:42:59.716 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49534.log.gz 2023-10-18T12:42:59.716 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41743.log 2023-10-18T12:42:59.716 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41297.log.gz 2023-10-18T12:42:59.717 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51074.log 2023-10-18T12:42:59.718 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40994.log.gz 2023-10-18T12:42:59.718 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41743.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41743.log.gz 2023-10-18T12:42:59.719 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45602.log 2023-10-18T12:42:59.721 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51074.log: 89.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.51074.log.gz-5 2023-10-18T12:42:59.721 INFO:teuthology.orchestra.run.smithi114.stderr:--verbose -- /var/log/ceph/ceph-client.admin.42607.log 2023-10-18T12:42:59.722 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44284.log 2023-10-18T12:42:59.723 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45602.log.gz 2023-10-18T12:42:59.723 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48539.log 2023-10-18T12:42:59.724 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42607.log.gz 2023-10-18T12:42:59.725 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44284.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44284.log.gz 2023-10-18T12:42:59.725 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49588.log 2023-10-18T12:42:59.726 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43102.log 2023-10-18T12:42:59.726 INFO:teuthology.orchestra.run.smithi114.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.48539.log.gz 2023-10-18T12:42:59.727 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49588.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49588.log.gz 2023-10-18T12:42:59.728 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50966.log 2023-10-18T12:42:59.729 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43102.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43102.log.gz 2023-10-18T12:42:59.729 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49997.log 2023-10-18T12:42:59.730 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50966.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50966.log.gz 2023-10-18T12:42:59.730 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48538.log 2023-10-18T12:42:59.731 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44039.log 2023-10-18T12:42:59.732 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49997.log.gz 2023-10-18T12:42:59.733 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48538.log: gzip -5 --verbose 88.7%-- -- replaced with /var/log/ceph/ceph-client.admin.48538.log.gz/var/log/ceph/ceph-client.admin.42940.log 2023-10-18T12:42:59.733 INFO:teuthology.orchestra.run.smithi114.stderr: 2023-10-18T12:42:59.734 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44039.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44039.log.gz 2023-10-18T12:42:59.734 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48904.log 2023-10-18T12:42:59.735 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42612.log 2023-10-18T12:42:59.735 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42940.log.gz 2023-10-18T12:42:59.736 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48904.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48904.log.gz 2023-10-18T12:42:59.736 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41378.log 2023-10-18T12:42:59.737 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51155.log 2023-10-18T12:42:59.738 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42612.log.gz 2023-10-18T12:42:59.738 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41378.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41378.log.gz 2023-10-18T12:42:59.739 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44420.log 2023-10-18T12:42:59.740 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48417.log 2023-10-18T12:42:59.740 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51155.log.gz 2023-10-18T12:42:59.741 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44420.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44420.log.gz 2023-10-18T12:42:59.742 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40811.log 2023-10-18T12:42:59.743 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45054.log 2023-10-18T12:42:59.743 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48417.log.gz 2023-10-18T12:42:59.744 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40811.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40811.log.gz 2023-10-18T12:42:59.745 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44338.log 2023-10-18T12:42:59.746 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45054.log: 87.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.45054.log.gz 2023-10-18T12:42:59.747 INFO:teuthology.orchestra.run.smithi114.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.50403.log 2023-10-18T12:42:59.747 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42994.log 2023-10-18T12:42:59.748 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44338.log.gz 2023-10-18T12:42:59.749 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42396.log 2023-10-18T12:42:59.749 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50403.log.gz 2023-10-18T12:42:59.750 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42994.log: gzip -5 --verbose -- 88.8%/var/log/ceph/ceph-client.admin.43291.log 2023-10-18T12:42:59.750 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42994.log.gz 2023-10-18T12:42:59.751 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42396.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42396.log.gz 2023-10-18T12:42:59.752 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42398.log 2023-10-18T12:42:59.753 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42382.log 2023-10-18T12:42:59.754 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43291.log.gz 2023-10-18T12:42:59.754 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42398.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-18T12:42:59.755 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42398.log.gz 2023-10-18T12:42:59.756 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43661.log 2023-10-18T12:42:59.756 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42382.log.gz 2023-10-18T12:42:59.757 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43958.log 2023-10-18T12:42:59.758 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43661.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43661.log.gz 2023-10-18T12:42:59.758 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50939.log 2023-10-18T12:42:59.760 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43958.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43958.log.gz 2023-10-18T12:42:59.760 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43904.log 2023-10-18T12:42:59.761 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51101.log 2023-10-18T12:42:59.761 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50939.log.gz 2023-10-18T12:42:59.763 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43904.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43904.log.gz 2023-10-18T12:42:59.763 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44201.log 2023-10-18T12:42:59.764 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48720.log 2023-10-18T12:42:59.765 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51101.log.gz 2023-10-18T12:42:59.766 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44201.log: 88.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.44201.log.gz 2023-10-18T12:42:59.766 INFO:teuthology.orchestra.run.smithi114.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.41797.log 2023-10-18T12:42:59.767 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48720.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.48720.log.gz 2023-10-18T12:42:59.767 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46850.log 2023-10-18T12:42:59.768 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41797.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41797.log.gz 2023-10-18T12:42:59.769 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48598.log 2023-10-18T12:42:59.770 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.46850.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46850.log.gz 2023-10-18T12:42:59.770 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41634.log 2023-10-18T12:42:59.771 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48598.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48598.log.gz 2023-10-18T12:42:59.771 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42392.log 2023-10-18T12:42:59.772 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51128.log 2023-10-18T12:42:59.773 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42392.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42392.log.gz 2023-10-18T12:42:59.774 INFO:teuthology.orchestra.run.smithi114.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.41634.log.gz 2023-10-18T12:42:59.775 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43526.log 2023-10-18T12:42:59.776 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51128.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51128.log.gz 2023-10-18T12:42:59.776 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41241.log 2023-10-18T12:42:59.777 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43526.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43526.log.gz 2023-10-18T12:42:59.778 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41459.log 2023-10-18T12:42:59.779 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45764.log 2023-10-18T12:42:59.779 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41241.log.gz 2023-10-18T12:42:59.780 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45273.log 2023-10-18T12:42:59.780 INFO:teuthology.orchestra.run.smithi114.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.41459.log.gz 2023-10-18T12:42:59.782 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45764.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45764.log.gzgzip 2023-10-18T12:42:59.782 INFO:teuthology.orchestra.run.smithi114.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.46610.log 2023-10-18T12:42:59.783 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45273.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45273.log.gz 2023-10-18T12:42:59.784 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49804.log 2023-10-18T12:42:59.785 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46610.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46610.log.gz 2023-10-18T12:42:59.785 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51234.log 2023-10-18T12:42:59.786 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49804.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49804.log.gz 2023-10-18T12:42:59.786 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50993.log 2023-10-18T12:42:59.787 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51234.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51234.log.gz 2023-10-18T12:42:59.788 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43796.log 2023-10-18T12:42:59.789 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50993.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50993.log.gz 2023-10-18T12:42:59.789 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49386.log 2023-10-18T12:42:59.790 INFO:teuthology.orchestra.run.smithi172.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-18T12:42:59.791 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45300.log 2023-10-18T12:42:59.792 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43796.log: /var/log/ceph/ceph-client.admin.49386.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43796.log.gz 2023-10-18T12:42:59.792 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49386.log.gz 2023-10-18T12:42:59.793 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46272.log 2023-10-18T12:42:59.793 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45300.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45300.log.gz 2023-10-18T12:42:59.794 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44779.log 2023-10-18T12:42:59.795 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46272.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30682.log 2023-10-18T12:42:59.795 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46272.log.gz 2023-10-18T12:42:59.797 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44779.log: gzip -5 --verbose -- 87.8%/var/log/ceph/ceph-client.admin.45219.log -- replaced with /var/log/ceph/ceph-client.admin.44779.log.gz 2023-10-18T12:42:59.797 INFO:teuthology.orchestra.run.smithi114.stderr: 2023-10-18T12:42:59.798 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph.tmp-client.admin.30682.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30682.log.gz 2023-10-18T12:42:59.798 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45494.log 2023-10-18T12:42:59.800 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43506.log 2023-10-18T12:42:59.800 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45219.log.gz 2023-10-18T12:42:59.801 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48356.log 2023-10-18T12:42:59.802 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45494.log.gz 2023-10-18T12:42:59.803 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.43506.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.43506.log.gz 2023-10-18T12:42:59.803 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49970.log 2023-10-18T12:42:59.804 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44230.log 2023-10-18T12:42:59.804 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48356.log.gz 2023-10-18T12:42:59.805 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49970.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49970.log.gz 2023-10-18T12:42:59.806 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44860.log 2023-10-18T12:42:59.807 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41324.log 2023-10-18T12:42:59.807 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44230.log.gz 2023-10-18T12:42:59.808 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44860.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44860.log.gz 2023-10-18T12:42:59.808 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44914.log 2023-10-18T12:42:59.809 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46380.log 2023-10-18T12:42:59.809 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41324.log.gz 2023-10-18T12:42:59.810 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44914.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44914.log.gz 2023-10-18T12:42:59.811 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43823.log 2023-10-18T12:42:59.812 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46583.log 2023-10-18T12:42:59.812 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46380.log.gz 2023-10-18T12:42:59.813 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43823.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43823.log.gz 2023-10-18T12:42:59.813 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49507.log 2023-10-18T12:42:59.814 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43850.log 2023-10-18T12:42:59.814 INFO:teuthology.orchestra.run.smithi114.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.46583.log.gz 2023-10-18T12:42:59.815 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49507.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49507.log.gz 2023-10-18T12:42:59.815 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47321.log 2023-10-18T12:42:59.816 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50912.log 2023-10-18T12:42:59.817 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43850.log.gz 2023-10-18T12:42:59.817 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47321.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.47321.log.gz 2023-10-18T12:42:59.818 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41270.log 2023-10-18T12:42:59.819 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50322.log 2023-10-18T12:42:59.819 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50912.log.gz 2023-10-18T12:42:59.820 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41270.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41270.log.gz 2023-10-18T12:42:59.820 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48964.log 2023-10-18T12:42:59.821 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50322.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50322.log.gz 2023-10-18T12:42:59.821 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50750.log 2023-10-18T12:42:59.822 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49561.log 2023-10-18T12:42:59.824 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48964.log: /var/log/ceph/ceph-client.admin.50750.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48964.log.gz 2023-10-18T12:42:59.824 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50750.log.gz 2023-10-18T12:42:59.825 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50669.log 2023-10-18T12:42:59.825 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49561.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49561.log.gz 2023-10-18T12:42:59.826 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42605.log 2023-10-18T12:42:59.827 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40873.log 2023-10-18T12:42:59.828 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50669.log: /var/log/ceph/ceph-client.admin.42605.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42605.log.gz 2023-10-18T12:42:59.828 INFO:teuthology.orchestra.run.smithi114.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50669.log.gz 2023-10-18T12:42:59.829 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41102.log 2023-10-18T12:42:59.830 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40873.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40873.log.gz 2023-10-18T12:42:59.830 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46527.log 2023-10-18T12:42:59.832 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47407.log 2023-10-18T12:42:59.832 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41102.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41102.log.gz 2023-10-18T12:42:59.833 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46527.log: gzip 87.8%-5 -- replaced with /var/log/ceph/ceph-client.admin.46527.log.gz 2023-10-18T12:42:59.834 INFO:teuthology.orchestra.run.smithi114.stderr:--verbose -- /var/log/ceph/ceph-client.admin.48719.log 2023-10-18T12:42:59.834 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47407.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.47407.log.gz 2023-10-18T12:42:59.835 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45327.log 2023-10-18T12:42:59.835 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48719.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48719.log.gz 2023-10-18T12:42:59.836 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49447.log 2023-10-18T12:42:59.837 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48661.log 2023-10-18T12:42:59.838 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45327.log.gz 2023-10-18T12:42:59.839 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49326.log 2023-10-18T12:42:59.839 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49447.log.gz 2023-10-18T12:42:59.840 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48661.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.48661.log.gz 2023-10-18T12:42:59.840 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49267.log 2023-10-18T12:42:59.841 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49326.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49326.log.gz 2023-10-18T12:42:59.841 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44636.log 2023-10-18T12:42:59.842 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49267.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49267.log.gz 2023-10-18T12:42:59.842 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42391.log 2023-10-18T12:42:59.844 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44636.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44636.log.gz 2023-10-18T12:42:59.844 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45192.log 2023-10-18T12:42:59.845 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46977.log 2023-10-18T12:42:59.846 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42391.log: /var/log/ceph/ceph-client.admin.45192.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45192.log.gz 2023-10-18T12:42:59.846 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42391.log.gz 2023-10-18T12:42:59.847 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47126.log 2023-10-18T12:42:59.848 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46977.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46977.log.gz 2023-10-18T12:42:59.848 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47194.log 2023-10-18T12:42:59.849 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46745.log 2023-10-18T12:42:59.849 INFO:teuthology.orchestra.run.smithi114.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.47126.log.gz 2023-10-18T12:42:59.850 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47194.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47194.log.gz 2023-10-18T12:42:59.851 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41405.log 2023-10-18T12:42:59.852 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42181.log 2023-10-18T12:42:59.853 INFO:teuthology.orchestra.run.smithi114.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.46745.log.gz 2023-10-18T12:42:59.853 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41405.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41405.log.gz 2023-10-18T12:42:59.854 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35625.log 2023-10-18T12:42:59.855 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49325.log 2023-10-18T12:42:59.855 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42181.log.gz 2023-10-18T12:42:59.856 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35625.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.35625.log.gz 2023-10-18T12:42:59.856 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43497.log 2023-10-18T12:42:59.857 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49943.log 2023-10-18T12:42:59.858 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49325.log.gz 2023-10-18T12:42:59.859 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.43497.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.43497.log.gz 2023-10-18T12:42:59.859 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45818.log 2023-10-18T12:42:59.860 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45000.log 2023-10-18T12:42:59.860 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49943.log.gz 2023-10-18T12:42:59.861 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46326.log 2023-10-18T12:42:59.862 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45818.log.gz 2023-10-18T12:42:59.863 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40840.log 2023-10-18T12:42:59.863 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45000.log.gz 2023-10-18T12:42:59.864 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44501.log 2023-10-18T12:42:59.864 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46326.log.gz 2023-10-18T12:42:59.865 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40840.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40840.log.gz 2023-10-18T12:42:59.865 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42616.log 2023-10-18T12:42:59.866 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44447.log 2023-10-18T12:42:59.866 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44501.log.gz 2023-10-18T12:42:59.867 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46950.log 2023-10-18T12:42:59.868 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42616.log.gz 2023-10-18T12:42:59.868 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44447.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44447.log.gz 2023-10-18T12:42:59.869 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-18T12:42:59.869 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41851.log 2023-10-18T12:42:59.870 INFO:teuthology.orchestra.run.smithi114.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46950.log.gz 2023-10-18T12:42:59.871 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48292.log 2023-10-18T12:42:59.872 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41851.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41851.log.gz 2023-10-18T12:42:59.872 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48416.log 2023-10-18T12:42:59.873 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-18T12:42:59.873 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35492.log 2023-10-18T12:42:59.874 INFO:teuthology.orchestra.run.smithi172.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-18T12:42:59.875 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48292.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48292.log.gz 2023-10-18T12:42:59.876 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48416.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48416.log.gz 2023-10-18T12:42:59.876 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48478.log 2023-10-18T12:42:59.876 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44555.log 2023-10-18T12:42:59.877 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35492.log.gz 2023-10-18T12:42:59.878 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44393.log 2023-10-18T12:42:59.878 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48478.log.gz 2023-10-18T12:42:59.878 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44555.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44555.log.gz 2023-10-18T12:42:59.879 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43156.log 2023-10-18T12:42:59.880 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42614.log 2023-10-18T12:42:59.880 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44393.log.gz 2023-10-18T12:42:59.881 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43156.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43156.log.gz 2023-10-18T12:42:59.881 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44833.log 2023-10-18T12:42:59.882 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47019.log 2023-10-18T12:42:59.883 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42614.log.gz 2023-10-18T12:42:59.883 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44833.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44833.log.gz 2023-10-18T12:42:59.883 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-18T12:42:59.884 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41510.log 2023-10-18T12:42:59.884 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47019.log.gz 2023-10-18T12:42:59.885 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48479.log 2023-10-18T12:42:59.886 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41510.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41510.log.gz 2023-10-18T12:42:59.886 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42100.log 2023-10-18T12:42:59.887 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49448.log 2023-10-18T12:42:59.888 INFO:teuthology.orchestra.run.smithi114.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.48479.log.gz 2023-10-18T12:42:59.889 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42100.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42100.log.gz 2023-10-18T12:42:59.889 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45386.log 2023-10-18T12:42:59.890 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49448.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49448.log.gz 2023-10-18T12:42:59.891 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35728.log 2023-10-18T12:42:59.892 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43877.log 2023-10-18T12:42:59.892 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45386.log.gz 2023-10-18T12:42:59.893 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.35728.log: gzip 88.7%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.35728.log.gz-- 2023-10-18T12:42:59.894 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45246.log 2023-10-18T12:42:59.895 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43877.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43877.log.gz 2023-10-18T12:42:59.895 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42127.log 2023-10-18T12:42:59.896 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42886.log 2023-10-18T12:42:59.897 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45246.log.gz 2023-10-18T12:42:59.898 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42127.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42127.log.gz 2023-10-18T12:42:59.898 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50557.log 2023-10-18T12:42:59.899 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42886.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42886.log.gz 2023-10-18T12:42:59.899 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43688.log 2023-10-18T12:42:59.900 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41716.log 2023-10-18T12:42:59.901 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50557.log.gz 2023-10-18T12:42:59.902 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44582.log 2023-10-18T12:42:59.903 INFO:teuthology.orchestra.run.smithi114.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.43688.log.gz 2023-10-18T12:42:59.904 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44744.log 2023-10-18T12:42:59.904 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41716.log.gz 2023-10-18T12:42:59.905 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43634.log 2023-10-18T12:42:59.906 INFO:teuthology.orchestra.run.smithi114.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44582.log.gz 2023-10-18T12:42:59.907 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44806.log 2023-10-18T12:42:59.907 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44744.log.gz 2023-10-18T12:42:59.908 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43634.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43634.log.gz 2023-10-18T12:42:59.909 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50106.log 2023-10-18T12:42:59.910 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44806.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.44806.log.gz-5 2023-10-18T12:42:59.910 INFO:teuthology.orchestra.run.smithi114.stderr:--verbose -- /var/log/ceph/ceph-client.admin.44120.log 2023-10-18T12:42:59.911 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50106.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50106.log.gz 2023-10-18T12:42:59.912 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41432.log 2023-10-18T12:42:59.913 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49385.log 2023-10-18T12:42:59.913 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44120.log.gz 2023-10-18T12:42:59.914 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41432.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41432.log.gz 2023-10-18T12:42:59.915 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50160.log 2023-10-18T12:42:59.916 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49385.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49385.log.gz 2023-10-18T12:42:59.916 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45899.log 2023-10-18T12:42:59.917 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50160.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50160.log.gzgzip 2023-10-18T12:42:59.918 INFO:teuthology.orchestra.run.smithi114.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.40939.log 2023-10-18T12:42:59.919 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42599.log 2023-10-18T12:42:59.919 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45899.log.gz 2023-10-18T12:42:59.920 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.40939.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40939.log.gz 2023-10-18T12:42:59.921 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49831.log 2023-10-18T12:42:59.922 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48293.log 2023-10-18T12:42:59.922 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42599.log.gz 2023-10-18T12:42:59.923 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49831.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49831.log.gz 2023-10-18T12:42:59.923 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.43614.log 2023-10-18T12:42:59.925 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48293.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48293.log.gz 2023-10-18T12:42:59.926 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45359.log 2023-10-18T12:42:59.926 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.2.43614.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.43614.log.gz 2023-10-18T12:42:59.927 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46082.log 2023-10-18T12:42:59.927 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45359.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45359.log.gz 2023-10-18T12:42:59.928 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48263.log 2023-10-18T12:42:59.929 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46082.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-18T12:42:59.930 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46082.log.gz 2023-10-18T12:42:59.931 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48263.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48263.log.gz 2023-10-18T12:42:59.931 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50214.log 2023-10-18T12:42:59.932 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42832.log 2023-10-18T12:42:59.934 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50214.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50214.log.gz 2023-10-18T12:42:59.934 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50696.log 2023-10-18T12:42:59.935 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50804.log 2023-10-18T12:42:59.936 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42832.log.gz 2023-10-18T12:42:59.937 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49145.log 2023-10-18T12:42:59.937 INFO:teuthology.orchestra.run.smithi114.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50696.log.gz 2023-10-18T12:42:59.938 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50804.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50804.log.gz 2023-10-18T12:42:59.939 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44941.log 2023-10-18T12:42:59.940 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41021.log 2023-10-18T12:42:59.940 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49145.log.gz 2023-10-18T12:42:59.942 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42859.log 2023-10-18T12:42:59.942 INFO:teuthology.orchestra.run.smithi114.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44941.log.gz 2023-10-18T12:42:59.943 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41021.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41021.log.gz 2023-10-18T12:42:59.943 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43931.log 2023-10-18T12:42:59.945 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46109.log 2023-10-18T12:42:59.945 INFO:teuthology.orchestra.run.smithi114.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42859.log.gz 2023-10-18T12:42:59.947 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51261.log 2023-10-18T12:42:59.947 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43931.log.gz 2023-10-18T12:42:59.948 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44257.log 2023-10-18T12:42:59.948 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46109.log.gz 2023-10-18T12:42:59.949 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42399.log 2023-10-18T12:42:59.949 INFO:teuthology.orchestra.run.smithi114.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51261.log.gz 2023-10-18T12:42:59.951 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.44257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42805.log 2023-10-18T12:42:59.951 INFO:teuthology.orchestra.run.smithi114.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44257.log.gz 2023-10-18T12:42:59.952 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46864.log 2023-10-18T12:42:59.953 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42399.log.gz 2023-10-18T12:42:59.954 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47051.log 2023-10-18T12:42:59.954 INFO:teuthology.orchestra.run.smithi114.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42805.log.gz 2023-10-18T12:42:59.955 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45521.log 2023-10-18T12:42:59.955 INFO:teuthology.orchestra.run.smithi114.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46864.log.gz 2023-10-18T12:42:59.957 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50349.log 2023-10-18T12:42:59.957 INFO:teuthology.orchestra.run.smithi114.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47051.log.gz 2023-10-18T12:42:59.958 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46218.log 2023-10-18T12:42:59.958 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45521.log.gz 2023-10-18T12:42:59.959 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43129.log 2023-10-18T12:42:59.960 INFO:teuthology.orchestra.run.smithi114.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50349.log.gz 2023-10-18T12:42:59.961 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50051.log 2023-10-18T12:42:59.961 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46218.log.gz 2023-10-18T12:42:59.962 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46353.log 2023-10-18T12:42:59.963 INFO:teuthology.orchestra.run.smithi114.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43129.log.gz 2023-10-18T12:42:59.964 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51047.log 2023-10-18T12:42:59.964 INFO:teuthology.orchestra.run.smithi114.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50051.log.gz 2023-10-18T12:42:59.966 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47258.log 2023-10-18T12:42:59.966 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46353.log.gz 2023-10-18T12:42:59.967 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.51047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43264.log 2023-10-18T12:42:59.967 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51047.log.gz 2023-10-18T12:42:59.968 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46796.log 2023-10-18T12:42:59.969 INFO:teuthology.orchestra.run.smithi114.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.47258.log.gz 2023-10-18T12:42:59.970 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47257.log 2023-10-18T12:42:59.970 INFO:teuthology.orchestra.run.smithi114.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43264.log.gz 2023-10-18T12:42:59.971 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43742.log 2023-10-18T12:42:59.971 INFO:teuthology.orchestra.run.smithi114.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46796.log.gz 2023-10-18T12:42:59.973 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.47257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45683.log 2023-10-18T12:42:59.973 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47257.log.gz 2023-10-18T12:42:59.974 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43742.log: 88.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.43742.log.gz 2023-10-18T12:42:59.975 INFO:teuthology.orchestra.run.smithi114.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.50831.log 2023-10-18T12:42:59.976 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42041.log 2023-10-18T12:42:59.976 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45683.log.gz 2023-10-18T12:42:59.977 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48965.log 2023-10-18T12:42:59.978 INFO:teuthology.orchestra.run.smithi114.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50831.log.gz 2023-10-18T12:42:59.979 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45108.log 2023-10-18T12:42:59.979 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42041.log.gz 2023-10-18T12:42:59.981 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.48965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42967.log 2023-10-18T12:42:59.981 INFO:teuthology.orchestra.run.smithi114.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48965.log.gz 2023-10-18T12:42:59.982 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.45108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43385.log 2023-10-18T12:42:59.982 INFO:teuthology.orchestra.run.smithi114.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45108.log.gz 2023-10-18T12:42:59.983 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42913.log 2023-10-18T12:42:59.984 INFO:teuthology.orchestra.run.smithi114.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42967.log.gz 2023-10-18T12:42:59.985 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.43385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41129.log 2023-10-18T12:42:59.985 INFO:teuthology.orchestra.run.smithi114.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43385.log.gz 2023-10-18T12:42:59.986 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41158.log 2023-10-18T12:42:59.987 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42913.log.gz 2023-10-18T12:42:59.987 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41129.log: gzip 88.6%-5 -- replaced with /var/log/ceph/ceph-client.admin.41129.log.gz--verbose 2023-10-18T12:42:59.988 INFO:teuthology.orchestra.run.smithi114.stderr:-- /var/log/ceph/ceph-client.admin.49674.log 2023-10-18T12:42:59.989 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42154.log 2023-10-18T12:42:59.990 INFO:teuthology.orchestra.run.smithi114.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41158.log.gz 2023-10-18T12:42:59.990 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.49674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41048.log 2023-10-18T12:42:59.991 INFO:teuthology.orchestra.run.smithi114.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49674.log.gz 2023-10-18T12:42:59.992 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.42154.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-18T12:42:59.993 INFO:teuthology.orchestra.run.smithi114.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42154.log.gz 2023-10-18T12:42:59.993 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.41048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50530.log 2023-10-18T12:42:59.994 INFO:teuthology.orchestra.run.smithi114.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.41048.log.gz 2023-10-18T12:42:59.995 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46016.log 2023-10-18T12:42:59.997 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.50530.log: gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50530.log.gz-5 2023-10-18T12:42:59.997 INFO:teuthology.orchestra.run.smithi114.stderr:--verbose -- /var/log/ceph/ceph-client.admin.46438.log 2023-10-18T12:42:59.998 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46016.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46016.log.gz 2023-10-18T12:42:59.999 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.46438.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46438.log.gz 2023-10-18T12:43:00.105 INFO:teuthology.orchestra.run.smithi172.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-18T12:43:00.420 INFO:teuthology.orchestra.run.smithi114.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-18T12:43:00.842 INFO:teuthology.orchestra.run.smithi172.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-10-18T12:43:00.859 INFO:teuthology.orchestra.run.smithi172.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-10-18T12:43:00.879 INFO:teuthology.orchestra.run.smithi172.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-10-18T12:43:00.898 INFO:teuthology.orchestra.run.smithi172.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-10-18T12:43:00.902 INFO:teuthology.orchestra.run.smithi172.stderr: 2023-10-18T12:43:00.902 INFO:teuthology.orchestra.run.smithi172.stderr:real 0m1.394s 2023-10-18T12:43:00.903 INFO:teuthology.orchestra.run.smithi172.stderr:user 0m5.921s 2023-10-18T12:43:00.903 INFO:teuthology.orchestra.run.smithi172.stderr:sys 0m0.588s 2023-10-18T12:43:00.916 INFO:teuthology.orchestra.run.smithi114.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-18T12:43:01.141 INFO:teuthology.orchestra.run.smithi114.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-18T12:43:01.247 INFO:teuthology.orchestra.run.smithi114.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-18T12:43:01.310 INFO:teuthology.orchestra.run.smithi114.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-18T12:43:01.314 INFO:teuthology.orchestra.run.smithi114.stderr: 2023-10-18T12:43:01.314 INFO:teuthology.orchestra.run.smithi114.stderr:real 0m1.844s 2023-10-18T12:43:01.314 INFO:teuthology.orchestra.run.smithi114.stderr:user 0m6.008s 2023-10-18T12:43:01.315 INFO:teuthology.orchestra.run.smithi114.stderr:sys 0m1.156s 2023-10-18T12:43:01.316 INFO:tasks.ceph:Archiving logs... 2023-10-18T12:43:01.316 DEBUG:teuthology.misc:Transferring archived files from smithi114:/var/log/ceph to /home/teuthworker/archive/dparmar-2023-10-18_11:50:16-fs:functional-wip-63105-distro-default-smithi/7431514/remote/smithi114/log 2023-10-18T12:43:01.318 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-18T12:43:02.387 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/log/ceph to /home/teuthworker/archive/dparmar-2023-10-18_11:50:16-fs:functional-wip-63105-distro-default-smithi/7431514/remote/smithi172/log 2023-10-18T12:43:02.388 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-18T12:43:03.209 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-18T12:43:03.218 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-18T12:43:03.219 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-18T12:43:03.226 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-18T12:43:03.319 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-18T12:43:03.328 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-18T12:43:03.329 DEBUG:teuthology.orchestra.run.smithi114:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-18T12:43:03.336 DEBUG:teuthology.orchestra.run.smithi172:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-18T12:43:03.368 INFO:teuthology.orchestra.run.smithi114.stdout: remote refid st t when poll reach delay offset jitter 2023-10-18T12:43:03.369 INFO:teuthology.orchestra.run.smithi114.stdout:============================================================================== 2023-10-18T12:43:03.369 INFO:teuthology.orchestra.run.smithi114.stdout:+hv01.front.sepi 67.205.162.81 3 u 1 64 377 0.117 -2.351 0.136 2023-10-18T12:43:03.370 INFO:teuthology.orchestra.run.smithi114.stdout:*hv02.front.sepi 63.231.80.2 3 u 61 64 377 0.094 2.371 0.164 2023-10-18T12:43:03.370 INFO:teuthology.orchestra.run.smithi114.stdout:+hv03.front.sepi 74.6.168.72 3 u 56 64 377 0.106 1.873 0.366 2023-10-18T12:43:03.370 INFO:teuthology.orchestra.run.smithi114.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 0.000 0.000 2023-10-18T12:43:03.382 INFO:teuthology.orchestra.run.smithi172.stdout: remote refid st t when poll reach delay offset jitter 2023-10-18T12:43:03.383 INFO:teuthology.orchestra.run.smithi172.stdout:============================================================================== 2023-10-18T12:43:03.383 INFO:teuthology.orchestra.run.smithi172.stdout:+hv01.front.sepi 67.205.162.81 3 u 45 128 377 0.123 -2.741 0.159 2023-10-18T12:43:03.383 INFO:teuthology.orchestra.run.smithi172.stdout:*hv02.front.sepi 63.231.80.2 3 u 109 128 377 0.117 1.876 0.167 2023-10-18T12:43:03.384 INFO:teuthology.orchestra.run.smithi172.stdout:+hv03.front.sepi 74.6.168.72 3 u 41 128 377 0.124 1.153 0.221 2023-10-18T12:43:03.384 INFO:teuthology.orchestra.run.smithi172.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 0.000 0.000 2023-10-18T12:43:03.386 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-18T12:43:03.395 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-18T12:43:03.396 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-18T12:43:03.405 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-18T12:43:03.418 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-18T12:43:03.433 INFO:teuthology.task.internal:Duration was 2178.897475 seconds 2023-10-18T12:43:03.433 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-18T12:43:03.446 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-18T12:43:03.447 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-18T12:43:03.455 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-18T12:43:03.617 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-18T12:43:03.618 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi114.front.sepia.ceph.com 2023-10-18T12:43:03.618 DEBUG:teuthology.orchestra.run.smithi114:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-18T12:43:03.656 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi172.front.sepia.ceph.com 2023-10-18T12:43:03.657 DEBUG:teuthology.orchestra.run.smithi172:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-18T12:43:03.694 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-18T12:43:03.695 DEBUG:teuthology.orchestra.run.smithi114:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-18T12:43:03.710 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-18T12:43:03.804 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-18T12:43:03.804 DEBUG:teuthology.orchestra.run.smithi114:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-18T12:43:03.812 DEBUG:teuthology.orchestra.run.smithi172:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-18T12:43:03.915 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-18T12:43:03.925 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-18T12:43:03.926 DEBUG:teuthology.orchestra.run.smithi114:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-18T12:43:03.962 DEBUG:teuthology.orchestra.run.smithi172:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-18T12:43:04.000 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-18T12:43:04.010 DEBUG:teuthology.orchestra.run.smithi114:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-18T12:43:04.017 DEBUG:teuthology.orchestra.run.smithi172:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-18T12:43:04.044 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern = core 2023-10-18T12:43:04.078 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = core 2023-10-18T12:43:04.109 DEBUG:teuthology.orchestra.run.smithi114:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-18T12:43:04.141 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T12:43:04.142 DEBUG:teuthology.orchestra.run.smithi172:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-18T12:43:04.170 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-18T12:43:04.170 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-18T12:43:04.181 INFO:teuthology.task.internal:Transferring archived files... 2023-10-18T12:43:04.182 DEBUG:teuthology.misc:Transferring archived files from smithi114:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/dparmar-2023-10-18_11:50:16-fs:functional-wip-63105-distro-default-smithi/7431514/remote/smithi114 2023-10-18T12:43:04.182 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-18T12:43:04.232 DEBUG:teuthology.misc:Transferring archived files from smithi172:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/dparmar-2023-10-18_11:50:16-fs:functional-wip-63105-distro-default-smithi/7431514/remote/smithi172 2023-10-18T12:43:04.232 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-18T12:43:04.274 INFO:teuthology.task.internal:Removing archive directory... 2023-10-18T12:43:04.274 DEBUG:teuthology.orchestra.run.smithi114:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-18T12:43:04.282 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-18T12:43:04.337 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-18T12:43:04.349 INFO:teuthology.task.internal:Not uploading archives. 2023-10-18T12:43:04.349 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-18T12:43:04.359 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-18T12:43:04.360 DEBUG:teuthology.orchestra.run.smithi114:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-18T12:43:04.367 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-18T12:43:04.384 INFO:teuthology.orchestra.run.smithi114.stdout: 1048600 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 18 12:43 /home/ubuntu/cephtest 2023-10-18T12:43:04.408 INFO:teuthology.orchestra.run.smithi172.stdout: 1048602 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 18 12:43 /home/ubuntu/cephtest 2023-10-18T12:43:04.414 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-18T12:43:04.424 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-18T12:43:04.447 INFO:teuthology.nuke:Checking targets against current locks 2023-10-18T12:43:04.473 DEBUG:teuthology.nuke:shortname: smithi114 2023-10-18T12:43:04.473 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-18T12:43:04.498 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi114.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-10-18_11:50:16-fs:functional-wip-63105-distro-default-smithi/7431514', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-18 11:56:19.502721', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-18T12:43:04.502 DEBUG:teuthology.nuke:shortname: smithi172 2023-10-18T12:43:04.502 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-18T12:43:04.527 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-10-18_11:50:16-fs:functional-wip-63105-distro-default-smithi/7431514', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-18 11:56:19.504155', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-18T12:43:04.554 INFO:teuthology.orchestra.console.smithi114:Power off 2023-10-18T12:43:04.555 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-18T12:43:04.571 INFO:teuthology.orchestra.console.smithi172:Power off 2023-10-18T12:43:04.572 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-18T12:43:04.581 DEBUG:teuthology.orchestra.console.smithi114:power off output: Chassis Power Control: Down/Off 2023-10-18T12:43:04.582 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T12:43:04.594 DEBUG:teuthology.orchestra.console.smithi172:power off output: Chassis Power Control: Down/Off 2023-10-18T12:43:04.594 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T12:43:04.603 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on 2023-10-18T12:43:04.615 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2023-10-18T12:43:08.605 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T12:43:08.616 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T12:43:08.716 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on 2023-10-18T12:43:08.726 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2023-10-18T12:43:12.719 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T12:43:12.727 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T12:43:12.830 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off 2023-10-18T12:43:12.838 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2023-10-18T12:43:12.931 INFO:teuthology.orchestra.console.smithi114:Power off completed 2023-10-18T12:43:12.940 INFO:teuthology.orchestra.console.smithi172:Power off completed 2023-10-18T12:43:13.045 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 47672119149b103ec7cec2cc65c063ccbb001ac7 client.1-kernel-sha1: 47672119149b103ec7cec2cc65c063ccbb001ac7 description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-recovery} duration: 2178.8974752426147 failure_reason: 'Test failure: test_client_eviction_if_config_is_set (tasks.cephfs.test_client_recovery.TestClientOnLaggyOSD)' flavor: default owner: scheduled_dparmar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=0e88186871bc4939bc83b9b33f5f6d21 status: fail success: false 2023-10-18T12:43:13.045 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T12:43:13.119 INFO:teuthology.run:FAIL